Google will put mini-TPUs into upcoming cellphones
19 May, 2017, 06:17 | Author: Nadine Todd
At Google I/O today, Google CEO Sundar Pichai provided an update on next generation of the custom-made Tensor Processing Units (TPU) which Google uses power its Google Compute Engine. The company's latest large language-translation models take a full day to train on 32 of the current top-end GPUs.
These maneuvers could complicate Google's relationship with Nvidia, which called out the cloud computing firm as a customer in its annual report.
At the same time, chip suppliers are pouring billions of dollars to stay ahead of the machine learning demands of cloud companies like Google and Microsoft, which has also devised custom chips for data centers.
Little was known about tensor processing units made by Google especially for machine learning until last month, when 75 co-authors published a paper about the chip. The four-processor board is described as a machine-learning "accelerator" that can be accessed from the cloud and used to train machine-learning models.
Google isn't the only company investing in hardware to help with machine learning.
According to Google, the chip can achieve 180 teraflops of floating-point performance, which is six times more than Nvidia's latest Tesla V100 accelerator for FP16 half-precision computation. A TPU pod contains 64 TPUs and provides up to 11.5 petaflops. "While one eighth of a TPU pod can do the job in an afternoon". Training, on the other hand, is how an AI algorithm is developed, and that takes exceptional resources.
That means that you can build a machine learning model - for example, to correctly identify an object in a photo is a tree, a auto or a cat. This has manifested itself in a number of different consumer products, like Google Translate's near-instantaneous ability to turn an English sentence into its Mandarin counterpart or AlphaGo's ability to play the deep, chess-like board game with superhuman proficiency. These training systems, in the more general sense, improve AI software through massive number crunching. "You can run inference on a single chip, but for training, you need to think more holistically".
Jeff Dean, a senior fellow for Google Brain, told reporters this week that Google is still using CPUs and GPUs to train some machine learning models.
These newer processing units are capable of doing both inference and training, and researchers can deploy more versatile AI experiments at a faster rate than before just as long as the software is built using TensorFlow.
In a post on its website, Google noted "While our first TPU was created to run machine learning models quickly ... training a machine is more hard than running it and days or weeks of computation on the best available CPUs and GPUs are commonly required to reach state of the art levels of accuracy".
The home secretary said most NHS systems were back to normal after the cyber attack that left the service crippled. Major pharmacy chains organise a co-ordinated response to NHS cyber attack, based on instant information sharing.
The requests by USA intelligence officials cast doubt on the assertion by the president's aides that the sharing was appropriate. President Donald Trump meets with Russian Foreign Minister Sergey Lavrov in the Oval Office of the White House in Washington .
By 9pm on Friday, with all of the results in, the Tories had gained 563 seats while Labour had lost 382. The weekend will probably be much more bearable for these two than the rest of the party leaders.
Leicester, who won the title last season, are now 11th with two games left and end their season at home to Bournemouth, in tenth. Simon Mignolet has kept three clean sheets in a row, and I think he'll add another on Sunday. "Now it is better".
But in between came a properly enjoyable race which highlighted how much better F1 is with a resurgent Ferrari. He blocked me, in the end I managed to get past, but by then I had lost an terrible lot of time.
House and Senate committees have immediately - and rightly - requested copies of the memos related to this controversy. Asked on his way out of the news conference whether he still retained confidence in Trump, Ryan replied: "I do".
Nevertheless, Terry has now fuelled speculation he could end his career altogether once his time at Chelsea comes to an end. Kanu played 23 league games, a lot of them as a substitute and scored three goals as Arsenal won the league title.
Manchester City manager Pep Guardiola has not had the simplest introduction to life in the Premier League. Aguero has scored 31 goals in all competitions and is enjoying one of his most prolific seasons at City.
The 30-year-old Wisconsin native is a model and owner of Worth Personal Training . "The production really fell in love with her". Lindsay believes it is best if she takes the direct approach in her journey to find love in " The Bachelorette " season 13.
Severe weather forecast later Thursday
UPDATE 4:27 p.m. - The National Weather Service has issues a tornado watch for Cleveland County until 8 p.m. A chance of severe weather exists for the KVOE listening area late Tuesday afternoon into the evening.
Arsenal fighting to stave off Champions League 'disappointment'
The trio has been fantastic for Tottenham this season which saw them finish second, their highest league finish in their history. Leicester, who won the title last season, are now 11th with two games left and end their season at home to Bournemouth, in tenth.