Home » Tech

Google will put mini-TPUs into upcoming cellphones

19 May, 2017, 06:17 | Author: Nadine Todd
  • Google will put mini-TPUs into upcoming cellphones

At Google I/O today, Google CEO Sundar Pichai provided an update on next generation of the custom-made Tensor Processing Units (TPU) which Google uses power its Google Compute Engine. The company's latest large language-translation models take a full day to train on 32 of the current top-end GPUs.

These maneuvers could complicate Google's relationship with Nvidia, which called out the cloud computing firm as a customer in its annual report.

At the same time, chip suppliers are pouring billions of dollars to stay ahead of the machine learning demands of cloud companies like Google and Microsoft, which has also devised custom chips for data centers.

Little was known about tensor processing units made by Google especially for machine learning until last month, when 75 co-authors published a paper about the chip. The four-processor board is described as a machine-learning "accelerator" that can be accessed from the cloud and used to train machine-learning models.

Google isn't the only company investing in hardware to help with machine learning.

So how do Google's new Cloud TPUs perform?

According to Google, the chip can achieve 180 teraflops of floating-point performance, which is six times more than Nvidia's latest Tesla V100 accelerator for FP16 half-precision computation. A TPU pod contains 64 TPUs and provides up to 11.5 petaflops. "While one eighth of a TPU pod can do the job in an afternoon". Training, on the other hand, is how an AI algorithm is developed, and that takes exceptional resources.

That means that you can build a machine learning model - for example, to correctly identify an object in a photo is a tree, a auto or a cat. This has manifested itself in a number of different consumer products, like Google Translate's near-instantaneous ability to turn an English sentence into its Mandarin counterpart or AlphaGo's ability to play the deep, chess-like board game with superhuman proficiency. These training systems, in the more general sense, improve AI software through massive number crunching. "You can run inference on a single chip, but for training, you need to think more holistically".

Jeff Dean, a senior fellow for Google Brain, told reporters this week that Google is still using CPUs and GPUs to train some machine learning models.

These newer processing units are capable of doing both inference and training, and researchers can deploy more versatile AI experiments at a faster rate than before just as long as the software is built using TensorFlow.

In a post on its website, Google noted "While our first TPU was created to run machine learning models quickly ... training a machine is more hard than running it and days or weeks of computation on the best available CPUs and GPUs are commonly required to reach state of the art levels of accuracy".


  • Kuwait Joins Saudis, Russia to Seek Oil-Cuts Extension Into 2018

    Kuwait Joins Saudis, Russia to Seek Oil-Cuts Extension Into 2018

    World oil prices jumped on Monday, with US crude futures trading 3% firmer at more than $49 a barrel. The contract rose $1.01 to close at $48.85 a barrel on Monday, the highest since April 28.
    USA  expresses concern after Erdogan visit violence

    USA expresses concern after Erdogan visit violence

    Necmi said he and a group of other Turkish individuals came to Washington exclusively to "welcome the Turkish president". The government has faced a resurgent threat from militant groups, including the Islamic State and the PKK.

    Zidane remains calm with Madrid one point away from the title

    Here is everything you need to know about their clash with Eibar. "We have to keep going until the end". What do Barcelona have to do to win La Liga?
  • Google announces standalone Daydream VR headsets

    The Google I/O 2017 is now happening in Mountain View, California and has already racked up more than its fair share of eyebrows. This is enabled by sensors on the outside of the device, aiming to help you feel like you're actually in the virtual world.

    Horgan holds hope he will be BC premier

    Horgan was asked for his response to the Vancouver Sun and other major publications' endorsements for the B.C. An erroneous story appeared on a TV station website that described Weaver as preferring to work with the B.C.
    Severe weather forecast later Thursday

    Severe weather forecast later Thursday

    UPDATE 4:27 p.m. - The National Weather Service has issues a tornado watch for Cleveland County until 8 p.m. A chance of severe weather exists for the KVOE listening area late Tuesday afternoon into the evening.
  • John Terry has made most of season on periphery at Chelsea

    John Terry has made most of season on periphery at Chelsea

    Nevertheless, Terry has now fuelled speculation he could end his career altogether once his time at Chelsea comes to an end. Kanu played 23 league games, a lot of them as a substitute and scored three goals as Arsenal won the league title.
    Donegal's Minister pays tribute to Taoiseach Kenny

    Donegal's Minister pays tribute to Taoiseach Kenny

    Kenny has led the party since 2002. "I want to see who will negotiate the best deal for Ireland on Brexit", she said. Ms Connell praised Mr Kenny saying he had a "massive impact" in Ireland over the past 15 years.
    MS-13 gang targeted in sweep across Los Angeles

    MS-13 gang targeted in sweep across Los Angeles

    They force new members to endure a 13-second beating known as "jumping in", Los Angeles authorities told CNN . Molina is charged with murder in the death of a man on September 27, 2015, on a street in North Hollywood.
  • Senate chairman: Flynn has not responded to subpoena

    Senate chairman: Flynn has not responded to subpoena

    The committee is one of several on Capitol Hill investigating possible collusion between Russian Federation and President Donald Trump's 2016 campaign.

    Len McCluskey 'confident' that opinion polls will start to turn for Labour

    Labour government would "immediately guarantee" existing rights for all European Union nationals in Britain. The Conservatives immediately slammed the plan as "nonsensical" and not properly costed.

    Trump taped phone calls at NYC office before presidency

    Hudson, a Bush appointee who struck down the centerpiece of the Obama administration's health care law in 2010. Trump is considering, a group that includes several lawmakers, attorneys and law enforcement officials.


A&Es 'fully open' again — NHS cyber attack
The home secretary said most NHS systems were back to normal after the cyber attack that left the service crippled. Major pharmacy chains organise a co-ordinated response to NHS cyber attack, based on instant information sharing.

Google partners Qualcomm To Develop Daydream VR Headset
The company has reportedly been working on the stand-alone VR system for more than a year now. Google's using what it's learned from its Daydream VR effort to build standalone headsets.

How Arsenal can still make the top four: All the permutations
Leicester, who won the title last season, are now 11th with two games left and end their season at home to Bournemouth, in tenth. Simon Mignolet has kept three clean sheets in a row, and I think he'll add another on Sunday. "Now it is better".

Man City 3-1 West Brom: Pep's men unbeaten in seven
Manchester City manager Pep Guardiola has not had the simplest introduction to life in the Premier League. Aguero has scored 31 goals in all competitions and is enjoying one of his most prolific seasons at City.

Labour faces 'historic' task to win power, Corbyn admits
By 9pm on Friday, with all of the results in, the Tories had gained 563 seats while Labour had lost 382. The weekend will probably be much more bearable for these two than the rest of the party leaders.