Google has a new chip that makes machine learning way faster

The new Tensor Processing Unit is a major leap forward for intelligent applications

Google has taken a big leap forward with the speed of its machine learning systems by creating its own custom chip that it's been using for over a year.

The company was rumored to have been designing its own chip, based partly on job ads it posted in recent years. But until today it had kept the effort largely under wraps.

It calls the chip a Tensor Processing Unit, or TPU, named after the TensorFlow software it uses for its machine learning programs. In a blog post, Google engineer Norm Jouppi refers to it as an accelerator chip, which means it speeds up a specific task.

At its I/O conference Wednesday, CEO Sundar Pichai said the TPU provides an order of magnitude better performance per watt than existing chips for machine learning tasks. It's not going to replace CPUs and GPUs but it can speed up machine learning processes without consuming a lot more more energy.

As machine learning becomes more widely used in all types of applications, from voice recognition to language translation and and data analytics, having a chip that speeds those workloads is essential to maintaining the pace of advancements.

And as Moore's Law slows down, reducing the gains from each new generation of processor, using accelerators for key tasks becomes even more important. Google says its TPU provides the equivalent gains to moving Moore's Law forward by three generations, or about seven years.

The TPU is in production use across Google's cloud, including powering the RankBrain search result sorting system and Google's voice recognition services. When developers pay to use the Google Voice Recognition Service, they're using its TPUs.

Urs Hölzle, Google's senior vice president for technical infrastructure, said during a press conference at I/O that the TPU can augment machine learning processes but that there are still functions that require CPUs and GPUs.

Google started developing the TPU about two years ago, he said.

Right now, Google has thousands of the chips in use. They're able to fit in the same slots used for hard drives in Google's data center racks, which means the company can easily deploy more of them if it needs to.

Right now, though, Hölzle says that they don't need to have a TPU in every rack just yet.

If there's one thing that Google likely won't do, it's sell TPUs as standalone hardware. Asked about that possibility, Google enterprise chief Diane Greene said that the company isn't planning to sell them for other companies to use.

Part of that has to do with the way application development is heading -- developers are building more and more applications in the cloud only, and don't want to worry about managing hardware configurations, maintenance and updates.

Another possible reason is that Google simply doesn't want to give its rivals access to the chips, which it likely spent a lot of time and money developing.

We don't yet know what exactly the TPU is best used for. Analyst Patrick Moorhead said he expects the chip will be used for inferencing, a part of machine learning operations that doesn't require as much flexibility.

Right now, that's all Google is saying. We still don't know which chip manufacturer is building the silicon for Google. Holzle said that the company will reveal more about the chip in a paper to be released this fall.

Join the PC World newsletter!

Error: Please check your email address.

Tags Google I/O 2016Google

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Blair Hanley Frank

IDG News Service
Show Comments

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?