Windows ML will tap your PC hardware to smarten up Windows 10 apps with AI

Windows ML is part of Microsoft's bid to add artificial intelligence to your devices.

Ever since the debut of Cortana within Windows 10, Microsoft has tried to inject Windows with artificial intelligence. Now it’s getting even more serious with a new API, called Windows ML, that will tap your CPU or GPU to make Windows and its apps even smarter.

Windows ML will debut within the “next major update to Windows 10,” presumably the “Redstone 4” update set to be released to hardware partners this month. Since it’s an API, every developer who writes apps for Windows will be able to take advantage of the new AI capabilities.

In the future, Microsoft said, Windows ML might even take advantage of an entirely new chip: a machine vision or visual processing chip designed by a subsidiary of Intel, called Movidius. Microsoft said that it is working closely with Movidius to support its 2485 VPU Accelerator, which could work in conjunction with or simply replace today’s webcams.

windows ml jabil circuit examination Microsoft

A practical use of Windows ML would be to visually inspect circuit boards for defects, Microsoft said.

What this means for you: On one hand, this seems like a smart, evolutionary step for Microsoft. You can search your Photos app for “beach” pictures, for example, or identify faces. And Cortana offers up suggestions about when to leave for appointments. But allowing developers to inject their own ideas makes even more sense. On the other hand, Microsoft will probably have to placate user groups like gamers, who will worry about Windows robbing their GPU of resources while playing a game.

Evolving Windows to make it smarter

“In Windows we already use AI in a broad set of ways,” said Kam VedBrat, a group program manager with Microsoft, who explained Windows ML during a Microsoft developer day webcast. “We use it for handwriting recognition, isolate security threats, and to power services like Cortana... So how do we think about bringing AI to Windows scale?”

windows ml guy holds movidius chip Microsoft

Kam VedBrat, a group program manager with Microsoft, holds up the Movidius chip.

The answer appears to be a combination of local processing and sending data back up into Microsoft’s Azure cloud for processing. VedBrat said that in certain situations, data sets would be too large or too expensive to send back to Microsoft; in others, the device might simply have an active data connection. In that case, he said, the device should be able to supply the AI processing power itself. 

“When you use AI in Windows devices, you get immediate results,” VedBrat said. “Windows uses the hardware capabilities on the devices to deliver great performances with low latency.”

windows ml dxdiag movidius Microsoft

VedBrat also supplied this Windows dxdiag screen to show the Movidius chip in action.

Windows ML will have the capability to use both the CPU as well as the GPU, with support for advanced CPU instruction sets like Intel’s AVX512. As a demonstration, VedBrat showed how a CPU could be used to manipulate an static image, giving it an arty, candy-like appearance (seen at the top of this page). But when the app was run on a Surface Book’s internal GPU, that app was able to apply the same filter to live video captured by the Book’s camera, though at low frame rates.

In the future, Microsoft hopes to bring ML capabilities to devices like the Movidius visual processor, a version of which Intel hopes will power tomorrow’s self-driving cars. Intel supplied one of the first RealSense depth cameras for the PC, which evolved into the Windows Hello-branded biometric recognition cameras that have become somewhat common on today’s PCs.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags Microsoft

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.
Mark Hachman

Mark Hachman

PC World (US online)
Show Comments

Cool Tech

Toys for Boys

Family Friendly

Stocking Stuffer

SmartLens - Clip on Phone Camera Lens Set of 3

Learn more >

Christmas Gift Guide

Click for more ›

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Aysha Strobbe

Microsoft Office 365/HP Spectre x360

Microsoft Office continues to make a student’s life that little bit easier by offering reliable, easy to use, time-saving functionality, while continuing to develop new features that further enhance what is already a formidable collection of applications

Michael Hargreaves

Microsoft Office 365/Dell XPS 15 2-in-1

I’d recommend a Dell XPS 15 2-in-1 and the new Windows 10 to anyone who needs to get serious work done (before you kick back on your couch with your favourite Netflix show.)

Maryellen Rose George

Brother PT-P750W

It’s useful for office tasks as well as pragmatic labelling of equipment and storage – just don’t get too excited and label everything in sight!

Cathy Giles

Brother MFC-L8900CDW

The Brother MFC-L8900CDW is an absolute stand out. I struggle to fault it.

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?