Microsoft shows impressively accurate hand-tracking system for VR

Handpose could take virtual reality and robotics control to new levels

Virtual reality has come a long way: put on a headset and you can peer into an alien world or feel like you're laying on a beach in Jamaica. But interacting with that world -- reaching out your hand to pick up a virtual object on the screen -- still has a long way to go.

Researchers at Microsoft said Friday they've brought that capability a bit closer, with an accurate and flexible hand-tracking system called Handpose that uses a standard Xbox One Kinect without any hardware modifications.

The system uses the depth camera and software developed by the researchers to track movements of your hand and fingers and transfer them to the screen. They're not the only people to have done this, but they say their system advances the state of the art in several ways.

The most unique aspects are the flexibility of the camera placement and the distance at which it works accurately. In a video, the researchers show how they can walk several meters from the camera -- out the door of their office, actually -- and Handpose still reads their gestures accurately.

It also works when the camera is shaking around. All these advancements make the system much more robust, meaning it's a better candidate for real world use. They'll present Handpose at the Computer Human Interaction conference next week in Seoul.

Kinect already tracks fully body movements and gestures like a kick or a punch. Tracking wrist and finger movements is a harder problem to solve, as movements are more varied and often less pronounced.

Handpose could eventually be used in a gaming system like Kinect, or in a virtual reality headset like the Oculus Rift, allowing people to reach out their hand to lift, move and place objects on the screen.

It could also be used in robotics, allowing a person to remotely handle dangerous substances, for example, by moving their hands in front of a screen. It could also help robots mimic the dexterity of human hands.

Microsoft hopes Handpose will help robots do something as subtle as twist the lid off of a jar. It could be combined with artificial intelligence which "provides another step toward helping computers interpret our body language, including everything from what kind of mood we are in to what we want them to do when we point at something," Microsoft said.

Agam Shah covers PCs, tablets, servers, chips and semiconductors for IDG News Service. Follow Agam on Twitter at @agamsh. Agam's e-mail address is agam_shah@idg.com

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags CHIconsumer electronicsMicrosoft

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Agam Shah

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?