Give your computer the finger: Touch-screen tech arrives

Time to kiss your mouse goodbye?

Getting real

Tufts' Jacob has developed a framework that unites such disparate technologies as multitouch screens and systems that can read emotions from the faces of users. He says such "reality-based interaction" is based on these four concepts:

Naive physics. It's common sense that tells people that an apple that comes off a tree will fall to the ground, even if they have forgotten Newton's laws. The Apple iPhone helps user intuition by simulating gravity (as when the screen switches from portrait to landscape mode as the user rotates the device) and inertia (e.g., when flicking through the contacts list, a fast flick will keep the contacts scrolling after the user's finger has been removed, as if the list had mass).

Body awareness and skills. It's the ability -- learned very early in life -- to coordinate one's hands, eyes and senses independent of environment. "Emerging interfaces support an increasingly rich set of input techniques based on these skills, including two-handed and whole body interaction," Jacob says.

Environmental awareness and skills. Humans naturally take actions in the context of objects in the environment. Emerging human-computer interaction styles -- such as virtual reality -- do the same. For example, "context aware" or sensing systems may compute a user's location and take actions based on that.

Social awareness and skills. People are aware of the presence of others and interact with them in various ways. Similarly, emerging technologies such as the Mitsubishi DiamondTouch Table facilitates collaboration via a touch display that allows users to maintain eye contact while interacting with the display simultaneously.

Says Jacob, "All of these new interaction styles draw strength by building on users' preexisting knowledge of the everyday, nondigital world to a much greater extent than before."

Tiny devices and the 'fat finger' problem

Some researchers say that a logical extension of touch technology is gesture recognition, by which a system recognizes hand or finger movements across a screen or close to it without requiring an actual touch.

"Our technology is halfway there," IBM's Pinhanez says, "because we recognize the gesture of touching rather than the occlusion of a particular area. You can go over buttons without triggering them."

The occlusion problem, where a finger or hand blocks a user's view of what he's doing and leads him to make mistakes, is being attacked in some novel ways. Microsoft and MERL collaborated on development of a research prototype called LucidTouch, a two-sided, "pseudo-translucent" mobile device that allows users to issue commands with their fingers on either the front or the back of the device.

"The problem we are addressing is what some people have called the 'fat finger problem,'" says Patrick Baudisch at Microsoft Research. When a user touches the back of the device, he sees an image of his fingers behind instead of in front of the things to be touched on-screen. LucidTouch can accept input from as many as 10 fingers at once.

Join the PC World newsletter!

Error: Please check your email address.

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Gary Anthes

Show Comments

Most Popular Reviews

Latest News Articles


PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?