Give your computer the finger: Touch-screen tech arrives

Time to kiss your mouse goodbye?

Getting real

Tufts' Jacob has developed a framework that unites such disparate technologies as multitouch screens and systems that can read emotions from the faces of users. He says such "reality-based interaction" is based on these four concepts:

Naive physics. It's common sense that tells people that an apple that comes off a tree will fall to the ground, even if they have forgotten Newton's laws. The Apple iPhone helps user intuition by simulating gravity (as when the screen switches from portrait to landscape mode as the user rotates the device) and inertia (e.g., when flicking through the contacts list, a fast flick will keep the contacts scrolling after the user's finger has been removed, as if the list had mass).

Body awareness and skills. It's the ability -- learned very early in life -- to coordinate one's hands, eyes and senses independent of environment. "Emerging interfaces support an increasingly rich set of input techniques based on these skills, including two-handed and whole body interaction," Jacob says.

Environmental awareness and skills. Humans naturally take actions in the context of objects in the environment. Emerging human-computer interaction styles -- such as virtual reality -- do the same. For example, "context aware" or sensing systems may compute a user's location and take actions based on that.

Social awareness and skills. People are aware of the presence of others and interact with them in various ways. Similarly, emerging technologies such as the Mitsubishi DiamondTouch Table facilitates collaboration via a touch display that allows users to maintain eye contact while interacting with the display simultaneously.

Says Jacob, "All of these new interaction styles draw strength by building on users' preexisting knowledge of the everyday, nondigital world to a much greater extent than before."

Tiny devices and the 'fat finger' problem

Some researchers say that a logical extension of touch technology is gesture recognition, by which a system recognizes hand or finger movements across a screen or close to it without requiring an actual touch.

"Our technology is halfway there," IBM's Pinhanez says, "because we recognize the gesture of touching rather than the occlusion of a particular area. You can go over buttons without triggering them."

The occlusion problem, where a finger or hand blocks a user's view of what he's doing and leads him to make mistakes, is being attacked in some novel ways. Microsoft and MERL collaborated on development of a research prototype called LucidTouch, a two-sided, "pseudo-translucent" mobile device that allows users to issue commands with their fingers on either the front or the back of the device.

"The problem we are addressing is what some people have called the 'fat finger problem,'" says Patrick Baudisch at Microsoft Research. When a user touches the back of the device, he sees an image of his fingers behind instead of in front of the things to be touched on-screen. LucidTouch can accept input from as many as 10 fingers at once.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Gary Anthes

Show Comments

Most Popular Reviews

Latest Articles


PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?