Microsoft researches user interface for the illiterate

Creating smarter iconic images for different countries and cultures is a key challenge

Microsoft's research arm is working on technology that would enable its engineers to build a user interface for the illiterate.

Scientists in Microsoft Research's Bangalore, India, research lab have been working on the project since 2005, according to P. Anandan, the facility's managing director. The scientists are building prototypes of the user interface (UI) now but Microsoft has no immediate plans for working it into a product, Anandan said.

"Many people in the world - about 50 per cent in India - cannot read and write," Anandan told Computerworld. "For them, a textual interface where they have to read and write just is not useful. You can show a lot more in a picture."

Anandan and his team from the Bangalore lab were in Washington this week for Microsoft's seventh annual TechFest gathering. They were among many of Microsoft's 800 PhD-level researchers from around the world who attended the event to show off projects they working on.

On Tuesday, the scientists gave the press and Microsoft research partners a glimpse of their work, and then rolled out a more comprehensive showcase on Wednesday and Thursday for Microsoft's own employees.

Anandan said part of the challenge in developing the new interface is to overcome the barrier of using reading and writing to interact with the computer. What it largely comes down to is coming up with better icons, he added.

Another problem lies in the fact that different countries, different cultures and even people from different towns respond differently to iconic images. Anandan explained that the average image used in the United States for a home would look like two sides of a home and a slanted roof. However, someone looking for housekeeping work in India might see that icon and assume that it was a hut and not a nice home. In India, the icon for a home would have to represent a two-story dwelling, he said.

"One part of this work is not so much about the icons but about the vocabulary a community speaks," he added. "Every iconic interface depends on the application you're creating it for and the community you're focusing on. You have to think of language, the country and the job people do."

Creating a user interface for people who are illiterate, however, can also help in the effort to improve more traditional interfaces, as literate people can also benefit from richer and more meaningful icons, noted Anandan.

"There's a certain amount of vividness that you get through images and sound that you don't get through text," he added.

Join the PC World newsletter!

Error: Please check your email address.

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Sharon Gaudin

Computerworld
Show Comments

Essentials

Microsoft L5V-00027 Sculpt Ergonomic Keyboard Desktop

Learn more >

Lexar® JumpDrive® S57 USB 3.0 flash drive

Learn more >

Mobile

Lexar® JumpDrive® S45 USB 3.0 flash drive 

Learn more >

Exec

Lexar® Professional 1800x microSDHC™/microSDXC™ UHS-II cards 

Learn more >

HD Pan/Tilt Wi-Fi Camera with Night Vision NC450

Learn more >

Lexar® JumpDrive® C20c USB Type-C flash drive 

Learn more >

Audio-Technica ATH-ANC70 Noise Cancelling Headphones

Learn more >

Budget

Back To Business Guide

Click for more ›

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?