Google looks to technology that recognizes text in images

Technology would allow Google to index text that appears in digital photos and videos

Google may have plans to expand its search engine beyond static text.

The search giant in June filed a patent application for technology that can recognize text in images. It could be used to retrieve text from video or from photographs that may show up as part of a street scene. The application was published on Thursday.

The company is seeking the patent for methods, systems and computer programs that can extract image text. For example, the application noted, the technology could search a collection of keywords extracted from text and retrieve an image associated with the extracted text.

The digital images that the technology aims to scout for text include illustrations of landscapes, people, urban scenes and other objects, according to the application.

"Image text typically includes text of varying size orientation and typeface," the application noted. "Text in a digital image derived, for example, from an urban scene (a city street scene) often proves information about the displayed scene or location. A typical street scene includes, for example, text as part of street signs, building names, address numbers and window signs."

Duncan Riley, a blogger at TechCrunch, noted that if Google really has found a way to index text in static images and video, "this is a great leap forward in the progression of search technology. This will make every book in the Google Books database really searchable, with the next step being YouTube, Flickr and more."

Adam Ostrow, a blogger at social networking site Mashable, said that potential applications of text recognition technology go beyond Google's existing products.

"Google could start photographing the aisles of stores to create product indexes with vast amounts of data," he wrote in a blog post. "For example, if Google were to photograph a box of Lucky Charms, it might be able to tell you not only its price, but nutritional information and ingredients."

However, Ostrow noted that the amount of manpower needed to capture this type of data would be hefty.

"Google Street View provides a fair amount of photos for major metropolitan areas, but it would seem that creating meaningful search products that utilize text recognition technology would require far deeper and more precise imagery," he said. "It sounds challenging, but perhaps not impossible with 15,000-plus employees at the company's disposal."

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Heather Havenstein

Computerworld
Show Comments

Cool Tech

Bang and Olufsen Beosound Stage - Dolby Atmos Soundbar

Learn more >

Toys for Boys

ASUS ROG, ACRONYM partner for Special Edition Zephyrus G14

Learn more >

Sony WF-1000XM3 Wireless Noise Cancelling Headphones

Learn more >

Nakamichi Delta 100 3-Way Hi Fi Speaker System

Learn more >

Family Friendly

Mario Kart Live: Home Circuit for Nintendo Switch

Learn more >

Philips Sonicare Diamond Clean 9000 Toothbrush

Learn more >

Stocking Stuffer

SunnyBunny Snowflakes 20 LED Solar Powered Fairy String

Learn more >

Teac 7 inch Swivel Screen Portable DVD Player

Learn more >

Christmas Gift Guide

Click for more ›

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Tom Pope

Dynabook Portégé X30L-G

Ultimately this laptop has achieved everything I would hope for in a laptop for work, while fitting that into a form factor and weight that is remarkable.

Tom Sellers

MSI P65

This smart laptop was enjoyable to use and great to work on – creating content was super simple.

Lolita Wang

MSI GT76

It really doesn’t get more “gaming laptop” than this.

Jack Jeffries

MSI GS75

As the Maserati or BMW of laptops, it would fit perfectly in the hands of a professional needing firepower under the hood, sophistication and class on the surface, and gaming prowess (sports mode if you will) in between.

Taylor Carr

MSI PS63

The MSI PS63 is an amazing laptop and I would definitely consider buying one in the future.

Christopher Low

Brother RJ-4230B

This small mobile printer is exactly what I need for invoicing and other jobs such as sending fellow tradesman details or step-by-step instructions that I can easily print off from my phone or the Web.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?