Building connection engines with metadata

In "Scan This Book!" -- a May 14 manifesto published in The New York Times Magazine -- Wired's Kevin Kelly explores the copyright battle provoked by Google's ambition to digitize millions of library books. It's ultimately a clash of business models, he concludes. In a networked world, where copying is implicit in every transfer of information, copies lose their direct economic value but gain indirect value as "discovery tools" that attract attention, sponsorship, and subscription.

Search is the game-changer. "Things can be found by search," Kelly adds, "only if they radiate potential connections." Yes, but that leads to a more nuanced view of search than the one Google and its competitors have popularized. For the past few months I've been revamping search on Full-text search works more effectively now and is augmented by streams of metadata and by RSS syndication. It's all about making the site a better connection engine.

On my blog, I've chronicled the development of a pair of applications called InfoWorld Power Search and InfoWorld Metadata Explorer. Both exploit three kinds of metadata to turbocharge the discovery of InfoWorld articles: first, structured document titles that include key attributes, such as date, type, and author; second, tags assigned by way of; third, subtitles and lead paragraphs.

In InfoWorld Power Search, aka iws, I use these metadata streams to add value to the output of our Ultraseek search engine. The raw Ultraseek results are ordered by relevance, but that's begging the question: Relevant to whom? For what purpose? Using iws, you can order results by date, type, and author, and you can evaluate the results in the context of their tags, subtitles, and lead paragraphs.

In InfoWorld Metadata Explorer, aka iwx, the same metadata streams add value to Compare the results for the tag "vista," for example, in and in iwx. It's the same set of URLs, but in iwx they're decorated with extra metadata. Those metadata elements aren't just passively displayed; they're active filters, too. Clicking a tag filters the view to include just items with that tag. Clicking an author's name adds another filter for items by that author.

These applications blend search and navigation in interesting and powerful ways. Because every view is fully specified by a URL, they radiate a lot of connections for people to use. Under the covers, they also use RSS feeds to radiate connections that people and machines alike can use.

Like many sites, offers a set of topical RSS feeds. Now that every iwx view can be seen through an RSS lens, that set is vastly enlarged. Suddenly we have feeds for Vista, Cisco, and many other topics. Cool! But not in the obvious way. Before iwx offered an RSS feed of InfoWorld's Vista articles, did. Frankly, neither version is very interesting in and of itself. If you want to syndicate articles about Vista, ours are only some of the ones you'll want to see in that feed.

Aggregated views are the ticket. And the key point is that the iwx version of the feed encourages smarter aggregation. Metadata is what makes the interactive experience in iwx more compelling than its counterpart. By syndicating that metadata, I'm inviting others to more richly contextualize their aggregations of our stuff.

If other publishers will return the favor, I'll gladly make better use of theirs. Any takers?

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Jon Udell

Show Comments

Most Popular Reviews

Latest Articles


PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?