Search engine roulette: sites rarely agree on top results

Search results vary markedly with all the leading search engines

The most popular Web search engines rarely deliver the same results when identical queries are performed on each site, and the disparity has increased over the past two years, new research has found.

In a study of 19,332 queries, Google, Yahoo, Windows Live and Ask delivered the same top result only 3.6 percent of the time. The four engines never delivered the same top three results, even when the order of the results was ignored. Fewer than 1 percent of first-page results were shared by all four sites.

The search engines agreed more often in a study two years ago, in which the top result matched all four engines on 7 percent of queries.

"These differences contradict any notion that all search engines are the same and that searching one engine will yield the absolute best results of the Web," the paper states.

Dogpile.com, a metasearch engine that combines results from the top search sites, conducted the study with researchers from Queensland University of Technology and Pennsylvania State University. The research paper claims the study highlights the value of sites that deliver results from multiple search engines.

The research spurred an executive with Ask.com to discuss the importance of knowing the strengths and weaknesses of each search tool, even for users who search only one engine each time they need information.

"We like to think of search engine overlap with a 'classical' library mindset. Libraries often acquire (for a fee) more than one reference book or electronic database that contain the same data, journal indexing. However, each database or book might offer different features, different ways of indexing. In other words, it's worth the money to offer, know about, and use a variety of tools. No one resource is ideal for each query," states a posting this week on ResourceShelf, a daily electronic newsletter for online researchers. The newsletter is written by Gary Price, a librarian and director of online information for Ask.com.

Searchers can find a comparison of engines in PC World, which recently tested the Web's major search engines and pronounced Google the best of the lot. AlltheWeb and AltaVista, both owned by Yahoo, topped Google in text-search tests, but Google is able to deliver accurate and comprehensive results for text, video, images, news and blogs, the magazine said.

Most of the results Google and other engines deliver on the first page won't be found in the top results of the other sites. Nearly 70 percent of first-page results delivered by Google in the search overlap study were not found in the first-page results of Yahoo, Ask or Windows Live. About 80 percent of first-page results on Yahoo and Live were unique to those engines, compared to 75 percent of Ask's first-page results.

The study's 19,332 queries returned 776,435 unduplicated first-page results from the four engines. Out of those results, 0.6 percent were shared by all four search engines, and 88.3 percent were found only in one of the four.

Join the PC World newsletter!

Error: Please check your email address.

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Jon Brodkin

Network World
Show Comments

Essentials

Lexar® JumpDrive® S57 USB 3.0 flash drive

Learn more >

Microsoft L5V-00027 Sculpt Ergonomic Keyboard Desktop

Learn more >

Mobile

Lexar® JumpDrive® S45 USB 3.0 flash drive 

Learn more >

Exec

Lexar® JumpDrive® C20c USB Type-C flash drive 

Learn more >

Lexar® Professional 1800x microSDHC™/microSDXC™ UHS-II cards 

Learn more >

Audio-Technica ATH-ANC70 Noise Cancelling Headphones

Learn more >

HD Pan/Tilt Wi-Fi Camera with Night Vision NC450

Learn more >

Budget

Back To Business Guide

Click for more ›

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?