P2P file transfers get speed boost

Non-identical movie, music files speed up peer-to-peer file sharing

New peer-to-peer (P2P) technology has been designed to speed file transfers through the sharing of non-identical files. The system promises to make online file sharing up to five times faster, and could potentially add to the efficiency of software updates and data transfers to and from portable storage devices.

Traditional P2P file-sharing services work by identifying identical files in a P2P network, and simultaneously downloading different chunks of the desired file from multiple sources. The speed with which a file can be obtained is generally determined by the number of sources available, which relates to the popularity of the file.

While popular files can typically be obtained reasonably quickly, rarer files with few identical sources may take quite some time to download. By configuring P2P networks to identify data chunks that are similar, - but not necessarily identical - to the desired file, the newly-designed technology, called Similarity-Enhanced Transfer (SET), is expected to greatly increase the number of potential sources for downloads, hence boosting transfer speeds.

No one knows the degree of similarity between data files stored in computers around the world, but analysis suggest the types of files most commonly shared are likely to contain a number of similar elements, researchers say. Many music files, for instance, may differ only in the artist-and-title headers, but are otherwise 99 percent similar.

"In some sense, the promise of P2P has been greater than the reality," said David G. Andersen, an assistant professor of computer science at the Carnegie Mellon University. "This [SET] is a technique that I would like people to steal ... it would make P2P transfers faster and more efficient."

Depending on the number of sources readily available, researchers expect SET to speed transfers by anything from 5 to 500 percent. Under recent testing, SET was found to improve the P2P transfer time of an MP3 music file by 71 percent. When the system was configured to download data from files that were 47 percent similar, a larger 55MB movie trailer was downloaded with a speed increase of about 30 percent.

In cases where files were so popular that available sources are already fast enough to use up all the receiver's bandwith, however, advantages may not be so great. During the download process, SET constantly spends time and bandwidth searching for other files, which researchers found could add about 0.5 percent to the download time.

As SET is based on identifying 'fingerprints' based on cryptographic hash functions that are fundamental to online transactions, Anderson said the technique is not likely to increase the risk of corrupted downloads.

"The chances of different data producing the same fingerprint are basically infinitesimal," he said. "These [cryptographic hash] functions underlie important parts of secure online commerce and data encryption."

P2P file sharing is notorious for its use in software, movie and music piracy; however, Andersen stresses that it is also widely used in other applications, such as the distribution of free and open source software.

"As the [P2P] technology matures, I think we'll see it being used for more and more legal uses," he said. "For instance, we're pretty sure based on other people's previous studies that SET will be useful for distributing software such as GNU/Linux; there's often substantial similarity between different releases of the operating system."

Although the researchers hope to implement SET in a service for sharing software or academic papers, Andersen said they have no intention of applying it themselves to movie- or music-sharing services. Current research is focussed instead on extending SET techniques to efficiently locate similar content that is already present on a user's hard drive, to speed data transfers.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Liz Tay

PC World
Show Comments

Cool Tech

SanDisk MicroSDXC™ for Nintendo® Switch™

Learn more >

Breitling Superocean Heritage Chronographe 44

Learn more >

Toys for Boys

Family Friendly

Panasonic 4K UHD Blu-Ray Player and Full HD Recorder with Netflix - UBT1GL-K

Learn more >

Stocking Stuffer

Razer DeathAdder Expert Ergonomic Gaming Mouse

Learn more >

Christmas Gift Guide

Click for more ›

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?