Permabit extends data dedupe to Linux-based NAS

Dedupe software is targeted at low-end NAS vendors

Permabit Technology on Tuesday announced an iteration of its Albireo primary data deduplication software for SMB network-attached storage systems based on Linux servers.

Albireo Virtual Data Optimizer (VDO), which will be available in the second half of this year, offers inline deduplication and optional data compression as a component of storage systems. Permabit sells a higher-end version of its Albireo deduplication product to NAS vendors such as BluArc, Xiotech and LSI Engenio.

The new VDO application is targeted at smaller NAS vendors that use commodity hardware to create inexpensive and easy to use NAS, such as Overland Storage, NetGear, Cisco Systems' Linksys and QNap Systems.

Albireo's index engine works by allowing application servers and NAS systems to quickly identify block- or file-level data already stored on an array of disks. Using the SHA-256 hash function, the software assigns a unique identifier to chunks of data being stored. Those hash identifiers are then stored, along with meta data from the storage systems -- such as the block address - in an index.

As new data comes in from application servers, the data is automatically compared with existing data. If duplicate files or blocks of data are found, the storage system is notified and the data is not stored. When data read requests come in to the NAS appliance, the data is delivered in the same way as a snapshot is copied on a backup system, through multiple pointers to the data chunks.

"It means there's no rehydration operation and we're not in the read path," said Jered Floyd, CTO and co-founder of Permabit. "This functionality is not limited to a handful of terabytes of data. It can deliver this across petabytes of data within same file system or volume."

Floyd said Albiereo is capable of delivering 420MB/sec. of sustained throughput using a single quad-core processor, so as not to cause a bottleneck in the data path.

"We'll never be the bottleneck in the storage network," Floyd said. "We feel if dedupe has a negative impact on a storage system, that's an obstacle to adoption."

Permabit is targeting Linux-based NAS systems with its new VDO product because, after top tier vendors, it's the fastest growing market. According to Gartner, the Linux-based NAS appliance market has grown from a 6.5 per cent market share in 2006 to 17.9 per cent in 2009.

Floyd said about 60 vendors offer Linux-based NAS systems, which mainly use the iSCSI transport protocol. The systems typically have from one to 96 drives.

In order for the NAS vendors to use the Albireo VDO software, there is a three-week to three-month engineering effort required to integrate the application with their native storage management software.

"There are dozens of Linux-based NAS vendors that are looking for ways to differentiate themselves from their competitors. If it is available, most of these vendors are frustrated with the sub-par capabilities of the deduplication that comes with the OS they integrate into their NAS," said George Crump, founder of market research firm Storage Switzerland, n a statement. "Building the Albireo VDO technology into their devices is an excellent way to differentiate themselves."

Lucas Mearian covers storage, disaster recovery and business continuity, financial services infrastructure and health care IT for Computerworld. Follow Lucas on Twitter at @lucasmearian or subscribe to Lucas's RSS feed. His e-mail address is lmearian@computerworld.com.

Read more about storage in Computerworld's Storage Topic Center.

Join the PC World newsletter!

Error: Please check your email address.

Tags LSInetwork-attached storageNetworked StorageOverland StoragestorageXiotechstorage softwareStorage Management

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Lucas Mearian

Computerworld (US)
Show Comments

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?