Lustre settles into post-Oracle life

A California startup picks up where Oracle leaves off in support for the Lustre file system

Despite reassurances from Oracle, advocates of yet another ex-Sun Microsystems technology are voicing concern about the future of their software. In this latest case, the technology is Lustre, a file system widely used across the supercomputing community.

"Lustre is in a bit of a flux at the moment. The community feels a little bit that Oracle is turning its back to them, and there is discussion going on over whether or not Oracle is forking the code," said Brent Gorda, CEO of Whamcloud, a San Francisco-based, venture capital-funded company recently started to service the potential market of HPC (high-performance computing), Linux-based Lustre users.

While Oracle has pledged to continue to develop the software, it has no plans to sell commercially supported versions of the software beyond version 1.8.3, the last released by Sun, except as part of integrated packages of Oracle hardware and software.

With Oracle potentially scaling back its plans to offer Lustre as widely as possible, the file system joins a number of other Sun technologies whose futures appear altered or cloudy since Oracle acquired Sun in January, such as OpenOffice (now renamed LibreOffice), OpenSolaris, OpenSSO and others.

The last public announcement the company made about its plans for the technology was at the Lustre User Group 2010 meeting in Monterey Bay, California, last April, according to Gorda. He said that Oracle has not made any announcements about Lustre since the meeting. "In the community, we're left wondering and assuming bad things," he said. Oracle declined to be interviewed for this article.

At that meeting, Oracle engineer Peter Bojanic gave the audience an overview of Oracle's plans for the technology.

In short, he explained that Oracle will continue to sell a commercially supported version of the current edition of the software, version 1.8, but has no plans to sell a standalone, software-only version of the next release, version 2.0. It will, however, continue to shepherd the development of the software and use it as part of integrated hardware/software offerings. Oracle released version 2.0 in August.

Much like IBM offers its own parallel file system, GPFS (General Parallel File System), for its high-performance computing systems, Oracle will maintain Lustre primarily for its own systems, Gorda said. Whamcloud sees its niche in supporting Linux-based Lustre deployments that run on commodity x86 servers.

"Because of the perception that Oracle is backing away from HPC and open Linux, there is a hole there, and we started Whamcloud to service that area," Gorda said.

Lustre is what is widely known as a massively parallel file system, meaning that it can be used for storing vast arrays of data across multiple nodes, by using a central index of where all the data is kept. The technology is used across a large percentage of the world's fastest supercomputers.

Beyond supercomputing, Gorda sees Lustre as a good fit for the emerging field of cloud computing. "Lustre has already proved itself to run at speeds that are incredibly demanding. I think of it as a superset of what cloud computing and data analytics needs," he said.

Lustre has multiple controllers, which means that there is less chance of having a bottleneck when lots of sources are seeking or writing data to disks. It has been shown to support more than 50,000 clients simultaneously. Lustre can deliver over 2GB/s (gigabits per second) to an individual client. It is an open-source technology, though in 2007 Sun Microsystems acquired CFS, the company that did much of the early development work.

"Lustre is a good, scalable, robust file system," said Mark Seager, principal investigator for supercomputing platforms at the U.S. Energy Department's Lawrence Livermore National Laboratory (LLNL). About 25 of the lab's systems, both for classified and unclassified work, run on the file system.

LLNL was the first large organization to use the file system in a production development, and continues to fund its development. LLNL also turned out to be one of Whamcloud's first customers. Last week, LLNL commissioned Whamcloud to undertake a number of Lustre-related tasks. One is upgrading the LLNL's LMT (Lustre Monitoring Tool) so that it can work with Lustre 2.0. A debugging tool, LMT allows an administrator to determine if one particular application is taking up too many resources.

"In a multi-user environment, when a file system gets too busy, it is hard to correlate what application is causing that," Gorda said. LLNL will make this software open source, and it is scheduled to be released early in 2011.

Whamcloud will also help LLNL characterize Lustre performance on solid-state disks, which are expected to be widely used in HPC systems as their storage needs continue to balloon. "We expect that we'll find performance issues inside Lustre that would be addressed in the long term," Gorda said. "We're getting a metric for determining if Flash [drives] are the right thing to use."

In contrast to Gorda's claims, LLNL's Seager has not felt that Lustre support has lagged since Oracle assumed control of the technology. Oracle has helped LLNL in matters of hardware maintenance and improving the way the failover mechanisms work. "We're very happy with the collaboration with Oracle," he said.

Still, Whamcloud plans to ramp up support for the technology.

"There's been this confusion for the past six months, and I think we're seeing a calm return to the community. People are seeing that Lustre is not going away," Gorda said.

Joab Jackson covers enterprise software and general technology breaking news for The IDG News Service. Follow Joab on Twitter at @Joab_Jackson. Joab's e-mail address is

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags Clusterssupercomputersstoragehardware systemssoftwarecloud computinginternetInfrastructure servicesOracleStorage ManagementHigh performance

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Joab Jackson

IDG News Service
Show Comments

Cool Tech

SanDisk MicroSDXC™ for Nintendo® Switch™

Learn more >

Breitling Superocean Heritage Chronographe 44

Learn more >

Toys for Boys

Family Friendly

Panasonic 4K UHD Blu-Ray Player and Full HD Recorder with Netflix - UBT1GL-K

Learn more >

Stocking Stuffer

Razer DeathAdder Expert Ergonomic Gaming Mouse

Learn more >

Christmas Gift Guide

Click for more ›

Most Popular Reviews

Latest Articles


PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?