When in doubt, buy more storage

Storage resource management software can give customers an accurate picture of how much storage they have and how much they are using up

Imagine driving a car without a fuel gauge. You have no idea how much fuel is in the tank and worry that you're about to run out, so you stop at every petrol station you see to buy more. Storage managers in data centers have much the same problem.

They purchase additional storage capacity and then assign portions of it to various purposes -- the database program, the e-mail program and so forth.

Once they've apportioned all the storage capacity, it looks like it's all used up (though they set some aside as a reserve). The storage vendor, of course, is happy to sell them more.

"This is sort of the dirty little secret of the storage industry," said Ray Villeneuve, president and CEO of MonoSphere. After a storage vendor delivers the customer's newest array, "the sales team is hovering, already working on the next US$2 million deal."

Privately held MonoSphere itself offers storage resource management software designed to give customers an accurate picture of not just how much storage they have but how much they are using up.

Many storage administrators endure a laborious process to figure that out, said Dianne McAdam, a storage industry analyst at The Clipper Group. They often use monitoring applications that place software agents on servers to track how much data is sent to storage. But they have to add up the numbers from each of what may be hundreds or thousands of servers, then manually match the results to the amount of storage provisioned for each application.

"It's ugly, it's painful," said McAdam, who once worked in the industry doing that very task. "I was doing queries to each storage appliance and just putting them into a spreadsheet manually."

Said John Kelly, product marketing manager for the Storage Essentials management software product at Hewlett-Packard: "There's a joke in the industry that Microsoft is the leading storage resource management vendor because everyone uses Excel."

Smaller, niche players like MonoSphere and Onaro offer specialized storage resource management software, McAdam said. Similar firms have been acquired by larger vendors, such as the 2005 HP acquisition of AppIQ Inc., to integrate into their own management software.

MonoSphere's Storage Horizon software runs on its own server on the customer's network. Instead of using agents deployed on each server, MonoSphere views the volumes of data generated by the application servers and correlates them with the storage capacity allocated to those applications.

If one portion of storage is being underutilized, it can be reallocated to another area that needs it.

Brent Ozar was surprised at the results after he took inventory using Onaro software of the 80T-bytes of storage he manages at Southern Wine & Spirits, a beverage distributor in Florida.

"We had about a half dozen servers that we had equipped with [storage] space that have never even used it. We were able to free up several hundred gigabytes of space by just going through and starting to ask questions," Ozar said.

On average, only 35 percent to 40 percent of storage capacity is being utilized, usually because various departments overestimate their storage needs, said Steve Norall, senior analyst with Taneja Group.

Overprovisioning helps push storage spending higher. By the end of 2006, the storage industry recorded its 14th consecutive quarter of revenue growth, according to a report from IDC, which also projects worldwide storage spending to grow to US$32.4 billion by 2010, from US$29.1 billion in 2006.

But if enterprises are spending those billions on storage and using only 40 percent of it, they're wasting money that could be better invested elsewhere in their business, Villeneuve said. By more accurately measuring how much storage they are using and reapportioning it within their data centers, they could bring utilization rates up to 80 percent.

If, for example, a company is actually using just 1 petabyte of storage, at 40 percent utilization they end up buying, managing, depreciating, powering and cooling 2.5 petabytes. If they bring utilization up to 80 percent, they would only be buying 1.25 petabytes. If storage costs, say, US$20,000 per terabyte, the capital expense savings would be US$25 million, not to mention the savings on operational costs and depreciation, Villeneuve said.

In general, it's better to do storage planning up front, when the storage is being provisioned, because reprovisioning it afterwards can be expensive and disruptive to the IT system, said Bryan Semple, vice president of marketing for Onaro.

"It takes a lot of work to reclaim and reallocate storage and it's not worth the cost just to reclaim 50 gigs," Semple said. If a company wants to use software like MonoSphere's to continue to monitor storage, it should use it only for the largest portions of storage.

Ultimately, storage overprovisioning is more a behavioral issue than a technology one, he said. Even if overall storage spending is rising, the unit price is declining so it's still considered a bargain. Storage administrators buy more than they need because they figure they won't get fired for having too much storage, but for having too little.

"No database manager wants to get paged in the middle of the night that a database is out of storage space," Semple said.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Robert Mullins

IDG News Service
Show Comments

Father’s Day Gift Guide

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?