Eliminating database recovery

Maintaining old copies of databases can become absurdly wasteful

Providing protection and ensuring timely recoverability of databases has always represented a unique challenge for IT. Unlike file system data, databases usually appear to backup applications as large monolithic containers, and as data volumes have increased, so has the problem.

Not too many years ago, a database of 50GB to 100GB in size was considered huge. In contrast, today it is no longer rare to see terabyte-size transactional databases and data warehouses in the tens of terabytes. So, how do you effectively and efficiently protect such environments? Traditional approaches, such as nightly backups, are simply inadequate, and the currently accepted best practice of multiple split mirrors (e.g. BCVs) can be too costly at today's capacity levels.

The first step in developing any protection strategy is, of course, to understand recovery requirements (recovery time objective and recovery point objective). With very large databases, it is also particularly important to seriously consider retention requirements. We routinely encounter environments that maintain copies of databases that are 30 days old or more. Often, upon further investigation, you realize that these older copies are of little or no real business value. Clearly, maintaining such copies of multiterabyte databases can become absurdly wasteful.

As strange as it may sound, in some cases, it may be possible to avoid recovery entirely. Consider the example of a data warehouse where original source data may be readily available, making it feasible and more cost-effective to re-create the warehouse rather than to recover it.

In other situations, leveraging a hybrid of several well-established technologies, such as database log shipping in conjunction with snapshot capabilities (far less storage-intensive than mirrors) can adequately provide the required levels of protection against both physical and logical data loss. Additionally, newer approaches like continuous data protection are well worth investigating.

On another level, one might question the wisdom of building enormous monolithic databases. There are a growing number of examples of application environments that employ an architecture consisting of multiple smaller databases with a common parallel query layer, making protection as well as scalability easier. Unfortunately, these design decisions are typically made several levels above those lowly individuals tasked with ensuring data protection, who still have to be able to recover -- bad design or not.

Jim Damoulakis is chief technology officer at GlassHouse Technologies, a provider of independent storage services. He can be reached at jimd@glasshouse.com.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Jim Damoulakis

Computerworld
Show Comments

Cool Tech

Breitling Superocean Heritage Chronographe 44

Learn more >

SanDisk MicroSDXC™ for Nintendo® Switch™

Learn more >

Toys for Boys

Family Friendly

Panasonic 4K UHD Blu-Ray Player and Full HD Recorder with Netflix - UBT1GL-K

Learn more >

Stocking Stuffer

Razer DeathAdder Expert Ergonomic Gaming Mouse

Learn more >

Christmas Gift Guide

Click for more ›

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?