DreamWorks: 3D movies to double data storage requirements

New digital library can scale out to almost 1 petabyte of capacity

DreamWorks Animation is releasing all of its films in stereoscopic 3D, more than doubling the amount of data storage capacity required to store its movies.

The move to 3D animation also requires the company's IT shop to migrate away from tape-based storage systems to disk systems in order to keep archived films online for animators to use as references for future sequels, which is the company's mainstay.

DreamWorks recently released its first 3D animated moviem Monsters vs. Aliens, which packed its newly installed disk array from Hewlett-Packard Co. with 93TB worth of images. The company plans to release five feature films every two years. In the past, each animated film averaged less than 25TB, according to Derek Chan, head of digital operations for DreamWorks Animation.

The creation of three-dimensional movies means for every film frame there will be two images instead of one: one image for the left eye and one for the right eye of a viewer. Those cheap plastic or cardboard bi-colored glasses handed out at the theater polarize the images on the screen and combine in order to give the perception of depth.

DreamWorks' philosophy on feature-length animated films is to build franchises. There are three Shrek movies, for example, Madagascar has two and Kung Fu Panda will also have a sequel, Chan said.

"Think about Shrek. We're working on the fourth version now. There are three previous versions to reference for historical accuracy and inspiration. Then you increase the amount of data with stereoscopic imaging, and you've got a much larger data archiving tier," Chan said.

Two months ago, DreamWorks installed a new online reference library for its films. The disk array, an HP StorageWorks 9100 Extreme Data Storage System (ExDS9100), has 170TB of capacity - enough to store about 36,000 DVDs. But DeamWorks' goal is to keep everything, so the ExDS9100 storage system was configured to be able to scale out to 820TB.

HP introduced a new version of its ExDS9100 this week, increasing the configuration options on the array so that the smallest capacity point is now 82TB. Previously, the array started at 246TB of raw space, according to Michael Callaghan, chief technologist for HP's Enterprise NAS Group. The ExDS9100 uses an HP C7000 server blade chassis, offering from four to 16 blades. The blade chassis can't store the data itself, but also includes "storage blocks" or arrays of disks, each of which contain 82 1TB hard drives. Each storage block is fronted by a pair of controllers configured for RAID 6 protection.

The ExDS9100 can be configured independently for CPU power and networking bandwidth depending on how many server blades are used in the C7000 chassis, and storage capacity can be increased by adding 82TB blocks. The base configuration of the ExDS9100 starts with two server blades, each of which can deliver up to 200MB/sec. of I/O performance, and can scale to a maximum 3.2GB/sec. Chan said DreamWorks paid under $US2 a gigabyte for the new digital archive library.

DreamWorks' previous archive setup, which used an LTO tape library, took animators days to retrieve movie sequences that are used for inspiration as well as to emulate characters and landscapes in new movies. The new disk archive system can retrieve video sequences in seconds, Chan said.

"Our focus was to find a cost effective bulk storage tier, optimized for capacity more than for performance. We're not going to turn our entire [image] render farm at it. So there aren't going to be 16,000 cores trying to reference this material simultaneously," Chan said. "But you will have high-demand artists who are looking into what Queen Lillian was wearing in Shrek III, and they don't want to wait to get it off tape. That breaks the creative flow."

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags HPdreamworks3d

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.
Lucas Mearian

Lucas Mearian

Computerworld
Show Comments

Cool Tech

Toys for Boys

Family Friendly

Stocking Stuffer

SmartLens - Clip on Phone Camera Lens Set of 3

Learn more >

Christmas Gift Guide

Click for more ›

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Aysha Strobbe

Microsoft Office 365/HP Spectre x360

Microsoft Office continues to make a student’s life that little bit easier by offering reliable, easy to use, time-saving functionality, while continuing to develop new features that further enhance what is already a formidable collection of applications

Michael Hargreaves

Microsoft Office 365/Dell XPS 15 2-in-1

I’d recommend a Dell XPS 15 2-in-1 and the new Windows 10 to anyone who needs to get serious work done (before you kick back on your couch with your favourite Netflix show.)

Maryellen Rose George

Brother PT-P750W

It’s useful for office tasks as well as pragmatic labelling of equipment and storage – just don’t get too excited and label everything in sight!

Cathy Giles

Brother MFC-L8900CDW

The Brother MFC-L8900CDW is an absolute stand out. I struggle to fault it.

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?