To those that know me it will come as no surprise that I’m a backup nerd. Since owning my first DAT drive in the mid 90’s that held a grand total of 2 gigs per tape (compressed) I’ve been interested in backup technology, redundancy and “playing it safe” when it comes to my data. That trend has been extended to my business for the benefit of my company as well as my clients.

This post will discuss a new backup appliance being introduced at NAB this year, and cover in general terms how we currently use its predecessor in our workflow. Even if you have your own method of archiving and don’t need anything at this time, you might want to read about our process toward the end of the post to see if you can benefit from it at all.

A Brief History – The Wrong Way
From 2002-2007 we used a hard drive backup system at our office that was working OK, but was starting to show signs of fatigue. With about 45 drives on the shelf (300-400 gigs each), some of the drives were 5 years old now and on occasion we would have problems retrieving files on some of the older drives.

There has been plenty written about the expected life of hard drives, the need to exercise them and the amount of time they will last on a shelf without regular use. No matter which side you’re on or what your personal belief is, I can tell you from first hand experience that we were losing data and I was getting very concerned. What use is a backup system that slowly loses its files over such a short period of time.

Back in April 2007 I went to NAB in part to find a new backup strategy (and in part to just relax in the hotel spa). After looking at plenty of solutions and talking to plenty of vendors, I came across the LTO A-Series drives from Quantum. It had some really great features that nobody else offered at the time, and was targeted to post production professionals. Some of the features include…

• Built on the LTO-3 standard, you could fit 400 gigs of storage per tape (tapes were about $50 each at the time, and even cheaper now).
• It was network accessible over Gigabit Ethernet. If you have multiple edit systems like we do, this is pretty big. You can park the machine anywhere on the network and access it from any local machine. With other solutions you have to move the drive from machine to machine as needed.
• No special software needed – using a standard FTP client or their built in web browser client you could backup and retrieve files with ease. It’s truly platform independent.
• The drive was based on the LTO open standard (there was also a SDLT version if you prefer). The two main benefits of this are that it’s an open standard that was created by Seagate, HP and IBM and the tapes have a 30 year shelf life.
• Each tape has it’s own built-in file system on the tape, so loading the tape directory and locating a file is fast and very responsive. No need to have a separate catalog file that you have to keep track of.

Implementing the A-Series Solution
The drive was not shipping at the time, but would be later that year. I patiently waited and in the fall of 2007 purchased the desktop version of the A-Series and a case of tapes.

This is where I’m supposed to tell you that everything went smoothly and rainbows were flowing out of the tape drive. Well, that was not the case. I’ll spare you the particulars and just say it took us almost 6 months, countless emails to tech support and a major software/firmware update to finally trust the drive with the long term safety of our projects. To their credit, the Quantum support staff and engineers were first rate in the way they responded to each and every problem we had. As annoying as I’m sure we were, they never made us feel we were any trouble even when we sometimes lost our patience.

In early 2008 they released a major software/firmware update that addressed 99.9% of our issues, and since then it has been smooth sailing. We have not had a single issue with archiving or retrieving elements and have found ways to turn the drive into a new revenue stream as well.

The Future is NOW (or at least very soon)
So here we are approaching another NAB, 2 years after my first introduction to the Quantum A-Series drive, and it just got better. I’m so excited and impressed with what’s coming out that I’m considering selling my current A-Series drive and buying the newer model. But, the new drives are not from Quantum. They’re from Cache-A.

Cache-A is a new startup company that has licensed the A-Series technology from Quantum so that they could build on the platform that Quantum created. They have some of the key players that helped create the original drive, and some seriously good people that have really thought through how to improve the new drive. Much of their feature list no doubt comes from feedback from the current customer base.

Here are the highlights of the new drives from Cache-A.

• The new drives are all based on the LTO-4 standard. This is huge, because now each tape can hold 800 gigs, double of the LTO-3 model from Quantum. That brings the price down to about 6¢ per gig. Wow!
• The drive is backwards compatible, and can read any LTO-3 tapes created with the Quantum A-Series drives. This is very smart, because it means upgrading from the previous model is very easy.
• The file system on each tape is now an open standard, which was not true before. This means that you can exchange a tape with anybody who has a standard LTO-4 drive. In the past, you both needed to have a A-Series drive to read the content. This was one of my biggest concerns with this solution originally, and it’s nice to see it has been fixed. No need to be that proprietary.
• The file system supports original metadata from source files, and they’ve made it clear they are adding to this support in the future.

I have requested an evaluation unit once they’re shipping, and if I get my hands on one I’ll do a follow up hands on review of the drive. For the previous review that Scott Roberts did on the Quantum A-Series drive we currently own, check out his post.

Looking a little further down the road, there are plans for the LTO format to progress with LTO-5 and LTO-6. LTO-5 will have a capacity of 1.6 TB per tape, and LTO-6 will hold 3.2 TB per tape. Time will tell if the technology continues down this path, but so far history has proven this format to be very robust and successful.

The Workflow
So how do we use the drive in our post production work flow? Here are the broad strokes.

Deciding What/When To Archive
All editing projects are archived to tape once the project has been complete and unchanged for 3 months or longer. It’s usually flagged for backup right around the 3 month mark by the primary editor on the project after conferring with the client. The backup will include all elements in the job (with the exception of digitized or imported original camera media) as well as a final master QT export of the project in it’s original format. If the client would like to include original camera media, we will do so for an extra charge based on the amount of space they need. This process is quick and easy since all projects use the project folder system I outlined in a previous post.

Once a project is marked for backup (by using colored labels in the Finder) it is moved into a folder called “Archive-Projects”. On the first of every month our assistant editor Scott goes to each edit system, verifies that each project has a master export, and creates backup folders that each contain roughly 400 gigs of files. We’ve found from experience that pre-organizing the folders/files in the finder prior to backup works much better then trying to do it all during the transfer process.

Performing The Backup
At this point it’s a matter of putting a blank tape in the drive and logging into the drive using your standard web browser. Using the client side software through the web browser you start the transfer by a simple drag and drop.

It takes roughly 3 to 3.5 hours to fill a 400 gig tape, but since this can run in the background it’s no problem to continue working on the computer. Once the transfer is complete, you get a confirmation message telling you that everything was successful, or a list of any problems that occurred during the backup process.

Once the projects are all successfully archived (as verified by Scott), he then turns the folders another color, indicating to me that the projects are safely archived and ready to be removed. Where removing projects is concerned, I’m a bit of a control freak and prefer that I’m the only one that deletes project folders and media. If a mistake is ever made and something is deleted by accident, I would rather be mad at myself.

Removing All Project Assets With A Simple Search
For the last part of this process I sit at the edit computer and load all of the media drives in the office (we have 2 raid systems totaling 20 TB of space, but a few years ago we had several G-Raid drives on each system). Using the job number from each job that has been archived, I do a file search for any and all files related to that job number across all drives. By doing this, I am able to not only delete the project folder, but all render files, capture scratch, project archives and so on. Once I have them all in the same window I give them a quick review – and then select them all and delete them. I then move onto the next project and repeat the step.

Keeping It Accessible
You may be wondering how we find files once they’re on the tapes. After all, we have over 25 tapes now and finding a single QT movie would be a nightmare without some sort of system in place. Well that’s the final step.

As each tape is filled, we mount it on the desktop of the computer and use a program called CD Finder to create a catalog file of all contents of the tape. This usually only takes a few minutes per tape. Once complete, the tape is in the CD Finder database and can be searched from any computer in the office without the tape being loaded. Once we find what we’re looking for, we load the appropriate tape and retrieve the files. It has turned out to be a great system.

The Payoff
So in the end, we have all of our important files backed up and safe for the next 30 years, they’re cataloged in a way that allows us to find a file in minutes, sometimes seconds, and we’ve made a small profit along the way by charging for the backup process and tape stock used. What started out as just pure overhead has turned into a income stream.

The SuiteTake
The amount of digital media attached to any single post production project is growing leaps and bounds at an alarming rate. Only a few years back having 1TB of storage per edit system seemed like a bottomless pit, and now we have 10TB per machine and at times are running low on space. The list of files to archive keeps growing, and if your workflow has includes tapeless media you have probably already been pushed to the limit.

One way to stay on top of managing your space is to do regular archives to a safe format that not only frees up drive space for new projects, but gives you peace of mind that all past projects are there when you need them.

As much as everybody wants to move away from tape, I still believe when it comes to reliability, cost per gig and shelf life, there’s still nothing better out there to archive your data. And I have literally put my money and company behind that belief. If you’ve been looking for a long term backup solution, I highly suggest you check out the new line of drives from Cache-A. If you can’t see them at NAB, be sure to check out their website or call them directly for more information. You won’t meet a nicer bunch of guys interested in helping you out.

See For Yourself
As of this writing, prices have not been set yet but I’m hoping they’re in the same area (or cheaper) then what the Quantum drives were selling for, which was about $7K for a single drive unit. If you’re going to NAB, be sure to stop by and visit them at booth SL-9605.

About the Author

Thomas Tomchak
President and Chief Technology Officer of Edit Creations, Inc.

Tom has been working in the broadcast industry since 1987 and has extensive experience editing corporate, broadcast and documentary programs. Tom has worked with a long list of nationally recognized companies and agencies including, Young and Rubicam, J.Walter Thompson, United Airlines, Better Homes & Gardens, Sears, Lions Clubs International, and Warner Brothers. You've seen his work on CNBC, United Airlines in-flight programming and major market television stations across the country.

Today he continues to seek new business opportunities while working with Edit-Creations' ever-expanding client base.

See All Posts by This Author