Under the Desktop: Heading Off the Lost-Files Blues

In his premier column about keeping your hardware and system software up to snuff, David Morgenstern focuses on no-nonsense backup solutions and strategies.
Written by David Morgenstern on February 27, 2001
Categories: Hardware, Features

Related Articles

Related Reading

Following a few recent site visits and frantic phone calls, I identified a new form of amnesia effecting the creative community. Unlike the familiar syndrome where a person is struck on the noggin and forgets his or her past -- a plot device that has carried countless "B" movies and soap operas -- this new memory loss affects our perception of the present.

Specifically, the amnesia removes any concern for the survival of critical data, such as the files open on your desktop while you're surfing to see what's new here. Or better, the project at hand with a deadline in the next few hours or day. Could you recover this project in time, or at all, if something bad happened to the file? If your hard drive or system crashed? Right now, not later today or tomorrow. In the next few minutes.

If you are the always-prepared scout, then please feel smug. In the more likely case that you have no backup strategy and no way to reclaim lost work, then you suffer this amnesia syndrome. You may take some small solace in knowing you're not alone: One designer admitted he's recently put more cash and effort in storing his digital audio files than securing the work that puts bread on his table.

Branded
I suggest that minding the data integrity of current projects is an essential element of personal branding. What holds a customer to your business is more than great design and ideas. Customers care about their entire relationship with you and your firm, including their perception of your reliability, the archiving of completed projects, and your ability to meet or exceed their often-unreasonable deadlines. Clients care little if your system crashed or their project files were corrupted because of a rolling blackout, or that you lost all the e-mail messages holding the details of a project. What they want is the whole job done. Now. And done right, without any worries. Anything else is bad for your business.

Confidence in your brand, moreover, can anchor current customers and bring in referrals. The strength of your brand is critical in today's tough market. According to some reports, major content sites project this year's advertising revenues to fall 10 to 20 percent lower than last year's. To lose a client for some reason outside your control is part of business; to lose a customer because of sloppy data handling is tragic.

Short-Term Memory
One not-so-conservative approach to the issue of data recovery is simply trusting that when and if disaster strikes, you'll be able to reconstruct your projects easily enough by relying on your own memory. Thinking back to more than one painful experience, I'll admit to poor results when trying to recreate some inspiration or complicated task from memory. And file recovery programs such as Norton Utilities come with no guarantee of performance: The process can be lengthy, and the resulting files can be a mess or incomplete, particularly if the disk was written to after the files were lost.

The quick and easy solution is to create redundant copies on a second, high-capacity storage device attached to your computer, such as a second hard disk. The safest work habit is to save your files every few minutes and then copy the current document or project folder to the second drive every hour or so -- more often as your deadline approaches.

Using the Save As command in your current application may seem the easiest and most convenient way of creating this redundant copy, but it's also the fastest route to confusion: It's all too easy to find yourself working on a copy of the file rather than the original, destroying the whole concept of data integrity and file control. To avoid any ambiguity, I now click out of the application onto the desktop and simply drag the file icon to an alias or a shortcut on the target storage device.

Some applications, such as Adobe Photoshop, offer a Save a Copy command for this purpose. However, I still prefer saving the copies manually on the desktop. First, it's possible to slip up in the menu or keyboard and perform a Save As command. Second, I can remember the actual file name better than its "Copy of ..." version when viewing files by name. Third, my emotional confidence in the process is reinforced by seeing the copy process on the desktop.

The Hard Stuff
Whatever software approach you follow, your choice of backup hardware will play a huge role in determining the convenience, speed, and flexibility of your backup solution. Ironically enough, people can be passionate about backup solutions, and plenty of good approaches exist, but for fast, portable, low-hassle backups I prefer external FireWire hard drives, both for Mac and Windows platforms. I recommend an external FireWire drive with a capacity between 40 and 60 gigabytes.

The cost of these drives changes almost weekly, but it's safe to say that prices are quite good. A "clunky" 3.5-inch drive with a built-in power supply will cost less than $400, and for this purpose I don't see a need for using smaller, 2.5-inch lightweight drives, which cost more and offer less capacity. Users of many Windows machines and older Macintosh models will need to purchase a FireWire PCI adapter, which typically costs less than $95.

Buying an internal IDE drive for your system may work just fine for you, but I favor external drives for their flexibility in the event something does go wrong. For instance, let's say your system dies altogether: With an external drive, you could begin working with your project again in short order on another system. An external drive also gives you another way to move files between systems even in good times, when your hardware is behaving perfectly well.

FireWire Pros, Cons
Even if your machine has a built-in flavor of SCSI interface, FireWire is still a better solution to my way of thinking: Cutting-edge flavors of SCSI drives are faster, but they can also be very expensive, with a cost per megabyte roughly double that of FireWire drives.

Several vendors at last month's Macworld Expo demonstrated a new technology that should improve the performance of FireWire drives. FireWire hard disks combine an IDE hard drive with a small logic board that bridges the internal IDE and external FireWire interfaces. The first generation of these IDE-to-FireWire bridge chips lacked support for the Ultra DMA data transfer modes available in modern IDE drives, limiting sustained data transfer rates to less than 15MB per second. But the forthcoming second-generation chips will support speeds of up to 40MB per second, leading to as much as a doubling of real-world performance, depending on characteristics of the particular drive. ADS Technologies and Granite Digital were the first companies to announce drives with the improved bridge chip, and sooner or later all vendors will transition to the faster logic.)

Some readers will point out that almost everyone has at least one form of removable-media drive connected to their machine. So why bother with a FireWire hard drive when there's a CD-Recordable or ReWritable drive available, or the familiar Iomega Zip or Jaz? First, a single FireWire hard drive is easier to work with than the numerous removable cartridges or discs you'd need to backup the same number of files. And the high capacity of a hard drive gives you plenty of room to create multiple redundant copies of a project. (At the end of the day have you ever wished you could go back to the way your project was in the morning?) In addition, speed is essential when copying very large files, which leaves out CD-R, CD-RW, and hard drives connected with USB. In short, the fewer obstacles we put between ourselves and sound backup procedures, the more likely we are to keep ourselves out of trouble.

Building Your Own
A number of peripheral vendors now offer inexpensive SCSI-to-FireWire adapters that let you put an existing legacy drive to work, but most older SCSI drives or even small drive arrays lack the capacity available in a single modern drive. I am also concerned with recent reports of incompatibilities and driver conflicts with some of these connectors.

A more compelling choice may be one of the numerous offerings that let you add an IDE drive to an external enclosure that includes an IDE-to-FireWire adapter. If you take this approach with a new, fast, high-capacity IDE drive, the end result should be much the same as if you bought a high-capacity external FireWire drive, but you'll save yourself $100 or so on the hardware. Such IDE-to-FireWire enclosures are available from numerous manufacturers, including ADS Technologies, FireWire Depot, MacAlly, and others.

Finally, before purchasing a FireWire hard drive, host adapter card, or build-your-own enclosure, get assurances from the vendor's technical support that the solution will work with your computer and operating system. For example, some devices on the Macintosh may have trouble running under Mac OS 8.6 or the new 9.1 update. And on the Windows side, some vendors may have conflicts with Windows 2000 or with other hardware.

Ancient Wisdom
Having run into my own little data-loss disasters here and there over the years, I've come to believe in the approaches I outline in this article, but no one backup approach or solution will be the best for every user. Precisely how you prepare for disaster isn't important as long as it allows you to save your work frequently -- and to salvage it when something goes horribly wrong.

In case my admonitions seem like overkill to some (or most) readers, I'll fall back on the wisdom of the sages. As the Talmud says: "Don't worry about tomorrow; who knows what will befall you today?" Believe me, one of these days, worrying about your data will pay off.

This is David Morgenstern's first column for creativepro.com. He is a a freelance writer, editor, and branding consultant based in San Francisco.

1

true, oh so true!

enjoyed this article...it is so true...who has't suffered through the demise of a lost file...and better safe than sorry...it is imperative to get into the habit of saving every few minutes...after a while it becomes second nature...punctual saving to a good secondary source will keep a smile on your face!..i look forward to future articles.

2

Harware is just the begining!

I am writting this from the view of a single user not a small or large business. While I find that backup is the single most important process I do I had troubles finding the "software solution" that I felt comfortable with. In the end I determined the following guidelines. 1.) DO NOT use a program that writes the backup in to any kind of propriatary file system, where you need that program to do a restore. The best kind of backup is a straight COPY, you can then go get backup files using windows explore or what ever file manager. 2.) Stoarge is Cheap. So! I ended up using a File-Synchronization program called InSync from dillobits.com. I have and old desktop box on the network with 2 15GB drives and this program can sort thru my 10GB's of files and copy the changed and new files in a flash.
Backup is about software! tom@nspn.com

3

Backup strategies deserve a more in-depth look

The sell on the article was a little misleading, which really is probably not the author's fault.

The most important part of a backup strategy, IMO, isn't the hardware used in the backup, although convenience is important. The most important part of a backup strategy is the day to day operation, which wasn't really explored fully in the article. Having implemented backup strategies for several large clients, I feel that a more complete article would at least have diagrammed the author's favored process and contrasted it with a diagram of several other favorites. A diagram of the process is essential to determining that available resources are being utilized as best they can.

Often clients are limited both in the time they have to address daily backups and in the processor and disk time available to achieve it. Determining priorities for data is important--the largest portion of most client's backups are static and thus only need to be performed once (with one or more duplicates made depending on the value and ease of replacement of the data in question).

Of course, this brings up other concerns for design firms. For example, do we store all images in one central image repository or do we store them on a per job basis? Most project flows can be adjusted to fit either strategy, but some may not be a good fit. Backup strategies end up influencing actual project workflows as much or even more than workflows influence backup strategies. Mostly because clients in need of direction usually have workflows that developed without any backup strategy in mind.

While more complex backup systems take longer to restore I would recommend that most clients do not attempt to utilize the strategy favored by the author for anything other than a temporary per-job backup meant to be replaced at the end of the day by an integrated backup strategy.

4

Off-site backup

Better still, removable FireWire drives are also a good solution for fast and easy off-site backups. At night, I simply take my 2nd drive (=3rd copy) home to safeguard against fires or burglary. Very easy, fast and cost-effective.

5

There is a better way to back up than suggested.

Having had the initial duty 5 years ago of setting up a backup strategy for our agency, we have learned what works and what works best. While I strongly agree with author regarding the establishment of a reliable backup system, I disagree with his solution offered. Adding on an external large capacity hard drive is a start, but it is not optimum. What happens when that hard drive fills up? Do you keep adding expensive drives into the loop? And, what about the human factor? Just because you have a large capacity hard drive doesn't mean you'll REMEMBER to back up. So, here is the solution I offer. Install a tape backup system which gives you ongoing unlimited capacity at a very reasonable per megabyte cost. We recently installed an Ecrix (www.ecrix.com) VXA-1 tape drive with a 33/66 GB capacity. It's fast, it's quiet and it's got big storage capacity. Although the tapes may seem a bit pricey, you are capable of storing 6600 MB worth of data on a single tape. That works out to .011 per MB. We purchased this product after reading a review in Macworld (which gave it 4 mice) and have been extremely pleased with it. Unlike our previous 2GB tape backup drive, the Ecrix doesn't require the expensive and vulnerable tape head alignment system which adds considerably to its dependability. So, for the money, you can't beat it. Now, for the second part of the backup strategy. The actual backing up. Human nature is such that even though you have good intentions of backing up, it won't happen on a regular basis. So, an AUTOMATIC backup procedure is needed. For that, Dantz Development Retrospect (www. retrospect.com) works flawlessly every time. You simply tell it when you want it to back up after hours and it will backup only the folders you tell it to. It will even shut down your computer after it does its backup. To retrieve data, it's a simple process as well. It will back up a single computer, or an entire network. We NEVER lose data. EVER. One last thing...you need a system of protecting your tapes from fires, earthquakes, etc. I suggest at least purchasing a small fire rated safe box to lock them up in. Our agency is located in a converted bank, so we have the luxury of locking our tapes in one of three walk in vaults. We habitually place the tapes in the vault and lock it everyday. That way, if we were to have a fire (or tornado in our neck of the woods), we would just replace equipment. Data can never be replaced.

John Chrise
Art Director/System Manager
Idea Bank Marketing
John@ideabankmarketing.com

6

Back-ups have saved my day

I have long been a proponent of a good, solid back-up regime, and many of my projects have been rescued because I was diligent in my back-ups. I agree with the reader who applauded the permanence of CDs, but on my set-up, I am prevented from accessing anything else on my computer while burning a CD, and I just can't afford that downtime as frequently as I do back-ups. I believe a combination approach is best. During the day I make frequent back-ups to an external FireWire drive, and at night or at the completion of a particular project, I burn a CD.

Jane Osborne
Graphic Designer
Robbins Scientific Corporation
josborne@robsci.com

7

The author responds

I appreciate all the feedback to the column. My goal for the piece was not to provide a be-all-and-end-all guide to backup and archiving data -- that would be impossible within the format. However, I plan to address these and other issues in future columns. I hoped to persuade readers that there is a simple, easy-to-implement means to create "informal" working backups in a workflow. A backup that can save your ass when the deadline looms and a bad thing happens. This quick saving of a file to another media is no substitute for a formal end-of-the-day backup to media such as tape. Nor is it a substitute for archival to CD-ROM (BTW:there ARE problems with writable CD media in the short and long term, but that's grist for a different column).

In addition, the column aims to place working backups as a consideration for an individual's branding and bottom-line. I disagree with posters who consider this a done deal with users. I constantly meet creative professionals who seldom back up, don't archive work and who miss deadlines and jobs because they've crashed. They even don't hit the Save key-combo often enough for me.

Just the other day, I spoke with a professional photo restorer at an antique show. Her creative work was fantastic, but she admitted that she had lost days of work when something or other spooked her then new PowerMac G4. And ironically, her sideline is running training classes at a local college! She should know better, we might say, but her what-me-worry workflow is typical.

As jfbiii mentions in a post above: the most important thing about a backup strategy isn't just in the hardware. It's the doing that counts.

thanks for reading,

daviD m.
--
"The chief thing is not to study but to do." -- Sayings of the Fathers, 1: 17.

8

after 1 HD crash in 5 years (20 Mac yrs.) we wished we did full

We used to only do random tape backups & burn final projects onto CDs until one designer's HD went. We lost alot of important files that were not backed up...he was to do a tape backup that morning (after 2 weeks since the last one), but an assignment made him forget it (he figured later that day if the job was completed by 4:30) until it was too late.

9

More over...

As I think the areas of importance that are missing in the article are well-covered by submissions by John Chrise, Tom Hiatt, jfbiii, and Mercury (Ouch! But hey, he's honest), one other thing comes to mind that's worth mentioning...Creative staffers generally share common assets and regularly require re-aquisition of content sometimes years later from its initial backup. Without systematic and sensible department-wide folder structures and naming conventions, retrieval of assets in Retrospect can be a time-consuming and fruitless task. With the proper hierarchy and procedures implemented throughout a creative department, Staffer A can easily retrieve content Staffer B had developed and backed up a year ago or more without consulting him, or anyone for that matter, as to it's file name or location.
While I agree with the author that it's about the "doing" that counts, retrieval of content from a procedure as the author describes by someone other than the originator could be seriously problematic. The "doing" has to be about process and strategy, not just a physical transfer of files from one volume to another, firewire or otherwise. If that is sound, the hardware will do its scheduled backup thing completely in the background, flawlessly, everytime while still allowing retrieval by anyone to be painless.
It's great to know your content is safe. It's another to have to spend hours looking for it in a retrieval because you and/or your department has no logical folder/backup structure.

Thanks,
Scott Mowry
Director New Media
Highlights for Children
samowry@highlights-corp.com

10

Backup is not confined to computer data

I would like to add that backup is useful for lots of things besides computer data.

A few years ago, the pastry chef at a world-famous San Francisco Bay Area restaurant was writing a cook book. Her source was her recipe file, which she carried in her purse so she could work on it at home.

When the purse was stolen, she, of course, lost it all. It is not known whether thief's goal was the recipe file or just money. The newspapers never reported whether she was able to reconstruct the file from her memory.

When I tell people this story, they often make some expression of sympathy, such as, "Isn't that terrible!" I reply that I have no sympathy, and they should not either. After all, she could have ensured safety by duplicating the whole thing at a copy shop for 10 dollars or so.

This is a great story to convince computer novices to back up continually. It is also a reminder that things besides data files need to be backed up.

Yours
Leonard Morgenstern

11

Why not just call this 'Firewire for you'

It took you too long to offer the advice "Got Firewire?". The best backup is automatic backup that doesn't require you to remember it. It's the process that is more important. Use Retrospect or Backup Exec and automate your back up. Backup Exec will even back up open files.

Also, I've never seen CDs go bad, but I've seen plenty of hard drives go bad. Off site is even better.

After you've decided on a plan, test the plan - under the worst conditions.Can you recover the data you need?

As an article on backup, this article was sorely lacking any real "meat". This article looks like it was written by a high school student the night before it was due. I expect highr standards from creative"pro".com.

I've worked in data backup for 5 years for PC/Mac in the PrePress and Publishing Industry.

12

Why not just call this 'Firewire for you'

It took you too long to offer the advice "Got Firewire?". The best backup is automatic backup that doesn't require you to remember it. It's the process that is more important. Use Retrospect or Backup Exec and automate your back up. Backup Exec will even back up open files.

Also, I've never seen CDs go bad, but I've seen plenty of hard drives go bad. Off site is even better.

After you've decided on a plan, test the plan - under the worst conditions.Can you recover the data you need?

As an article on backup, this article was sorely lacking any real "meat". This article looks like it was written by a high school student the night before it was due. I expect highr standards from creative"pro".com.

I've worked in data backup for 5 years for PC/Mac in the PrePress and Publishing Industry.

Login

Login to post a comment. Not a member? Sign up here
You may login with either your assigned username or your e-mail address.
The password field is case sensitive.
Forgot your password?