Backups

On March 30, 2010, in Computers, by psu

You need to do backups. Back when computers were primitive and useless, backups were not as much of a problem because no one was storing anything in the machines. But these days, computers have grown up and it’s possible that your entire life is stored in your laptop. So you should back it up. I came up with the following backup scheme primarily to archive my digital pictures. But I think it’s useful for most general use too. The scheme sounds complicated, but it’s actually fairly simple.

Rule number one about backups is simple: don’t think. Back it all up. The less you have to think the better.

Rule number two about backups is that the best place to put them is on an external hard disk. In the old days, optical disks were big enough for people to consider using them, but DVDs only hold at most 8GB each which means it would take three or four to do a full backup of a circa 2001 Apple Powerbook with a 20GB drive. Disk storage has grown by an order of magnitude since then, so you are talking about burning a few hundred DVDs for a backup. I was too lazy to even do four back in the day. So avoid optical disks because they make it too hard to apply rule number one (backup everything).

The best thing about external disks is that they get bigger every couple of years. So every couple of years you buy a new set and copy all the old data to the new disks. This is rule number three about backups: no matter how you store the backups, the bits will rot. The only way to make sure they do not rot is to copy them over and over again. Copying everything to a new set of disks every year or two is therefore a good idea. Don’t worry about the cost, you can buy a terabyte external drive for $100 now. Compared to losing your entire digital life, that’s free.

The next best thing about external hard drives is that they are so cheap you can buy lots of them and use them for different backup purposes. At a minimum you should have two external drives that are about the same size as the main drive in the machine you are concerned about. My main machine is a laptop, so here is what I do:

1. Whenever I get a new laptop, I buy two bus powered portable drives that are about the same size as the main drive in the laptop.

2. When I get the laptop set up, I take one of these drives and make a complete bootable copy of the drive in the laptop. On Macs, there are various pieces of software that allow you to do this easily. You can use Disk Utility to do it. I use something called SuperDuper! because it has some other handy features. I then label this drive as the “mirror” drive. I carry this drive on trips in case the disk in the laptop goes bad and I need an emergency boot drive.

The mirror drive is also handy for when you need to undo some disaster that you have perpetrated on your main machine. You can mirror your machine before every major OS update, for example, in case you need to back it out. If it all goes bad, you can boot from your mirror and copy it all back to the main drive on the laptop. Macs make this easy. I would assume and hope that there is some way to do this in Windows too, but I don’t really know.

3. I use the second external drive for Time Machine. Time machine is handy for automatically keeping track of all the new files I’ve created without me needing to do anything. And it keeps multiple versions of all those files. So in a disaster, I can boot with the mirror drive and restore all my data from the Time Machine drive if the mirror drive is out of date.

My backup scheme follows this main pattern. I generally do a backup whenever I have a add batch of pictures to my laptop. I do this a lot, and digital photographs make up the bulk of the data that I want to back up, so this makes sense for me. Here is how the flow works.

1. Load pictures into laptop. Do all the picture workflow stuff on them.

2. Hook up the mirror drive. Sync the new data to the pictures folder there. SuperDuper! has an incremental update feature which makes this easy.

3. Hook up the Time Machine drive, let Time Machine do its thing.

At this point, the first level backups are done. But, there is more to consider.

In addition to the two small drives, I also have two large desktop drives that have my complete photo archive on them. The laptop and portable drives really only have enough room for a year or two of pictures, and I’m up to eight years of pictures now. These two large drives are specifically dedicated to the photo archive. So whenever I add pictures, I use a script to copy the new pictures to these drives. In addition, I keep one of these drives at work, just in case my house burns down. This forms the second level of my backup archives.

As a side note, the one time I had a serious disk crash (knock wood) on my laptop, it was the work backup drive that saved me from losing about a month of photos. I generally bring my laptop to work about once a week to sync it.

The fourth rule about backups is that if you can make two backups of something, it’s just as easy to make four. I have a desktop machine at home that is used mostly for iTunes. But I also use it as a third level of backups. Whenever I add pictures to the mirror drive, I also sync them to my home directory on the iMac. Then I let Time Machine on the iMac copy them to yet another external drive.

So now each new photo is stored seven times:

1. On the laptop.

2. On pocket drives #1 and #2.

3. On desktop drives #1 and #2.

4. On the iMac.

5. On the Time Machine disk for the iMac.

When I run out of space on the laptop and the smaller external disks, I delete older photos. So for the long term, I have the entire photo archive stored four times. As before, every couple of years I upgrade all these disks.

Most recently, I also decided to sign up for one of these online backup services. I picked Backblaze. I told it to backup my iMac to some data center somewhere. So if Pittsburgh burns down and takes all of my local drives with it, I can still call them up and get my photos back. It only took a month for the iMac to copy everything over the network.

To summarize. There are four things you need to know about backups:

1. Backup everything. Even what you don’t need. Backup the important stuff more.

2. Use disk drives. Other media are too inconvenient, which means you won’t make backups.

3. You must make new copies of the data every year or two. Conveniently, you need new disk drives once in a while anyway.

4. If you are going to back everything up once, you might as well do it twice. And if you are going to do it twice, you might as well do it four times.

 

5 Responses to “Backups”

  1. Jason says:

    I’m pretty sure Zeno would say that if you can back up twice, it’s just as easy to back up an infinite number of times.

  2. Benoit says:

    I was worried about single-planet backups so I hacked the mars rovers and I back up my stash of illegally-downloaded movies to Opportunity. And really, if you hack one rover, you may as well hack two.

  3. DMW says:

    Man, that’s thorough. So you haven’t had any problems with Time Machine? I wanted to have my backups happen wirelessly and automatically (for me, even plugging in one USB cable is too high an activation barrier). So I bought a Time Capsule (Apple’s backup drive slash wireless router), and my life descended into a nightmarish cycle of failed backups, mysterious console logs, and despair. On the plus side, I now own a distinctive white trivet. Maybe I should try this backblaze thing.

  4. psu says:

    I only use Time Machine with a drive directly mounted to the machine that is being backed up. I’ve never tried the Time Capsule, because the networked Time Machine backups work slightly differently and are a bit more difficult and flakey to deal with.

  5. Mark says:

    One important thing to note is that there are at least two hidden lists of file types that Time Machine will not back up, in addition to your manually created exclusion list. I discovered this to my misfortune when I accidentally deleted an application bundle I was working with and discovered that application bundles you build in XCode are on the exclusion list.