∅ the empty set

Backup revisited

Server and RAID enclosure

I've recently fine tuned my overall backup strategy and finally found a balance between efficiency, security and ease of use that suits me. As you may or may not know, I'm a paranoid sucker when it comes down to backup. I've sadly seen too many disks crash over the years to know that sh*t happens. The main issues I had were related to running automatic unattended backup, off site rotation of a full copy of the backup, and overall reliability.

My situation is not exceptional: I have a server in the office serving my files, svn repository and development websites to a Mac Pro in the office or a MacBook Pro out of the office.

The general idea is to have my project files and assets available at all times should I be in the office of not. The resources need to be available at all times as I don't always work in the office. A VPN connection secures me in when I'm out, and svn over ssh gets my files in and out securely.

The server uses two RAID 1 arrays (mirrors), one for production and the other for backups. I use a Sonnet Fusion D400 to store my drives which connects through eSATA to a dedicated controller in the server. The production array hosts all my assets, projects, svn repository and files, while the backup array stores a mirror copy of the production array and of my different computers hard drives. The backup array is bigger (500Gb) that the production one (300Gb) as it must contain the backup of the server as well as those of my workstation and notepad.

Rotate off site

I use SoftRAID 3 to manage the arrays. Not only do I find it reliable and easy to use, but it essentially enables me to have a 3 disk mirror array for backup. Two disks are online while the third is stored securely off site in a read-only mode (see the user manual for more details). The secondary disk is swapped every Monday morning and brought up to sync automatically.

The backups are performed by SuperDuper. I've given many other software a try, but SD comes out a winner (for me), even over Unix favourites such as rsync which unfortunately tends to be buggy on Mac OS X. Joe Kissel in his excellent book on Take Control of Mac OS X Backups says:

“Unfortunately, Apple’s rsync is several years out of date, fails to copy several important pieces of metadata, and is reputed to be crash-prone. The developer of RsyncX created his own version of rsync, which gets rid of some problems of Apple’s version but adds a few more. And there are at least one or two other versions of rsync that similarly offer different trade-offs of capabilities and problems.��?

Page 161

On the downside, in order to use SD's Scheduler, the account used to configure it must be logged in. Although I don't like the idea of my server being “open��?, direct physical access to it is limited, so it's a small price to pay. On the workstations the problem doesn't occur as they are shutdown after backup.

Another downside is that you need to turn the option “Copy ACLs��? off otherwise a bug in Apple's ACL Copy code crashes SD. Dave Nanian of Shirt Pocket said their development team was working on replacing their calls with their own as Apple doesn't seem to want to fix it. All we need is a command-line interface and I'll will definitively be the best (for me).

Duplicate

The backups (read duplications, as I don't archive incremental or differential copies of files) are performed on a daily or weekly basis depending on their usage. The RAID is backed upevery evening and the server's startup disk (non RAID) every week. I launch the Mac Pro's smart backup when I leave the office, and trust SuperDuper to shut them down after completion. The MacBook Pro gets backed up either at the office or at home when I feel it needs to.

A sweet addition to this configuration is that in case of duplication failure, Growl notifies me by e-mail via the MailMe display style. If you wanted, you could have instant SMS notification by using an e-mail to SMS portal such as World-Text for instance.

superduper_growl_notification.png

This solution works for me at the time of writing, it might not for you, and I might have changed in a year from now. But I have redundancy for maximum availability and uptime and off site storage for disaster recovery with a minimum of manual intervention.

Ø permalink: https://davidroessli.com/logs/2007/10/backup_revisited/


Reponses to “Backup revisited”

#1 by Adriano Marián

17:01 on 19 October 2007

I've been using softraid, but I'm unable to split a mirror drive as you describe. I get a "Drive in use" message. Any idea?

#2 by David Roessli

17:11 on 19 October 2007

@Adriano: did you quite all running apps? If so, you probably have a service accessing the drive (filesharing most probably).

Here are the steps I follow on my Mac OS X Server:

1. Open server Admin;
2. Stop file sharing services (AFP, Windows);
3. Open SoftRAID;
4. Split MIrror Volume Backup into “Read-only Secondary Disk��?. Two disks with the same name will appear in the Finder. One has a padlock, that is the secondary drive;
5. Unmount the padlocked volume and remove physically the disk from the system;
6. Insert the other secondary disk. It will appear as locked volume in SoftRAID;
8. Click it and select "Convert Read-only Secondary Drive" from the Volume menu;
9. A dialog box will ask you what to do with it. Select “Add to original mirror��?. The secondary disk will then synched;
10. Restart file sharing services and resume normal life.

If you're not running Mac OS Server, turn the file sharing services off from the System Preferences > Sharing pane.

#3 by Deb

20:49 on 10 November 2007

David,
Thanks for posting this article on how your use SoftRaid and Super Duper. (I found you after plugging in several combinations of keywords into Google - whew!) My mercury elite plug-n-play that comes with SoftRaid should be coming soon as I'll be using that to back-up everything from my computer hard drive and any external drives off the computer. I had heard I can use Super Duper to schedule but still have to figure it out exactly how to do that. Looks like a lot of user manual reading is in the near future (grin). I'm used to having a help desk and recently became my own tech support - oy. Thanks for the other tips and letting me know it can be done ;-)
Deb

#4 by download privacy

07:20 on 22 June 2015

Do you have a spam issue on this website; I also am a blogger,
and I was wondering your situation; many of
us have created some nice procedures and we are looking to trade methods with other folks, please shoot
me an email if interested.

Post a comment

(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)



Previous: Wrapped up in Hamed Bouzzine's Moroccan tales

Next: Raspberry sky


About

Hello, my name is David Roessli. I am a freelance web designer and developer based in Geneva, Switzerland.

This weblog is an nth attempt to solve my multiple online personalities and weblog/rss feeds burnout issues. (more)

Words

I have been contemplating the idea of upgrading my desktop Mac since this spring. The latest 27" iMac (Quad-Core) seemed the perfect candidate, but the release of Apple's 27" Monitor last September made me stick with the Mac Pro...

Music

The autopsy of an iconic album cover picked up on Kottke.org. A stacked graph of successive radio signals from pulsar CP 1919, in a 1977 astronomy encyclopedia that originated in a 1970 Ph.D. thesis. Fascinating <3...

Pictures

Check out my latest Flickr ramblings. Mostly day to day cameraphone pictures stolen here and there.


© 2000-2016 David Roessli | v4.1 | as valid xhtml and css as possible | hosted by pair Networks | RSS feeds.