Backing up and syncing data

I was having a conversation recently about backups, and how Dropbox is great for ensuring that you don’t lose valuable files. However, the free version of Dropbox can only handle a maximum of 8Gb, and once you start looking at music and photographs then I think most of us would probably need a paid Dropbox account to make this method worthwhile.

Alas, the paid Dropbox accounts only come in 50 or 100Gb denominations, and can come across as quite pricey. I think there’s certainly a market for smaller and cheaper paid options, and I think that a 20Gb account at a reasonable price would get a lot of interest.

But yes, I digress. I though what would be useful (for me at least) would be to detail how I back up my data, and also how I sync it between the various machines I use (which is part of the same process for me).

I’m a great fan of Dropbox, and I use it to sync data between my machines and to collaborate with people on all sorts of work and non-work projects. What I keep in Dropbox is anything that might change, or that I will need to access on all my computers. This largely boils down to:

  • Work related documents that I need to share or collaborate on with my co-worker
  • Anything else I’m collaborating on
  • Anything that is an editable file (generally anything created with OpenOffice.org or Microsoft Office)
  • Documents I’m currently writing (usually as plain text files, unless they are collaborations)
  • PDFs of books/documents I’m currently reading
  • Useful phone numbers, next of kin details etc.

I also sync my browsing history and bookmarks through Firefox Sync, meaning that on a new/reinstalled computer I just need to install two applications and I can have a fair approximation of my most useful data within a few minutes, regardless of what operating system I’m using.

For actual backups I have a 2Tb NAS (Network attached storage) that backs up my Ubuntu laptop via DejaDup, and my Mac via Time Machine. All my other computers just reply on Dropbox and Firefox sync. I also maintain a few directories available to either just myself or to everyone on our home network. These are things I might want access to occasionally on multiple machines, but that are too weighty for Dropbox:

  • Photographs
  • Books
  • Music
  • Videos
  • Linux disc images
  • My .virtualbox file containing my virtual web server and a few other things

These total about 200 Gb, and I can access them from anywhere on our network (and further afield if I wished to configure the NAS to do so, which I don’t). Each of these items exists on one of my other computers already, but the NAS represents a repository of everything, and would be the one thing I’d save in a fire to ensure I had at least one copy of everything that was important.

I also have a 500Gb portable hard drive that I manually back up things to sometimes, but that I largely use when I’m away from home and want access to more movies and music that I can sensibly fit on my netbook.

I used to have a very complicated email backup system, but since I switched to Google Apps then I tend to let Google do most of the work and just back up my mailbox as part of my DejaDup/Time Machine backups. I also dump a copy of all my useful documents into Google Docs occasionally, and use it largely for real-time collaboration (which Dropbox can’t really handle).

So yes, that’s about it I think. I wouldn’t recommend this for everyone, but it certainly seems to be working for me at the moment.

My first stab at self-interview

In my last post I mentioned The Setup. This is my attempt to answer the questions.

Who are you and what do you do?

I’m Andy, and I work for IT Services at the University of Birmingham in a Service Desk management/development role. In my spare time I listen to and write about music, dabble in free and open source software (mainly Ubuntu), and am sporadically involved in the Isles of Darkness live action roleplay society.

What hardware are you using?

At work everything is largely generic. I have a Dell desktop that is coming to the end of its life, but that is still more than capable of dealing with most of my emailing and calendaring needs. It is plugged into a 17″ Sony monitor that has been with me for about 4 years now, and which I keep holding on to as it is one of the few desktop monitors I’ve used that doesn’t give me a headache after hours of staring at it (yes, I know a new monitor and more breaks might be a more sensible plan).

Most of my actual work is done on an (again) fairly generic Fujitsu Siemens laptop, which I started using a couple of years ago, and which allows me to type for hours without my wrists hurting. I wouldn’t recommend this laptop above any other, but it does the job.

At home I have pretty much left desktop computers behind. My main workstation is a Sony Vaio VGN-NS10l (dual core, 4Gb ram), which I bought a couple of years ago and deals with anything I throw at it. I’ve also got a 10″ Dell Inspiron Mini, which goes everywhere with me, and is increasingly becoming the computer I do most of my web browsing, email and writing on. My backup machines are a G4 iBook and a EeePC 701, and we’ve also got another Mac and a Wii plugged into the TV downstairs. My wife has several other computers which I’ll not mention here except to say that we have more computers than there are rooms in our house (by quite a lot). And that’s not counting the ones that are propping open doors or otherwise not really being used for anything productive any longer.

And what software?

Work is a mix of Windows XP (desktop) and Ubuntu 10.04 (laptop). In Windows I largely use Outlook for email and calendaring, office communicator for collaboration, and very little else. In Linux I use Firefox for browsing (with Chrome and Epiphany for testing), Evolution for email, Empathy and Dropbox for collaboration, OpenOffice.org for creating documents and spreadsheets, and (generally) Bluefish for coding. Recently I’ve been using GIMP a lot too, and have also been dabbling with a few command-line image conversion tools. I also maintain several instances of Mediawiki, as well as a full LAMP environment for development, and use google calendar to plan and maintain my work-life balance.

At home both of my laptops are running the latest version of Ubuntu, which I’ve used as my primary OS since 2005. I use largely the same software as I use at work, although I’ve recently reverted to using gedit for writing blog posts and other bits of text, and only venturing into OpenOffice when I want to make something available to other people. Home is also where I spend a lot of time playing with WordPress and Virtualbox, and where I use Rhythmbox to listen to music (and Last.fm to catalogue what I’m listening to). I’ve also recently started using Google Reader, and I now don’t know how I coped without it.

My Macs run a very stripped down version of Leopard, and really only get used for iTunes and other media related things now (although I’d still use my iBook as my main portable computer if it weighed a little less). They also run Dropbox (as does every computer I own), and I’ve been syncing all my important files between all my machines for a couple of years now. I still can’t understand why more people don’t do this, and I’ve lost count of the number of times this one piece of software has got me out of a hole.

What would be your dream setup?

I change my mind about my ideal working environment a lot, but what I basically want is a laptop that is thin, light and stylish, and that can perform at the level where I could use it as my only computer (including storing 100gb of music). The nearest thing I’ve come across is the 13″ Macbook Pro, although I’d be happier with something the size and weight of my 10″ Dell Mini with all the power and stylishness of the Macbook Pro. Being able to run OS X and Ubuntu at the same time would also be great.

Of course, having used an iPad for the first time recently, I’d probably have to add that to my wish list, just because it’s a really stylish and functional piece of kit.

I also wonder if having a desktop computer with two large monitors would make me more productive. I have a feeling that most of what I do can be achieved on a single small screen, but it would be nice to have the opportunity to experiment with these things.

Question format borrowed from The Setup under the Attribution-Share Alike license.

Synching with folders outside of /dropbox

This could probably be summed up in a few words (the words being “use symlinks”).

Basically, what I wanted to do was to sync several folders outside my dropbox folder (for various reasons). The solution was to create a shortcut in the folder I wanted to sync, and then moving the link to my dropbox folder.  This can be done of the command line by typing something like:

ln -s /home/folder/to/sync /home/andy/dropbox/synched_folder

This could be used in all sorts of ways, some of which I may blog about over the next couple of weeks.