Open Source Backups Ignoring Open Standards

by Derek J. Balling

I work at a moderately sized private college in the Hudson Valley region of New York State. We've got a potpourri of systems, including some Red Hat servers, some Solaris servers, a couple Windows servers, some Mac servers, but predominantly, our needs are met by our old standby - Debian.

We have a lot of servers. Not a lot as might be defined by a former employer of mine, but certainly in terms of data, there's a lot. We back up a couple terabytes of data every week.

We've cobbled together this backup system over the years (and by "we" I mean the college and my predecessors). It works great, but it's definitely sub-optimal, requiring loving care and attention, which is something you really don't want from your backup system. You want your backup system to just work (and of course, you schedule random tests of your backup system to assure that this is the case).

But we started to need some features we couldn't cobble together any more, like NDMP support, and so we started looking for alternative solutions. Things more sophisticated than a collection of Perl and Bash scripts.

So I went to yesterday afternoon's "Open Source Backups" session with a lot of hope. I hoped I'd find something that would meet our organization's needs. They're not that complicated -- back up the various servers to our TonsO'Disk® servers. Archive that disk storage to tape for offsite vaulting. Then back up our (separate) NetApps to tape using NDMP, and offsite those tapes. That's not that hard, I wouldn't think. Day-to-day restores come from the local disk backups, and the tapes are strictly for DR purposes.

Except, of course, that there's no open source product that does these things. Bacula doesn't support backing up to disk(?!?). (Updated: OK, it does support backing up to disk, it's just not really in an intuitive place in the manual so I didn't see it.) Amanda does, but it does so in such a kludgy fashion that I wouldn't even consider it. Oh, and Amanda likes to think it knows better than I do when it should be doing full backups instead of incrementals, etc. Because why should I know better than it does when the system is under lower demand, or when the disk isn't being hammered by other tasks, I'm only the SysAdmin after all.

But worst of all these crimes against humanity is that neither of them supports NDMP. There's an open standard out there -- and one that's been around for quite some time -- and neither of the open source products supports it. If I want support for the open standard, I have to used closed-source software. Where's the logic of that?

Sure, the standard mantra of the Open Source community is "patches welcome", but what that really means is "unless you've got programmers on staff who can make this work for you, you're going to send money off to (Veritas,IBM,CA)[rand] and pay them to do it for you, and get something that's going to make management more warm and fuzzy than the Open Source solution was going to, anyway."

Because, sadly, that's what I have to do when I go back to work next week - find which closed-source company I plan to give money to.

What's a poor sysadmin to do?


7 Comments

mfflynn
2005-08-04 11:59:37
You're not the only dissapointed one.
If you ever do find a good open-source backup program...please share the wealth. We run Amanda at our office and though some don't mind it, I wish we had something that was better.


Very frustrating.

danlangille
2005-08-05 03:34:59
Bacula does do disk
Bacula does do disk. A quick google would have told you that:


http://www.bacula.org/dev-manual/Automated_Disk_Backup.html


Or you could have read my Bacula article:


http://www.onlamp.com/pub/a/onlamp/2004/01/09/bacula.html


Have you tried Bacula?

dballing
2005-08-05 16:17:34
Bacula does do disk
Bacula does do disk. A quick google would have told you that:


http://www.bacula.org/dev-manual/Automated_Disk_Backup.html


I guess I would have expected that to be somewhere more intuitive in the Release manual (which I looked over). e.g., that there would be a section right there next to "backing up to single tapes", "backing up to autochangers", and then followed by "backing up to disk".


But (and maybe I'm missing it), can Bacula do:


  • "Archive this backup to tape"

  • NDMP
danlangille
2005-08-06 04:36:36
Bacula does do disk
I guess I would have expected that to be somewhere more intuitive in the Release manual (which I looked over)


It is also in the release manual. http://www.bacula.org/rel-manual/What_is_Bacula.html


Right there, under "Bacula Components or Services": 'In other words, the Storage daemon is responsible for reading and writing your tapes (or other storage media, e.g. files)'


Bacula backs up to a volume, be that tape or disk. They are both the same to Bacula.... Again, that is in the documentation.


I hope the false statement in the article is soon corrected.

danlangille
2005-08-06 04:42:28
Bacula does do disk
Sorry, I missed your questions.


"Archive this backup to tape" - I think that is called a "migration".


"NDMP" - No. Sounds nice. I think you're the first to ask about NDMP with respect to Bacula.

dballing
2005-08-08 03:35:11
Answers
"Migration" -- where is that described in the manual? I see a couple references to it as a "type", either in a config definition or in the schema, but no real description of how it works, usage examples, or anything like that (at least, not that the google search of bacula.org found)


NDMP -- Pretty please implement soon? It would certainly put Bacula in a class with the professional products and would (in the end) make it perfectly acceptable for our purposes here.

Anna
2006-06-01 08:49:02
Absolutely!


I've been banging my head against the wall trying to get a NAS to backup using NDMP using commercial software... and still without success. With such hardware setups becoming more common, there is a growing need for an open source NDMP capable backup solution. I very much hope that we will see one soon.