Re: [Duplicity-talk] Resumption and fulls with large backups.

[Robin Lee Powell]

On Wed, Aug 12, 2009 at 06:55:08AM -0500, Kenneth Loafman wrote:
> Robin Lee Powell wrote:
> > On Tue, Aug 11, 2009 at 01:13:48PM -0500, Kenneth Loafman wrote:
> >> A full backup, by definition, backs up all the files, so yes, a
> >> full backup copies all the files.  
> > 
> > Yes, but many backup system look at the previous full, and keep
> > files that haven't changed, without retransmitting.  We're
> > talking about 700 GiB of data; copying all of 700GiB (to S3 no
> > less) takes a *very* long time.
> 
> I don't know of those backup systems.  Without something on the
> remote to manage the backup volumes, 

Ah, right, that makes sense; the sorts of things I'm thinking of
collect all the files on a master server, and then (maybe) copy it
off site or to tape OSLT.

> > We're only copying the data generated by the application; we're
> > not touching the OS at all.
> 
> That's a fair amount of data.

Oh, *believe me*, I know.  And the client in question didn't tell us
they wanted backups until it was already at that size.  -_-

I think we're going to have to not go with duplicity for this one;
retransmitting 700GiB once a month isn't really very feasible.  (We
use duplicity for the rest of our backups at my work, fwiw)

-Robin

-- 
They say:  "The first AIs will be built by the military as weapons."
And I'm  thinking:  "Does it even occur to you to try for something
other  than  the default  outcome?"  See http://shrunklink.com/cdiz
http://www.digitalkingdom.org/~rlpowell/ *** http://www.lojban.org/