[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Duplicity-talk] Do backup to or restore from S3 get slower as a buc
From: |
Andrew Pimlott |
Subject: |
Re: [Duplicity-talk] Do backup to or restore from S3 get slower as a bucket increases in size? |
Date: |
Sat, 15 Jan 2011 20:45:32 -0800 |
User-agent: |
Sup/git |
Excerpts from Brandon Simmons's message of Sat Jan 15 11:49:44 -0800 2011:
> It seems that if duplicity is using the archive directory to store
> metadata that it wouldn't matter how many files a bucket contained, in
> which case the slowdown I'm seeing is from some other factor.
>
> Can someone provided an explanation of what operations might be
> affected by number of files in the repository bucket?
I've learned (unhappily) that duplicity does a full file listing. This
loses badly for some backends, probably including S3. I don't know why
it doesn't just use its own metadata.
Andrew