duplicity-talk
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Duplicity-talk] Re: Duplicity using more space than needed?


From: Fabiano Bonin
Subject: Re: [Duplicity-talk] Re: Duplicity using more space than needed?
Date: Thu, 28 Jun 2007 11:57:14 -0300

It is just one database file.
'snapshot1' and 'snapshot2' are copies of this same file in different times.
Your guess is right. It's a Firebird database file which changes in
small portions all over the file.
I also think the problem is related with the kind of this file in
particular, but what is strange is that rdiff generates a delta of
just 13MB...

I'm trying to reproduce this issue in a more generic way, creating a
file using 'dd' with random data, but up to now i had no success.

I can provide you in private a link to download a bzipped copy of this
file and rdiff's delta, if you need. It will have +- 350MB

Regards,

Fabiano.

On 6/28/07, Kenneth Loafman <address@hidden> wrote:
Thanks for the info!  It helps.

I am having trouble replicating this issue.  My backups have been close
to the same no matter what I back up.  What is the mix of files like?
All large files with small changes?  Small files?  A mix?

My guess is that a large file with small changes may be the issue, maybe
a database file or something like that.

...Ken

Fabiano Bonin wrote:
> Here is a test case, step by step, copy/pasted from my terminal, which
> shows this issue, and also shows files and folder sizes. It shows at
> the end it is not an accounting problem. I can send both the snapshots
> if someone needs to reproduce this test.
> I'm using duplicity 0.4.3.RC8, but the same problem is present in 0.4.2.
>
> address@hidden ~]# cd /var/tmp/testcase1
> address@hidden testcase1]# ll -h
> total 3.3G
> -rw------- 3 root root 1.7G Jun 20 08:41 snapshot1
> -rw------- 2 root root 1.7G Jun 20 16:32 snapshot2
> address@hidden testcase1]# rdiff signature snapshot1 snapshot1.sig
> address@hidden testcase1]# rdiff delta snapshot1.sig snapshot2
> snapshot2.delta
> address@hidden testcase1]# ll -h
> total 3.4G
> -rw------- 3 root root 1.7G Jun 20 08:41 snapshot1
> -rw-r--r-- 1 root root 9.9M Jun 28 08:56 snapshot1.sig
> -rw------- 2 root root 1.7G Jun 20 16:32 snapshot2
> -rw-r--r-- 1 root root  13M Jun 28 08:58 snapshot2.delta
> address@hidden testcase1]# mkdir /var/tmp/testcase1_source
> address@hidden testcase1]# mkdir /var/tmp/testcase1_destination
> address@hidden testcase1]# cp snapshot1 /var/tmp/testcase1_source/snapshot
> address@hidden testcase1]# duplicity /var/tmp/testcase1_source
> file:///var/tmp/testcase1_destination
> GnuPG passphrase:
> Retype to confirm:
> No signatures found, switching to full backup.
> --------------[ Backup Statistics ]--------------
> StartTime 1183032377.10 (Thu Jun 28 09:06:17 2007)
> EndTime 1183033364.78 (Thu Jun 28 09:22:44 2007)
> ElapsedTime 987.68 (16 minutes 27.68 seconds)
> SourceFiles 3
> SourceFileSize 1870516224 (1.74 GB)
> NewFiles 3
> NewFileSize 1870516224 (1.74 GB)
> DeletedFiles 0
> ChangedFiles 0
> ChangedFileSize 0 (0 bytes)
> ChangedDeltaSize 0 (0 bytes)
> DeltaEntries 3
> RawDeltaSize 9087984 (8.67 MB)
> TotalDestinationSizeChange 392502939 (374 MB)
> Errors 0
> -------------------------------------------------
> address@hidden testcase1]# du --max-depth 1 -h
> /var/tmp/testcase1_destination
> 376M    /var/tmp/testcase1_destination
> address@hidden testcase1]# cp snapshot2 /var/tmp/testcase1_source/snapshot
> address@hidden testcase1]# duplicity /var/tmp/testcase1_source
> file:///var/tmp/testcase1_destination
> GnuPG passphrase:
> Retype to confirm:
> --------------[ Backup Statistics ]--------------
> StartTime 1183033523.75 (Thu Jun 28 09:25:23 2007)
> EndTime 1183033726.08 (Thu Jun 28 09:28:46 2007)
> ElapsedTime 202.33 (3 minutes 22.33 seconds)
> SourceFiles 3
> SourceFileSize 1870516224 (1.74 GB)
> NewFiles 1
> NewFileSize 4096 (4.00 KB)
> DeletedFiles 0
> ChangedFiles 1
> ChangedFileSize 1768112128 (1.65 GB)
> ChangedDeltaSize 0 (0 bytes)
> DeltaEntries 2
> RawDeltaSize 5174784 (4.94 MB)
> TotalDestinationSizeChange 113601574 (108 MB)
> Errors 0
> -------------------------------------------------
> address@hidden testcase1]# du --max-depth 1 -h
> /var/tmp/testcase1_destination
> 485M    /var/tmp/testcase1_destination
> address@hidden testcase1]#
>
> As you can see, rdiff delta size is 13MB, while
> /var/tmp/testcase1_destination increased from 376MB to 485MB (109MB)
>
>
> _______________________________________________
> Duplicity-talk mailing list
> address@hidden
> http://lists.nongnu.org/mailman/listinfo/duplicity-talk
>


_______________________________________________
Duplicity-talk mailing list
address@hidden
http://lists.nongnu.org/mailman/listinfo/duplicity-talk





reply via email to

[Prev in Thread] Current Thread [Next in Thread]