Re: [rdiff-backup-users] newbee

[Max Waterman]

2008/10/30 Matthew Miller <address@hidden>:
> On Thu, Oct 30, 2008 at 09:43:52PM +0200, Max Waterman wrote:
>> > How much different are they coming out?
>> $df -kl
>> Filesystem           1K-blocks      Used            Available   Use% Mounted 
>> on
>> /dev/sda1            148992316   116049508  25434032  83%   /
>> $ sudo du -sk /mnt/backup/root
>> 204348936    /mnt/backup/root
>> The difference is 88299428KB.
>
> can you do du / so we have number calculated exactly the same way to compare?

Hrm, but wouldn't that include all the different filesystems?

In any case, I think the output below means this isn't necessary...

>
>> > How many files do you have?
>> $ sudo find /mnt/backup/root -type f | wc -l
>> 3566531
>
> So, kind of a lot. And actually, I don't mean just type f. What does df -i
> show you? My root filesystem has about 150,000 inodes used....

Ooh, I didn't know about that command :)

Filesystem            Inodes   IUsed   IFree IUse% Mounted on
/dev/sda1            9388032 1196174 8191858   13% /
/dev/md0             30531584  389598 30141986    2% /mnt/array
/dev/mapper/backupVG-backup
                     30531584 4807888 25723696   16% /mnt/backup

/ -> /mnt/backup/root
/mnt/array -> /mnt/backup/array

sda1+md0 = 1196174 + 389598 = 1585772
but
/mnt/backup = 4807888

However, I think /mnt/array back been backed up several times already,
so perhaps that accounts for the difference, and the rdiff-backup
files, of course.

>
>> > What does rdiff-backup-statistics say when run on the backup dir?
>> I tried to run this, and it's been going for several hours already and
>> is eating tons of memory (over 2GB). Since the system is swapping like
>> crazy, I don't think I'll let it run any more. Perhaps I'll give it a
>> try at the weekend when no one is using the system. What sort of
>> output should I expect?
>
> Something like:
>
> --------------[ Average of 1 stat files ]--------------
> ElapsedTime 0.46 (0.46 seconds)
> SourceFiles 24.0
> SourceFileSize 121093.0 (118 KB)
> MirrorFiles 1.0
> MirrorFileSize 0.0 (0 bytes)
> NewFiles 23.0
> NewFileSize 121093.0 (118 KB)
> DeletedFiles 0.0
> DeletedFileSize 0.0 (0 bytes)
> ChangedFiles 1.0
> ChangedSourceSize 0.0 (0 bytes)
> ChangedMirrorSize 0.0 (0 bytes)
> IncrementFiles 0.0
> IncrementFileSize 0.0 (0 bytes)
> TotalDestinationSizeChange 121093.0 (118 KB)
> Errors 0
> ------------------------------------------------------
>
> (and then some more about specific files)
>
> It should be pretty quick....

Ok, I tried it on the other backup (/mnt/backup/array) and it was
indeed quick. It still didn't seem to complete on /mnt/backup/root
though, so I deleted it all and let a new one get created overnight
(from crontab) - and I added the --print-statistics flag :

UpdateError var/log/apache2/access.log Updated mirror temp file
/mnt/backup/root/var/log/apache2/rdiff-backup.tmp.3742487 does not
match source
--------------[ Session statistics ]--------------
StartTime 1225497602.00 (Sat Nov  1 02:00:02 2008)
EndTime 1225517139.76 (Sat Nov  1 07:25:39 2008)
ElapsedTime 19537.76 (5 hours 25 minutes 37.76 seconds)
SourceFiles 4204061
SourceFileSize 213604979312 (199 GB)
MirrorFiles 1
MirrorFileSize 0 (0 bytes)
NewFiles 4204060
NewFileSize 213604979312 (199 GB)
DeletedFiles 0
DeletedFileSize 0 (0 bytes)
ChangedFiles 1
ChangedSourceSize 0 (0 bytes)
ChangedMirrorSize 0 (0 bytes)
IncrementFiles 0
IncrementFileSize 0 (0 bytes)
TotalDestinationSizeChange 213604979312 (199 GB)
Errors 0
--------------------------------------------------

(Interesting that there's an error and yet it prints 'Errors 0' at the end)

In case it helps, the /mnt/backup/array backup printed this :

--------------[ Session statistics ]--------------
StartTime 1225490403.00 (Sat Nov  1 00:00:03 2008)
EndTime 1225490629.12 (Sat Nov  1 00:03:49 2008)
ElapsedTime 226.12 (3 minutes 46.12 seconds)
SourceFiles 389589
SourceFileSize 17624283301 (16.4 GB)
MirrorFiles 389480
MirrorFileSize 17624257215 (16.4 GB)
NewFiles 241
NewFileSize 150538 (147 KB)
DeletedFiles 132
DeletedFileSize 126363 (123 KB)
ChangedFiles 124
ChangedSourceSize 382806 (374 KB)
ChangedMirrorSize 380895 (372 KB)
IncrementFiles 499
IncrementFileSize 75690 (73.9 KB)
TotalDestinationSizeChange 101776 (99.4 KB)
Errors 0
--------------------------------------------------

Does this tell you anything?

Max.