[rdiff-backup-users] CRC check Failed

[rdiff]

We are using 1.0.4 and it has been running stable for many months.  Every 
once in a while this CRC check comes across and in the past, the only way 
we knew to resolve it is to remove the rdiff-backup-data directory and 
start over.  --check-destination-dir also fails with the same error.

After reading the mailing list, they suggest that one of the .gz files is 
bad.  After something like this:

(http://www.mail-archive.com/address@hidden/msg01116.html)

find dest/rdiff-backup-data -type f -name \*.gz -print0 | \
        xargs -0r gzip --test

I found that the file 
dest/rdiff-backup-data/mirror_metadata.2007-01-19T18:30:23-08:00.snapshot.gz 
was bad.  The previous mirror_metadata file 
"mirror_metadata.2007-01-19T05:52:24-08:00.snapshot.gz" was intact so I 
copied the good one over the bad one and re-ran --check-destination-dir. 
Even though I used an older mirror_metadata, --check-destination-dir 
returned without error.

I realize that because I copied an old metadata over a more recent 
backup's metadata some of the increments may be clobbered or perhaps 
confused.  However, it is possible that the damaged metadata was a backup 
which never really did anything in which case, no harm done; 
unfortunately, this is unknown.

What kind of metadata confusion/increment errors/restore errors might come 
up due to this metadata replacement which we should be aware of?

Is there a way to check the integrity of the increments?

Can rdiff-backup perform restore operations on each file with increments 
and compare against some metadata md5/sha?

Is there a way to keep mirror_metadata's from getting damaged or making 
the code which handles mirror_metadata more robust to failures?

Does anyone have suggestions to avoid these scenarios in the future?

Thank you for your help!!!

-Eric




Backing up address@hidden::/cygdrive/c/Acct --> /var/backup/LocksNW/Acct
Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 23, in ?
    rdiff_backup.Main.Main(sys.argv[1:])
  File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 285, 
in Main
    take_action(rps)
  File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 255, 
in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line 305, 
in Backup
    backup.Mirror_and_increment(rpin, rpout, incdir)
  File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line 51, 
in Mirror_and_increment
    DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
  File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line 
227, in patch_and_increment
    for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
  File "/usr/lib/python2.4/site-packages/rdiff_backup/rorpiter.py", line 
173, in FillInIter
    first_rp = rpiter.next() # StopIteration gets passed upwards
  File "/usr/lib/python2.4/site-packages/rdiff_backup/iterfile.py", line 
364, in next
    while not type: type, data = self._get()
  File "/usr/lib/python2.4/site-packages/rdiff_backup/iterfile.py", line 
401, in _get
    if not self.buf: self.buf += self.file.read()
  File "/usr/lib/python2.4/site-packages/rdiff_backup/connection.py", line 
513, in read
    return self.connection.VirtualFile.readfromid(self.id, length)
  File "/usr/lib/python2.4/site-packages/rdiff_backup/connection.py", line 
445, in __call__
    return apply(self.connection.reval, (self.name,) + args)
  File "/usr/lib/python2.4/site-packages/rdiff_backup/connection.py", line 
367, in reval
    if isinstance(result, Exception): raise result
IOError: CRC check failed
Exception exceptions.TypeError: "'NoneType' object is not callable" in 
<bound method GzipFile.__del__ of <gzip open file
'/var/backup/LocksNW/Acct/rdiff-backup-data/file_statistics.2007-01-20T06:13:58-08:00.data.gz', 
mode 'wb' at 0xb7de8650
-0x4820eed4>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable" in 
<bound method GzipFile.__del__ of <gzip open file
'/var/backup/LocksNW/Acct/rdiff-backup-data/error_log.2007-01-20T06:13:58-08:00.data.gz', 
mode 'wb' at 0xb7de8530
-0x48210474>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable" in 
<bound method GzipFile.__del__ of <gzip open file
'/var/backup/LocksNW/Acct/rdiff-backup-data/mirror_metadata.2007-01-20T06:13:58-08:00.snapshot.gz', 
mode 'wb' at
0xb7de8578 -0x4820ef94>> ignored