Re: [Duplicity-talk] Which backups include a particular file?

[Tim Riemenschneider]

Am 14.12.2010 15:41, schrieb address@hidden:
>
>>>
>> Listing does not work, since cleanup deleted the signatures (which are
>> used for the list):
>>
>> mail:~/backup# duplicity --version
>> duplicity 0.6.08b
>
> Did you change duplicity versions around december 5th? 
No, according to /var/log/dpkg, I installed version 0.6.08b-1 (from
debian testing) on 2010-04-21.

>> mail:~/backup# duplicity collection-status $OPTIONS $TARGET
>> Local and Remote metadata are synchronized, no sync needed.
>> Last full backup date: Sun Dec  5 01:31:01 2010
>
> Did you use --extra-clean?
> Because the metadata shouldn't be deleted since 0.6.06. Why is it gone?
The backups are created like this:

OPTIONS="--exclude-if-present .do_not_backup_me --asynchronous-upload
--archive-dir /var/lib/duplicity --full-if-older-than 21D
--exclude-other-filesystems --ssh-askpass"
KEEP_FULL_BACKUPS=3
TARGET="ssh://address@hidden/backups"
ENCRYPT="--encrypt-key XXXX --encrypt-key YYYY"
SIGN="--sign-key ZZZZ"

echo "----- cleanup backup-dir: "`date -Iseconds`
duplicity remove-all-but-n-full $KEEP_FULL_BACKUPS --force --archive-dir
/var/lib/duplicity --ssh-askpass $TARGET
duplicity cleanup --force --archive-dir /var/lib/duplicity --ssh-askpass
$TARGET
echo "----- start backup: "`date -Iseconds`
duplicity $ENCRYPT $SIGN $OPTIONS --include-globbing-filelist filelist /
$TARGET
echo "----- cleanup2 backup-dir: "`date -Iseconds`
duplicity cleanup --force --archive-dir /var/lib/duplicity --ssh-askpass
$TARGET
echo "----- done backup: "`date -Iseconds`

As you can see, no --extra-clean....
(output is redirected to a logfile)

The logfile from 2010-12-06 contains:
----- cleanup backup-dir: 2010-12-06T01:30:29+0100
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sun Dec  5 01:31:01 2010
Deleting backup sets at times:
Sat Oct  2 01:30:07 2010
Sun Oct  3 01:33:11 2010
Mon Oct  4 01:30:19 2010
Tue Oct  5 01:30:01 2010
Wed Oct  6 01:30:01 2010
Thu Oct  7 01:29:56 2010
Fri Oct  8 01:29:57 2010
Sat Oct  9 01:29:39 2010
Sun Oct 10 01:30:22 2010
Mon Oct 11 01:30:19 2010
Tue Oct 12 01:30:03 2010
Wed Oct 13 01:29:42 2010
Thu Oct 14 01:30:02 2010
Fri Oct 15 01:31:29 2010
Sat Oct 16 01:30:54 2010
Sun Oct 17 01:29:44 2010
Mon Oct 18 01:30:55 2010
Tue Oct 19 01:31:04 2010
Wed Oct 20 01:29:58 2010
Thu Oct 21 01:30:08 2010
Fri Oct 22 01:30:31 2010
Deleting these files from backend:
duplicity-full-signatures.20101113T003034Z.sigtar.gz
duplicity-new-signatures.20101113T003034Z.to.20101114T003324Z.sigtar.gz
duplicity-new-signatures.20101114T003324Z.to.20101115T003200Z.sigtar.gz
duplicity-new-signatures.20101115T003200Z.to.20101116T003045Z.sigtar.gz
duplicity-new-signatures.20101116T003045Z.to.20101117T003046Z.sigtar.gz
duplicity-new-signatures.20101117T003046Z.to.20101118T003032Z.sigtar.gz
duplicity-new-signatures.20101118T003032Z.to.20101119T003019Z.sigtar.gz
duplicity-new-signatures.20101119T003019Z.to.20101120T003015Z.sigtar.gz
duplicity-new-signatures.20101120T003015Z.to.20101121T003053Z.sigtar.gz
duplicity-new-signatures.20101121T003053Z.to.20101122T003046Z.sigtar.gz
duplicity-new-signatures.20101122T003046Z.to.20101123T003004Z.sigtar.gz
duplicity-new-signatures.20101123T003004Z.to.20101124T003050Z.sigtar.gz
duplicity-new-signatures.20101124T003050Z.to.20101125T003103Z.sigtar.gz
duplicity-new-signatures.20101125T003103Z.to.20101126T003043Z.sigtar.gz
duplicity-new-signatures.20101126T003043Z.to.20101127T003007Z.sigtar.gz
duplicity-new-signatures.20101127T003007Z.to.20101128T003004Z.sigtar.gz
duplicity-new-signatures.20101128T003004Z.to.20101129T003136Z.sigtar.gz
duplicity-new-signatures.20101129T003136Z.to.20101130T003145Z.sigtar.gz
duplicity-new-signatures.20101130T003145Z.to.20101201T003046Z.sigtar.gz
duplicity-new-signatures.20101201T003046Z.to.20101202T003049Z.sigtar.gz
duplicity-new-signatures.20101202T003049Z.to.20101203T003048Z.sigtar.gz
duplicity-new-signatures.20101203T003048Z.to.20101204T003015Z.sigtar.gz
duplicity-full-signatures.20101113T003034Z.sigtar.gpg
duplicity-new-signatures.20101113T003034Z.to.20101114T003324Z.sigtar.gpg
duplicity-new-signatures.20101114T003324Z.to.20101115T003200Z.sigtar.gpg
duplicity-new-signatures.20101115T003200Z.to.20101116T003045Z.sigtar.gpg
duplicity-full-signatures.20101113T003034Z.sigtar.gpg
duplicity-new-signatures.20101113T003034Z.to.20101114T003324Z.sigtar.gpg
duplicity-new-signatures.20101114T003324Z.to.20101115T003200Z.sigtar.gpg
duplicity-new-signatures.20101115T003200Z.to.20101116T003045Z.sigtar.gpg
duplicity-new-signatures.20101116T003045Z.to.20101117T003046Z.sigtar.gpg
duplicity-new-signatures.20101117T003046Z.to.20101118T003032Z.sigtar.gpg
duplicity-new-signatures.20101118T003032Z.to.20101119T003019Z.sigtar.gpg
duplicity-new-signatures.20101119T003019Z.to.20101120T003015Z.sigtar.gpg
duplicity-new-signatures.20101120T003015Z.to.20101121T003053Z.sigtar.gpg
duplicity-new-signatures.20101121T003053Z.to.20101122T003046Z.sigtar.gpg
duplicity-new-signatures.20101122T003046Z.to.20101123T003004Z.sigtar.gpg
duplicity-new-signatures.20101123T003004Z.to.20101124T003050Z.sigtar.gpg
duplicity-new-signatures.20101124T003050Z.to.20101125T003103Z.sigtar.gpg
duplicity-new-signatures.20101125T003103Z.to.20101126T003043Z.sigtar.gpg
duplicity-new-signatures.20101126T003043Z.to.20101127T003007Z.sigtar.gpg
duplicity-new-signatures.20101127T003007Z.to.20101128T003004Z.sigtar.gpg
duplicity-new-signatures.20101128T003004Z.to.20101129T003136Z.sigtar.gpg
duplicity-new-signatures.20101129T003136Z.to.20101130T003145Z.sigtar.gpg
duplicity-new-signatures.20101130T003145Z.to.20101201T003046Z.sigtar.gpg
duplicity-new-signatures.20101201T003046Z.to.20101202T003049Z.sigtar.gpg
duplicity-new-signatures.20101202T003049Z.to.20101203T003048Z.sigtar.gpg
duplicity-new-signatures.20101203T003048Z.to.20101204T003015Z.sigtar.gpg
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sun Dec  5 01:31:01 2010
No extraneous files found, nothing deleted in cleanup.
----- start backup: 2010-12-06T01:33:17+0100


On the backend, one can see that the old signatures are gone, only the
old manifests are there:
address@hidden:/backups/bizbackup/backups# ls *.sigtar*
duplicity-full-signatures.20101205T003101Z.sigtar.gpg
duplicity-new-signatures.20101205T003101Z.to.20101206T003317Z.sigtar.gpg
duplicity-new-signatures.20101206T003317Z.to.20101207T003105Z.sigtar.gpg
duplicity-new-signatures.20101207T003105Z.to.20101208T003046Z.sigtar.gpg
duplicity-new-signatures.20101208T003046Z.to.20101209T003106Z.sigtar.gpg
duplicity-new-signatures.20101209T003106Z.to.20101210T003033Z.sigtar.gpg
duplicity-new-signatures.20101210T003033Z.to.20101212T003115Z.sigtar.gpg
duplicity-new-signatures.20101212T003115Z.to.20101213T003109Z.sigtar.gpg
duplicity-new-signatures.20101213T003109Z.to.20101214T003125Z.sigtar.gpg
address@hidden:/backups/bizbackup/backups# ls *manifest*
duplicity-full.20101022T233057Z.manifest.gpg
duplicity-full.20101113T003034Z.manifest.gpg
duplicity-full.20101205T003101Z.manifest.gpg
duplicity-inc.20101022T233057Z.to.20101023T233229Z.manifest.gpg
duplicity-inc.20101023T233229Z.to.20101024T233042Z.manifest.gpg
duplicity-inc.20101024T233042Z.to.20101025T233132Z.manifest.gpg
duplicity-inc.20101025T233132Z.to.20101026T233036Z.manifest.gpg
duplicity-inc.20101026T233036Z.to.20101027T233044Z.manifest.gpg
duplicity-inc.20101027T233044Z.to.20101028T233055Z.manifest.gpg
duplicity-inc.20101028T233055Z.to.20101029T233110Z.manifest.gpg
duplicity-inc.20101029T233110Z.to.20101030T232953Z.manifest.gpg
duplicity-inc.20101030T232953Z.to.20101101T003041Z.manifest.gpg
duplicity-inc.20101101T003041Z.to.20101102T003122Z.manifest.gpg
duplicity-inc.20101102T003122Z.to.20101103T003013Z.manifest.gpg
duplicity-inc.20101103T003013Z.to.20101104T003053Z.manifest.gpg
duplicity-inc.20101104T003053Z.to.20101105T003101Z.manifest.gpg
duplicity-inc.20101105T003101Z.to.20101106T003040Z.manifest.gpg
duplicity-inc.20101106T003040Z.to.20101107T003045Z.manifest.gpg
duplicity-inc.20101107T003045Z.to.20101108T003051Z.manifest.gpg
duplicity-inc.20101108T003051Z.to.20101109T003053Z.manifest.gpg
duplicity-inc.20101109T003053Z.to.20101110T003020Z.manifest.gpg
duplicity-inc.20101110T003020Z.to.20101111T003005Z.manifest.gpg
duplicity-inc.20101111T003005Z.to.20101112T003140Z.manifest.gpg
duplicity-inc.20101113T003034Z.to.20101114T003324Z.manifest.gpg
duplicity-inc.20101114T003324Z.to.20101115T003200Z.manifest.gpg
duplicity-inc.20101115T003200Z.to.20101116T003045Z.manifest.gpg
duplicity-inc.20101116T003045Z.to.20101117T003046Z.manifest.gpg
duplicity-inc.20101117T003046Z.to.20101118T003032Z.manifest.gpg
duplicity-inc.20101118T003032Z.to.20101119T003019Z.manifest.gpg
duplicity-inc.20101119T003019Z.to.20101120T003015Z.manifest.gpg
duplicity-inc.20101120T003015Z.to.20101121T003053Z.manifest.gpg
duplicity-inc.20101121T003053Z.to.20101122T003046Z.manifest.gpg
duplicity-inc.20101122T003046Z.to.20101123T003004Z.manifest.gpg
duplicity-inc.20101123T003004Z.to.20101124T003050Z.manifest.gpg
duplicity-inc.20101124T003050Z.to.20101125T003103Z.manifest.gpg
duplicity-inc.20101125T003103Z.to.20101126T003043Z.manifest.gpg
duplicity-inc.20101126T003043Z.to.20101127T003007Z.manifest.gpg
duplicity-inc.20101127T003007Z.to.20101128T003004Z.manifest.gpg
duplicity-inc.20101128T003004Z.to.20101129T003136Z.manifest.gpg
duplicity-inc.20101129T003136Z.to.20101130T003145Z.manifest.gpg
duplicity-inc.20101130T003145Z.to.20101201T003046Z.manifest.gpg
duplicity-inc.20101201T003046Z.to.20101202T003049Z.manifest.gpg
duplicity-inc.20101202T003049Z.to.20101203T003048Z.manifest.gpg
duplicity-inc.20101203T003048Z.to.20101204T003015Z.manifest.gpg
duplicity-inc.20101205T003101Z.to.20101206T003317Z.manifest.gpg
duplicity-inc.20101206T003317Z.to.20101207T003105Z.manifest.gpg
duplicity-inc.20101207T003105Z.to.20101208T003046Z.manifest.gpg
duplicity-inc.20101208T003046Z.to.20101209T003106Z.manifest.gpg
duplicity-inc.20101209T003106Z.to.20101210T003033Z.manifest.gpg
duplicity-inc.20101210T003033Z.to.20101212T003115Z.manifest.gpg
duplicity-inc.20101212T003115Z.to.20101213T003109Z.manifest.gpg
duplicity-inc.20101213T003109Z.to.20101214T003125Z.manifest.gpg
address@hidden:/backups/bizbackup/backups#