Re: [Duplicity-talk] SHA1 hash mismatch (I see previous messages as old as 2003)

[M. Ini]

[...]
*Any hint will be much appreciated.*

hey M,

1.
please provide a full error stack. run duplicity with max. verbosity '-v9' and provide the full output of the terminal.

2.
what's your python version?

generally a checksum error is a protective measure that checks if backend files are still the same during verify/restore. if you regularily run into those i could imagine that maybe your python version has a bug.

currently there is no known checksum error issue. check the mailing list again and you will probably see that issues were rooted in bad file systems or transfer problems etc.

..ede/duply.net

Hi Edgar,

Thank you for replying.

Ubuntu 18.04.2 LTS

address@hidden:~$ python --version
Python 2.7.15rc1

address@hidden:~$ uname -r
4.18.0-17-generic
address@hidden:~$

(But this "SHA1 hash mismatch" problem appeared before the last update involving the kernel and headers.)

For this test, I've created a folder with two files made of random bytes (dd reading from /dev/urandom), so I can upload to some cloud service if you need them. During the last days I was testing (and having the hash mismatch problem) on "real" data. (Marginally, if it is of any utility, this excludes that it might only happen with long/many file names involved.)

address@hidden:~$ ls -la testDuplicity_source/
total 4249512
drwxr-xr-x  2 lemon lemon       4096 abr  7 18:27 .
drwxr-xr-x 24 lemon lemon       4096 abr  7 18:53 ..
-rw-r--r--  1 lemon lemon 1450493344 abr  7 18:21 randomBytes1.bin
-rw-r--r--  1 lemon lemon 2900986684 abr  7 18:27 randomBytes2.bin
address@hidden:~$ ls -lah testDuplicity_source/
total 4,1G
drwxr-xr-x  2 lemon lemon 4,0K abr  7 18:27 .
drwxr-xr-x 24 lemon lemon 4,0K abr  7 18:53 ..
-rw-r--r--  1 lemon lemon 1,4G abr  7 18:21 randomBytes1.bin
-rw-r--r--  1 lemon lemon 2,8G abr  7 18:27 randomBytes2.bin
address@hidden:~$ cat doTestDuplicity.sh
#!/bin/bash

duplicity -v9 --no-encryption /home/$USER/testDuplicity_source file:///media/$USER/Toshiba3TB_SATA3/BACKUP/testDuplicity_backup &> testDuplicity_creation_consoleOutput.txt

duplicity -v9 verify --no-encryption file:///media/$USER/Toshiba3TB_SATA3/BACKUP/testDuplicity_backup /home/$USER/testDuplicity_source &> testDuplicity_verify_consoleOutput.txt

address@hidden:~$

#---------------------------------------------------------------------...

address@hidden:~$ cat testDuplicity_creation_consoleOutput.txt
Using archive dir: /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb
Using backup name: 47a314e4a41c6721e966cefd48eb11bb
GPG binary is gpg, version 2.2.4
Import of duplicity.backends.acdclibackend Succeeded
Import of duplicity.backends.azurebackend Succeeded
Import of duplicity.backends.b2backend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.hubicbackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.lftpbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.mediafirebackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.multibackend Succeeded
Import of duplicity.backends.ncftpbackend Succeeded
Import of duplicity.backends.onedrivebackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.pydrivebackend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.ssh_paramiko_backend Succeeded
Import of duplicity.backends.ssh_pexpect_backend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Main action: inc
Acquiring lockfile /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/lockfile
================================================================================
duplicity 0.7.18.2 ($reldate)
Args: /usr/bin/duplicity -v9 --no-encryption /home/lemon/testDuplicity_source file:///media/lemon/Toshiba3TB_SATA3/BACKUP/testDuplicity_backup
Linux PC 4.18.0-17-generic #18~18.04.1-Ubuntu SMP Fri Mar 15 15:27:12 UTC 2019 x86_64 x86_64
/usr/bin/python2 2.7.15rc1 (default, Nov 12 2018, 14:31:15)
[GCC 7.3.0]
================================================================================
Using temporary directory /tmp/duplicity-aeVwSK-tempdir
Registering (mkstemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mkstemp-Ik5d6I-1
Temp has 2775409057792 available, backup will use approx 272629760.
Local and Remote metadata are synchronized, no sync needed.
0 files exist on backend
1 file exists in cache
Extracting backup chains from list of files: []
Last full backup date: none
Collection Status
-----------------
Connecting with backend: BackendWrapper
Archive dir: /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb

Found 0 secondary backup chains.
No backup chains with active signatures found
No orphaned or incomplete backup sets found.
No signatures found, switching to full backup.
Using temporary directory /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/duplicity-RNIfDC-tempdir
Registering (mktemp) temporary file /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/duplicity-RNIfDC-tempdir/mktemp-zWjr1r-1
Using temporary directory /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/duplicity-gMwJ8p-tempdir
Registering (mktemp) temporary file /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/duplicity-gMwJ8p-tempdir/mktemp-bx5b0C-1
AsyncScheduler: instantiating at concurrency 0
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-GHTb1k-2
Selecting /home/lemon/testDuplicity_source
Comparing . and None
Getting delta of (. dir) and None
A .
Selection: examining path /home/lemon/testDuplicity_source/randomBytes1.bin
Selection:     + no selection functions found. Including
Selecting /home/lemon/testDuplicity_source/randomBytes1.bin
Comparing randomBytes1.bin and None
Getting delta of (randomBytes1.bin reg) and None
A randomBytes1.bin
Removing still remembered temporary file /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/duplicity-RNIfDC-tempdir/mktemp-zWjr1r-1
Removing still remembered temporary file /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/duplicity-gMwJ8p-tempdir/mktemp-bx5b0C-1
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol1.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-GHTb1k-2
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-GHTb1k-2
AsyncScheduler: task completed successfully
Processed volume 1
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-RbAT3K-3
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol2.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-RbAT3K-3
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-RbAT3K-3
AsyncScheduler: task completed successfully
Processed volume 2
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-T8_WD5-4
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol3.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-T8_WD5-4
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-T8_WD5-4
AsyncScheduler: task completed successfully
Processed volume 3
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-CTaBbO-5
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol4.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-CTaBbO-5
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-CTaBbO-5
AsyncScheduler: task completed successfully
Processed volume 4
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-mB1l9a-6
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol5.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-mB1l9a-6
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-mB1l9a-6
AsyncScheduler: task completed successfully
Processed volume 5
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-_3ZuXi-7
Selection: examining path /home/lemon/testDuplicity_source/randomBytes2.bin
Selection:     + no selection functions found. Including
Selecting /home/lemon/testDuplicity_source/randomBytes2.bin
Comparing randomBytes2.bin and None
Getting delta of (randomBytes2.bin reg) and None
A randomBytes2.bin
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol6.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-_3ZuXi-7
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-_3ZuXi-7
AsyncScheduler: task completed successfully
Processed volume 6
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-lNUQzy-8
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol7.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-lNUQzy-8
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-lNUQzy-8
AsyncScheduler: task completed successfully
Processed volume 7
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-PRBfM7-9
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol8.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-PRBfM7-9
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-PRBfM7-9
AsyncScheduler: task completed successfully
Processed volume 8
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-yWh5Kl-10
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol9.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-yWh5Kl-10
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-yWh5Kl-10
AsyncScheduler: task completed successfully
Processed volume 9
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-SYGySy-11
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol10.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-SYGySy-11
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-SYGySy-11
AsyncScheduler: task completed successfully
Processed volume 10
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-Is8koN-12
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol11.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-Is8koN-12
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-Is8koN-12
AsyncScheduler: task completed successfully
Processed volume 11
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-ZlerGe-13
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol12.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-ZlerGe-13
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-ZlerGe-13
AsyncScheduler: task completed successfully
Processed volume 12
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-RdrJV_-14
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol13.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-RdrJV_-14
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-RdrJV_-14
AsyncScheduler: task completed successfully
Processed volume 13
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-HaX2Y3-15
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol14.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-HaX2Y3-15
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-HaX2Y3-15
AsyncScheduler: task completed successfully
Processed volume 14
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-GM_79Q-16
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol15.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-GM_79Q-16
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-GM_79Q-16
AsyncScheduler: task completed successfully
Processed volume 15
Registering (mktemp) temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-pjeA2c-17
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20190407T213225Z.vol16.difftar.gz
Deleting /tmp/duplicity-aeVwSK-tempdir/mktemp-pjeA2c-17
Forgetting temporary file /tmp/duplicity-aeVwSK-tempdir/mktemp-pjeA2c-17
AsyncScheduler: task completed successfully
Processed volume 16
18 files exist on backend
3 files exist in cache
Extracting backup chains from list of files: [u'duplicity-full-signatures.20190407T213225Z.sigtar.gz', u'duplicity-full.20190407T213225Z.manifest', u'duplicity-full.20190407T213225Z.vol1.difftar.gz', u'duplicity-full.20190407T213225Z.vol10.difftar.gz', u'duplicity-full.20190407T213225Z.vol11.difftar.gz', u'duplicity-full.20190407T213225Z.vol12.difftar.gz', u'duplicity-full.20190407T213225Z.vol13.difftar.gz', u'duplicity-full.20190407T213225Z.vol14.difftar.gz', u'duplicity-full.20190407T213225Z.vol15.difftar.gz', u'duplicity-full.20190407T213225Z.vol16.difftar.gz', u'duplicity-full.20190407T213225Z.vol2.difftar.gz', u'duplicity-full.20190407T213225Z.vol3.difftar.gz', u'duplicity-full.20190407T213225Z.vol4.difftar.gz', u'duplicity-full.20190407T213225Z.vol5.difftar.gz', u'duplicity-full.20190407T213225Z.vol6.difftar.gz', u'duplicity-full.20190407T213225Z.vol7.difftar.gz', u'duplicity-full.20190407T213225Z.vol8.difftar.gz', u'duplicity-full.20190407T213225Z.vol9.difftar.gz']
File duplicity-full-signatures.20190407T213225Z.sigtar.gz is not part of a known set; creating new set
Ignoring file (rejected by backup set) 'duplicity-full-signatures.20190407T213225Z.sigtar.gz'
File duplicity-full.20190407T213225Z.manifest is not part of a known set; creating new set
File duplicity-full.20190407T213225Z.vol1.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol10.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol11.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol12.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol13.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol14.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol15.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol16.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol2.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol3.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol4.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol5.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol6.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol7.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol8.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol9.difftar.gz is part of known set
Found backup chain [Sun Apr  7 18:32:25 2019]-[Sun Apr  7 18:32:25 2019]
--------------[ Backup Statistics ]--------------
StartTime 1554672745.81 (Sun Apr  7 18:32:25 2019)
EndTime 1554673251.91 (Sun Apr  7 18:40:51 2019)
ElapsedTime 506.10 (8 minutes 26.10 seconds)
SourceFiles 3
SourceFileSize 4351484124 (4.05 GB)
NewFiles 3
NewFileSize 4351484124 (4.05 GB)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 3
RawDeltaSize 4351480028 (4.05 GB)
TotalDestinationSizeChange 3318034978 (3.09 GB)
Errors 0
-------------------------------------------------

Releasing lockfile /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/lockfile
Removing still remembered temporary file /tmp/duplicity-aeVwSK-tempdir/mkstemp-Ik5d6I-1
Releasing lockfile /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/lockfile
address@hidden:~$

#...---------------------------------------------------------------------

#---------------------------------------------------------------------...

address@hidden:~$ cat testDuplicity_verify_consoleOutput.txt
Using archive dir: /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb
Using backup name: 47a314e4a41c6721e966cefd48eb11bb
GPG binary is gpg, version 2.2.4
Import of duplicity.backends.acdclibackend Succeeded
Import of duplicity.backends.azurebackend Succeeded
Import of duplicity.backends.b2backend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.hubicbackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.lftpbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.mediafirebackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.multibackend Succeeded
Import of duplicity.backends.ncftpbackend Succeeded
Import of duplicity.backends.onedrivebackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.pydrivebackend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.ssh_paramiko_backend Succeeded
Import of duplicity.backends.ssh_pexpect_backend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Main action: verify
Acquiring lockfile /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/lockfile
================================================================================
duplicity 0.7.18.2 ($reldate)
Args: /usr/bin/duplicity -v9 verify --no-encryption file:///media/lemon/Toshiba3TB_SATA3/BACKUP/testDuplicity_backup /home/lemon/testDuplicity_source
Linux PC 4.18.0-17-generic #18~18.04.1-Ubuntu SMP Fri Mar 15 15:27:12 UTC 2019 x86_64 x86_64
/usr/bin/python2 2.7.15rc1 (default, Nov 12 2018, 14:31:15)
[GCC 7.3.0]
================================================================================
Local and Remote metadata are synchronized, no sync needed.
18 files exist on backend
3 files exist in cache
Extracting backup chains from list of files: [u'duplicity-full-signatures.20190407T213225Z.sigtar.gz', u'duplicity-full.20190407T213225Z.manifest', u'duplicity-full.20190407T213225Z.vol1.difftar.gz', u'duplicity-full.20190407T213225Z.vol10.difftar.gz', u'duplicity-full.20190407T213225Z.vol11.difftar.gz', u'duplicity-full.20190407T213225Z.vol12.difftar.gz', u'duplicity-full.20190407T213225Z.vol13.difftar.gz', u'duplicity-full.20190407T213225Z.vol14.difftar.gz', u'duplicity-full.20190407T213225Z.vol15.difftar.gz', u'duplicity-full.20190407T213225Z.vol16.difftar.gz', u'duplicity-full.20190407T213225Z.vol2.difftar.gz', u'duplicity-full.20190407T213225Z.vol3.difftar.gz', u'duplicity-full.20190407T213225Z.vol4.difftar.gz', u'duplicity-full.20190407T213225Z.vol5.difftar.gz', u'duplicity-full.20190407T213225Z.vol6.difftar.gz', u'duplicity-full.20190407T213225Z.vol7.difftar.gz', u'duplicity-full.20190407T213225Z.vol8.difftar.gz', u'duplicity-full.20190407T213225Z.vol9.difftar.gz']
File duplicity-full-signatures.20190407T213225Z.sigtar.gz is not part of a known set; creating new set
Ignoring file (rejected by backup set) 'duplicity-full-signatures.20190407T213225Z.sigtar.gz'
File duplicity-full.20190407T213225Z.manifest is not part of a known set; creating new set
File duplicity-full.20190407T213225Z.vol1.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol10.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol11.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol12.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol13.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol14.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol15.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol16.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol2.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol3.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol4.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol5.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol6.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol7.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol8.difftar.gz is part of known set
File duplicity-full.20190407T213225Z.vol9.difftar.gz is part of known set
Found backup chain [Sun Apr  7 18:32:25 2019]-[Sun Apr  7 18:32:25 2019]
Last full backup date: Sun Apr  7 18:32:25 2019
Collection Status
-----------------
Connecting with backend: BackendWrapper
Archive dir: /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb

Found 0 secondary backup chains.

Found primary backup chain with matching signature chain:
-------------------------
Chain start time: Sun Apr  7 18:32:25 2019
Chain end time: Sun Apr  7 18:32:25 2019
Number of contained backup sets: 1
Total number of contained volumes: 16
 Type of backup set:                            Time:      Num volumes:
                Full         Sun Apr  7 18:32:25 2019                16
-------------------------
No orphaned or incomplete backup sets found.
Processing local manifest /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/duplicity-full.20190407T213225Z.manifest (2414)
Found manifest volume 1
Found manifest volume 2
Found manifest volume 3
Found manifest volume 4
Found manifest volume 5
Found manifest volume 6
Found manifest volume 7
Found manifest volume 8
Found manifest volume 9
Found manifest volume 10
Found manifest volume 11
Found manifest volume 12
Found manifest volume 13
Found manifest volume 14
Found manifest volume 15
Found manifest volume 16
Found 16 volumes in manifest
Using temporary directory /tmp/duplicity-cM_AiT-tempdir
Registering (mktemp) temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-YjFQjw-1
Selecting /home/lemon/testDuplicity_source
Selection: examining path /home/lemon/testDuplicity_source/randomBytes1.bin
Selection:     + no selection functions found. Including
Selecting /home/lemon/testDuplicity_source/randomBytes1.bin
Deleting /tmp/duplicity-cM_AiT-tempdir/mktemp-YjFQjw-1
Forgetting temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-YjFQjw-1
Processed volume 1 of 16
Registering (mktemp) temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-x1O676-2
Deleting /tmp/duplicity-cM_AiT-tempdir/mktemp-x1O676-2
Forgetting temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-x1O676-2
Processed volume 2 of 16
Registering (mktemp) temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-iuFz6R-3
Deleting /tmp/duplicity-cM_AiT-tempdir/mktemp-iuFz6R-3
Forgetting temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-iuFz6R-3
Processed volume 3 of 16
Registering (mktemp) temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-3xosj4-4
Invalid data - SHA1 hash mismatch for file:
 duplicity-full.20190407T213225Z.vol4.difftar.gz
 Calculated hash: e99f9afba61652bc317638720fd1bd8f1f86111c
 Manifest hash: 4606688e9aa86b4685eecf3a79e6157615cad38c

Releasing lockfile /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/lockfile
Removing still remembered temporary file /tmp/duplicity-cM_AiT-tempdir/mktemp-3xosj4-4
Releasing lockfile /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/lockfile
Releasing lockfile /home/lemon/.cache/duplicity/47a314e4a41c6721e966cefd48eb11bb/lockfile
address@hidden:~$

#...---------------------------------------------------------------------

address@hidden:~$ ls -la /media/lemon/Toshiba3TB_SATA3/BACKUP/testDuplicity_backup/
total 3265156
drwxrwxrwx 1 lemon lemon      4096 abr  7 18:40 .
drwxrwxrwx 1 lemon lemon      4096 abr  7 18:32 ..
-rwxrwxrwx 1 lemon lemon      2414 abr  7 18:40 duplicity-full.20190407T213225Z.manifest
-rwxrwxrwx 1 lemon lemon 209679478 abr  7 18:37 duplicity-full.20190407T213225Z.vol10.difftar.gz
-rwxrwxrwx 1 lemon lemon 209678946 abr  7 18:38 duplicity-full.20190407T213225Z.vol11.difftar.gz
-rwxrwxrwx 1 lemon lemon 209679315 abr  7 18:38 duplicity-full.20190407T213225Z.vol12.difftar.gz
-rwxrwxrwx 1 lemon lemon 209679002 abr  7 18:39 duplicity-full.20190407T213225Z.vol13.difftar.gz
-rwxrwxrwx 1 lemon lemon 209678823 abr  7 18:39 duplicity-full.20190407T213225Z.vol14.difftar.gz
-rwxrwxrwx 1 lemon lemon 209679631 abr  7 18:40 duplicity-full.20190407T213225Z.vol15.difftar.gz
-rwxrwxrwx 1 lemon lemon 172827764 abr  7 18:40 duplicity-full.20190407T213225Z.vol16.difftar.gz
-rwxrwxrwx 1 lemon lemon 209684768 abr  7 18:32 duplicity-full.20190407T213225Z.vol1.difftar.gz
-rwxrwxrwx 1 lemon lemon 209685411 abr  7 18:33 duplicity-full.20190407T213225Z.vol2.difftar.gz
-rwxrwxrwx 1 lemon lemon 209685696 abr  7 18:33 duplicity-full.20190407T213225Z.vol3.difftar.gz
-rwxrwxrwx 1 lemon lemon 209687025 abr  7 18:34 duplicity-full.20190407T213225Z.vol4.difftar.gz
-rwxrwxrwx 1 lemon lemon 209688070 abr  7 18:35 duplicity-full.20190407T213225Z.vol5.difftar.gz
-rwxrwxrwx 1 lemon lemon 209667142 abr  7 18:35 duplicity-full.20190407T213225Z.vol6.difftar.gz
-rwxrwxrwx 1 lemon lemon 209676419 abr  7 18:36 duplicity-full.20190407T213225Z.vol7.difftar.gz
-rwxrwxrwx 1 lemon lemon 209677982 abr  7 18:36 duplicity-full.20190407T213225Z.vol8.difftar.gz
-rwxrwxrwx 1 lemon lemon 209679506 abr  7 18:37 duplicity-full.20190407T213225Z.vol9.difftar.gz
-rwxrwxrwx 1 lemon lemon  25429845 abr  7 18:40 duplicity-full-signatures.20190407T213225Z.sigtar.gz
address@hidden:~$

(

Today I've started using borg and it's working very well so far, but duplicity is definitely extremely interesting (e.g. asymmetric encryption with gpg keys, less requirements on destination filesystem) so I hope that this helps spot some python bug or some incompatibility with certain libraries versions.

)