Re: [Duplicity-talk] Duplicity stops after 40 volumes

[edgar . soldin]

On 02.09.2014 00:12, Carlos Chavez wrote:
>     I just installed a new CentOS 6.5 server with Duplicity 0.6.22 but I am 
> having trouble completing the first full backup.  The backup stops every 40 
> volumes.  So far had to restart it several times and it has stopped at 40, 
> 80, 120 and 160.  I really cannot understand why it is doing that.  The 
> network connection between the servers is fast and stable.  Here is the 
> output of duplicity:
> 
> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> Reading globbing filelist /root/backupinclude.txt
> Local and Remote metadata are synchronized, no sync needed.
> Last full backup left a partial set, restarting.
> Last full backup date: Sun Aug 31 12:21:25 2014
> RESTART: The first volume failed to upload before termination.
>          Restart is impossible...starting backup from beginning.
> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> Reading globbing filelist /root/backupinclude.txt
> Local and Remote metadata are synchronized, no sync needed.
> Last full backup date: none
> Last full backup is too old, forcing full backup
> No handlers could be found for logger "paramiko.transport"
> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 1 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 2 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 3 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 4 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 5 of 5) Will 
> retry in 10 seconds.
> BackendException: Giving up trying to upload 
> 'duplicity-full.20140831T223248Z.vol41.difftar.gz' after 5 attempts
> address@hidden ~]#
> address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 7D 
> --include-globbing-filelist /root/backupinclude.txt / 
> ssh://telecomab.dyndns.org//respaldos/cabana
> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> Reading globbing filelist /root/backupinclude.txt
> Local and Remote metadata are synchronized, no sync needed.
> Last full backup left a partial set, restarting.
> Last full backup date: Sun Aug 31 17:32:48 2014
> RESTART: Volumes 41 to 41 failed to upload before termination.
>          Restarting backup at volume 41.
> Restarting after volume 40, file 
> home/circulobienesraices/homes/conchaazuara/Maildir/cur/1409498005.000044.mbox:2,RS,
>  block 181
> No handlers could be found for logger "paramiko.transport"
> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed: Server connection 
> dropped:  (Try 1 of 5) Will retry in 10 seconds.
> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 2 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 3 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 4 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 5 of 5) Will 
> retry in 10 seconds.
> BackendException: Giving up trying to upload 
> 'duplicity-full.20140831T223248Z.vol81.difftar.gz' after 5 attempts
> address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 7D 
> --include-globbing-filelist /root/backupinclude.txt / 
> ssh://telecomab.dyndns.org//respaldos/cabana
> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> Reading globbing filelist /root/backupinclude.txt
> Local and Remote metadata are synchronized, no sync needed.
> Last full backup left a partial set, restarting.
> Last full backup date: Sun Aug 31 17:32:48 2014
> RESTART: Volumes 81 to 81 failed to upload before termination.
>          Restarting backup at volume 81.
> Restarting after volume 80, file 
> home/circulobienesraices/homes/doloresestrada/Maildir/.sent-mail/cur/1409498271.000672.mbox:2,S,
>  block 11
> No handlers could be found for logger "paramiko.transport"
> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed: Server connection 
> dropped:  (Try 1 of 5) Will retry in 10 seconds.
> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 2 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 3 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 4 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 5 of 5) Will 
> retry in 10 seconds.
> BackendException: Giving up trying to upload 
> 'duplicity-full.20140831T223248Z.vol121.difftar.gz' after 5 attempts
> address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 7D 
> --include-globbing-filelist /root/backupinclude.txt / 
> ssh://telecomab.dyndns.org//respaldos/cabana
> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> Reading globbing filelist /root/backupinclude.txt
> Local and Remote metadata are synchronized, no sync needed.
> Last full backup left a partial set, restarting.
> Last full backup date: Sun Aug 31 17:32:48 2014
> RESTART: Volumes 121 to 121 failed to upload before termination.
>          Restarting backup at volume 121.
> Restarting after volume 120, file 
> home/circulobienesraices/homes/edelamora/Maildir/cur/1409498342.000415.mbox:2,S,
>  block 7
> No handlers could be found for logger "paramiko.transport"
> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed: Server connection 
> dropped:  (Try 1 of 5) Will retry in 10 seconds.
> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 2 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 3 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 4 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 5 of 5) Will 
> retry in 10 seconds.
> BackendException: Giving up trying to upload 
> 'duplicity-full.20140831T223248Z.vol161.difftar.gz' after 5 attempts
> 

smells like a backend issue. first update to latest duplicity 0.6.24 to make 
sure this is a bug already fixed.

try updating your local python paramiko, if possible.

a quick workaround might be to use '--ssh-backend pexpect' to use the legacy 
ssh backend.

..ede/duply.net