duplicity-talk
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Duplicity-talk] Restoring from the last full backup (Re: Difficulties w

From: andrew
Subject: [Duplicity-talk] Restoring from the last full backup (Re: Difficulties with restore: 'Could not restore the following files. Please make sure you are able to write to them.')
Date: Mon, 15 Nov 2021 10:01:29 +0000
User-agent: Roundcube Webmail/1.4.2 
Hi everyone,
How do I force duplicity to restore from the last full backup which it made? I can see the options for creating a new full back-up but not restoring it. Indeed, how do I find out when the last full backup was made.
The manual (this one: https://linux.die.net/man/1/duplicity) isn't at all helpful in this regard. Thanks. 

Best wishes,

Andrew

Andrew Wood, Oxford.

- o -

On 14/11/2021 20:02, andrew via Duplicity-talk wrote:

Hi Ken, ede

Could I restore to the last full back-up if not the most recent one
(ie full back-up with incremental updates)? If so then how would I
force that?

Indeed, the version of duplicity on Fedora 33 would have been 0.8.x
although I'm not sure which one exactly (that's not in the verbose
output, I guess).

I tried rolling-back to the last but one back-up but that didn't seem
to make any difference. The back-ups were weekly.

Thanks.

Best wishes,

Andrew

Andrew Wood, Oxford.

- o -

On 14/11/2021 12:04, edgar.soldin--- via Duplicity-talk wrote:

hey Andrew, Ken,

On 13.11.2021 20:14, Kenneth Loafman via Duplicity-talk wrote:
It looks as if something was writing to the mail directory while the backup 
was trying to process it.


indeed. it does. we had a bug with the same error in
 https://bugs.launchpad.net/duplicity/+bug/1252484
 https://bugs.launchpad.net/duplicity/+bug/662442

generally it's a bad idea to backup files that are currently modified
as the saved state is probably inconsistent. modern linux has
capabilities to do file system snapshots. if you can't make sure the
applications are shut down, try to use these mechanisms.


What version of duplicity created the original backup?


your output suggests, as backups are created quarterly, that it was
the recent 0.8.x? right Andrew?


Was a mail client or server running at the same time as the backup or
restore?


i'd like to know too :)
Below are the error messages for the files/dirs that failed. I still don't see a Traceback at the end and none of the files was corrupted (tar would 
have said something).


that confuses me too.
Andrew: can you make sure the backup/files_mentioned were indeed
restored incompletely or corrupted.


Errors like this were present in very early versions
of librsync and duplicity, 0.6-series especially.  I'm not confident
there's any solution if this came from a younger version. The only thing I can suggest is to quiesce your system as much as possible and try to rerun 
the restore.


finally, i suggest you to run verify regularly, ideally after every
backup. it's just an extra step to ensure your data is save!


Post the output.txt file only if the result changes.


looking forward to hear from you .. ede/duply.net


...Ken

ken@dione:~/workspace/duplicity-git$ egrep ^Processed\|librsync
~/Downloads/duplicity-output.txt
Processed volume 1 of 1406
Processed volume 2 of 1406
Processed volume 3 of 1406
Processed volume 4 of 1406
Processed volume 5 of 1406
Processed volume 6 of 1406
Processed volume 7 of 1406
Processed volume 8 of 1406
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/Contact-Improv
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/Contact-Improv.msf
Processed volume 9 of 1406
Processed volume 10 of 1406
Processed volume 11 of 1406
Processed volume 12 of 1406
Processed volume 13 of 1406
Processed volume 14 of 1406
Processed volume 15 of 1406
Processed volume 16 of 1406
Processed volume 17 of 1406
Processed volume 18 of 1406
Processed volume 19 of 1406
Processed volume 20 of 1406
Processed volume 21 of 1406
Processed volume 22 of 1406
Processed volume 23 of 1406
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd14
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/Fedora
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd14
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/Fedora.msf
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/GNUcash
Processed volume 24 of 1406
Processed volume 25 of 1406
Processed volume 26 of 1406
Processed volume 27 of 1406
Processed volume 28 of 1406
Processed volume 29 of 1406
Processed volume 30 of 1406
Processed volume 31 of 1406
Processed volume 32 of 1406
Processed volume 33 of 1406
Processed volume 34 of 1406
Processed volume 35 of 1406
Processed volume 36 of 1406
Processed volume 37 of 1406
Processed volume 38 of 1406
Processed volume 39 of 1406
Processed volume 40 of 1406
Processed volume 41 of 1406
Processed volume 42 of 1406
Processed volume 43 of 1406
Processed volume 44 of 1406
Processed volume 45 of 1406
Processed volume 46 of 1406
Processed volume 47 of 1406
Processed volume 48 of 1406
Processed volume 49 of 1406
Processed volume 50 of 1406
Processed volume 51 of 1406
Processed volume 52 of 1406
Processed volume 53 of 1406
Processed volume 54 of 1406
Processed volume 55 of 1406
Processed volume 56 of 1406
Processed volume 57 of 1406
Processed volume 58 of 1406
Processed volume 59 of 1406
Processed volume 60 of 1406
Processed volume 61 of 1406
Processed volume 62 of 1406
Processed volume 63 of 1406
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd15
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/Inbox.msf
Processed volume 64 of 1406
Processed volume 65 of 1406
Processed volume 66 of 1406
Processed volume 67 of 1406
Processed volume 68 of 1406
Processed volume 69 of 1406
Processed volume 70 of 1406
Processed volume 71 of 1406
Processed volume 72 of 1406
Processed volume 73 of 1406
Processed volume 74 of 1406
Processed volume 75 of 1406
Processed volume 76 of 1406
Processed volume 77 of 1406
Processed volume 78 of 1406
Processed volume 79 of 1406
Processed volume 80 of 1406
Processed volume 81 of 1406
Processed volume 82 of 1406
Processed volume 83 of 1406
Processed volume 84 of 1406
Processed volume 85 of 1406
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/Sent.msf
Processed volume 86 of 1406
Processed volume 87 of 1406
Processed volume 88 of 1406
Processed volume 89 of 1406
Processed volume 90 of 1406
Processed volume 91 of 1406
Processed volume 92 of 1406
Processed volume 93 of 1406
Processed volume 94 of 1406
Processed volume 95 of 1406
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/Trash.msf
Processed volume 96 of 1406
Processed volume 97 of 1406
Processed volume 98 of 1406
Processed volume 99 of 1406
Processed volume 100 of 1406
Processed volume 101 of 1406
Processed volume 102 of 1406
Processed volume 103 of 1406
Processed volume 104 of 1406
Processed volume 105 of 1406
Processed volume 106 of 1406
Processed volume 107 of 1406
Processed volume 108 of 1406
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/Mail/Local Folders/jobs
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input> Error 'librsync error 103 while in patch cycle' patching 
hrxj5i8h.default/Mail/Local Folders/jobs.msf
Processed volume 109 of 1406
Processed volume 110 of 1406
Processed volume 111 of 1406
Processed volume 112 of 1406
librsync: ERROR: (rs_file_copy_cb) unexpected eof on fd13
librsync: ERROR: (rs_job_complete) patch job failed: unexpected end of input 
Error 'librsync error 103 while in patch cycle' patching
hrxj5i8h.default/training.dat
Processed volume 113 of 1406
Processed volume 114 of 1406
Processed volume 115 of 1406
Processed volume 116 of 1406
Processed volume 117 of 1406
Processed volume 118 of 1406
Processed volume 119 of 1406
Processed volume 120 of 1406

On Fri, Nov 12, 2021 at 3:17 PM andrew via Duplicity-talk <
duplicity-talk@nongnu.org> wrote:


Hi ede,

Thank-you for the command line addition.

Using this now:

duplicity restore -v9 --file-to-restore home/awood/.thunderbird
file:///run/media/awood/MyPassport/Deja-Vu-Back-up/
home/awood/.thunderbird > output.txt 2>&1

Gives the attached file. Apologies for the size of it.

Best wishes,

Andrew

Andrew Wood, Oxford.

- o -

On 12/11/2021 16:52, edgar.soldin--- via Duplicity-talk wrote:

hey Andrew,
this still does _not_ contain an error stack. pretty likely error are put out to STDERR which you omitted to redirect. please run again with 
'2>&1' in the end e.g.

duplicity restore ... > output.txt 2>&1

nothing is supposed to be output to the terminal then as all is
captured by the redirect into the file given!

good luck.. ede

On 12.11.2021 17:02, andrew via Duplicity-talk wrote:

Hi ede/everyone,
To investigate why duplicity wasn't restoring the email files which I 
mentioned then I ran this:

duplicity restore -v9 --file-to-restore home/awood/.thunderbird
file:///run/media/awood/MyPassport/Deja-Vu-Back-up/
home/awood/.thunderbird > output.txt

I've attached the outputfile which is 3.7 MB. There were also some
libsync errors which I guess were being output on stderr?

Best wishes,

Andrew

Andrew Wood, Oxford

- o -


On 11/11/2021 12:49, edgar.soldin--- via Duplicity-talk wrote:

On 10.11.2021 20:20, andrew via Duplicity-talk wrote:

Hello,
I hope you're keeping. I've run into a difficult with duplicity and I am at a loss to understand the difficulty. Any suggestions would 
be appreciated.

I have been using Déjà Dup on Fedora 33 for weekly backups of my
home directory which includes a hidden Thunderbird directory. I
installed Fedora 35 and tried using restore (Backups 42.8). While 
this has successfully restored most of the files, it hasn't been
successful with some Thunderbird files - but not all of them!

For example:

/home/awood/Documents/myDocuments/Thunderbird-gnapcorg10nov2021/

pop.gn.apc.org/Mail/Local

Folders/Inbox
/home/awood/Documents/myDocuments/Thunderbird-gnapcorg10nov2021/

pop.gn.apc.org/Mail/Local

Folders/Inbox.msf
/home/awood/Documents/myDocuments/Thunderbird-gnapcorg10nov2021/

pop.gn.apc.org/Mail/Local

Folders/Sent
/home/awood/Documents/myDocuments/Thunderbird-gnapcorg10nov2021/

pop.gn.apc.org/Mail/Local

Folders/Sent.msf
/home/awood/Documents/myDocuments/Thunderbird-gnapcorg10nov2021/

pop.gn.apc.org/Mail/Local

Folders/Trash
/home/awood/Documents/myDocuments/Thunderbird-gnapcorg10nov2021/

pop.gn.apc.org/Mail/Local

Folders/Trash.msf

At the end of the restore then these files are listed along with
'Could not restore the following files. Please make sure you are
able to write to them.'
I can't think of any reason why they couldn't be written - there's definitely space on the disk. I also tried to restore the back-up on 
Ubuntu and I had the same message.

Any suggestions? Thank-you.


hey Andrew,

we need more details. could you please run duplicity with maximum
verbosity '-v9' and put the full command line output to pastebin or 
the like and post the link here? obfuscate information you deem
private in it beforehand!

..regards ede/duply.net

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk


_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk




_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk




_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk




_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk


_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
reply via email to
[Prev in Thread] Current Thread [Next in Thread]