First, thank you for integrating the acdcli backend. I've used it on
a couple machines. Amazon Cloud Drive seems to be slow and a little
bit unreliable compared to other cloud backup providers. I don't
know if that's due to ACD being consumer oriented or because
Amazon's systems/networks are not as good.
On one server, I got some errors and warnings in the course of a
backup operation, but duplicity reported the backup as having
completed. I'd like to ask if this is something to be concerned about.
There were a few different kinds of errors and warnings (examples
below), but they all include the text "Attempt 1 failed" so am I to
understand that this means duplicity will retry such failures and
everything is OK as long as duplicity reported the normal statistics
at the end?
(I did check the ACD online file list for some of the failed files
and they are listed there)
It's also interesting to note that one of the errors indicated that
Amazon was asking me to stop uploading files so fast - it looks like
acdcli understands this and paused the duplicity operation? I guess
the entire package is robust enough to handle that?
Last question, the final error listed in the duplicity log had a
timestamp that was AFTER the "EndTime" reported by the duplicity
statistics that were printed BELOW that error message. In fact, the
acd_cli log file showed some activity AFTER the timestamp of that
error too! I'm curious what to make of this.
PS - The progress meter type output returned from the backend looks
to be intended for interactive uses; any way to get rid of that?
Here are examples of the errors I saw:
16-05-30 14:46:30.214 [WARNING] [acd_cli] - Timeout while uploading
"/tmp/duplicity-6QhuKP-tempdir/duplicity_temp.1/duplicity-full.20160530T143513Z.vol4.difftar.gpg.vol000+200.par2".
Attempt 1 failed. BackendException: Error running 'acd_cli upload
--force --overwrite
'/tmp/duplicity-6QhuKP-tempdir/duplicity-full.20160530T143513Z.vol7.difftar.gpg' '/backups3/'': returned 8, with
output:
[ ] 0.0% of 25MiB 0/1 0.0B/s
0s^M[ ] 1.9% of 25MiB 0/1 166.7KB/s
02:34m^M[###### ] 26.5% of 25MiB 0/1
2.3MB/s 08s^M[############### ] 63.5% of 25MiB 0/1
5.5MB/s 01s^M[#########################] 100.0% of 25MiB
1/1 8.8MB/s 0s^M[#########################] 100.0% of
25MiB 1/1 8.8MB/s 0s^M[#########################] 100.0%
of 25MiB 1/1 8.8MB/s 0s^M[#########################]
100.0% of 25MiB 1/1 8.8MB/s
0s^M[#########################] 100.0% of 25MiB 1/1 8.8MB/s
0s^M[ ] 0.0% of 25MiB 0/1 -2.1KB/s
0s^M
1 file(s) failed.
16-05-30 14:48:26.154 [ERROR] [acd_cli] - Uploading
"duplicity-full.20160530T143513Z.vol7.difftar.gpg" failed.
RequestError: 500, {"message":"Internal failure"}.
Attempt 1 failed. BackendException: Error running 'acd_cli upload
--force --overwrite
'/tmp/duplicity-6QhuKP-tempdir/duplicity_temp.3/duplicity-full.20160530T143513Z.vol146.difftar.gpg.par2' '/backups3/'': returned 8, with
output:
[ ] 0.0% of 39KiB 0/1 0.0B/s
0s^M[#########################] 100.0% of 40KiB 1/1 13.5KB/s
0s^M[ ] 0.0% of 39KiB 0/1 -15.9B/s
0s^M
1 file(s) failed.
16-05-30 21:27:41.353 [ERROR] [acd_cli] - Uploading
"duplicity-full.20160530T143513Z.vol1193.difftar.gpg" failed.
RequestError: 429,
{"logref":"9db471a1-4933-16e2-b81a-6873b0ad0163","message":"System
unavailable. Please back off for a while and try again
later","code":""}.
Attempt 1 failed. BackendException: Error running 'acd_cli upload
--force --overwrite
'/tmp/duplicity-6QhuKP-tempdir/duplicity-full.20160530T143513Z.vol1199.difftar.gpg' '/backups3/'': returned 8, with
output:
[ ] 0.0% of 25MiB 0/1 0.0B/s
0s^M[ ] 0.9% of 25MiB 0/1 76.5KB/s
05:40m^M[## ] 8.4% of 25MiB 0/1
736.0KB/s 32s^M[########## ] 40.7% of 25MiB
0/1 3.6MB/s 04s^M[################### ] 77.8% of
25MiB 0/1 6.8MB/s 00s^M[ ] 0.0%
of 25MiB 0/1 5.8KB/s 01:14h^M
1 file(s) failed.