Re: [Duplicity-talk] Sometimes reads manifest from backup location even though it's in cache -- why?

[edgar . soldin]

yeah, please file a bug on launchpad, but check if there is a similar entry 
first please.
also point to this mail thread (via gmane or some) for others to read.

i still haven't and probably for some time will not have time to disect the 
issue.
first and foremost. the local cache (archive-dir) functionality was introduced 
with 0.6 by Kenneth (the maintainer), so we should ask him what he thinks the 
issue is here. i tried before, but haven't got an anser. i'll cc him again.

Ken: any idea on this? cite from below: "duplicity will sometimes decide to 
retrieve a manifest from the remote backup location even though there's a copy 
in the local cache"


..ede/duply.net


On 17.04.2013 04:04, address@hidden wrote:
> So I guess I should just turn this into a bug report? Concerns me that I 
> don't see a good way for the maintainer to reproduce the bug, which is going 
> to make it hard to fix.
> 
> One circumstance that was different when it failed from when it worked is 
> this: I was running nightly backups, then the machines all got shut down for 
> a week and a half, and it was when I started them back up that this failure 
> appeared. Does duplicity like to retrieve the manifest from the remote if 
> it's more than a week old?
> 
>  - Dave Cottingham
> 
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
> *From: address@hidden
> *To: *"Discussion of the backup program duplicity" <address@hidden>
> *Sent: *Friday, April 12, 2013 3:16:58 PM
> *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup location 
> even though it's in cache -- why?
> 
> Here's the log file, gzipped. I should've thought of that myself.
> 
> Thanks,
> Dave Cottingham
> 
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
> *From: *"edgar soldin" <address@hidden>
> *To: *"Discussion of the backup program duplicity" <address@hidden>
> *Sent: *Friday, April 12, 2013 2:05:00 PM
> *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup location 
> even though it's in cache -- why?
> 
> did you try zipping it? else just put it on some filehoster/pastebin 
> ..ede/duply.net
> 
> On 12.04.2013 19:03, address@hidden wrote:
>> I see the same problem with 0.6.21.
>> 
>> I found that one of my other machines was already running the latest 
>> version. It similarly fails when it decides to retrieve the latest manifest 
>> from the remote location, although the manifest is in the local cache.
>> 
>> I tried sending this message this morning with the "-v9" log attached, and 
>> it never appeared on the list, so I'm trying again without the attachments. 
>> If this gets through I'll try sending the log in a subsequent message.
>> 
>> Thanks,
>> Dave Cottingham
>> 
>> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>> *From: *"edgar soldin" <address@hidden>
>> *To: *"Discussion of the backup program duplicity" <address@hidden>
>> *Sent: *Monday, April 8, 2013 12:36:40 PM
>> *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup 
>> location even though it's in cache -- why?
>> 
>> looks like you are right. it explicitely states that the metadata is in 
>> sync, hence it should use the local copy.
>> 
>> before anything else. please try the latest release 0.6.21. install it from 
>> tarball if your distro does not sport in the repository. directions here 
>> http://duply.net/?title=Duply-documentation under section TIP.
>> we have had lot's of fixes since your version.
>> 
>> @Ken: any idea why it still tries to download it?
>> 
>> ..ede/duply.net
>> 
>> On 08.04.2013 17:29, address@hidden wrote:
>>> Here's the output of "-v9" for one of my backups. It's quite voluminous, so 
>>> I've put it in an attachment.
>>> 
>>> I've also attached a list of the archive dir -- looks to me like the file 
>>> it's trying to retrieve is already cached.
>>> 
>>> Thanks,
>>> Dave Cottingham
>>> 
>>> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>>> *From: *"edgar soldin" <address@hidden>
>>> *To: *"Discussion of the backup program duplicity" <address@hidden>
>>> *Sent: *Monday, April 8, 2013 9:05:07 AM
>>> *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup 
>>> location even though it's in cache -- why?
>>> 
>>> On 08.04.2013 02:58, address@hidden wrote:
>>>> I see that duplicity will sometimes decide to retrieve a manifest from the 
>>>> remote backup location even though there's a copy in the local cache. Can 
>>>> anyone clarify what circumstances cause this to happen, and why?
>>>> 
>>>> Here's why I care. I am backing up to Amazon S3 and using a lifecycle rule 
>>>> to transition everything to Glacier. So, of course, nothing can be 
>>>> retrieved without prior manual intervention. I expected this to work since 
>>>> the local cache has everything duplicity needs, and in fact this worked 
>>>> with nightly backups for over two weeks. But now duplicity fails because 
>>>> it is trying to retrieve the last manifest, even though that file is in 
>>>> the cache.
>>>> 
>>> 
>>> question is why. do you have an extra verbose '-v9' output for us? 
>>> obfuscate private strings in it and post it here.
>>> 
>>> ..ede/duply.net
>>>