Re: "Calculated and written ECMA-119 tree end differ" under very specific circumstances

[Valtteri Vuorikoski]

"Thomas Schmitt" <scdbackup@gmx.net> writes:

>
> Valtteri Vuorikoski wrote:
>> The bad news is that the full backup job with some 140k files
>> fails using an invocation that worked previously (apparently because
>> zisofs was only applied to files from the local filesystem).
>> ...
>> find /Mail -type f -pending_data -exec set_filter --zisofs --
>
> So now /Mail comes from NFS ?
> How many files are in Mail ? Most of the 140k ?

Looks like total is closer to 130k after I had adjusted some
excludes. Mail is local and is about 50k. I'd say about 90% of the
remaining 80k comes from NFS mounted filesystems.

> Does it work with -xattr "on" ?
>
> Did you try whether it really works with -for_backup if you omit the
> setting of zisofs filters ?
> (You may use -dev "stdio:/dev/zero" instead of -dev "/dev/sr0".
> It's only of interest whether the warning message appears.)

-for_backup with zisofs disabled (dev set to /dev/zero) also fails:

xorriso : UPDATE : Writing:       8170s    0.2%   fifo   0%  buf  50%
libisofs: WARNING : Calculated and written ECMA-119 tree end differ: 37130 <> 
37063
xorriso : UPDATE : Writing:      44587s    0.9%   fifo   0%  buf  50%   76.9xD 
[…]
xorriso : UPDATE : Writing:    5082760s   98.8%   fifo   0%  buf  50%  137.4xD 
libisofs: FATAL : Image is most likely damaged. Calculated/written tree end 
address mismatch.
libisofs: FATAL : Image is most likely damaged. Calculated/written image end 
address mismatch.
libburn : FAILURE : Premature end of input encountered. Missing: 444416 bytes

With only "-xattr any" and zisofs disabled:

xorriso : UPDATE : Writing:       7141s    0.1%   fifo   0%  buf  50%
libisofs: WARNING : Calculated and written ECMA-119 tree end differ: 32551 <> 
32522
xorriso : UPDATE : Writing:      36974s    0.7%   fifo   0%  buf  50%   55.0xD 
[…]
xorriso : UPDATE : Writing:    5130836s   99.8%   fifo   0%  buf  50%  514.6xD 
libisofs: FATAL : Image is most likely damaged. Calculated/written tree end 
address mismatch.
libisofs: FATAL : Image is most likely damaged. Calculated/written image end 
address mismatch.
libburn : FAILURE : Premature end of input encountered. Missing: 366592 bytes

Invocation with "-xattr on" finishes successfully.

> How ist it structured, roughly ? (How many subdirectories with how many
> files ?)
> How long are the file names ?

There are about 50k local files and 80k files from NFS mounts in a total
of around 16k directories. File names should be mostly normal (mean ~26
characters, maximum is 82), full paths get pretty long (>130 characters
is common, maximum is 260).

 -Valtteri

signature.asc
Description: PGP signature