lzip-bug
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Lzip-bug] bug report: 'plzip -vf9' fails to compress files over a c


From: Antonio Diaz Diaz
Subject: Re: [Lzip-bug] bug report: 'plzip -vf9' fails to compress files over a certain size
Date: Tue, 12 Dec 2017 16:24:07 +0100
User-agent: Mozilla/5.0 (X11; U; Linux i586; en-US; rv:1.9.1.19) Gecko/20110420 SeaMonkey/2.0.14

Erik Jan Tromp wrote:
The troublesome test files compressed without error, but at a cost of
time on some machines (lesser thread count).

Thanks. I chose a conservative 2 GiB limit to avoid problems with signed addresses, but I have been reading again the linux configuration help, and it states that when HIGHMEM is enabled, the per process memory limit is 3 GiB.

As I guess that all 32 bit machines with enough processors will have HIGHMEM (or similar) enabled, maybe you could try to raise the limit to 3 GiB replacing '0x7FFFFFFF' with '0xBFFFFFFFLL' in the patch and see what happens? Thanks.


Side note: the system default value is unchanged between unpatched&
patched.

Yes. The system default is the number of processors reported by sysconf.


I'm curious as to the disparity between system default&  actual
threads. Dispatcher(s)&  workers?

Exactly. As you can see in the plzip manual[1], "For each input file, a splitter thread and several worker threads are created, acting the main thread as muxer (multiplexer) thread."

[1] http://www.nongnu.org/lzip/manual/plzip_manual.html#Program-design


Best regards,
Antonio.



reply via email to

[Prev in Thread] Current Thread [Next in Thread]