wget-dev
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: libWARC | Identify external libraries required by LibWARC (#5)


From: Suhas K S
Subject: Re: libWARC | Identify external libraries required by LibWARC (#5)
Date: Wed, 27 May 2020 06:07:59 +0000



Suhas K S commented:


Here are the external libraries that libWARC would use:

1. **libuuid:** This would be used for generation of UUIDs required for 
WARC-Record-IDs of individual records.
2. **Gnulib modules:**
    - **crypto/sha1:** This module contains functions for calculating SHA1 
digests which would be useful in obtaining the Block and the Payload digests 
for records.
    - **base32:** WARC specifications require digests to be encoded in base32. 
This module would be used for that.
3. **libzstd:** Compression is an important aspect of writing WARC files. Wget 
used GZIP for WARC compression. LibWARC would use zstd since it offers better 
compression ratios.

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/libwarc/-/issues/5#note_349748996
You're receiving this email because of your account on gitlab.com.




reply via email to

[Prev in Thread] Current Thread [Next in Thread]