|
From: | Suhas K S |
Subject: | Re: libWARC | Identify external libraries required by LibWARC (#5) |
Date: | Wed, 27 May 2020 06:07:59 +0000 |
Suhas K S commented: Here are the external libraries that libWARC would use: 1. **libuuid:** This would be used for generation of UUIDs required for WARC-Record-IDs of individual records. 2. **Gnulib modules:** - **crypto/sha1:** This module contains functions for calculating SHA1 digests which would be useful in obtaining the Block and the Payload digests for records. - **base32:** WARC specifications require digests to be encoded in base32. This module would be used for that. 3. **libzstd:** Compression is an important aspect of writing WARC files. Wget used GZIP for WARC compression. LibWARC would use zstd since it offers better compression ratios. -- Reply to this email directly or view it on GitLab: https://gitlab.com/gnuwget/libwarc/-/issues/5#note_349748996 You're receiving this email because of your account on gitlab.com.
[Prev in Thread] | Current Thread | [Next in Thread] |