Re: [Wget-dev] wget2 | Add proper WARC API + support by wget2 (#65)

[Chillar Anand]

Wget has warc support and archiving millions of urls is simple & quite fast 
compared to many other tools. 

To make this process faster, we have to use multiprocessing and spawning 1000+ 
process takes lot of RAM(~10GB). Instead if we have multi threading support, 
this processing will become much simpler.

Currently wget2/aria2 or any other multi threading tools doesn't have warc 
support.

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/wget2/issues/65#note_116083924
You're receiving this email because of your account on gitlab.com.