wget-dev
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: wget2 | no-parent option not working as expected (#620)


From: leex (@leex279)
Subject: Re: wget2 | no-parent option not working as expected (#620)
Date: Mon, 12 Dec 2022 17:17:17 +0000



leex commented:


Ok, but why is it needed to scan outside the parent directory. In my case this 
leads into more than 500 Million documents that are loaded into RAM but not 
needed. It also took a lot of time (for nothing?!). 

I already game my server VM more RAM (2 -> 8 GB). So it was able to finish the 
job.

My usecase (and I hope I can use wget2 for it) is to download continously all 
the files from the mentioned website (they will be parsed after downloading). 
-> Is that possible in your view? Think I would need to use "-N" for 
timestamping but I guess it will still start then at beginning and load up all 
into RAM. Try to test it.


Thanks for trying to check it :smile:

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/wget2/-/issues/620#note_1205993498
You're receiving this email because of your account on gitlab.com.




reply via email to

[Prev in Thread] Current Thread [Next in Thread]