Re: wget2 | Add support for pre/post download scripts (#80)

[Andrew White (@awhite27)]

Andrew White commented: 
https://gitlab.com/gnuwget/wget2/-/issues/80#note_1837284512

This is something I would find useful. In particular I would like to be able to 
rewrite URLs. I am mirroring a website that uses queries to generate webpages. 
There are some redundant fields in the query. The URLs parsed from the pages 
contain different values in the redundant fields so I end up downloading each 
page 10 to 20 times. If I could normalize the URLs before wget2 downloads each 
page I could eliminate the duplicates and just symlink the original URL to the 
normalized URL.

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/wget2/-/issues/80#note_1837284512
You're receiving this email because of your account on gitlab.com.