wget-dev
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the ro


From: Archit Pandey
Subject: Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454)
Date: Tue, 22 Oct 2019 10:34:09 +0000



Archit Pandey commented:


Yes, just mailed it to address@hidden. 

Let me know if any changes are required since I'm unsure of how copyright 
transfers work. :grimacing:

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/wget2/merge_requests/454#note_233819128
You're receiving this email because of your account on gitlab.com.




reply via email to

[Prev in Thread] Current Thread [Next in Thread]