|
From: | Tim Rühsen |
Subject: | Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454) |
Date: | Tue, 22 Oct 2019 11:45:28 +0000 |
Merge Request !454 was closed by Tim Rühsen Merge Request url: https://gitlab.com/gnuwget/wget2/merge_requests/454 Project:Branches: archit-p/wget2:robot-fix to gnuwget/wget2:master Author: Archit Pandey Assignees: -- Reply to this email directly or view it on GitLab: https://gitlab.com/gnuwget/wget2/merge_requests/454 You're receiving this email because of your account on gitlab.com.
[Prev in Thread] | Current Thread | [Next in Thread] |