wget2 | Exit code 8 - mirror complex site (#535)

[Aron Novak]

Aron Novak created an issue: https://gitlab.com/gnuwget/wget2/-/issues/535



The following command:
```
time docker run --user "$(id -u):$(id -g)" -v $PWD:/data --rm 
arongizra/wget2-alpine --max-threads=16 --mirror --page-requisites 
--adjust-extension --no-parent --convert-links -e robots=off --reject 
"*.jpg,*.jpeg,*.png,*.zip,*.pdf,*.svg,*&page=*,*?page=*,*media/oembed?*,*.jpg\?*,*.png\?*,*.jpeg\?*"
 haiti.un.org
```

Results in an exit code 8.

The docker container has wget2-1.99.2 .

Also I could reproduce it by downloading the .tar.gz of the latest release:
```
./src/wget2 --max-threads=16 --mirror --page-requisites --adjust-extension 
--no-parent --convert-links -e robots=off --reject 
"*.jpg,*.jpeg,*.png,*.zip,*.pdf,*.svg,*&page=*,*?page=*,*media/oembed?*,*.jpg\?*,*.png\?*,*.jpeg\?*"
 benin.un.org
```

```
./src/wget2 --max-threads=16  --page-requisites --adjust-extension --no-parent 
-e robots=off --reject 
"*.jpg,*.jpeg,*.png,*.zip,*.pdf,*.svg,*&page=*,*?page=*,*media/oembed?*,*.jpg\?*,*.png\?*,*.jpeg\?*"
 benin.un.org
```
Also fails similarly.

Further simplifying the things:
```
./src/wget2 --max-threads=16  --adjust-extension --no-parent -e robots=off 
--reject 
"*.jpg,*.jpeg,*.png,*.zip,*.pdf,*.svg,*&page=*,*?page=*,*media/oembed?*,*.jpg\?*,*.png\?*,*.jpeg\?*"
 benin.un.org
```

works, exit code 0 is generated.

![Screenshot_20201013_145909](/uploads/038fd182fcce766fdb8f12724d2e5474/Screenshot_20201013_145909.png)

Despite the erroneous exit code, the content is downloaded, most of the links 
seem to be rewritten correctly.

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/wget2/-/issues/535
You're receiving this email because of your account on gitlab.com.