Re: [Bug-wget] [Failed] Wget mirroring command

[Tim Ruehsen]

On Sunday, July 10, 2016 11:50:07 AM CEST chika tambun wrote:
> Dear List,
> 
> I've used to mirror the website using the command
> # wget -np --mirror -p --convert-links --reject
> msi,asc,gz,bz2,zip,bin,rpm,deb -P /var/www/html $url
> 
> But i've got failed when launch this command for
> http://supervisord.org/index.html
> # wget -np --mirror -p --convert-links --reject
> asc,bin,bz2,deb,doc,exe,gif,gz,java,jpg,msi,pdf,png,rpm,txt,zip -P
> /var/www/html http://supervisord.org/index.html
> 
> Any reference, would be appreciated.

They don't want you to mirror their site :-(

You have to change the request User-Agent (option -U) to work around.
You should consider to be polite and also add --wait=1 to wait 1s between 
requests .

Regards, Tim

signature.asc
Description: This is a digitally signed message part.