Re: wget timeout does not work

[Dave Henderson]

Unfortunately this is on a shared hosting server that I have no control 
over.  I will reach out to their staff to see what can be done.  I 
appreciate the confirmation of fixes in the latter version though Tim.


Dave



On 3/11/22 2:16 PM, Tim Rühsen wrote:
> Hey Dave,
>
> just testing with wget 1.21.2 and it times out after 3s with your 
> command line.
>
> So this is a long fixed issue. Your wget 1.19.4 is from Jan 2018 and 
> dozens or hundreds of issues has been fixed meanwhile. Please try to 
> update.
>
> Regards, Tim
>
> On 08.03.22 22:45, Dave Henderson wrote:
> > Thanks for getting back in touch Tim. Sorry it took a little bit to 
> > respond.  I tried your suggestion, but there is no difference in the 
> > outcome - wget still hangs. Here is another URL to test:
> >
> > https://www.usnews.com/news/politics/articles/2022-03-04/clinton-global-initiative-restarted-to-tackle-urgent-needs 
> >
> >
> >
> > I am using version 1.19.4 with the following switches:
> >
> > wget -E -k -p -q -N --timeout=3 --tries=1 --server-response "URL"
> >
> >
> > Any other help would be appreciated!
> >
> > Thanks,
> >
> > Dave
> >
> >
> >
> > On 2/25/22 9:33 AM, Tim Rühsen wrote:
> > > On 16.02.22 00:32, Dave Henderson wrote:
> > > > Good afternoon.  I am trying to use wget to crawl some sites and one
> > > > of the sites that it gets to makes it get stuck.  I've tried using all
> > > > the timeout parameters, even each individually.  None of them work.
> > > > It just stays stuck.  Here's the link it is getting stuck on:
> > > >
> > > > https://www.adidas.com/us/women-sports_bras?cm_mmc=AdiDisplay_-_-training-_--_-Billboard-_-Default_ad-_-dv%3ABrand-_-cn%3ABRAREVOLUTIONAPPSS22_Reach-_-pc%3Atraining&cm_mmc1=GLOBAL&cm_mmc2=adidas-GLOBAL-Brand-Display-training-Multiple-GLOBAL-BRAREVOLUTIONAPPSS22-2202 
> > > >
> > > >
> > > > Looking forward to hearing back!
> > >
> > > By default, wget retries up to 20x, with a growing time span between 
> > > retries.
> > >
> > > Just try --timeout=3 --tries=1.
> > >
> > > Regards, Tim