Re: [Bug-wget] help

[George Liu]

?Dear Ray,

Thank you so much for the kind help. This really helps a lot.
Highly appreciative of your answer!!!

Best regards,

George


From: Ray Satiro 
Sent: Wednesday, December 15, 2010 11:32 AM
To: address@hidden ; Live-Email 
Subject: Re: [Bug-wget] help


      --- On Mon, 12/13/10, Live-Email <address@hidden> wrote:

        For instance, the following is year=2010, month=11, day=01 to 07. I 
used the following command but it failed.


        wget -r -l 3 -A"*.*" 
http://weather.uwyo.edu/cgi-bin/sounding?region=seasia&TYPE=TEXT%3ALIST&YEAR=2010&MONTH=11&FROM=0100&TO=0712&STNM=45004%3A


      Hi,

      You need to place quotes around a URL like that because of special 
characters, the ampersands and maybe others depending on your shell.

      no:
      wget http://abchost/whatever?fruit=apple&color=red
      yes:
      wget "http://abchost/whatever?fruit=apple&color=red";

      The actual download in your case is rejected however because of what's in 
the server's robots.txt. It has a disallow on /cgi-bin
      For more read this
      http://addictivecode.org/FrequentlyAskedQuestions#robots

      You could disable robots.txt (not polite) or in your example case it 
looks like disabling recursion would be just as good:
      wget 
"http://weather.uwyo.edu/cgi-bin/sounding?region=seasia&TYPE=TEXT:LIST&YEAR=2010&MONTH=11&FROM=0100&TO=0712&STNM=45004:";