[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Bug-wget] generating a directory list using wget
From: |
Micah Cowan |
Subject: |
Re: [Bug-wget] generating a directory list using wget |
Date: |
Wed, 18 Mar 2009 10:15:04 -0700 |
User-agent: |
Thunderbird 2.0.0.19 (X11/20090105) |
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Santyana, Henry Gibson wrote:
> I'm a little bit new with wget and I would like to ask if it is possible
> to use wget to crawl through web pages and produce a directory listing?
>
> There is currently a web site that I need to monitor for changes and
> what I'm doing is I download the whole web site and compare it to an
> earlier version I downloaded. But I find it taking a long period of time
> to download. I was thinking that if I don't need to download the content
> and come up with a way to just produce a directory listing then it would
> save me a lot of time.
Unfortunately, wget won't be much help for you in that. And if the
server doesn't produce its own directory listings, I'm not really sure
anything can help you much; you'd still need to download things in order
to parse for new links and such.
- --
Micah J. Cowan
Programmer, musician, typesetting enthusiast, gamer.
Maintainer of GNU Wget and GNU Teseq
http://micah.cowan.name/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAknBLBgACgkQ7M8hyUobTrFzhACdEju0HYy5ilbZimbnk1gYlucO
/+kAn03RHsGsKwg2+ib2vYJepCLAI3QQ
=cmaK
-----END PGP SIGNATURE-----