[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Bug-wget] How to crawl multiple URLs enlisted in a file using single wg
From: |
Avinash |
Subject: |
[Bug-wget] How to crawl multiple URLs enlisted in a file using single wget connection ? |
Date: |
Tue, 29 Jun 2010 16:06:03 +0530 |
Hi All,
I have a file with hundreds of URLs present in it. One per line.
I am using -i option of wget to crawl all these URLs.
But it seems that wget is creating a new connection per URL.
Is there any way to tell wget to use single connection for all URLs ?
If so then what is that and what could be the side effects of going with
this approach ?
If there are none of them then why is wget not going with this approach by
default ?
Please provide your expert opinion.
Thanks & Regards,
Avinash
- [Bug-wget] How to crawl multiple URLs enlisted in a file using single wget connection ?,
Avinash <=