wget
Tom 'Needs A Hat' Mitchell
mitch48 at sbcglobal.net
Fri Apr 16 04:13:45 UTC 2004
On Thu, Apr 15, 2004 at 10:41:39AM -0700, Gunnar vS Kramm wrote:
> Original e-mail from: Matthew Benjamin (msbenjamin at fedex.com):
>
> > Does anyone know how to use wget to drill down to all of the folders and
> > subdirectories in a website. I can mirror my website however it does not
> > grab all of the folders which contain data that the links go to. The
> > site is password protected.
> >
> > mattB.
....
> You should be able to use the -r switch to wget, as such:
> wget -r http://YourWebSite
Also, does his web site have a robots file?
--
T o m M i t c h e l l
/dev/null the ultimate in secure storage.
More information about the fedora-list
mailing list