wget

Daniel Carrillo daniel.carrillo at gmail.com
Mon Jun 30 17:12:25 UTC 2008


2008/6/30 Joy Methew <ml4joy at gmail.com>:
> Bacchi
>
> how i use "robost.txt" plz explain with example.
>
> Daniel......
> it`s working for "wget" but still we can download from other utilities
> like..."DownloadStudio
>

Add another line:

SetEnvIfNoCase User-Agent "^DownloadStudio" blacklist.

Check Apache documentation for more details.

BR.




More information about the redhat-list mailing list