Looking for some apache config help to block evil spiders
Sharpe, Sam J
sam.sharpe+lists.redhat at gmail.com
Sat Oct 10 18:59:31 UTC 2009
2009/10/10 Sharpe, Sam J <sam.sharpe+lists.redhat at gmail.com>:
> 2009/10/10 Steven W. Orr <steveo at syslang.net>:
>> RewriteCond %{HTTP_USER_AGENT} ^Baiduspider.* [OR]
>> RewriteCond %{HTTP_USER_AGENT} ^msnbot.* [OR]
>> RewriteCond %{HTTP_USER_AGENT} ^NaverBot.* [OR]
>> RewriteCond %{HTTP_USER_AGENT} ^Sogou-Test-Spider.*
>> RewriteCond %{HTTP_USER_AGENT} ^Mozilla/4.0.*
>> RewriteCond %{HTTP_USER_AGENT} ^T-Mobile Dash.*
>> RewriteRule .* - [F,L]
>
> Are you actually missing the [OR] at the end of the 4th and 5th
> RewriteCond lines, or is that a mispaste...
>
> If you are missing the [OR] then you are only matching things that
> starts with any of the top four matches AND Mozilla/4.0 AND T-Mobile
> Dash (somewhat mutually exclusive!)...
I found this for a customer today, it's a cracking read and has some
great pre-written ways of blocking this kind of thing:
http://www.askapache.com/htaccess/fight-blog-spam-with-apache.html
--
Sam
More information about the fedora-list
mailing list