[LRUG] Exception notifier and bots

[Daniel Tenner]

Have you considered using robots.txt to tell the bots to stay away  
from those error pages?

Daniel

On 31 Jul 2008, at 11:2731 Jul 2008, Matthew Rudy Jacobs wrote:

> You mean you get exceptions from bots randomly causing 500s?
>
> Yeah...
> don't know what to do about that.
>
> Just because it's a bot, doesn't mean it's request is invalid.
>
> eg. Google indexes a lot of pages that you want to work, but may not  
> get hit very often.
>
> If you have proper Regexp inbox rules,
> then perhaps you can just put mails that don't have a body matching  
> "Mozilla|MSIE|Safari" into a "exceptions (maybe from a bot)" mail  
> folder.
>
> :s
>
> 2008/7/31 Andrea (Q) <q at ptumpa.com>
> Hi,
>
> everyday i receive a lot of exceptions but the most of are from bot,  
> there is a way to manage that situation? i don't want to receive the  
> exceptions raised by a bot. I think that i could try to read the  
> header of the request and the HTTP_USER_AGENT field but maybe there  
> is something better.
>
> Cheers
>
> Andrea
> _______________________________________________
> Chat mailing list
> Chat at lists.lrug.org
> http://lists.lrug.org/listinfo.cgi/chat-lrug.org
>
> _______________________________________________
> Chat mailing list
> Chat at lists.lrug.org
> http://lists.lrug.org/listinfo.cgi/chat-lrug.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lrug.org/pipermail/chat-lrug.org/attachments/20080731/911f59fe/attachment-0003.html>