[LRUG] Exception notifier and bots

[Daniel Tenner]

I doubt your error pages are going to rank very high in the search  
engines!

If you know that certain URLs that bots are prone to poke are always  
going to throw exceptions, tell the bots not to go there... Chances  
are, they mark you down for having lots of error pages anyway, so by  
removing those pages from what the bots index, you might well improve  
your rankings...

I didn't suggest to tell the bots to stay away from your page, btw -  
only from the spurious URLs which the bots hit all the time and which  
generate errors each time. I'm assuming there's a pattern to them.

Daniel

On 31 Jul 2008, at 11:5731 Jul 2008, Andrea (Q) wrote:

> I just don't want to receive it, i don't know if it's a good idea to  
> tell the bots to stay away from my page, more pages are indexed more  
> people can see my app, no?
> But that's funny because actually i've some troubles with the search  
> engines, my domain disappear :D
>
> On Jul 31, 2008, at 11:34 AM, Thomas R. Koll wrote:
>
>> What exception?
>> ActionController::InvalidAuthenticityToken is the most common for
>> me but I don't bother the mails so the following tips are just  
>> theory:
>>
>> The exception is raised in  
>> ActionController::RequestForgeryProtection.verify_authenticity_token
>> so you might want to overwrite it and for example redirect to  
>> something else.
>>
>> An alternative is to skip the filter for your create (or update)  
>> method and
>> in those methods do like
>>
>> skip_before_filter :verify_authenticity_token, :only => :create
>> def create
>> render :new and return unless verified_request?
>> # ...
>> end
>>
>> ciao, tom
>>
>>
>> Am 31.07.2008 um 12:16 schrieb Andrea (Q):
>>
>>> Hi,
>>>
>>> everyday i receive a lot of exceptions but the most of are from  
>>> bot, there is a way to manage that situation? i don't want to  
>>> receive the exceptions raised by a bot. I think that i could try  
>>> to read the header of the request and the HTTP_USER_AGENT field  
>>> but maybe there is something better.
>>
>>
>>
>> --
>> Thomas R. "TomK32" Koll || http://tomk32.de || http://ananasblau.com
>> just a geek trying to change the world
>> Skype: TomK32 || Mail: tomk32 at gmx.de
>>
>> _______________________________________________
>> Chat mailing list
>> Chat at lists.lrug.org
>> http://lists.lrug.org/listinfo.cgi/chat-lrug.org
>
> _______________________________________________
> Chat mailing list
> Chat at lists.lrug.org
> http://lists.lrug.org/listinfo.cgi/chat-lrug.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lrug.org/pipermail/chat-lrug.org/attachments/20080731/aa09b39e/attachment-0003.html>