[whatwg] Proposal: Exclude robots on a per-link basis

Karl Dubost karld at opera.com
Sat Nov 26 06:34:00 PST 2011


Le 26 nov. 2011 à 07:20, Markus Ernst a écrit :
> Viewing the logs of applications I wrote, I noticed that a considerable number of requests are from robots following links of types such as "Add to shopping cart" or "Remember this item" - links that typically point to the same page they are clicked on, with some GET variable that triggers an action on the server.


http://www.w3.org/2001/tag/doc/whenToUseGet.html
http://blog.whatfettle.com/2005/10/31/is-it-safe/

-- 
Karl Dubost - http://dev.opera.com/
Developer Relations & Tools, Opera Software



More information about the whatwg mailing list