On 8/17/07, jidanni@jidanni.org jidanni@jidanni.org wrote:
Anyway of keeping these from wasting bandwidth, GET /index.php?title=Special:Search&ns0=1&redirs=0&searchx=1&search=487.3000 "Baiduspider GET /index.php?title=Category:130.6000&action=edit Googlebot/2.1 _without_ worrying about making pretty URLs (so one can use "index.php" in robots.txt)?
You could blacklist anything with an "&" in it to achieve similar effect, I suppose.