Google is checking all the Difference links and the histories - which it does not need to
because this puts unnecessary load on the server. Is there any way to stop this? I'm
not sure what to specify in the Robots.txt file.
thanks
Eric
-------------------------------------------
Server Logs:
66.249.72.163
www.my-site.com - - [30/Oct/2006:18:26:54 -0600] "GET
/index.php?title=MyPage&diff=next&oldid=4879 HTTP/1.1" 200 7673 "-"
"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.235
www.my-site.com - - [23/Nov/2006:05:13:50 -0600] "GET
/index.php?title=Special:Recentchanges&limit=50&days=14&hideminor=1&hideliu=1&from=20061121121419
HTTP/1.1" 200 2795 "-" "Mozilla/5.0 (compatible; Googlebot/2.1;
+http://www.google.com/bot.html)"
---------------------------------
Cheap Talk? Check out Yahoo! Messenger's low PC-to-Phone call rates.