I put this code in my index.php file of the wiki directory:
if (eregi("googlebot",$_SERVER['HTTP_USER_AGENT'])) { mail("my.address@my.isp", "Googlebot - ".$_SERVER['REQUEST_URI'], "Google has visited: ".$_SERVER['REQUEST_URI']); }
and in just an hour I'm getting lots of messages. EG: ================ I don't mind this:
Google has visited: /GenWiki/index.php?title=Police_district_of_Strelno ================ But would rather not have this:
Google has visited: /GenWiki/index.php?title=Special:Recentchanges&hideminor=0&hideliu=0&hidebots=1&limit=50&from=20050224023354
Google has visited: /GenWiki/index.php?title=Special:Recentchangeslinked&target=User:Schmerse&days=14&limit=500&hideminor=0
Google has visited: /GenWiki/index.php?title=Talk:Catholic_parish_of_Lewkow&action=edit
Google has visited: /GenWiki/index.php?title=Image:Posen_kr_Pleschen.jpg&curid=0&action=history ================
How can I steer the Googlebot?
James