I put this code in my index.php file of the wiki directory:
if (eregi("googlebot",$_SERVER['HTTP_USER_AGENT']))
{
mail("my.address(a)my.isp".isp", "Googlebot -
".$_SERVER['REQUEST_URI'],
"Google has visited: ".$_SERVER['REQUEST_URI']);
}
and in just an hour I'm getting lots of messages. EG:
================
I don't mind this:
Google has visited: /GenWiki/index.php?title=Police_district_of_Strelno
================
But would rather not have this:
Google has visited:
/GenWiki/index.php?title=Special:Recentchanges&hideminor=0&hideliu=0&hidebots=1&limit=50&from=20050224023354
Google has visited:
/GenWiki/index.php?title=Special:Recentchangeslinked&target=User:Schmerse&days=14&limit=500&hideminor=0
Google has visited:
/GenWiki/index.php?title=Talk:Catholic_parish_of_Lewkow&action=edit
Google has visited:
/GenWiki/index.php?title=Image:Posen_kr_Pleschen.jpg&curid=0&action=history
================
How can I steer the Googlebot?
James