[Mediawiki-l] Google's crawlers

Graeme Worthy graeme at sxip.com
Wed Feb 15 02:24:02 UTC 2006


If you read your webserver's logs, you anything that's identified by  
the useragent 'googlebot' is a googlebot.
..

On 14-Feb-06, at 6:18 PM, Mauro do Carmo wrote:

> Hi all,
>
> Someone knows about any program (crawler) which I could install in  
> my PC/win XP
> in order to get a look of whatsoever Google's crawlers are getting  
> from my
> website?
>
> Thanks a lot, mauro.
>
> -- 
> No virus found in this outgoing message.
> Checked by AVG Free Edition.
> Version: 7.1.375 / Virus Database: 267.15.6/257 - Release Date:  
> 2/10/2006
>
>
> _______________________________________________
> MediaWiki-l mailing list
> MediaWiki-l at Wikimedia.org
> http://mail.wikipedia.org/mailman/listinfo/mediawiki-l
>
>




More information about the MediaWiki-l mailing list