[Mediawiki-l] Google accesses through Special:RecentchangesLinked
Rene Bakker
rene at bakkerplomp.nl
Thu Nov 6 19:47:43 UTC 2008
I noticed that the Googlebot does not use the exact article path from
the sitemap files but uses Special:RecentchangesLinked instead to access
the articles. So instead of /www.mysite.com/wiki/My_Article/, Google
uses /www.mysite.com/wiki/Special:RecentchangesLinked/My_Article/. Why
is that?
I ran into this because I disallowed //wiki/Special:RecentchangesLinked/
within robots.txt. This was to prevent the bots from indexing all
revisions.
Regards,
Rene Bakker
More information about the MediaWiki-l
mailing list