[Mediawiki-l] 'Randompage' in robots.txt should be 'Random'?
Freddy Vulto
fvulto at gmail.com
Wed Oct 25 18:27:35 UTC 2006
The file robots.txt on wikipedia.org contains:
Disallow: /wiki/Special:Randompage
Disallow: /wiki/Special%3ARandompage
but the actual link is Special:Random - not Special:Randompage, so
shouldn't robots.txt contain:
Disallow: /wiki/Special:Random
Disallow: /wiki/Special%3ARandom
The current setting lets Google index random pages. Now when you select
a search result, Google will serve you another (random) page - NOT the
page as suggested in the search results. For example, search Google for:
allinanchor:"Special:Random" site:wikipedia.org
and click on link '../wiki/Special:Random'.
Freddy Vulto
http://www.fvue.nl/wiki/
More information about the MediaWiki-l
mailing list