On Tuesday 26 October 2004 01:08, Mark Richards wrote:
'history' versions are not trawled by search
This depends on the Apache web server configuration via the robots.txt file.
I am not sure what rules Wikipedia defines in robots.txt but I think it doesn't allow search indexing of history pages. However, according to your proposal, if useful/interesting content is available via history pages then it will not get indexed if your robots.txt disallows that, so users will be unable to search for it. I wonder whether there is any way to disallow indexing only for certain history pages...
In my wikis ( http://jnana.wikinerds.org , http://maatworks.wikinerds.org , http://nerdypc.wikinerds.org , http://adapedia.wikinerds.org ) I have noticed that some search engines crawl my edit and history pages but I should change my robots.txt to disallow that.