> This wouldn't stop people from coming to the site, only robots. And how do people find the site if it doesn't appear in search results? I don't have the statistics, but I imagine the vast majority of visitors to Wikipedia come via a search engine.