On Mon, 2002-12-16 at 10:55, Jonathan Walther wrote:
Brion, what is the mechanism for telling Google not to follow a link? Pragma: no-cache? In mod_wiki, it would be cool to make "googleable" be an attribute of the page one could turn on and off.
The cache obviously doesn't kill google, or our entire site would be missing from their index. ;)
What we use seems to be: <meta name="robots" content="noindex,nofollow">
Supposedly it works, though I've made no attempt to test it. (Our robots.txt blocks off everything that directly uses the /w/wiki.phtml link, ie everything but simple page views and the default views of special pages.)
-- brion vibber (brion @ pobox.com)