On Mon, Dec 16, 2002 at 11:03:06AM -0800, Brion Vibber wrote:
Not that I'm aware of. We exclude _edit pages_ since they're the equivalent of 404s; and we exclude some dynamically generated pages because spidering them puts extra load on the server as zillions of "show next XX items" links are followed.
Brion, what is the mechanism for telling Google not to follow a link? Pragma: no-cache? In mod_wiki, it would be cool to make "googleable" be an attribute of the page one could turn on and off.
Jonathan