On Mon, Dec 16, 2002 at 11:03:06AM -0800, Brion Vibber wrote:
Not that I'm aware of. We exclude _edit pages_
since they're the
equivalent of 404s; and we exclude some dynamically generated pages
because spidering them puts extra load on the server as zillions of
"show next XX items" links are followed.
Brion, what is the mechanism for telling Google not to follow a link?
Pragma: no-cache? In mod_wiki, it would be cool to make
"googleable" be an attribute of the page one could turn on and off.
Jonathan
--
Geek House Productions, Ltd.
Providing Unix & Internet Contracting and Consulting,
QA Testing, Technical Documentation, Systems Design & Implementation,
General Programming, E-commerce, Web & Mail Services since 1998
Phone: 604-435-1205
Email: djw(a)reactor-core.org
Webpage:
http://reactor-core.org
Address: 2459 E 41st Ave, Vancouver, BC V5R2W2