On ĵaŭ, 2003-02-13 at 03:18, Magnus Manske wrote:
Maybe it has something to do with excluding Google
from pages containing
"/w/"? The one to avoid Google et al scanning edit pages?
Not unless they're very badly mangling their interpretation of the
robots.txt standard. As our experience with trying to exclude "/w"
shows, they seem to be following it to the letter...
-- brion vibber (brion @
pobox.com)