On ĵaŭ, 2003-02-13 at 03:18, Magnus Manske wrote:
Maybe it has something to do with excluding Google from pages containing "/w/"? The one to avoid Google et al scanning edit pages?
Not unless they're very badly mangling their interpretation of the robots.txt standard. As our experience with trying to exclude "/w" shows, they seem to be following it to the letter...
-- brion vibber (brion @ pobox.com)