On Wed, Jul 30, 2008 at 3:12 AM, David Katz <dkatz2001(a)gmail.com> wrote:
Would this prevent mirror sites from
'scraping' noindex pages? This
would be a definite improvement as talk pages are often a depository
of libel and whilst we can remove and oversight material on wp pages
we're powerless to do anything on a mirror
I believe most mirrors use an actual database dump (though some might
scrape). In that case they would get all the content on Wikipedia,
wherever it is.
--
Chris Howie
http://www.chrishowie.com
http://en.wikipedia.org/wiki/User:Crazycomputers