[WikiEN-l] No-indexing of project-space pages

[Chris Howie]

On Wed, Jul 30, 2008 at 3:12 AM, David Katz <dkatz2001 at gmail.com> wrote:
> Would this prevent mirror sites from 'scraping' noindex pages? This
> would be a definite improvement as talk pages are often a depository
> of libel and whilst we can remove and oversight material on wp pages
> we're powerless to do anything on a mirror

I believe most mirrors use an actual database dump (though some might
scrape).  In that case they would get all the content on Wikipedia,
wherever it is.

-- 
Chris Howie
http://www.chrishowie.com
http://en.wikipedia.org/wiki/User:Crazycomputers