2008/7/30 Gregory Maxwell gmaxwell@gmail.com:
What a great idea!
(which is why it's already done that way :) ... Also, I don't believe that most mirrors which actually use the dumps copy anything but the articles though I don't have any data to back that up)
Depends. Some take the lot on the basis that it gives the more content to put adds next to. And if we go noindex on all that stuff it will stop getting whacked by the duplicate content penalty.