Re: [Wikipedia-l] robots.txt - why disallow everyone, everywhere?

25 Mar 2005

Gerrit Holl wrote:
...
  What happened to robots.txt?
 Why is this happening? 
Bad symlink caused the wrong files to be overwritten on the slave
servers. Fixed now.

-- brion vibber (brion @ pobox.com)

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

Re: [Wikipedia-l] robots.txt - why disallow everyone, everywhere?