On 10/27/07, Jay R. Ashworth <jra(a)baylink.com> wrote:
On Fri, Oct 26, 2007 at 08:21:17PM -0400, Anthony
wrote:
> Heh, I just noticed that Wikipedia's robots.txt blocks grub. For
> those who don't get the joke, Jimbo's company owns grub.
As far as I know, the grub block was instated in 2004 or 2003 when
grub was usually very bad-behaving in terms of listening to robots.txt
advises.
Mathias