2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

List overview
Download

[Wikibots-l] Robots.txt

Scot Wilcoxon

11 Jul 2005 11 Jul '05

5:55 a.m.

Do wikipedia.py and urllib2 obey robots.txt? I didn't find anything in the former.

Reply

Back to the thread

Back to the list