On Oct 24, 2004, at 7:28 AM, Ken Ara wrote:
I'm sorry but I don't know how to obtain the headers,
If you're using urllib: import httplib httplib.HTTPConnection.debuglevel = 1
Or use a packet sniffer like ethereal to grab the HTTP traffic.
Basically I'm trying to find out: a) that your robot is sending all the correct headers, such as the custom user-agent and the host: header b) find out what response is being returned that looks like you've been "blocked"
-- brion vibber (brion @ pobox.com)