On Oct 24, 2004, at 7:28 AM, Ken Ara wrote:
I'm sorry but I don't know how to obtain the
headers,
If you're using urllib:
import httplib
httplib.HTTPConnection.debuglevel = 1
Or use a packet sniffer like ethereal to grab the HTTP traffic.
Basically I'm trying to find out:
a) that your robot is sending all the correct headers, such as the
custom user-agent and the host: header
b) find out what response is being returned that looks like you've been
"blocked"
-- brion vibber (brion @
pobox.com)