Simetrical wrote:
Any web spider *automatically* sends *millions* of arbitrary GET requests, and has to for the Internet as we know it to function. There is no way that sending arbitrary GET requests can hurt *anything*.
That is simply not true. Web spiders only follow links.
The kinds of webmasters we are talking about here will assume that you can never fire a given GET URL if you never see a page with a link to it on it.
Timwi