Simetrical wrote:
Any web spider *automatically* sends *millions* of arbitrary GET
requests, and has to for the Internet as we know it to function.
There is no way that sending arbitrary GET requests can hurt
*anything*.
That is simply not true. Web spiders only follow links.
The kinds of webmasters we are talking about here will assume that you
can never fire a given GET URL if you never see a page with a link to it
on it.
Timwi