Since I've unilaterally banned a couple of IPs from accessing the site due to unfriendly spidering and extreme database-stressing, I thought it best that we set up some sort of actual policy for this.
Tentative beginnings: http://www.wikipedia.org/wiki/Wikipedia:Spiders_and_bots_policy
-- brion vibber (brion @ pobox.com)