Sorry, I didn't know that a periodic cache update wasn't acceptable. Also, we didn't fake the Agent string - but I'm not sure what string the Microsoft.XMLHTTP object shows when visiting. I will check the link provided and rewrite the code so everybody is happy :) Thanks, Tony
-----Original Message----- From: wikitech-l-bounces@lists.wikimedia.org [mailto:wikitech-l-bounces@lists.wikimedia.org] On Behalf Of Rob Church Sent: Tuesday, January 30, 2007 9:20 AM To: Wikimedia developers Subject: Re: [Wikitech-l] Our IP was blocked by mistake
On 30/01/07, Webmaster webmaster@tiosam.com wrote:
Where can we find them? Thanks
In general, we discourage people remote loading content from our sites, in part because it causes extra load on our servers which hasn't come from one of our direct users, and in part because a vast number of such sites end up violating one or more of the terms of the content licence, usually the attribution side of things.
We provide regular database dumps to make the information freely available in a manner that is friendlier to our servers, and that is usually easier to process and import - it's much more convenient for both parties to import all the revision text at once, rather than crawling for it.
Even a "periodic cache update" is not particularly acceptable, as it implies a burst of load, such as the one Tim mentioned. We have the logs, we know what goes on.
Rob Church
_______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org http://lists.wikimedia.org/mailman/listinfo/wikitech-l