Sorry, I didn't know that a periodic cache update wasn't acceptable.
Also, we didn't fake the Agent string - but I'm not sure what string the
Microsoft.XMLHTTP object shows when visiting.
I will check the link provided and rewrite the code so everybody is happy :)
Thanks,
Tony
-----Original Message-----
From: wikitech-l-bounces(a)lists.wikimedia.org
[mailto:wikitech-l-bounces@lists.wikimedia.org] On Behalf Of Rob Church
Sent: Tuesday, January 30, 2007 9:20 AM
To: Wikimedia developers
Subject: Re: [Wikitech-l] Our IP was blocked by mistake
On 30/01/07, Webmaster <webmaster(a)tiosam.com> wrote:
Where can we find them?
Thanks
http://download.wikimedia.org
In general, we discourage people remote loading content from our sites, in
part because it causes extra load on our servers which hasn't come from one
of our direct users, and in part because a vast number of such sites end up
violating one or more of the terms of the content licence, usually the
attribution side of things.
We provide regular database dumps to make the information freely available
in a manner that is friendlier to our servers, and that is usually easier to
process and import - it's much more convenient for both parties to import
all the revision text at once, rather than crawling for it.
Even a "periodic cache update" is not particularly acceptable, as it implies
a burst of load, such as the one Tim mentioned. We have the logs, we know
what goes on.
Rob Church
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
http://lists.wikimedia.org/mailman/listinfo/wikitech-l