Hi all,
We've just configured a simple rate limiter on the Cloud VPS web proxy that limits traffic from a single IP address to 100 requests/second. The limit is designed to be high enough that it shouldn't affect most normal workflows while also being low enough to properly block excess traffic.
This is in response to some misbehaving crawlers that were causing instability in the proxy service. We applied a similar rate limit to Toolforge earlier this year.
Please be in touch if this is causing issues for your project.
Thanks!
-- Taavi
cloud-announce@lists.wikimedia.org