Hi,
I'm GET-ing the page/html/{title} endpoint at
https://en.wikipedia.org/api/rest_v1/ for information extraction. I'm trying to nail down a polite request rate, and to determine whether the current rate limit is likely to change soon.
- the doc at
https://en.wikipedia.org/api/rest_v1/ pegs the rate limit at 200 req/s;
- on #wikimedia-services, +gwicke noted that the varnish cache's rate limit is much lower -- around 100 req/s; but
- in practice, I get 429's whenever I exceed 70 req/s for more than a few minutes.
Pchelolo suggested additional debug logs on 429's might help get to the bottom of this lower-than-expected rate limit.