Hi,
I'm GET-ing the page/html/{title} endpoint at
https://en.wikipedia.org/api/rest_v1/ for information extraction. I'm
trying to nail down a polite request rate, and to determine whether the
current rate limit is likely to change soon.
- the doc at
https://en.wikipedia.org/api/rest_v1/ pegs the rate limit at
200 req/s;
- on #wikimedia-services, +gwicke noted that the varnish cache's rate limit
is much lower -- around 100 req/s; but
- in practice, I get 429's whenever I exceed 70 req/s for more than a few
minutes.
Pchelolo suggested additional debug logs on 429's might help get to the
bottom of this lower-than-expected rate limit.
What kind of debugging info can I provide from my end? Any chance I'll be
able to hit the 200 req/s mark in the next few months?
Thanks,
Shahin