On Fri, Jun 3, 2016 at 10:21 AM, James Forrester jforrester@wikimedia.org wrote:
On 3 June 2016 at 00:14, Pine W wiki.pine@gmail.com wrote:
I'd like to request a clarification about RESTBase.
These notes say: "* RESTBase ** enforcing rate limits as of today *** pageview: 10 req/s *** transforms: 5 req/s"
Can you expand on what kinds of requests these rate limits are limiting?
Small correction: The "pageview" reference here is to the page view API end points:
- https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageview... - https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageview... - https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageview...
See https://phabricator.wikimedia.org/T135240 for background on these limits on the pageview API. tl;dr: The backend for pageview data has limited traffic capacity right now, but the analytics team is working on a hardware upgrade. In the meantime, we need to make sure that the limited capacity is used fairly, by enforcing conservative per-client limits.
Unless you're running a tool against this API at a very high speed, ignoring the Terms of Use, it won't affect you.
Indeed. For the (relatively expensive) transform end points, we picked the limits so that none of the current users are actually affected by them.
Gabriel