Is there any outlook about when WikiData API will be working again? I can understand throttling write operations but my bots are struggling to get simple info lie a template interwikis :(
Retrieving 1 pages from wikipedia:pl. Treating: Szablon:CEE Spring 2020 Sleeping for 5.0 seconds, 2020-05-22 15:05:42 Sleeping for 5.0 seconds, 2020-05-22 15:05:47 Sleeping for 5.0 seconds, 2020-05-22 15:05:52 Sleeping for 6.5 seconds, 2020-05-22 15:05:58 Sleeping for 7.1 seconds, 2020-05-22 15:06:04 Sleeping for 8.6 seconds, 2020-05-22 15:06:12 Sleeping for 10.0 seconds, 2020-05-22 15:06:20 Sleeping for 11.4 seconds, 2020-05-22 15:06:31 Sleeping for 12.9 seconds, 2020-05-22 15:06:42 Sleeping for 14.3 seconds, 2020-05-22 15:06:56
masti
I have no glue whether or not wmf has any solution shortly. The maxlag is exceeded over several hours every day an the value is about 8 then.
I made a proposal in https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/576813/ to enforce any response after some wait cycles by increasing the maxlag parameter step by step.
Unfortunately our CI test also found wrong data response from time to time and haven't a solution for this issue on pwb side.
Probably the put_throttle should not be higher than 12 which is double of the default but I guess that most bot have a very fast edit rate of 1 per second or so which may be a reason for the maxlag problem. Another parameter we could play with is the minthrottle for read operation. This is an old compat parameter and is set to 0 in core.
All these parameters are useless if bot owners follow them more ore less; The higher you increase the edit rates for you bots the lower is it for the others. And fear that there are differences in bots settings outside of the default values. Therefore I guess wmf is working on a server side pool throttling. After 4 months of this problem I think we should have a solution very quickly.
Best xqt
Am 22.05.2020 um 15:10 schrieb masti mastigm@gmail.com:
Is there any outlook about when WikiData API will be working again? I can understand throttling write operations but my bots are struggling to get simple info lie a template interwikis :(
Retrieving 1 pages from wikipedia:pl. Treating: Szablon:CEE Spring 2020 Sleeping for 5.0 seconds, 2020-05-22 15:05:42 Sleeping for 5.0 seconds, 2020-05-22 15:05:47 Sleeping for 5.0 seconds, 2020-05-22 15:05:52 Sleeping for 6.5 seconds, 2020-05-22 15:05:58 Sleeping for 7.1 seconds, 2020-05-22 15:06:04 Sleeping for 8.6 seconds, 2020-05-22 15:06:12 Sleeping for 10.0 seconds, 2020-05-22 15:06:20 Sleeping for 11.4 seconds, 2020-05-22 15:06:31 Sleeping for 12.9 seconds, 2020-05-22 15:06:42 Sleeping for 14.3 seconds, 2020-05-22 15:06:56
masti
pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot
Pe vineri, 22 mai 2020, masti mastigm@gmail.com a scris:
Is there any outlook about when WikiData API will be working again?
Not really, no :( See https://phabricator.wikimedia.org/T243701
I can understand throttling write operations but my bots are struggling to
get simple info lie a template interwikis :(
Retrieving 1 pages from wikipedia:pl. Treating: Szablon:CEE Spring 2020 Sleeping for 5.0 seconds, 2020-05-22 15:05:42 Sleeping for 5.0 seconds, 2020-05-22 15:05:47 Sleeping for 5.0 seconds, 2020-05-22 15:05:52 Sleeping for 6.5 seconds, 2020-05-22 15:05:58 Sleeping for 7.1 seconds, 2020-05-22 15:06:04 Sleeping for 8.6 seconds, 2020-05-22 15:06:12 Sleeping for 10.0 seconds, 2020-05-22 15:06:20 Sleeping for 11.4 seconds, 2020-05-22 15:06:31 Sleeping for 12.9 seconds, 2020-05-22 15:06:42 Sleeping for 14.3 seconds, 2020-05-22 15:06:56
masti
pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot