I made a proposal in https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/576813/ to enforce any response after some wait cycles by increasing the maxlag parameter step by step.

Unfortunately our CI test also found wrong data response from time to time and haven't a solution for this issue on pwb side.

Probably the put_throttle should not be higher than 12 which is double of the default but I guess that most bot have a very fast edit rate of 1 per second or so which may be a reason for the maxlag problem. Another parameter we could play with is the minthrottle for read operation. This is an old compat parameter and is set to 0 in core.

All these parameters are useless if bot owners follow them more ore less; The higher you increase the edit rates for you bots the lower is it for the others. And fear that there are differences in bots settings outside of the default values. Therefore I guess wmf is working on a server side pool throttling. After 4 months of this problem I think we should have a solution very quickly.

Best

xqt

Is there any outlook about when WikiData API will be working again?
I can understand throttling write operations but my bots are struggling to get simple info lie a template interwikis :(

Retrieving 1 pages from wikipedia:pl.
Treating: Szablon:CEE Spring 2020
Sleeping for 5.0 seconds, 2020-05-22 15:05:42
Sleeping for 5.0 seconds, 2020-05-22 15:05:47
Sleeping for 5.0 seconds, 2020-05-22 15:05:52
Sleeping for 6.5 seconds, 2020-05-22 15:05:58
Sleeping for 7.1 seconds, 2020-05-22 15:06:04
Sleeping for 8.6 seconds, 2020-05-22 15:06:12
Sleeping for 10.0 seconds, 2020-05-22 15:06:20
Sleeping for 11.4 seconds, 2020-05-22 15:06:31
Sleeping for 12.9 seconds, 2020-05-22 15:06:42
Sleeping for 14.3 seconds, 2020-05-22 15:06:56

masti

_______________________________________________
pywikibot mailing list
pywikibot@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot