I can confirm the throttling is caused by Wikidata. Not sure why I
didn't see it before, as I was using that api query that you gave
above. Are there some (known) issues currently or should I log a bug
on this?
Strainu
În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <ladsgroup@gmail.com> a scris:
>
> It should be accessible in https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&refresh=1m&fullscreen&panelId=22 but I'm not sure why other types of max lag is not showing up.
>
> You can also check maxlag like this: https://www.wikidata.org/w/api.php?action=query&titles=MediaWiki&format=json&maxlag=-1
>
> On Sat, Jan 25, 2020 at 10:53 PM Strainu <strainu10@gmail.com> wrote:
>>
>> Actually, now that you mention it, it might be because of wikidata -
>> I read stuff from there in all affected scripts. If I get throttled
>> there 5s for each element, this might account for the long delays. Let
>> me see if I can print some debug data. Any suggestion on what I should
>> look for regarding Wikidata lag?
>>
>> În sâm., 25 ian. 2020 la 23:48, Strainu <strainu10@gmail.com> a scris:
>> >
>> > All sites. Currently I also encounter other issues (connection
>> > timeouts), but the throttling has been going on for days (at least
>> > since 1/20).
>> >
>> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani <ladsgroup@gmail.com> a scris:
>> > >
>> > > Is it Wikidata only it's all sites? Wikidata uses another set of measures for maxlag, like lag between dispatching to other wiki and lag to WDQS.
>> > >
>> > > HTH
>> > >
>> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu <strainu10@gmail.com> wrote:
>> > >>
>> > >> Hi,
>> > >>
>> > >> In the last few days my bots get throttled for minutes and minutes (up
>> > >> to 10, on the worse instances) on basically all sites I use (ro.wp,
>> > >> commons, wikidata). I knew about write throttle and I use the default
>> > >> setting there, but it seems that now I get throttled on read
>> > >> operations as well. I use pwb from git, currently synced at
>> > >> 0924e1655ef9e61c86e98884226b18d8250da368.
>> > >>
>> > >> I checked the server lag and it is 0 most times I see the throttling.
>> > >> Any idea why do I get throttled for such long periods of time?
>> > >>
>> > >> Thanks,
>> > >> Strainu
>> > >>
>> > >> _______________________________________________
>> > >> pywikibot mailing list
>> > >> pywikibot@lists.wikimedia.org
>> > >> https://lists.wikimedia.org/mailman/listinfo/pywikibot
>> > >
>> > >
>> > >
>> > > --
>> > > Amir (he/him)
>> > >
>> > > _______________________________________________
>> > > pywikibot mailing list
>> > > pywikibot@lists.wikimedia.org
>> > > https://lists.wikimedia.org/mailman/listinfo/pywikibot
>>
>> _______________________________________________
>> pywikibot mailing list
>> pywikibot@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/pywikibot
>
>
>
> --
> Amir (he/him)
>
> _______________________________________________
> pywikibot mailing list
> pywikibot@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/pywikibot
_______________________________________________
pywikibot mailing list
pywikibot@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot