I can confirm the throttling is caused by Wikidata. Not sure why I
didn't see it before, as I was using that api query that you gave
above. Are there some (known) issues currently or should I log a bug
on this?
Strainu
În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <ladsgroup(a)gmail.com> a scris:
It should be accessible in
https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&ref…
but I'm not sure why other types of max lag is not showing up.
You can also check maxlag like this:
https://www.wikidata.org/w/api.php?action=query&titles=MediaWiki&fo…
On Sat, Jan 25, 2020 at 10:53 PM Strainu <strainu10(a)gmail.com> wrote:
>
> Actually, now that you mention it, it might be because of wikidata -
> I read stuff from there in all affected scripts. If I get throttled
> there 5s for each element, this might account for the long delays. Let
> me see if I can print some debug data. Any suggestion on what I should
> look for regarding Wikidata lag?
>
> În sâm., 25 ian. 2020 la 23:48, Strainu <strainu10(a)gmail.com> a scris:
> >
> > All sites. Currently I also encounter other issues (connection
> > timeouts), but the throttling has been going on for days (at least
> > since 1/20).
> >
> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani <ladsgroup(a)gmail.com> a
scris:
> > >
> > > Is it Wikidata only it's all sites? Wikidata uses another set of
measures for maxlag, like lag between dispatching to other wiki and lag to WDQS.
> > >
> > > HTH
> > >
> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu <strainu10(a)gmail.com>
wrote:
> > >>
> > >> Hi,
> > >>
> > >> In the last few days my bots get throttled for minutes and minutes (up
> > >> to 10, on the worse instances) on basically all sites I use (ro.wp,
> > >> commons, wikidata). I knew about write throttle and I use the default
> > >> setting there, but it seems that now I get throttled on read
> > >> operations as well. I use pwb from git, currently synced at
> > >> 0924e1655ef9e61c86e98884226b18d8250da368.
> > >>
> > >> I checked the server lag and it is 0 most times I see the throttling.
> > >> Any idea why do I get throttled for such long periods of time?
> > >>
> > >> Thanks,
> > >> Strainu
> > >>
> > >> _______________________________________________
> > >> pywikibot mailing list
> > >> pywikibot(a)lists.wikimedia.org
> > >>
https://lists.wikimedia.org/mailman/listinfo/pywikibot
> > >
> > >
> > >
> > > --
> > > Amir (he/him)
> > >
> > > _______________________________________________
> > > pywikibot mailing list
> > > pywikibot(a)lists.wikimedia.org
> > >
https://lists.wikimedia.org/mailman/listinfo/pywikibot
>
> _______________________________________________
> pywikibot mailing list
> pywikibot(a)lists.wikimedia.org
>
https://lists.wikimedia.org/mailman/listinfo/pywikibot
--
Amir (he/him)
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org