I would recommend creating a ticket against search
platform team as this
is due to WDQS nodes being behind Wikidata's production.
On Sat, Jan 25, 2020 at 11:27 PM Strainu <strainu10(a)gmail.com> wrote:
I can confirm the throttling is caused by
Wikidata. Not sure why I
didn't see it before, as I was using that api query that you gave
above. Are there some (known) issues currently or should I log a bug
on this?
Strainu
În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <ladsgroup(a)gmail.com> a
scris:
It should be accessible in
https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&ref…
but I'm not sure why other types of max lag is not showing up.
You can also check maxlag like this:
https://www.wikidata.org/w/api.php?action=query&titles=MediaWiki&fo…
On Sat, Jan 25, 2020 at 10:53 PM Strainu <strainu10(a)gmail.com> wrote:
>
> Actually, now that you mention it, it might be because of wikidata -
> I read stuff from there in all affected scripts. If I get throttled
> there 5s for each element, this might account for the long delays. Let
> me see if I can print some debug data. Any suggestion on what I should
> look for regarding Wikidata lag?
>
> În sâm., 25 ian. 2020 la 23:48, Strainu <strainu10(a)gmail.com> a scris:
> >
> > All sites. Currently I also encounter other issues (connection
> > timeouts), but the throttling has been going on for days (at least
> > since 1/20).
> >
> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani <ladsgroup(a)gmail.com>
a scris:
> > >
> > > Is it Wikidata only it's all sites? Wikidata uses another set of
measures for maxlag, like lag between dispatching to other wiki and lag to
WDQS.
> > >
> > > HTH
> > >
> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu <strainu10(a)gmail.com>
wrote:
> > >>
> > >> Hi,
> > >>
> > >> In the last few days my bots get throttled for minutes and
minutes (up
> > >> to 10, on the worse instances)
on basically all sites I use
(ro.wp,
> > >> commons, wikidata). I knew
about write throttle and I use the
default
> > >> setting there, but it seems
that now I get throttled on read
> > >> operations as well. I use pwb from git, currently synced at
> > >> 0924e1655ef9e61c86e98884226b18d8250da368.
> > >>
> > >> I checked the server lag and it is 0 most times I see the
throttling.
>
>> Any idea why do I get throttled for such long periods of time?
> >>
> >> Thanks,
> >> Strainu
> >>
> >> _______________________________________________
> >> pywikibot mailing list
> >> pywikibot(a)lists.wikimedia.org
> >>
https://lists.wikimedia.org/mailman/listinfo/pywikibot
> >
> >
> >
> > --
> > Amir (he/him)
> >
> > _______________________________________________
> > pywikibot mailing list
> > pywikibot(a)lists.wikimedia.org
> >
https://lists.wikimedia.org/mailman/listinfo/pywikibot
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot
--
Amir (he/him)
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot
--
Amir (he/him)
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org