Hi,
I encountered what I believe is the same issue as others. This happens on
my integraality tool with entirely read-only operations, without any hits
on the Query service.
I filed <https://phabricator.wikimedia.org/T244030> with my investigations
and the tracing showing how Pywikibot spent over 25 minutes doing a
page.templatesWithParams().
Hope that helps,
-- Jean-Fred
Le ven. 31 janv. 2020 à 18:32, AntiCompositeNumber <
anticompositenumber(a)gmail.com> a écrit :
https://phabricator.wikimedia.org/T243701
On Fri, Jan 31, 2020 at 10:01 AM Albert Villanova del Moral
<albertvillanova(a)gmail.com> wrote:
Hello,
Have you finally created a ticket for this issue? It is very annoying:
sometimes,
more than 30 minutes "sleeping".
Regards,
Albert.
Albert VILLANOVA DEL MORAL
Phone: +33 6 24 20 42 38
Email: albert.villanova(a)gmail.com
Missatge de Amir Sarabadani <ladsgroup(a)gmail.com> del dia ds., 25 de
gen.
2020 a les 23:55:
>
> I would recommend creating a ticket against search platform team as
this is
due to WDQS nodes being behind Wikidata's production.
>
> On Sat, Jan 25, 2020 at 11:27 PM Strainu <strainu10(a)gmail.com> wrote:
>>
>> I can confirm the throttling is caused by Wikidata. Not sure why I
>> didn't see it before, as I was using that api query that you gave
>> above. Are there some (known) issues currently or should I log a bug
>> on this?
>>
>> Strainu
>>
>> În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <ladsgroup(a)gmail.com>
a scris:
>> >
>> > It should be accessible in
https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&ref…
but I'm not sure why other types of max lag is not showing up.
>> >
>> > You can also check maxlag like this:
https://www.wikidata.org/w/api.php?action=query&titles=MediaWiki&fo…
>> >
>> > On Sat, Jan 25, 2020 at 10:53 PM Strainu <strainu10(a)gmail.com>
wrote:
>> >>
>> >> Actually, now that you mention it, it might be because of wikidata -
>> >> I read stuff from there in all affected scripts. If I get throttled
>> >> there 5s for each element, this might account for the long delays.
Let
>> >> me see if I can print some debug
data. Any suggestion on what I
should
>> >> look for regarding Wikidata
lag?
>> >>
>> >> În sâm., 25 ian. 2020 la 23:48, Strainu <strainu10(a)gmail.com> a
scris:
>> >> >
>> >> > All sites. Currently I also encounter other issues (connection
>> >> > timeouts), but the throttling has been going on for days (at least
>> >> > since 1/20).
>> >> >
>> >> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani <
ladsgroup(a)gmail.com> a scris:
>> >> > >
>> >> > > Is it Wikidata only it's all sites? Wikidata uses another
set
of measures for maxlag, like lag between dispatching to other wiki and lag
to WDQS.
>> >> > >
>> >> > > HTH
>> >> > >
>> >> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu
<strainu10(a)gmail.com>
wrote:
>> >> > >>
>> >> > >> Hi,
>> >> > >>
>> >> > >> In the last few days my bots get throttled for minutes and
minutes (up
>> >> > >> to 10, on the
worse instances) on basically all sites I use
(ro.wp,
>> >> > >> commons,
wikidata). I knew about write throttle and I use the
default
>> >> > >> setting there, but
it seems that now I get throttled on read
>> >> > >> operations as well. I use pwb from git, currently synced
at
>> >> > >> 0924e1655ef9e61c86e98884226b18d8250da368.
>> >> > >>
>> >> > >> I checked the server lag and it is 0 most times I see the
throttling.
>> > >> Any idea why do I get throttled
for such long periods of time?
>> > >>
>> > >> Thanks,
>> > >> Strainu
>> > >>
>> > >> _______________________________________________
>> > >> pywikibot mailing list
>> > >> pywikibot(a)lists.wikimedia.org
>> > >>
https://lists.wikimedia.org/mailman/listinfo/pywikibot
>> > >
>> > >
>> > >
>> > > --
>> > > Amir (he/him)
>> > >
>> > > _______________________________________________
>> > > pywikibot mailing list
>> > > pywikibot(a)lists.wikimedia.org
>> > >
https://lists.wikimedia.org/mailman/listinfo/pywikibot
>>
>> _______________________________________________
>> pywikibot mailing list
>> pywikibot(a)lists.wikimedia.org
>>
https://lists.wikimedia.org/mailman/listinfo/pywikibot
>
>
>
> --
> Amir (he/him)
>
> _______________________________________________
> pywikibot mailing list
> pywikibot(a)lists.wikimedia.org
>
https://lists.wikimedia.org/mailman/listinfo/pywikibot
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot
--
Amir (he/him)
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot
_______________________________________________
pywikibot mailing list
pywikibot(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot