I’ve not checked in the v3+ version but there used to be a preload page generator that batch retrieved stuff from the API. Then pass the preloaded page object on to the parallel processing part.
On Mon, Mar 27, 2023 at 3:58 PM Roy Smith roy@panix.com wrote:
I need to issue a bunch of Page.get() requests in parallel. My understanding is that pywikibot uses the requests library which is incompatible with async_io, so that's out. So what do people use? Threading https://docs.python.org/3.9/library/threading.html? Or, I see there's an async_io friendly requests port https://github.com/rdbhost/yieldfromRequests. Is there a way to make pywikibot use that?
pywikibot mailing list -- pywikibot@lists.wikimedia.org Public archives at https://lists.wikimedia.org/hyperkitty/list/pywikibot@lists.wikimedia.org/me... To unsubscribe send an email to pywikibot-leave@lists.wikimedia.org