Mpaa added a subscriber: Mpaa. Mpaa added a comment.
In https://phabricator.wikimedia.org/T85389#945688, @Daviskr wrote:
Another side effect of the current setup is that it fetches all pages (that match the regex) before it applies `limit`. This causes extreme slowdown as seen in this build https://travis-ci.org/wikimedia/pywikibot-core/jobs/45256940#L1119.
One clarification: only if a namespace different from 0 is specified, as it is done in the test, for the reason explained above: no pages will be yielded at all, so the test will end only when all the pages in the specified ns have been fetched by allpages().
TASK DETAIL https://phabricator.wikimedia.org/T85389
REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>.
EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Mpaa Cc: Aklapper, Daviskr, Ricordisamoa, Mpaa, jayvdb, pywikipedia-bugs