jenkins-bot has submitted this change and it was merged.
Change subject: harvest_template: Use PreloadingGenerator ......................................................................
harvest_template: Use PreloadingGenerator
PreloadingGenerator can safely be used because we are not writing to the pages. Using larger batches should speed up processing, even though writing to wikidata will still be slow.
Change-Id: Id8b411134b6337c3ab6f56f6dacb2e1500ebfa72 --- M scripts/harvest_template.py 1 file changed, 1 insertion(+), 1 deletion(-)
Approvals: Merlijn van Deen: Looks good to me, approved jenkins-bot: Verified
diff --git a/scripts/harvest_template.py b/scripts/harvest_template.py index 05a9c52..d4bef05 100755 --- a/scripts/harvest_template.py +++ b/scripts/harvest_template.py @@ -40,7 +40,7 @@ * fields - A dictionary of fields that are of use to us
""" - self.generator = generator + self.generator = pg.PreloadingGenerator(generator) self.templateTitle = templateTitle.replace(u'_', u' ') # TODO: Make it a list which also includes the redirects to the template self.fields = fields
pywikibot-commits@lists.wikimedia.org