jenkins-bot has submitted this change and it was merged.
Change subject: harvest_template: Use PreloadingGenerator
......................................................................
harvest_template: Use PreloadingGenerator
PreloadingGenerator can safely be used because we are
not writing to the pages. Using larger batches should
speed up processing, even though writing to wikidata
will still be slow.
Change-Id: Id8b411134b6337c3ab6f56f6dacb2e1500ebfa72
---
M scripts/harvest_template.py
1 file changed, 1 insertion(+), 1 deletion(-)
Approvals:
Merlijn van Deen: Looks good to me, approved
jenkins-bot: Verified
diff --git a/scripts/harvest_template.py b/scripts/harvest_template.py
index 05a9c52..d4bef05 100755
--- a/scripts/harvest_template.py
+++ b/scripts/harvest_template.py
@@ -40,7 +40,7 @@
* fields - A dictionary of fields that are of use to us
"""
- self.generator = generator
+ self.generator = pg.PreloadingGenerator(generator)
self.templateTitle = templateTitle.replace(u'_', u' ')
# TODO: Make it a list which also includes the redirects to the template
self.fields = fields
--
To view, visit
https://gerrit.wikimedia.org/r/81016
To unsubscribe, visit
https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Id8b411134b6337c3ab6f56f6dacb2e1500ebfa72
Gerrit-PatchSet: 2
Gerrit-Project: pywikibot/core
Gerrit-Branch: master
Gerrit-Owner: Legoktm <legoktm.wikipedia(a)gmail.com>
Gerrit-Reviewer: Ladsgroup <ladsgroup(a)gmail.com>
Gerrit-Reviewer: Merlijn van Deen <valhallasw(a)arctus.nl>
Gerrit-Reviewer: jenkins-bot