Re: [Xmldatadumps-l] Xmldatadumps-l Digest, Vol 94, Issue 1

Send Xmldatadumps-l mailing list submissions to xmldatadumps-l(a)lists.wikimedia.org To subscribe or unsubscribe via the World Wide Web, visit https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l or, via email, send a message with subject or body 'help' to xmldatadumps-l-request(a)lists.wikimedia.org You can reach the person managing the list at xmldatadumps-l-owner(a)lists.wikimedia.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Xmldatadumps-l digest..." Today's Topics: 1. change to output file numbering of big wikis (Ariel Glenn WMF) ---------------------------------------------------------------------- Message: 1 Date: Thu, 31 May 2018 14:36:51 +0300 From: Ariel Glenn WMF &lt;ariel(a)wikimedia.org&gt; To: Wikipedia Xmldatadumps-l &lt;Xmldatadumps-l(a)lists.wikimedia.org&gt;rg>, Wikimedia developers &lt;wikitech-l(a)lists.wikimedia.org&gt; Subject: [Xmldatadumps-l] change to output file numbering of big wikis Message-ID: <

Content-Type: text/plain; charset="utf-8" TL;DR: Scripts that reply on xml files numbered 1 through 4 should be updated to check for 1 through 6. Explanation: A number of wikis have stubs and page content files generated 4 parts at a time, with the appropriate number added to the filename. I'm going to be increasing that thi month to 6. The reason for the increase is that near the end of the run there are usually just a few big wikis taking their time at completing. If they run with 6 processes at once, they'll finish up a bit sooner. If you have scripts that rely on the number 4, just increase it to 6 and you're done. This will go into effect for the June 1 run and all runs afterwards. Thanks!