Hello,
the actualy running dump for enwiki takes a lot of time for Wiki page-to-page link records. At http://download.wikipedia.org/enwiki/20100130/ it was only one and a half hour.
Best regards
Andreas
Andreas Meier wrote:
Hello,
the actualy running dump for enwiki takes a lot of time for Wiki page-to-page link records. At http://download.wikipedia.org/enwiki/20100130/ it was only one and a half hour.
Best regards
Andreas
It's just dumping a table, it shouldn't be too slow. Although they have probably increased a lot on this 6 months. Has anyone studied its grow function?, I wouldn't be surprised if it was exponential.
Στις 28-07-2010, ημέρα Τετ, και ώρα 13:03 +0200, ο/η Platonides έγραψε:
Andreas Meier wrote:
Hello,
the actualy running dump for enwiki takes a lot of time for Wiki page-to-page link records. At http://download.wikipedia.org/enwiki/20100130/ it was only one and a half hour.
Best regards
Andreas
It's just dumping a table, it shouldn't be too slow. Although they have probably increased a lot on this 6 months. Has anyone studied its grow function?, I wouldn't be surprised if it was exponential.
I have terminated the en wiki dumps for the moment; it looks like an issue of which index is used for the select, domas is doing some poking at it. This may be related to an update in the version of mysql on the server a month or so ago. More info when it becomes available.
Ariel
Στις 29-07-2010, ημέρα Πεμ, και ώρα 16:31 -0700, ο/η Ariel T. Glenn έγραψε:
Στις 28-07-2010, ημέρα Τετ, και ώρα 13:03 +0200, ο/η Platonides έγραψε:
Andreas Meier wrote:
Hello,
the actualy running dump for enwiki takes a lot of time for Wiki page-to-page link records. At http://download.wikipedia.org/enwiki/20100130/ it was only one and a half hour.
Best regards
Andreas
It's just dumping a table, it shouldn't be too slow. Although they have probably increased a lot on this 6 months. Has anyone studied its grow function?, I wouldn't be surprised if it was exponential.
I have terminated the en wiki dumps for the moment; it looks like an issue of which index is used for the select, domas is doing some poking at it. This may be related to an update in the version of mysql on the server a month or so ago. More info when it becomes available.
Ariel
A patched version of mysqld will likely be rolled out on that host tomorrow, at which time the en wikipedia dump will be restarted.
Ariel
Στις 29-07-2010, ημέρα Πεμ, και ώρα 16:55 -0700, ο/η Ariel T. Glenn έγραψε:
Στις 29-07-2010, ημέρα Πεμ, και ώρα 16:31 -0700, ο/η Ariel T. Glenn έγραψε:
Στις 28-07-2010, ημέρα Τετ, και ώρα 13:03 +0200, ο/η Platonides έγραψε:
Andreas Meier wrote:
Hello,
the actualy running dump for enwiki takes a lot of time for Wiki page-to-page link records. At http://download.wikipedia.org/enwiki/20100130/ it was only one and a half hour.
Best regards
Andreas
It's just dumping a table, it shouldn't be too slow. Although they have probably increased a lot on this 6 months. Has anyone studied its grow function?, I wouldn't be surprised if it was exponential.
I have terminated the en wiki dumps for the moment; it looks like an issue of which index is used for the select, domas is doing some poking at it. This may be related to an update in the version of mysql on the server a month or so ago. More info when it becomes available.
Ariel
A patched version of mysqld will likely be rolled out on that host tomorrow, at which time the en wikipedia dump will be restarted.
Ariel
Domas pushed this change live and restarted en wiki dumps this morning.
Ariel
xmldatadumps-l@lists.wikimedia.org