The stats job failed halfway through on the en: 'old' SQl dump. This happened before, since huge en: has been split into 2 files. Second part probably corrupt/incomplete.
Brion, if you rerun, did you receive my mail about new version of perl files, as usual at http://members.chello.nl/epzachte/Wikipedia/Statistics/Perl.zip
A minor fixes + Catalan version B new js file (fixes bar heights for small Wp's, rounding happened before scaling) C please add codes for new phase 3 Wp's
Erik Zachte
On Dec 21, 2003, at 10:24, epzachte@chello.nl wrote:
The stats job failed halfway through on the en: 'old' SQl dump. This happened before, since huge en: has been split into 2 files. Second part probably corrupt/incomplete.
===== WikiCounts / 6:12 Sunday, December 21, 2003 / Wikipedia: EN =====
Read sql dump file '/home/wikipedia/backups/public/en/cur_table.sql.bz2' (150.2 Mb) Extract names and timestamps. Data read (Mb):
06:12 - 10 06:13 - 20 30 40 50 60 70 80 90 100 110 06:14 - 120 130 140 150 160 170 180 190 200 210 220 06:15 - 230 240 250 260 270 280 290 300 310 320 06:16 - 330 340 350 360 370 380 390 400 410 420 430 440 06:17 - 450 460 470 480 490 500 510 520 530 540 550 560 570 06:18 - 580 590 600 610 Read sql dump file '/home/wikipedia/backups/public/en/old_table.sql.bz2' (2665.3 Mb) Extract names and timestamps. Data read (Mb): 10 20 30 40 50 60 70 06:19 - 80 90 100 110 120 130 140 150 160 170 180
Parsing SQL files took 6 min, 59 sec.
That's rather mysterious.
Re-running with the new version, let's see what happens...
-- brion vibber (brion @ pobox.com)
On Dec 21, 2003, at 18:07, Brion Vibber wrote:
That's rather mysterious.
Re-running with the new version, let's see what happens...
Dies at the same point. Erik, would it be possible to add some error checks that would explain why it stopped at that point? I'm not sure I fancy looking through 10 megabytes of text looking for 'something that might make the script stop.' :)
(Note that the dump is not split into two parts. It's just one big bzip2 file, but it's dying only 180-some megabytes into the _uncompressed_ data.)
-- brion vibber (brion @ pobox.com)
Ok, tried to manually decompress the file, and bzip2 is crapping out at 191025000 bytes with a 'data integrity error'.
How... encouraging.
I'll run another backup.
-- brion vibber (brion @ pobox.com)
wikitech-l@lists.wikimedia.org