On 12/4/06, Brion Vibber brion@pobox.com wrote:
Evan Martin wrote:
When I run mwdumper with enwiki-20061001-pages-articles.xml.bz2 and pipe it to mysql (see my other mail), it eventually prints out something like 3,583,699 pages (490.212/sec), 3,583,699 revs (490.212/sec) and exits.
However, on the database afterwards a query like SELECT COUNT(*) FROM page gives me a result count somewhere around 2.5 million (I don't have the exact number in my notes, sorry).
This means MySQL encountered an error and stopped executing further statements from input.
Be sure to watch the output of MySQL for errors, not just the output of mwdumper... you may find it easier if you send the SQL output to an intermediate file first, or else redirect each program's error output to separate files (which you can tail in separate terminals and/or look at later).
I had thought that both MySQL and mwdumper would output to the console, but I guess it must've output this error many lines back without killing the pipe, which meant mwdumper kept going. Redirecting stderr produced ERROR 1114 (HY000) at line 19339: The table 'text' is full which I know how to fix.
Thanks again.