Brion Vibber wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Evan Martin wrote:
When I run mwdumper with enwiki-20061001-pages-articles.xml.bz2 and pipe it to mysql (see my other mail), it eventually prints out something like 3,583,699 pages (490.212/sec), 3,583,699 revs (490.212/sec) and exits.
However, on the database afterwards a query like SELECT COUNT(*) FROM page gives me a result count somewhere around 2.5 million (I don't have the exact number in my notes, sorry).
This means MySQL encountered an error and stopped executing further statements from input.
Be sure to watch the output of MySQL for errors, not just the output of mwdumper... you may find it easier if you send the SQL output to an intermediate file first, or else redirect each program's error output to separate files (which you can tail in separate terminals and/or look at later).
- -- brion vibber (brion @ pobox.com)
-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2.2 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFFdP/awRnhpk1wk44RAhf1AKDe7vwpTyh2c4XpELGeaS3whBh/zwCfbqdS Shosm2/hXgo32BfQkKT6zhQ= =N4Di -----END PGP SIGNATURE----- _______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
Brion,
When I use mwdumper, it says its dumping to the db, but none of the articles show up in the new dump or the database (but the innodb gets bigger). importDump works, but is slow as hell.
Jeff