HI
I have downloaded the last frwiki dump, in particulary: http://download.wikimedia.org/frwiki/latest/frwiki-latest-pages-meta-history...
I have checked the md5.
I have tried to upload with the following command:
/home/kelson/tools/jre1.5.0_06/bin/java -server -classpath /home/kelson/tools/mysql-connector-java-5.0.4/mysql-connector-java-5.0.4-bin.jar:/home/kelson/tools/mwdumper.jar org.mediawiki.dumper.Dumper --output=mysql://localhost/frwiki?user=*******&password=******** --format=sql:1.5 frwiki-latest-pages-meta-history.xml.bz2 >& titi
And that's what I have got on stderr :
8 pages (1,26/sec), 1000 revs (157,456/sec) 10 pages (0,712/sec), 2000 revs (142,339/sec) 16 pages (0,712/sec), 3000 revs (133,583/sec) 20 pages (0,631/sec), 4000 revs (126,267/sec) 28 pages (0,759/sec), 5000 revs (135,45/sec) 32 pages (0,744/sec), 6000 revs (139,519/sec) Exception in thread "main" java.io.IOException: java.sql.SQLException: Not a valid escape sequence: {[Mm]sg:/{{/',530,'Orthogaffe','20040603204946',...........
Any idea what goes wrong
Kelson
You shouldn't need to specify a -classpath argument for mysql-connector.
mwdumper. jar works fine simply calling the JRE 1.5 with the appropiate .bz2 archive.
Try exactly the command in the README file, or in:
http://www.mediawiki.org/wiki/MWDumper
All the best.
Felipe.
Emmanuel Engelhart emmanuel@engelhart.org escribió: HI
I have downloaded the last frwiki dump, in particulary: http://download.wikimedia.org/frwiki/latest/frwiki-latest-pages-meta-history...
I have checked the md5.
I have tried to upload with the following command:
/home/kelson/tools/jre1.5.0_06/bin/java -server -classpath /home/kelson/tools/mysql-connector-java-5.0.4/mysql-connector-java-5.0.4-bin.jar:/home/kelson/tools/mwdumper.jar org.mediawiki.dumper.Dumper --output=mysql://localhost/frwiki?user=*******&password=******** --format=sql:1.5 frwiki-latest-pages-meta-history.xml.bz2 >& titi
And that's what I have got on stderr :
8 pages (1,26/sec), 1000 revs (157,456/sec) 10 pages (0,712/sec), 2000 revs (142,339/sec) 16 pages (0,712/sec), 3000 revs (133,583/sec) 20 pages (0,631/sec), 4000 revs (126,267/sec) 28 pages (0,759/sec), 5000 revs (135,45/sec) 32 pages (0,744/sec), 6000 revs (139,519/sec) Exception in thread "main" java.io.IOException: java.sql.SQLException: Not a valid escape sequence: {[Mm]sg:/{{/',530,'Orthogaffe','20040603204946',...........
Any idea what goes wrong
Kelson _______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
---------------------------------
LLama Gratis a cualquier PC del Mundo. Llamadas a fijos y móviles desde 1 céntimo por minuto. http://es.voice.yahoo.com
Thank you Felipe for your answer.
The solution was the following one : max_allowed_packet = 16M in my.cnf
But I have an other question: Does mwdumper allow to generate gzipped article text to insert into the old revision table ? How to do that ?
Best regards
Emmanuel
2006/10/31, Felipe Ortega glimmer_phoenix@yahoo.es:
You shouldn't need to specify a -classpath argument for mysql-connector.
mwdumper. jar works fine simply calling the JRE 1.5 with the appropiate .bz2 archive.
Try exactly the command in the README file, or in:
http://www.mediawiki.org/wiki/MWDumper
All the best.
Felipe.
Emmanuel Engelhart emmanuel@engelhart.org escribió: HI
I have downloaded the last frwiki dump, in particulary: http://download.wikimedia.org/frwiki/latest/frwiki-latest-pages-meta-history...
I have checked the md5.
I have tried to upload with the following command:
/home/kelson/tools/jre1.5.0_06/bin/java -server -classpath /home/kelson/tools/mysql-connector-java-5.0.4/mysql-connector-java-5.0.4-bin.jar:/home/kelson/tools/mwdumper.jar org.mediawiki.dumper.Dumper --output=mysql://localhost/frwiki?user=*******&password=******** --format=sql:1.5 frwiki-latest-pages-meta-history.xml.bz2 >& titi
And that's what I have got on stderr :
8 pages (1,26/sec), 1000 revs (157,456/sec) 10 pages (0,712/sec), 2000 revs (142,339/sec) 16 pages (0,712/sec), 3000 revs (133,583/sec) 20 pages (0,631/sec), 4000 revs (126,267/sec) 28 pages (0,759/sec), 5000 revs (135,45/sec) 32 pages (0,744/sec), 6000 revs (139,519/sec) Exception in thread "main" java.io.IOException: java.sql.SQLException: Not a valid escape sequence: {[Mm]sg:/{{/',530,'Orthogaffe','20040603204946',...........
Any idea what goes wrong
Kelson _______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
LLama Gratis a cualquier PC del Mundo. Llamadas a fijos y móviles desde 1 céntimo por minuto. http://es.voice.yahoo.com _______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
As far as I know, it doesn't.
You can get XML dumps with mwdumper and perform some basic filter options (as you can see in the documentation available), as well as produce gzip output data.
But you cannot filter individual tables. The XML dump must have been filtered previously. I don't know how the XML dump process (not the recovery) is implemented (perhaps Brion or someone else could help you... if they're not very busy).
Regards,
Felipe.
Emmanuel Engelhart emmanuel@engelhart.org escribió: Thank you Felipe for your answer.
The solution was the following one : max_allowed_packet = 16M in my.cnf
But I have an other question: Does mwdumper allow to generate gzipped article text to insert into the old revision table ? How to do that ?
Best regards
Emmanuel
2006/10/31, Felipe Ortega :
You shouldn't need to specify a -classpath argument for mysql-connector.
mwdumper. jar works fine simply calling the JRE 1.5 with the appropiate .bz2 archive.
Try exactly the command in the README file, or in:
http://www.mediawiki.org/wiki/MWDumper
All the best.
Felipe.
Emmanuel Engelhart escribió: HI
I have downloaded the last frwiki dump, in particulary: http://download.wikimedia.org/frwiki/latest/frwiki-latest-pages-meta-history...
I have checked the md5.
I have tried to upload with the following command:
/home/kelson/tools/jre1.5.0_06/bin/java -server -classpath /home/kelson/tools/mysql-connector-java-5.0.4/mysql-connector-java-5.0.4-bin.jar:/home/kelson/tools/mwdumper.jar org.mediawiki.dumper.Dumper --output=mysql://localhost/frwiki?user=*******&password=******** --format=sql:1.5 frwiki-latest-pages-meta-history.xml.bz2 >& titi
And that's what I have got on stderr :
8 pages (1,26/sec), 1000 revs (157,456/sec) 10 pages (0,712/sec), 2000 revs (142,339/sec) 16 pages (0,712/sec), 3000 revs (133,583/sec) 20 pages (0,631/sec), 4000 revs (126,267/sec) 28 pages (0,759/sec), 5000 revs (135,45/sec) 32 pages (0,744/sec), 6000 revs (139,519/sec) Exception in thread "main" java.io.IOException: java.sql.SQLException: Not a valid escape sequence: {[Mm]sg:/{{/',530,'Orthogaffe','20040603204946',...........
Any idea what goes wrong
Kelson _______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
LLama Gratis a cualquier PC del Mundo. Llamadas a fijos y móviles desde 1 céntimo por minuto. http://es.voice.yahoo.com _______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
_______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
---------------------------------
LLama Gratis a cualquier PC del Mundo. Llamadas a fijos y móviles desde 1 céntimo por minuto. http://es.voice.yahoo.com
wikitech-l@lists.wikimedia.org