On Tue, 2007-10-30 at 17:16 -0400, David A. Desrosiers wrote:
I have the whole process of fetch, unpack, import
scripted to happen
unattended and aside from initial debugging, it has not failed yet in
the last year or more.
I'll post back with my results when that is done.
The full import of page, revision and text for Wikipedia, Wikiquote and
Wiktionary in 9 languages (en fr de pl it pt sv es nl) took:
real 91m19.910s
user 15m16.073s
sys 1m43.810s
The number of records found for the Wikipedia versions of these
languages are:
for lang in en fr de pl it pt sv es nl; do
mysql mediawiki -e "select count(*) from ep_${lang}_text";
done;
+----------+
| count(*) |
+----------+ <- English Wikipedia
| 5836166 |
+----------+
+----------+
| count(*) |
+----------+ <- French
| 1147662 |
+----------+
+----------+
| count(*) |
+----------+ <- German
| 1344476 |
+----------+
+----------+
| count(*) |
+----------+ <- Polish
| 628225 |
+----------+
+----------+
| count(*) |
+----------+ <- Italian
| 688577 |
+----------+
+----------+
| count(*) |
+----------+ <- Portuguese
| 726593 |
+----------+
+----------+
| count(*) |
+----------+ <- Swedish
| 445601 |
+----------+
+----------+
| count(*) |
+----------+ <- Spanish
| 556088 |
+----------+
+----------+
| count(*) |
+----------+ <- Dutch
| 616810 |
+----------+
Everything looks to be working fine for me.
--
David A. Desrosiers
desrod(a)gnu-designs.com
setuid(a)gmail.com
http://projects.plkr.org/
Skype...: 860-967-3820