On Tue, 2007-10-30 at 17:16 -0400, David A. Desrosiers wrote:
I have the whole process of fetch, unpack, import scripted to happen unattended and aside from initial debugging, it has not failed yet in the last year or more.
I'll post back with my results when that is done.
The full import of page, revision and text for Wikipedia, Wikiquote and Wiktionary in 9 languages (en fr de pl it pt sv es nl) took:
real 91m19.910s user 15m16.073s sys 1m43.810s
The number of records found for the Wikipedia versions of these languages are:
for lang in en fr de pl it pt sv es nl; do mysql mediawiki -e "select count(*) from ep_${lang}_text"; done;
+----------+ | count(*) | +----------+ <- English Wikipedia | 5836166 | +----------+
+----------+ | count(*) | +----------+ <- French | 1147662 | +----------+
+----------+ | count(*) | +----------+ <- German | 1344476 | +----------+
+----------+ | count(*) | +----------+ <- Polish | 628225 | +----------+
+----------+ | count(*) | +----------+ <- Italian | 688577 | +----------+
+----------+ | count(*) | +----------+ <- Portuguese | 726593 | +----------+
+----------+ | count(*) | +----------+ <- Swedish | 445601 | +----------+
+----------+ | count(*) | +----------+ <- Spanish | 556088 | +----------+
+----------+ | count(*) | +----------+ <- Dutch | 616810 | +----------+
Everything looks to be working fine for me.