Hi David,
The problem is not with downloading. The problem is with loading the data into mysql.
-Fawad.
On 10/30/07, David A. Desrosiers desrod@gnu-designs.com wrote:
On Mon, 2007-10-29 at 09:02 -0400, David A. Desrosiers wrote:
I'm testing a download of the -meta-current.xml.bz2 right now to see if it does indeed work, but it will take 1/2 day to get it all. I'll post back and let you know what happens.
It took awhile on my lowly home DSL connection, but here's the results using plain wget:
$ wget -c http://download.wikimedia.org/enwiki/20071018/enwiki-20071018-pages-meta-cur... --20:52:54-- http://download.wikimedia.org/enwiki/20071018/enwiki-20071018-pages-meta-cur... => `enwiki-20071018-pages-meta-current.xml.bz2' Resolving download.wikimedia.org... 66.230.200.212 Connecting to download.wikimedia.org|66.230.200.212|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 5,780,471,837 (5.4G) [application/x-bzip]
100%[==================================>] 5,780,471,837 158.53K/s ETA 00:00
07:03:59 (153.96 KB/s) - `enwiki-20071018-pages-meta-current.xml.bz2' saved [5780471837/5780471837]
$ du -sch enwiki-20071018-pages-meta-current.xml.bz2 5.4G enwiki-20071018-pages-meta-current.xml.bz2 5.4G total
$ md5sum enwiki-20071018-pages-meta-current.xml.bz2 faa7e18e372103d861c8c933efd782e2 enwiki-20071018-pages-meta-current.xml.bz2
-- David A. Desrosiers desrod@gnu-designs.com setuid@gmail.com http://projects.plkr.org/ Skype...: 860-967-3820
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org http://lists.wikimedia.org/mailman/listinfo/wikitech-l