Received-SPF: pass (google.com: best guess record for domain of
 wikitech-l-bounces@lists.wikimedia.org designates 91.198.174.5 as permitted
 sender) client-ip=91.198.174.5;
Message-ID: <4B985F37.7000704@wikimedia.org>
Date: Wed, 10 Mar 2010 19:10:47 -0800
From: Tomasz Finc <tfinc@wikimedia.org>
User-Agent: Thunderbird 2.0.0.23 (Macintosh/20090812)
MIME-Version: 1.0
To: Wikimedia developers <wikitech-l@lists.wikimedia.org>,
	xmldatadumps-admin-l@lists.wikimedia.org, xmldatadumps@lists.wikimedia.org
Subject: [Wikitech-l] 2010-03-11 01:10:08: enwiki Checksumming
 pages-meta-history.xml.bz2 :D
Precedence: list
Reply-To: Wikimedia developers <wikitech-l@lists.wikimedia.org>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Sender: wikitech-l-bounces@lists.wikimedia.org
Errors-To: wikitech-l-bounces@lists.wikimedia.org

New full history en wiki snapshot is hot off the presses!

It's currently being checksummed which will take a while for 280GB+ of 
compressed data but for those brave souls willing to test please grab it 
from

http://download.wikipedia.org/enwiki/20100130/enwiki-20100130-pages-meta-history.xml.bz2

and give us feedback about its quality. This run took just over a month 
and gained a huge speed up after Tims work on re-compressing ES. If we 
see no hiccups with this data snapshot, I'll start mirroring it to other 
locations (internet archive, amazon public data sets, etc).

For those not familiar, the last successful run that we've seen of this 
data goes all the way back to 2008-10-03. That's over 1.5 years of 
people waiting to get access to these data bits.

I'm excited to say that we seem to have it :)

--tomasz

_______________________________________________
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l