Date: Wed, 17 Mar 2010 15:15:24 +0100 From: Platonides Platonides@gmail.com Subject: Re: [Wikitech-l] [Xmldatadumps-admin-l] 2010-03-11 01:10:08: enwiki Checksumming pages-meta-history.xml.bz2 :D To: wikitech-l@lists.wikimedia.org Message-ID: hnqo49$itc$1@dough.gmane.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Jamie Morken wrote:
Also I wonder if it is possible to convert from 7z to bz2 without having
to make the 5469GB file first? If this can be done then having only 7z
files would be fine, as the bz2 file could be created with a "normal"
PC (ie one without a 6TB+ harddrive). This would be a good solution,
but not sure if it can be done. If it could though, might as well get
rid of all the large wiki's bz2 pages-meta-history files!
Sure. 7z e -so DatabaseDump.7z | bzip -9 > DatabaseDump.bz
Hi,
Thanks for the info, I think 7z is the way to go :)
cheers, Jamie