Yep, if we can use compressed dumps, we can use much lesser resources that what it is using now (currently &gt;800GB).<br><br><div class="gmail_quote">On Sun, May 6, 2012 at 12:24 AM, John <span dir="ltr">&lt;<a href="mailto:phoenixoverride@gmail.com" target="_blank">phoenixoverride@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I was taking a look at our dumps in user-store and none of them are compressed, and I was socked about that. I know a lot of people use pywikipedia to parse the dumps, and I know it can handle the bz2 files. any reason we dont just make them all bz2?<span class="HOEnZb"><font color="#888888"><br>

<br>John<br>
</font></span><br>_______________________________________________<br>
Toolserver-l mailing list (<a href="mailto:Toolserver-l@lists.wikimedia.org">Toolserver-l@lists.wikimedia.org</a>)<br>
<a href="https://lists.wikimedia.org/mailman/listinfo/toolserver-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/toolserver-l</a><br>
Posting guidelines for this list: <a href="https://wiki.toolserver.org/view/Mailing_list_etiquette" target="_blank">https://wiki.toolserver.org/view/Mailing_list_etiquette</a><br></blockquote></div><br><br clear="all"><div>
<br></div>-- <br><div>Regards,</div><div>Hydriz</div><div><br></div>We&#39;ve created the greatest collection of shared knowledge in history. Help protect Wikipedia. Donate now: <a href="http://donate.wikimedia.org/" target="_blank">http://donate.wikimedia.org</a><br>