On Fri, Mar 25, 2011 at 7:08 AM, Charles Polisher <cpolish(a)surewest.net>wrote;wrote:
Consider using pigz for the compression step.
+ Much (7x?) faster than gzip
gzip is fairly fast already, but also does a poor job at compressing huge
repetitive text dumps compared to the (MUCHHHHHHH slower) bzip2 and
(MUCHHHHHH^3 slower) 7zip LZMA which are what we use.
-- brion