On Fri, Mar 25, 2011 at 7:08 AM, Charles Polisher cpolish@surewest.netwrote:
Consider using pigz for the compression step.
- Much (7x?) faster than gzip
gzip is fairly fast already, but also does a poor job at compressing huge repetitive text dumps compared to the (MUCHHHHHHH slower) bzip2 and (MUCHHHHHH^3 slower) 7zip LZMA which are what we use.
-- brion