Subject: Re: bug#23113: parallel gzip processes trash hard disks, need larger buffers

From: Jim Meyering <[email-masked]>
Date: Mon, 11 Apr 2016 19:30:04 -0700

On Sun, Apr 10, 2016 at 12:49 AM, Mark Adler <[email-masked]> wrote:
> Bastien,
>
> pigz (a parallel version of gzip) has a variable buffer size. The -b or --blocksize option allows up to 512 MB buffers, defaulting to 128K. See http://zlib.net/pigz/

Thanks for the reminder about pigz, Mark.
This is yet another reason to consider gzip is in maintenance-only mode,
i.e., the barrier to adding new features is even higher, given that
pigz is so compatible, yet with added features and the benefit of
a modern codebase.