GNU bug report logs - #23113
parallel gzip processes trash hard disks, need larger buffers

Previous Next

Full log

View this message in rfc822 format

From: Jim Meyering <jim <at> meyering.net>
To: Mark Adler <madler <at> alumni.caltech.edu>
Cc: "Chevreux, Bastien" <bastien.chevreux <at> dsm.com>, "23113 <at> debbugs.gnu.org" <23113 <at> debbugs.gnu.org>
Subject: bug#23113: parallel gzip processes trash hard disks, need larger buffers
Date: Mon, 11 Apr 2016 19:30:04 -0700

On Sun, Apr 10, 2016 at 12:49 AM, Mark Adler <madler <at> alumni.caltech.edu> wrote:
> Bastien,
>
> pigz (a parallel version of gzip) has a variable buffer size. The -b or --blocksize option allows up to 512 MB buffers, defaulting to 128K. See http://zlib.net/pigz/

Thanks for the reminder about pigz, Mark.
This is yet another reason to consider gzip is in maintenance-only mode,
i.e., the barrier to adding new features is even higher, given that
pigz is so compatible, yet with added features and the benefit of
a modern codebase.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.