From unknown Tue Aug 19 12:51:04 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#28082 <28082@debbugs.gnu.org> To: bug#28082 <28082@debbugs.gnu.org> Subject: Status: bash: /bin/rm: Argument list too long Reply-To: bug#28082 <28082@debbugs.gnu.org> Date: Tue, 19 Aug 2025 19:51:04 +0000 retitle 28082 bash: /bin/rm: Argument list too long reassign 28082 coreutils submitter 28082 Jonny Grant severity 28082 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Sun Aug 13 17:36:12 2017 Received: (at submit) by debbugs.gnu.org; 13 Aug 2017 21:36:12 +0000 Received: from localhost ([127.0.0.1]:32941 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dh0YN-0000ii-Qp for submit@debbugs.gnu.org; Sun, 13 Aug 2017 17:36:11 -0400 Received: from eggs.gnu.org ([208.118.235.92]:46484) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dh0YL-0000ib-J3 for submit@debbugs.gnu.org; Sun, 13 Aug 2017 17:36:10 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dh0YF-0007LZ-Bn for submit@debbugs.gnu.org; Sun, 13 Aug 2017 17:36:04 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-0.5 required=5.0 tests=BAYES_05,FREEMAIL_FROM, T_DKIM_INVALID autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:56088) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dh0YF-0007L9-8W for submit@debbugs.gnu.org; Sun, 13 Aug 2017 17:36:03 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:37455) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dh0YE-0005se-2q for bug-coreutils@gnu.org; Sun, 13 Aug 2017 17:36:03 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dh0YB-0007Bt-0g for bug-coreutils@gnu.org; Sun, 13 Aug 2017 17:36:02 -0400 Received: from mail-wm0-x235.google.com ([2a00:1450:400c:c09::235]:35868) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1dh0YA-00076M-Pi for bug-coreutils@gnu.org; Sun, 13 Aug 2017 17:35:58 -0400 Received: by mail-wm0-x235.google.com with SMTP id t201so25587632wmt.1 for ; Sun, 13 Aug 2017 14:35:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:to:from:subject:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=cyXcyB7YZTfhUYv2s/yRqIprYw9MK3vP1B+nT2nWo18=; b=cOY6r5WhD8xFYEnWQPDSql7wtL4KKkcp1t99SiZwp/svqP6OncRoUFRhHs5S1wA7/1 anvOyMuBgx1K3lI0CpdIdM2eg4iXQys3Oev/IeERTt4Ulggi4YoKglwITfZA2yPvVTzJ Ob++ETSBGmSaJIrdOx8lFJp5eAmwX+42aI8jvgogCKbbo9ewEiUJPU+GCb4dC6uPtLCa jyo0ldq4iYuZGsys1DsozscKvDwiT+qJjKuse6gB2xVa42tAMZkQK3mDLlGWtVs9ZonC sLMJsCdSJM/FAUubCC4+aeuXoetoAAyTJ4RF+AAmKTKhf7zh/emGdGSdYxLmEMBZ0EWm BWfw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:to:from:subject:message-id:date :user-agent:mime-version:content-language:content-transfer-encoding; bh=cyXcyB7YZTfhUYv2s/yRqIprYw9MK3vP1B+nT2nWo18=; b=QQOtuRl7/ASZIRMocHGKQ3wh0gkz6xik9QR8ZWY6E3rInv50ELR7lAEVleNXdZM+rz s0ihRrhmKbjl83bKZpeuVpetM6RSrtdO9Sz0YzbVQEIoMrCYzEz4A7M94Ra0OPCu7Vro lNFM3x7lyTv1Z2DinDqKbIA9Qoa/CMmrDwtQaIa9Epp+M1Wv/wobDGgO/dGD5iarvA1d ItRSInqd+vSZ8w1eOqOAM/ibDUsrpET3gpYWaj6gMs8PGgYvFkp/BhXrcAtICqn1KRIb b3If0/QfU9WMTUv8hXXfr2EuGmoATvZn7ZIdz6qCaw5UBatnfJPXr5nbEKyoo7dDxYYp buRQ== X-Gm-Message-State: AHYfb5iiAh8y8vMyljM0qHvmYy6u13Owo/5C2CbZ05Pb6yl5QcmxvKxd PJJ+pNmUM8xdFjJo X-Received: by 10.28.26.144 with SMTP id a138mr3677391wma.68.1502660155852; Sun, 13 Aug 2017 14:35:55 -0700 (PDT) Received: from [192.168.1.245] (21.4.7.51.dyn.plus.net. [51.7.4.21]) by smtp.googlemail.com with ESMTPSA id b23sm8226480wrd.40.2017.08.13.14.35.54 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 13 Aug 2017 14:35:54 -0700 (PDT) To: bug-coreutils@gnu.org From: Jonny Grant Subject: bash: /bin/rm: Argument list too long Message-ID: Date: Sun, 13 Aug 2017 22:35:54 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -3.8 (---) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.8 (---) Hello Can this be resolved please? Seems a shame in 2017 on a machine with 16GB of ram I suffer this. Each filename is around 40 bytes. Roughly 60,000 files So total strings around 2.4 MBytes. Quite a small limit. $rm jonny*.* bash: /bin/rm: Argument list too long rm (GNU coreutils) 8.25 I'm not on this list, could you keep my email address in replies Regards, Jonny From debbugs-submit-bounces@debbugs.gnu.org Sun Aug 13 18:27:04 2017 Received: (at 28082-done) by debbugs.gnu.org; 13 Aug 2017 22:27:04 +0000 Received: from localhost ([127.0.0.1]:33133 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dh1Lb-00019b-OF for submit@debbugs.gnu.org; Sun, 13 Aug 2017 18:27:03 -0400 Received: from zimbra.cs.ucla.edu ([131.179.128.68]:36548) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dh1LZ-00019E-1R for 28082-done@debbugs.gnu.org; Sun, 13 Aug 2017 18:27:02 -0400 Received: from localhost (localhost [127.0.0.1]) by zimbra.cs.ucla.edu (Postfix) with ESMTP id 50B5E160848; Sun, 13 Aug 2017 15:26:54 -0700 (PDT) Received: from zimbra.cs.ucla.edu ([127.0.0.1]) by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id J7BFzrCy3B8p; Sun, 13 Aug 2017 15:26:53 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by zimbra.cs.ucla.edu (Postfix) with ESMTP id A9A6416084B; Sun, 13 Aug 2017 15:26:53 -0700 (PDT) X-Virus-Scanned: amavisd-new at zimbra.cs.ucla.edu Received: from zimbra.cs.ucla.edu ([127.0.0.1]) by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id xcmBa6MBu-aw; Sun, 13 Aug 2017 15:26:53 -0700 (PDT) Received: from [192.168.1.9] (unknown [47.153.184.153]) by zimbra.cs.ucla.edu (Postfix) with ESMTPSA id 8B258160759; Sun, 13 Aug 2017 15:26:53 -0700 (PDT) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: Jonny Grant , 28082-done@debbugs.gnu.org References: From: Paul Eggert Organization: UCLA Computer Science Department Message-ID: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> Date: Sun, 13 Aug 2017 15:26:53 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 28082-done X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Jonny Grant wrote: > Can this be resolved please? It cannot be resolved by sending email to bug-gnu-utils, because the problem is due to a limit enforced by your operating system kernel, not by bash or by 'rm' or by any other GNU utility. Please file a bug report with whoever maintains your kernel. From debbugs-submit-bounces@debbugs.gnu.org Mon Aug 14 00:27:10 2017 Received: (at 28082) by debbugs.gnu.org; 14 Aug 2017 04:27:10 +0000 Received: from localhost ([127.0.0.1]:34551 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dh6y5-0005uX-QY for submit@debbugs.gnu.org; Mon, 14 Aug 2017 00:27:09 -0400 Received: from mail.magicbluesmoke.com ([82.195.144.49]:42194) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dh6y4-0005uR-04 for 28082@debbugs.gnu.org; Mon, 14 Aug 2017 00:27:08 -0400 Received: from localhost.localdomain (unknown [73.93.153.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.magicbluesmoke.com (Postfix) with ESMTPSA id 481E523F; Mon, 14 Aug 2017 05:27:06 +0100 (IST) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: Jonny Grant , 28082@debbugs.gnu.org References: From: =?UTF-8?Q?P=c3=a1draig_Brady?= Message-ID: <918bf71c-c001-4616-86b0-5e600acb8bc8@draigBrady.com> Date: Sun, 13 Aug 2017 21:27:03 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 28082 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) tag 28082 notabug close 28082 stop On 13/08/17 14:35, Jonny Grant wrote: > Hello > > Can this be resolved please? Seems a shame in 2017 on a machine with > 16GB of ram I suffer this. Each filename is around 40 bytes. > > Roughly 60,000 files > > So total strings around 2.4 MBytes. Quite a small limit. > > $rm jonny*.* > bash: /bin/rm: Argument list too long The standard mechanism to scale this is to use xargs, something like: find . -maxdepth 1 -name 'jonny*.*' -print0 | xargs -r0 rm In any case this is not a limitation imposed by rm. cheers, Pádraig. From debbugs-submit-bounces@debbugs.gnu.org Mon Aug 14 11:59:32 2017 Received: (at 28082) by debbugs.gnu.org; 14 Aug 2017 15:59:32 +0000 Received: from localhost ([127.0.0.1]:35652 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhHm8-0004oO-Eu for submit@debbugs.gnu.org; Mon, 14 Aug 2017 11:59:32 -0400 Received: from mx1.redhat.com ([209.132.183.28]:41140) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhHm6-0004oI-Tk for 28082@debbugs.gnu.org; Mon, 14 Aug 2017 11:59:31 -0400 Received: from smtp.corp.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 20E627CE1B; Mon, 14 Aug 2017 15:59:25 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mx1.redhat.com 20E627CE1B Authentication-Results: ext-mx04.extmail.prod.ext.phx2.redhat.com; dmarc=none (p=none dis=none) header.from=redhat.com Authentication-Results: ext-mx04.extmail.prod.ext.phx2.redhat.com; spf=fail smtp.mailfrom=eblake@redhat.com Received: from [10.10.120.199] (ovpn-120-199.rdu2.redhat.com [10.10.120.199]) by smtp.corp.redhat.com (Postfix) with ESMTP id 876D261374; Mon, 14 Aug 2017 15:59:24 +0000 (UTC) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: =?UTF-8?Q?P=c3=a1draig_Brady?= , Jonny Grant , 28082@debbugs.gnu.org References: <918bf71c-c001-4616-86b0-5e600acb8bc8@draigBrady.com> From: Eric Blake Openpgp: url=http://people.redhat.com/eblake/eblake.gpg Organization: Red Hat, Inc. Message-ID: <89bea508-8b2e-5ca6-9d6b-8eeeb14e62b5@redhat.com> Date: Mon, 14 Aug 2017 10:59:23 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <918bf71c-c001-4616-86b0-5e600acb8bc8@draigBrady.com> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="DBDWlv23FBI6EEQAPlC7eOCJMccdDbkrP" X-Scanned-By: MIMEDefang 2.79 on 10.5.11.11 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.28]); Mon, 14 Aug 2017 15:59:25 +0000 (UTC) X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 28082 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --DBDWlv23FBI6EEQAPlC7eOCJMccdDbkrP Content-Type: multipart/mixed; boundary="KOFsSkgDAgoE61xarHHD0FVDJ4HeqN3DA"; protected-headers="v1" From: Eric Blake To: =?UTF-8?Q?P=c3=a1draig_Brady?= , Jonny Grant , 28082@debbugs.gnu.org Message-ID: <89bea508-8b2e-5ca6-9d6b-8eeeb14e62b5@redhat.com> Subject: Re: bug#28082: bash: /bin/rm: Argument list too long References: <918bf71c-c001-4616-86b0-5e600acb8bc8@draigBrady.com> In-Reply-To: <918bf71c-c001-4616-86b0-5e600acb8bc8@draigBrady.com> --KOFsSkgDAgoE61xarHHD0FVDJ4HeqN3DA Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 08/13/2017 11:27 PM, P=C3=A1draig Brady wrote: >> $rm jonny*.* >> bash: /bin/rm: Argument list too long >=20 > The standard mechanism to scale this is to use xargs, > something like: >=20 > find . -maxdepth 1 -name 'jonny*.*' -print0 | xargs -r0 rm >=20 > In any case this is not a limitation imposed by rm. In fact, we have a FAQ about it: https://www.gnu.org/software/coreutils/faq/coreutils-faq.html#Argument-li= st-too-long --=20 Eric Blake, Principal Software Engineer Red Hat, Inc. +1-919-301-3266 Virtualization: qemu.org | libvirt.org --KOFsSkgDAgoE61xarHHD0FVDJ4HeqN3DA-- --DBDWlv23FBI6EEQAPlC7eOCJMccdDbkrP Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: Public key at http://people.redhat.com/eblake/eblake.gpg Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEzBAEBCAAdFiEEccLMIrHEYCkn0vOqp6FrSiUnQ2oFAlmRyNsACgkQp6FrSiUn Q2o8Cwf+ObU+qekcDOlmm+BjakXgt/zS0oY79HvPODGR+a27bmAPJCfK+Ms3T28I hZ2qXzQfFv3lMnkJ49oZTxSlBay/xJvUzpc0lsL5Q8PJ3DATqxxcANeeZ9fer3xe /fpQ91JqimMVA+clrCDStOcpKCs1DlGiWHnFxVDPIxWVUlpGn/Qd3eU8GmMJr1xD SVIQ+eKBFQd6CVR6OfgImNLluFSBKqJDLQ9ZSblANvDu26VoYkflXBPYpmDnMFgU ZK06LqELULuMTmWwdv2L7I/uz/hYO7ziUyaNSyNG5XJZTmGoMk4iDo3E1Q71/5TN UL/csxU9epJoFDMQwzxWyr8yRFsgIQ== =X5Qg -----END PGP SIGNATURE----- --DBDWlv23FBI6EEQAPlC7eOCJMccdDbkrP-- From debbugs-submit-bounces@debbugs.gnu.org Mon Aug 14 19:50:16 2017 Received: (at 28082) by debbugs.gnu.org; 14 Aug 2017 23:50:16 +0000 Received: from localhost ([127.0.0.1]:37505 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhP7g-0001wi-6N for submit@debbugs.gnu.org; Mon, 14 Aug 2017 19:50:16 -0400 Received: from zimbra.cs.ucla.edu ([131.179.128.68]:60154) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhP7e-0001wc-FO for 28082@debbugs.gnu.org; Mon, 14 Aug 2017 19:50:14 -0400 Received: from localhost (localhost [127.0.0.1]) by zimbra.cs.ucla.edu (Postfix) with ESMTP id CBD951600B5; Mon, 14 Aug 2017 16:50:08 -0700 (PDT) Received: from zimbra.cs.ucla.edu ([127.0.0.1]) by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id 5R3GBJnq0i95; Mon, 14 Aug 2017 16:50:07 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by zimbra.cs.ucla.edu (Postfix) with ESMTP id B32011600CF; Mon, 14 Aug 2017 16:50:07 -0700 (PDT) X-Virus-Scanned: amavisd-new at zimbra.cs.ucla.edu Received: from zimbra.cs.ucla.edu ([127.0.0.1]) by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 9cDvpGBSeisO; Mon, 14 Aug 2017 16:50:07 -0700 (PDT) Received: from [192.168.1.9] (unknown [47.153.184.153]) by zimbra.cs.ucla.edu (Postfix) with ESMTPSA id 8961E1600B5; Mon, 14 Aug 2017 16:50:07 -0700 (PDT) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: Jonny Grant References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> From: Paul Eggert Organization: UCLA Computer Science Department Message-ID: <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> Date: Mon, 14 Aug 2017 16:50:07 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 28082 Cc: 28082@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Jonny Grant wrote: > do you know which kernel API has this limitation? All kernels have a limitation there to some extent, except perhaps the Hurd. Sorry, I don't know what the limits are. From debbugs-submit-bounces@debbugs.gnu.org Tue Aug 15 03:19:23 2017 Received: (at 28082) by debbugs.gnu.org; 15 Aug 2017 07:19:23 +0000 Received: from localhost ([127.0.0.1]:37662 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhW8J-0000eQ-8k for submit@debbugs.gnu.org; Tue, 15 Aug 2017 03:19:23 -0400 Received: from mail-wr0-f193.google.com ([209.85.128.193]:33007) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhW8H-0000eI-Vm for 28082@debbugs.gnu.org; Tue, 15 Aug 2017 03:19:22 -0400 Received: by mail-wr0-f193.google.com with SMTP id n88so125923wrb.0 for <28082@debbugs.gnu.org>; Tue, 15 Aug 2017 00:19:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=3Ac1qjeATLRyhcfConZQEROhdvOPSBLVCVF1ovRLBB8=; b=Xhlhz5BUEM8Dvx/iZHgG/xdoOfVI/5mblkJHle1yPVAqxUERnglyho0ShoM12K2s/U 8aPgLt6OnfdEJ9bYroshJWjwWPTv8/+kIleuxZYWFwJPwHuvJ2+4+2nR0Nbk4bBjv31I DldQOrL2byTEaRNQAi/J9N3K/mKFuX2KWeXNk+l9xGPI7e88Fij082Goe6xSC+W2l8LU N/yNX68YOKZ5S6mmbLYjz/5esa+exvZ/LmHweY8dCTgKN9JqUB7J2MaBvtueN0nyEc+Q W3t4+pn4Yt74CdVafJbpyGVU+WSpmTuuq+FoK4awb5YrTLmZRxui6igeJd2056vtH0GP WTTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=3Ac1qjeATLRyhcfConZQEROhdvOPSBLVCVF1ovRLBB8=; b=NUkvSfH8WUULAIsGFrGMjBS77a+6DnL1yBJNQGB/JFMimavjur66cSxowr54KMnJas zz844AX1dKTPsYOdBMjtTC6bI3WC2OhdJZexxvH9wqbtw0PUp/bb/G/q2CjR5gz9iP8+ 3Rabxt1vIjEpTMr3fj7jvNxf2qsBaTgcn/atNqp0VEVx8SmMefi4RkMQ23feZ/SicAka ZrlpAFe+7VCaDuMH/hUs3DvNb3i3/D1klzrqom2B1lCsf2+TAe+i1KKQOo1W/+nIdF9B aIambOtsYIwLtwS9dRUu4xRxD1g712tY3jX1VFPCrH4yUA7kK21f31rFa0O1WXJ2IK1x 0SOg== X-Gm-Message-State: AHYfb5jgKtW0maH8DFyg7IEThZFry0R+p8OzcfInanOdnGld6AaEN37Z UG4XL7dwZImireKB X-Received: by 10.223.161.195 with SMTP id v3mr16653413wrv.125.1502781555939; Tue, 15 Aug 2017 00:19:15 -0700 (PDT) Received: from [192.168.1.245] (21.4.7.51.dyn.plus.net. [51.7.4.21]) by smtp.googlemail.com with ESMTPSA id 13sm13079397wrw.72.2017.08.15.00.19.14 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 15 Aug 2017 00:19:14 -0700 (PDT) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: Paul Eggert References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> From: Jonny Grant Message-ID: Date: Tue, 15 Aug 2017 08:19:13 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Spam-Score: -2.6 (--) X-Debbugs-Envelope-To: 28082 Cc: 28082@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.6 (--) On 15/08/17 00:50, Paul Eggert wrote: > Jonny Grant wrote: >> do you know which kernel API has this limitation? > > All kernels have a limitation there to some extent, except perhaps the > Hurd. Sorry, I don't know what the limits are. Ok thank you. I imagine kernels just need a dynamic API, so it doesn't need to be a fixed buffer. Jonny From debbugs-submit-bounces@debbugs.gnu.org Tue Aug 15 05:45:58 2017 Received: (at 28082) by debbugs.gnu.org; 15 Aug 2017 09:45:58 +0000 Received: from localhost ([127.0.0.1]:37729 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhYQA-0001pB-MA for submit@debbugs.gnu.org; Tue, 15 Aug 2017 05:45:58 -0400 Received: from vmicros1.altlinux.org ([194.107.17.57]:57632) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhYQ8-0001p5-5J for 28082@debbugs.gnu.org; Tue, 15 Aug 2017 05:45:56 -0400 Received: from mua.local.altlinux.org (mua.local.altlinux.org [192.168.1.14]) by vmicros1.altlinux.org (Postfix) with ESMTP id BF55772DAD1; Tue, 15 Aug 2017 12:45:49 +0300 (MSK) Received: by mua.local.altlinux.org (Postfix, from userid 508) id B22A87CCB5A; Tue, 15 Aug 2017 12:45:49 +0300 (MSK) Date: Tue, 15 Aug 2017 12:45:49 +0300 From: "Dmitry V. Levin" To: Jonny Grant Subject: Re: bug#28082: bash: /bin/rm: Argument list too long Message-ID: <20170815094549.GB16553@altlinux.org> References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 28082 Cc: Paul Eggert , 28082@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) On Tue, Aug 15, 2017 at 08:19:13AM +0100, Jonny Grant wrote: > On 15/08/17 00:50, Paul Eggert wrote: > > Jonny Grant wrote: > >> do you know which kernel API has this limitation? > > > > All kernels have a limitation there to some extent, except perhaps the > > Hurd. Sorry, I don't know what the limits are. > > Ok thank you. > > I imagine kernels just need a dynamic API, so it doesn't need to be a > fixed buffer. It's a security limit rather than a fixed buffer, see e.g. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 -- ldv From debbugs-submit-bounces@debbugs.gnu.org Sat Aug 26 01:46:07 2017 Received: (at 28082) by debbugs.gnu.org; 26 Aug 2017 05:46:07 +0000 Received: from localhost ([127.0.0.1]:55712 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlTv4-0004Nq-2z for submit@debbugs.gnu.org; Sat, 26 Aug 2017 01:46:07 -0400 Received: from ishtar.tlinx.org ([173.164.175.65]:36278 helo=Ishtar.sc.tlinx.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlTv2-0004Ni-Py for 28082@debbugs.gnu.org; Sat, 26 Aug 2017 01:46:05 -0400 Received: from [192.168.3.12] (Athenae [192.168.3.12]) by Ishtar.sc.tlinx.org (8.14.7/8.14.4/SuSE Linux 0.8) with ESMTP id v7Q5jp9Y029096; Fri, 25 Aug 2017 22:45:53 -0700 Message-ID: <59A10B0F.4060304@tlinx.org> Date: Fri, 25 Aug 2017 22:45:51 -0700 From: L A Walsh User-Agent: Thunderbird MIME-Version: 1.0 To: "Dmitry V. Levin" , Jonny Grant Subject: Re: bug#28082: bash: /bin/rm: Argument list too long References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> <20170815094549.GB16553@altlinux.org> In-Reply-To: <20170815094549.GB16553@altlinux.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 28082 Cc: 28082@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Dmitry V. Levin wrote: > It's a security limit rather than a fixed buffer, see e.g. > https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 > > > Hmm, original poster had about 2.3MB of data. The patch referenced above says to limit arg stack usage to at most 75% of _STK_LIM (6MB), or about 4.5MB. Ah... also, 25% of your stack limit. Mine's 8M, so that wouldn't allow for 2.4MB of args. You might get that specific case to pass if you increased your stack limit(?), but it still would be a problem in the general case. From debbugs-submit-bounces@debbugs.gnu.org Sat Aug 26 03:39:10 2017 Received: (at 28082) by debbugs.gnu.org; 26 Aug 2017 07:39:10 +0000 Received: from localhost ([127.0.0.1]:55832 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlVgU-0006wr-EU for submit@debbugs.gnu.org; Sat, 26 Aug 2017 03:39:10 -0400 Received: from mail-lf0-f68.google.com ([209.85.215.68]:37586) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlVgS-0006we-Hi for 28082@debbugs.gnu.org; Sat, 26 Aug 2017 03:39:08 -0400 Received: by mail-lf0-f68.google.com with SMTP id z12so1026423lfd.4 for <28082@debbugs.gnu.org>; Sat, 26 Aug 2017 00:39:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=LWK/Tr9AVFIhJXsIk4wQUMTd6QOa1HlYnLxLJiDHN1k=; b=eYAFyu/jEcL1GEQiflGc1GfG2wMyBBm2Cz/00J5nJyEVoJXqGpw2plh4CMGQvLAvea LPjcghiDQ0zbNBPETHJMDC/bDGEfNLL6CjQbKkGcGwYlIGdYVcAQKwAF9CVgfLRshRxw zh/uiE/qEVIT5EjZTWufO6OggO2z1TgoUJ5N8cH9AvFKRuv3GI2XZ3HVXP6fgFhB+v/q Y0sfzBrUEYbWLXDRmdmLRReYkK3xHu/nmWRntDStI8ncB+0iMy5fuOInjaWk9CuKnZtW psYWp0DPTFtBUNJ6cvaT6elnRp1cGivTNKhugzgVOSJZKqnKrNSCDaj0pbzLL50bjU1A Astw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=LWK/Tr9AVFIhJXsIk4wQUMTd6QOa1HlYnLxLJiDHN1k=; b=QEJjdr4LLJyUAfWOAenH7sCq3cmkOPcLnmYMbu64a1k0trQK3ozA4psQaH1q08Fzpv 2GUXpkja4hvt8i5bk0dR9k1Ez27ZAxuH2ZcaKq9uKegeG3OaP//uZXDnIOs48lHBXz57 gnIvb1libKZYhAAdV7hrn+SOnVtl00/kiRTQ4FF9M++aCJB4wNUjNiJBLFVDnXgmNUUT iFGQx+tSGSM5IT/QCvmZ5LFVSLZcS6HKW27KyORPaRysXK8ojdAn1OLAAnNY5Pdjhtsk BSCUKfwRMt6Bra1TieSmmSka1Tn7GkhY9fEgBpOuOgmtMYJ0U9Xa5gM/xKc4AaH6VqJQ sQ0A== X-Gm-Message-State: AHYfb5jcrXkPw+hx9wzQGbARTcIbfdVZCbvy7sNT6tF1zCUazTSnKZaT Uo6t3N4T1XWdYegF X-Received: by 10.25.210.146 with SMTP id j140mr491978lfg.83.1503733142164; Sat, 26 Aug 2017 00:39:02 -0700 (PDT) Received: from [192.168.5.136] ([84.52.116.107]) by smtp.googlemail.com with ESMTPSA id t15sm1365281ljd.56.2017.08.26.00.39.00 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 26 Aug 2017 00:39:00 -0700 (PDT) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: L A Walsh , "Dmitry V. Levin" References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> <20170815094549.GB16553@altlinux.org> <59A10B0F.4060304@tlinx.org> From: Jonny Grant Message-ID: <514da956-d02c-f32e-a512-6f5bd859e075@jguk.org> Date: Sat, 26 Aug 2017 10:39:00 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <59A10B0F.4060304@tlinx.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Spam-Score: 4.2 (++++) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: On 26/08/17 08:45, L A Walsh wrote: > Dmitry V. Levin wrote: >> It's a security limit rather than a fixed buffer, see e.g. >> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 >> >> >> > Hmm, original poster had about 2.3MB of data. > The patch referenced above says to limit arg stack usage to at > most 75% of _STK_LIM (6MB), or about 4.5MB. > > Ah... also, 25% of your stack limit. Mine's 8M, so that wouldn't allow > for 2.4MB of args. You might get that specific case to pass > if you increased your stack limit(?), but it still would be > a problem in the general case. [...] Content analysis details: (4.2 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 3.6 RCVD_IN_SBL_CSS RBL: Received via a relay in Spamhaus SBL-CSS [84.52.116.107 listed in zen.spamhaus.org] -0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3) [209.85.215.68 listed in wl.mailspike.net] -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/, no trust [209.85.215.68 listed in list.dnswl.org] 0.5 RCVD_IN_SORBS_SPAM RBL: SORBS: sender is a spam source [209.85.215.68 listed in dnsbl.sorbs.net] 0.0 HEADER_FROM_DIFFERENT_DOMAINS From and EnvelopeFrom 2nd level mail domains are different -0.0 SPF_PASS SPF: sender matches SPF record 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (jongrantuk[at]gmail.com) 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid 0.2 FREEMAIL_FORGED_FROMDOMAIN 2nd level domains in From and EnvelopeFrom freemail headers are different -0.0 RCVD_IN_MSPIKE_WL Mailspike good senders X-Debbugs-Envelope-To: 28082 Cc: 28082@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 4.2 (++++) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: On 26/08/17 08:45, L A Walsh wrote: > Dmitry V. Levin wrote: >> It's a security limit rather than a fixed buffer, see e.g. >> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 >> >> >> > Hmm, original poster had about 2.3MB of data. > The patch referenced above says to limit arg stack usage to at > most 75% of _STK_LIM (6MB), or about 4.5MB. > > Ah... also, 25% of your stack limit. Mine's 8M, so that wouldn't allow > for 2.4MB of args. You might get that specific case to pass > if you increased your stack limit(?), but it still would be > a problem in the general case. [...] Content analysis details: (4.2 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.5 RCVD_IN_SORBS_SPAM RBL: SORBS: sender is a spam source [209.85.215.68 listed in dnsbl.sorbs.net] 3.6 RCVD_IN_SBL_CSS RBL: Received via a relay in Spamhaus SBL-CSS [84.52.116.107 listed in zen.spamhaus.org] -0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3) [209.85.215.68 listed in wl.mailspike.net] -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/, no trust [209.85.215.68 listed in list.dnswl.org] 0.0 HEADER_FROM_DIFFERENT_DOMAINS From and EnvelopeFrom 2nd level mail domains are different -0.0 SPF_PASS SPF: sender matches SPF record 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (jongrantuk[at]gmail.com) 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid 0.2 FREEMAIL_FORGED_FROMDOMAIN 2nd level domains in From and EnvelopeFrom freemail headers are different -0.0 RCVD_IN_MSPIKE_WL Mailspike good senders On 26/08/17 08:45, L A Walsh wrote: > Dmitry V. Levin wrote: >> It's a security limit rather than a fixed buffer, see e.g. >> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 >> >> >> > Hmm, original poster had about 2.3MB of data. > The patch referenced above says to limit arg stack usage to at > most 75% of _STK_LIM (6MB), or about 4.5MB. > > Ah... also, 25% of your stack limit. Mine's 8M, so that wouldn't allow > for 2.4MB of args. You might get that specific case to pass > if you increased your stack limit(?), but it still would be > a problem in the general case. I don't know if there is a way that Bash, could split up the long argument lists to workaround a known limit. eg using xargs Regards, Jonny From debbugs-submit-bounces@debbugs.gnu.org Wed Sep 06 08:54:22 2017 Received: (at 28082) by debbugs.gnu.org; 6 Sep 2017 12:54:22 +0000 Received: from localhost ([127.0.0.1]:52449 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dpZqY-0005NA-DU for submit@debbugs.gnu.org; Wed, 06 Sep 2017 08:54:22 -0400 Received: from mail-lf0-f46.google.com ([209.85.215.46]:32838) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dpZqX-0005My-DN for 28082@debbugs.gnu.org; Wed, 06 Sep 2017 08:54:21 -0400 Received: by mail-lf0-f46.google.com with SMTP id s11so17507708lfe.0 for <28082@debbugs.gnu.org>; Wed, 06 Sep 2017 05:54:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=mBMd6IRndBQQt9pU0y7SmrDsjBqJesjnMkAwrq+KRsY=; b=g5aktMHW12rxkEGy/uQM3QYuCa4OYJ3DUyfQ3ZKh7LO4LE0tpbJAiwhuQqkhuHKBvO iljaLe/5zQMaIRaX1wTNOC4wIJ6IGMYx3BYdOti4CtsCwLZsd2Nj1wjY1YPENZTt1Zvb gSKFC/LHqt2hw++n2JE6sRoylX1hytcGErflrzXWhV7JT5hvFKjOAMqG4/+ULWJe77Y3 bxN6mpPo1HKVuVWX+peFrNCILY5mIK/vyygYdqKhfRm0nE8l7Hm5xJK3oXkXsgiqX+WR Cyf9PIgIQ8tquTrk1Z7TpNaLjZ8cQ54A+mXNGSIZLwK25HdvAjAMkR0bC8zaeUHk9faX blAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=mBMd6IRndBQQt9pU0y7SmrDsjBqJesjnMkAwrq+KRsY=; b=hoSpkbTU6Q9SGFYibPMezPYLD7bVo7MsSAFy72RQL4gfIQC13iBMDveGvvE6/MDgdz ACffL8GZEE+oElttRpjbSZxDm2DkETPY/wKyI/4Z6xdRwOrmb9RHCIG7cf5BVv57MN2p eOz3vKJNP3Gzl2tWOk+YJMi0tI0H7c9ShlMB5NX9ae5EjEcVqTcxfug+H7ilm5dMBBs9 EtPi6Mv4LdlGac9lt8BtZZtAPeIVmcXbqeGllRs3WLzjEy7Y6Ek1g9ylZSEh0Utk6zE0 MDawLBooaJOvqPGtzFQ5ks7jBxfCq7TBptBPNS5Dm5PIyNaWXIXmz5unomGhTRjaId1/ aK2w== X-Gm-Message-State: AHPjjUgbX4VDks/41PEOtkxdw3emi2y+PCrqFdMpo6Zdm0t6b029/TrJ +NbhKCsXa+lm1/dh X-Google-Smtp-Source: ADKCNb6JBt2EYT8wv3mCMr2HODmmdV3M2ABpCOThElaOH6mTqu9/65gLwA04l2BbwB6QmOGeQBliYw== X-Received: by 10.46.1.134 with SMTP id f6mr1013766lji.100.1504702454798; Wed, 06 Sep 2017 05:54:14 -0700 (PDT) Received: from [192.168.1.34] (host-87-255-31-247.bigtelecom.ru. [87.255.31.247]) by smtp.googlemail.com with ESMTPSA id v9sm580569lfa.68.2017.09.06.05.54.12 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 06 Sep 2017 05:54:13 -0700 (PDT) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: "Dmitry V. Levin" References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> <20170815094549.GB16553@altlinux.org> From: Jonny Grant Message-ID: Date: Wed, 6 Sep 2017 15:54:10 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <20170815094549.GB16553@altlinux.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 28082 Cc: Paul Eggert , 28082@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On 15/08/17 12:45, Dmitry V. Levin wrote: > On Tue, Aug 15, 2017 at 08:19:13AM +0100, Jonny Grant wrote: >> On 15/08/17 00:50, Paul Eggert wrote: >>> Jonny Grant wrote: >>>> do you know which kernel API has this limitation? >>> >>> All kernels have a limitation there to some extent, except perhaps the >>> Hurd. Sorry, I don't know what the limits are. >> >> Ok thank you. >> >> I imagine kernels just need a dynamic API, so it doesn't need to be a >> fixed buffer. > > It's a security limit rather than a fixed buffer, see e.g. > https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 Thank you for your reply. My Ubuntu 16.04 limit is 2MB it seems: $ getconf ARG_MAX 2097152 This laptop has 16GB RAM, so it is a shame it isn't much bigger, or dynamic so can be expanded when needed somehow. Those mapped pages of RAM wouldn't be wasted, as just VM right? I imagine a lot of people may have 60,000 files in a directory like me these days. Latest Linux kernel just added support for billions of files per directory I read. Regards, Jonny From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 08 00:11:43 2017 Received: (at 28082) by debbugs.gnu.org; 8 Sep 2017 04:11:43 +0000 Received: from localhost ([127.0.0.1]:55063 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dqAdq-0002Dv-MF for submit@debbugs.gnu.org; Fri, 08 Sep 2017 00:11:42 -0400 Received: from mail-yw0-f182.google.com ([209.85.161.182]:34332) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dq9j7-0000rU-BG for 28082@debbugs.gnu.org; Thu, 07 Sep 2017 23:13:05 -0400 Received: by mail-yw0-f182.google.com with SMTP id r85so4250218ywg.1 for <28082@debbugs.gnu.org>; Thu, 07 Sep 2017 20:13:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=uOlvlsuXoibdNFXLxpsu8RukQKaPDdkUH8o+6CL2f2I=; b=Y+s4moydHCuxYd/9Ik6QL1O/fgCpj8M12KYoIZEA9oUqJg9DcHbHi73PfIm8MnYRTl AUspflGZ+TmnK+SKhjSVvTYp3khbNxAXrlJ6ZQqktO+ru7UdP+VqY9kLvJFFMM1h6DvW 3xWGXTs9PuOXqdrqyqexVMvp5UHGz0wM7ttUW2DsZ2QuFTtKIsx00OYCCGvBBlqTRSta RMt8U8Kxq3/6UflriEjZ+FbgXwU/lFw1vxUl8R5leFChp/BhwGGnrnMFSFDfV70KxwUO TuFMpJY72iWJt2PDMGXNYolIVzrrYLoQPd3SIEyLzAeMzmHguqy9JRISfJhw2VXuMq2L 889g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=uOlvlsuXoibdNFXLxpsu8RukQKaPDdkUH8o+6CL2f2I=; b=gHLQ6kwZOtwk/AugFEjDOVbOucBQ2+HqP+9W/1ae45tU0e3Pg4dB4IUpnFgrXVA1WZ 3IlrMBn9fhS5zNytRrmlWTGKnB/30kwucQciGOdmO0Hajvo6zsdRkw1Pt04MaquHczsb TKF2RNGYqquyWoz8se6lU9f4Bt+lby8JOiNMejkb5XKorH3C60wGctZ0NOxTDZL3vbbJ +ZSCzYFW0or+NvE4p05MdhpIJVz9XCDZjs+xi+YNsT5GcobM6DhNTAG1/o8sV9eDDL0r nZaG44SeayoaH19PMBVGGtp+MNpCvdRTlgrMV/kS2/rfAxrURhUmHH8pccrZ3aqyclJD wvmg== X-Gm-Message-State: AHPjjUjRBHGm9f/XDA0ZG087Lw4udshlPxE8yAerAdeUTItBoAA0BD/S G6A+IRhptGEA9GIy7SW7a3IHp8MTrw== X-Google-Smtp-Source: AOwi7QCYfhndoi+DFzW9FOgkIAzFnQDk1DCVtRzjT09vSDBuqyHQfvM9W6jcEincp7alyx+AZnvI1urwytXPR6DagCc= X-Received: by 10.37.216.148 with SMTP id p142mr1205567ybg.355.1504840379605; Thu, 07 Sep 2017 20:12:59 -0700 (PDT) MIME-Version: 1.0 Received: by 10.129.211.10 with HTTP; Thu, 7 Sep 2017 20:12:59 -0700 (PDT) In-Reply-To: References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> <20170815094549.GB16553@altlinux.org> From: R0b0t1 Date: Thu, 7 Sep 2017 22:12:59 -0500 Message-ID: Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: Jonny Grant Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 28082 X-Mailman-Approved-At: Fri, 08 Sep 2017 00:11:41 -0400 Cc: 28082@debbugs.gnu.org, Paul Eggert , "Dmitry V. Levin" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On Wed, Sep 6, 2017 at 7:54 AM, Jonny Grant wrote: > > > On 15/08/17 12:45, Dmitry V. Levin wrote: >> >> On Tue, Aug 15, 2017 at 08:19:13AM +0100, Jonny Grant wrote: >>> >>> On 15/08/17 00:50, Paul Eggert wrote: >>>> >>>> Jonny Grant wrote: >>>>> >>>>> do you know which kernel API has this limitation? >>>> >>>> >>>> All kernels have a limitation there to some extent, except perhaps the >>>> Hurd. Sorry, I don't know what the limits are. >>> >>> >>> Ok thank you. >>> >>> I imagine kernels just need a dynamic API, so it doesn't need to be a >>> fixed buffer. >> >> >> It's a security limit rather than a fixed buffer, see e.g. >> >> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 > > > Thank you for your reply. > > My Ubuntu 16.04 limit is 2MB it seems: > $ getconf ARG_MAX > 2097152 > > > This laptop has 16GB RAM, so it is a shame it isn't much bigger, or dynamic > so can be expanded when needed somehow. Those mapped pages of RAM wouldn't > be wasted, as just VM right? > > I imagine a lot of people may have 60,000 files in a directory like me these > days. Latest Linux kernel just added support for billions of files per > directory I read. > If this is a strict requirement, you could switch to Hurd. I checked with a Hurd developer(?) some time ago and one of their design philosophies is no artificial limits. I wasn't able to find an actual citation for this behavior, sadly. R0b0t1. From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 08 06:04:23 2017 Received: (at 28082) by debbugs.gnu.org; 8 Sep 2017 10:04:23 +0000 Received: from localhost ([127.0.0.1]:55334 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dqG99-0003yk-Bo for submit@debbugs.gnu.org; Fri, 08 Sep 2017 06:04:23 -0400 Received: from mail-lf0-f47.google.com ([209.85.215.47]:36030) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dqG97-0003yS-Pn for 28082@debbugs.gnu.org; Fri, 08 Sep 2017 06:04:22 -0400 Received: by mail-lf0-f47.google.com with SMTP id m199so4573324lfe.3 for <28082@debbugs.gnu.org>; Fri, 08 Sep 2017 03:04:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=83YkxJ5NUhHoVAsSBHOUul+H587+sar7J6txmHIKy1A=; b=A5kM6RDN9bO2oLm3vnXARPvn0OWT6qDwDKStj1sOCJvs/tTkriAK0lfuID/RX8jvv/ p1Jltv73cyTm6ZMTEAoanYwA5GsjX9YDRaB6HSE332ALOHAXgmNddCDGbAb69MQ0s5dH qbs11RcWgvPrgVz7P5Q1qAhRMl7k1f/vQN87vXkGZWbOtNPqMJu3wGlkf42J1r1Lmg4L hC0THaJoyYKPPxy7QBd2/rjCUZPQI58hdBoDBGPTBjZ3Nb0uzwzuzLXRxNHj12A7C/bk xYnA9d8gp7fce+h1uVJNkUNAFbDhH3m8uJBVHD1veVOWJGvWX1oZz8+aiIqLQghpnLJa RtwQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=83YkxJ5NUhHoVAsSBHOUul+H587+sar7J6txmHIKy1A=; b=WRTxxXRKILlZjO88WJGK2St8o34L0ZKUXz6oEMO7HzLwQwB7nP5Zbu/h99/UhSp5AD XHxjv5Z1187UYwMfwLN//5/erWuikpc0+BzcjU8HGS2VJ7M9i2Ko3napXPnoW3J/hOTg ZbHyK4OfhCyyb+wIIkSybydYJkuLIMJ4TZsxDnb8jXYRvg+KAKLe4pW4O3pOtdl3qZEX 3mX3NlvLQ56gsUZLYI9Y4FPZZ7meKwZCxf0T+lVhAtXBUoDpE3REiw+KnlNJr8Y+2hD7 tronAuhzKvf327ZeqzeSPyVww575tu86sMdcDpFmnv3XpoE6wB1fdya+wESzjI/iRW4a k9kA== X-Gm-Message-State: AHPjjUgmbrJFpb3iYK/eCLKegkK1gz+RnGr0RNKXiA6dsHJnX/sJTxTu DwmE/ptgskv7Lzpm X-Google-Smtp-Source: AOwi7QCgmbWA6YTQ1dDBCmKo7VzymDMOLH9+Wr+5Bk1rW8UcEPRz2pQBl4R58RXX4onhqmok1WjJdA== X-Received: by 10.25.44.199 with SMTP id s190mr897900lfs.11.1504865055572; Fri, 08 Sep 2017 03:04:15 -0700 (PDT) Received: from [192.168.1.34] (host-87-255-31-247.bigtelecom.ru. [87.255.31.247]) by smtp.googlemail.com with ESMTPSA id f25sm255452lji.49.2017.09.08.03.04.14 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 08 Sep 2017 03:04:14 -0700 (PDT) Subject: Re: bug#28082: bash: /bin/rm: Argument list too long To: R0b0t1 References: <54cc96b4-8c25-fa87-bf58-c8db799e25fe@cs.ucla.edu> <9fb0ec73-6d11-ce41-79cd-f090e408f635@cs.ucla.edu> <20170815094549.GB16553@altlinux.org> From: Jonny Grant Message-ID: <2f76e183-50fa-58cf-045e-655a33010b52@jguk.org> Date: Fri, 8 Sep 2017 13:04:13 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 28082 Cc: 28082@debbugs.gnu.org, Paul Eggert , "Dmitry V. Levin" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On 08/09/17 06:12, R0b0t1 wrote: > On Wed, Sep 6, 2017 at 7:54 AM, Jonny Grant wrote: >> >> >> On 15/08/17 12:45, Dmitry V. Levin wrote: >>> >>> On Tue, Aug 15, 2017 at 08:19:13AM +0100, Jonny Grant wrote: >>>> >>>> On 15/08/17 00:50, Paul Eggert wrote: >>>>> >>>>> Jonny Grant wrote: >>>>>> >>>>>> do you know which kernel API has this limitation? >>>>> >>>>> >>>>> All kernels have a limitation there to some extent, except perhaps the >>>>> Hurd. Sorry, I don't know what the limits are. >>>> >>>> >>>> Ok thank you. >>>> >>>> I imagine kernels just need a dynamic API, so it doesn't need to be a >>>> fixed buffer. >>> >>> >>> It's a security limit rather than a fixed buffer, see e.g. >>> >>> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=da029c11e6b12f321f36dac8771e833b65cec962 >> >> >> Thank you for your reply. >> >> My Ubuntu 16.04 limit is 2MB it seems: >> $ getconf ARG_MAX >> 2097152 >> >> >> This laptop has 16GB RAM, so it is a shame it isn't much bigger, or dynamic >> so can be expanded when needed somehow. Those mapped pages of RAM wouldn't >> be wasted, as just VM right? >> >> I imagine a lot of people may have 60,000 files in a directory like me these >> days. Latest Linux kernel just added support for billions of files per >> directory I read. >> > > If this is a strict requirement, you could switch to Hurd. I checked > with a Hurd developer(?) some time ago and one of their design > philosophies is no artificial limits. > > I wasn't able to find an actual citation for this behavior, sadly. > > R0b0t1. Thank you for your reply. Yes, probably Linux kernel / Glibc should include this improvement. I don't know who to ask there though. Saves us each from needing to modularise/batch our commands in bash scripts. Jonny From unknown Tue Aug 19 12:51:04 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 06 Oct 2017 11:24:05 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator