From unknown Wed Jun 18 23:04:23 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#17827 <17827@debbugs.gnu.org> To: bug#17827 <17827@debbugs.gnu.org> Subject: Status: =?UTF-8?Q?=E2=80=9CToo?= many open =?UTF-8?Q?files=E2=80=9D?= error while substituter is running Reply-To: bug#17827 <17827@debbugs.gnu.org> Date: Thu, 19 Jun 2025 06:04:23 +0000 retitle 17827 =E2=80=9CToo many open files=E2=80=9D error while substituter= is running reassign 17827 guix submitter 17827 ludo@gnu.org (Ludovic Court=C3=A8s) severity 17827 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 21 10:24:43 2014 Received: (at submit) by debbugs.gnu.org; 21 Jun 2014 14:24:43 +0000 Received: from localhost ([127.0.0.1]:56164 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1WyMDi-0002Kb-NQ for submit@debbugs.gnu.org; Sat, 21 Jun 2014 10:24:43 -0400 Received: from eggs.gnu.org ([208.118.235.92]:38645) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1WyMDg-0002KM-4R for submit@debbugs.gnu.org; Sat, 21 Jun 2014 10:24:40 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1WyMDR-0001gX-TM for submit@debbugs.gnu.org; Sat, 21 Jun 2014 10:24:34 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=BAYES_20,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:45668) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1WyMDR-0001gE-QW for submit@debbugs.gnu.org; Sat, 21 Jun 2014 10:24:25 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:40299) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1WyMDI-00012v-PF for bug-guix@gnu.org; Sat, 21 Jun 2014 10:24:25 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1WyMD9-0001dP-Np for bug-guix@gnu.org; Sat, 21 Jun 2014 10:24:16 -0400 Received: from hera.aquilenet.fr ([2a01:474::1]:34383) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1WyMD9-0001d8-Hi for bug-guix@gnu.org; Sat, 21 Jun 2014 10:24:07 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 0BFEA2D08 for ; Sat, 21 Jun 2014 16:24:06 +0200 (CEST) Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pmewo3VTgUrG for ; Sat, 21 Jun 2014 16:24:05 +0200 (CEST) Received: from pluto (reverse-83.fdn.fr [80.67.176.83]) by hera.aquilenet.fr (Postfix) with ESMTPSA id BB37222C0 for ; Sat, 21 Jun 2014 16:24:05 +0200 (CEST) From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: bug-guix@gnu.org Subject: =?utf-8?Q?=E2=80=9CToo?= many open =?utf-8?Q?files=E2=80=9D?= error while substituter is running X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 3 Messidor an 222 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0xEA52ECF4 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 83C4 F8E5 10A3 3B4C 5BEA D15D 77DD 95E2 EA52 ECF4 X-OS: x86_64-unknown-linux-gnu Date: Sat, 21 Jun 2014 16:24:05 +0200 Message-ID: <87simyibne.fsf@gnu.org> User-Agent: Gnus/5.130009 (Ma Gnus v0.9) Emacs/24.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) While running the substituter in a disk/VM image built with Guix (on the metal or on QEMU), I quickly stumble upon EMFILE. It goes like this: 1. Run =E2=80=98guix build emacs -n=E2=80=99 to warm up /var/guix/substit= ute-binary; this (currently) uses many threads and everything, but doesn=E2=80=99t cause any problems. 2. Run =E2=80=98guix build emacs=E2=80=99. This starts downloading subst= itutes, via =E2=80=98guix substitute-binary --substitute=E2=80=99. It works fine,= except that running something in parallel like =E2=80=98guix package --help=E2=80= =99 quickly fails with EMFILE (=E2=80=9CToo many open files=E2=80=9D.) Looking at /proc/sys/fs/file-nr suggests we=E2=80=99re still way below the threshold at that point. Increasing file-max doesn=E2=80=99t make a differ= ence. Looking at the strace output of the failing =E2=80=98guix package --help=E2= =80=99 shows that it does lots of open/close calls, but remains at 10 open files. Eventually, one of its close(2) calls (!) returns EMFILE, and all the subsequent open(2) calls fail similarly. The problem seems to manifest more easily when there=E2=80=99s a lot of RAM, which made me thing of a Scheme file port leak. Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 21 11:37:32 2014 Received: (at 17827-done) by debbugs.gnu.org; 21 Jun 2014 15:37:32 +0000 Received: from localhost ([127.0.0.1]:56290 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1WyNMC-0004Ca-2L for submit@debbugs.gnu.org; Sat, 21 Jun 2014 11:37:32 -0400 Received: from hera.aquilenet.fr ([141.255.128.1]:36823) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1WyNM8-0004CQ-GM for 17827-done@debbugs.gnu.org; Sat, 21 Jun 2014 11:37:29 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 44A602D0D for <17827-done@debbugs.gnu.org>; Sat, 21 Jun 2014 17:37:27 +0200 (CEST) Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jLXwuYzcI5zx for <17827-done@debbugs.gnu.org>; Sat, 21 Jun 2014 17:37:27 +0200 (CEST) Received: from pluto (reverse-83.fdn.fr [80.67.176.83]) by hera.aquilenet.fr (Postfix) with ESMTPSA id EBED7234A for <17827-done@debbugs.gnu.org>; Sat, 21 Jun 2014 17:37:26 +0200 (CEST) From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: 17827-done@debbugs.gnu.org Subject: Re: bug#17827: =?utf-8?Q?=E2=80=9CToo?= many open =?utf-8?Q?files?= =?utf-8?Q?=E2=80=9D?= error while substituter is running References: <87simyibne.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 3 Messidor an 222 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0xEA52ECF4 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 83C4 F8E5 10A3 3B4C 5BEA D15D 77DD 95E2 EA52 ECF4 X-OS: x86_64-unknown-linux-gnu Date: Sat, 21 Jun 2014 17:37:26 +0200 In-Reply-To: <87simyibne.fsf@gnu.org> ("Ludovic \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\= \=\?utf-8\?Q\?s\?\= message of "Sat, 21 Jun 2014 16:24:05 +0200") Message-ID: <874mzegtop.fsf@gnu.org> User-Agent: Gnus/5.130009 (Ma Gnus v0.9) Emacs/24.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 17827-done X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) The problem was that the unionfs process for the root file system would run out of file descriptors (the default limit is 1024.) Fixed in commit 9b9148d. Ludo=E2=80=99. From unknown Wed Jun 18 23:04:23 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Sun, 20 Jul 2014 11:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator