From unknown Fri Jun 13 10:54:41 2025 X-Loop: help-debbugs@gnu.org Subject: bug#34016: Git checkouts managed by (guix git) grow indefinitely? Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 08 Jan 2019 16:58:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 34016 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 34016@debbugs.gnu.org Cc: Erik Edrosa X-Debbugs-Original-To: Bug Guix Received: via spool by submit@debbugs.gnu.org id=B.154696664727090 (code B ref -1); Tue, 08 Jan 2019 16:58:01 +0000 Received: (at submit) by debbugs.gnu.org; 8 Jan 2019 16:57:27 +0000 Received: from localhost ([127.0.0.1]:50164 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ggugw-00072s-UC for submit@debbugs.gnu.org; Tue, 08 Jan 2019 11:57:27 -0500 Received: from eggs.gnu.org ([209.51.188.92]:50595) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ggugs-00072c-Ph for submit@debbugs.gnu.org; Tue, 08 Jan 2019 11:57:23 -0500 Received: from lists.gnu.org ([209.51.188.17]:33630) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ggugl-00079n-9u for submit@debbugs.gnu.org; Tue, 08 Jan 2019 11:57:15 -0500 Received: from eggs.gnu.org ([209.51.188.92]:60788) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ggugk-00011r-4Y for bug-guix@gnu.org; Tue, 08 Jan 2019 11:57:15 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-5.0 required=5.0 tests=BAYES_40,RCVD_IN_DNSWL_HI autolearn=disabled version=3.3.2 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ggugg-0006xb-0K for bug-guix@gnu.org; Tue, 08 Jan 2019 11:57:14 -0500 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:8251) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ggugf-0006pc-LP for bug-guix@gnu.org; Tue, 08 Jan 2019 11:57:09 -0500 X-IronPort-AV: E=Sophos;i="5.56,454,1539640800"; d="scan'208";a="291215753" Received: from unknown (HELO ribbon) ([193.50.110.193]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/AES256-GCM-SHA384; 08 Jan 2019 17:56:55 +0100 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 19 =?UTF-8?Q?Niv=C3=B4se?= an 227 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 08 Jan 2019 17:56:55 +0100 Message-ID: <87h8ejw0iw.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 192.134.164.104 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hello, On berlin I noticed that Cuirass would run out of file descriptors almost immediately once started. I managed to get the list of open files: --8<---------------cut here---------------start------------->8--- ludo@berlin ~$ sudo ls -l /proc/$(sudo herd status cuirass|grep value|sed -= es'/^.* \([0-9]\+\)\.$/\1/g')/fd [=E2=80=A6] alwq/.git/objects/pack/pack-dde01a576697a783fd12eb73228921153ba18b4b.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 978 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d65= f5c22414e4864a00ec7bee4cff5ff0b4a2c31.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 979 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d78= f9f47a68d4254a81d57d6183fe9c9be41752d.pack l-wx------ 1 cuirass cuirass 64 Jan 8 17:46 98 -> 'pipe:[70917334]' lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 980 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-58f= 83b77dbe392bba277f10a1bdd7ed469946feb.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 981 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d28= d075e1dd259683747b5723a232fa4d60cd1a9.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 982 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-cff= bdad6def559b60bd928173916f3edbb1a4a8f.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 983 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-ac4= 2d4dd95b02bb54d03687c984c67bacf0e1feb.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 984 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-e5e= 26a7aeb5a33889f6ac8cff8bef182b5b8a0b2.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 985 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-ac6= 6439d6b07a0e4cf2e4ccef3be21e8a1c96d55.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 986 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-f73= b60b056634b58f44fb65f20416e22a6c936e8.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 987 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-f8f= 3313f5ec872e43cb1e12a8b6509e7f0a13512.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 988 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-55e= 720e2a4ec09cc996599c5089be871eba8f829.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 989 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d24= 41e647df889422906a30d06d6d195e522cbd1.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 99 -> 'pipe:[70908233]' lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 990 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-61f= ed4082491ff66716c92fe49fe499cd6a5fa78.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 991 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-0bc= efb4f7953471a0bc944f0f0c3bbe9143df22b.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 992 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-6a5= fbea2046bdc8c94926e9d3d516e1b5351b645.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 993 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-add= 66d8bdd96e4cc67e78a23c428f7b4e46974df.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 994 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-740= 728c75faa0e9179ad977d4e4b2eb6bfa51345.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 995 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-c78= 417a98abdc6a7396fb3f6e4d5633de20c819c.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 996 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-df4= cae77b58d600538f2dc51b7b31b61a92cab23.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 997 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-835= 59c192d41400596d42587bb50d409c121969d.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 998 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-1f4= 6268a2ba6bd3b97d9d7cea4e18233212cc75e.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 999 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-55a= 94a468fa892b0128656fc5aa953c667161fcd.pack --8<---------------cut here---------------end--------------->8--- So it=E2=80=99s Guile-Git, called from =E2=80=98update-cached-checkout=E2= =80=99=C2=B9, that would open all these pack files, quickly running out of file descriptors. I wonder if we=E2=80=99re doing something wrong here or if we hit a limitation of libgit2. Ideas? In the meantime, the obvious workaround was to =E2=80=9Crm -rf /var/cache/cuirass/pjmkglp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq=E2= =80=9D. Thanks, Ludo=E2=80=99. =C2=B9 https://git.savannah.gnu.org/cgit/guix.git/tree/guix/git.scm#n122 From debbugs-submit-bounces@debbugs.gnu.org Wed Jan 09 15:32:31 2019 Received: (at control) by debbugs.gnu.org; 9 Jan 2019 20:32:31 +0000 Received: from localhost ([127.0.0.1]:52563 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ghKWc-00076X-U3 for submit@debbugs.gnu.org; Wed, 09 Jan 2019 15:32:31 -0500 Received: from hera.aquilenet.fr ([185.233.100.1]:50122) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ghKWa-00076N-Mz for control@debbugs.gnu.org; Wed, 09 Jan 2019 15:32:29 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id DF5DA10BE for ; Wed, 9 Jan 2019 21:32:26 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id FVLr-8Qvc3IN for ; Wed, 9 Jan 2019 21:32:26 +0100 (CET) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 32402104E for ; Wed, 9 Jan 2019 21:32:26 +0100 (CET) Date: Wed, 09 Jan 2019 21:32:25 +0100 Message-Id: <87muo9373a.fsf@gnu.org> To: control@debbugs.gnu.org From: =?utf-8?Q?Ludovic_Court=C3=A8s?= Subject: control message for bug #34016 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) severity 34016 important From unknown Fri Jun 13 10:54:41 2025 X-Loop: help-debbugs@gnu.org Subject: bug#34016: Git checkouts managed by (guix git) grow indefinitely? Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 09 Aug 2019 09:37:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 34016 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 34016@debbugs.gnu.org Cc: Erik Edrosa Received: via spool by 34016-submit@debbugs.gnu.org id=B34016.156534338128342 (code B ref 34016); Fri, 09 Aug 2019 09:37:01 +0000 Received: (at 34016) by debbugs.gnu.org; 9 Aug 2019 09:36:21 +0000 Received: from localhost ([127.0.0.1]:42058 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hw1Jt-0007N4-If for submit@debbugs.gnu.org; Fri, 09 Aug 2019 05:36:21 -0400 Received: from eggs.gnu.org ([209.51.188.92]:38323) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hw1Jo-0007Mp-Qs for 34016@debbugs.gnu.org; Fri, 09 Aug 2019 05:36:17 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:51849) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1hw1Jj-0005o1-LF; Fri, 09 Aug 2019 05:36:11 -0400 Received: from adijon-655-1-159-145.w90-6.abo.wanadoo.fr ([90.6.12.145]:45258 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1hw1Jj-0003lb-0c; Fri, 09 Aug 2019 05:36:11 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87h8ejw0iw.fsf@inria.fr> Date: Fri, 09 Aug 2019 11:36:08 +0200 In-Reply-To: <87h8ejw0iw.fsf@inria.fr> ("Ludovic \=\?utf-8\?Q\?Court\=C3\=A8s\=22\?\= \=\?utf-8\?Q\?'s\?\= message of "Tue, 08 Jan 2019 17:56:55 +0100") Message-ID: <875zn6brzr.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, Ludovic Court=C3=A8s skribis: > So it=E2=80=99s Guile-Git, called from =E2=80=98update-cached-checkout=E2= =80=99=C2=B9, that would open > all these pack files, quickly running out of file descriptors. I wonder > if we=E2=80=99re doing something wrong here or if we hit a limitation of > libgit2. Ideas? Forwarded here: . Ludo=E2=80=99. From unknown Fri Jun 13 10:54:41 2025 X-Loop: help-debbugs@gnu.org Subject: bug#34016: Git checkouts managed by (guix git) grow indefinitely References: <87h8ejw0iw.fsf@inria.fr> In-Reply-To: <87h8ejw0iw.fsf@inria.fr> Resent-From: Brendan Tildesley Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 23 Apr 2021 11:12:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 34016 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: "34016@debbugs.gnu.org" <34016@debbugs.gnu.org> Cc: "ludo@gnu.org" Received: via spool by 34016-submit@debbugs.gnu.org id=B34016.161917630421765 (code B ref 34016); Fri, 23 Apr 2021 11:12:01 +0000 Received: (at 34016) by debbugs.gnu.org; 23 Apr 2021 11:11:44 +0000 Received: from localhost ([127.0.0.1]:36262 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lZtiq-0005ez-Er for submit@debbugs.gnu.org; Fri, 23 Apr 2021 07:11:44 -0400 Received: from mout-p-202.mailbox.org ([80.241.56.172]:20354) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lZtin-0005ek-EL for 34016@debbugs.gnu.org; Fri, 23 Apr 2021 07:11:43 -0400 Received: from smtp1.mailbox.org (smtp1.mailbox.org [80.241.60.240]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mout-p-202.mailbox.org (Postfix) with ESMTPS id 4FRWng1nhCzQk3f; Fri, 23 Apr 2021 13:11:35 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=mailbox.org; h= content-type:content-type:mime-version:subject:subject :message-id:from:from:date:date:received; s=mail20150812; t= 1619176291; bh=gW+3u+7Srx51XgMRE0uAA7+Wiq8mEeFfZrpI3Z+eeUU=; b=P Srz5niDTgZUR0aEtGezNIgnKZ+wKruDbBZi89roTtXSU1TfJCcGtSNz4rLawxyhw piyCSJ3bWKTQ2EyLe+1uLVyzmizVeGH/wG1d19BlBVZbQDw6ozA+7cKhFVQlsV0o /3AJfPxNQhNEfWzC8hXtPzM2cUakQbytTNi9cDswkLTXo+nl/A4/06d7u6o7wJgr 4YZG/rRrIAx01+xxuECM70CFWjs2Mrlndsuwrj+5sQ1dXAa3yiiS9QDGXwIVypQR Sgvj2XTioGXydHgh7ZuWcZtKBFIEH+AVbd4rDbnWl04J/2/gVC3EX3pw0NwSzDpn T6+GfOOCrba1fqZtqp8tA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mailbox.org; s=mail20150812; t=1619176293; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=kn0W4ttkO7rBaQvWPtOR3OUrb8NTeFVHApNw7Dt1l80=; b=wClBHJSsqmTKtJkvyLJA+EMPLc/FlR4iETFO6byjm5X2nYgmEyKlZRV7JGRp1mtGS/Opvr FnnMY4UPsJaJTIOcrmT0kF8ktrJ+Y7ZN0bZiKts7jFa03CjrBWZxqJdEP5xnRtB50KhUfn h7uZIH1juYPw40gg3KbL6WgT2E4TrtNNdwzO4kEsTMG0fI0voZt2iIHS8F/8QlTUZEnM/2 pgj0ClXqYaii3ZsAPeohvaW/y4qwn49TBjUMEjmlonRwH6zcosfKb/MiFJQ2OIb16W6Y3k ifgSHDq1G1WoHrikaWHhc7g49fVprnLAWomXkl3EF/aQ7+UQPQ3VD+CScw4/ag== X-Virus-Scanned: amavisd-new at heinlein-support.de Received: from smtp1.mailbox.org ([80.241.60.240]) by spamfilter03.heinlein-hosting.de (spamfilter03.heinlein-hosting.de [80.241.56.117]) (amavisd-new, port 10030) with ESMTP id eGKthEm5GQK2; Fri, 23 Apr 2021 13:11:31 +0200 (CEST) Date: Fri, 23 Apr 2021 13:11:31 +0200 (CEST) From: Brendan Tildesley Message-ID: <124603819.14964.1619176291284@office.mailbox.org> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_14963_2076960358.1619176291283" X-Priority: 3 Importance: Normal X-MBO-SPAM-Probability: X-Rspamd-Score: -0.68 / 15.00 / 15.00 X-Rspamd-Queue-Id: F21A815F8 X-Rspamd-UID: 1dfbb8 X-Spam-Score: -0.7 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) ------=_Part_14963_2076960358.1619176291283 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Since this bug report 1.1.0 was released. The Changelog includes this note: "Repositories with a large number of packfiles no longer exhaust the number of file descriptors." https://github.com/libgit2/libgit2/pull/5396 May or may not be related to this. ------=_Part_14963_2076960358.1619176291283 MIME-Version: 1.0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit
Since this bug report 1.1.0 was released. The Changelog includes this note:
"Repositories with a large number of packfiles no longer exhaust the
number of file descriptors."

https://github.com/libgit2/libgit2/pull/5396

May or may not be related to this.
------=_Part_14963_2076960358.1619176291283-- From unknown Fri Jun 13 10:54:41 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Subject: bug#34016: closed (Re: Git checkouts managed by (guix git) grow indefinitely) Message-ID: References: <87mttpnj0w.fsf@gnu.org> <87h8ejw0iw.fsf@inria.fr> X-Gnu-PR-Message: they-closed 34016 X-Gnu-PR-Package: guix Reply-To: 34016@debbugs.gnu.org Date: Fri, 23 Apr 2021 15:01:02 +0000 Content-Type: multipart/mixed; boundary="----------=_1619190062-30000-1" This is a multi-part message in MIME format... ------------=_1619190062-30000-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #34016: Git checkouts managed by (guix git) grow indefinitely? which was filed against the guix package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 34016@debbugs.gnu.org. --=20 34016: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D34016 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1619190062-30000-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 34016-done) by debbugs.gnu.org; 23 Apr 2021 15:00:13 +0000 Received: from localhost ([127.0.0.1]:38490 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lZxHx-0007mj-IJ for submit@debbugs.gnu.org; Fri, 23 Apr 2021 11:00:13 -0400 Received: from eggs.gnu.org ([209.51.188.92]:47876) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lZxHu-0007lS-5v for 34016-done@debbugs.gnu.org; Fri, 23 Apr 2021 11:00:12 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:54267) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lZxHo-0005FM-4F; Fri, 23 Apr 2021 11:00:04 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=41864 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1lZxHl-0001CC-04; Fri, 23 Apr 2021 11:00:03 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Brendan Tildesley Subject: Re: Git checkouts managed by (guix git) grow indefinitely References: <124603819.14964.1619176291284@office.mailbox.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 4 =?utf-8?Q?Flor=C3=A9al?= an 229 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Fri, 23 Apr 2021 16:59:59 +0200 In-Reply-To: <124603819.14964.1619176291284@office.mailbox.org> (Brendan Tildesley's message of "Fri, 23 Apr 2021 13:11:31 +0200 (CEST)") Message-ID: <87mttpnj0w.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 34016-done Cc: "34016@debbugs.gnu.org" <34016-done@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi Brendan, Brendan Tildesley skribis: > Since this bug report 1.1.0 was released. The Changelog includes this not= e: > "Repositories with a large number of packfiles no longer exhaust the > number of file descriptors." > > https://github.com/libgit2/libgit2/pull/5396 > > May or may not be related to this. That may be the case because I=E2=80=99ve not experienced it in more than a= year. Closing! Thanks for the heads-up, Ludo=E2=80=99. ------------=_1619190062-30000-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 8 Jan 2019 16:57:27 +0000 Received: from localhost ([127.0.0.1]:50164 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ggugw-00072s-UC for submit@debbugs.gnu.org; Tue, 08 Jan 2019 11:57:27 -0500 Received: from eggs.gnu.org ([209.51.188.92]:50595) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ggugs-00072c-Ph for submit@debbugs.gnu.org; Tue, 08 Jan 2019 11:57:23 -0500 Received: from lists.gnu.org ([209.51.188.17]:33630) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ggugl-00079n-9u for submit@debbugs.gnu.org; Tue, 08 Jan 2019 11:57:15 -0500 Received: from eggs.gnu.org ([209.51.188.92]:60788) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ggugk-00011r-4Y for bug-guix@gnu.org; Tue, 08 Jan 2019 11:57:15 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-5.0 required=5.0 tests=BAYES_40,RCVD_IN_DNSWL_HI autolearn=disabled version=3.3.2 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ggugg-0006xb-0K for bug-guix@gnu.org; Tue, 08 Jan 2019 11:57:14 -0500 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:8251) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ggugf-0006pc-LP for bug-guix@gnu.org; Tue, 08 Jan 2019 11:57:09 -0500 X-IronPort-AV: E=Sophos;i="5.56,454,1539640800"; d="scan'208";a="291215753" Received: from unknown (HELO ribbon) ([193.50.110.193]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/AES256-GCM-SHA384; 08 Jan 2019 17:56:55 +0100 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Bug Guix Subject: Git checkouts managed by (guix git) grow indefinitely? X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 19 =?utf-8?Q?Niv=C3=B4se?= an 227 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 08 Jan 2019 17:56:55 +0100 Message-ID: <87h8ejw0iw.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 192.134.164.104 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: submit Cc: Erik Edrosa X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hello, On berlin I noticed that Cuirass would run out of file descriptors almost immediately once started. I managed to get the list of open files: --8<---------------cut here---------------start------------->8--- ludo@berlin ~$ sudo ls -l /proc/$(sudo herd status cuirass|grep value|sed -= es'/^.* \([0-9]\+\)\.$/\1/g')/fd [=E2=80=A6] alwq/.git/objects/pack/pack-dde01a576697a783fd12eb73228921153ba18b4b.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 978 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d65= f5c22414e4864a00ec7bee4cff5ff0b4a2c31.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 979 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d78= f9f47a68d4254a81d57d6183fe9c9be41752d.pack l-wx------ 1 cuirass cuirass 64 Jan 8 17:46 98 -> 'pipe:[70917334]' lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 980 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-58f= 83b77dbe392bba277f10a1bdd7ed469946feb.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 981 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d28= d075e1dd259683747b5723a232fa4d60cd1a9.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 982 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-cff= bdad6def559b60bd928173916f3edbb1a4a8f.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 983 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-ac4= 2d4dd95b02bb54d03687c984c67bacf0e1feb.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 984 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-e5e= 26a7aeb5a33889f6ac8cff8bef182b5b8a0b2.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 985 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-ac6= 6439d6b07a0e4cf2e4ccef3be21e8a1c96d55.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 986 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-f73= b60b056634b58f44fb65f20416e22a6c936e8.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 987 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-f8f= 3313f5ec872e43cb1e12a8b6509e7f0a13512.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 988 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-55e= 720e2a4ec09cc996599c5089be871eba8f829.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 989 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-d24= 41e647df889422906a30d06d6d195e522cbd1.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 99 -> 'pipe:[70908233]' lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 990 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-61f= ed4082491ff66716c92fe49fe499cd6a5fa78.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 991 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-0bc= efb4f7953471a0bc944f0f0c3bbe9143df22b.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 992 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-6a5= fbea2046bdc8c94926e9d3d516e1b5351b645.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 993 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-add= 66d8bdd96e4cc67e78a23c428f7b4e46974df.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 994 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-740= 728c75faa0e9179ad977d4e4b2eb6bfa51345.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 995 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-c78= 417a98abdc6a7396fb3f6e4d5633de20c819c.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 996 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-df4= cae77b58d600538f2dc51b7b31b61a92cab23.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 997 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-835= 59c192d41400596d42587bb50d409c121969d.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 998 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-1f4= 6268a2ba6bd3b97d9d7cea4e18233212cc75e.pack lr-x------ 1 cuirass cuirass 64 Jan 8 17:46 999 -> /var/cache/cuirass/pjmk= glp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq/.git/objects/pack/pack-55a= 94a468fa892b0128656fc5aa953c667161fcd.pack --8<---------------cut here---------------end--------------->8--- So it=E2=80=99s Guile-Git, called from =E2=80=98update-cached-checkout=E2= =80=99=C2=B9, that would open all these pack files, quickly running out of file descriptors. I wonder if we=E2=80=99re doing something wrong here or if we hit a limitation of libgit2. Ideas? In the meantime, the obvious workaround was to =E2=80=9Crm -rf /var/cache/cuirass/pjmkglp4t7znuugeurpurzikxq3tnlaywmisyr27shj7apsnalwq=E2= =80=9D. Thanks, Ludo=E2=80=99. =C2=B9 https://git.savannah.gnu.org/cgit/guix.git/tree/guix/git.scm#n122 ------------=_1619190062-30000-1--