From unknown Thu Sep 11 05:10:27 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#32600 <32600@debbugs.gnu.org> To: bug#32600 <32600@debbugs.gnu.org> Subject: Status: =?UTF-8?Q?=E2=80=98guix?= system =?UTF-8?Q?vm-image=E2=80=99?= spends a very long time =?UTF-8?Q?=E2=80=9Cregistering_?= =?UTF-8?Q?closures=E2=80=9D?= Reply-To: bug#32600 <32600@debbugs.gnu.org> Date: Thu, 11 Sep 2025 12:10:27 +0000 retitle 32600 =E2=80=98guix system vm-image=E2=80=99 spends a very long tim= e =E2=80=9Cregistering closures=E2=80=9D reassign 32600 guix submitter 32600 ludo@gnu.org (Ludovic Court=C3=A8s) severity 32600 important thanks From debbugs-submit-bounces@debbugs.gnu.org Fri Aug 31 06:07:38 2018 Received: (at submit) by debbugs.gnu.org; 31 Aug 2018 10:07:38 +0000 Received: from localhost ([127.0.0.1]:39779 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fvgL4-0002kq-Gc for submit@debbugs.gnu.org; Fri, 31 Aug 2018 06:07:38 -0400 Received: from eggs.gnu.org ([208.118.235.92]:46449) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fvgL3-0002ke-5K for submit@debbugs.gnu.org; Fri, 31 Aug 2018 06:07:37 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fvgKw-0005He-98 for submit@debbugs.gnu.org; Fri, 31 Aug 2018 06:07:31 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:46352) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1fvgKv-0005HL-Gm for submit@debbugs.gnu.org; Fri, 31 Aug 2018 06:07:30 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:39191) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fvgKu-0002eh-KN for bug-guix@gnu.org; Fri, 31 Aug 2018 06:07:29 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fvgKt-0005Gg-Ue for bug-guix@gnu.org; Fri, 31 Aug 2018 06:07:28 -0400 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:47249) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fvgKm-0005AX-SW; Fri, 31 Aug 2018 06:07:20 -0400 Received: from [193.50.110.186] (port=46682 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1fvgKm-0004lb-JZ; Fri, 31 Aug 2018 06:07:20 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: bug-guix@gnu.org Subject: =?utf-8?Q?=E2=80=98guix?= system =?utf-8?Q?vm-image=E2=80=99?= spends a very long time =?utf-8?Q?=E2=80=9Cregistering_closures=E2=80=9D?= X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 14 Fructidor an 226 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Fri, 31 Aug 2018 12:07:19 +0200 Message-ID: <87wos6q27c.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit Cc: Leo Famulari X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.0 (------) Hi, A couple of days ago, Leo reported that =E2=80=98guix system vm-image=E2=80= =99 spends a very long time in the =E2=80=9Cregistering closures=E2=80=9D phase: --8<---------------cut here---------------start------------->8--- I wonder about the slowness of 'registering closures' with `guix sys= tem vm-image` and similiar commands. I don't remember this taking so long in the past [22:52] [...] Created a bare-bones VM takes ~90 minutes for me recently s/Created/Creating with vm-image? Yes [...] With #:reset-timestamps #f, I cancelled the task after 10 minutes of 'registering closures' [23:33] [...] lfam: i added some pk's and it seems that it's deduplucation that= 's killing us [00:41] because it involves retraversing each store item and reading each file [00:42] It does it for each file? Or, you could just point me to the relevant code so I can learn it :) yeah, it has to read them to be able to determine if there are duplicates (guix store database) calls the deduplication code [00:43] which is in (guix store deduplication) (reepca's code from last year's GSoC) maybe c45477d2a1a651485feede20fe0f3d15aec48b39 or something close inadvertently turned on deduplication [00:44] so in (gnu system vm), we could pass #:deduplicate? #f to 'root-partition-initializer' --8<---------------cut here---------------end--------------->8--- Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Sun Sep 02 09:51:52 2018 Received: (at control) by debbugs.gnu.org; 2 Sep 2018 13:51:52 +0000 Received: from localhost ([127.0.0.1]:42455 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fwSmv-0005An-OV for submit@debbugs.gnu.org; Sun, 02 Sep 2018 09:51:52 -0400 Received: from eggs.gnu.org ([208.118.235.92]:39804) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fwSmZ-00059O-NJ for control@debbugs.gnu.org; Sun, 02 Sep 2018 09:51:31 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fwSm2-0008KK-3N for control@debbugs.gnu.org; Sun, 02 Sep 2018 09:50:51 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:51621) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fwSm2-0008JE-0g for control@debbugs.gnu.org; Sun, 02 Sep 2018 09:50:42 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=40402 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1fwSlu-0007R1-9M for control@debbugs.gnu.org; Sun, 02 Sep 2018 09:50:34 -0400 Date: Sun, 02 Sep 2018 15:49:18 +0200 Message-Id: <878t4kau1t.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #32600 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) severity 32600 important From debbugs-submit-bounces@debbugs.gnu.org Sun Sep 23 17:38:14 2018 Received: (at 32600-done) by debbugs.gnu.org; 23 Sep 2018 21:38:14 +0000 Received: from localhost ([127.0.0.1]:51171 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1g4C50-0000Tx-JX for submit@debbugs.gnu.org; Sun, 23 Sep 2018 17:38:14 -0400 Received: from eggs.gnu.org ([208.118.235.92]:36766) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1g4C4z-0000Tj-Gt for 32600-done@debbugs.gnu.org; Sun, 23 Sep 2018 17:38:13 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1g4C4t-0007Ea-36 for 32600-done@debbugs.gnu.org; Sun, 23 Sep 2018 17:38:07 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:49741) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1g4C4q-0007Ck-ID; Sun, 23 Sep 2018 17:38:04 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=42160 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1g4C4q-0002mx-9u; Sun, 23 Sep 2018 17:38:04 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: 32600-done@debbugs.gnu.org Subject: Re: bug#32600: =?utf-8?Q?=E2=80=98guix?= system =?utf-8?Q?vm-imag?= =?utf-8?Q?e=E2=80=99?= spends a very long time =?utf-8?Q?=E2=80=9Cregiste?= =?utf-8?Q?ring_closures=E2=80=9D?= References: <87wos6q27c.fsf@gnu.org> Date: Sun, 23 Sep 2018 23:38:03 +0200 In-Reply-To: <87wos6q27c.fsf@gnu.org> ("Ludovic \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\= \=\?utf-8\?Q\?s\?\= message of "Fri, 31 Aug 2018 12:07:19 +0200") Message-ID: <87mus7rj2c.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 32600-done Cc: Leo Famulari X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.0 (------) Hello, ludo@gnu.org (Ludovic Court=C3=A8s) skribis: > A couple of days ago, Leo reported that =E2=80=98guix system vm-image=E2= =80=99 spends a > very long time in the =E2=80=9Cregistering closures=E2=80=9D phase: > Created a bare-bones VM takes ~90 minutes for me recently As of commit fce225471128c4a5246342b3aa1b7e53a8066211, =E2=80=98guix system vm-image bare-bones.tmpl=E2=80=99 runs in ~2m42s on my SSD-based laptop. T= he key commits here are fce225471128c4a5246342b3aa1b7e53a8066211 and bb3b6ccb05550fbfbeb459c68819a752327d6e1e. Regarding deduplication (commit b5460d95e970608bee7a794590be1b051b57d3a3), I found that it doesn=E2=80=99t change the image size of bare-bones.tmpl (1.2G), but enabling it makes things slower, ~6m. Lemme know how it goes for you! Thanks, Ludo=E2=80=99. From unknown Thu Sep 11 05:10:27 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Mon, 22 Oct 2018 11:24:03 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator