From unknown Sat Aug 16 21:59:39 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#78194 <78194@debbugs.gnu.org> To: bug#78194 <78194@debbugs.gnu.org> Subject: Status: `guix pull --list-generations' is extremely slow Reply-To: bug#78194 <78194@debbugs.gnu.org> Date: Sun, 17 Aug 2025 04:59:39 +0000 retitle 78194 `guix pull --list-generations' is extremely slow reassign 78194 guix submitter 78194 Ian Eure severity 78194 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Thu May 01 11:35:47 2025 Received: (at submit) by debbugs.gnu.org; 1 May 2025 15:35:47 +0000 Received: from localhost ([127.0.0.1]:52378 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1uAVwx-0002iV-0w for submit@debbugs.gnu.org; Thu, 01 May 2025 11:35:47 -0400 Received: from lists.gnu.org ([2001:470:142::17]:51916) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1uAVwt-0002hw-Ii for submit@debbugs.gnu.org; Thu, 01 May 2025 11:35:45 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1uAVwk-00057R-FX for bug-guix@gnu.org; Thu, 01 May 2025 11:35:34 -0400 Received: from fout-b1-smtp.messagingengine.com ([202.12.124.144]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1uAVwh-0002FH-8U for bug-guix@gnu.org; Thu, 01 May 2025 11:35:34 -0400 Received: from phl-compute-11.internal (phl-compute-11.phl.internal [10.202.2.51]) by mailfout.stl.internal (Postfix) with ESMTP id 96E951140187 for ; Thu, 1 May 2025 11:35:27 -0400 (EDT) Received: from phl-mailfrontend-02 ([10.202.2.163]) by phl-compute-11.internal (MEProxy); Thu, 01 May 2025 11:35:27 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=retrospec.tv; h= cc:content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:message-id:mime-version:reply-to:subject :subject:to:to; s=fm2; t=1746113727; x=1746200127; bh=LIwsLlcjFA ycNreMIw6Ho3RDDr5yxRbUYGVDTL3nvrw=; b=JaQo06EEjrJxImaEkAJ7XHDY/I rvhn2XVGxnrflWUXB7zG8Bh4BvOMYsRboFdK1Gff3gWc6OHd5Qs/6/qS1MpcYiOW x+MDamKVMU55yNAdW19jdeRd+IXOpJC9tEO2ANXeMn9kYL2gLRUqY6OqWJWjc75X CiKtTbvXSo/blTvNMS2N3FKsYZFARomh0ZS0haL/8gVKp2TTCVwDCyaMXy55I5vU fDApKD45UrlettRPnpUR0yvppyRyBjSPhDefvc+MyqpaD4o9d4/Un4dgYj92W6Ax FkeiklY8NC/OPTMqI/G8ycQ8MfFbATIiFyEnvV9x5XGAJShQumuCLSvaVtcg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:message-id:mime-version:reply-to:subject:subject:to :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t= 1746113727; x=1746200127; bh=LIwsLlcjFAycNreMIw6Ho3RDDr5yxRbUYGV DTL3nvrw=; b=Kj3cSYtL8VQVjJqi7WTB3xX1NMQcCzepwOJvVSqnvLVkdjRvqjx dCvfuLcFOhZ6JVYTh6v52hMQrJzd7CgQu0Hz+GsTvKMbGrShA2a0TDeV45Udb1WN 3frKgN/Z3J9ue9/ApjkmLeviKYqz7u/+UnnrxMvcjZMdrYew5RnoeGQku+fXBx+m rRn582eBEZ81dHdiVTJstM4MpQk5Rn4r397dtYdl4rkIfwP4zJZinFT5jdqWKqTT pzfvRNUhCJWuK9aFtK1wm5E/4pfJ5Z/XOq5BSy5CGFfwA/I4vOu+6jL0URRob6uD 6hiWvC12BQv48O4jNPj8CF/Tw1Wgf2Eibkg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgddvieelleegucetufdoteggodetrf dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefhvf fufgffkfggtgfgsehtqhertddtreejnecuhfhrohhmpefkrghnucfguhhrvgcuoehirghn sehrvghtrhhoshhpvggtrdhtvheqnecuggftrfgrthhtvghrnhepieeffeekkeegtedutd eiteegudefgedtieevueeftdeggefgjeeludevjeevvdejnecuvehluhhsthgvrhfuihii vgeptdenucfrrghrrghmpehmrghilhhfrhhomhepihgrnhesrhgvthhrohhsphgvtgdrth hvpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgtphhtthhopegs uhhgqdhguhhigiesghhnuhdrohhrgh X-ME-Proxy: Feedback-ID: id9014242:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 1 May 2025 11:35:26 -0400 (EDT) From: Ian Eure To: bug-guix@gnu.org Subject: `guix pull --list-generations' is extremely slow User-Agent: mu4e 1.12.9; emacs 29.4 Date: Thu, 01 May 2025 08:35:21 -0700 Message-ID: <87msbw4a4m.fsf@retrospec.tv> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=202.12.124.144; envelope-from=ian@retrospec.tv; helo=fout-b1-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.3 (/) I=E2=80=99ve been frustrated by this before, but decided to measure=20 things: `guix home list-generations' takes 3.535s to list 28 items. `guix system list-generations' takes 1.406s to list 35 items. `guix pull --list-generations' takes 232.599s to list 41 items. Why is `guix pull --list-generations' >100x slower than `guix=20 system list-generations'? Thanks, -- Ian From debbugs-submit-bounces@debbugs.gnu.org Wed May 14 13:04:11 2025 Received: (at 78194) by debbugs.gnu.org; 14 May 2025 17:04:11 +0000 Received: from localhost ([127.0.0.1]:44771 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1uFFWc-0004oe-Sn for submit@debbugs.gnu.org; Wed, 14 May 2025 13:04:11 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:47836) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1uFFWY-0004mc-C4 for 78194@debbugs.gnu.org; Wed, 14 May 2025 13:04:07 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id B9F20E4C; Wed, 14 May 2025 19:03:57 +0200 (CEST) X-Virus-Scanned: Debian amavis at hera.aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavis, port 10024) with ESMTP id 5mJSX86gdgVn; Wed, 14 May 2025 19:03:57 +0200 (CEST) Received: from ribbon (91-160-117-201.subs.proxad.net [91.160.117.201]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 0A88EE49; Wed, 14 May 2025 19:03:57 +0200 (CEST) From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Ian Eure Subject: Re: bug#78194: `guix pull --list-generations' is extremely slow In-Reply-To: <87msbw4a4m.fsf@retrospec.tv> (Ian Eure's message of "Thu, 01 May 2025 08:35:21 -0700") References: <87msbw4a4m.fsf@retrospec.tv> Date: Wed, 14 May 2025 18:33:35 +0200 Message-ID: <87h61nywww.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 78194 Cc: 78194@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.3 (/) Hi, Ian Eure writes: > I=E2=80=99ve been frustrated by this before, but decided to measure thing= s: > > `guix home list-generations' takes 3.535s to list 28 items. > `guix system list-generations' takes 1.406s to list 35 items. > `guix pull --list-generations' takes 232.599s to list 41 items. > > Why is `guix pull --list-generations' >100x slower than `guix system > list-generations'? Because for each pair of generations, it shows the corresponding news entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is quite= expensive because it involves a Git log traversal. I think we should (1) optimize the news code (that=E2=80=99s =E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not e= nough consider keeping it off by default in =E2=80=98guix pull --list-generations=E2=80=99. Thoughts? Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Wed May 14 17:51:05 2025 Received: (at 78194) by debbugs.gnu.org; 14 May 2025 21:51:05 +0000 Received: from localhost ([127.0.0.1]:46783 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1uFK0H-0005jc-Iv for submit@debbugs.gnu.org; Wed, 14 May 2025 17:51:05 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:47068) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1uFK0C-0005hu-V2 for 78194@debbugs.gnu.org; Wed, 14 May 2025 17:51:01 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1uFK07-0007vw-4V; Wed, 14 May 2025 17:50:55 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#78194: `guix pull --list-generations' is extremely slow In-Reply-To: <87h61nywww.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Wed, 14 May 2025 18:33:35 +0200") References: <87msbw4a4m.fsf@retrospec.tv> <87h61nywww.fsf@gnu.org> Date: Wed, 14 May 2025 22:28:37 +0200 Message-ID: <877c2jym16.fsf@chbouib.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 78194 Cc: 78194@debbugs.gnu.org, Ian Eure X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Ludovic Court=C3=A8s writes: > Because for each pair of generations, it shows the corresponding news > entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is qui= te expensive > because it involves a Git log traversal. > > I think we should (1) optimize the news code (that=E2=80=99s > =E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not= enough consider > keeping it off by default in =E2=80=98guix pull --list-generations=E2=80= =99. That turned out to be easier than I thought, see , which makes it 10=E2=80=9320x faster. Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Sun Jun 15 04:49:49 2025 Received: (at 78194-done) by debbugs.gnu.org; 15 Jun 2025 08:49:49 +0000 Received: from localhost ([127.0.0.1]:54156 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1uQj3l-0007Lr-0w for submit@debbugs.gnu.org; Sun, 15 Jun 2025 04:49:49 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:37290) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1uQj3j-0007LG-6B for 78194-done@debbugs.gnu.org; Sun, 15 Jun 2025 04:49:47 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 593AE1EB; Sun, 15 Jun 2025 10:49:41 +0200 (CEST) Authentication-Results: hera.aquilenet.fr; none X-Virus-Scanned: Debian amavis at hera.aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavis, port 10024) with ESMTP id bcNDKQWEMOzi; Sun, 15 Jun 2025 10:49:40 +0200 (CEST) Received: from jurong (176-179-191-150.abo.bbox.fr [176.179.191.150]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 7AA99112; Sun, 15 Jun 2025 10:49:40 +0200 (CEST) Date: Sun, 15 Jun 2025 10:49:39 +0200 From: Andreas Enge To: 78194-done@debbugs.gnu.org Subject: Close Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Server: hera X-Rspamd-Queue-Id: 593AE1EB X-Spamd-Result: default: False [-5.58 / 15.00]; NEURAL_HAM(-3.00)[-1.000]; BAYES_HAM(-2.98)[99.91%]; MID_RHS_NOT_FQDN(0.50)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Action: no action X-Spamd-Bar: ----- X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 78194-done X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) This has apparently been solved, see the last message; closing. Andreas From unknown Sat Aug 16 21:59:39 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Sun, 13 Jul 2025 11:24:20 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator