From unknown Sun Jun 22 08:01:16 2025 X-Loop: help-debbugs@gnu.org Subject: bug#36509: guix pull: too many substitute updates, or bad log messages Resent-From: Robert Vollmert Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 05 Jul 2019 11:21:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 36509 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 36509@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.15623256528590 (code B ref -1); Fri, 05 Jul 2019 11:21:01 +0000 Received: (at submit) by debbugs.gnu.org; 5 Jul 2019 11:20:52 +0000 Received: from localhost ([127.0.0.1]:52418 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hjMGq-0002ET-80 for submit@debbugs.gnu.org; Fri, 05 Jul 2019 07:20:52 -0400 Received: from lists.gnu.org ([209.51.188.17]:38223) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hjMGo-0002EN-Oy for submit@debbugs.gnu.org; Fri, 05 Jul 2019 07:20:51 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:37616) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hjMGn-0001c7-8o for bug-guix@gnu.org; Fri, 05 Jul 2019 07:20:50 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,URIBL_BLOCKED autolearn=disabled version=3.3.2 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hjMGk-0005DS-S2 for bug-guix@gnu.org; Fri, 05 Jul 2019 07:20:48 -0400 Received: from mx2a.mailbox.org ([2001:67c:2050:104:0:2:25:2]:17734 helo=mx2.mailbox.org) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1hjMGj-0004C8-Tx for bug-guix@gnu.org; Fri, 05 Jul 2019 07:20:46 -0400 Received: from smtp1.mailbox.org (smtp1.mailbox.org [IPv6:2001:67c:2050:105:465:1:1:0]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (No client certificate requested) by mx2.mailbox.org (Postfix) with ESMTPS id 1FD10A1102 for ; Fri, 5 Jul 2019 13:20:30 +0200 (CEST) X-Virus-Scanned: amavisd-new at heinlein-support.de Received: from smtp1.mailbox.org ([80.241.60.240]) by spamfilter05.heinlein-hosting.de (spamfilter05.heinlein-hosting.de [80.241.56.123]) (amavisd-new, port 10030) with ESMTP id q-eTmYhKsLZ7 for ; Fri, 5 Jul 2019 13:20:19 +0200 (CEST) From: Robert Vollmert Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Message-Id: <4FC8E550-8025-47A4-8451-3D6B9392DEED@vllmrt.net> Date: Fri, 5 Jul 2019 13:20:17 +0200 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2001:67c:2050:104:0:2:25:2 X-Spam-Score: -1.6 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.6 (--) When running `guix pull`, output like the following is common for me: $ guix pull Updating channel 'puzzlink' from Git repository at = '/home/rob/guix-puzzlink'=E2=80=A6 [=E2=80=A6] Building from these channels: guix https://github.com/robx/guix.git 11f68b3 [=E2=80=A6] Computing Guix derivation for 'x86_64-linux'... | The following derivations will be built: /gnu/store/ym0l8rvnh3aa3qv8g3xgh1mszbhww8c2-elm.drv [=E2=80=A6] /gnu/store/dcxwfh37bn8r3h8s9w7wfq8yhzynqxx5-profile.drv The following profile hooks will be built: /gnu/store/biw1n2a956skpaa4m7rmka6j8h1clhmv-guix-package-cache.drv [=E2=80=A6] /gnu/store/kxrkynck33ypwyy09ypi2qm7737fsw28-fonts-dir.drv substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% building /gnu/store/wxfi8mdp11l5k4ngkbsy9apcg9h74jfk-guix-system.drv=E2=80= =A6 Either guix is making useless extra downloads or: (a) the substitute log message should be changed to differentiate = between the different calls (b) there should be extra log messages before the substitute messages to indicate what guix is doing that causes the individual substitue = messages. From unknown Sun Jun 22 08:01:16 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: Robert Vollmert Subject: bug#36509: closed (Re: bug#36509: guix pull: too many substitute updates, or bad log messages) Message-ID: References: <875zo06zrm.fsf@gnu.org> <4FC8E550-8025-47A4-8451-3D6B9392DEED@vllmrt.net> X-Gnu-PR-Message: they-closed 36509 X-Gnu-PR-Package: guix Reply-To: 36509@debbugs.gnu.org Date: Wed, 17 Jul 2019 22:52:03 +0000 Content-Type: multipart/mixed; boundary="----------=_1563403923-8378-1" This is a multi-part message in MIME format... ------------=_1563403923-8378-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #36509: guix pull: too many substitute updates, or bad log messages which was filed against the guix package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 36509@debbugs.gnu.org. --=20 36509: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D36509 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1563403923-8378-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 36509-done) by debbugs.gnu.org; 17 Jul 2019 22:51:36 +0000 Received: from localhost ([127.0.0.1]:53143 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hnsls-0002AX-DJ for submit@debbugs.gnu.org; Wed, 17 Jul 2019 18:51:36 -0400 Received: from eggs.gnu.org ([209.51.188.92]:57558) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hnslq-0002AL-M9 for 36509-done@debbugs.gnu.org; Wed, 17 Jul 2019 18:51:35 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:39046) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1hnslk-0003va-7m; Wed, 17 Jul 2019 18:51:28 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=35672 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1hnslj-0005nM-Hp; Wed, 17 Jul 2019 18:51:28 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Robert Vollmert Subject: Re: bug#36509: guix pull: too many substitute updates, or bad log messages References: <4FC8E550-8025-47A4-8451-3D6B9392DEED@vllmrt.net> Date: Thu, 18 Jul 2019 00:51:25 +0200 In-Reply-To: <4FC8E550-8025-47A4-8451-3D6B9392DEED@vllmrt.net> (Robert Vollmert's message of "Fri, 5 Jul 2019 13:20:17 +0200") Message-ID: <875zo06zrm.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 36509-done Cc: 36509-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, Robert Vollmert skribis: > When running `guix pull`, output like the following is common > for me: > > $ guix pull > Updating channel 'puzzlink' from Git repository at '/home/rob/guix-puzzli= nk'=E2=80=A6 > [=E2=80=A6] > Building from these channels: > guix https://github.com/robx/guix.git 11f68b3 > [=E2=80=A6] > Computing Guix derivation for 'x86_64-linux'... | > The following derivations will be built: > /gnu/store/ym0l8rvnh3aa3qv8g3xgh1mszbhww8c2-elm.drv > [=E2=80=A6] > /gnu/store/dcxwfh37bn8r3h8s9w7wfq8yhzynqxx5-profile.drv > The following profile hooks will be built: > /gnu/store/biw1n2a956skpaa4m7rmka6j8h1clhmv-guix-package-cache.drv > [=E2=80=A6] > /gnu/store/kxrkynck33ypwyy09ypi2qm7737fsw28-fonts-dir.drv > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > building /gnu/store/wxfi8mdp11l5k4ngkbsy9apcg9h74jfk-guix-system.drv=E2= =80=A6 I believe this is fixed by 9b9b753529db1c7a8c4628cc255e358703c15618. The story here is that we were calling =E2=80=98show-what-to-build=E2=80=99= with #:use-substitutes #f. Thus, Guix would not try to see which substitutes are available (and it=E2=80=99d report that everything must be built.) But right after that, we=E2=80=99d build the profile with substitutes enabl= ed, and at that point it would have to fetch substitute info (=E2=80=9Cnarinfos= =E2=80=9D) for each of these, more or less one at a time (because =E2=80=98guix substi= tute --substitute=E2=80=99 is called once for each store item.) IOW, =E2=80=98show-what-to-build=E2=80=99 warms the substitute info cache a= s a side-effect, and that cache warm-up was not happening here. Thanks, Ludo=E2=80=99. ------------=_1563403923-8378-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 5 Jul 2019 11:20:52 +0000 Received: from localhost ([127.0.0.1]:52418 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hjMGq-0002ET-80 for submit@debbugs.gnu.org; Fri, 05 Jul 2019 07:20:52 -0400 Received: from lists.gnu.org ([209.51.188.17]:38223) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hjMGo-0002EN-Oy for submit@debbugs.gnu.org; Fri, 05 Jul 2019 07:20:51 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:37616) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hjMGn-0001c7-8o for bug-guix@gnu.org; Fri, 05 Jul 2019 07:20:50 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,URIBL_BLOCKED autolearn=disabled version=3.3.2 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hjMGk-0005DS-S2 for bug-guix@gnu.org; Fri, 05 Jul 2019 07:20:48 -0400 Received: from mx2a.mailbox.org ([2001:67c:2050:104:0:2:25:2]:17734 helo=mx2.mailbox.org) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1hjMGj-0004C8-Tx for bug-guix@gnu.org; Fri, 05 Jul 2019 07:20:46 -0400 Received: from smtp1.mailbox.org (smtp1.mailbox.org [IPv6:2001:67c:2050:105:465:1:1:0]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (No client certificate requested) by mx2.mailbox.org (Postfix) with ESMTPS id 1FD10A1102 for ; Fri, 5 Jul 2019 13:20:30 +0200 (CEST) X-Virus-Scanned: amavisd-new at heinlein-support.de Received: from smtp1.mailbox.org ([80.241.60.240]) by spamfilter05.heinlein-hosting.de (spamfilter05.heinlein-hosting.de [80.241.56.123]) (amavisd-new, port 10030) with ESMTP id q-eTmYhKsLZ7 for ; Fri, 5 Jul 2019 13:20:19 +0200 (CEST) From: Robert Vollmert Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: guix pull: too many substitute updates, or bad log messages Message-Id: <4FC8E550-8025-47A4-8451-3D6B9392DEED@vllmrt.net> Date: Fri, 5 Jul 2019 13:20:17 +0200 To: bug-guix@gnu.org X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2001:67c:2050:104:0:2:25:2 X-Spam-Score: -1.6 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.6 (--) When running `guix pull`, output like the following is common for me: $ guix pull Updating channel 'puzzlink' from Git repository at = '/home/rob/guix-puzzlink'=E2=80=A6 [=E2=80=A6] Building from these channels: guix https://github.com/robx/guix.git 11f68b3 [=E2=80=A6] Computing Guix derivation for 'x86_64-linux'... | The following derivations will be built: /gnu/store/ym0l8rvnh3aa3qv8g3xgh1mszbhww8c2-elm.drv [=E2=80=A6] /gnu/store/dcxwfh37bn8r3h8s9w7wfq8yhzynqxx5-profile.drv The following profile hooks will be built: /gnu/store/biw1n2a956skpaa4m7rmka6j8h1clhmv-guix-package-cache.drv [=E2=80=A6] /gnu/store/kxrkynck33ypwyy09ypi2qm7737fsw28-fonts-dir.drv substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% building /gnu/store/wxfi8mdp11l5k4ngkbsy9apcg9h74jfk-guix-system.drv=E2=80= =A6 Either guix is making useless extra downloads or: (a) the substitute log message should be changed to differentiate = between the different calls (b) there should be extra log messages before the substitute messages to indicate what guix is doing that causes the individual substitue = messages. ------------=_1563403923-8378-1--