From debbugs-submit-bounces@debbugs.gnu.org Tue Mar 02 11:32:49 2021 Received: (at submit) by debbugs.gnu.org; 2 Mar 2021 16:32:49 +0000 Received: from localhost ([127.0.0.1]:54073 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lH7x3-00059W-5J for submit@debbugs.gnu.org; Tue, 02 Mar 2021 11:32:49 -0500 Received: from lists.gnu.org ([209.51.188.17]:49774) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lH7x1-00059O-0i for submit@debbugs.gnu.org; Tue, 02 Mar 2021 11:32:48 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:37696) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lH7x0-0006fR-K5 for bug-guix@gnu.org; Tue, 02 Mar 2021 11:32:46 -0500 Received: from tobias.gr ([2a02:c205:2020:6054::1]:41640) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lH7wy-00026s-32 for bug-guix@gnu.org; Tue, 02 Mar 2021 11:32:46 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tobias.gr; s=2018; bh=8WZJ59UO56m6A2gAm3lPOlTLbuu1sJr29FC/oKpEjJY=; h=date:subject:to: from; b=W1lsl3nCpamThWjA4V1YRyYKOHiJD/EeYInA65LAbQXqjCRdWtxrYs9Ql9zZbV JLWGFV1EAPL1FHvBEDvtaYohVe4BcSuDQ1bsYWibD8BIxT8AkKtmyo6wFkL3LSWI8TZEK+ Gl22WPXuj4quQUL5syeg/e47DJ4+IVnzEMVKnrNRFZquK3B1K6+Iunpg6ghASLAhlKPZQv BhNpeIFCYPOlkHLR3j9gyYKYA4lAy+Z2slKn+cfAgdr+B4MfixeyunBBeRW2FVqce5ycB4 fIABt9gSMqvHNY9tK1NPjULALTHTeU/VHjYiETdkoNnbPifPO8YgLLBnjPz5VsB1TV8pNQ == Received: by submission.tobias.gr (OpenSMTPD) with ESMTPSA id cfe447eb (TLSv1.2:ECDHE-ECDSA-AES256-GCM-SHA384:256:NO) for ; Tue, 2 Mar 2021 16:33:33 +0000 (UTC) BIMI-Selector: v=BIMI1; s=default; From: Tobias Geerinckx-Rice To: bug-guix@gnu.org Subject: Guix assumes ideal network exists, does not Date: Tue, 02 Mar 2021 17:32:50 +0100 Message-ID: <87eegxms7h.fsf@nckx> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=2a02:c205:2020:6054::1; envelope-from=me@tobias.gr; helo=tobias.gr X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.4 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.4 (--) --=-=-= Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Guixfriends, Errors like the one below are omnipresent. It's a problem. Expecting an ever-increasing (16k+?) number of requests to finish=20 flawlessly or aborting a very long (20+ minutes here) process is=20 doomed. We don't seem to have a plan forward (I include myself!). Looking=20 at other package managers, a blunt =E2=80=98retry a finite number of=20 times=E2=80=99 seems common. Guix's =E2=80=98pretend that "transient" is a= magic=20 powerword=E2=80=99 approach less so. What do people think? Does the heavy pipelining complicate=20 matters? =2D-8<---------------cut here---------------start------------->8--- ~ $ guix weather --substitute-urls=3Dhttps://guix.tobias.gr computing 16,745 package derivations for x86_64-linux... looking for 18,127 store items on https://guix.tobias.gr... updating substitutes from 'https://guix.tobias.gr'...=20 41.6%Backtrace: 11 (primitive-load=20 "/home/nckx/.config/guix/current/bin/guix") In guix/ui.scm: 2164:12 10 (run-guix-command _ . _) In ice-9/boot-9.scm: 1736:10 9 (with-exception-handler _ _ #:unwind? _=20 #:unwind-for-type _) 1731:15 8 (with-exception-handler # _ #:unwind? _ =E2=80=A6) In guix/scripts/weather.scm: 546:9 7 (_) In guix/build/utils.scm: 569:23 6 (every* # _) In guix/scripts/weather.scm: 547:19 5 (_ "https://guix.tobias.gr") 116:17 4 (report-server-coverage _ _ #:display-missing? _) In unknown file: 3 (_ # #=20 . #w()) In guix/scripts/substitute.scm: 411:23 2 (lookup-narinfos _ _ #:open-connection _) 371:26 1 (fetch-narinfos _ _ #:open-connection _) In ice-9/boot-9.scm: 1669:16 0 (raise-exception _ #:continuable? _) ice-9/boot-9.scm:1669:16: In procedure raise-exception: Throw to key `gnutls-error' with args `(# read_from_session_record_port)'. =2D-8<---------------cut here---------------end--------------->8--- Kind regards, T G-R --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iIMEARYKACsWIQT12iAyS4c9C3o4dnINsP+IT1VteQUCYD5osg0cbWVAdG9iaWFz LmdyAAoJEA2w/4hPVW15JcsA/jJ+ct5hDD+9ORqA0GwsvGNyspvrdqP+RpNWXrdf afuoAQCIvpujM9vA26Stvfu/VxN3MVCM6Z/gAYIaBT61qTaqDQ== =9dJQ -----END PGP SIGNATURE----- --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Tue Mar 02 14:55:13 2021 Received: (at submit) by debbugs.gnu.org; 2 Mar 2021 19:55:13 +0000 Received: from localhost ([127.0.0.1]:54285 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHB6v-0003ai-5A for submit@debbugs.gnu.org; Tue, 02 Mar 2021 14:55:13 -0500 Received: from lists.gnu.org ([209.51.188.17]:43002) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHB6s-0003aY-9a for submit@debbugs.gnu.org; Tue, 02 Mar 2021 14:55:12 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:34284) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lHB6r-0007E7-UT for bug-guix@gnu.org; Tue, 02 Mar 2021 14:55:09 -0500 Received: from wout5-smtp.messagingengine.com ([64.147.123.21]:54873) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lHB6q-0000B1-1V for bug-guix@gnu.org; Tue, 02 Mar 2021 14:55:09 -0500 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.west.internal (Postfix) with ESMTP id E1DB316CF; Tue, 2 Mar 2021 14:55:05 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Tue, 02 Mar 2021 14:55:06 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-transfer-encoding:in-reply-to; s=mesmtp; bh=ShRZXfnP1vzGgTioQlQ2RTEB1/8FpSDR/dOl4zWI7Bg=; b=PoQKz46pm1pl P4MroDQ8WfoCJGSnYLVgAZyM8uACzvzWQtkxJmKp21wV9gLMnwk/YzqQBDVDNSk4 zNqEA/9q+tebPkuNhbnw3YF5zt7/j9Fui8BlhAC6uzDiU1armrCcVs0ZTTaFmvRO V4D13gYLtBmFdWWxMHtTb60d1pgJKsw= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; bh=ShRZXfnP1vzGgTioQlQ2RTEB1/8FpSDR/dOl4zWI7 Bg=; b=JvmiiJfAhHs9I2o78IWLgqBi06xb1htaTTItNqaEy6vFzPPFPzOeHtWSE nLz0HiyegyyYiFy9CsglDXc+sbPcyPK+2pOkWTyfUicopqQly9Lsu6RLmmEMXI5V 5AojP2BRGvSSeB9tyBpGD4OgCdTRA5qYqmGOp/dkB0QPDMHU4RhlJmfj4M7vQC/5 Elzd2ipFwJrQ1bwJ8JmA8AGZliTY7iT4kvjk6iAJ9hmBtO4By99wmTazdt29PbCo i209+RBBnuoLAGnfodc4nn4WlivCcC8Ocau42FCf9H/0YfxP8xB0WV6KLNb8ktFp vOiEAYHuSD+G4XZJ/0VvNjtBd0LGA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledruddttddguddvgecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpeffhffvuffkfhggtggugfgjsehtqhertddttdejnecuhfhrohhmpefnvgho ucfhrghmuhhlrghrihcuoehlvghosehfrghmuhhlrghrihdrnhgrmhgvqeenucggtffrrg htthgvrhhnpeejleevjefhkeelhffgtdfgfeegtefhgfehhefgffdtteffueeghedtieej leeigeenucffohhmrghinhepthhosghirghsrdhgrhenucfkphepuddttddruddurdduie elrdduudeknecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mheplhgvohesfhgrmhhulhgrrhhirdhnrghmvg X-ME-Proxy: Received: from localhost (pool-100-11-169-118.phlapa.fios.verizon.net [100.11.169.118]) by mail.messagingengine.com (Postfix) with ESMTPA id 07828240054; Tue, 2 Mar 2021 14:55:05 -0500 (EST) Date: Tue, 2 Mar 2021 14:55:02 -0500 From: Leo Famulari To: Tobias Geerinckx-Rice via Bug reports for GNU Guix Subject: Re: bug#46877: Guix assumes ideal network exists, does not Message-ID: References: <87eegxms7h.fsf@nckx> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: <87eegxms7h.fsf@nckx> Received-SPF: pass client-ip=64.147.123.21; envelope-from=leo@famulari.name; helo=wout5-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.4 (-) X-Debbugs-Envelope-To: submit Cc: 46877@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.4 (--) On Tue, Mar 02, 2021 at 05:32:50PM +0100, Tobias Geerinckx-Rice via Bug rep= orts for GNU Guix wrote: > Guixfriends, >=20 > Errors like the one below are omnipresent. It's a problem. >=20 > Expecting an ever-increasing (16k+?) number of requests to finish flawles= sly > or aborting a very long (20+ minutes here) process is doomed. >=20 > We don't seem to have a plan forward (I include myself!). Looking at oth= er > package managers, a blunt =E2=80=98retry a finite number of times=E2=80= =99 seems common. > Guix's =E2=80=98pretend that "transient" is a magic powerword=E2=80=99 ap= proach less so. >=20 > What do people think? Does the heavy pipelining complicate matters? >=20 > --8<---------------cut here---------------start------------->8--- > ~ $ guix weather --substitute-urls=3Dhttps://guix.tobias.gr I sometimes see similar failures with `guix weather`. To clarify, do you also see them when substituting? Or just when checking for substitutes? From debbugs-submit-bounces@debbugs.gnu.org Tue Mar 02 15:01:15 2021 Received: (at 46877) by debbugs.gnu.org; 2 Mar 2021 20:01:15 +0000 Received: from localhost ([127.0.0.1]:54292 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHBCl-0003lq-6K for submit@debbugs.gnu.org; Tue, 02 Mar 2021 15:01:15 -0500 Received: from mail-qk1-f181.google.com ([209.85.222.181]:40740) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHBCk-0003lb-2h for 46877@debbugs.gnu.org; Tue, 02 Mar 2021 15:01:14 -0500 Received: by mail-qk1-f181.google.com with SMTP id l132so20389147qke.7 for <46877@debbugs.gnu.org>; Tue, 02 Mar 2021 12:01:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=PPaP5eFHLCmRif1hviV9BH44yG2FgsmSRFGcS5H0Hm4=; b=poGjhGsf0iJx8FNJjiN6i6uMgTEBVXHlD48Ebd4rO3UfVWb19CquHanmbGb1p/gX40 jbkivgp+9p8cug5FfTTC3WscdDvEcCCHfUhpFN/UkA5e4uwze8aIQdg6frZp1YHHbtNK ytcut0Wcywzdv1Fmrhba2slZDlcsaJOP+IgFFTVc4r3La4B7aX/7saczdWDNIt/KTMBf glYk0Tr6P7+o/zi6KsItARFEcynSbN0JC6v5aGfr59K/gDJg3sECmb9NZzFClCsHL5/l P8jpA7/vferL5EN0HSBdmyPi3TcV2aoXdlaW648Han7st9RUqgN11EbWK5Ix+8QgZs9z 4zKA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=PPaP5eFHLCmRif1hviV9BH44yG2FgsmSRFGcS5H0Hm4=; b=J7SO6Y7RLYxdN04RindGA7mVVpPu+PcHk4SFAy1rFjy+awaCjcEqmSdv7ymkWcv9AA qWA8KVW1fspKICB2vNpBfh34whaMdYA3a8lnaS6iCXa1EnV5itRESorlrRgSKaPCPrrM P2IluPUtr8IZHvkbUrJOYcIJNZa3WQas4jhgXi7rEzpXhAgDIpie7BcxJZF49u/ePjnC qITDAMuu/oy9tT1k5F2qeBjd7/pa7+5Moj+2bJoZyt8sirPy3rL2pg8yM8V6fjKmnQv9 kM/MqzH+nBd0IizwHFs7XP+u+y29x8psVFTiXLgN1mOr7stm86zYaKqb/2I3ivqcFFpe zPYw== X-Gm-Message-State: AOAM5309kD4+sPP0ATzxJV/761BW1GOivMq8SEZHBi1pVrQETDoBbj6i WSbNirNJHKMjQ4KzAnMEnMGrLDmkSOyVKUEvr3Q= X-Google-Smtp-Source: ABdhPJzSGSbAIGpLWEtk7osDn/Le3ViNpOEb3TZ8U4tt5qhh2x31Uw45w2mAWu7NgdrlMHr64u7NswSWF4ibLp/pJ90= X-Received: by 2002:a05:620a:630:: with SMTP id 16mr22778021qkv.304.1614715268430; Tue, 02 Mar 2021 12:01:08 -0800 (PST) MIME-Version: 1.0 References: <87eegxms7h.fsf@nckx> In-Reply-To: <87eegxms7h.fsf@nckx> From: zimoun Date: Tue, 2 Mar 2021 21:00:57 +0100 Message-ID: Subject: Re: bug#46877: Guix assumes ideal network exists, does not To: Tobias Geerinckx-Rice Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46877 Cc: 46877@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Tobias, On Tue, 2 Mar 2021 at 17:33, Tobias Geerinckx-Rice via Bug reports for GNU Guix wrote: > We don't seem to have a plan forward (I include myself!). Looking > at other package managers, a blunt =E2=80=98retry a finite number of > times=E2=80=99 seems common. Guix's =E2=80=98pretend that "transient" is= a magic > powerword=E2=80=99 approach less so. If I read correctly, the issue comes from (guix scripts substitutes) in 'fetch-narinfos': --8<---------------cut here---------------start------------->8--- (call-with-connection-error-handling uri (lambda () (http-multiple-get uri handle-narinfo-response '() requests #:open-connection open-connection #:verify-certificate? #f)))= ))) --8<---------------cut here---------------end--------------->8--- where 'requests' can be really large (all the missing information from local cache). Instead of processing the list in one go, we could imagine split it into several chunks, say X, and so process only X requests by X requests. WDYT? Cheers, simon From debbugs-submit-bounces@debbugs.gnu.org Tue Mar 02 15:18:38 2021 Received: (at 46877) by debbugs.gnu.org; 2 Mar 2021 20:18:38 +0000 Received: from localhost ([127.0.0.1]:54301 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHBTa-0004AS-BO for submit@debbugs.gnu.org; Tue, 02 Mar 2021 15:18:38 -0500 Received: from mail-qt1-f180.google.com ([209.85.160.180]:33648) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHBTV-0004AB-99 for 46877@debbugs.gnu.org; Tue, 02 Mar 2021 15:18:36 -0500 Received: by mail-qt1-f180.google.com with SMTP id s15so15806600qtq.0 for <46877@debbugs.gnu.org>; Tue, 02 Mar 2021 12:18:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=tL6VWIWKZ4xhkZMnZLMksTjKZzlabGVqxxghSEhotf8=; b=Ypa6ZVtSHyN7fbYAnIwwfOcloeX7Dnrh22X9Qk0TSoDrxQO9cJaib8k2kK7hdtvoIL QQpBjyap4T7hGQHxoN+DYxMZXIeEQ4eHbmHUlfj4FFCkKGZgSojif7NbtfVsSpYCSMu8 N6edNTOp6DbWRhSYqOa7T/r/ZUOA7p+IwO5IDlX6o9TaOPU5myMDsLgXQzeMMZ6cGs7S 7buIyjt/LQ0zRBvTZKkY8rGixwSz9gUycGNfqy807MWjE5R6lVfJAyJ2m4zhBmN2kiD5 qwYH5jleTNsrl0r6uT0bjf4EtQZKFXveF4EahxRHC8F73Vu7C10+lXUWJbyS3wTvHb3Y W9WQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=tL6VWIWKZ4xhkZMnZLMksTjKZzlabGVqxxghSEhotf8=; b=GWBfiJOuMgK2SqbzXyCh1flmr2CE/4YTA2btA5WGY7XBsrQlPVPmA1QwCVPUSpmzGz JM5i0pU24V79C2JcLYnyhhDyOkWjOJgHQj1PhBPUqncUb4FLObyE/7MiueMMKsBczdv2 53ugEmxJWIitAWn14zc1UvB0c0tqWd8iLfDlinEFN5sqVjsp2u6t7BeE4HuTvBGDOAWr Q8BIsmxcVKAIT6cbqURYtJgemSJH3HTHRiVPfRyo1AxouVNmebH09XtNENw1gOSlPCFW W/NHgKCFrpalG8qDsuIp06cDnqv/2Z1D55kMHy6jHZcZMih+zyxfBNQ+tvzyUQg+MNRi jNFg== X-Gm-Message-State: AOAM530sDrzRJ2s02tQuKRcp2zwXbKPokJOXJ13IsSeO0pI1zGcX+mj6 H/ppDyrndGNZHuCXsw06EaC5MpmTXA3QpR8QpWA= X-Google-Smtp-Source: ABdhPJyTOlXLLvWfIthQ7lhgZ2JB/VoqRTdEJWtJJVsCquf/3rl8QdGYTVtLmaUJkUuZuAHvO4p7hOddw9tE93SS0Xo= X-Received: by 2002:a05:622a:307:: with SMTP id q7mr19727033qtw.211.1614716307911; Tue, 02 Mar 2021 12:18:27 -0800 (PST) MIME-Version: 1.0 References: <87eegxms7h.fsf@nckx> In-Reply-To: From: zimoun Date: Tue, 2 Mar 2021 21:18:17 +0100 Message-ID: Subject: Re: bug#46877: Guix assumes ideal network exists, does not To: Tobias Geerinckx-Rice Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46877 Cc: 46877@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) On Tue, 2 Mar 2021 at 21:00, zimoun wrote: > Instead of processing the list in one go, we could imagine split it > into several chunks, say X, and so process only X requests by X > requests. My bad, it is already the case where X=1000 in (guix http-client). Well, the error / retry seems poorly handled in 'http-multiple-get'. Cheers, simon From debbugs-submit-bounces@debbugs.gnu.org Wed Mar 10 06:17:47 2021 Received: (at submit) by debbugs.gnu.org; 10 Mar 2021 11:17:47 +0000 Received: from localhost ([127.0.0.1]:48953 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lJwqZ-0007YH-Bg for submit@debbugs.gnu.org; Wed, 10 Mar 2021 06:17:47 -0500 Received: from lists.gnu.org ([209.51.188.17]:38076) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lJwqW-0007Y8-1N for submit@debbugs.gnu.org; Wed, 10 Mar 2021 06:17:45 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:48586) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lJwqV-0007y3-8u for bug-guix@gnu.org; Wed, 10 Mar 2021 06:17:43 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:59413) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lJwqU-0003z7-QC; Wed, 10 Mar 2021 06:17:42 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=48712 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1lJwqU-0004PG-Dg; Wed, 10 Mar 2021 06:17:42 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Tobias Geerinckx-Rice via Bug reports for GNU Guix Subject: Re: bug#46877: Guix assumes ideal network exists, does not References: <87eegxms7h.fsf@nckx> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 20 =?utf-8?Q?Vent=C3=B4se?= an 229 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Wed, 10 Mar 2021 12:17:41 +0100 In-Reply-To: <87eegxms7h.fsf@nckx> (Tobias Geerinckx-Rice via Bug reports for's message of "Tue, 02 Mar 2021 17:32:50 +0100") Message-ID: <87o8fr2r6y.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit Cc: Tobias Geerinckx-Rice , 46877@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, Tobias Geerinckx-Rice via Bug reports for GNU Guix skribis: > ~ $ guix weather --substitute-urls=3Dhttps://guix.tobias.gr > computing 16,745 package derivations for x86_64-linux... > looking for 18,127 store items on https://guix.tobias.gr... > updating substitutes from 'https://guix.tobias.gr'...=20 > 41.6%Backtrace: > 11 (primitive-load=20 > "/home/nckx/.config/guix/current/bin/guix") > In guix/ui.scm: > 2164:12 10 (run-guix-command _ . _) > In ice-9/boot-9.scm: > 1736:10 9 (with-exception-handler _ _ #:unwind? _=20 > #:unwind-for-type _) > 1731:15 8 (with-exception-handler # ice-9/boot-9.scm:1815:7 (exn)> _ #:unwind? _ =E2=80=A6) > In guix/scripts/weather.scm: > 546:9 7 (_) > In guix/build/utils.scm: > 569:23 6 (every* # guix/scripts/weather.scm:546:17 (server)> _) > In guix/scripts/weather.scm: > 547:19 5 (_ "https://guix.tobias.gr") > 116:17 4 (report-server-coverage _ _ #:display-missing? _) > In unknown file: > 3 (_ # guix/scripts/weather.scm:184:2 ()> #=20 > . #w()) > In guix/scripts/substitute.scm: > 411:23 2 (lookup-narinfos _ _ #:open-connection _) > 371:26 1 (fetch-narinfos _ _ #:open-connection _) > In ice-9/boot-9.scm: > 1669:16 0 (raise-exception _ #:continuable? _) > > ice-9/boot-9.scm:1669:16: In procedure raise-exception: > Throw to key `gnutls-error' with args `(# in the pull function.> read_from_session_record_port)'. Hmm isn=E2=80=99t it a regression? First, in (guix scripts substitute) there=E2=80=99s a =E2=80=98with-network= ing=E2=80=99 macro to nicely present networking errors; perhaps we=E2=80=99re missing it here? Second, is it a genuine bug? Do you see the same thing from (guix scripts substitute)? Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Wed Mar 10 17:05:40 2021 Received: (at 46877) by debbugs.gnu.org; 10 Mar 2021 22:05:40 +0000 Received: from localhost ([127.0.0.1]:52035 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lK6xY-0001KK-9S for submit@debbugs.gnu.org; Wed, 10 Mar 2021 17:05:40 -0500 Received: from mail-wm1-f52.google.com ([209.85.128.52]:51721) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lK6xW-0001K7-Si for 46877@debbugs.gnu.org; Wed, 10 Mar 2021 17:05:39 -0500 Received: by mail-wm1-f52.google.com with SMTP id l19so99955wmh.1 for <46877@debbugs.gnu.org>; Wed, 10 Mar 2021 14:05:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:in-reply-to:references:date:message-id:mime-version :content-transfer-encoding; bh=K0/X27i8Qvr1I5WiBqA9L/lozUVnNk6ivdRqvdqp6nw=; b=XrQamvO1GIidwomJxO0qRE1y6YSAcuHHSrhFmH0hc1Bsi1DG0zg+VdatJj6hlTlE1Q DkgQbM2o8laQUZLRwnc4MB0ZsBNk+MTE8OArktbFmekykV3DWxI5+o45ATYGIWEfoAQx vN93cmuPkJmy1WC2lkloMutnwCf2KjgadOlaVRDUm719coTAptiy7keHPfIoZt4VU6V1 9NXQT4EllAuhJNVxzATJhFYD3h93n0uhqa1tphnIyreFrXRS139iXyjUZY8xYrXOtsOm 6Ltyxfz8tBxXCSOOqwTqfwGhf2NM/SB0R0acshoZjsTNNcDMwVbbTHA6dX1IjInGflup 7dJg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=K0/X27i8Qvr1I5WiBqA9L/lozUVnNk6ivdRqvdqp6nw=; b=c2mCqft1naHndpRnd5PhPoGmRrYXDSW90mBNERwSXBdhuMtLGrg1pi8ob4i/J3w0zm HLMz4rrcuL1WolvWKFyWNK2XZpuKWGbK1nHpvWS1vmqMjrLgisiR8rEB1aM47La2C+wh WR+2S8vu8z+4BzU27pC1ctbwUUufzELLMC4xcPi0/JTacvux/qdMwcmT1TvGDNhO0egG OFeFrLMYgKHcPfIQ7fMd2Tu0SRW3CHjxj/ms/8yjr6xFJOH1ZcrLIY7PkSfaTadVAobr aGSQSGZQDKCs0te9A8s3Cpvg1r8WqEG80DvISfxG+rGWWiqUu3EM3ZfSaQQmitXXwB6r gGSw== X-Gm-Message-State: AOAM532mHwuczOjNUwuytfaKBlTGEMzvSO6PysFz1MlmTBmJW4W4NuIy fmV7v+I5m9wWxHYup3AEDIJer4zCoxM= X-Google-Smtp-Source: ABdhPJwNAsD2gl4DfPCLA5BmWav/6Ez5NEmhU0JyN5cTUCHpxDvKu77s0Hxc+BwU29mvzpkPuy6SeQ== X-Received: by 2002:a7b:c010:: with SMTP id c16mr5395772wmb.46.1615413932969; Wed, 10 Mar 2021 14:05:32 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id v9sm677966wrn.86.2021.03.10.14.05.32 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 10 Mar 2021 14:05:32 -0800 (PST) From: zimoun To: Ludovic =?utf-8?Q?Court=C3=A8s?= , 46877@debbugs.gnu.org Subject: Re: bug#46877: Guix assumes ideal network exists, does not In-Reply-To: <87o8fr2r6y.fsf@gnu.org> References: <87eegxms7h.fsf@nckx> <87o8fr2r6y.fsf@gnu.org> Date: Wed, 10 Mar 2021 23:04:59 +0100 Message-ID: <86k0qebr78.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46877 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi, On Wed, 10 Mar 2021 at 12:17, Ludovic Court=C3=A8s wrote: >> In guix/scripts/substitute.scm: >> 411:23 2 (lookup-narinfos _ _ #:open-connection _) >> 371:26 1 (fetch-narinfos _ _ #:open-connection _) >> In ice-9/boot-9.scm: >> 1669:16 0 (raise-exception _ #:continuable? _) >> >> ice-9/boot-9.scm:1669:16: In procedure raise-exception: >> Throw to key `gnutls-error' with args `(#> in the pull function.> read_from_session_record_port)'. > > Hmm isn=E2=80=99t it a regression? > > First, in (guix scripts substitute) there=E2=80=99s a =E2=80=98with-netwo= rking=E2=80=99 macro to > nicely present networking errors; perhaps we=E2=80=99re missing it here? > > Second, is it a genuine bug? Do you see the same thing from (guix > scripts substitute)? I do not know if it is related, the bug#47055 seems =E2=80=9Csimilar=E2=80= =9D: Cheers, simon