From unknown Fri Jun 20 07:26:29 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#46942 <46942@debbugs.gnu.org> To: bug#46942 <46942@debbugs.gnu.org> Subject: Status: ci.guix.gnu.org is slow from my system Reply-To: bug#46942 <46942@debbugs.gnu.org> Date: Fri, 20 Jun 2025 14:26:29 +0000 retitle 46942 ci.guix.gnu.org is slow from my system reassign 46942 guix submitter 46942 raid5atemyhomework severity 46942 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 06:22:34 2021 Received: (at submit) by debbugs.gnu.org; 5 Mar 2021 11:22:34 +0000 Received: from localhost ([127.0.0.1]:33004 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI8XR-0003i0-OH for submit@debbugs.gnu.org; Fri, 05 Mar 2021 06:22:34 -0500 Received: from lists.gnu.org ([209.51.188.17]:58550) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI8XO-0003hp-3H for submit@debbugs.gnu.org; Fri, 05 Mar 2021 06:22:31 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:58142) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lI8XN-0004n0-Hk for bug-guix@gnu.org; Fri, 05 Mar 2021 06:22:29 -0500 Received: from mail-40140.protonmail.ch ([185.70.40.140]:42217) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lI8XJ-0004j5-Bm for bug-guix@gnu.org; Fri, 05 Mar 2021 06:22:29 -0500 Date: Fri, 05 Mar 2021 11:22:17 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614943340; bh=1CnJThCoa27ZULKakDoCuU2UCMwhMWe29uil8hphJHY=; h=Date:To:From:Reply-To:Subject:From; b=jbpIJecvb4rgC0xVItWyOMurGBu8o0IYffhNXUHKLXRGQp8f7s1k6Q9NApViQcUOK MdwhSEP4hpPtRdhvg110KuwrrZ/rlv/pJdbvyoHah7prx5eQYRCYHJvqCSqgVwAX6G 45Pl4wfc92Hior9NKRmo4q+qRWix6MHjd7JGdxDc= To: "bug-guix@gnu.org" From: raid5atemyhomework Subject: ci.guix.gnu.org is slow from my system Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch Received-SPF: pass client-ip=185.70.40.140; envelope-from=raid5atemyhomework@protonmail.com; helo=mail-40140.protonmail.ch X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) Downloading substitutes from ci.guix.gnu.org is slow from my two Guix-using= computers. One is a pure Guix System install without any channels, the other one is a = foreign Guix install with the-channel-that-cannot-be-named. ``` downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmw= qrrb8lz-wine64-6.0 ... wine64-6.0 54.4MiB = 1= 0KiB/s 01:55 [ ] 2.1% ``` This can be very slow, including as slow as 4KiB/s at times. This is fairly= awful since sometimes I get this result: ``` downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmw= qrrb8lz-wine64-6.0 ... wine64-6.0 54.4MiB = 4= 9KiB/s 06:01 [##### ] 31.9%guix substitute: error: TLS error i= n procedure 'read_from_session_record_port': Error decoding the received TL= S packet. substitution of /gnu/store/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 fail= ed guix package: error: some substitutes for the outputs of derivation `/gnu/s= tore/wr9kf2bgcsvwxcmhnl9lf047nr8xcklc-wine64-6.0.drv' failed (usually happe= ns due to networking issues); try `--fallback' to build derivation from sou= rce ``` Because of the failed incomplete download, I have to ***restart the downloa= d again from 0%***, which is awful, awful UX. It would be really nice if: 1. The guix download process would make an effort to ***retry*** this a few= times. 2. Continue the previous download instead of restarting from 0%. The problem is not on my ISP, or at least not solely on my ISP. Doing a `wg= et` from `github.com`: ``` $ wget https://github.com/zfsonlinux/zfs/releases/download/zfs-2.0.3/zfs-2.= 0.3.tar.gz --2021-03-05 17:39:46-- https://github.com/zfsonlinux/zfs/releases/downloa= d/zfs-2.0.3/zfs-2.0.3.tar.gz Resolving github.com (github.com)... 13.229.188.59 Connecting to github.com (github.com)|13.229.188.59|:443... connected. HTTP request sent, awaiting response... 301 Moved Permanently Location: https://github.com/openzfs/zfs/releases/download/zfs-2.0.3/zfs-2.= 0.3.tar.gz [following] --2021-03-05 17:39:47-- https://github.com/openzfs/zfs/releases/download/z= fs-2.0.3/zfs-2.0.3.tar.gz Reusing existing connection to github.com:443. HTTP request sent, awaiting response... 302 Found Location: https://github-releases.githubusercontent.com/437011/71526a80-6ba= 3-11eb-893f-4ceb55b479d6?X-Amz-Algorithm=3DAWS4-HMAC-SHA256&X-Amz-Credentia= l=3DAKIAIWNJYAX4CSVEH53A%2F20210305%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-D= ate=3D20210305T093947Z&X-Amz-Expires=3D300&X-Amz-Signature=3D9454446348219a= a0731af009a5232bf5772e3d45a3a34052fa61f64f04c3c979&X-Amz-SignedHeaders=3Dho= st&actor_id=3D0&key_id=3D0&repo_id=3D437011&response-content-disposition=3D= attachment%3B%20filename%3Dzfs-2.0.3.tar.gz&response-content-type=3Dapplica= tion%2Foctet-stream [following] --2021-03-05 17:39:47-- https://github-releases.githubusercontent.com/4370= 11/71526a80-6ba3-11eb-893f-4ceb55b479d6?X-Amz-Algorithm=3DAWS4-HMAC-SHA256&= X-Amz-Credential=3DAKIAIWNJYAX4CSVEH53A%2F20210305%2Fus-east-1%2Fs3%2Faws4_= request&X-Amz-Date=3D20210305T093947Z&X-Amz-Expires=3D300&X-Amz-Signature= =3D9454446348219aa0731af009a5232bf5772e3d45a3a34052fa61f64f04c3c979&X-Amz-S= ignedHeaders=3Dhost&actor_id=3D0&key_id=3D0&repo_id=3D437011&response-conte= nt-disposition=3Dattachment%3B%20filename%3Dzfs-2.0.3.tar.gz&response-conte= nt-type=3Dapplication%2Foctet-stream Resolving github-releases.githubusercontent.com (github-releases.githubuser= content.com)... 185.199.108.154, 185.199.109.154, 185.199.110.154, ... Connecting to github-releases.githubusercontent.com (github-releases.github= usercontent.com)|185.199.108.154|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 13114404 (13M) [application/octet-stream] Saving to: =E2=80=98zfs-2.0.3.tar.gz=E2=80=99 zfs-2.0.3.tar.gz 100%[=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 12.51M 9.34MB= /s in 1.3s 2021-03-05 17:39:49 (9.34 MB/s) - =E2=80=98zfs-2.0.3.tar.gz=E2=80=99 saved = [13114404/13114404] ``` As can be seen above, I get 9.34MB/s elsewhere, which is better than the >6= 0Mbit/s promised by my ISP. It's possible that the problem is between my ISP and ci.guix.gnu.org. If I = `wget` directly: ``` $ wget https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wi= ne64-6.0 --2021-03-05 18:56:21-- https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh= 76xw6hmwqrrb8lz-wine64-6.0 Resolving ci.guix.gnu.org (ci.guix.gnu.org)... 141.80.181.40 Connecting to ci.guix.gnu.org (ci.guix.gnu.org)|141.80.181.40|:443... conne= cted. HTTP request sent, awaiting response... 200 OK Length: 57048561 (54M) [application/octet-stream] Saving to: =E2=80=981bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0=E2=80=99 1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 0%[ = = ] 167.79K 13.4KB/s eta 69m 20s^C ``` HOWEVER, if I `torify wget`: ``` $ torify wget https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrr= b8lz-wine64-6.0 --2021-03-05 18:57:00-- https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh= 76xw6hmwqrrb8lz-wine64-6.0 Resolving ci.guix.gnu.org (ci.guix.gnu.org)... 141.80.181.40 Connecting to ci.guix.gnu.org (ci.guix.gnu.org)|141.80.181.40|:443... conne= cted. HTTP request sent, awaiting response... 200 OK Length: 57048561 (54M) [application/octet-stream] Saving to: =E2=80=981bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0.1=E2=80= =99 1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0.1 13%[=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D> = ] 7.13M 683KB/s eta 72s ^C ``` Which is a big WHAT THE FUCK? Tor should not be 45x faster (683KB/s) than d= irectly from my ISP (13KB/s). I am not using any special workarounds for To= r, like meek or obfs4, which makes me doubt that my ISP is attempting to ce= nsor --- if my ISP is the one doing the censoring, it would probably target= Tor first before ci.guix.gnu.org, but I can access Tor just fine without s= pecial workarounds needed for very oppressive countries. I've tried this a few times. Consistently, using `torify wget` is much fas= ter than `wget` alone, I don't have to bang my head in boredom with `torify= wget`. This is not my expectation given what I understand of the Tor netw= ork and the public network. Is `ci.guix.gnu.org` doing some kind of per-IP or per-ISP or other throttli= ng? This looks very suspicious given the massive speed difference when usi= ng Tor and not using Tor. Doing `torify guix package -m manifest.scm` does not seem to perform the do= wnload inside Tor, which makes sense since it's probably `guix-daemon` that= is doing the download. So my questions are: * WHY IS DIRECT DOWNLOAD FROM MY ISP SLOWER THAN TOR? What can I do to chec= k if it's my ISP that is attempting to censor ci.guix.gnu.org? * Is there a way to make `guix-daemon` use a Tor proxy? I have two systems= using Guix, one is a Guix System, the other is using a foreign distro, and= I'd like to adjust both to use Tor instead since it's faster. * If not, is there a way to tell `guix-daemon` that I have these `nar` fi= les and it can put them in its store somehow instead of me waiting for it t= o ***SLOOOOOOOOWLY*** download it? * Are there any mirrors I can use for substitutes instead? How do I change = my systems (both the Guix System and the foreign distro) to use the mirrors= ? Is there some configuration option to do this? * How hard would it be to make the substitute download process at least mak= e an effort to attempt to continue a failed download instead of failing imm= ediately and forcing a restart from 0%? `texlive` is something like 400Mb, = it takes hours at 10KiB/s, I once had it fail at >90% which was very painfu= l because it had to restart from 0%, I had to do `guix package -m manifest.= scm` in a loop over and over again until it finished download. It would pro= bably cut down on people hammering on the server as well. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 06:48:53 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 11:48:53 +0000 Received: from localhost ([127.0.0.1]:33040 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI8wv-0004Zq-4p for submit@debbugs.gnu.org; Fri, 05 Mar 2021 06:48:53 -0500 Received: from mira.cbaines.net ([212.71.252.8]:35178) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI8wt-0004Zi-Or for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 06:48:52 -0500 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:8ac0:b4c7:f5c8:7caa]) by mira.cbaines.net (Postfix) with ESMTPSA id 657B227BC4F; Fri, 5 Mar 2021 11:48:50 +0000 (GMT) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id bfde5f43; Fri, 5 Mar 2021 11:48:50 +0000 (UTC) References: User-agent: mu4e 1.4.15; emacs 27.1 From: Christopher Baines To: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system In-reply-to: Date: Fri, 05 Mar 2021 11:48:44 +0000 Message-ID: <87o8fxn7mr.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: 46942@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain raid5atemyhomework via Bug reports for GNU Guix writes: > Downloading substitutes from ci.guix.gnu.org is slow from my two Guix-using computers. > > One is a pure Guix System install without any channels, the other one is a foreign Guix install with the-channel-that-cannot-be-named. > > > ``` > downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 ... > wine64-6.0 54.4MiB 10KiB/s 01:55 [ ] 2.1% > ``` If you try this same download again, do you get the same speed? guix publish, which is used on ci.guix.gnu.org can dynamically create nars if they're not cached, which will probably result in slower download speeds. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmBCGp5fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XeaphAAotp1sc8bmjJe+4HmKG6w8Fckf7qeOCx1 8MWekR9pV1fi6/5ULUedMlAVL6XEsKaAYLw7+NWb83J4YBbMZFmvt6jTo19HJdaG CIjgTSIMLvbdvwZFtFZDfTtxJkwoRZcRaPm4UMwy3IUrviHAu27olpDa6MygS4Ox GWnEaJuuCBWMlHEAbuDLZ4Xprtih44nTXNX6FzvGLKql00UqVRlmpDK1a3AZbwg9 0U64M7eHKrIe0y0QuXHZvf0FGgEss/3B4QB14Cz1CaZD/bR0iHY2WxoZmNGQVdcZ B+zYMKOBBBz9dF4QYtIHNfETWc7DIv9tdpOXEsaMB2nADnlvl0PRjKq9gFjNEwy+ 5nmni+bH6MuNRqsjA3IEj3aaOPMCvGQuGMkBrS0UCXd2DHgvHvDcJyu5M6f8HnLB kt8n9BnyiPX2uFU+713+0nvH39enrf67K7qcRfLo3IoDv38RxlbyGa1e9FiVEW56 HtqWcqESJzZd+VvpYIP2iw4fiHjCx6iBzM9arq5sLsIYiFqGhJzBYEXvlPXaJFSM l3WK6vPZYyE4HOF5/Jvyao+1vo/YwluDE/iMNcM7PHHRuG/tmUt3EcGxmST2Z7ED LoVtKYdh7XIh1vecQ2sUmxFaYca8MArlab9JTpYJPBJmxoQYxYUDgkHPd3sLGGW7 gGxnRHXH8x4= =fuaX -----END PGP SIGNATURE----- --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 07:13:08 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 12:13:08 +0000 Received: from localhost ([127.0.0.1]:33079 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9KN-0005BS-T1 for submit@debbugs.gnu.org; Fri, 05 Mar 2021 07:13:08 -0500 Received: from mail4.protonmail.ch ([185.70.40.27]:37316) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9KL-0005Ax-6b for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 07:13:06 -0500 Date: Fri, 05 Mar 2021 12:12:51 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614946378; bh=mLKxnXP4J3gEtn1zwwOa6AyRuk0jYtIDyeVk2MVdB0w=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=s6E9MO7BCqKLon2Du1l90SRumQyxI/2Q+Fu1kOvv+xRghbTag0knpP/YtkiAl8KIk wTZPSW3sM3DYSspzz4zgC5zaBN2MMyG9PgdUQmQQLRDh08HAUt3nwa9TvBfzkcJUi5 1U+jwUcgGtIDeVDHrSPVfNIcpWoQZ2v0eg93tOr8= To: Christopher Baines From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: <87o8fxn7mr.fsf@cbaines.net> References: <87o8fxn7mr.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 46942 Cc: "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Hello Christopher, > raid5atemyhomework via Bug reports for GNU Guix bug-guix@gnu.org writes: > > > Downloading substitutes from ci.guix.gnu.org is slow from my two Guix-u= sing computers. > > One is a pure Guix System install without any channels, the other one i= s a foreign Guix install with the-channel-that-cannot-be-named. > > > > downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh= 76xw6hmwqrrb8lz-wine64-6.0 ... > > wine64-6.0 54.4MiB = = 10KiB/s 01:55 [ ] 2.1% > > > > If you try this same download again, do you get the same speed? > > guix publish, which is used on ci.guix.gnu.org can dynamically create > nars if they're not cached, which will probably result in slower > download speeds. Yes, I have been suffering slow download speeds for a few weeks now. Even = with repeated downloads, it is consistently slow. I only just now tried ou= t using `torify wget`, which surprised me since it was much much faster ---= one lucky download even got up to 6MB/s over frikking TOR before I ^Ced it= . I've even tried doing `torify wget` and `wget` in parallel on two separa= te shells --- the `torify wget` was definitely faster, getting anywhere fro= m 100kB/s to 700kB/s with a few outliers at >1MB/s, while `wget` was consis= tently below 40kB/s and eventually settling to ~11kB/s after a few seconds. This holds even for packages I expect to be popular and thus likely to be i= n-cache with high probability, like `linux-libre`. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 07:26:39 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 12:26:39 +0000 Received: from localhost ([127.0.0.1]:33112 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9XT-0005WX-3C for submit@debbugs.gnu.org; Fri, 05 Mar 2021 07:26:39 -0500 Received: from mail-40141.protonmail.ch ([185.70.40.141]:23608) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9XQ-0005W4-Bn for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 07:26:37 -0500 Date: Fri, 05 Mar 2021 12:26:22 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614947189; bh=+F1Etm1o2/xeuqvv38F4WXCF1PghszDf25dRWuoQJ4A=; h=Date:To:From:Reply-To:Subject:In-Reply-To:References:From; b=XLT2qSKOIrS8BzCB4jWZxYvfPbMrmkasQ6h200TdPIxI6ISFqzljGX5b1iHK9BJyy qNk81QEwyPWRIitiEG5+wgltdBrtY2OTbBo/U8MeLsNnTlEdq4g0j5iY2YzErtj4E0 KNBFnQm9OTZulBH/0rw/QINcfoiIPjtu+zMsCGbo= To: "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: <87o8fxn7mr.fsf@cbaines.net> References: <87o8fxn7mr.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) > * Is there a way to make `guix-daemon` use a Tor proxy? I have two syste= ms using Guix, one is a Guix System, the other is using a foreign distro, a= nd I'd like to adjust both to use Tor instead since it's faster. I saw that `guix-daemon` respects `http_proxy` and `https_proxy` envvars, b= ut trying it out on my foreign-distro Guix computer, adding `https_proxy=3D= socks5h://127.0.0.1:9050 http_proxy=3Dsocks5h://127.0.0.1:9050` to the `sys= temd` service file doesn't work. ``` guix substitute: error: TLS error in procedure 'handshake': The TLS connect= ion was non-properly terminated. substitution of /gnu/store/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 fail= ed guix package: error: some substitutes for the outputs of derivation `/gnu/s= tore/wr9kf2bgcsvwxcmhnl9lf047nr8xcklc-wine64-6.0.drv' failed (usually happe= ns due to networking issues); try `--fallback' to build derivation from sou= rce ``` Looking at the foreign distro's syslog: ``` Mar 5 19:52:03 developer guix-daemon[145182]: accepted connection from pid= 145190, user raid5atemyhomework Mar 5 19:52:05 developer guix-daemon[145200]: spurious SIGPOLL Mar 5 19:52:07 developer Tor[1029]: Socks version 67 not recognized. (This= port is not an HTTP proxy; did you want to use HTTPTunnelPort?) ``` So it looks to me that `guix-daemon` expects `https_proxy` to be an HTTPS p= roxy and not a SOCKS5/SOCKS5H proxy. I'll look into Tor's HTTPTunnelPort. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 07:41:46 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 12:41:47 +0000 Received: from localhost ([127.0.0.1]:33128 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9m6-0007yM-LA for submit@debbugs.gnu.org; Fri, 05 Mar 2021 07:41:46 -0500 Received: from mail-40140.protonmail.ch ([185.70.40.140]:34872) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9m4-0007y4-Fb for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 07:41:45 -0500 Date: Fri, 05 Mar 2021 12:41:34 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614948097; bh=f3wPojrDQc0PQGaiv6TcjOzL7sxS3HrKqLAySaUo0jU=; h=Date:To:From:Reply-To:Subject:In-Reply-To:References:From; b=Tz8kXiWrL+SHINmnwQ2b+GQdRQriAtyTR7hYAUoFPphYpuCy9J5JW4dwSJh9DcGmL GIK4jfy3dTvgvoxCGcz41GVorlHUu2WpFSiVESZvtDQz5zCbialYmqsgd8Y+rmWgMI uEBNOQV5b9qGesCmoLr6f/CCd8wPFsb9kbexQUqs= To: "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: References: <87o8fxn7mr.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM,NUMERIC_HTTP_ADDR, WEIRD_PORT shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi all, > > - Is there a way to make `guix-daemon` use a Tor proxy? I have two sy= stems using Guix, one is a Guix System, the other is using a foreign distro= , and I'd like to adjust both to use Tor instead since it's faster. > > I saw that`guix-daemon` respects `http_proxy` and `https_proxy` envvars, = but trying it out on my foreign-distro Guix computer, adding `https_proxy= =3Dsocks5h://127.0.0.1:9050 http_proxy=3Dsocks5h://127.0.0.1:9050` to the `= systemd` service file doesn't work. > > guix substitute: error: TLS error in procedure 'handshake': The TLS c= onnection was non-properly terminated. > substitution of /gnu/store/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.= 0 failed > guix package: error: some substitutes for the outputs of derivation `= /gnu/store/wr9kf2bgcsvwxcmhnl9lf047nr8xcklc-wine64-6.0.drv' failed (usually= happens due to networking issues); try `--fallback' to build derivation fr= om source > > > Looking at the foreign distro's syslog: > > Mar 5 19:52:03 developer guix-daemon[145182]: accepted connection fr= om pid 145190, user raid5atemyhomework > Mar 5 19:52:05 developer guix-daemon[145200]: spurious SIGPOLL > Mar 5 19:52:07 developer Tor[1029]: Socks version 67 not recognized.= (This port is not an HTTP proxy; did you want to use HTTPTunnelPort?) > > > So it looks to me that`guix-daemon` expects `https_proxy` to be an HTTPS = proxy and not a SOCKS5/SOCKS5H proxy. I'll look into Tor's HTTPTunnelPort. On the foreign distro computer, adding an `HTTPTunnelPort 9080` to `/etc/to= r/torrc` and then adding `http_proxy=3Dhttps://127.0.0.1:9080 https_proxy= =3Dhttps://127.0.0.1:9080` to `guix-daemon.service`, then restarting servic= es, seems to work. ``` ownloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwq= rrb8lz-wine64-6.0 ... wine64-6.0 54.4MiB = 57= 9KiB/s 01:36 [##################] 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% The following derivation will be built: /gnu/store/7mr17xka558smr0c76crf9g727ccj76g-profile.drv 3.2 MB will be downloaded downloading from https://ci.guix.gnu.org/nar/lzip/gs3li4m0ydajm57r0qn1wvsdy= fsa68p7-font-gnu-unifont-13.0.06 ... font-gnu-unifont-13.0.06 3.0MiB = 51= 5KiB/s 00:06 [##################] 100.0% ``` The above is significantly better than the previous runs where I get 11KiB/= s, and matches the speeds I get from `torify wget`. While it's a good ***workaround*** for my problem instead of me silently we= eping at the ridiculous slowness of Guix substitutes, it doesn't solve my r= oot problem: * SOMETHING between my ISP and ci.guix.gnu.org is throttling access to the = substitutes. * Given that I have been using my ISP for a year without experiencing suc= h spurious slowdowns, and I have been using ci.guix.gnu.org for the past fe= w months only and have been hit with this slowness in the past month or so,= I am more inclined to blame ci.guix.gnu.org, but please tell me how I can = find out what is throttling the bandwidth here. The fact that Tor is ***FA= STER*** is very suspicious. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 07:43:36 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 12:43:36 +0000 Received: from localhost ([127.0.0.1]:33132 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9nr-000813-3E for submit@debbugs.gnu.org; Fri, 05 Mar 2021 07:43:36 -0500 Received: from mail-wm1-f45.google.com ([209.85.128.45]:40099) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lI9no-00080q-Ea for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 07:43:33 -0500 Received: by mail-wm1-f45.google.com with SMTP id o2so1344334wme.5 for <46942@debbugs.gnu.org>; Fri, 05 Mar 2021 04:43:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:in-reply-to:references:date:message-id:mime-version; bh=CQU88X/bcn65oA6ekal5gRJ0b2rx43rdGUNal9vxNQ8=; b=okmOfZCgLOpOXt+moG3+H0huL/88fnJp8JYlicAIbjjVmWXqjqKh0PP1jAz3sL4oWz fHoYOSPyGg276m/PqQzEE1PYbu51UEa3CQE+BHtaCXqzQm5FPb+u474OoeNdoMpqUWvZ gwH0ENjYH1D9MPYcFhH07sA8809F+OlZiFs1AnrpfkksVm4LR+WIWRtfgMsfN09Kpb0g tX0Ws2kFAi3ThJJQhHpSvuxFVPjpYAdN3Fmf7JsHa7rlfvjpo9vXzpW1Pa2RUPPs2HY2 eCUrk5M+smjeuKwx02ACEqKPXDkoEtkN1HP9j8QGxDOGkrhKurZQq1T28Yw7tw6n/yD2 F1bg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:in-reply-to:references:date :message-id:mime-version; bh=CQU88X/bcn65oA6ekal5gRJ0b2rx43rdGUNal9vxNQ8=; b=uMVys3yiIJMl//m95aM7tEF/DjRJR39hRCPjrJgSZx3FQceoKiZAUILQVH0a5cDhqE DHDg2/d5zrf8jtx6PCg/fFgSm2OGCELJRfEOWYZCfQSv2fzLnaJnvguZRFEbRfOqjnWs SOpRegzFE+yADRyytq0NUOfEMDWn9viD2hO4/rQ8YXVu52eKAGTxxOBTWs+5kvu3KJy5 IFZaN5f/70Es5KRMwvE4b7eambbRMs3ckQeg27+Wh7dDeRO3JxGr16VlsqT9s4H9oqR6 2f4saaVR21den6eT1pCfm4RUuBhgONlrOh7t6JWKfYsTIsnU7aZfLkrcNpt639GhZ012 b1/Q== X-Gm-Message-State: AOAM533N6WtvrHAbQCM4H+BlQpAhfxFww8P5Xm9HPavQMOmNNxPXdQJN d8wsEzLSvPK11fn+eJv09WxX633Aw/E= X-Google-Smtp-Source: ABdhPJzaLZWiMA9eO0gGIG1Mbds0nTB0tzla0lSzwTjtWTG+jACLOFvLxhH8UpyOEMLL0I7Dn1esyA== X-Received: by 2002:a1c:e912:: with SMTP id q18mr8748631wmc.59.1614948206555; Fri, 05 Mar 2021 04:43:26 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id x25sm4559345wmj.14.2021.03.05.04.43.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 05 Mar 2021 04:43:26 -0800 (PST) From: zimoun To: raid5atemyhomework , 46942@debbugs.gnu.org Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system In-Reply-To: References: Date: Fri, 05 Mar 2021 13:41:00 +0100 Message-ID: <86a6rh7oyr.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi, On Fri, 05 Mar 2021 at 11:22, raid5atemyhomework via Bug reports for GNU Guix wrote: > This can be very slow, including as slow as 4KiB/s at times. [...] > The problem is not on my ISP, or at least not solely on my ISP. Doing a `wget` from `github.com`: [...] > As can be seen above, I get 9.34MB/s elsewhere, which is better than the >60Mbit/s promised by my ISP. Where are you located? I mean, ci.guix.gnu.org is in Berlin, so if you are far, say in Alaska or in Puerto Williams[*], you get a poor downloading rate. However, github.com probably uses CDN or something like that, so obviously the rate becomes much better. *Puerto Williams, the World Southest town with an Internet connection. :-) All the best, simon From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 08:00:55 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 13:00:55 +0000 Received: from localhost ([127.0.0.1]:33178 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIA4W-0000l7-Hn for submit@debbugs.gnu.org; Fri, 05 Mar 2021 08:00:55 -0500 Received: from mail-40137.protonmail.ch ([185.70.40.137]:22203) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIA4T-0000dA-TQ for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 08:00:46 -0500 Date: Fri, 05 Mar 2021 13:00:33 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614949238; bh=IksEqrAaf2skUNSBDSnVrT/5I43QfQKuBpDoQcskzUU=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=urJ3DHrNnxXMAIKh6FZZhNv7O6VlS5dgBXYnAaRb4pWg5xnqH8HxbwXCh6FjK6ZzW rcVvLZSLhjbfVROFazIPfMTZd+1BxKRpGVNaH9IOa77FLK5d9/AsBJGdpRGLRHCezx U2DoPnSv6r87V6wXDw3lMnR93v4NN7rEt8q12A1A= To: zimoun From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: <86a6rh7oyr.fsf@gmail.com> References: <86a6rh7oyr.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi zimoun, > Hi, > > On Fri, 05 Mar 2021 at 11:22, raid5atemyhomework via Bug reports for GNU = Guix bug-guix@gnu.org wrote: > > > This can be very slow, including as slow as 4KiB/s at times. > > [...] > > > The problem is not on my ISP, or at least not solely on my ISP. Doing a= `wget` from `github.com`: > > [...] > > > As can be seen above, I get 9.34MB/s elsewhere, which is better than th= e >60Mbit/s promised by my ISP. > > Where are you located? I mean,ci.guix.gnu.org is in Berlin, so if you > are far, say in Alaska or in Puerto Williams[*], you get a poor > downloading rate. However, github.com probably uses CDN or something > like that, so obviously the rate becomes much better. > > *Puerto Williams, the World Southest town with an Internet > connection. :-) I would rather not say, since I am a very private person (otherwise I would= n't be using the "raid5atemyhomework" moniker). What I **do** find strange is that ***Tor is faster***. Surely connecting = directly from my ISP to ci.guix.gnu.org should be, in principle, faster tha= n connecting to my ISP to a random node, which connects to another random n= ode, which connects to another random node, which finally connects to Berli= n, should be ***slower***? Here are a few `ping`s to some places: ``` $ ping gnu.org PING gnu.org (209.51.188.148) 56(84) bytes of data. 64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D1 ttl=3D50 ti= me=3D301 ms 64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D2 ttl=3D50 ti= me=3D306 ms 64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D3 ttl=3D50 ti= me=3D335 ms 64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D4 ttl=3D50 ti= me=3D257 ms 64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D5 ttl=3D50 ti= me=3D234 ms ^C --- gnu.org ping statistics --- 5 packets transmitted, 5 received, 0% packet loss, time 4226ms rtt min/avg/max/mdev =3D 233.804/286.626/335.242/36.261 ms $ ping www.vikings.net PING www.vikings.net (168.119.169.112) 56(84) bytes of data. 64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D1 ttl=3D48 time=3D= 190 ms 64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D2 ttl=3D48 time=3D= 190 ms 64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D3 ttl=3D48 time=3D= 220 ms 64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D4 ttl=3D48 time=3D= 241 ms 64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D5 ttl=3D48 time=3D= 264 ms ^C --- www.vikings.net ping statistics --- 5 packets transmitted, 5 received, 0% packet loss, time 4413ms rtt min/avg/max/mdev =3D 189.767/220.941/264.326/29.054 ms $ ping www.raptorcs.com PING www.raptorcs.com (23.155.224.44) 56(84) bytes of data. 64 bytes from websvc.rptsys.com (23.155.224.44): icmp_seq=3D1 ttl=3D55 time= =3D294 ms 64 bytes from websvc.rptsys.com (23.155.224.44): icmp_seq=3D2 ttl=3D55 time= =3D307 ms 64 bytes from websvc.rptsys.com (23.155.224.44): icmp_seq=3D3 ttl=3D55 time= =3D227 ms ^C --- www.raptorcs.com ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2627ms rtt min/avg/max/mdev =3D 226.868/275.933/306.748/35.071 ms ``` And here's a few select `wget`s: ``` $ wget https://store.vikings.net/image/cache/catalog/kcmad8-1088x816.jpeg --2021-03-05 20:50:37-- https://store.vikings.net/image/cache/catalog/kcma= d8-1088x816.jpeg Resolving store.vikings.net (store.vikings.net)... 185.199.141.17 Connecting to store.vikings.net (store.vikings.net)|185.199.141.17|:443... = connected. HTTP request sent, awaiting response... 200 OK Length: 246991 (241K) [image/jpeg] Saving to: =E2=80=98kcmad8-1088x816.jpeg=E2=80=99 kcmad8-1088x816.jpeg 100%[=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 241.20K 19.2KB= /s in 13s 2021-03-05 20:50:51 (19.2 KB/s) - =E2=80=98kcmad8-1088x816.jpeg=E2=80=99 sa= ved [246991/246991] $ torify wget https://store.vikings.net/image/cache/catalog/kcmad8-1088x816= .jpeg --2021-03-05 20:51:22-- https://store.vikings.net/image/cache/catalog/kcma= d8-1088x816.jpeg Resolving store.vikings.net (store.vikings.net)... 185.199.141.17 Connecting to store.vikings.net (store.vikings.net)|185.199.141.17|:443... = connected. HTTP request sent, awaiting response... 200 OK Length: 246991 (241K) [image/jpeg] Saving to: =E2=80=98kcmad8-1088x816.jpeg.1=E2=80=99 kcmad8-1088x816.jpeg.1 100%[=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 241.20K 293KB= /s in 0.8s 2021-03-05 20:51:25 (293 KB/s) - =E2=80=98kcmad8-1088x816.jpeg.1=E2=80= =99 saved [246991/246991] $ wget https://static.fsf.org/nosvn/videos/fight-to-repair/videos/Fight-to-= Repair-720p.webm --2021-03-05 20:54:03-- https://static.fsf.org/nosvn/videos/fight-to-repai= r/videos/Fight-to-Repair-720p.webm Resolving static.fsf.org (static.fsf.org)... 209.51.188.233, 2001:470:142:5= ::233 Connecting to static.fsf.org (static.fsf.org)|209.51.188.233|:443... connec= ted. HTTP request sent, awaiting response... 200 OK Length: 40191351 (38M) [video/webm] Saving to: =E2=80=98Fight-to-Repair-720p.webm=E2=80=99 Fight-to-Repair-720p.webm 2%[=3D> = = ] 856.00K 146KB/s eta 4m 32s ^C $ torify wget https://static.fsf.org/nosvn/videos/fight-to-repair/videos/Fi= ght-to-Repair-720p.webm --2021-03-05 20:54:13-- https://static.fsf.org/nosvn/videos/fight-to-repai= r/videos/Fight-to-Repair-720p.webm Resolving static.fsf.org (static.fsf.org)... 209.51.188.233 Connecting to static.fsf.org (static.fsf.org)|209.51.188.233|:443... connec= ted. HTTP request sent, awaiting response... 200 OK Length: 40191351 (38M) [video/webm] Saving to: =E2=80=98Fight-to-Repair-720p.webm.1=E2=80=99 Fight-to-Repair-720p.webm.1 6%[=3D=3D=3D=3D=3D> = = ] 2.55M 498KB/s eta 92s ^C $ wget https://static.raptorcs.com/TL2WK2/images/boardlarge.png --2021-03-05 20:57:19-- https://static.raptorcs.com/TL2WK2/images/boardlar= ge.png Resolving static.raptorcs.com (static.raptorcs.com)... 23.155.224.44 Connecting to static.raptorcs.com (static.raptorcs.com)|23.155.224.44|:443.= .. connected. HTTP request sent, awaiting response... 200 OK Length: 5398922 (5.1M) [image/png] Saving to: =E2=80=98boardlarge.png=E2=80=99 boardlarge.png 100%[=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 5.15M 505KB= /s in 9.4s 2021-03-05 20:57:30 (559 KB/s) - =E2=80=98boardlarge.png=E2=80=99 saved [53= 98922/5398922] $ torify wget https://static.raptorcs.com/TL2WK2/images/boardlarge.png --2021-03-05 20:57:32-- https://static.raptorcs.com/TL2WK2/images/boardlar= ge.png Resolving static.raptorcs.com (static.raptorcs.com)... 23.155.224.44 Connecting to static.raptorcs.com (static.raptorcs.com)|23.155.224.44|:443.= .. connected. HTTP request sent, awaiting response... 200 OK Length: 5398922 (5.1M) [image/png] Saving to: =E2=80=98boardlarge.png.1=E2=80=99 boardlarge.png.1 100%[=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 5.15M 534KB= /s in 10s 2021-03-05 20:57:45 (515 KB/s) - =E2=80=98boardlarge.png.1=E2=80=99 saved [= 5398922/5398922] ``` I know Vikings is based in Germany, so it looks like my ISP does not like c= onnecting to German sites --- again I am seeing this phenomenon where using= Tor is faster than connecting directly, but it certainly now looks a whole= lot more like a problem with my ISP. On the other hand the `fsf.org` site has better speed when connected direct= ly, but still the one via Tor is about 3x faster. And finally RaptorCS is about the same speed both directly and over Tor. A= gain, this is still a surprise as I expect Tor to be slower than direct con= nection. Lemme go poke at my ISP. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 09:46:26 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 14:46:26 +0000 Received: from localhost ([127.0.0.1]:33358 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIBik-0002ga-98 for submit@debbugs.gnu.org; Fri, 05 Mar 2021 09:46:26 -0500 Received: from mail-40138.protonmail.ch ([185.70.40.138]:18364) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIBid-0002gH-7S for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 09:46:24 -0500 Date: Fri, 05 Mar 2021 14:46:09 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614955572; bh=BU3GkJRwNLyomlbwiPOPmPa5Ofgru2yQCD0liGhwFYA=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=DSHjGV2Ff6EBx+orXbjg2u1GhX0O/ERhKsOZoes/2L9BVB7gUfe5vVJk0VS3+O6X5 PY+ZBiY2J0g1T0UGI5RMQc3yxJStnvLgYMemUwBDb6vqGj6umJ2ywW1TYV0L7YHV+S oQpWk8/Jrs9P1mgY+WW07Tn0N+VbJgp+k3OzBCmE= To: zimoun From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: References: <86a6rh7oyr.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi all, In case it's useful, here's my `traceroute`, would this be helpful for Guix= ? I erased some internal IP addresses and omit a few bytes off the source cou= ntry. After hop 25 `traceroute` couldn't find anything anymore. I annotated= the IP addresses to country map. ``` $ sudo `which traceroute` 141.80.181.40 traceroute to 141.80.181.40 (141.80.181.40), 64 hops max 1 3.140ms 0.947ms 0.981ms 2 2.527ms 1.571ms 1.416ms 3 4.318ms 4.705ms 3.680ms 4 .4.16 2.605ms 1.856ms 1.963ms 5 .1.205 2.177ms 2.087ms 1.876ms 6 .3.54 29.090ms 30.237ms 28.982ms 7 203.208.168.129 29.200ms 29.497ms 30.863ms # Singapore Singapo= re Telecommunications Pte Ltd 8 203.208.152.82 29.295ms 29.231ms 29.227ms # Singapore SingTel= Internet Exchange 9 203.208.182.249 30.769ms 31.872ms 47.615ms # Singapore Singapo= re Telecommunications Pte Ltd 10 203.208.183.133 30.271ms 30.713ms 31.635ms # Singapore Singapo= re Telecommunications Pte Ltd 11 203.208.158.178 363.911ms 301.844ms 204.896ms # Singapore SingTel= Internet Exchange 12 203.208.172.234 213.664ms 298.038ms 213.798ms # Singapore Singapo= re Telecommunications Pte Ltd 13 * * * 14 * * * 15 * * * 16 * * * 17 * * * 18 64.125.28.36 335.579ms 499.267ms 411.078ms # Netherlands Zayo = Bandwidth 19 * * * 20 64.125.28.36 349.449ms 347.413ms 432.726ms # Netherlands Zayo = Bandwidth 21 80.81.193.222 334.576ms 334.150ms 335.696ms # Germany DE-CIX Ma= nagement GmbH 22 64.125.26.173 343.767ms 344.376ms 344.544ms # Germany Zayo Band= width 23 188.1.238.78 375.499ms 346.705ms 417.986ms # Germany Verein zu= r Foerderung eines Deutschen Forschungsnetzes e.V. 24 141.80.238.11 339.792ms 383.421ms 406.579ms # Germany Campus Be= rlin-Buch GmbH 25 188.1.146.210 410.225ms 334.844ms 335.196ms # Germany Verein zu= r Foerderung eines Deutschen Forschungsnetzes e.V. ``` The big increase in ping times is somewhere inside Singapore, which seems l= ike a reasonable assumption that it's what is throttling bandwidth. A quick= research shows Singapore Telecommunications Pte Ltd is the same as SingTel= Internet Exchange. Are there any other mirror substitute servers aside from `ci.guix.gnu.org`? Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 13:43:43 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 18:43:43 +0000 Received: from localhost ([127.0.0.1]:35399 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIFQN-0000hV-1M for submit@debbugs.gnu.org; Fri, 05 Mar 2021 13:43:43 -0500 Received: from mail-wm1-f41.google.com ([209.85.128.41]:51196) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIFQL-0000hJ-0o for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 13:43:42 -0500 Received: by mail-wm1-f41.google.com with SMTP id i9so2278796wml.0 for <46942@debbugs.gnu.org>; Fri, 05 Mar 2021 10:43:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version; bh=JFWrdcgexiHgdZjUy/xzqAZ68/0W3WTVo7vpgbVchV4=; b=FBFNVCyjZTKYrMHPhkeT3DlW+0GfLBuBQadH0vVsPMZSC0VpVq0tQIuko/icUrDD1d lLkHmdalGJx1yiFvuCAuUZYuRV6m0/I7vDUU5vYzHsc0hMU/NhCGYGUM60eu4vX1vdxd F6IkhIpn3mQvEr/8BHhjcM1GSfiFXjB4izb2hTWXHPGxm7RaLgvUfY781p+OKwE5LJ/5 cuxPlke4lL/D45cWCgyUdwGBNxAOkxM5gkKEXs4lVOO2zbSrygV11mVvkPuI2DD5NLwL SuRM6Zl9yBEWG7sOu8Uhpt07girSwUaMf7Drw0jr45jFnW3pA/78v/ePv2Q7/JLJwPDI m/VA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version; bh=JFWrdcgexiHgdZjUy/xzqAZ68/0W3WTVo7vpgbVchV4=; b=Hl4qfJIVI8nfTU0Y+osTw1iUP6oDdUVNIc6X1rzod8y8YTXXEcrW+YnjxUsWBr+qtw ZOrOK6s16kcGTy4OPASQ0C+lCUMdn5HjstZOJadF3tNFUuy715mzrssRvJLOqAI3e6BG pPe2jwYwejIlRHMDbaaDOzQAPvI5doG10RCiweLcEH6Qod/7BUtr0/GQ7salAxe6/+37 83ulZd7pCWG9rcW/z3wE37DbUN/bCLd6MC2cmD2y9WpwzzPpP59sNV+DP8/GGgJW37E5 9hZHtEFR51reRDqM4RwxUqwKLTEEO+w9DD4xR0aGzXCqtBFez3QxW34sbdZU85ZQA98V E5OQ== X-Gm-Message-State: AOAM532gqBEDBFcPryTf717vX5qt/digk0GRfONBizHQrjbYDqqe1yOM t3XjCf0Vij1NaCRsc+++S4LURx/6jFo= X-Google-Smtp-Source: ABdhPJyxqs8Mrw8Hblv6n0sBGgZJBrOEw7QhVNmYjI04D/c1OYQV0wutSX5rAUKSsi5O/slH1UYVSg== X-Received: by 2002:a1c:68c5:: with SMTP id d188mr9865978wmc.119.1614969814941; Fri, 05 Mar 2021 10:43:34 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id f5sm5244659wrx.39.2021.03.05.10.43.34 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 05 Mar 2021 10:43:34 -0800 (PST) From: zimoun To: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system In-Reply-To: References: <86a6rh7oyr.fsf@gmail.com> Date: Fri, 05 Mar 2021 19:39:24 +0100 Message-ID: <86r1ktsaw3.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 1.4 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: Hi, On Fri, 05 Mar 2021 at 14:46, raid5atemyhomework wrote: > Are there any other mirror substitute servers aside from `ci.guix.gnu.org`? Content analysis details: (1.4 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at https://www.dnswl.org/, no trust [209.85.128.41 listed in list.dnswl.org] 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record -0.0 SPF_PASS SPF: sender matches SPF record 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (zimon.toutoune[at]gmail.com) -0.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2) [209.85.128.41 listed in wl.mailspike.net] 1.4 PDS_TONAME_EQ_TOLOCAL_SHORT Short body with To: name matches everything in local email X-Debbugs-Envelope-To: 46942 Cc: "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.4 (/) Hi, On Fri, 05 Mar 2021 at 14:46, raid5atemyhomework wrote: > Are there any other mirror substitute servers aside from `ci.guix.gnu.org`? Well, only one in China I AFAIK. See for details. All the best, simon From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 14:40:22 2021 Received: (at submit) by debbugs.gnu.org; 5 Mar 2021 19:40:22 +0000 Received: from localhost ([127.0.0.1]:35499 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIGJB-0002OX-Sl for submit@debbugs.gnu.org; Fri, 05 Mar 2021 14:40:22 -0500 Received: from lists.gnu.org ([209.51.188.17]:45620) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIGJA-0002OJ-Fs for submit@debbugs.gnu.org; Fri, 05 Mar 2021 14:40:20 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:41992) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lIGJA-0004tr-9A for bug-guix@gnu.org; Fri, 05 Mar 2021 14:40:20 -0500 Received: from wout1-smtp.messagingengine.com ([64.147.123.24]:54891) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lIGJ6-0000xg-73 for bug-guix@gnu.org; Fri, 05 Mar 2021 14:40:20 -0500 Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id E5A1C2AFC; Fri, 5 Mar 2021 14:40:13 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Fri, 05 Mar 2021 14:40:14 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=mesmtp; bh=payamRyQz8p+VHC+wSLdLoI5 peUTTLUsMpnRJvd0B0w=; b=vVNIhUktb8SwOdDuAO2tn9/ceBakYJAhGHh+nvQW V/OLN/9I5f/QSmqCwjqEQd0vAt2q18nKaLMGG0CWI1bcrHH+n/oQEPtSt114fwpv RwqsCirs4EajJIGk8ulKdpMLSjPz72SDl0VxAN9lkiG9NopiC6l4dlj1klGH5SO2 O1Y= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=payamR yQz8p+VHC+wSLdLoI5peUTTLUsMpnRJvd0B0w=; b=Lfo2hA0QP5yJ6a9EZrfo3M t/D89mHTBRRPS1U+eKkcZHej8HqIJzeMpIztsh4fwLglnppbgCz8MzeaVx6bb+mS aN/refem6L2rZY64JKPCDbukUEv3wsvblBL7KSVmY1hN81Qcj43MQiEo619TB1rG 7mf8QhHGHSPlwIRzIzFF91h4QvjYhXNxuEAR+4fRT7052vWE6BKkQoBIohl4JCfy CdPUE13+R714C++x8NiuDZHwyNEM0WgLLRJRUk6Z8bbFPcI8kqfTPFZbfUqi00Pl E3g9LwbHxuyqcQ0mXes0D9yQ49VdnY1HaRpnGr6yxyV6bs0jQ/+6ZLGwbFbMAutA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledruddtiedguddukecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpeffhffvuffkfhggtggujgesthdtredttddtvdenucfhrhhomhepnfgvohcu hfgrmhhulhgrrhhiuceolhgvohesfhgrmhhulhgrrhhirdhnrghmvgeqnecuggftrfgrth htvghrnhepudejteevgeelveeikefhffettefgueehleetffejleehhfelhfevhfduffev vdfhnecuffhomhgrihhnpehgnhhurdhorhhgpdhgnhhurdhorhhgrdhsohenucfkphepud dttddruddurdduieelrdduudeknecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghm pehmrghilhhfrhhomheplhgvohesfhgrmhhulhgrrhhirdhnrghmvg X-ME-Proxy: Received: from localhost (pool-100-11-169-118.phlapa.fios.verizon.net [100.11.169.118]) by mail.messagingengine.com (Postfix) with ESMTPA id D8F771080054; Fri, 5 Mar 2021 14:40:11 -0500 (EST) Date: Fri, 5 Mar 2021 14:40:10 -0500 From: Leo Famulari To: raid5atemyhomework via Bug reports for GNU Guix Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Received-SPF: pass client-ip=64.147.123.24; envelope-from=leo@famulari.name; helo=wout1-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.4 (-) X-Debbugs-Envelope-To: submit Cc: 46942@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.4 (--) On Fri, Mar 05, 2021 at 11:22:17AM +0000, raid5atemyhomework via Bug reports for GNU Guix wrote: > Downloading substitutes from ci.guix.gnu.org is slow from my two Guix-using computers. > > One is a pure Guix System install without any channels, the other one is a foreign Guix install with the-channel-that-cannot-be-named. > > > ``` > downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 ... > wine64-6.0 54.4MiB 10KiB/s 01:55 [ ] 2.1% > ``` Sometimes we get reports like this, of strangely slow downloads from ci.guix.gnu.org. They don't seem to depend on geography. They sometimes happen to people who usually download quickly from ci.guix.gnu.org. So far, we don't have any idea why they happen. But, it's not just you. You are the first person to file a detailed bug report about it, if I remember correctly (if!). If you'd like to help debug it, let us know, but it would probably mean identifying your IP / location. From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 16:53:59 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 21:54:00 +0000 Received: from localhost ([127.0.0.1]:35606 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIIOV-0005bq-Jv for submit@debbugs.gnu.org; Fri, 05 Mar 2021 16:53:59 -0500 Received: from lepiller.eu ([89.234.186.109]:59718) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIIOS-0005bf-Ay for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 16:53:57 -0500 Received: from lepiller.eu (localhost [127.0.0.1]) by lepiller.eu (OpenSMTPD) with ESMTP id 13e771b8; Fri, 5 Mar 2021 21:53:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=lepiller.eu; h=date :in-reply-to:references:mime-version:content-type :content-transfer-encoding:subject:to:from:message-id; s=dkim; bh=Ay7rE5gZbcL8I57oblcWIJ03dQvG2tanwbW9hojtx58=; b=G2uuvil4YfqR G97+rMGmJvGTdL/CcK+W3t1OELYjZLOq4L76iEe7K6f54NswJtBmRoxz6DgW1FsX SZ7yUmd7e07cR71MY32XxDAf0J+UZVb/Mrt2Ep4fQ3Zmv76j4eCEP6h+Wx3DaLm6 olidlXd83Qw485Qxdkuip6JUAmCzTHurHvIENyUGd8f1LoeaEIDCywaHx4koCrA5 5P20WxTvplI+ve10dkJa2uZMR7MAQF0khliKJjDzUvl5T8n1BATPv+Niz97SXAvL XlOe1qD9Rgesik7e+8p1dN1mQLz8vtxFuY6P1IcvVmAIHtVUVYdVpglAkWpZ0mH9 mb6/DWLq2w== Received: by lepiller.eu (OpenSMTPD) with ESMTPSA id 7648004f (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Fri, 5 Mar 2021 21:53:53 +0000 (UTC) Date: Fri, 05 Mar 2021 16:53:33 -0500 User-Agent: K-9 Mail for Android In-Reply-To: References: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----EPWFELHD8Z36NLT7ZT94504MD8H81B" Content-Transfer-Encoding: 7bit Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system To: Leo Famulari ,46942@debbugs.gnu.org From: Julien Lepiller Message-ID: <257938C2-93F2-41A9-A8E5-FF0F5A43DB5A@lepiller.eu> X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 46942 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) ------EPWFELHD8Z36NLT7ZT94504MD8H81B Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Actually, location usually has nothing to do with it (unless someone dug a = hole right in the middle of optic fibers, but you'd notice)=2E The most imp= ortant info is AS (basically, which ISP you're using, but some have more th= an one AS)=2E We don't need your IP, but ISP might be already too revealing= for your taste=2E Le 5 mars 2021 14:40:10 GMT-05:00, Leo Famulari a = =C3=A9crit : >On Fri, Mar 05, 2021 at 11:22:17AM +0000, raid5atemyhomework via Bug >reports for GNU Guix wrote: >> Downloading substitutes from ci=2Eguix=2Egnu=2Eorg is slow from my two >Guix-using computers=2E >>=20 >> One is a pure Guix System install without any channels, the other one >is a foreign Guix install with the-channel-that-cannot-be-named=2E >>=20 >>=20 >> ``` >> downloading from >https://ci=2Eguix=2Egnu=2Eorg/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-w= ine64-6=2E0 >=2E=2E=2E >> wine64-6=2E0 54=2E4MiB = =20 > 10KiB/s 01:55 [ ] 2=2E1% >> ``` > >Sometimes we get reports like this, of strangely slow downloads from >ci=2Eguix=2Egnu=2Eorg=2E They don't seem to depend on geography=2E They s= ometimes >happen to people who usually download quickly from ci=2Eguix=2Egnu=2Eorg= =2E So >far, we don't have any idea why they happen=2E But, it's not just you=2E > >You are the first person to file a detailed bug report about it, if I >remember correctly (if!)=2E If you'd like to help debug it, let us know, >but it would probably mean identifying your IP / location=2E ------EPWFELHD8Z36NLT7ZT94504MD8H81B Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable Actually, location usually has nothing to do with = it (unless someone dug a hole right in the middle of optic fibers, but you'= d notice)=2E The most important info is AS (basically, which ISP you're usi= ng, but some have more than one AS)=2E We don't need your IP, but ISP might= be already too revealing for your taste=2E

Le 5 mars 2021 14:40:10 GMT-05:00, Leo Famulari <leo@famulari=2Ename&= gt; a =C3=A9crit :
On Fri, Mar 05, 2021 at 11:22:17AM +0000, raid5atemy=
homework via Bug reports for GNU Guix wrote:
Downloading substitutes from ci=2Eguix=2Egnu=2Eorg is=
 slow from my two Guix-using computers=2E

One is a pure Guix System =
install without any channels, the other one is a foreign Guix install with =
the-channel-that-cannot-be-named=2E


```
downloading from https://ci=2Eguix=2Egnu=2Eorg/nar/lzip/1bdldr80p39g1mjnh7=
6xw6hmwqrrb8lz-wine64-6=2E0 =2E=2E=2E
 wine64-6=2E0  54=2E4MiB      =
                                                                           =
                                                10KiB/s 01:55 [            =
      ]   2=2E1%
```

Sometimes we get reports like t=
his, of strangely slow downloads from
ci=2Eguix=2Egnu=2Eorg=2E They don'=
t seem to depend on geography=2E They sometimes
happen to people who usu=
ally download quickly from ci=2Eguix=2Egnu=2Eorg=2E So
far, we don't hav=
e any idea why they happen=2E But, it's not just you=2E

You are the =
first person to file a detailed bug report about it, if I
remember corre=
ctly (if!)=2E If you'd like to help debug it, let us know,
but it would =
probably mean identifying your IP / location=2E



------EPWFELHD8Z36NLT7ZT94504MD8H81B-- From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 17:12:49 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 22:12:49 +0000 Received: from localhost ([127.0.0.1]:35621 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIIgi-00063Y-Qb for submit@debbugs.gnu.org; Fri, 05 Mar 2021 17:12:49 -0500 Received: from wout4-smtp.messagingengine.com ([64.147.123.20]:59935) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIIgg-00063J-G3 for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 17:12:47 -0500 Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id EE0AA1844; Fri, 5 Mar 2021 17:12:39 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Fri, 05 Mar 2021 17:12:40 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-transfer-encoding:in-reply-to; s=mesmtp; bh=1d9qcAwbPhYrCX6tPtnURBbIjjFx3aZ8LJ9kUT7IDh0=; b=I8WsFLKsXMze cZTwfVjWDzzA7UphznN6FVipoqRiEwGwFwzOtrQOV2jJEwNvHscVQ8axyw07I4ec 5ZfMvj+zDkoMHhkJFPQicVQ/BwFgz1Se0VP9CQ3kHus8kVWrKY8kCswL3gCuzmvn sSoNUlih+6FXNSZA/MlOL0a6d10LIF4= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; bh=1d9qcAwbPhYrCX6tPtnURBbIjjFx3aZ8LJ9kUT7ID h0=; b=hrh1nli+HsbUVykpkX9DkUkfA3h5jNvXrPAkhQglKCeTnkqaf8Zu/9dSu 2EzNcOXUUDdW3vLAuF+ogXpXmIIQ+tz5y9F2GdAu8fOBHm/VwvY2/EM3XNFD0Ca9 /wFIl5j3GzMsp5nbYAbEIU+7Lw3jE950CbWMsDky7SCliL0bblR8vPzgjl3imHg2 rdlocU4A6a1cOGZG/7vyLeYnwZb54TFOdEFRc9fakmddihHYq0e7428+2u4vzXvQ 2VvgPz6QnrqbSKI4pqhD2SrJy3scHyteWJUz/ljAP1P2+0eyyRxX8kJ2LFS3y23N j5WRD49PNdahRMp9CUTn40ygU4gpA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledruddtiedgudegjecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpeffhffvuffkfhggtggugfgjsehtkeertddttddunecuhfhrohhmpefnvgho ucfhrghmuhhlrghrihcuoehlvghosehfrghmuhhlrghrihdrnhgrmhgvqeenucggtffrrg htthgvrhhnpeelfefhffevgffffedtgefhheejueetfeeuieeggfdugeeviedthfekuefg gfegieenucffohhmrghinhepghhnuhdrohhrghdpghhnuhdrohhrghdrshhonecukfhppe dutddtrdduuddrudeiledruddukeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgr mhepmhgrihhlfhhrohhmpehlvghosehfrghmuhhlrghrihdrnhgrmhgv X-ME-Proxy: Received: from localhost (pool-100-11-169-118.phlapa.fios.verizon.net [100.11.169.118]) by mail.messagingengine.com (Postfix) with ESMTPA id DE161108005F; Fri, 5 Mar 2021 17:12:38 -0500 (EST) Date: Fri, 5 Mar 2021 17:12:37 -0500 From: Leo Famulari To: Julien Lepiller Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: References: <257938C2-93F2-41A9-A8E5-FF0F5A43DB5A@lepiller.eu> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <257938C2-93F2-41A9-A8E5-FF0F5A43DB5A@lepiller.eu> X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 46942 Cc: 46942@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Right, I meant that the required information would likely make it possible to determine this person's location. Or at least make a good guess. On Fri, Mar 05, 2021 at 04:53:33PM -0500, Julien Lepiller wrote: > Actually, location usually has nothing to do with it (unless someone dug a hole right in the middle of optic fibers, but you'd notice). The most important info is AS (basically, which ISP you're using, but some have more than one AS). We don't need your IP, but ISP might be already too revealing for your taste. > > Le 5 mars 2021 14:40:10 GMT-05:00, Leo Famulari a écrit : > >On Fri, Mar 05, 2021 at 11:22:17AM +0000, raid5atemyhomework via Bug > >reports for GNU Guix wrote: > >> Downloading substitutes from ci.guix.gnu.org is slow from my two > >Guix-using computers. > >> > >> One is a pure Guix System install without any channels, the other one > >is a foreign Guix install with the-channel-that-cannot-be-named. > >> > >> > >> ``` > >> downloading from > >https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 > >... > >> wine64-6.0 54.4MiB > > 10KiB/s 01:55 [ ] 2.1% > >> ``` > > > >Sometimes we get reports like this, of strangely slow downloads from > >ci.guix.gnu.org. They don't seem to depend on geography. They sometimes > >happen to people who usually download quickly from ci.guix.gnu.org. So > >far, we don't have any idea why they happen. But, it's not just you. > > > >You are the first person to file a detailed bug report about it, if I > >remember correctly (if!). If you'd like to help debug it, let us know, > >but it would probably mean identifying your IP / location. From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 17:57:46 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 22:57:46 +0000 Received: from localhost ([127.0.0.1]:35651 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIJOE-00079G-9z for submit@debbugs.gnu.org; Fri, 05 Mar 2021 17:57:46 -0500 Received: from mail-40141.protonmail.ch ([185.70.40.141]:44823) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIJOB-000791-OW for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 17:57:45 -0500 Date: Fri, 05 Mar 2021 22:57:26 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614985053; bh=quJySjwznwhbPO4VcJ9ZfuIXrhhpAiJb9Yr0HTriqeA=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=YKkoDI8utaMCAoJfUfylOTwaxC1k093C1313bY2SaPhqlSanGJxlP4hkM0rVHNNOe Ojex1McVImZwiHTRRh0kyfEfp58QItNN+PFeDn6kPGaBx/t5Y1NhnzxiefIZcMeIMT zyLD2Ohfwi2AACnkiDxfBw14Sbv55Iu+DJLJK/W8= To: zimoun From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> In-Reply-To: <86r1ktsaw3.fsf@gmail.com> References: <86a6rh7oyr.fsf@gmail.com> <86r1ktsaw3.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi zimoun, > Hi, > > On Fri, 05 Mar 2021 at 14:46, raid5atemyhomework raid5atemyhomework@proto= nmail.com wrote: > > > Are there any other mirror substitute servers aside from `ci.guix.gnu.o= rg`? > > Well, only one in China I AFAIK. > > https://mirrors.sjtug.sjtu.edu.cn/guix > > Seehttps://yhetil.org/guix/87czz24ilu.fsf@riseup.net for details. Thank you very much, an experimental `wget` shows I get much higher speeds = from this: ``` $ wget https://mirror.sjtu.edu.cn/guix/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqr= rb8lz-wine64-6.0 --2021-03-06 06:45:10-- https://mirror.sjtu.edu.cn/guix/nar/lzip/1bdldr80p= 39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 Resolving mirror.sjtu.edu.cn (mirror.sjtu.edu.cn)... 111.186.58.212, 2001:d= a8:8000:7100::322:a Connecting to mirror.sjtu.edu.cn (mirror.sjtu.edu.cn)|111.186.58.212|:443..= . connected. HTTP request sent, awaiting response... 200 OK Length: 57048561 (54M) [application/octet-stream] Saving to: =E2=80=981bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0.3=E2=80= =99 1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0.3 100%[=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 54.41M 3.82MB= /s in 17s 2021-03-06 06:45:31 (3.21 MB/s) - =E2=80=981bdldr80p39g1mjnh76xw6hmwqrrb8lz= -wine64-6.0.3=E2=80=99 saved [57048561/57048561] ``` I will try it out as the first server in `--substitute-urls`. Would it not be appropriate to somehow put a list of such substitute server= s (even if it is currently only a single mirror) somewhere official, like t= he Guix manual? I suppose if Peng Mei Yu thinks this mirror would be mainta= ined long term? Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 18:51:47 2021 Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 23:51:47 +0000 Received: from localhost ([127.0.0.1]:35692 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIKER-0008RK-TW for submit@debbugs.gnu.org; Fri, 05 Mar 2021 18:51:47 -0500 Received: from mail-wr1-f48.google.com ([209.85.221.48]:44214) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIKEQ-0008R5-3o for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 18:51:42 -0500 Received: by mail-wr1-f48.google.com with SMTP id h98so3879107wrh.11 for <46942@debbugs.gnu.org>; Fri, 05 Mar 2021 15:51:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version; bh=sNGCS6dBid8YOoS3CAIQ+hUS1ZJCMK3wAyZQdcUSE0I=; b=u4XfJIxPvhl74xseTErwZV83YjsnUxe8ccqj+MaORyW0XrxmppNk5JWyRLZjE0nld2 eulFc6L+Lga6zeiY/6dV187FNxBcSG7aYOtMaxTrOFGD3R5le91IPwt+k2v1zK4Cn9fC wubh12130T+aELOLHqRmaWWvk6QhWotHhpSBmuqWzCq4pxY8zvE+c/xhZOnV69cjK+RZ SYmjJRlgeuprpEQrJ37z2fcHprlJ04v1GuVbjC4igAIrPQrQhb/5MT0TVdnKruY2XkWr TVv7nyxMidAkz5GWs7Wtcq5IzyhNWPnp9ftQEuA7n++Njocro9chvGC2mpGgkZA54UgA asUA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version; bh=sNGCS6dBid8YOoS3CAIQ+hUS1ZJCMK3wAyZQdcUSE0I=; b=ZRBbVDd5jVo4oVhEOQLdnAUDn/h2SkMN1Wt/4KaXRDxnmZvJeOP33p0POcVYvKINL3 Ao5aGsVh9h8aA3PTAi1k65kSNC0iYdEGntZFGHTRRb/EjFdIUWp3FzX6iZX5hx5wTDNd MxHFC242UB+1WKl19b/CSQm6ZFGJNDeM9pJIsQvU0/T+mRHv2F2as5nj9O0w0Jjd4Cm4 sLSNi54y34lXKqMn962Wuin8T2jBvWlN0w/g1UmDUh3xtegDutaiHYnqh/FPBymZWQ02 zqlGlKDIld6KG7102y+o/sMj+pu48wJBF0Ox+Pgg02+otYDRG4tT/uci3BKczxzLmEoJ g4HQ== X-Gm-Message-State: AOAM5305UmuAY48Ze9Xhe7bl0KVpK+jIpiNaF9TSoP3l5f4Cy5i3WZF+ rltcICn1u0kMh9pZ9pTN0xY= X-Google-Smtp-Source: ABdhPJxlZXZDLVMyd0/X/KDXJgAmCgB2zgUbt9JHnY6j+CWhwyQp1DjPaDpwguBAUZ5dgZEKZYb4nA== X-Received: by 2002:adf:cf0b:: with SMTP id o11mr1898124wrj.310.1614988295222; Fri, 05 Mar 2021 15:51:35 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id j125sm6163553wmb.44.2021.03.05.15.51.34 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 05 Mar 2021 15:51:34 -0800 (PST) From: zimoun To: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system In-Reply-To: <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> References: <86a6rh7oyr.fsf@gmail.com> <86r1ktsaw3.fsf@gmail.com> <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> Date: Sat, 06 Mar 2021 00:48:23 +0100 Message-ID: <86ft19rwl4.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi, On Fri, 05 Mar 2021 at 22:57, raid5atemyhomework wrote: > Would it not be appropriate to somehow put a list of such substitute > servers (even if it is currently only a single mirror) somewhere > official, like the Guix manual? I suppose if Peng Mei Yu thinks this > mirror would be maintained long term? It was something discussed in the mentioned thread. But no one took the time to send a patch for the manual or the cookbook. Feel free to do. :-) Nice if it improves the situation for you. Do you consider the problem (bug report) is solved? In order to close it. Cheers, simon From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 19:23:54 2021 Received: (at 46942) by debbugs.gnu.org; 6 Mar 2021 00:23:54 +0000 Received: from localhost ([127.0.0.1]:35698 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIKjZ-0000ke-Ls for submit@debbugs.gnu.org; Fri, 05 Mar 2021 19:23:54 -0500 Received: from mail-40135.protonmail.ch ([185.70.40.135]:34622) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIKjW-0000kN-Bj for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 19:23:51 -0500 Date: Sat, 06 Mar 2021 00:23:36 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1614990220; bh=Q2Zesaetg5QUULWUysTH3glNApNZPqBn+1bkhj1Q5rg=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=lUIMomecZS7ckFGe/Q663H2iCvkBdg2lyiDMG3vYijAfd970iiUUMWTQj/ci06IIC ncWPrl7znoefHTzZNzUF98xV18b3Ac5y5EC+T4CjB+wAb4HaiZR2e28uA9mxAbXJQI 4FZkEGGJ5VmY8S/XU9oNxgZ9SKf2Naa+9mKg4Pow= To: zimoun From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> References: <86a6rh7oyr.fsf@gmail.com> <86r1ktsaw3.fsf@gmail.com> <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Hi zimoun, Thanks, this is a definite improvement and I have set both systems to use i= t as the first item in `substitute-server`. I'll make a patch for the manua= l at least, then close this issue once that patch is accepted. So I was thinking of modifying the installer so at least some page offers u= p options for mirrors. However, because of the way the installer works, it = would have to be done by `(gnu installer services)`, which does not use `mo= dify-services` on the base service list. What the installer expects is that services will have their own `(service <= type> )` entry, without modifying the base service type. What I *want* to do would be to have an extensible `guix-substitute-url-ser= vice-type`. Unfortunately the existing `guix-service-type` accepts a list = of build directories to `chroot`. So here's a sketch: * Create a new `guix-daemon-service-type` and move most of the `guix-servic= e-type` code into it. * This is extensible; extensions provide a procedure which accepts a `` record and outputs a `` record. * `(compose (cut apply compose <>))` * `(extend (lambda (config modifier) (modifier config)))` * Create a new `guix-build-chroot-service-type` which just extends `guix-da= emon-service-type`: * `(service-extension guix-daemon-service-type (lambda (build-chroots) (l= ambda (guix-config) (guix-configuration (inherit guix-config) (chroot-direc= tories (append (guix-configuration-chroot-directories guix-config) build-ch= roots))))))` * `(define-deprecated guix-service-type guix-build-chroot-service-type)` * I mean seriously why does Guix assume only one configuration field of a= base system service is usefully extensible, it seems to me that the genera= l pattern should be that basic system service types should be extensible by= a procedure that accepts an existing configuration record and returns a mo= dified configuration record, then just define individual service types for = each list-of-foo field of the configuration record to make a convenient way= to extend such lists. * Create a new `guix-substitute-url-service-type` similar to `guix-build-ch= root-service-type`, which prepends a list of substitute URLs to the one in = the configuration. Then finally in the installer side: * in `(gnu installer services)` add something like: * `(system-service (name (G_ "https://mirrors.sjtug.sjtu.edu.cn/guix/ (SJ= TUG, China)")) (type 'substitute-url) (snippet '((simple-service guix-subst= itute-url-service-type (list "https://mirrors.sjtug.sjtu.edu.cn/guix/")))))= ` * `(system-service (name (G_ "https://ci.guix.gnu.org (Guix, Germany) - n= o mirror") (type 'substitute-url) (snippet '())))` * In `(gnu installer newt services)`, add a page for substitute URL mirrors= , probably a `run-listbox-selection-page`. * `(G_ "You can select a mirror that is nearer to you for faster updating= of packages. The main Guix substitute server, https://ci.guix.gnu.org/, wi= ll always be set as a fallback, so even if the mirror goes down, you can st= ill upgrade from the main Guix substitute server.")` Is that something that has any chance of getting accepted into Guix? I'd ra= ther not do any coding unless this has any chance at all of getting merged = in. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 05 19:46:42 2021 Received: (at 46942) by debbugs.gnu.org; 6 Mar 2021 00:46:42 +0000 Received: from localhost ([127.0.0.1]:35724 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIL5e-0001Jv-Ex for submit@debbugs.gnu.org; Fri, 05 Mar 2021 19:46:42 -0500 Received: from mail-wm1-f41.google.com ([209.85.128.41]:34718) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lIL5c-0001Jj-Tk for 46942@debbugs.gnu.org; Fri, 05 Mar 2021 19:46:41 -0500 Received: by mail-wm1-f41.google.com with SMTP id n11-20020a05600c4f8bb029010e5cf86347so1388297wmq.1 for <46942@debbugs.gnu.org>; Fri, 05 Mar 2021 16:46:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version; bh=fbduGT48InZ+xF2h91bUwqGGKVZnQcSKNu4km5DqLIU=; b=E1OnT1ba6HnwLOzI33viNsnrzR9zMx3+ybB92zlfC2rFlgv78jdS/CEaVlyRrA83KK cC4QmYjiEMBtJrDSCGfoPxCx2rQBesbSmdUOp3FmmOHYXqhCUsE2Iiyg8r891136qFeG B57G6ERz4mD7znQBHis/1epr/8FFDgVl78OlnsriFwufw+WH8AkuzQWWiWlqHkkJdGsQ 50RoY7wAzD47oKWyejrf0K9tXIk7pC6raqRCA/d2kTCbqTlwe35B0mh9opkRcX5s098n M3pwtAuTjOCcup5euujiTPTR6yahf1DWZ07q2IayD+7P8CQ79B1sFm+K7mD/7qcp0a8P gXQw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version; bh=fbduGT48InZ+xF2h91bUwqGGKVZnQcSKNu4km5DqLIU=; b=fT4gJTfa8RmuhacbY2LG4n4HDxEZ7BaIcYjxhzsJmcgpOGwhJV3HrNFobaWEv24If8 jCd1JPlFq8bDj+U+HdMpR5QwPELRD7GwKmgK8d02wfGJAep93x/l+1xZnV61keoXMDIB CaA9XwRRLXfNHtArFxs3PzvxzAKGNoS9c5Nd58wruKzde9gsbe/RVFp1gM1j7gEdJraS iNhjldOH2AtsCdRyqe4DBle3iy/iMStimRirZoUZJmPnREkrA/C4JiWSC76no5jIQRpD pXkw8u8Vz8MehbVlmySytA2j4VWd2Vkjo0Av8gRr/7Jtg+X0C5g0fuF2hJV2GJEbStq1 6iXQ== X-Gm-Message-State: AOAM532QX2Wa1J4gpKGAjtb3F6D42DRAoiVH3QHvaEqVdBaK03z902Qt dmECwvVGXTwlYmkws5BPOOM= X-Google-Smtp-Source: ABdhPJxwBnyEO54gL2R17JkbLW1ziIdBfZQQgqYqxdTgw1yrPLsJvwdGm9QHCWln7dm/R0+y0F0HGg== X-Received: by 2002:a1c:bac2:: with SMTP id k185mr11390054wmf.148.1614991594975; Fri, 05 Mar 2021 16:46:34 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id r2sm6347877wrt.8.2021.03.05.16.46.34 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 05 Mar 2021 16:46:34 -0800 (PST) From: zimoun To: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system In-Reply-To: References: <86a6rh7oyr.fsf@gmail.com> <86r1ktsaw3.fsf@gmail.com> <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> Date: Sat, 06 Mar 2021 01:42:08 +0100 Message-ID: <864khpru3j.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi, On Sat, 06 Mar 2021 at 00:23, raid5atemyhomework wrote: > Hi zimoun, > > Thanks, this is a definite improvement and I have set both systems to > use it as the first item in `substitute-server`. I'll make a patch for > the manual at least, then close this issue once that patch is > accepted. Ok. > So I was thinking of modifying the installer so at least some page > offers up options for mirrors. However, because of the way the > installer works, it would have to be done by `(gnu installer > services)`, which does not use `modify-services` on the base service > list. [...] > Is that something that has any chance of getting accepted into Guix? > I'd rather not do any coding unless this has any chance at all of > getting merged in. >From my point of view, I will get a better chance for an answer if you ask on guix-devel with an appropriate subject, rather in (relatively) long thread inside a bug report with a subject out this very question. My 2 cent. ;-) Cheers, simon From debbugs-submit-bounces@debbugs.gnu.org Sun Mar 14 20:14:04 2021 Received: (at 46942) by debbugs.gnu.org; 15 Mar 2021 00:14:04 +0000 Received: from localhost ([127.0.0.1]:34503 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLarz-0007Zx-RK for submit@debbugs.gnu.org; Sun, 14 Mar 2021 20:14:04 -0400 Received: from mail-40132.protonmail.ch ([185.70.40.132]:54100) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLarx-0007Z9-Cj for 46942@debbugs.gnu.org; Sun, 14 Mar 2021 20:14:02 -0400 Date: Mon, 15 Mar 2021 00:13:48 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1615767234; bh=hEU7Mz4fbyhq+s22duhAPebBajWAQSJHuYGODRLGyu0=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=usIq7KhiiydN8b9t0GdKZz1h7cM4d/NJri7HiHf3AUXPvR811O43QRWMFOmU0aCf9 ZUmr7aba9BMWU7pQAVofxxpxZM36u+KScMGabzo/NfNinKly+UylMcbm1xWRkmAgHK jV8CWptA+UYcT+55QRh/938q0EFGjqeVUapP/YiQ= To: zimoun From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: <864khpru3j.fsf@gmail.com> References: <86a6rh7oyr.fsf@gmail.com> <86r1ktsaw3.fsf@gmail.com> <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> <864khpru3j.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Hello all, Unfortunately, it seems that the SJTU server is somewhat unreliable, I some= times get random failures in various parts talking to the substitute server= , complaining of strange responses from the server: ``` Backtrace: In guix/ui.scm: 2164:12 19 (run-guix-command _ . _) In guix/scripts/substitute.scm: 652:2 18 (guix-substitute . _) In unknown file: 17 (with-continuation-barrier #) In ice-9/boot-9.scm: 1736:10 16 (with-exception-handler _ _ #:unwind? _ # _) In unknown file: 15 (apply-smob/0 #) In ice-9/boot-9.scm: 1736:10 14 (with-exception-handler _ _ #:unwind? _ # _) 1736:10 13 (with-exception-handler _ _ #:unwind? _ # _) 1731:15 12 (with-exception-handler # =E2=80=A6) In guix/scripts/substitute.scm: 701:17 11 (_) 410:7 10 (process-substitution _ "/gnu/store/yfzsz94qy92c7m9w0j= =E2=80=A6" =E2=80=A6) In ice-9/boot-9.scm: 1736:10 9 (with-exception-handler _ _ #:unwind? _ # _) In guix/scripts/substitute.scm: 419:9 8 (_) In ice-9/boot-9.scm: 1731:15 7 (with-exception-handler # =E2=80=A6) 1669:16 6 (raise-exception _ #:continuable? _) 1667:16 5 (raise-exception _ #:continuable? _) 1669:16 4 (raise-exception _ #:continuable? _) 1764:13 3 (_ #<&compound-exception components: (#<&error> #<&irri= =E2=80=A6>) 1669:16 2 (raise-exception _ #:continuable? _) 1667:16 1 (raise-exception _ #:continuable? _) 1669:16 0 (raise-exception _ #:continuable? _) ice-9/boot-9.scm:1669:16: In procedure raise-exception: Throw to key `bad-response' with args `("Bad Response-Line: ~s" (""))'. Backtrace: In ice-9/boot-9.scm: 1736:10 4 (with-exception-handler _ _ #:unwind? _ # _) In unknown file: 3 (apply-smob/0 #) In ice-9/boot-9.scm: 718:2 2 (call-with-prompt _ _ #) In ice-9/eval.scm: 619:8 1 (_ #(#(#))) In guix/ui.scm: 2164:12 0 (run-guix-command _ . _) guix/ui.scm:2164:12: In procedure run-guix-command: Throw to key `bad-response' with args `("Bad Response-Line: ~s" (""))'. substitution of /gnu/store/yfzsz94qy92c7m9w0jbll7slc2pcap45-guix-packages-b= ase failed guix pull: error: corrupt input while restoring archive from # ``` I configured `guix-daemon` to have two substitute URLs: SJTUG, and the offi= cial Cuirass in Berlin. My expectation is that if the SJTUG server fails, = it should fall back on using the Cuirass server. So my problems are two-fold: * Apparently the SJTUG mirror sometimes acts in ways that aren't quite how = Guix expects it. Either SJTUG or Guix has to be fixed so they talk in comp= atible manners. * Multiple Substitute URLs are not useful for the mirroring configuration w= here one server is temporarily unable to properly serve; further servers ar= e not checked. I'm still not satisfied with this solution overall. Yes it's fast but it's= imperfect. I recently had to rebuild an OS (because I was dumb; the Guix language for = shepherd services can easily lead you deadlocking shepherd itself) and had = supreme difficulty reinstalling, because the Berlin server was too slow (wo= uld have taken ~10hours downloading everything) while the SJTUG server was = unreliable and would consistently break the automated install. I had to `g= uix system build --fallback` separately and *then* `guix system init` manua= lly. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 15 03:21:43 2021 Received: (at 46942) by debbugs.gnu.org; 15 Mar 2021 07:21:43 +0000 Received: from localhost ([127.0.0.1]:34800 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLhXq-0003bF-Vz for submit@debbugs.gnu.org; Mon, 15 Mar 2021 03:21:43 -0400 Received: from albert.telenet-ops.be ([195.130.137.90]:48000) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLhXo-0003b6-4J for 46942@debbugs.gnu.org; Mon, 15 Mar 2021 03:21:41 -0400 Received: from ptr-bvsjgyjmffd7q9timvx.18120a2.ip6.access.telenet.be ([IPv6:2a02:1811:8c09:9d00:aaf1:9810:a0b8:a55d]) by albert.telenet-ops.be with bizsmtp id gXMe240040mfAB406XMeBg; Mon, 15 Mar 2021 08:21:38 +0100 Message-ID: Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system From: Maxime Devos To: raid5atemyhomework , zimoun Date: Mon, 15 Mar 2021 08:21:32 +0100 In-Reply-To: References: <86a6rh7oyr.fsf@gmail.com> <86r1ktsaw3.fsf@gmail.com> <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> <864khpru3j.fsf@gmail.com> Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-GM8O78PPnKAqXipp7b8R" User-Agent: Evolution 3.34.2 MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telenet.be; s=r21; t=1615792898; bh=XUtTKpKDgxssItInVFyPQWz4BVIpcj1smSjWaYaSVQs=; h=Subject:From:To:Cc:Date:In-Reply-To:References; b=TAuiWgMyQMGLT/aNE+bvkFt+TKV/wAQCtWmWEqCe5gMAzY9Fcz8rILMb05ckig5Lr 49i7xLvU87c1UALpxbpiSUW0eGkK1XtJi7vLv8Cd0Q6lg2iqfeQiLX3NK2r16zq6zU +GAq7PuyAk2KhfkVetCenp6WPa2tDlbj6jll1+TmZEyxDz6D+geljXZFgMRDv/Q71n zfdyD6vQHY63AfuGIZwCuN/haOzX5avcJkMw/mULdd5f2PskxI7Px1ka9maobPnLQ4 Dl0UVwqVkzI1Ow2AHZ6g8O9bbIa5JgV2E/iWMBJWzfxo/PS9rLab/Sn2gAd8NUFLjI x8bQ6KMI6DkZw== X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) --=-GM8O78PPnKAqXipp7b8R Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, 2021-03-15 at 00:13 +0000, raid5atemyhomework via Bug reports for G= NU Guix wrote: > Hello all, >=20 > [...] > I recently had to rebuild an OS (because I was dumb; the Guix language > for shepherd services can easily lead you deadlocking shepherd itself) > and had supreme difficulty reinstalling, [...] Reinstalling after a messed up configuration file shouldn't be necessary. At least when using GRUB as bootloader, guix keeps some old (& presumably not broken) system generations around, that can be selected when booting from the bootloader. (I don't recall exactly how the menu is named, maybe =E2=80=98Old system generations of $HOSTNAMES?) Greetings, Maxime. --=-GM8O78PPnKAqXipp7b8R Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iI0EABYIADUWIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCYE8K/BccbWF4aW1lZGV2 b3NAdGVsZW5ldC5iZQAKCRBJ4+4iGRcl7rLyAQCjY1+ynWZu4dtcoemrhTrxbT5k oK7tbX1vAjM4pTQfrAEAridUBgcbzQWDozD56gc5m04O6FGy2jL8nmkOAAYKdgw= =fMem -----END PGP SIGNATURE----- --=-GM8O78PPnKAqXipp7b8R-- From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 15 06:01:55 2021 Received: (at 46942) by debbugs.gnu.org; 15 Mar 2021 10:01:55 +0000 Received: from localhost ([127.0.0.1]:34908 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLk2t-0007jh-Bx for submit@debbugs.gnu.org; Mon, 15 Mar 2021 06:01:55 -0400 Received: from mail-40140.protonmail.ch ([185.70.40.140]:30641) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLk2r-0007jR-5g for 46942@debbugs.gnu.org; Mon, 15 Mar 2021 06:01:53 -0400 Date: Mon, 15 Mar 2021 10:01:39 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1615802506; bh=Hr7Q6NYsa+Mn/OcDaVmb6opm26Ozb1ZhWGF1HZUVC5g=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=uZC6PkKviPcnzT/PzQQ0t2PXjTgQdySYDBcchLu+1eGO/PPh8H/81eIKwe3FP2Jsc DqqH0T03QmRh6qJlYwqeIqKB4lU5tdVnlcHqBRhH/4zeHscsYH8rj2M2yOM9i8UCGn m3fPA0ewLvc2LPlz0y8T62zwptfJwmW9ljnKwdtk= To: Maxime Devos From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: References: <86a6rh7oyr.fsf@gmail.com> <86r1ktsaw3.fsf@gmail.com> <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> <864khpru3j.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org>, zimoun X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Maxime, > On Mon, 2021-03-15 at 00:13 +0000, raid5atemyhomework via Bug reports for= GNU Guix wrote: > > > Hello all, > > [...] > > I recently had to rebuild an OS (because I was dumb; the Guix language > > for shepherd services can easily lead you deadlocking shepherd itself) > > and had supreme difficulty reinstalling, [...] > > Reinstalling after a messed up configuration file shouldn't be necessary. > At least when using GRUB as bootloader, guix keeps some old (& presumably > not broken) system generations around, that can be selected when booting > from the bootloader. (I don't recall exactly how the menu is named, > maybe =E2=80=98Old system generations of $HOSTNAMES?) Unfortunately I had a long-standing latent bug in my configuration file tha= t triggered on a (persistent on-disk) edge case which would cause the sheph= erd process to enter an infinite loop (because the shepherd configuration l= anguage is Turing-complete enough to allow infinite loops in the first plac= e). All the remaining generations (since I didn't like keeping more than a= dozen, and had recently been excessively tweaking the configuration file) = had this bug, so I had no way of reverting to an even older generation that= predated the bug. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 15 06:14:49 2021 Received: (at 46942) by debbugs.gnu.org; 15 Mar 2021 10:14:49 +0000 Received: from localhost ([127.0.0.1]:34917 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLkFM-00082Q-SZ for submit@debbugs.gnu.org; Mon, 15 Mar 2021 06:14:49 -0400 Received: from mail-40130.protonmail.ch ([185.70.40.130]:54056) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lLkFL-00082A-4A for 46942@debbugs.gnu.org; Mon, 15 Mar 2021 06:14:48 -0400 Date: Mon, 15 Mar 2021 10:14:28 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1615803280; bh=BOJBcJTwkqGHRJ02CSvLjeio6qW1WGYiVB8Awdi5jSQ=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=h4NBirE0JUxvb6W13SUfLgny/8AxnUuLFS33X9tAcciunhVUjGQm07QYlKKkvbqNK 5C6OKNNpppZPTOSCqN1CVROz3vY/GBO8gdhkxBjA8hxyaVwctEppspqHsFiBzBjpZZ ucHDYXJ0JfcOtheEFlg67BjLvWn1sV3bqyWMGkZM= To: Maxime Devos From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: References: <86r1ktsaw3.fsf@gmail.com> <8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-_1rjQ_oiY=@protonmail.com> <864khpru3j.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org>, zimoun X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) > Hi Maxime, > > > On Mon, 2021-03-15 at 00:13 +0000, raid5atemyhomework via Bug reports f= or GNU Guix wrote: > > > > > Hello all, > > > [...] > > > I recently had to rebuild an OS (because I was dumb; the Guix languag= e > > > for shepherd services can easily lead you deadlocking shepherd itself= ) > > > and had supreme difficulty reinstalling, [...] > > > > Reinstalling after a messed up configuration file shouldn't be necessar= y. > > At least when using GRUB as bootloader, guix keeps some old (& presumab= ly > > not broken) system generations around, that can be selected when bootin= g > > from the bootloader. (I don't recall exactly how the menu is named, > > maybe =E2=80=98Old system generations of $HOSTNAMES?) > > Unfortunately I had a long-standing latent bug in my configuration file t= hat triggered on a (persistent on-disk) edge case which would cause the she= pherd process to enter an infinite loop (because the shepherd configuration= language is Turing-complete enough to allow infinite loops in the first pl= ace). All the remaining generations (since I didn't like keeping more than = a dozen, and had recently been excessively tweaking the configuration file)= had this bug, so I had no way of reverting to an even older generation tha= t predated the bug. And regardless, this kind of problem shouldn't occur in the first place. * Instead of running the `start` code in the same process 1 (which is speci= al enough that no amount of `kill -s SIGKILL 1` will work even if you manag= e to log into a console), `shepherd` should really run it in a separate pro= cess and monitor it if it's taking too long and possibly allow the operator= to break out of it. Principle of least power and all that... * If you want details: there is a shepherd service A that is a requiremen= t of shepherd service B, however the daemon launched by A needed to reach a= particular point in its initialization before B can start talking to it. = B itself will fail to start if A has not reached that point in initializati= on. The extra code I added to the `start` of shepherd service A was to wai= t for that point of initialization before A was considered "started". It t= urned out it was buggy in that if the point was not reached in 1 second it = would inadvertently enter an incorrect looping logic (ironically, the logic= was supposed to exit it after 60 seconds, but I got increment/decrement cr= ossed, meaning it would always loop as long as you never reached -60 second= s, which was impossible....) that ended up being an infinite loop and preve= nting process 1 from advancing. And this point was getting delayed when th= e process launched by A had to do a lot of (important) data on-disk that it= needed to process at startup, so it was persistent on-disk data that would= need > 1 second to process, thus ensuring that the buggy code would be ent= ered. * If this was a new computer it would also be just as screwed during instal= lation anyway, you should consider this a fortuitous discovery of a latent = bug. * New users trying out Guix System that happen to get hit by this bug mig= ht very well decide that Guix is not stable enough for them to commit to us= ing. Thanks raid5atemyhomework From debbugs-submit-bounces@debbugs.gnu.org Tue Mar 16 08:38:26 2021 Received: (at 46942) by debbugs.gnu.org; 16 Mar 2021 12:38:26 +0000 Received: from localhost ([127.0.0.1]:38416 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lM8xt-0005Ks-I2 for submit@debbugs.gnu.org; Tue, 16 Mar 2021 08:38:25 -0400 Received: from mail-40137.protonmail.ch ([185.70.40.137]:58389) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lM8xp-0005Kd-OD for 46942@debbugs.gnu.org; Tue, 16 Mar 2021 08:38:23 -0400 Date: Tue, 16 Mar 2021 12:38:05 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1615898294; bh=M4771+WLPp5/Nt84boGG5b7CdPThA5U20KCXXFSjgqU=; h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From; b=YR4any/1drkcHxmzFxw6IYGBtMb4RFCRbCGNgxGXLkTDO57otal4BvyNkWSsEemgh 4PbbN4/GBZH/3C9/e7RksxCUkg4zKrZtg7FHsQlRdbaQ2mxIKyyQkM45wAOE2oE16G eiPMQ4VcQE6H9XpdeR6+bAiTmqSzpPAhp4A5AChY= To: Maxime Devos From: raid5atemyhomework Subject: Re: bug#46942: ci.guix.gnu.org is slow from my system Message-ID: In-Reply-To: References: =?us-ascii?Q?__<86r1ktsaw3.fsf@gmail.com>_<8bR3l7i5BPTQzCRF0BRGqsXMNe-DIM0QlFFj7qG-SJd7Z-KgPdvdlM5ZkhFlX8GVqQSocUgx9WCBthzbVrgZ5c2zMBegDmhCj-=5F1rjQ=5FoiY=3D@protonmail.com>__<864khpru3j.fsf@gmail.com>____?= MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on mailout.protonmail.ch X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 46942 Cc: "pengmeiyu@riseup.net" , "46942@debbugs.gnu.org" <46942@debbugs.gnu.org>, zimoun X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: raid5atemyhomework Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Here's another error! For *this* instance notice the very slow download speed; other downloads go= t up to 2MiB/s. If my understanding is correct the SJTUG server is effecti= vely a caching proxy, meaning that the low download speed here probably mea= ns that the SJTUG server itself is downloading from the Berlin Cuirass. As= noted before, often an issue with using ci.guix.gnu.org is that for large = multi-megabyte substitutes sometimes the Berlin server will just disconnect= and EOF early, so I suspect something similar is happening to the SJTUG se= rver. ``` downloading from https://mirror.sjtu.edu.cn/guix/nar/lzip/6fa3h0n957hr2nbd0= 5ygjnk4idjq122q-ffmpeg-4.3.2 ... ffmpeg-4.3.2 8.8MiB = 1= 3KiB/s 05:05 [####### ] 44.2% Backtrace: In guix/store/deduplication.scm: 227:2 19 (dump-file/deduplicate "/gnu/store/6fa3h0n957hr2nbd05y= =E2=80=A6" =E2=80=A6) In ice-9/ports.scm: 463:17 18 (call-with-output-file _ _ #:binary _ #:encoding _) In guix/store/deduplication.scm: 232:10 17 (_ _) In guix/serialization.scm: 261:6 16 (dump _) 247:20 15 (dump # # =E2=80=A6) In unknown file: 14 (get-bytevector-n! # # 0 #) In guix/store/deduplication.scm: 203:22 13 (read! #vu8(85 110 107 110 111 119 110 32 112 105 99 =E2=80= =A6) =E2=80=A6) In unknown file: 12 (get-bytevector-n! # # 0 #) In gcrypt/hash.scm: 223:13 11 (read! #vu8(85 110 107 110 111 119 110 32 112 105 99 =E2=80= =A6) =E2=80=A6) In unknown file: 10 (get-bytevector-n! # # 0 #) In lzlib.scm: 501:4 9 (lzread! # # =E2=80=A6) In unknown file: 8 (get-bytevector-n # 65537) In guix/progress.scm: 358:30 7 (read! _ _ _) In unknown file: 6 (get-bytevector-n! # # 0 #) In web/response.scm: 95:2 5 (read! _ _ _) In ice-9/boot-9.scm: 1669:16 4 (raise-exception _ #:continuable? _) 1669:16 3 (raise-exception _ #:continuable? _) 1764:13 2 (_ #<&compound-exception components: (#<&error> #<&irri= =E2=80=A6>) 1669:16 1 (raise-exception _ #:continuable? _) 1669:16 0 (raise-exception _ #:continuable? _) ice-9/boot-9.scm:1669:16: In procedure raise-exception: Throw to key `bad-response' with args `("EOF while reading response body: ~= a bytes of ~a" (4112173 9196598))'. Backtrace: In ice-9/boot-9.scm: 1736:10 4 (with-exception-handler _ _ #:unwind? _ # _) In unknown file: 3 (apply-smob/0 #) In ice-9/boot-9.scm: 718:2 2 (call-with-prompt _ _ #) In ice-9/eval.scm: 619:8 1 (_ #(#(#))) In guix/ui.scm: 2164:12 0 (run-guix-command _ . _) guix/ui.scm:2164:12: In procedure run-guix-command: Throw to key `bad-response' with args `("EOF while reading response body: ~= a bytes of ~a" (4112173 9196598))'. substitution of /gnu/store/6fa3h0n957hr2nbd05ygjnk4idjq122q-ffmpeg-4.3.2 fa= iled guix upgrade: error: some substitutes for the outputs of derivation `/gnu/s= tore/9xx9kbbjals2y7llhak65fnnyfh9rkyq-gnome-tweaks-3.34.1.drv' failed (usua= lly happens due to networking issues); try `--fallback' to build derivation= from source ``` Thanks raid5atemyhomework