From debbugs-submit-bounces@debbugs.gnu.org Sat Feb 05 13:55:40 2022 Received: (at submit) by debbugs.gnu.org; 5 Feb 2022 18:55:40 +0000 Received: from localhost ([127.0.0.1]:35596 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nGQDj-0004Tx-Rh for submit@debbugs.gnu.org; Sat, 05 Feb 2022 13:55:40 -0500 Received: from lists.gnu.org ([209.51.188.17]:35786) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nGQDi-0004Tq-1n for submit@debbugs.gnu.org; Sat, 05 Feb 2022 13:55:38 -0500 Received: from eggs.gnu.org ([209.51.188.92]:60752) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nGQDg-0004B9-48 for bug-guix@gnu.org; Sat, 05 Feb 2022 13:55:37 -0500 Received: from [2a02:1800:110:4::f00:1a] (port=52810 helo=albert.telenet-ops.be) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nGQDd-0008UF-K8 for bug-guix@gnu.org; Sat, 05 Feb 2022 13:55:35 -0500 Received: from [172.20.10.5] ([213.251.108.188]) by albert.telenet-ops.be with bizsmtp id rWvT2600C43vTVR06WvUuW; Sat, 05 Feb 2022 19:55:29 +0100 Message-ID: <8d9fe7cf7290ef0dbe12a42f2026c711b588e80e.camel@telenet.be> Subject: remaining connection slots are reserved for non-replication superuser connections From: Maxime Devos To: bug-guix@gnu.org Date: Sat, 05 Feb 2022 19:55:22 +0100 Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-CpDNtqAVF+Z7a4+dNnVP" User-Agent: Evolution 3.38.3-1 MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telenet.be; s=r22; t=1644087329; bh=m7RofLx92imYP0sjw7xG2MqzhKx+MsqhRrmHEQ5NxNQ=; h=Subject:From:To:Date; b=gTk3jL6OTOoSpxoA5fr+KqjGxphDI0EK79T+XJX6cPDNgQ6YNg3sYkseXt8quGVkX V2+PL4ZpmtzV/jtRtKjllegz0UC1mT1IPVIg69EYmZicZiKbhNc2QvstZOMmHhx0ae x0IjA1/5qHKcrzGrGB+Ozu6CE83b8qvCxyFg5IP3sjVb/B2o/siWeCNooMjM2tiSz5 w9/ISJUWgQbYfGj5NyZhdsfOQd+7GJadZuuSz7iE16N20bbSr/yPPsNxq3CY+ucImY 8C2enY7EPO3/SjU/zqTIVoWXpOwYgg2/cWSueQZQRvgJ2krLXKX16SW7+/3m5TkY3o cyCL4/qB57Rew== X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a02:1800:110:4::f00:1a (failed) Received-SPF: pass client-ip=2a02:1800:110:4::f00:1a; envelope-from=maximedevos@telenet.be; helo=albert.telenet-ops.be X-Spam_score_int: -19 X-Spam_score: -2.0 X-Spam_bar: -- X-Spam_report: (-2.0 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) --=-CpDNtqAVF+Z7a4+dNnVP Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi guix, Looking at , I noticed the 'core-updates' jobset failed. Looking at the log=20 https://ci.guix.gnu.org/eval/66725/log/raw>, I see squee.scm:257:10: In procedure connect-to-postgres-paramstring: Throw to key `psql-connect-error' with args `(connection-bad "FATAL: remai= ning connection slots are reserved for non-replication superuser connection= s\n")'. with bactkrace: Backtrace: In ice-9/boot-9.scm: 1752:10 13 (with-exception-handler _ _ #:unwind? _ # _) In unknown file: 12 (apply-smob/0 #) In ice-9/boot-9.scm: 724:2 11 (call-with-prompt _ _ #) In ice-9/eval.scm: 619:8 10 (_ #(#(#))) In cuirass/ui.scm: 104:10 9 (run-cuirass-command _ . _) In ice-9/boot-9.scm: 152:2 8 (with-fluid* _ _ _) In ice-9/eval.scm: 293:34 7 (_ #(#(#(#(# ?)) ?) ?)) 191:35 6 (_ #(#(#(#(# ?)) ?) ?)) In cuirass/utils.scm: 123:6 5 (make-worker-thread-channel _ #:parallelism _) In srfi/srfi-1.scm: 634:9 4 (for-each # ?) In cuirass/utils.scm: 125:21 3 (_ . _) In ice-9/eval.scm: 155:9 2 (_ #(#(#))) In cuirass/database.scm: 375:12 1 (db-open #:database _) In squee.scm: 257:10 0 (connect-to-postgres-paramstring _) I don't know what that means precisely but apparently something went wrong. Possibly relevant: . It might be possible to use persistent connections and/or raise the connect= ion limit. Greetings, Maxime. --=-CpDNtqAVF+Z7a4+dNnVP Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iI0EABYKADUWIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCYf7IGhccbWF4aW1lZGV2 b3NAdGVsZW5ldC5iZQAKCRBJ4+4iGRcl7l2qAQDHV7fHG4AfAJZXCmkz6dqkXURk w+47b6LGlRAfMwnnpAD/ZZhX5S/oLpxR7+anMQEReTVR6RgUPPTCYZCgb3XLbA8= =RtHg -----END PGP SIGNATURE----- --=-CpDNtqAVF+Z7a4+dNnVP-- From debbugs-submit-bounces@debbugs.gnu.org Sat Feb 05 14:38:05 2022 Received: (at 53806) by debbugs.gnu.org; 5 Feb 2022 19:38:05 +0000 Received: from localhost ([127.0.0.1]:35629 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nGQsn-0005Wv-EU for submit@debbugs.gnu.org; Sat, 05 Feb 2022 14:38:05 -0500 Received: from eggs.gnu.org ([209.51.188.92]:59870) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nGQsl-0005WS-Ig for 53806@debbugs.gnu.org; Sat, 05 Feb 2022 14:38:03 -0500 Received: from [2001:470:142:3::e] (port=40872 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nGQsf-0005kQ-O0; Sat, 05 Feb 2022 14:37:57 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=+YCm2yVliPC5mOJqqlckcVUlIq5n3898gn8LISz51wc=; b=dytiOOcgS+21r/mQlTaP blXLH4Q3rCba2lw0fCphOiSHNOOSFWOZPWiYiz73I7Z/MWVa0UbpcDPVA4KQCk94g0LkmQtQgOA4K ThY+0m0g1JFgK3+sITxTS7JbRxc3yS9X6yHMGJyR2Ebn8bCQLXTuvSowCFRW0m5aGIhhN12EM6v0J hU40l27/HASwUi6hxD9RENgGb+Gyl+Bqq8vM1zv4LUfVmW7M7bmBe76sRjoL37VO6o8zfx4N3ZEoQ PzJ8xgUUZXiQpSigrImY8cOm3lER0mOAWSsKbhAvZrJ7ip7skevK/KtfA90SuDhGWFNZHYJ/8F/Fv 3aoxmVE4MZD7ow==; Received: from [2a01:e0a:19b:d9a0:2f3b:16f2:b776:3ef9] (port=54844 helo=meije) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nGQsf-0006gC-Bq; Sat, 05 Feb 2022 14:37:57 -0500 From: Mathieu Othacehe To: Maxime Devos Subject: Re: bug#53806: remaining connection slots are reserved for non-replication superuser connections References: <8d9fe7cf7290ef0dbe12a42f2026c711b588e80e.camel@telenet.be> Date: Sat, 05 Feb 2022 20:37:55 +0100 In-Reply-To: <8d9fe7cf7290ef0dbe12a42f2026c711b588e80e.camel@telenet.be> (Maxime Devos's message of "Sat, 05 Feb 2022 19:55:22 +0100") Message-ID: <87a6f5gl4c.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 53806 Cc: 53806@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello Maxime, Thanks for the report. There are 300 postgresql connection slots on berlin which is enough under nominal CI activity. However, this issue: http://issues.guix.gnu.org/53463 causes most of the Guix jobset evaluations to hang, hence the connection slots starvation. Now the 53463 issue is probably caused by two underlying issues: - Offloading is never timing out - Guix on aarch64 can not be evaluated correctly. Many things to fix then. Mathieu