From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 05 08:20:41 2022 Received: (at submit) by debbugs.gnu.org; 5 Sep 2022 12:20:41 +0000 Received: from localhost ([127.0.0.1]:46703 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1oVB5l-0007EQ-3B for submit@debbugs.gnu.org; Mon, 05 Sep 2022 08:20:41 -0400 Received: from lists.gnu.org ([209.51.188.17]:50272) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1oVB5j-0007EJ-VT for submit@debbugs.gnu.org; Mon, 05 Sep 2022 08:20:40 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:39116) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1oVB5V-0005zX-6G for bug-guix@gnu.org; Mon, 05 Sep 2022 08:20:28 -0400 Received: from mira.cbaines.net ([212.71.252.8]:36712) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oVB5T-0002fY-GA for bug-guix@gnu.org; Mon, 05 Sep 2022 08:20:24 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:54d1:d5d4:280e:f699]) by mira.cbaines.net (Postfix) with ESMTPSA id B6F7927BBE9 for ; Mon, 5 Sep 2022 13:20:20 +0100 (BST) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 59290069 for ; Mon, 5 Sep 2022 12:20:19 +0000 (UTC) User-agent: mu4e 1.6.11; emacs 28.1 From: Christopher Baines To: bug-guix@gnu.org Subject: guix lint --checkers=derivation doesn't complete, Too many heap sections Date: Mon, 05 Sep 2022 13:14:44 +0100 Message-ID: <87zgfe2eta.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.4 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.4 (--) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable When running the derivation checker on all packages for recent guix revisions, it dones't seem to complete. Instead, you get an error which I think comes from the garbage collection implementation that Guile uses: =E2=86=92 guix lint --checkers=3Dderivation Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS Aborted I noticed this on data.guix.gnu.org, as it effectively does something similar when trying to record the lint warnings for a revision. Maybe there's enough derivations now that the process of computing them all is too much for Guile? Or maybe it's something in the graph that's forming a loop? Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmMV6YFfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XfU7w//cHJcZtBT3iIysKhsQ43zcjqyJAYuoXrV IXgZNhhghy72rWi7GSPprIBSDlSLJNb7DSDmY9Eg0JUghK6H1sQgeHfke/urNUzF KTFPV4opM6h86ZeP5rMBCy54Ocrwac9t9uFQ5nSi8Y5iqEicS+0MF+n/7WIZF/xa MpJGBsB9MWoTy1RWT3rX/Na+dpQIhboC4C8HoxMo+nFWPPNTASoqfuWbuOGZ0938 9Vy3r5SdIKiM4d1DUnRWbvjqF572e9rX40kbPHyhJzuOl/wRr5F86Ok1/+v2pfq2 RgR+LjElFNIDr1njkCC3y4dLRbDU6jdz3hfvDxGqr1gq7pR1vNJ4O2IEjwOZ57CW C8aOcZ9lSqNNKmu14UzPj5sZpipfJkIbYn/sAM0y8ttLog4QnN21Ps0S0CFZEA2c 9IPQVZHxY3xmOBQTB6KQxBMd05CgnVeBBRsVIAuTuChyH7u/K4dDmiLj+MCY8cBG G8wyZMkElrnexHfxTA18HJEN0F7rJB5k/NAXyLTN5HeFmWbZ2H+iGrC1oMapv43D 6B66IACRqofcn2bOE0rgs7YYfApjKOlfZVSSkUY02jq5hXW0wnXx3PXQnAQZBVuW Cgiazs+cRG/4Qvqmsf1UbIPrCFeQoVDo+WTvNgAnBPemD3xJ5Qozhr0OjTuArZTV TUFfAo8gSwQ= =cX6S -----END PGP SIGNATURE----- --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Tue Sep 06 03:30:29 2022 Received: (at 57596) by debbugs.gnu.org; 6 Sep 2022 07:30:30 +0000 Received: from localhost ([127.0.0.1]:49458 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1oVT2T-0003xH-Jc for submit@debbugs.gnu.org; Tue, 06 Sep 2022 03:30:29 -0400 Received: from mira.cbaines.net ([212.71.252.8]:41412) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1oVT2S-0003x8-AG for 57596@debbugs.gnu.org; Tue, 06 Sep 2022 03:30:28 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:54d1:d5d4:280e:f699]) by mira.cbaines.net (Postfix) with ESMTPSA id AAEA027BBE9 for <57596@debbugs.gnu.org>; Tue, 6 Sep 2022 08:30:26 +0100 (BST) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 15725381 for <57596@debbugs.gnu.org>; Tue, 6 Sep 2022 07:30:26 +0000 (UTC) References: <87zgfe2eta.fsf@cbaines.net> User-agent: mu4e 1.6.11; emacs 28.1 From: Christopher Baines To: 57596@debbugs.gnu.org Subject: Re: bug#57596: guix lint --checkers=derivation doesn't complete, Too many heap sections Date: Tue, 06 Sep 2022 08:28:32 +0100 In-reply-to: <87zgfe2eta.fsf@cbaines.net> Message-ID: <87v8q12c4t.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 57596 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Christopher Baines writes: > When running the derivation checker on all packages for recent guix > revisions, it dones't seem to complete. Instead, you get an error which > I think comes from the garbage collection implementation that Guile > uses: > > =E2=86=92 guix lint --checkers=3Dderivation > Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS > Aborted > > I noticed this on data.guix.gnu.org, as it effectively does something > similar when trying to record the lint warnings for a revision. > > Maybe there's enough derivations now that the process of computing them > all is too much for Guile? Or maybe it's something in the graph that's > forming a loop? I've got a bit more information now, I'm guessing the changes in [1] just tipped the balance as that's when the data service instances started not being able to process revisions. 1: https://git.savannah.gnu.org/cgit/guix.git/log/?qt=3Drange&q=3Daae98c297= 214f87eb45302863adb021078c41a6f...d22a5c18517d662516fc93889534367fd3a448f2 I think I've managed to work around this now in the data service [2], but the problem still remains when running the linter through the script. 2: http://git.savannah.gnu.org/cgit/guix/data-service.git/commit/?id=3Db3d5= 9c650a45429f90953e8fd865a3ba76a891cf --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmMW9xJfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XeXoA/+MELfiirvsfRGeaJJLPh2psszBNGbQ0Yz ED43hSgFUxOz8OYcQ3aAEhLIs+ew0E23yZmxv1HGmfqCp2CUJo5nmrMmPwuXUETC yT86A+rlgsrQNXXHm8Ec8r+BfjQMDOnSVfi3Prh8iWpPlsbporfdYaXYzZn1iBpO czfW/iZoOkyQ5yXBZa7lGdVRknqhNJWm0rG5KP5aJcNMjkFKoLVne9SUMY6LJoUI 77THuWuCXYTexrtnOcvMGU6QVN5CprOLqOoPgL6cbt+w5Hh2i7pmjnsxrXaACGeT njVrijiGMu9QaV3zPP24VoNE4npsVTnLIMIFP9SA2EeulupPn7PhwKAM+uEpn2qh 0jJJczGPqIipK/7TCSQB1Pqyspqq5fyQSp+nKdD/mHtt1nh7w9zv0cKkVB0BwjQV IYugoNmzIliQINEpzoKodWSj1byvzhQGDC58qFpAwkPdRkipDAnFb0cYypZmmwWz RGCAQOWUnWaBGml5Wn4nqtHBG3m0zhRkYOfzMZRAjTTd8KBf4V4NHVzRfjxRDnxF Mf8pVT8uF/hqsQkd8Gr5wQD+z6m3ep85QT+xX0kFVRM0uHti2camscV9VcANlTOC 25DoQLlBDDHeVPiQbhkRtx1NUx2qIx7iTL1eC65HGnM6b8NsafzR1ckS88GOMJlQ 7MSlT16zPJE= =2gJp -----END PGP SIGNATURE----- --=-=-=--