From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 24 12:32:28 2017 Received: (at submit) by debbugs.gnu.org; 24 Jun 2017 16:32:28 +0000 Received: from localhost ([127.0.0.1]:35867 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dOnz1-0004V4-Uh for submit@debbugs.gnu.org; Sat, 24 Jun 2017 12:32:28 -0400 Received: from eggs.gnu.org ([208.118.235.92]:41134) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dOnz0-0004Ur-61 for submit@debbugs.gnu.org; Sat, 24 Jun 2017 12:32:26 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dOnyt-00004u-Sh for submit@debbugs.gnu.org; Sat, 24 Jun 2017 12:32:20 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_DKIM_INVALID autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:37608) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dOnyt-0008W9-Pj for submit@debbugs.gnu.org; Sat, 24 Jun 2017 12:32:19 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:60336) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dOnys-0004B9-IE for bug-guix@gnu.org; Sat, 24 Jun 2017 12:32:19 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dOnyp-0008KK-FH for bug-guix@gnu.org; Sat, 24 Jun 2017 12:32:18 -0400 Received: from out3-smtp.messagingengine.com ([66.111.4.27]:35579) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dOnyp-0008HW-6s for bug-guix@gnu.org; Sat, 24 Jun 2017 12:32:15 -0400 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 5A65D20743; Sat, 24 Jun 2017 12:32:14 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Sat, 24 Jun 2017 12:32:14 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=content-type:date:from:message-id:mime-version:subject:to :x-me-sender:x-me-sender:x-sasl-enc:x-sasl-enc; s=mesmtp; bh=lGw WMq0oGBldgub/mhfeEAi1MTPVdDh2xgyWVWVhrb8=; b=lvjS4aqqlypmLeA88Yc GArBH7PsDyk3TV3Cz5G7cFDCuk0u5LZ9OB4JlpYC8yj0Wbv5yRkMVr+tfQ7xUFxa JFik4hv2oE1VRRDZGNLMsB4ndbyZsxX/o+8mQfIC7uVa3RX3bESejMjlWVZG1THp fkrigoy1/oEYqehqJ522rDzE= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-sender:x-me-sender:x-sasl-enc :x-sasl-enc; s=fm1; bh=lGwWMq0oGBldgub/mhfeEAi1MTPVdDh2xgyWVWVhr b8=; b=KBIkzGmugT6XvHzla7XVCZYpVkq7exLUayTYzOSDjrWUEW3f97jGPWv5v Ucx5qz/q44+y7e/jyxLOkS2AGNCJ2uqeqTnjdTX2CQj30TWlklXYLCnjYnCVMTKT t2VEMOpPO21lci30tJ0E09eygUQ/zcZxfO1mH4MlO2jPNKmdGruf/BpJTA/Xr9Df jR2glS925xPSHVr8HnxRP//UYaXuK3VOWjLdkAsFrUq4nI+S8QHKL5LP31otzQim lcWO7DKVk0FRzfKBzQzzf+CtKFwtdXLEsAHfcD4DS7fp/0e5c5eSaP3CiwiHjQ4m 6NiqEV6lkArHNqW6aY+B1fGPb8BXg== X-ME-Sender: X-Sasl-enc: InmPQHiHxwtl6QDVyPPdi5PwM1AWH0Q+4AbZ66mUsJdu 1498321934 Received: from localhost (unknown [128.64.129.7]) by mail.messagingengine.com (Postfix) with ESMTPA id 20118245EF for ; Sat, 24 Jun 2017 12:32:14 -0400 (EDT) Date: Sat, 24 Jun 2017 12:32:12 -0400 From: Leo Famulari To: bug-guix@gnu.org Subject: Wrong type (expecting mutex) Message-ID: <20170624163212.GA22546@jasmine.lan> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="IJpNTDwzlM2Ie8A6" Content-Disposition: inline User-Agent: Mutt/1.8.3 (2017-05-23) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -4.1 (----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -4.1 (----) --IJpNTDwzlM2Ie8A6 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline I just got this from `guix pull`: guix pull --url=file:///gnu/store/l552m9iavw3amq5c8vaifqlxvw09r2nz-guix-latest.tar.gz unpacking '/gnu/store/l552m9iavw3amq5c8vaifqlxvw09r2nz-guix-latest.tar.gz'... updating list of substitutes from 'https://4606.nsupdate.info'... 100.0%o'... 0.0% The following derivation will be built: /gnu/store/xxy7l4jfjx6n62anfqlw4gbmafypqgrs-guix-latest.drv updating list of substitutes from 'https://4606.nsupdate.info'... 100.0%o'... 0.0% substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0% copying and compiling to '/gnu/store/r1z6nbkrl99hxppcvcprc8vgbzakv632-guix-latest' with Guile 2.2.2... loading... 25.4% of 606 filesrandom seed for tests: 1498319917 loading... 99.8% of 606 files compiling... 99.2% of 606 filesBacktrace: 2 (primitive-load "/gnu/store/v9a9cqzh41qg4sixl2mk5kndglp?") In ./guix/build/pull.scm: 181:8 1 (build-guix _ _ #:system _ #:storedir _ #:localstatedir ?) In ice-9/threads.scm: 289:22 0 (loop _) ice-9/threads.scm:289:22: In procedure loop: ice-9/threads.scm:289:22: Wrong type (expecting mutex): (3556 . #) Some deprecated features have been used. Set the environment variable GUILE_WARN_DEPRECATED to "detailed" and rerun the program to get more information. Set it to "no" to suppress this message. builder for `/gnu/store/xxy7l4jfjx6n62anfqlw4gbmafypqgrs-guix-latest.drv' failed with exit code 1 guix pull: error: build failed: build of `/gnu/store/xxy7l4jfjx6n62anfqlw4gbmafypqgrs-guix-latest.drv' failed --IJpNTDwzlM2Ie8A6 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAllOlAsACgkQJkb6MLrK fwiEhg/+I/BbkX/UecS4mGQoAR++PP5UGQXPSEV40QYQJrkfQjlSYnOQl29P+V7c VPKzt6jaFmimT6NrxM5cxRh4OB6AG72LzFSZtsBQIYqEh/p62h9ACUHGMhzyt/2j fqipI0JjoEq4nHOrcFWgid4Vgymx+9clQ1eXFxvg6ifSACpKe/2bQdUZrU7JUjHe APntKfcfO9BHx9g7giBr2X0ExDdfnvYkwyKdQYQPu73kwnb/MzoLygrf5A3Cekmc Q+fX3N3SfgsTjhum9+2q+PYLwY1aBFzY6ZB45LAv/jC1NRJgePvGwS6FhMaQ7Tbe SZS75Ws4OlPElMdplUX/BjPf2YOlqyu2nh1FTpEBMaInEqPOEIuj6Hv+C9550PbL Rk5SHNy14DqfJ9q9Q3EUsxi9KUXwflg6R0ERE5xAoXJT+SELaZa4hb6aeyHw7JPf KN9/M6unLJPF0Eta9ISmq3SbwkpdSGCTWqhFXKUiSZVfBulhfhYUAA9dx8tAsl0B gplUV4EbqGsKjvufV9dR4VzkXPzApIoYWnjdGaH5Bzoy35N3iAuusafmxk1L1zMS 9+sBklIyhgwV1pVM92XtlMVEwE1rmud6JP1xAWMOKMdvX/mBDIiu8Edmfo9KXfTp Trhj/feFkc6DqP2kO7XxvWV7EtLOmCZNNLNvTrDLvspYnK20jAA= =0Tn+ -----END PGP SIGNATURE----- --IJpNTDwzlM2Ie8A6-- From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 24 12:55:14 2017 Received: (at 27476) by debbugs.gnu.org; 24 Jun 2017 16:55:14 +0000 Received: from localhost ([127.0.0.1]:35877 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dOoL3-00051t-Vx for submit@debbugs.gnu.org; Sat, 24 Jun 2017 12:55:14 -0400 Received: from out3-smtp.messagingengine.com ([66.111.4.27]:49635) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dOoL1-00051k-Ux for 27476@debbugs.gnu.org; Sat, 24 Jun 2017 12:55:12 -0400 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 4735020866; Sat, 24 Jun 2017 12:55:11 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Sat, 24 Jun 2017 12:55:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc :x-sasl-enc; s=mesmtp; bh=vg0TAYwFuAYu2KpWb8qVJAm8Bfh2oc2k2in2ib S5qUI=; b=BloIgDCZm0RQvyeGXUZY/WfTnLAKGtGoxEdksetNkaSBbCBf9IoVyk mePWwo+EfyBDEl6maGaUNv00DAwFYs5n6dzIas7BnNkXH+jEOI0EQZUxQbDqfj7A U/2oe4pgb207SP2653stYIK5D+t9xvSU7YUxqQfvnzEDvhU16odZ0= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc:x-sasl-enc; s=fm1; bh=vg0TAYwFuAYu2KpWb8 qVJAm8Bfh2oc2k2in2ibS5qUI=; b=J4fei6NYxb4qZ3uvNjVe/GQ30s+ZP/RmcJ SC4fvGeb59UzNTX2yKRszAdFKsiDjAZd0NkIzXxY8SvlRWgoFKujnbJ+7dfqSuFp ImJ5v3LfwPcrFFfOVZHhTdqzPw0q+izdw6Fg8sEdbGfbuDtrEARTsb+jS3yc1MeL qIkGGFWFuTMSfMscAwBXzIcJELbt323PvitdWWXrcArrYV1NLyr77Qhv2htNlxvP 39n7c+QWy33bcxHcmVDe6nzG6ZYUKZdW8olvP/92oFp9ImGsoZvhTEtc0lO3BrZm ypv6cbm55yQ7HgymeS+haIuLlYJXWxgRT6ZeUEbemeYIkDATfhhA== X-ME-Sender: X-Sasl-enc: BSQNPRyhX9t4n5ZenGSRHuoYfLsKbbK5mRo+Kx/FtQKO 1498323311 Received: from localhost (unknown [128.64.129.7]) by mail.messagingengine.com (Postfix) with ESMTPA id 085C224232 for <27476@debbugs.gnu.org>; Sat, 24 Jun 2017 12:55:11 -0400 (EDT) Date: Sat, 24 Jun 2017 12:55:08 -0400 From: Leo Famulari To: 27476@debbugs.gnu.org Subject: Re: Wrong type (expecting mutex) Message-ID: <20170624165508.GA21063@jasmine.lan> References: <20170624163212.GA22546@jasmine.lan> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="a8Wt8u1KmwUX3Y2C" Content-Disposition: inline In-Reply-To: <20170624163212.GA22546@jasmine.lan> User-Agent: Mutt/1.8.3 (2017-05-23) X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27476 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) --a8Wt8u1KmwUX3Y2C Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Jun 24, 2017 at 12:32:12PM -0400, Leo Famulari wrote: > compiling... 99.2% of 606 filesBacktrace: > 2 (primitive-load "/gnu/store/v9a9cqzh41qg4sixl2mk5kndglp?") > In ./guix/build/pull.scm: > 181:8 1 (build-guix _ _ #:system _ #:storedir _ #:localstatedir ?) > In ice-9/threads.scm: > 289:22 0 (loop _) >=20 > ice-9/threads.scm:289:22: In procedure loop: > ice-9/threads.scm:289:22: Wrong type (expecting mutex): (3556 . #) It didn't happen when I re-ran the command. --a8Wt8u1KmwUX3Y2C Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAllOmWwACgkQJkb6MLrK fwjyww//V0K5yStbzjftvKHeMnTSPBUTU2/utmx9lnfKRznSPQ3ldl7Ic5Vpiw6U B9nL6A+Akm3Ev4D0FSd5j7gQqrkIsfcS46NpPvSINUgBz8iTi4qpRzGtpLp6cyuD fGkI6w09UpdFndYus3gJN6xpCGzsvOT1lLKI9eUkB8H4lFbKVapHsOeDwNRda+7H EEABtkbygcd/vtc9MpioT8d2rN0rMuTEe/yKxZ+me+3+L/wwYoH0DKlvnGTy0zwj LbErBC8zh09UtvDJiHfmDKXFoU3Pgpf87fX0KjcDC/SpcHl7lfq071U1FMleUDdS 6h34eB5anXrZHDoPifIDXOZKl1B/w5fpPrYPzCN/jjGs10IFCkGRFeag1ZRNYhh9 5FSpSGiiAvnKdCvz4LJzXH60KAzIrsTCXpC97OMsp3dbL7/N4vMTwErH8P3KhiVP A36tHV8tVbAYhueM68YGFZ5nl+9ZQd+GTwCA6D3WEgrfA5s707cgBIefzgm9wahl VRHvWS+b16yTjEuc8ZXGk5KsuqBoT7PzYBAzC9vByFCE/lIEieXcijvJyPcGSb3Z hJqUKfSN1Q1H0EzRn2La+fxxAU1dzN6cNAvuIL3ur6UPo3zBGvHKlSIdIkBBKoDA DvDBNjKtpNh7s2z9RTfPetxkiF24lYvbqzbNCWItYWy92dWpTKM= =YvSI -----END PGP SIGNATURE----- --a8Wt8u1KmwUX3Y2C-- From debbugs-submit-bounces@debbugs.gnu.org Sat Aug 26 10:13:17 2017 Received: (at control) by debbugs.gnu.org; 26 Aug 2017 14:13:17 +0000 Received: from localhost ([127.0.0.1]:56740 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlbps-0005VE-WA for submit@debbugs.gnu.org; Sat, 26 Aug 2017 10:13:17 -0400 Received: from eggs.gnu.org ([208.118.235.92]:57400) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlbps-0005V2-5s for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:13:16 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dlbpi-0004ax-7E for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:13:11 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:36435) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dlbpi-0004aq-3u for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:13:06 -0400 Received: from x590d0e4d.dyn.telefonica.de ([89.13.14.77]:51362 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dlbph-0001os-4l for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:13:05 -0400 Date: Sat, 26 Aug 2017 16:12:39 +0200 Message-Id: <877exqa04o.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) severity 27476 important From debbugs-submit-bounces@debbugs.gnu.org Sat Aug 26 10:14:57 2017 Received: (at control) by debbugs.gnu.org; 26 Aug 2017 14:14:57 +0000 Received: from localhost ([127.0.0.1]:56748 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlbrV-0005Y6-Hg for submit@debbugs.gnu.org; Sat, 26 Aug 2017 10:14:57 -0400 Received: from eggs.gnu.org ([208.118.235.92]:57607) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlbrT-0005Xu-Uh for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:14:56 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dlbrJ-00051w-QL for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:14:50 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:36448) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dlbrJ-00051q-NL for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:14:45 -0400 Received: from x590d0e4d.dyn.telefonica.de ([89.13.14.77]:51370 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dlbrH-0001uj-A1 for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:14:45 -0400 Date: Sat, 26 Aug 2017 16:14:24 +0200 Message-Id: <874lsua01r.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) merge 27476 27652 From debbugs-submit-bounces@debbugs.gnu.org Sat Aug 26 10:18:18 2017 Received: (at control) by debbugs.gnu.org; 26 Aug 2017 14:18:18 +0000 Received: from localhost ([127.0.0.1]:56761 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlbuk-0007Up-BX for submit@debbugs.gnu.org; Sat, 26 Aug 2017 10:18:18 -0400 Received: from eggs.gnu.org ([208.118.235.92]:57970) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlbui-0007Ua-CA for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:18:16 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dlbuY-0005yQ-Dz for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:18:11 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:36466) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dlbuY-0005yK-Ao for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:18:06 -0400 Received: from x590d0e4d.dyn.telefonica.de ([89.13.14.77]:51382 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dlbuW-00025W-WA for control@debbugs.gnu.org; Sat, 26 Aug 2017 10:18:06 -0400 Date: Sat, 26 Aug 2017 16:18:00 +0200 Message-Id: <87ziam8lbb.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) retitle 27476 Compilation with 'guix pull' crashes non-deterministically on many-core machines From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 22 10:11:13 2017 Received: (at 27476) by debbugs.gnu.org; 22 Sep 2017 14:11:13 +0000 Received: from localhost ([127.0.0.1]:52955 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvOfh-00012Y-2p for submit@debbugs.gnu.org; Fri, 22 Sep 2017 10:11:13 -0400 Received: from eggs.gnu.org ([208.118.235.92]:38308) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvOff-00012K-TZ for 27476@debbugs.gnu.org; Fri, 22 Sep 2017 10:11:12 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dvOfU-0005nS-Bu for 27476@debbugs.gnu.org; Fri, 22 Sep 2017 10:11:06 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD, URIBL_BLOCKED autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:38451) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dvOfU-0005nN-6x; Fri, 22 Sep 2017 10:11:00 -0400 Received: from [193.50.110.164] (port=54698 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dvOfT-00015R-Po; Fri, 22 Sep 2017 10:11:00 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus , Andy Wingo Subject: Re: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 1 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Fri, 22 Sep 2017 16:10:57 +0200 In-Reply-To: <87h8vvp1q7.fsf@elephly.net> (Ricardo Wurmus's message of "Fri, 22 Sep 2017 10:38:24 +0200") Message-ID: <87377esu1a.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27476 Cc: help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Hi Ricardo, Ricardo Wurmus skribis: > The following derivation will be built: > /gnu/store/yvyfkns3w3vm7ynwbr7mvxcmin4gd2a0-guix-latest.drv > copying and compiling to '/gnu/store/7m52dkr98nhwgpsx20mmpwyw2yzj58d3-gui= x-latest' with Guile 2.2.2... > loading... 25.4% of 629 filesrandom seed for tests: 1506066913 > loading... 99.8% of 629 files > compiling... 69.2% of 629 filesice-9/threads.scm:289:22: In procedure= loop: > ice-9/threads.scm:289:22: Syntax error: > guix/scripts.scm:130:2: >>=3D: >>=3D (bind) used outside of 'with-monad' = in form (>>=3D (apply set-build-options* #:use-substitutes > ptions)) (lambda (unused-value) (mbegin %store-monad (mlet %store-monad (= (derivation (origin->derivation (package-source pack > tutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-out= puts derivation))))))) This was reported at , and I suspect a thread-safety issue. However, syntax parameters are purely functional AFAICS, so I fail to see why multithreading could be a problem. Andy, any idea what could be causing this? Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 25 03:27:39 2017 Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 07:27:39 +0000 Received: from localhost ([127.0.0.1]:57167 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwNnn-0006KR-Gh for submit@debbugs.gnu.org; Mon, 25 Sep 2017 03:27:39 -0400 Received: from pb-sasl1.pobox.com ([64.147.108.66]:61507 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwNnl-0006KJ-P3 for 27476@debbugs.gnu.org; Mon, 25 Sep 2017 03:27:38 -0400 Received: from sasl.smtp.pobox.com (unknown [127.0.0.1]) by pb-sasl1.pobox.com (Postfix) with ESMTP id 3D206A6035; Mon, 25 Sep 2017 03:27:37 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc :subject:references:date:in-reply-to:message-id:mime-version :content-type:content-transfer-encoding; s=sasl; bh=DVt3EzsOBV7u Z5AhEO4A3g+dHgc=; b=N/aY3d/Sio6KhGb+NViqJoKOqNwBDwRUdIH6eGR3zjun mC4w38eGGrNjwNfE7WMyOeFETs9RpWgki+uo0f/SHUx7VAroGsVGmfYCw9r6BVZp FO689FuP/on39tRJxfGbbZeOIm+YhrJczb6xeR2xLFIhkpo8/+e80xEaYbqRcjA= Received: from pb-sasl1.nyi.icgroup.com (unknown [127.0.0.1]) by pb-sasl1.pobox.com (Postfix) with ESMTP id 27477A6034; Mon, 25 Sep 2017 03:27:37 -0400 (EDT) Received: from rusty (unknown [88.160.190.192]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by pb-sasl1.pobox.com (Postfix) with ESMTPSA id 566AEA6033; Mon, 25 Sep 2017 03:27:36 -0400 (EDT) From: Andy Wingo To: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: Re: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> Date: Mon, 25 Sep 2017 09:27:45 +0200 In-Reply-To: <87377esu1a.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Fri, 22 Sep 2017 16:10:57 +0200") Message-ID: <87k20nz18u.fsf@igalia.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Pobox-Relay-ID: 00F48708-A1C3-11E7-9348-2C49D6707B88-02397024!pb-sasl1.pobox.com X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On Fri 22 Sep 2017 16:10, ludo@gnu.org (Ludovic Court=C3=A8s) writes: > Hi Ricardo, > > Ricardo Wurmus skribis: > >> The following derivation will be built: >> /gnu/store/yvyfkns3w3vm7ynwbr7mvxcmin4gd2a0-guix-latest.drv >> copying and compiling to '/gnu/store/7m52dkr98nhwgpsx20mmpwyw2yzj58d3-gu= ix-latest' with Guile 2.2.2... >> loading... 25.4% of 629 filesrandom seed for tests: 1506066913 >> loading... 99.8% of 629 files >> compiling... 69.2% of 629 filesice-9/threads.scm:289:22: In procedur= e loop: >> ice-9/threads.scm:289:22: Syntax error: >> guix/scripts.scm:130:2: >>=3D: >>=3D (bind) used outside of 'with-monad'= in form (>>=3D (apply set-build-options* #:use-substitutes >> ptions)) (lambda (unused-value) (mbegin %store-monad (mlet %store-monad = ((derivation (origin->derivation (package-source pack >> tutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-ou= tputs derivation))))))) > > This was reported at , and I suspect a > thread-safety issue. However, syntax parameters are purely functional > AFAICS, so I fail to see why multithreading could be a problem. > > Andy, any idea what could be causing this? I have heard of but not seen a number of similar bugs: errors that "can't happen" but which appear under multiple threads. I don't know what underlying pattern is. Has anyone found a test case that reliably reproduces? Andy From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 25 04:43:23 2017 Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 08:43:23 +0000 Received: from localhost ([127.0.0.1]:57242 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwOz5-000830-8s for submit@debbugs.gnu.org; Mon, 25 Sep 2017 04:43:23 -0400 Received: from mail.lassieur.org ([83.152.10.219]:33158) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwOz3-00082r-M2 for 27476@debbugs.gnu.org; Mon, 25 Sep 2017 04:43:22 -0400 Received: from newt (46.218.109.88 [46.218.109.88]) by mail.lassieur.org (OpenSMTPD) with ESMTPSA id 2ed02151 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Mon, 25 Sep 2017 08:42:35 +0000 (UTC) References: <87h8vvp1q7.fsf@elephly.net> User-agent: mu4e 0.9.18; emacs 25.2.1 From: =?utf-8?Q?Cl=C3=A9ment?= Lassieur To: Ricardo Wurmus Subject: Re: guix pull fails on powerful server In-reply-to: <87h8vvp1q7.fsf@elephly.net> Date: Mon, 25 Sep 2017 10:43:16 +0200 Message-ID: <87k20nrwwr.fsf@lassieur.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) I got it too for the first time yesterday on my 128G RAM and 32 CPU cores server: --8<---------------cut here---------------start------------->8--- substitute: updating list of substitutes from [...] Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'... Building from Git commit 3140844e33254316348135b03762eaeb04764544... substitute: updating list of substitutes from [...] The following derivation will be built: /gnu/store/7143x1dd2r5kch8dldyylz1ljhp3nird-guix-latest.drv copying and compiling to '/gnu/store/8a42yc4yxslrr1hf7wk5x5mddbs76yqm-guix-latest' with Guile 2.2.2... loading... 25.3% of 632 filesrandom seed for tests: 1506279202 loading... 99.8% of 632 files compiling... 94.8% of 632 filesice-9/threads.scm:289:22: In procedure loop: ice-9/threads.scm:289:22: Syntax error: guix/gexp.scm:530:8: return: return used outside of 'with-monad' in form (return output) Some deprecated features have been used. Set the environment variable GUILE_WARN_DEPRECATED to "detailed" and rerun the program to get more information. Set it to "no" to suppress this message. builder for `/gnu/store/7143x1dd2r5kch8dldyylz1ljhp3nird-guix-latest.drv' failed with exit code 1 guix pull: error: build failed: build of `/gnu/store/7143x1dd2r5kch8dldyylz1ljhp3nird-guix-latest.drv' failed --8<---------------cut here---------------end--------------->8--- And then, today, again: --8<---------------cut here---------------start------------->8--- substitute: updating list of substitutes from [...] Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'... Building from Git commit 66660960ba75233ae5b6c539f43d97d06d64e9ad... substitute: updating list of substitutes from [...] The following derivation will be built: /gnu/store/dmv64icdan1fqrl00czgwx1an923fzda-guix-latest.drv copying and compiling to '/gnu/store/slqcrr5gwhi1zqv21wjp0l973zs3dywc-guix-latest' with Guile 2.2.2... loading... 25.3% of 632 filesrandom seed for tests: 1506327995 loading... 99.8% of 632 files compiling... 94.8% of 632 filesice-9/threads.scm:289:22: In procedure loop: ice-9/threads.scm:289:22: Syntax error: guix/gexp.scm:539:10: return: return used outside of 'with-monad' in form (return (derivation->output-path drv)) Some deprecated features have been used. Set the environment variable GUILE_WARN_DEPRECATED to "detailed" and rerun the program to get more information. Set it to "no" to suppress this message. builder for `/gnu/store/dmv64icdan1fqrl00czgwx1an923fzda-guix-latest.drv' failed with exit code 1 guix pull: error: build failed: build of `/gnu/store/dmv64icdan1fqrl00czgwx1an923fzda-guix-latest.drv' failed --8<---------------cut here---------------end--------------->8--- From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 25 09:03:40 2017 Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 13:03:40 +0000 Received: from localhost ([127.0.0.1]:57476 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwT2y-0002xS-88 for submit@debbugs.gnu.org; Mon, 25 Sep 2017 09:03:40 -0400 Received: from eggs.gnu.org ([208.118.235.92]:36062) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwT2w-0002xG-7i for 27476@debbugs.gnu.org; Mon, 25 Sep 2017 09:03:38 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dwT2n-0004k8-SI for 27476@debbugs.gnu.org; Mon, 25 Sep 2017 09:03:33 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=BAYES_40,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:38352) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dwT2n-0004k1-OY; Mon, 25 Sep 2017 09:03:29 -0400 Received: from [193.50.110.164] (port=44370 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dwT2n-0006eA-BB; Mon, 25 Sep 2017 09:03:29 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Andy Wingo Subject: Re: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 4 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 25 Sep 2017 15:03:27 +0200 In-Reply-To: <87k20nz18u.fsf@igalia.com> (Andy Wingo's message of "Mon, 25 Sep 2017 09:27:45 +0200") Message-ID: <87a81jj5gg.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Hi, Andy Wingo skribis: > On Fri 22 Sep 2017 16:10, ludo@gnu.org (Ludovic Court=C3=A8s) writes: > >> Hi Ricardo, >> >> Ricardo Wurmus skribis: >> >>> The following derivation will be built: >>> /gnu/store/yvyfkns3w3vm7ynwbr7mvxcmin4gd2a0-guix-latest.drv >>> copying and compiling to '/gnu/store/7m52dkr98nhwgpsx20mmpwyw2yzj58d3-g= uix-latest' with Guile 2.2.2... >>> loading... 25.4% of 629 filesrandom seed for tests: 1506066913 >>> loading... 99.8% of 629 files >>> compiling... 69.2% of 629 filesice-9/threads.scm:289:22: In procedu= re loop: >>> ice-9/threads.scm:289:22: Syntax error: >>> guix/scripts.scm:130:2: >>=3D: >>=3D (bind) used outside of 'with-monad= ' in form (>>=3D (apply set-build-options* #:use-substitutes >>> ptions)) (lambda (unused-value) (mbegin %store-monad (mlet %store-monad= ((derivation (origin->derivation (package-source pack >>> tutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-o= utputs derivation))))))) >> >> This was reported at , and I suspect a >> thread-safety issue. However, syntax parameters are purely functional >> AFAICS, so I fail to see why multithreading could be a problem. >> >> Andy, any idea what could be causing this? > > I have heard of but not seen a number of similar bugs: errors that > "can't happen" but which appear under multiple threads. I don't know > what underlying pattern is. Has anyone found a test case that reliably > reproduces? With this program: --8<---------------cut here---------------start------------->8--- (use-modules (ice-9 threads) (srfi srfi-1)) (define-syntax-parameter foo (identifier-syntax +)) (define threads (unfold (lambda (x) (> x 100)) (lambda (x) (call-with-new-thread (lambda () (while #t (macroexpand '(syntax-parameterize ((foo (identifier-syntax -))) (foo y z))))))) 1+ 0)) (for-each join-thread threads) --8<---------------cut here---------------end--------------->8--- I managed to get a segfault: --8<---------------cut here---------------start------------->8--- $ guile syntax-parms.scm ;;; note: source file /home/ludo/src/guix/syntax-parms.scm ;;; newer than compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/h= ome/ludo/src/guix/syntax-parms.scm.go ;;; note: auto-compilation is enabled, set GUILE_AUTO_COMPILE=3D0 ;;; or pass the --no-auto-compile argument to disable. ;;; compiling /home/ludo/src/guix/syntax-parms.scm ;;; compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/home/ludo/src/guix= /syntax-parms.scm.go In /home/ludo/src/guix/syntax-parms.scm: 13:17 13 (_) In ice-9/psyntax.scm: 1233:22 12 (expand-top-sequence (#(ribcage #(x) #((m-1dff1b83541ce327-7f9= 7c #)) #) # =E2=80=A6) =E2=80=A6) In ice-9/boot-9.scm: 230:17 11 (map1 (#)) In ice-9/psyntax.scm: 2053:19 10 (_ _ #() (foo y z) ()) In ice-9/boot-9.scm: 230:17 9 (map1 #()) In ice-9/psyntax.scm: 1408:12 8 (_ _) 1788:11 7 (lp (1) (11 0 . 0)) 1678:45 6 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 230:17 5 (map1 ((tmp-1dff1b83541ce327-7f98b 0 . 0))) In ice-9/psyntax.scm: 2701:67 4 Adres-eraro --8<---------------cut here---------------end--------------->8--- =E2=80=A6 but then I failed to reproduce it again (that was on my 4-thread laptop). Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 25 10:03:58 2017 Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 14:03:58 +0000 Received: from localhost ([127.0.0.1]:58507 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwTzJ-0008Ou-Q8 for submit@debbugs.gnu.org; Mon, 25 Sep 2017 10:03:57 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21030) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwTzI-0008Om-N7 for 27476@debbugs.gnu.org; Mon, 25 Sep 2017 10:03:57 -0400 Received: from localhost (141.80.193.136 [141.80.193.136]) by mx.zohomail.com with SMTPS id 1506348159380560.9028820360278; Mon, 25 Sep 2017 07:02:39 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: guix pull fails on powerful server In-reply-to: <87a81jj5gg.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Mon, 25 Sep 2017 16:02:36 +0200 Message-ID: <87bmlyzxj7.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) Ludovic Courtès writes: > With this program: > > --8<---------------cut here---------------start------------->8--- > (use-modules (ice-9 threads) > (srfi srfi-1)) > > (define-syntax-parameter foo > (identifier-syntax +)) > > (define threads > (unfold (lambda (x) (> x 100)) > (lambda (x) > (call-with-new-thread > (lambda () > (while #t > (macroexpand > '(syntax-parameterize ((foo (identifier-syntax -))) > (foo y z))))))) > 1+ > 0)) > > (for-each join-thread threads) > --8<---------------cut here---------------end--------------->8--- I have tried this programme on my 16 core 32G workstation, and on the 192 core 1.5T server, but could not get it to segfault. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Sat Sep 30 04:00:21 2017 Received: (at 27476) by debbugs.gnu.org; 30 Sep 2017 08:00:21 +0000 Received: from localhost ([127.0.0.1]:39922 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dyChB-00009H-5M for submit@debbugs.gnu.org; Sat, 30 Sep 2017 04:00:21 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21084) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dyCh9-000099-LU for 27476@debbugs.gnu.org; Sat, 30 Sep 2017 04:00:20 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1506758347; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; l=3106; bh=z5hRJpafsL4XwurybfnJaYSJwZZ7TGKmWGM309OnDKs=; b=gr4r5A3f8K9B/oInIQdG7+9RV9p6hkywmhhM9rd/kEpX28VaNLy7iWdZhX6MC9fw G3NDbKnAhPgHmp8T75mgQ2zugtuqyzc6nxJTxtq6IGBNljNGWcocIh04pDEiKNn5TKG YeFvv8KiSwfocpEhgEBDeoCsubiYRyuUpLwn1TXs= Received: from mail.zoho.com by mx.zohomail.com with SMTP id 1506758347763647.6839451815042; Sat, 30 Sep 2017 00:59:07 -0700 (PDT) Received: from localhost (port-92-200-5-175.dynamic.qsc.de [92.200.5.175]) by mx.zohomail.com with SMTPS id 1506758347686916.7135800001489; Sat, 30 Sep 2017 00:59:07 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: guix pull fails on powerful server In-reply-to: <87bmlyzxj7.fsf@elephly.net> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Sat, 30 Sep 2017 09:59:03 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Message-ID: <87shf44ny0.fsf@elephly.net> X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) I=E2=80=99ve tried =E2=80=9Cguix pull=E2=80=9D on the same server again, th= is time limiting CPUs with =E2=80=9Ctaskset -c 0 guix pull=E2=80=9D: --8<---------------cut here---------------start------------->8--- $ taskset -c 0 guix pull guile: warning: failed to install locale warning: failed to install locale: Invalid argument substitute: guile: warning: failed to install locale substitute: warning: failed to install locale: Invalid argument Starting download of /tmp/guix-file.QleIQR >From https://git.savannah.gnu.org/cgit/guix.git/snapshot/master.tar.gz... ....tar.gz 1.6MiB/s 00:09 | 13.6MiB transf= erred unpacking '/gnu/store/g5246hzsj9vv1fmigdd7fh0060fybnbd-guix-latest.tar.gz'.= .. The following derivation will be built: /gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv copying and compiling to '/gnu/store/s3s7xlqa10mvf8v0ypxz8gzw3lcf1x5z-guix-= latest' with Guile 2.2.2... loading... 25.7% of 635 filesrandom seed for tests: 1506720257 loading... 99.8% of 635 files compiling... 69.1% of 635 filesice-9/threads.scm:289:22: In procedure l= oop: ice-9/threads.scm:289:22: Syntax error: guix/scripts/graph.scm:103:10: return: return used outside of 'with-monad' = in form (return (package-node-edges a)) Some deprecated features have been used. Set the environment variable GUILE_WARN_DEPRECATED to "detailed" and rerun the program to get more information. Set it to "no" to suppress this message. builder for `/gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv' f= ailed with exit code 1 guix pull: error: build failed: build of `/gnu/store/z5bhk17nxmdhvj0g4cy038= p25mzh1gys-guix-latest.drv' failed --8<---------------cut here---------------end--------------->8--- After limiting memory with =E2=80=9Culimit -Sv 5000000=E2=80=9D: --8<---------------cut here---------------start------------->8--- ice-9/threads.scm:289:22: In procedure loop: ice-9/threads.scm:289:22: Syntax error: guix/scripts/pull.scm:192:8: >>=3D: >>=3D (bind) used outside of 'with-mona= d' in form (>>=3D (indirect-root-added latest) (lambda (done) (mlet* %store= -monad () (if (and (file-exists? latest) (string=3D? (readlink latest) sour= ce-dir)) (begin (display (G_ "Guix already up to date\n")) (return #t)) (be= gin (switch-symlinks latest source-dir) (format #t (G_ "updated ~a successf= ully deployed under `~a'~%") %guix-package-name latest) (return #t)))))) Some deprecated features have been used. Set the environment variable GUILE_WARN_DEPRECATED to "detailed" and rerun the program to get more information. Set it to "no" to suppress this message. builder for `/gnu/store/afji58647yzz7cr9dvlj87sd3ad36lbk-guix-latest.drv' f= ailed with exit code 1 guix pull: error: build failed: build of `/gnu/store/afji58647yzz7cr9dvlj87= sd3ad36lbk-guix-latest.drv' failed --8<---------------cut here---------------end--------------->8--- It always crashes at around 69%. Is there another work-around I could try on this machine? -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Tue Oct 03 16:29:05 2017 Received: (at 27476) by debbugs.gnu.org; 3 Oct 2017 20:29:05 +0000 Received: from localhost ([127.0.0.1]:46875 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzToP-00088A-EE for submit@debbugs.gnu.org; Tue, 03 Oct 2017 16:29:05 -0400 Received: from out1-smtp.messagingengine.com ([66.111.4.25]:53851) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzToM-000881-Ka for 27476@debbugs.gnu.org; Tue, 03 Oct 2017 16:29:04 -0400 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 0ABF220BF7; Tue, 3 Oct 2017 16:29:02 -0400 (EDT) Received: from frontend1 ([10.202.2.160]) by compute5.internal (MEProxy); Tue, 03 Oct 2017 16:29:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.com; h= cc:content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc :x-sasl-enc; s=fm1; bh=dtB8YIfc4qPdKOptablEZaKKG7bIX0K3ijIIaML3E BM=; b=jqEEKkm+EVOM+AfhywJp3zjRZ4k7y3tfOwm/lZtGB1/X5PIqhQ6/sCQ7M wJuYO3nBjuDLZfXnuYl2bGm88XizTfPtvZGXKTtSiP8QdrXhWQJiuA0xa7R950hi sWoUCU7GUn6C1k/OwmHQ+/JzF2qO4rZid13K1q65cRnJ/lYXmv7xQn6XXFelJRJl f/DBsuIIZsHcTVerUpEjIZSAL8QInswnNwKh1G4yOnBqJy9X4FCqBze1ew4vFL39 pFl5HmWbhSIJtyuHdJqotKdHxOZas0fFUxCDUF6leXjup7rrmjmgjAARJiFUZyR5 5p7Fc7mFPJ/Jsmg52X+H/J2rwkORQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc:x-sasl-enc; s=fm1; bh=dtB8YIfc4qPdKOptab lEZaKKG7bIX0K3ijIIaML3EBM=; b=kN4UgXq20B3UQVQHeL81MIxRmrWD8H53Ra uOG8Eme40b3vpogXOHl4XuG22o+CjPrI2IO09M0DDYZl/LQsXD6c4yasPb6hSfd0 7bLunLA3OX7/G5Q3sSKR5Ar0qPOryz/ZJZM+uja7JAT/h7z4SA4mPOy+pO6KheXm PxFLHE+NIDEoxwofHMjXor9p0P6iHXOiNIZPcOaX3pzxcoDh29BfMylT5SjXjxgq H1VE30D1eoldv8k8p7Q2Y5X9wODIC5lx2D7lxaBXpqOdXzlTniCCIU78iq3HhtW5 bD15CDhukV4JjHMozWyU00JYs6x1rp+g5HebilYujHStPkPd9RFg== X-ME-Sender: X-Sasl-enc: RbPF4YcoyC8JP9SspC5o7qzi8kTJoO+ZXadow9/zxTO1 1507062541 Received: from localhost (cm-84.214.173.174.getinternet.no [84.214.173.174]) by mail.messagingengine.com (Postfix) with ESMTPA id 7D7347F927; Tue, 3 Oct 2017 16:29:01 -0400 (EDT) From: Marius Bakke To: Ricardo Wurmus , Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: guix pull fails on powerful server In-Reply-To: <87shf44ny0.fsf@elephly.net> References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> User-Agent: Notmuch/0.25.1 (https://notmuchmail.org) Emacs/25.2.1 (x86_64-unknown-linux-gnu) Date: Tue, 03 Oct 2017 22:29:00 +0200 Message-ID: <87a818dlgz.fsf@fastmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) --=-=-= Content-Type: text/plain Ricardo Wurmus writes: > Is there another work-around I could try on this machine? Using Guile 2.0 worked for me: guix package -r guix guile-git -i guile2.0-guix guile2.0-git --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCgAdFiEEu7At3yzq9qgNHeZDoqBt8qM6VPoFAlnT8wwACgkQoqBt8qM6 VPr7wQgAl78ceQ9rCYxUbent9nvxNXu6qQuHYnPqK4LHIgR3yQ3QV407vM5hjb7A rBTw6dQYqzOuCTdiEXDxolBvvS0tQabBnlkrURp6LpkLtEiiXOjd+0ahHXEP+y+B BFc0n+VkA5B6DuAlSbTVt/c1MKux2YGLUoYMIlvKFZgx+iSyUzRhWKoHkwYwtedp OJYuKREmz7aWw/W3ce9noI+IdD3qPfkSAPxpiHQy21DXm5/grg/SbQ0VCajXP4vL c3wkPqdwRMnwp677Dl7hKuiF3xu/k1SkzSmhFtU4KUlQyOTNPRjxG2IhqLeDrtkp Jjr58BrNgCV+7XBoxSL59+LrrEH70Q== =95WG -----END PGP SIGNATURE----- --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Wed Oct 04 09:17:09 2017 Received: (at 27476) by debbugs.gnu.org; 4 Oct 2017 13:17:09 +0000 Received: from localhost ([127.0.0.1]:47737 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzjXx-0006CR-7X for submit@debbugs.gnu.org; Wed, 04 Oct 2017 09:17:09 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21039) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzjXu-0006CI-Pc for 27476@debbugs.gnu.org; Wed, 04 Oct 2017 09:17:08 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507122962; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; l=2250; bh=ybw58W3m83AL66xSg8xY9xZegKQU1NB38Npyl05hiXg=; b=Ty+I4EYoC81FHoqRHaUXskpnuneSRaD7ECF3PmFb4q/EBBO3dsKBqpddKyQRP1pc E88gxZFCcKBXODdwHKVedNf5tUq4HW2UQ/67B60LpECZFf4qjKU4JPoyvoz+5Pli7ze Lay3LfOqsr/RzmU3g/6/kdabirDsWKyvXnzsFvd0= Received: from localhost (141.80.193.171 [141.80.193.171]) by mx.zohomail.com with SMTPS id 1507122962713381.53358242131094; Wed, 4 Oct 2017 06:16:02 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <87a818dlgz.fsf@fastmail.com> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: Marius Bakke Subject: Re: guix pull fails on powerful server In-reply-to: <87a818dlgz.fsf@fastmail.com> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Wed, 04 Oct 2017 15:15:58 +0200 Message-ID: <877ewb3vg1.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , Ludovic =?utf-8?Q?Court=C3=A8s?= , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Marius Bakke writes: > Ricardo Wurmus writes: > >> Is there another work-around I could try on this machine? > > Using Guile 2.0 worked for me: > > guix package -r guix guile-git -i guile2.0-guix guile2.0-git Unfortunately, this didn’t work for me. I tried this: guix package -i guile2.0-guix --with-source=/path/to/guix/checkout This printed a lot of repetitions of “warning: unknown warning type `macro-use-before-definition'” and eventually failed with this backtrace: --8<---------------cut here---------------start------------->8--- Backtrace: In ice-9/boot-9.scm: 160: 9 [catch #t # ...] In unknown file: ?: 8 [apply-smob/1 #] In ice-9/boot-9.scm: 66: 7 [call-with-prompt prompt0 ...] In ice-9/eval.scm: 432: 6 [eval # #] In ice-9/boot-9.scm: 2412: 5 [save-module-excursion #] 4091: 4 [#] 1734: 3 [%start-stack load-stack #] 1739: 2 [#] In unknown file: ?: 1 [primitive-load "/tmp/guix-build-guile2.0-guix-0.13.0-4.f1ddfe4.drv-0/source/./build-aux/compile-all.scm"] In ice-9/threads.scm: 99: 0 [loop (("guix/base16.scm" "guix/base32.scm" "guix/base64.scm" ...))] ice-9/threads.scm:99:22: In procedure loop: ice-9/threads.scm:99:22: In procedure fport_write: Bad address make[2]: *** [Makefile:5252: make-go] Error 1 make[2]: Leaving directory '/tmp/guix-build-guile2.0-guix-0.13.0-4.f1ddfe4.drv-0/source' make[1]: *** [Makefile:4383: all-recursive] Error 1 make[1]: Leaving directory '/tmp/guix-build-guile2.0-guix-0.13.0-4.f1ddfe4.drv-0/source' make: *** [Makefile:2973: all] Error 2 phase `build' failed after 149.5 seconds builder for `/gnu/store/aqz4d2bbihvdmxqb6rlb71c853jb4dp3-guile2.0-guix-0.13.0-4.f1ddfe4.drv' failed with exit code 1 guix package: error: build failed: build of `/gnu/store/aqz4d2bbihvdmxqb6rlb71c853jb4dp3-guile2.0-guix-0.13.0-4.f1ddfe4.drv --8<---------------cut here---------------end--------------->8--- -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Wed Oct 04 11:09:45 2017 Received: (at 27476) by debbugs.gnu.org; 4 Oct 2017 15:09:45 +0000 Received: from localhost ([127.0.0.1]:49057 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzlIv-0004Yt-8H for submit@debbugs.gnu.org; Wed, 04 Oct 2017 11:09:45 -0400 Received: from mail.lassieur.org ([83.152.10.219]:36850) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzlIt-0004Yj-RA for 27476@debbugs.gnu.org; Wed, 04 Oct 2017 11:09:44 -0400 Received: from newt (46.218.109.88 [46.218.109.88]) by mail.lassieur.org (OpenSMTPD) with ESMTPSA id ef620fad (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Wed, 4 Oct 2017 15:09:42 +0000 (UTC) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> User-agent: mu4e 0.9.18; emacs 25.3.1 From: =?utf-8?Q?Cl=C3=A9ment?= Lassieur To: Ricardo Wurmus Subject: Re: guix pull fails on powerful server In-reply-to: <87shf44ny0.fsf@elephly.net> Date: Wed, 04 Oct 2017 17:09:41 +0200 Message-ID: <87o9pnt0ei.fsf@lassieur.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , Ludovic =?utf-8?Q?Court=C3=A8s?= , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Ricardo Wurmus writes: > Is there another work-around I could try on this machine? My workaround was to build Guix from sources. But I'm sure you thought about it. From debbugs-submit-bounces@debbugs.gnu.org Wed Oct 04 12:18:28 2017 Received: (at 27476) by debbugs.gnu.org; 4 Oct 2017 16:18:28 +0000 Received: from localhost ([127.0.0.1]:49109 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzmNP-0006E8-Qf for submit@debbugs.gnu.org; Wed, 04 Oct 2017 12:18:27 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21048) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dzmNN-0006Dz-F1 for 27476@debbugs.gnu.org; Wed, 04 Oct 2017 12:18:26 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507133882; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; l=459; bh=thI38TFYp2IGodm7Sw1YkN6K+beqczm1B3KcGl+TkdE=; b=Uao9h2EAPFawNohZ5zuTsXkheYY4Z/RGohBQGUeN+Rk9K447os8yjfqWVGzlOzfV Ndb1mYr249k7wrB7y8sBh4fZ5Cixcp69V25VpbGQuO2yuZ/w0QT6Be+lnFNVjqWILHf oPcY2JGW0PUWb3Ojqxzu6hICXfg1FG/V5xHfFnLE= Received: from localhost (port-92-200-27-32.dynamic.qsc.de [92.200.27.32]) by mx.zohomail.com with SMTPS id 1507133882651491.0298546665814; Wed, 4 Oct 2017 09:18:02 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <87o9pnt0ei.fsf@lassieur.org> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: =?utf-8?Q?Cl=C3=A9ment?= Lassieur Subject: Re: guix pull fails on powerful server In-reply-to: <87o9pnt0ei.fsf@lassieur.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Wed, 04 Oct 2017 18:17:57 +0200 Message-ID: <874lre51l6.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , Ludovic =?utf-8?Q?Court=C3=A8s?= , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Clément Lassieur writes: > Ricardo Wurmus writes: > >> Is there another work-around I could try on this machine? > > My workaround was to build Guix from sources. But I'm sure you thought > about it. Yes, that works, but I was looking for something that a user can do who wouldn’t like to fiddle with git. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 07 11:11:52 2017 Received: (at 27476) by debbugs.gnu.org; 7 Oct 2017 15:11:52 +0000 Received: from localhost ([127.0.0.1]:54848 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e0qlc-00036O-6k for submit@debbugs.gnu.org; Sat, 07 Oct 2017 11:11:52 -0400 Received: from eggs.gnu.org ([208.118.235.92]:60232) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e0qla-000369-Ll for 27476@debbugs.gnu.org; Sat, 07 Oct 2017 11:11:50 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1e0qlU-0000gL-Oo for 27476@debbugs.gnu.org; Sat, 07 Oct 2017 11:11:45 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:49160) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1e0qlU-0000gF-LJ; Sat, 07 Oct 2017 11:11:44 -0400 Received: from [2a01:e0a:1d:7270:6a6c:dc17:fc02:cfda] (port=46188 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1e0qlU-0004Vm-8j; Sat, 07 Oct 2017 11:11:44 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus Subject: Re: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 16 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Sat, 07 Oct 2017 17:11:42 +0200 In-Reply-To: <87shf44ny0.fsf@elephly.net> (Ricardo Wurmus's message of "Sat, 30 Sep 2017 09:59:03 +0200") Message-ID: <87po9zj8lt.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Ricardo Wurmus skribis: > I=E2=80=99ve tried =E2=80=9Cguix pull=E2=80=9D on the same server again, = this time limiting CPUs > with =E2=80=9Ctaskset -c 0 guix pull=E2=80=9D: As a stopgap, commit aba219af0fed6a349af930f19c913fb87e6a69dd ensures that =E2=80=98--cores=E2=80=99 is honored. So if you run =E2=80=9Cguix pul= l --cores=3D1=E2=80=9D, it will build things sequentially. Now, to take advantage of that, you first need to update to the current Guix=E2=80=A6 Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Tue Oct 10 03:18:41 2017 Received: (at 27476) by debbugs.gnu.org; 10 Oct 2017 07:18:41 +0000 Received: from localhost ([127.0.0.1]:59037 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e1ooL-0005DU-De for submit@debbugs.gnu.org; Tue, 10 Oct 2017 03:18:41 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21130) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e1ooJ-0005DL-Pd for 27476@debbugs.gnu.org; Tue, 10 Oct 2017 03:18:40 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507619840; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; l=711; bh=Ntw8eQ4TRlku79p3bSYsPU6yjEefN8gcrBW1ub7+zKY=; b=g8EAeVMgd+HT/eCA6uGWsfnz4vno+oey8IAZNGm1z/8XI4Go8pM2SMhs3kDb+ve6 Nj72GRu8e6qpODRZbZEzTSQ+tnVWWftbqr5x2vzgDDL7af5vKon39OBEyxacUix+WV3 4x2G7Fgm1Q8y7CtM+YXRJJL5pk3lJd/VG84RAfK0= Received: from localhost (port-92-200-153-247.dynamic.qsc.de [92.200.153.247]) by mx.zohomail.com with SMTPS id 1507619840784727.3355523311205; Tue, 10 Oct 2017 00:17:20 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <87po9zj8lt.fsf@gnu.org> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: guix pull fails on powerful server In-reply-to: <87po9zj8lt.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Tue, 10 Oct 2017 09:17:17 +0200 Message-ID: <878tgjmpz6.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Ludovic Courtès writes: > Ricardo Wurmus skribis: > >> I’ve tried “guix pull” on the same server again, this time limiting CPUs >> with “taskset -c 0 guix pull”: > > As a stopgap, commit aba219af0fed6a349af930f19c913fb87e6a69dd ensures > that ‘--cores’ is honored. So if you run “guix pull --cores=1”, it will > build things sequentially. > > Now, to take advantage of that, you first need to update to the current > Guix… Thank you, this worked! On that server I built Guix from source and then let the users pull with “--cores=1” to update their own Guix. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Tue Oct 10 07:32:45 2017 Received: (at 27476) by debbugs.gnu.org; 10 Oct 2017 11:32:45 +0000 Received: from localhost ([127.0.0.1]:59321 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e1smD-00079L-5K for submit@debbugs.gnu.org; Tue, 10 Oct 2017 07:32:45 -0400 Received: from eggs.gnu.org ([208.118.235.92]:60135) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e1smA-000796-9F for 27476@debbugs.gnu.org; Tue, 10 Oct 2017 07:32:42 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1e1sm1-0006dQ-4f for 27476@debbugs.gnu.org; Tue, 10 Oct 2017 07:32:37 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:51854) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1e1sm1-0006dJ-0s; Tue, 10 Oct 2017 07:32:33 -0400 Received: from [193.50.110.208] (port=34410 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1e1sm0-0006Aq-Kh; Tue, 10 Oct 2017 07:32:32 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus Subject: Re: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <87po9zj8lt.fsf@gnu.org> <878tgjmpz6.fsf@elephly.net> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 19 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 10 Oct 2017 13:32:30 +0200 In-Reply-To: <878tgjmpz6.fsf@elephly.net> (Ricardo Wurmus's message of "Tue, 10 Oct 2017 09:17:17 +0200") Message-ID: <87wp43nsq9.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Ricardo Wurmus skribis: > Ludovic Court=C3=A8s writes: > >> Ricardo Wurmus skribis: >> >>> I=E2=80=99ve tried =E2=80=9Cguix pull=E2=80=9D on the same server again= , this time limiting CPUs >>> with =E2=80=9Ctaskset -c 0 guix pull=E2=80=9D: >> >> As a stopgap, commit aba219af0fed6a349af930f19c913fb87e6a69dd ensures >> that =E2=80=98--cores=E2=80=99 is honored. So if you run =E2=80=9Cguix = pull --cores=3D1=E2=80=9D, it will >> build things sequentially. >> >> Now, to take advantage of that, you first need to update to the current >> Guix=E2=80=A6 > > Thank you, this worked! > > On that server I built Guix from source and then let the users pull with > =E2=80=9C--cores=3D1=E2=80=9D to update their own Guix. You could also run guix-daemon with --cores=3D4 or similar, so that it uses 4 cores by default (few package builds scale beyond that anyway), and then maybe --max-jobs=3D4 so you don=E2=80=99t waste the other cores. = ;-) Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Thu Oct 12 09:37:18 2017 Received: (at 27476) by debbugs.gnu.org; 12 Oct 2017 13:37:18 +0000 Received: from localhost ([127.0.0.1]:35039 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e2dfq-0007fz-BQ for submit@debbugs.gnu.org; Thu, 12 Oct 2017 09:37:18 -0400 Received: from hera.aquilenet.fr ([141.255.128.1]:49548) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e2dfm-0007fn-Kj for 27476@debbugs.gnu.org; Thu, 12 Oct 2017 09:37:15 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id AA8FFE97D; Thu, 12 Oct 2017 15:37:14 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id bVzYlVwNXFkB; Thu, 12 Oct 2017 15:37:13 +0200 (CEST) Received: from ribbon (unknown [193.50.110.214]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 82C66E0A1; Thu, 12 Oct 2017 15:37:13 +0200 (CEST) From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus Subject: Re: bug#27476: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> Date: Thu, 12 Oct 2017 15:37:12 +0200 In-Reply-To: <87shf44ny0.fsf@elephly.net> (Ricardo Wurmus's message of "Sat, 30 Sep 2017 09:59:03 +0200") Message-ID: <877ew0o5br.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi! Ricardo Wurmus skribis: > The following derivation will be built: > /gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv > copying and compiling to '/gnu/store/s3s7xlqa10mvf8v0ypxz8gzw3lcf1x5z-gui= x-latest' with Guile 2.2.2... > loading... 25.7% of 635 filesrandom seed for tests: 1506720257 > loading... 99.8% of 635 files > compiling... 69.1% of 635 filesice-9/threads.scm:289:22: In procedure= loop: > ice-9/threads.scm:289:22: Syntax error: > guix/scripts/graph.scm:103:10: return: return used outside of 'with-monad= ' in form (return (package-node-edges a)) The program below crashes with completely surreal backtraces in less than a minute on my 4-thread laptop: --8<---------------cut here---------------start------------->8--- (use-modules (ice-9 threads) (srfi srfi-1) (guix monads) (guix store)) (define threads (unfold (lambda (x) (> x 100)) (lambda (x) (call-with-new-thread (lambda () (define monad (symbol-append 'foo-monad (string->symbol (number->string x)))) (while #t (macroexpand `(begin (define-monad ,monad (bind +) (return -)) (with-monad ,monad (return 3)) (mapm ,monad + '(1 2 3)))))))) 1+ 0)) (for-each join-thread threads) --8<---------------cut here---------------end--------------->8--- Can you check if that also happens on your many-core machine? The patch below seems to fix the problem: (guix monads) has shared state (hash tables) used both at expansion-time and run-time, and it wasn=E2=80= =99t protected. My hypothesis is that this was causing random memory corruption. The weird thing, though, is that the errors we were getting were not so random. Also, the load phase of =E2=80=98guix pull=E2=80=99 is sequential. Could you test it and report back? Thanks, Ludo=E2=80=99. --=-=-= Content-Type: text/x-patch Content-Disposition: inline diff --git a/guix/monads.scm b/guix/monads.scm index 6ae616aca..c9c5da3bb 100644 --- a/guix/monads.scm +++ b/guix/monads.scm @@ -20,6 +20,7 @@ #:use-module ((system syntax) #:select (syntax-local-binding)) #:use-module (ice-9 match) + #:use-module (ice-9 threads) #:use-module (srfi srfi-1) #:use-module (srfi srfi-9) #:use-module (srfi srfi-26) @@ -117,6 +118,7 @@ ;; the syntax object of the parameter over which it is templated, and (2) ;; the syntax of its body. (define-once %templates (make-hash-table)) + (define-once %template-lock (make-mutex)) (define (register-template! name param body) (hash-set! %templates name (cons param body))) @@ -139,8 +141,9 @@ template instances." (syntax-source s)) (define current-info-port - ;; Port for debugging info. - (const (%make-void-port "w"))) + ;; Port for debugging info. Return a fresh port at each call to make + ;; sure we're thread-safe. + (lambda () (%make-void-port "w"))) (define location-string (format #f "~a:~a:~a" @@ -204,12 +207,14 @@ template instances." ;; Search for an instance of template NAME for this ACTUAL parameter. ;; On success, expand to the identifier of the instance; otherwise ;; expand to #f. - (any (matching-instance? #'name #'actual) %template-instances)) + (with-mutex %template-lock + (any (matching-instance? #'name #'actual) %template-instances))) ((_ exists? name actual) ;; Likewise, but return a Boolean. (let ((result (->bool - (any (matching-instance? #'name #'actual) - %template-instances)))) + (with-mutex %template-lock + (any (matching-instance? #'name #'actual) + %template-instances))))) (unless result (format (current-warning-port) "~a: warning: no specialization of template '~a' for '~a'~%" @@ -220,8 +225,9 @@ template instances." ;; Expand to the definitions of all the existing templates ;; specialized for ACTUAL. #`(begin - #,@(hash-map->list (cut instance-definition <> <> #'actual) - %templates)))))) + #,@(with-mutex %template-lock + (hash-map->list (cut instance-definition <> <> #'actual) + %templates))))))) (define-syntax define-template (lambda (s) --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Fri Oct 13 16:30:44 2017 Received: (at 27476) by debbugs.gnu.org; 13 Oct 2017 20:30:44 +0000 Received: from localhost ([127.0.0.1]:38472 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e36bU-0003wo-Aw for submit@debbugs.gnu.org; Fri, 13 Oct 2017 16:30:44 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21050) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e36bS-0003wf-E5 for 27476@debbugs.gnu.org; Fri, 13 Oct 2017 16:30:42 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507926553; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; l=3373; bh=yOCOPcztF8G4xfvWyAboFit0jwiom82hoHIcr4XHKYI=; b=dgb0Q3Q0zSnESK8JEp8VtY45ZZK4KvtKKYKVZ6mv9c+q8LCCfEgPVfysG/wbqYRg wXBGwVYOoBHfMfGKa1WfoMQ8RulXQfJq0YGyue6llppMOEN8wr1CFIPpWf8o9jaT6yu MI1yFqlYjPLQjqgzB9+FwhhDy2Li7MSMNioP0zJw= Received: from localhost (port-92-200-64-181.dynamic.qsc.de [92.200.64.181]) by mx.zohomail.com with SMTPS id 1507926553099313.6016282841433; Fri, 13 Oct 2017 13:29:13 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <877ew0o5br.fsf@gnu.org> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#27476: guix pull fails on powerful server In-reply-to: <877ew0o5br.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Fri, 13 Oct 2017 22:29:09 +0200 Message-ID: <877evyu6zu.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hi Ludo, > Ricardo Wurmus skribis: > >> The following derivation will be built: >> /gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv >> copying and compiling to '/gnu/store/s3s7xlqa10mvf8v0ypxz8gzw3lcf1x5z-guix-latest' with Guile 2.2.2... >> loading... 25.7% of 635 filesrandom seed for tests: 1506720257 >> loading... 99.8% of 635 files >> compiling... 69.1% of 635 filesice-9/threads.scm:289:22: In procedure loop: >> ice-9/threads.scm:289:22: Syntax error: >> guix/scripts/graph.scm:103:10: return: return used outside of 'with-monad' in form (return (package-node-edges a)) > > The program below crashes with completely surreal backtraces in less > than a minute on my 4-thread laptop: > > --8<---------------cut here---------------start------------->8--- > (use-modules (ice-9 threads) > (srfi srfi-1) > (guix monads) > (guix store)) > > (define threads > (unfold (lambda (x) (> x 100)) > (lambda (x) > (call-with-new-thread > (lambda () > (define monad > (symbol-append 'foo-monad > (string->symbol (number->string x)))) > > (while #t > (macroexpand > `(begin > (define-monad ,monad > (bind +) > (return -)) > (with-monad ,monad > (return 3)) > (mapm ,monad + '(1 2 3)))))))) > 1+ > 0)) > > (for-each join-thread threads) > --8<---------------cut here---------------end--------------->8--- > > Can you check if that also happens on your many-core machine? It does not crash. I left it running for more than an hour (without compiling) and it printed things like this: --8<---------------cut here---------------start------------->8--- … GC Warning: Repeated allocation of very large block (appr. size 57528320): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 57528320): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 57528320): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 57528320): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 14385152): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 14385152): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 57528320): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 28766208): May lead to memory leak and poor performance … --8<---------------cut here---------------end--------------->8--- That’s on the machine with 1.5T RAM and 192 cores. Then I ran it again for 10 minutes after compiling it. It did not crash. > The patch below seems to fix the problem: (guix monads) has shared state > (hash tables) used both at expansion-time and run-time, and it wasn’t > protected. > > My hypothesis is that this was causing random memory corruption. The > weird thing, though, is that the errors we were getting were not so > random. Also, the load phase of ‘guix pull’ is sequential. > > Could you test it and report back? I’m trying the patch right now with “guix pull”. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Fri Oct 13 17:05:29 2017 Received: (at 27476) by debbugs.gnu.org; 13 Oct 2017 21:05:29 +0000 Received: from localhost ([127.0.0.1]:38495 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e3797-0004pu-Bq for submit@debbugs.gnu.org; Fri, 13 Oct 2017 17:05:29 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21112) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e3796-0004pk-0i for 27476@debbugs.gnu.org; Fri, 13 Oct 2017 17:05:28 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507928674; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; l=2142; bh=w21Zy0WU5P59C90GK0KoGIVZ8QD0DfZFHerY1G1OWeQ=; b=XdjZ77TmrTTaB9IO0kR+Y3WTx+EZKLXZyy9K56DEp9MZA9p35cALTqBwq67ZBHnO EFwTTB7M7Msghz7DhcANJacN82sStgCVX+K+2CORYz38Lg7AE7X6b0OXNfUeLhuTCuc qeNqC18WRXwrXbZ24DM58zdDb8MDwhk2+HNQrHjI= Received: from localhost (port-92-200-64-181.dynamic.qsc.de [92.200.64.181]) by mx.zohomail.com with SMTPS id 1507928674501780.0834283052844; Fri, 13 Oct 2017 14:04:34 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <877ew0o5br.fsf@gnu.org> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#27476: guix pull fails on powerful server In-reply-to: <877ew0o5br.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Fri, 13 Oct 2017 23:04:31 +0200 Message-ID: <874lr2u5cw.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hi Ludo, > The patch below seems to fix the problem: (guix monads) has shared state > (hash tables) used both at expansion-time and run-time, and it wasn’t > protected. > > My hypothesis is that this was causing random memory corruption. The > weird thing, though, is that the errors we were getting were not so > random. Also, the load phase of ‘guix pull’ is sequential. > > Could you test it and report back? This doesn’t seem to be enough to fix the problem. I patched ~/guix and ran “guix pull --url=$PWD” from ~/guix: --8<---------------cut here---------------start------------->8--- [rwurmus@murphy:~/guix] (335) $ time ./pre-inst-env guix pull --url=$PWD guile: warning: failed to install locale warning: failed to install locale: Invalid argument Updating from Git repository at '/home/rwurmus/guix'... Building from Git commit d24c69d86670bfad0c6bb147162c918e9fcdccc2... substitute: guile: warning: failed to install locale substitute: warning: failed to install locale: Invalid argument guix pull: warning: failed to load '(bimsb packages bioinformatics-nonfree)': ERROR: no code for module (gnu packages zip) guix pull: warning: failed to load '(bimsb packages staging)': ERROR: no code for module (gnu packages zip) substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0% The following derivation will be built: /gnu/store/y54b92jj44li36743fgxzy0iagi6gb9n-guix-latest.drv copying and compiling to '/gnu/store/p5zlw7fas26bickkqz4d68g8bxnjr14z-guix-latest' with Guile 2.2.2... loading... 25.8% of 640 filesrandom seed for tests: 1507927861 loading... 99.8% of 640 files compiling... 18.6% of 640 filesIn thread: ERROR: In procedure return: return used outside of 'with-monad'Error while printing exception. compiling... 70.0% of 640 files --8<---------------cut here---------------end--------------->8--- The higher the percentage of completion, the slower this all gets. It hasn’t actually finished yet, even though it has been running for over 13 minutes. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Fri Oct 13 17:12:00 2017 Received: (at 27476) by debbugs.gnu.org; 13 Oct 2017 21:12:00 +0000 Received: from localhost ([127.0.0.1]:38515 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e37FP-00050z-RG for submit@debbugs.gnu.org; Fri, 13 Oct 2017 17:12:00 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21042) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e37FN-00050r-Hb for 27476@debbugs.gnu.org; Fri, 13 Oct 2017 17:11:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507929032; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type; l=1753; bh=yiHEZcTfo4uf58iXU+LVxcbko86T4H6quSkflfr2efc=; b=ShsCfXyrY2lDUIxD7hGkDJlvXtZZPsn0oT/S9kUb43B9CmMxUhomp6vEqtO1za/F ZmvPVDFk01MoKlYFMePT2igh96TeojOZJ3Xc2NfAB01o9jhU8sRUsy9pqX/bJ53NgN/ w1QJ1hqfGvNjq1092Ds1j57uGsmZ3631+BDadI9k= Received: from localhost (port-92-200-64-181.dynamic.qsc.de [92.200.64.181]) by mx.zohomail.com with SMTPS id 1507929032860550.6813183971276; Fri, 13 Oct 2017 14:10:32 -0700 (PDT) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <877ew0o5br.fsf@gnu.org> <874lr2u5cw.fsf@elephly.net> User-agent: mu4e 0.9.18; emacs 25.3.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#27476: guix pull fails on powerful server In-reply-to: <874lr2u5cw.fsf@elephly.net> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Fri, 13 Oct 2017 23:10:29 +0200 Message-ID: <87376mu52y.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) I tried it again after unsetting GUIX_PACKAGE_PATH, but the results are just as bad: --8<---------------cut here---------------start------------->8--- [rwurmus@murphy:~/guix] (338) $ unset GUIX_PACKAGE_PATH [rwurmus@murphy:~/guix] (339) $ time ./pre-inst-env guix pull --url=$PWD guile: warning: failed to install locale warning: failed to install locale: Invalid argument Updating from Git repository at '/home/rwurmus/guix'... Building from Git commit d24c69d86670bfad0c6bb147162c918e9fcdccc2... substitute: guile: warning: failed to install locale substitute: warning: failed to install locale: Invalid argument substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0% The following derivation will be built: /gnu/store/q5sh4c1mfk396kixqdq8j0wdfwin4dsx-guix-latest.drv copying and compiling to '/gnu/store/jzq053lg77shnysmhj4i2f2bngz2rr5b-guix-latest' with Guile 2.2.2... loading... 25.8% of 640 filesrandom seed for tests: 1507928738 loading... 99.8% of 640 files compiling... 14.4% of 640 filesIn thread: ERROR: In procedure >>=: >>= (bind) used outside of 'with-monad'Error while printing exception. compiling... 14.5% of 640 filesIn thread: ERROR: In procedure return: return used outside of 'with-monad'Error while printing exception. compiling... 17.3% of 640 filesIn thread: ERROR: In procedure return: return used outside of 'with-monad'Error while printing exception. compiling... 70.0% of 640 filesGC Warning: Repeated allocation of very large block (appr. size 28766208): May lead to memory leak and poor performance --8<---------------cut here---------------end--------------->8--- -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net From debbugs-submit-bounces@debbugs.gnu.org Tue Nov 07 05:57:16 2017 Received: (at 27476) by debbugs.gnu.org; 7 Nov 2017 10:57:16 +0000 Received: from localhost ([127.0.0.1]:55228 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eC1ZD-0003gU-SB for submit@debbugs.gnu.org; Tue, 07 Nov 2017 05:57:16 -0500 Received: from hera.aquilenet.fr ([141.255.128.1]:37512) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eC1ZB-0003gL-B0 for 27476@debbugs.gnu.org; Tue, 07 Nov 2017 05:57:13 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 3A007F6BA; Tue, 7 Nov 2017 11:57:14 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id lXLJIigpgCkE; Tue, 7 Nov 2017 11:57:13 +0100 (CET) Received: from ribbon (unknown [193.50.110.150]) by hera.aquilenet.fr (Postfix) with ESMTPSA id ED623F6B6; Tue, 7 Nov 2017 11:57:12 +0100 (CET) From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus Subject: Re: bug#27476: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> Date: Tue, 07 Nov 2017 11:57:10 +0100 In-Reply-To: <87shf44ny0.fsf@elephly.net> (Ricardo Wurmus's message of "Sat, 30 Sep 2017 09:59:03 +0200") Message-ID: <878tfi9x15.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) Hi, Ricardo Wurmus skribis: > After limiting memory with =E2=80=9Culimit -Sv 5000000=E2=80=9D: > > ice-9/threads.scm:289:22: In procedure loop: > ice-9/threads.scm:289:22: Syntax error: > guix/scripts/pull.scm:192:8: >>=3D: >>=3D (bind) used outside of 'with-mo= nad' in form (>>=3D (indirect-root-added latest) (lambda (done) (mlet* %sto= re-monad () (if (and (file-exists? latest) (string=3D? (readlink latest) so= urce-dir)) (begin (display (G_ "Guix already up to date\n")) (return #t)) (= begin (switch-symlinks latest source-dir) (format #t (G_ "updated ~a succes= sfully deployed under `~a'~%") %guix-package-name latest) (return #t)))))) > > Some deprecated features have been used. Set the environment > variable GUILE_WARN_DEPRECATED to "detailed" and rerun the > program to get more information. Set it to "no" to suppress > this message. > builder for `/gnu/store/afji58647yzz7cr9dvlj87sd3ad36lbk-guix-latest.drv'= failed with exit code 1 > guix pull: error: build failed: build of `/gnu/store/afji58647yzz7cr9dvlj= 87sd3ad36lbk-guix-latest.drv' failed > > It always crashes at around 69%. This gave me an idea. With this program: --8<---------------cut here---------------start------------->8--- (use-modules (ice-9 threads) (srfi srfi-1) (guix monads) (guix store) (system base compile)) (compile #f) ;load modules (define threads (unfold (lambda (x) (> x 100)) (lambda (x) (call-with-new-thread (lambda () (while #t (compile '(begin (with-monad %store-monad (>>=3D foo bar (return 3))) (mlet %store-monad ((x y)) (mbegin %store-monad (return x) (return y)))) #:env (current-module) #:from 'scheme #:to 'tree-il))))) 1+ 0)) (for-each join-thread threads) --8<---------------cut here---------------end--------------->8--- I can reproduce the error: --8<---------------cut here---------------start------------->8--- $ ulimit -Sv 2000000 $ guile syntax-parms.scm In ice-9/psyntax.scm: 1678:45 19 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 230:17 18 (map1 (((("placeholder" placeholder) ((#) . #) =E2=80=A6) =E2=80=A6))) In ice-9/psyntax.scm: 1483:23 17 (_ _ _) In ice-9/boot-9.scm: 230:29 16 (map1 (# # (#) (#)) 230:17 15 (map1 (# (#) (# #)) In ice-9/psyntax.scm: 1788:11 14 (lp ((# # () # ((# #)) #) 1678:45 13 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 230:17 12 (map1 (((("placeholder" placeholder) ("l-1dff1b83541ce327-67a3= 671" lexical . #) ("placeho=E2=80=A6" =E2=80=A6) =E2=80=A6) =E2=80=A6))) In ice-9/psyntax.scm: 1678:45 11 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 230:17 10 (map1 (((("placeholder" placeholder) ((#) . #) =E2=80=A6) . #))) In ice-9/psyntax.scm: 2337:44 9 (expand-let _ _ _ #f (hygiene guile-user) # _ =E2=80=A6) 1678:45 8 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 230:17 7 (map1 (((("placeholder" placeholder) ("l-1dff1b83541ce327-67a3= 7b2" lexical . #) ("placeho=E2=80=A6" =E2=80=A6) =E2=80=A6) =E2=80=A6))) In ice-9/psyntax.scm: 1678:45 6 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 230:17 5 (map1 (((("placeholder" placeholder) ((#) . #) =E2=80=A6) =E2=80=A6))) In ice-9/psyntax.scm: 1483:23 4 (_ _ _) In ice-9/boot-9.scm: 230:17 3 (map1 (# # (#) (#=E2=80=A6>)) In ice-9/psyntax.scm: 1406:23 2 (_ _) 1347:32 1 (syntax-type ((# #)) (("p= laceholder" placeholder) ((#) . #) =E2=80=A6) =E2=80=A6) 1558:32 0 (expand-macro # _ _ _ _ _ _) ice-9/psyntax.scm:1558:32: In procedure expand-macro: ice-9/psyntax.scm:1558:32: Syntax error: unknown location: state-return: Wrong number of arguments in form ((%store-= monad %return)) In syntax-parms.scm: 15:17 9 (_) In system/base/compile.scm: 255:6 8 (compile _ #:from _ #:to _ #:env _ #:opts _) 183:32 7 (compile-fold (#) (begin= (with-monad %store-monad (>>=3D =E2=80=A6)) #) =E2=80=A6) In ice-9/boot-9.scm: 2316:4 6 (save-module-excursion #) In language/scheme/compile-tree-il.scm: 31:15 5 (_) In ice-9/psyntax.scm: 1233:22 4 (expand-top-sequence ((begin (with-monad %store-monad (>>=3D f= oo bar (return 3))) (mlet # ((=E2=80=A6)) #))) _ =E2=80=A6) In ice-9/boot-9.scm: 230:17 3 (map1 (# #= )) In ice-9/psyntax.scm: 1611:33 2 (parse (((("placeholder" placeholder) ((#) . #) =E2=80=A6) . #)) =E2=80=A6) 1347:32 1 (syntax-type (>>=3D foo bar (return 3)) (("placeholder" placeh= older) ((#) . #) =E2=80=A6) =E2=80=A6) 1558:32 0 (expand-macro # _ _ _ _ _ _) ice-9/psyntax.scm:1558:32: In procedure expand-macro: ice-9/psyntax.scm:1558:32: Syntax error: unknown location: source expression failed to match any pattern GC Warning: Failed to expand heap by 28770304 bytes GC Warning: Failed to expand heap by 28770304 bytes GC Warning: Failed to expand heap by 14385152 bytes GC Warning: Out of Memory! Heap size: 919 MiB. Returning NULL! Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler. --8<---------------cut here---------------end--------------->8--- So it looks like Guile failing badly in ENOMEM conditions. I can=E2=80=99t reproduce this with current Guile =E2=80=98stable-2.2=E2=80= =99, following Andy=E2=80=99s weak-table rewrite=C2=B9, so this might have been a weak-table bug showing = up under memory pressure. With =E2=80=98guix pull=E2=80=99 this was more likely to happen on your man= y-core server than on my laptop because you have more threads and thus much higher memory usage. Ludo=E2=80=99. =C2=B9 https://lists.gnu.org/archive/html/guile-devel/2017-10/msg00051.html https://git.savannah.gnu.org/cgit/guile.git/commit/?h=3Dstable-2.2&id=3Da= 053c0510c4a644f9453166b7b385cf30f6d3a21 From debbugs-submit-bounces@debbugs.gnu.org Mon Apr 30 17:19:46 2018 Received: (at 27476) by debbugs.gnu.org; 30 Apr 2018 21:19:46 +0000 Received: from localhost ([127.0.0.1]:44391 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGD3-0000w2-Vn for submit@debbugs.gnu.org; Mon, 30 Apr 2018 17:19:46 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:41094) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGD2-0000vu-Kc for 27476@debbugs.gnu.org; Mon, 30 Apr 2018 17:19:45 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 1649B12021; Mon, 30 Apr 2018 23:19:44 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id uX4Uh2nlo7-R; Mon, 30 Apr 2018 23:19:43 +0200 (CEST) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id B118311FB5; Mon, 30 Apr 2018 23:19:42 +0200 (CEST) From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus Subject: Re: bug#27476: guix pull fails on powerful server References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> Date: Mon, 30 Apr 2018 23:19:42 +0200 In-Reply-To: <878tfi9x15.fsf@gnu.org> ("Ludovic \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\= \=\?utf-8\?Q\?s\?\= message of "Tue, 07 Nov 2017 11:57:10 +0100") Message-ID: <87h8nstms1.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) ludo@gnu.org (Ludovic Court=C3=A8s) skribis: > I can=E2=80=99t reproduce this with current Guile =E2=80=98stable-2.2=E2= =80=99, following Andy=E2=80=99s > weak-table rewrite=C2=B9, so this might have been a weak-table bug showin= g up > under memory pressure. With Guile 2.2.3 a similar program triggers a crash very quickly: --8<---------------cut here---------------start------------->8--- $ cat ../guile-debugging/syntax-parms.scm=20 (use-modules (ice-9 threads) (srfi srfi-1) (guix monads) (guix store) (system base compile)) (compile #f) ;load modules (define threads (unfold (lambda (x) (> x 100)) (lambda (x) (call-with-new-thread (lambda () (while #t (compile '(mlet %store-monad ((x y)) (mbegin %store-monad (return x) (return y))) #:env (current-module) #:from 'scheme #:to 'tree-il))))) 1+ 0)) (for-each join-thread threads) $ guile --version guile (GNU Guile) 2.2.3 Copyright (C) 2017 Free Software Foundation, Inc. License LGPLv3+: GNU LGPL 3 or later . This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. $ guile ../guile-debugging/syntax-parms.scm=20 In ice-9/psyntax.scm: 2338:44 19 (expand-let _ _ _ #f _ # _ _ _) 1679:45 18 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 17 (map1 ("-" "1dff1b83541ce327" "-" "2ad70")) In ice-9/psyntax.scm: 1679:45 16 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 15 (map1 ((#(ribcage () () ()) #(ribcage () () ()) #(ribcage #(un= used-value) #((m-1dff1b83541ce327-29a7a top)) #("l-1dff1b83541ce327-2bce9")= ) #(ribcage () () ()) # =E2=80=A6))) In ice-9/psyntax.scm: 1484:23 14 (_ _ _) In ice-9/boot-9.scm: 222:29 13 (map1 _) 222:17 12 (map1 ("-" "2bd28")) In ice-9/psyntax.scm: 1789:11 11 (lp _ ()) 1679:45 10 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 9 (map1 ((expand-1dff1b83541ce327-2bd31) (#) =E2=80=A6)) In ice-9/psyntax.scm: 1679:45 8 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 7 (map1 ((m-1dff1b83541ce327-2bcf4 top))) In ice-9/psyntax.scm: 1484:23 6 (_ _ _) In ice-9/boot-9.scm: 222:17 5 (map1 (#)) In ice-9/psyntax.scm: 1407:23 4 (_ _) 1317:39 3 (syntax-type y (shift #(ribcage #(e) #((top)) #("l-680b775fb37= a463-1343")) #(ribcage () () ()) #(ribcage #(xx) #((top)) #("l-680b775fb37a= 463-1340")) #(ribcage =E2=80=A6)) # =E2=80=A6) 916:15 2 (resolve-identifier y (#>=3D> # #)>) (shift #(ribcage #(e) #((top)) #("l-680b775fb37a463-1= 343")) #(ribcage () () #) =E2=80=A6) =E2=80=A6) 833:21 1 (id-var-name y _ _) 669:4 0 (search y (() #(ribcage () () ()) #(ribcage () () ()) #(ribcag= e () () ()) #(ribcage () () ())) (top) (hygiene guile-user)) ice-9/psyntax.scm:669:4: In procedure search: In procedure vector-ref: Wrong type argument in position 1 (expecting vecto= r): () In ice-9/boot-9.scm: 222:29 19 (map1 _) 222:17 18 (map1 (#f)) In ice-9/psyntax.scm: 1789:11 17 (lp _ ()) 1679:45 16 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 15 (map1 (() (m-1dff1b83541ce327-8f24e top))) In ice-9/psyntax.scm: 1679:45 14 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 13 (map1 ((m-1dff1b83541ce327-8fe71 top) shift #(ribcage #(e) #((= top)) #("l-680b775fb37a463-1343")) #(ribcage () () ()) #(ribcage #(xx) #((t= op)) #("l-680b775fb3=E2=80=A6")) #)) In ice-9/psyntax.scm: 1409:12 12 (expand-expr _ _ _ (shift #(ribcage #(e) #((top)) #("l-680b775= fb37a463-1343")) #(ribcage () () ()) #(ribcage #(xx) #((top)) #("l-680b775f= b37a463-1340")) #(# # =E2=80=A6)) # =E2=80=A6) 2054:19 11 (_ _ _ (m-1dff1b83541ce327-8fe71 top) ()) In ice-9/boot-9.scm: 222:17 10 (map1 (# (# #))) In ice-9/psyntax.scm: 1409:12 9 (_ _) 1789:11 8 (lp _ (#(ribcage () () ()) #(ribcage #(x) #((m-1dff1b83541ce32= 7-8f383 top)) #("l-1dff1b83541ce327-8f40b")) #(ribcage () () ()) #(ribcage = () () ()) #(ribcage # =E2=80=A6) =E2=80=A6)) 1679:45 7 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 6 (map1 (#(ribcage #(x) #((m-1dff1b83541ce327-8f383 top)) #("l-1= dff1b83541ce327-8f40b")) #(ribcage () () ()) shift #(ribcage #(monad body) = #((top) (top)) #("=E2=80=A6" =E2=80=A6)) =E2=80=A6)) In ice-9/psyntax.scm: 2702:67 5 (_ tmp-1dff1b83541ce327-8fa7a _ _) 2646:111 4 (gen-clause # () (#(ribcage () () ()) #(ribcage #(x) #((m-1dff1b83541ce327-8f383 top)) = #("l-1dff1b83541ce3=E2=80=A6")) =E2=80=A6) =E2=80=A6) 2607:69 3 (build-dispatch-call (("8fa7c" . 0)) "1dff1b83541ce327" # #((m-1dff1b83541ce327-8f383 t= op)) (#f #f () (#) # =E2=80=A6)) In ice-9/boot-9.scm: 222:17 2 (map1 ("8fa7c")) In ice-9/psyntax.scm: 2004:10 1 (gen-var _) In unknown file: 0 (symbol->string "8fa7c") ERROR: In procedure symbol->string: In procedure symbol->string: Wrong type argument in position 1 (expecting s= ymbol): "8fa7c" --8<---------------cut here---------------end--------------->8--- Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Apr 30 17:39:09 2018 Received: (at 27476) by debbugs.gnu.org; 30 Apr 2018 21:39:09 +0000 Received: from localhost ([127.0.0.1]:44401 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGVp-0001QN-D9 for submit@debbugs.gnu.org; Mon, 30 Apr 2018 17:39:09 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:41284) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGVo-0001QG-8q for 27476@debbugs.gnu.org; Mon, 30 Apr 2018 17:39:08 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id ACA15131BE; Mon, 30 Apr 2018 23:39:07 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Fp973NHZgvD4; Mon, 30 Apr 2018 23:39:06 +0200 (CEST) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 568F812FC4; Mon, 30 Apr 2018 23:39:06 +0200 (CEST) From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus Subject: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe In-Reply-To: <87h8nstms1.fsf@gnu.org> ("Ludovic \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\= \=\?utf-8\?Q\?s\?\= message of "Mon, 30 Apr 2018 23:19:42 +0200") References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) Date: Mon, 30 Apr 2018 23:39:05 +0200 Message-ID: <874ljstlvq.fsf_-_@gnu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) ludo@gnu.org (Ludovic Court=C3=A8s) skribis: > With Guile 2.2.3 a similar program triggers a crash very quickly: Even simpler: --8<---------------cut here---------------start------------->8--- $ guile ../guile-debugging/syntax-parms.scm=20 ;;; note: source file /home/ludo/src/guix/../guile-debugging/syntax-parms.s= cm ;;; newer than compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/h= ome/ludo/src/guile-debugging/syntax-parms.scm.go ;;; note: auto-compilation is enabled, set GUILE_AUTO_COMPILE=3D0 ;;; or pass the --no-auto-compile argument to disable. ;;; compiling /home/ludo/src/guix/../guile-debugging/syntax-parms.scm ;;; compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/home/ludo/src/guil= e-debugging/syntax-parms.scm.go In /home/ludo/src/guix/../guile-debugging/syntax-parms.scm: 37:17 13 (_) In system/base/compile.scm: 255:6 12 (compile _ #:from _ #:to _ #:env _ #:opts _) 183:32 11 (compile-fold (#f syntax-violation (# # #)) # =E2=80=A6) In ice-9/boot-9.scm: 2312:4 10 (save-module-excursion #) In language/scheme/compile-tree-il.scm: 31:15 9 (_) In ice-9/psyntax.scm: 1234:22 8 (expand-top-sequence (#) =E2=80=A6) In ice-9/boot-9.scm: 222:29 7 (map1 ((10 (3 #((0 . 0)) 2 (1 (11 0 . 0) (7 (3 #() 2 (10 (13 1= 5 5 (guile) list . #f) (5 . #) (11 0 . 0) (11 0 . 1)) () 2) (11 0= . 0)) 10 (. #) =E2=80=A6) =E2=80=A6) #) =E2=80=A6)) 222:17 6 (map1 (10 (3 #((0 . 0)) 2 (1 (11 0 . 0) (7 (3 #() 2 (10 (13 15= 5 (guile) list . #f) (5 . #) (11 0 . 0) (11 0 . 1)) () 2) (11 0 = . 0)) 10 (13 # . #) =E2=80=A6) =E2=80=A6) =E2=80=A6)) In ice-9/psyntax.scm: 2054:19 5 (_ _ (#) (param 1 2) ()) In ice-9/boot-9.scm: 222:17 4 (map1 (#)) In ice-9/psyntax.scm: 2057:27 3 (_ _) 289:10 2 (eval-local-transformer _ _) In ice-9/eval.scm: 718:15 1 (primitive-eval _) In unknown file: 0 (memoize-expression #) ERROR: In procedure memoize-expression: In procedure vector: Wrong type argument in position 1: #(#) C-c C-c $ cat ../guile-debugging/syntax-parms.scm=20 (use-modules (ice-9 threads) (srfi srfi-1) (system base compile)) (compile #f) ;load modules (define-syntax-parameter param (lambda (s) (syntax-case s () ((_ a b) #'(+ a b))))) (define threads (unfold (lambda (x) (> x 100)) (lambda (x) (call-with-new-thread (lambda () (while #t (compile '(begin (param 1 2) (syntax-parameterize ((param (lambda (s) (syntax-case s = () ((_ a b) #'(- a b))))= )) (param 1 2))) #:env (current-module) #:from 'scheme #:to 'tree-il))))) 1+ 0)) (for-each join-thread threads) --8<---------------cut here---------------end--------------->8--- So the problem, AIUI, is that psyntax evaluates syntax parameters using =E2=80=98primitive-eval=E2=80=99 (via =E2=80=98eval-local-transformer=E2=80= =99), but memoization in (ice-9 eval) is not thread-safe, hence the random crashes. Not sure what can be done. Thoughts? Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Apr 30 17:40:19 2018 Received: (at control) by debbugs.gnu.org; 30 Apr 2018 21:40:20 +0000 Received: from localhost ([127.0.0.1]:44405 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGWx-0001SL-Oi for submit@debbugs.gnu.org; Mon, 30 Apr 2018 17:40:19 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:41298) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGWw-0001SD-Ag for control@debbugs.gnu.org; Mon, 30 Apr 2018 17:40:18 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id CFFBE131BE for ; Mon, 30 Apr 2018 23:40:17 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SijClfFyYpbv for ; Mon, 30 Apr 2018 23:40:17 +0200 (CEST) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 2593912FC4 for ; Mon, 30 Apr 2018 23:40:17 +0200 (CEST) Date: Mon, 30 Apr 2018 23:40:16 +0200 Message-Id: <8736zctltr.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) retitle 27476 Multi-threaded compilation of 'syntax-parameterize' forms crashes From debbugs-submit-bounces@debbugs.gnu.org Mon Apr 30 17:40:27 2018 Received: (at control) by debbugs.gnu.org; 30 Apr 2018 21:40:27 +0000 Received: from localhost ([127.0.0.1]:44408 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGX3-0001Se-Vp for submit@debbugs.gnu.org; Mon, 30 Apr 2018 17:40:27 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:41304) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fDGX2-0001SX-Nc for control@debbugs.gnu.org; Mon, 30 Apr 2018 17:40:24 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 3C341131BE for ; Mon, 30 Apr 2018 23:40:24 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id C6fRHNXD8WLd for ; Mon, 30 Apr 2018 23:40:23 +0200 (CEST) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 1173F12FC4 for ; Mon, 30 Apr 2018 23:40:23 +0200 (CEST) Date: Mon, 30 Apr 2018 23:40:22 +0200 Message-Id: <871sewtltl.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) severity 27476 serious From debbugs-submit-bounces@debbugs.gnu.org Wed May 09 04:41:44 2018 Received: (at 27476) by debbugs.gnu.org; 9 May 2018 08:41:44 +0000 Received: from localhost ([127.0.0.1]:54769 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fGKfO-0002Cg-OZ for submit@debbugs.gnu.org; Wed, 09 May 2018 04:41:44 -0400 Received: from pb-sasl2.pobox.com ([64.147.108.67]:63284 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fGKfN-0002CY-1j for 27476@debbugs.gnu.org; Wed, 09 May 2018 04:41:41 -0400 Received: from sasl.smtp.pobox.com (unknown [127.0.0.1]) by pb-sasl2.pobox.com (Postfix) with ESMTP id 7F876B8072; Wed, 9 May 2018 04:41:40 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc :subject:references:date:in-reply-to:message-id:mime-version :content-type:content-transfer-encoding; s=sasl; bh=tbt4oV6dQOaa GBFmBdiJW5SCkGE=; b=pOD8qP6IGR+NZ1N5bVks41PxPvpaM4ffrpo7lDaqF6ST 0EDnyQlUBK1QIQnvhc8BA0i7A1afGJnsPCc63kctX1neFzT8q3ad9hN9yTTb+4lf wpTDssVSRNZhJ8jaQTtoBzxvX59vm93DVE7NHCa3bcRYauigIZuQQYMcYqDxn2o= Received: from pb-sasl2.nyi.icgroup.com (unknown [127.0.0.1]) by pb-sasl2.pobox.com (Postfix) with ESMTP id 66964B806E; Wed, 9 May 2018 04:41:40 -0400 (EDT) Received: from sparrow (unknown [151.127.12.20]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by pb-sasl2.pobox.com (Postfix) with ESMTPSA id 455D9B806D; Wed, 9 May 2018 04:41:39 -0400 (EDT) From: Andy Wingo To: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: Re: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> <874ljstlvq.fsf_-_@gnu.org> Date: Wed, 09 May 2018 10:41:32 +0200 In-Reply-To: <874ljstlvq.fsf_-_@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s?= =?utf-8?Q?=22's?= message of "Mon, 30 Apr 2018 23:39:05 +0200") Message-ID: <87603x6x1f.fsf@igalia.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Pobox-Relay-ID: CA8AD0F6-5364-11E8-A467-B479894C8D7C-02397024!pb-sasl2.pobox.com X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.3 (/) Hi, On Mon 30 Apr 2018 23:39, ludo@gnu.org (Ludovic Court=C3=A8s) writes: > So the problem, AIUI, is that psyntax evaluates syntax parameters using > =E2=80=98primitive-eval=E2=80=99 (via =E2=80=98eval-local-transformer=E2= =80=99), but memoization in > (ice-9 eval) is not thread-safe, hence the random crashes. Sorry I've been a bit AWOL here... if this diagnosis is correct, then the problem is ultimately the memoization that needs to be thread-safe, right? Is the memoization you are referring to the "set!" in the "lazy" form in ice-9/eval.scm ? Or something else? FWIW I would not think the "set!" could be the issue, at least on x86, but who knows. A From debbugs-submit-bounces@debbugs.gnu.org Wed May 09 05:24:09 2018 Received: (at 27476) by debbugs.gnu.org; 9 May 2018 09:24:09 +0000 Received: from localhost ([127.0.0.1]:54816 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fGLKS-00059y-PI for submit@debbugs.gnu.org; Wed, 09 May 2018 05:24:08 -0400 Received: from eggs.gnu.org ([208.118.235.92]:41362) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fGLKR-00059k-D9 for 27476@debbugs.gnu.org; Wed, 09 May 2018 05:24:07 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fGLKL-0008WR-At for 27476@debbugs.gnu.org; Wed, 09 May 2018 05:24:02 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:35636) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fGLKL-0008WF-6Y; Wed, 09 May 2018 05:24:01 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=48424 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1fGLKK-0008Te-Or; Wed, 09 May 2018 05:24:01 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Andy Wingo Subject: Re: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> <874ljstlvq.fsf_-_@gnu.org> <87603x6x1f.fsf@igalia.com> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 20 =?utf-8?Q?Flor=C3=A9al?= an 226 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Wed, 09 May 2018 11:23:59 +0200 In-Reply-To: <87603x6x1f.fsf@igalia.com> (Andy Wingo's message of "Wed, 09 May 2018 10:41:32 +0200") Message-ID: <878t8tyyfk.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.0 (------) Hello Andy! Andy Wingo skribis: > On Mon 30 Apr 2018 23:39, ludo@gnu.org (Ludovic Court=C3=A8s) writes: > >> So the problem, AIUI, is that psyntax evaluates syntax parameters using >> =E2=80=98primitive-eval=E2=80=99 (via =E2=80=98eval-local-transformer=E2= =80=99), but memoization in >> (ice-9 eval) is not thread-safe, hence the random crashes. > > Sorry I've been a bit AWOL here... if this diagnosis is correct, then > the problem is ultimately the memoization that needs to be thread-safe, > right? It looks like it, yes. > Is the memoization you are referring to the "set!" in the "lazy" form in > ice-9/eval.scm ? Or something else? FWIW I would not think the "set!" > could be the issue, at least on x86, but who knows. Actually I=E2=80=99m not sure exactly. =E2=80=98memoize-expression=E2=80= =99 itself is side-effect-free, right? Thanks for your feedback, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Wed May 09 06:18:17 2018 Received: (at 27476) by debbugs.gnu.org; 9 May 2018 10:18:17 +0000 Received: from localhost ([127.0.0.1]:54832 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fGMAp-0006UR-D6 for submit@debbugs.gnu.org; Wed, 09 May 2018 06:18:15 -0400 Received: from pb-sasl2.pobox.com ([64.147.108.67]:51913 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fGMAl-0006UH-9l for 27476@debbugs.gnu.org; Wed, 09 May 2018 06:18:12 -0400 Received: from sasl.smtp.pobox.com (unknown [127.0.0.1]) by pb-sasl2.pobox.com (Postfix) with ESMTP id D93A5B847A; Wed, 9 May 2018 06:18:10 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc :subject:references:date:in-reply-to:message-id:mime-version :content-type:content-transfer-encoding; s=sasl; bh=zGdMsaDhFSkP zBcVuW0yKK5rc74=; b=F11l5uCrCvP+fZoZvwvSnVzVgeQby1eYyL7DBVzZ6YTM fknn4rATVhFaB1/0v9o3yM+iuBu1wf+VbGCXop43W+AqPhdHWl4+E1QzzHhCA59w Ir+ybx5/XKVs0qiNPJyUXh9Bv8C5wdhkuqVszuZxiTzi8XKhGlmnYMvWeIsJzbg= Received: from pb-sasl2.nyi.icgroup.com (unknown [127.0.0.1]) by pb-sasl2.pobox.com (Postfix) with ESMTP id D04CBB8479; Wed, 9 May 2018 06:18:10 -0400 (EDT) Received: from sparrow (unknown [151.127.12.20]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by pb-sasl2.pobox.com (Postfix) with ESMTPSA id C7054B8478; Wed, 9 May 2018 06:18:08 -0400 (EDT) From: Andy Wingo To: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: Re: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> <874ljstlvq.fsf_-_@gnu.org> <87603x6x1f.fsf@igalia.com> <878t8tyyfk.fsf@gnu.org> Date: Wed, 09 May 2018 12:18:01 +0200 In-Reply-To: <878t8tyyfk.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Wed, 09 May 2018 11:23:59 +0200") Message-ID: <87lgct5e06.fsf@igalia.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Pobox-Relay-ID: 456357DC-5372-11E8-866F-B479894C8D7C-02397024!pb-sasl2.pobox.com X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.3 (/) On Wed 09 May 2018 11:23, ludo@gnu.org (Ludovic Court=C3=A8s) writes: >> Is the memoization you are referring to the "set!" in the "lazy" form in >> ice-9/eval.scm ? Or something else? FWIW I would not think the "set!" >> could be the issue, at least on x86, but who knows. > > Actually I=E2=80=99m not sure exactly. =E2=80=98memoize-expression=E2=80= =99 itself is > side-effect-free, right? As far as I know (and I had a look this morning), yes. It takes a Tree-IL input and returns a memoized output. The internal mutation that exists in the evaluator is just the lazy "compilation" (see the invocations of the "lazy" form). Of course the function being evaluated could mutate shared state as well! Andy From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 07 12:19:54 2018 Received: (at control) by debbugs.gnu.org; 7 Jun 2018 16:19:54 +0000 Received: from localhost ([127.0.0.1]:38379 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fQxdi-0004Dy-1O for submit@debbugs.gnu.org; Thu, 07 Jun 2018 12:19:54 -0400 Received: from eggs.gnu.org ([208.118.235.92]:56556) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fQxdh-0004Dn-5n for control@debbugs.gnu.org; Thu, 07 Jun 2018 12:19:53 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fQxdY-0003YU-Sx for control@debbugs.gnu.org; Thu, 07 Jun 2018 12:19:48 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:57689) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fQxdY-0003YI-PX for control@debbugs.gnu.org; Thu, 07 Jun 2018 12:19:44 -0400 Received: from [193.50.110.75] (port=41198 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1fQxdY-0006ba-Ai for control@debbugs.gnu.org; Thu, 07 Jun 2018 12:19:44 -0400 Date: Thu, 07 Jun 2018 18:19:43 +0200 Message-Id: <87tvqea7s0.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.0 (------) merge 27476 31740 From debbugs-submit-bounces@debbugs.gnu.org Tue Jan 22 15:59:06 2019 Received: (at control) by debbugs.gnu.org; 22 Jan 2019 20:59:06 +0000 Received: from localhost ([127.0.0.1]:41613 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gm38T-0005Mi-Nd for submit@debbugs.gnu.org; Tue, 22 Jan 2019 15:59:05 -0500 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:7079) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gm38Q-0005Lz-2M for control@debbugs.gnu.org; Tue, 22 Jan 2019 15:59:02 -0500 X-IronPort-AV: E=Sophos;i="5.56,508,1539640800"; d="scan'208";a="365316255" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/AES256-GCM-SHA384; 22 Jan 2019 21:58:48 +0100 Date: Tue, 22 Jan 2019 21:58:47 +0100 Message-Id: <87h8e0l88o.fsf@gnu.org> To: control@debbugs.gnu.org From: =?utf-8?Q?Ludovic_Court=C3=A8s?= Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -4.0 (----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) merge 27476 34112 From debbugs-submit-bounces@debbugs.gnu.org Tue Jan 29 05:23:29 2019 Received: (at 27476) by debbugs.gnu.org; 29 Jan 2019 10:23:29 +0000 Received: from localhost ([127.0.0.1]:49725 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1goQYD-0000Az-Hj for submit@debbugs.gnu.org; Tue, 29 Jan 2019 05:23:29 -0500 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21145) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1goQYA-0000Aq-7U for 27476@debbugs.gnu.org; Tue, 29 Jan 2019 05:23:27 -0500 ARC-Seal: i=1; a=rsa-sha256; t=1548756440; cv=none; d=zoho.com; s=zohoarc; b=WEkZECjtiFgs4ty4TcpyFeXMXkpLOp3Rqs0y1LWmxjpIUelfv+af+yfLr7jKEcH/gIeE87SjLmF8Mx19QLClyUtboNBiMqUj8HpQfGSg4t28Z3YXWrKgQ8S6+OgVTTuY7ScPyzaaDoU3oU5ApuRsy5F/rfSYZaCgLkajwmT1X3E= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1548756440; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:To:ARC-Authentication-Results; bh=Khh1BAJPj/ax5LV42rxCB3WH0Z4yWACdk2gsM1icH+w=; b=P/QLR9gJMZk9As2MnV0j1xUUaWe4/W6dYcYRTKzAyA7fuOX1FrjSwOYKM3FKktarl+R9OVRuZ5DT/7popLr5NMLsYu16E4q2/0D9b3vH7SVo1deBEu72HrUy4Yc+x8aC1NrBdcP8Gy3au467NU19n6CVnepocDnU02j6Gejz418= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1548756440; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; l=1233; bh=Khh1BAJPj/ax5LV42rxCB3WH0Z4yWACdk2gsM1icH+w=; b=CZz2+Wh4j28SYP6UHL2mi+Mr+BYwM2hkQPjSqatYvVO2owwWoAKYGUzvDLbrmwZm MDGpvbPQOSt4dIfAVLULAC5xy262FfTs159JceSi0kJyZuWIGpPt1uLEEawbsd0IYoj 31UjaPFGSRs63hfIAtLnitwNiE/ATOdYJT9Rwtvc= Received: from localhost (p578E6B40.dip0.t-ipconnect.de [87.142.107.64]) by mx.zohomail.com with SMTPS id 1548756439341569.8064956900462; Tue, 29 Jan 2019 02:07:19 -0800 (PST) References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> User-agent: mu4e 1.0; emacs 26.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#27476: guix pull fails on powerful server In-reply-to: <87h8nstms1.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Tue, 29 Jan 2019 11:07:15 +0100 Message-ID: <8736pbrd4c.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 27476 Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Ludovic Court=C3=A8s writes: > ludo@gnu.org (Ludovic Court=C3=A8s) skribis: > >> I can=E2=80=99t reproduce this with current Guile =E2=80=98stable-2.2=E2= =80=99, following Andy=E2=80=99s >> weak-table rewrite=C2=B9, so this might have been a weak-table bug showi= ng up >> under memory pressure. > > With Guile 2.2.3 a similar program triggers a crash very quickly: > > --8<---------------cut here---------------start------------->8--- > $ cat ../guile-debugging/syntax-parms.scm > (use-modules (ice-9 threads) > (srfi srfi-1) > (guix monads) > (guix store) > (system base compile)) > > (compile #f) ;load modules > > (define threads > (unfold (lambda (x) (> x 100)) > (lambda (x) > (call-with-new-thread > (lambda () > (while #t > (compile > '(mlet %store-monad ((x y)) > (mbegin %store-monad > (return x) > (return y))) > #:env (current-module) > #:from 'scheme > #:to 'tree-il))))) > 1+ > 0)) > > (for-each join-thread threads) [=E2=80=A6] > --8<---------------cut here---------------end--------------->8--- I tried this with guile 2.2.4 on my laptop with 4 CPUs (according to lscpu) and I did not get a crash even after waiting for several minutes. -- Ricardo From debbugs-submit-bounces@debbugs.gnu.org Wed Feb 06 08:20:11 2019 Received: (at control) by debbugs.gnu.org; 6 Feb 2019 13:20:11 +0000 Received: from localhost ([127.0.0.1]:34156 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grN7b-0002pg-2x for submit@debbugs.gnu.org; Wed, 06 Feb 2019 08:20:11 -0500 Received: from hera.aquilenet.fr ([185.233.100.1]:47166) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grN7Z-0002pV-6l for control@debbugs.gnu.org; Wed, 06 Feb 2019 08:20:09 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id B0139C57C for ; Wed, 6 Feb 2019 14:20:08 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qqheGXoCAWoJ for ; Wed, 6 Feb 2019 14:20:08 +0100 (CET) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 0308EC43 for ; Wed, 6 Feb 2019 14:20:07 +0100 (CET) Date: Wed, 06 Feb 2019 14:20:07 +0100 Message-Id: <875ztxawag.fsf@gnu.org> To: control@debbugs.gnu.org From: =?utf-8?Q?Ludovic_Court=C3=A8s?= Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) merge 27476 34319 From debbugs-submit-bounces@debbugs.gnu.org Wed Feb 06 09:48:58 2019 Received: (at 27476) by debbugs.gnu.org; 6 Feb 2019 14:48:58 +0000 Received: from localhost ([127.0.0.1]:34206 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grOVW-00075m-4A for submit@debbugs.gnu.org; Wed, 06 Feb 2019 09:48:58 -0500 Received: from hera.aquilenet.fr ([185.233.100.1]:48918) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grOVT-00075b-At for 27476@debbugs.gnu.org; Wed, 06 Feb 2019 09:48:56 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 8C5B9C56D; Wed, 6 Feb 2019 15:48:53 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id vybYlbeQSRmR; Wed, 6 Feb 2019 15:48:52 +0100 (CET) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 44A86C545; Wed, 6 Feb 2019 15:48:52 +0100 (CET) From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Andy Wingo Subject: Re: bug#27476: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> <874ljstlvq.fsf_-_@gnu.org> <87603x6x1f.fsf@igalia.com> <878t8tyyfk.fsf@gnu.org> <87lgct5e06.fsf@igalia.com> Date: Wed, 06 Feb 2019 15:48:51 +0100 In-Reply-To: <87lgct5e06.fsf@igalia.com> (Andy Wingo's message of "Wed, 09 May 2018 12:18:01 +0200") Message-ID: <87lg2t7z1o.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello Andy! Since guix-core.drv is the best reproducer I have so far for this syntax parameter crash, I modified (guix self) to print the name of the files it=E2=80=99s compiling, and here=E2=80=99s the crash I got (on a 24-core ma= chine): --8<---------------cut here---------------start------------->8--- building /gnu/store/hf324mhj5607hh2izb01dzhwakmn8am8-guix-core.drv... [ 39/ 78] loading... 100.0% of 39 filesbuilding "guix/config.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix/monad-repl.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix/store.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix/utils.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix/memoization.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix/profiling.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix/build/utils.scm" [ 39/ 78] compiling... 0.0% of 39 filesbuilding "guix/build/syscalls.scm" [ 40/ 78] compiling... 2.6% of 39 filesbuilding "guix/deprecation.scm" [ 41/ 78] compiling... 5.1% of 39 filesbuilding "guix/i18n.scm" [ 42/ 78] compiling... 7.7% of 39 filesbuilding "guix/serialization.scm" [ 43/ 78] compiling... 10.3% of 39 filesbuilding "guix/combinators.scm" [ 44/ 78] compiling... 12.8% of 39 filesbuilding "guix/monads.scm" [ 45/ 78] compiling... 15.4% of 39 filesbuilding "guix/records.scm" [ 46/ 78] compiling... 17.9% of 39 filesIn ice-9/psyntax.scm: 2338:44 19 (expand-let _ _ _ ((line . 447) (column . 6) (filename . "./gu= ix/monads.scm")) _ # = _ _ _) 1679:45 18 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 17 (map1 (((("placeholder" placeholder) ("l-10a3c941d34314a1-4889= " lexical . failure-10a3c941d34314a1-488a) ("placeholder" placeholder) ("pl= aceholder" placeholder) ("l-10a3c9?" . #) ?) ?))) In ice-9/psyntax.scm: 1409:12 16 (_ _ _ #)>) 2338:44 15 (expand-let _ _ _ ((line . 447) (column . 6) (filename . "./gu= ix/monads.scm")) (hygiene guix monads) # _ _ ((# ?))) 1679:45 14 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 13 (map1 (((("l-10a3c941d34314a1-4894" macro . #) ("placeholder" placeholder) ("l-10a3c941d3= 4314a1-488f" lexical . #) ("l-10?" . #) ?) . #))) In ice-9/psyntax.scm: 2338:44 12 (expand-let _ _ _ ((line . 447) (column . 6) (filename . "./gu= ix/monads.scm")) (hygiene guix monads) # _ _ ((# ?))) 1679:45 11 (parse _ _ _ _ _ _ _) In ice-9/boot-9.scm: 222:17 10 (map1 (((("l-10a3c941d34314a1-48b0" macro . #) ("placeholder" placeholder) ("l-10a3c941d3= 4314a1-48ac" lexical . #) ("l-10?" . #) ?) . #))) In ice-9/psyntax.scm: 2338:44 9 (expand-let _ _ _ ((line . 447) (column . 6) (filename . "./gu= ix/monads.scm")) (hygiene guix monads) # _ _ ((# ?))) 1612:33 8 (parse (((("placeholder" placeholder) ("l-10a3c941d34314a1-48c= 8" lexical . tail-10a3c941d34314a1-48c9) ("l-10a3c941d34314a1-48b0" macro .= #) ?) . #)) ?) 1348:32 7 (syntax-type (>>=3D (mproc head result) (lambda (result) (loop= tail result))) (("placeholder" placeholder) ("l-10a3c941d34314a1-48c8" lex= ical . tail-10a3c941d34314a1-48c9) ("l-?" . #) ?) ?) 1559:32 6 (expand-macro # _ _ _ _ _ _) In ice-9/boot-9.scm: 752:25 5 (dispatch-exception _ _ _) 751:25 4 (dispatch-exception 1 syntax-error (>>=3D ">>=3D (bind) used o= utside of 'with-monad'" ((line . 451) (column . 9) (filename . "./guix/mona= ds.scm")) (>>=3D (mproc head result) (lambda # ?)) #)) In guix/build/compile.scm: 122:6 3 (_ _ . _) In ice-9/boot-9.scm: 829:9 2 (catch #t # # _) In guix/build/compile.scm: 125:21 1 (_) In unknown file: 0 (make-stack #t) guix/build/compile.scm:125:21: Syntax error: ./guix/monads.scm:452:9: >>=3D: >>=3D (bind) used outside of 'with-monad' i= n form (>>=3D (mproc head result) (lambda (result) (loop tail result))) builder for `/gnu/store/hf324mhj5607hh2izb01dzhwakmn8am8-guix-core.drv' fai= led with exit code 1 --8<---------------cut here---------------end--------------->8--- Here (guix monads) was already loaded before, but it=E2=80=99s only when compiling (guix monads), so after it had been loaded, that we get the error. The syntax parameter in question is defined in (guix monads) itself. I drew the conclusion that our syntax parameter is redefined when we compile or when we load (guix monads), so there=E2=80=99s a chance that we = get to see the wrong value when we expand (guix monads) (I=E2=80=99m not entire= ly sure about the exact sequence of events.) So I came up with =E2=80=98define-syntax-parameter-once=E2=80=99, which is = like =E2=80=98define-once=E2=80=99 but for syntax parameters (note that we can= =E2=80=99t use =E2=80=98define-once=E2=80=99 in =E2=80=98define-syntax-parameter-once=E2= =80=99 because it expands to a reference to NAME, which doesn=E2=80=99t work for a macro): --=-=-= Content-Type: text/x-patch Content-Disposition: inline diff --git a/guix/monads.scm b/guix/monads.scm index 6ae616aca9..1bbf79c8ba 100644 --- a/guix/monads.scm +++ b/guix/monads.scm @@ -274,12 +274,20 @@ more optimizations." (_ #'generic-name)))))))))) -(define-syntax-parameter >>= +(define-syntax-rule (define-syntax-parameter-once name proc) + (eval-when (load eval expand compile) + (define name + (if (module-locally-bound? (current-module) 'name) + (module-ref (current-module) 'name) + (make-syntax-transformer 'name 'syntax-parameter + (list proc)))))) + +(define-syntax-parameter-once >>= ;; The name 'bind' is already taken, so we choose this (obscure) symbol. (lambda (s) (syntax-violation '>>= ">>= (bind) used outside of 'with-monad'" s))) -(define-syntax-parameter return +(define-syntax-parameter-once return (lambda (s) (syntax-violation 'return "return used outside of 'with-monad'" s))) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable I=E2=80=99ve done a number of rebuilds of guix-core.drv on that 24-core mac= hine and AFAICS that fixes the issue! We=E2=80=99ll also have to use it in (guix gexp), which I=E2=80=99m pretty = sure will fix . I=E2=80=99ll push this workaround if there are no objections. On the Guile side, we could maybe arrange to always have =E2=80=98define-on= ce=E2=80=99 semantics for those bindings introduced at expansion time, as shown below (untested): --=-=-= Content-Type: text/x-patch Content-Disposition: inline --- a/module/ice-9/psyntax.scm +++ b/module/ice-9/psyntax.scm @@ -296,9 +296,10 @@ (define put-global-definition-hook (lambda (symbol type val) - (module-define! (current-module) - symbol - (make-syntax-transformer symbol type val)))) + (unless (module-locally-bound? (current-module) symbol) + (module-define! (current-module) + symbol + (make-syntax-transformer symbol type val))))) (define get-global-definition-hook (lambda (symbol module) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable WDYT, Andy? The discussion we had at FOSDEM turned out to be very helpful, thanks a lot! Ludo=E2=80=99. --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Wed Feb 06 11:14:53 2019 Received: (at 27476) by debbugs.gnu.org; 6 Feb 2019 16:14:54 +0000 Received: from localhost ([127.0.0.1]:36096 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grPqf-0003JB-Jz for submit@debbugs.gnu.org; Wed, 06 Feb 2019 11:14:53 -0500 Received: from pb-sasl21.pobox.com ([173.228.157.49]:63175 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grPqc-0003J1-7P for 27476@debbugs.gnu.org; Wed, 06 Feb 2019 11:14:51 -0500 Received: from sasl.smtp.pobox.com (unknown [127.0.0.1]) by pb-sasl21.pobox.com (Postfix) with ESMTP id 1508019115; Wed, 6 Feb 2019 11:14:49 -0500 (EST) (envelope-from wingo@igalia.com) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc :subject:references:date:in-reply-to:message-id:mime-version :content-type:content-transfer-encoding; s=sasl; bh=itu+D37zuu95 FjzgLG9yMp3lXOQ=; b=WbN3rESNN+3p5hNGLLk4Asy+HoGg4Ky0UvSNk4NJxRi1 L5/trR66GDw9JCmFwhW+8tgi2neCS7xluhVqhcfqvMXjPglYGa0i4F0K+H6HnaeW nR3/BGG5ejtF03kcyP3VrJsr5eO/VAdJezAYS1m5J/lQjgsZNWUIjFiiqVjSb1U= Received: from pb-sasl21.sea.icgroup.com (unknown [127.0.0.1]) by pb-sasl21.pobox.com (Postfix) with ESMTP id 01A8B19114; Wed, 6 Feb 2019 11:14:49 -0500 (EST) (envelope-from wingo@igalia.com) Received: from milano (unknown [90.87.228.11]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by pb-sasl21.pobox.com (Postfix) with ESMTPSA id 1A36F19110; Wed, 6 Feb 2019 11:14:44 -0500 (EST) (envelope-from wingo@igalia.com) From: Andy Wingo To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#27476: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> <874ljstlvq.fsf_-_@gnu.org> <87603x6x1f.fsf@igalia.com> <878t8tyyfk.fsf@gnu.org> <87lgct5e06.fsf@igalia.com> <87lg2t7z1o.fsf@gnu.org> Date: Wed, 06 Feb 2019 17:14:37 +0100 In-Reply-To: <87lg2t7z1o.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Wed, 06 Feb 2019 15:48:51 +0100") Message-ID: <87o97o99n6.fsf@igalia.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Pobox-Relay-ID: 515165A4-2A2A-11E9-9CD3-A7336ED6240D-02397024!pb-sasl21.pobox.com X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.3 (/) Hi! On Wed 06 Feb 2019 15:48, Ludovic Court=C3=A8s writes: > I drew the conclusion that our syntax parameter is redefined when we > compile or when we load (guix monads), so there=E2=80=99s a chance that w= e get > to see the wrong value when we expand (guix monads) (I=E2=80=99m not enti= rely > sure about the exact sequence of events.) You are a wizard!!!! To be clear, here's the series of events. Firstly, know that defining a syntax parameter is like: (define name (make-syntax-transformer 'name 'syntax-parameter (list f))) So at the top level you end up with an association between a name and a "syntax transformer" object (see macros.[ch]). The syntax transformer object itself consists of its name (for debugging), its syntax type, and its syntax binding. For syntax parameters, the binding is a list containing a single element, the syntax transformer. This list is later used as a key into a compile-time environment, as it's a unique object associated with the syntax parameter. When (syntax-parameterize ((name f*)) exp) is seen, psyntax will look up `name' in the current expansion-time environment. It asserts that the name is bound to a syntax transformer and that the syntax transformer is indeed a syntax parameter, and extracts the associated binding `b'. Keep in bind that `b' is the single-element list containing the "default" syntax transformer `f'. syntax-parameterize then does something weird: it adds an association between the binding value `b' and `f*' to the expand-time environment. It does this because the `b' is just a fresh object, so it's a unique key that's usable for associations. (The way this works is my fault FWIW.) To be clear, it doesn't add a new definition of `name'; it instead establishes a new lexical binding for the unique object `b'. Then when a use of `name' is seen within `exp', Guile finds that `name' is a syntax parameter, extracts the binding from the syntax transformer object, then does a second lookup of that binding. If it finds something bound, it uses that, otherwise it uses the default binding. I think you see the race here. For an initial state of (define P (stx-param (list F))) we have: thread A thread B time resolve P | extract B | associate B and F* | | define P (stx-param (list F**)) resolve P | extract B (!) | resolve B (!) | see F** instead of F* (!) | v > So I came up with =E2=80=98define-syntax-parameter-once=E2=80=99, which i= s like > =E2=80=98define-once=E2=80=99 but for syntax parameters (note that we can= =E2=80=99t use > =E2=80=98define-once=E2=80=99 in =E2=80=98define-syntax-parameter-once=E2= =80=99 because it expands to a > reference to NAME, which doesn=E2=80=99t work for a macro): Your fix is good! But, it prevents redefinition of syntax parameters. I would like to work on a solution that instead of using this double-lookup, simply adds an association between P and F* in the environment, instead of doing the double-lookup thing. Probably that will be 3.0-only. For 2.2, we can probably update the compiler to trampoline through some kind of "redefine-syntax" or something that will do (set-car! B F**) instead of (define P (stx-param B*)). I.e. redefinition keeps the unique key there. Andy From debbugs-submit-bounces@debbugs.gnu.org Wed Feb 06 15:57:33 2019 Received: (at control) by debbugs.gnu.org; 6 Feb 2019 20:57:34 +0000 Received: from localhost ([127.0.0.1]:36209 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grUGD-0005yw-K3 for submit@debbugs.gnu.org; Wed, 06 Feb 2019 15:57:33 -0500 Received: from hera.aquilenet.fr ([185.233.100.1]:53706) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grUGB-0005yo-RG for control@debbugs.gnu.org; Wed, 06 Feb 2019 15:57:32 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 3B750C78C for ; Wed, 6 Feb 2019 21:57:31 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id z7eHljAn8uhu for ; Wed, 6 Feb 2019 21:57:30 +0100 (CET) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 90BD6C760 for ; Wed, 6 Feb 2019 21:57:30 +0100 (CET) Date: Wed, 06 Feb 2019 21:57:29 +0100 Message-Id: <87h8dg8wjq.fsf@gnu.org> To: control@debbugs.gnu.org From: =?utf-8?Q?Ludovic_Court=C3=A8s?= Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) merge 27476 28144 From debbugs-submit-bounces@debbugs.gnu.org Wed Feb 06 17:09:30 2019 Received: (at 27476) by debbugs.gnu.org; 6 Feb 2019 22:09:30 +0000 Received: from localhost ([127.0.0.1]:36274 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grVNq-0001NU-Aa for submit@debbugs.gnu.org; Wed, 06 Feb 2019 17:09:30 -0500 Received: from hera.aquilenet.fr ([185.233.100.1]:54776) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1grVNm-0001NH-9A for 27476@debbugs.gnu.org; Wed, 06 Feb 2019 17:09:29 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id A0191C814; Wed, 6 Feb 2019 23:09:25 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id aqo0STq-8mD5; Wed, 6 Feb 2019 23:09:25 +0100 (CET) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id A92E7963F; Wed, 6 Feb 2019 23:09:24 +0100 (CET) From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Andy Wingo Subject: Re: bug#27476: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> <874ljstlvq.fsf_-_@gnu.org> <87603x6x1f.fsf@igalia.com> <878t8tyyfk.fsf@gnu.org> <87lgct5e06.fsf@igalia.com> <87lg2t7z1o.fsf@gnu.org> <87o97o99n6.fsf@igalia.com> Date: Wed, 06 Feb 2019 23:09:23 +0100 In-Reply-To: <87o97o99n6.fsf@igalia.com> (Andy Wingo's message of "Wed, 06 Feb 2019 17:14:37 +0100") Message-ID: <87va1w6030.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 27476 Cc: Ricardo Wurmus , 27476@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hi! Andy Wingo skribis: > To be clear, here's the series of events. Firstly, know that defining a > syntax parameter is like: Thanks for the clear explanation! >> So I came up with =E2=80=98define-syntax-parameter-once=E2=80=99, which = is like >> =E2=80=98define-once=E2=80=99 but for syntax parameters (note that we ca= n=E2=80=99t use >> =E2=80=98define-once=E2=80=99 in =E2=80=98define-syntax-parameter-once= =E2=80=99 because it expands to a >> reference to NAME, which doesn=E2=80=99t work for a macro): > > Your fix is good! But, it prevents redefinition of syntax parameters. Yes. It=E2=80=99s acceptable in this case, so I=E2=80=99ve pushed it as a = workaround as commit 8245bb74fc7bdcdc2f9d458057cefc9cd982e489 in Guix. > I would like to work on a solution that instead of using this > double-lookup, simply adds an association between P and F* in the > environment, instead of doing the double-lookup thing. Probably that > will be 3.0-only. > > For 2.2, we can probably update the compiler to trampoline through some > kind of "redefine-syntax" or something that will do (set-car! B F**) > instead of (define P (stx-param B*)). I.e. redefinition keeps the > unique key there. Sounds good. Are you taking a look at this? Perhaps that=E2=80=99d be a good excuse to release 2.2.5. Thank you! Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Sat Feb 09 17:11:10 2019 Received: (at control) by debbugs.gnu.org; 9 Feb 2019 22:11:10 +0000 Received: from localhost ([127.0.0.1]:41614 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gsaq6-0007iR-Ag for submit@debbugs.gnu.org; Sat, 09 Feb 2019 17:11:10 -0500 Received: from hera.aquilenet.fr ([185.233.100.1]:55182) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gsaq4-0007iK-VT for control@debbugs.gnu.org; Sat, 09 Feb 2019 17:11:09 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 6810FDE1D for ; Sat, 9 Feb 2019 23:11:08 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Pfllsl7kFV5b for ; Sat, 9 Feb 2019 23:11:07 +0100 (CET) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 9F9BADE1C for ; Sat, 9 Feb 2019 23:11:07 +0100 (CET) Date: Sat, 09 Feb 2019 23:11:06 +0100 Message-Id: <87sgwwpq85.fsf@gnu.org> To: control@debbugs.gnu.org From: =?utf-8?Q?Ludovic_Court=C3=A8s?= Subject: control message for bug #27476 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) reassign 27476 guile From debbugs-submit-bounces@debbugs.gnu.org Thu Dec 17 10:12:29 2020 Received: (at 27476-done) by debbugs.gnu.org; 17 Dec 2020 15:12:29 +0000 Received: from localhost ([127.0.0.1]:36670 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kpuxA-0005Bh-Rr for submit@debbugs.gnu.org; Thu, 17 Dec 2020 10:12:29 -0500 Received: from eggs.gnu.org ([209.51.188.92]:44524) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kpux9-0005BT-5c for 27476-done@debbugs.gnu.org; Thu, 17 Dec 2020 10:12:27 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:53412) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kpux2-0003GT-Rp; Thu, 17 Dec 2020 10:12:21 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=40376 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kpux1-00083H-Qd; Thu, 17 Dec 2020 10:12:20 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Andy Wingo Subject: Re: bug#27476: libguile/memoize.c is not thread safe, so syntax parameter expansion is not thread-safe References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <878tfi9x15.fsf@gnu.org> <87h8nstms1.fsf@gnu.org> <874ljstlvq.fsf_-_@gnu.org> <87603x6x1f.fsf@igalia.com> <878t8tyyfk.fsf@gnu.org> <87lgct5e06.fsf@igalia.com> <87lg2t7z1o.fsf@gnu.org> <87o97o99n6.fsf@igalia.com> <87va1w6030.fsf@gnu.org> Date: Thu, 17 Dec 2020 16:12:17 +0100 In-Reply-To: <87va1w6030.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Wed, 06 Feb 2019 23:09:23 +0100") Message-ID: <87wnxgfovi.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 27476-done Cc: 27476-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi! For the record, this was fixed in 61a8c9300daeb730fe5094f889bf13241942be84, which made it into 2.9/3.0, and 2dccec9f553776656d9378e2315ad32d2e55286b, which made it into 2.2.5. Closing! :-) Ludo=E2=80=99. From unknown Tue Jun 17 01:46:30 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 15 Jan 2021 12:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator