From debbugs-submit-bounces@debbugs.gnu.org Sun Nov 01 05:31:10 2015 Received: (at submit) by debbugs.gnu.org; 1 Nov 2015 10:31:10 +0000 Received: from localhost ([127.0.0.1]:47511 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zspuo-0001k6-1u for submit@debbugs.gnu.org; Sun, 01 Nov 2015 05:31:10 -0500 Received: from eggs.gnu.org ([208.118.235.92]:53741) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZspuT-0001jM-Hl for submit@debbugs.gnu.org; Sun, 01 Nov 2015 05:31:08 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ZspuS-0000TR-Al for submit@debbugs.gnu.org; Sun, 01 Nov 2015 05:30:49 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:42054) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZspuS-0000TN-7m for submit@debbugs.gnu.org; Sun, 01 Nov 2015 05:30:48 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:35514) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZspuR-0006w0-B8 for bug-guix@gnu.org; Sun, 01 Nov 2015 05:30:48 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ZspuM-0000Ss-BM for bug-guix@gnu.org; Sun, 01 Nov 2015 05:30:47 -0500 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:52926) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZspuM-0000So-84 for bug-guix@gnu.org; Sun, 01 Nov 2015 05:30:42 -0500 Received: from reverse-83.fdn.fr ([80.67.176.83]:58000 helo=pluto) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1ZspuK-00047W-Sm for bug-guix@gnu.org; Sun, 01 Nov 2015 05:30:41 -0500 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: bug-guix@gnu.org Subject: Guitarix builds non-deterministically X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 11 Brumaire an 224 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x3D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Sun, 01 Nov 2015 11:30:39 +0100 Message-ID: <87k2q257w0.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Guitarix 0.33.0, as of Guix commit 3c3e697, builds non-deterministically: --8<---------------cut here---------------start------------->8--- $ ./pre-inst-env guix challenge guitarix updating list of substitutes from 'http://hydra.gnu.org'... 100.0% /gnu/store/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix-0.33.0 contents differ: local hash: 1rh7qxmylsbsaah59h7sclqqxcz0lwsixlc0krkzwhx8gfhlyam6 http://hydra.gnu.org/nar/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix-0.33.0= : 1cq4k1wdqibwraqk0wkjj6n5hgs9v9zcvwr2wfgxvgxnf5l1rfhf $ wget -q -O - http://hydra.gnu.org/nar/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-gu= itarix-0.33.0 | bunzip2 | guix archive -x t $ LC_ALL=3DC diff -r /gnu/store/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix-0= .33.0 t $ LC_ALL=3DC diff -r --no-dereference /gnu/store/6ksnwcqn92z2nf6qw5js7njnfq= lifgpb-guitarix-0.33.0 t File /gnu/store/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix-0.33.0/lib/libgxw= .so is a symbolic link while file t/lib/libgxw.so is a regular file --8<---------------cut here---------------end--------------->8--- It appears to create libgxw.so either as a symlink or as a regular file in a non-deterministic fashion. It would be nice to see why this happens, and whether this affects all Waf-based packages. Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Tue Nov 12 15:44:41 2019 Received: (at 21803) by debbugs.gnu.org; 12 Nov 2019 20:44:41 +0000 Received: from localhost ([127.0.0.1]:58454 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iUd1j-0001fr-Ab for submit@debbugs.gnu.org; Tue, 12 Nov 2019 15:44:41 -0500 Received: from mail-qk1-f170.google.com ([209.85.222.170]:39028) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iUd1f-0001fc-4m for 21803@debbugs.gnu.org; Tue, 12 Nov 2019 15:44:35 -0500 Received: by mail-qk1-f170.google.com with SMTP id 15so15749444qkh.6 for <21803@debbugs.gnu.org>; Tue, 12 Nov 2019 12:44:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=EOWhy15txCbZ0g2mMySLMfSRR7qkZmotIeK1FrE+Qyc=; b=qovyy2hwCdcbws2kvmX4GIjnAq1uf6tm+JPvUgN+FbY2vVMRi1D9rMgT4zsqI9dIZX HsDDkV2ImlL7M0ZzOHr3/Fv76DgPLhtqRvguK8o0K3lIH40oVICiQAalqjbEH8hvHE0L /cEe4h+zeOIfxRiVhtD67VChApy2kLPJyGu6vgAGZhTB/mDGe6xmse/UhAo/4D4J/9nZ +yQ67zkOe7zWoOt4f97RQjY7db6/yZsM8iqZW92X9S76OKx38qoLsWsOKsTyBGg68U2E +Z2Bm3nPx084cO+Sk1JOeuwC4V4FRf1culmBULQ0l40m8xfWUmkZWvLhImHZQEFVx17J UgLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=EOWhy15txCbZ0g2mMySLMfSRR7qkZmotIeK1FrE+Qyc=; b=MGrYAmQMq3iBQzh/GfXNleZF0pqPsNS1e7t4KoIQ9e6ekBee84ABt2lgp9HLM5uxCz eqbKdUdN3mUz24IDpte8qRTWGPt43Ox4xpmoxLqOMwww+vy5HId8khRVKJUe7QzPLxd1 fOFmDIa65kXTQ/63kqe3OrVYDpOfOwWIuPAr1YGb/B1g3/GNYXu1dza8oL8u2O1IUhzJ iEd55t/D7ZpPh+7zAEWdtH7QF71kAxti8K46jEQ8vWiA10WhMvuMlWxrqRPNEk9Zta1P ysRIDTHPrf79z0uhciyFrE6KWiL4oqS9wa+j6RosKMzd2SaPHUx9k2D5PViN7EJwIxCd y7Tw== X-Gm-Message-State: APjAAAVeoIyhdjxz8u72PeaNIbBpASXq+OzU4bl/5wlfBSKxB3UCsAvO Y2pt0yTfpC06sEnmKvpwq1lmNOCkgDLlq46y38bYcxkYo70= X-Google-Smtp-Source: APXvYqyUFqMPN+RfiWKUlN3SdLTUQnC+JC+q1ZIN9wKfqsj8SXXrnr4avpPlmnzvw7vYcWfcbbzqwAsSRj4JfsXEuV0= X-Received: by 2002:a37:4146:: with SMTP id o67mr7291573qka.232.1573591469567; Tue, 12 Nov 2019 12:44:29 -0800 (PST) MIME-Version: 1.0 From: zimoun Date: Tue, 12 Nov 2019 21:44:18 +0100 Message-ID: Subject: Bug #21803 Hunting: status? To: 21803@debbugs.gnu.org, =?UTF-8?Q?Ludovic_Court=C3=A8s?= Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21803 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Ludo, You reported this bug more than 4 years ago about Guitarix 0.33 and now it is gone and replaced by Guitarix 0.38. >From my test with Guix d258d9c7d222e6b64531c14293f41bd8d62ea4f7, "guix challenge guitarix" and "guix build --rounds=3" do not report issues about reproducibility. And from my knowledge, the waf-based packages are not affected. Do you agree to close this bug since it is not relevant anymore? Thanks in advance for any comments. All the best, simon From debbugs-submit-bounces@debbugs.gnu.org Wed Nov 13 08:42:23 2019 Received: (at 21803) by debbugs.gnu.org; 13 Nov 2019 13:42:24 +0000 Received: from localhost ([127.0.0.1]:58932 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iUsuc-000715-5j for submit@debbugs.gnu.org; Wed, 13 Nov 2019 08:42:22 -0500 Received: from eggs.gnu.org ([209.51.188.92]:36621) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iUsua-00070u-RZ for 21803@debbugs.gnu.org; Wed, 13 Nov 2019 08:42:21 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:57248) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1iUsuV-0002yd-Ms; Wed, 13 Nov 2019 08:42:15 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=38964 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1iUsuV-00073J-9a; Wed, 13 Nov 2019 08:42:15 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: zimoun Subject: Re: Bug #21803 Hunting: status? References: X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 23 Brumaire an 228 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Wed, 13 Nov 2019 14:42:13 +0100 In-Reply-To: (zimoun's message of "Tue, 12 Nov 2019 21:44:18 +0100") Message-ID: <87sgmropu2.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, zimoun skribis: > From my test with Guix d258d9c7d222e6b64531c14293f41bd8d62ea4f7, > "guix challenge guitarix" and "guix build --rounds=3D3" do not report > issues about reproducibility. > > And from my knowledge, the waf-based packages are not affected. > > Do you agree to close this bug since it is not relevant anymore? If you=E2=80=99ve checked that a local build gives the same result several = times in a row (make sure it actually rebuilt things; =E2=80=9Cguix build --round= s=3D3 foo=E2=80=9D does nothing if =E2=80=9Cfoo=E2=80=9D is already in the store)= , then you can definitely close it! Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Wed Nov 13 13:14:25 2019 Received: (at 21803) by debbugs.gnu.org; 13 Nov 2019 18:14:25 +0000 Received: from localhost ([127.0.0.1]:60140 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iUx9r-0002lw-Gr for submit@debbugs.gnu.org; Wed, 13 Nov 2019 13:14:25 -0500 Received: from mail-qv1-f49.google.com ([209.85.219.49]:41880) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iUx9p-0002lj-6r for 21803@debbugs.gnu.org; Wed, 13 Nov 2019 13:14:21 -0500 Received: by mail-qv1-f49.google.com with SMTP id g18so1198974qvp.8 for <21803@debbugs.gnu.org>; Wed, 13 Nov 2019 10:14:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=NgY/daZiJKhq1ufsP0JmjUCJfwE81GA3W1G7SpsGjUs=; b=XbJfGIr2nKfWNJHx/1HhMKnjCH3D6bXF5zfXW6nygBMgUv2kGoaO3BZ/LM52+x1rBS E2/fFxEl+16Et2Z2udquphbKBpxRAe9EW/bp9funbRTi+GRXClxJ3AZHruF3e3cpBLu4 c+o91CTOuFS2HDoPaLg1fUz0D5jMKGgScEeRxu16Wz3R3w0AMYhqhLTnhCRWox0VNRuM YXK+jIb3A8axXS6m3MyfLpkMAr0uTd2FU3qVB78xQfcOvx97ukLrHAWGj4X/NLMaIq/P gub+u3+ATeaFBi5ziDJIf/S3pAdpXi8cbxyXOAJPLIE6SW0ZxEWFSK2dRiOm0MdSqG5y jWMQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=NgY/daZiJKhq1ufsP0JmjUCJfwE81GA3W1G7SpsGjUs=; b=lTbOTdz5HUyLsqZuS1hqwkkFwSPrXWFIRaCiQFiTiJ3rnkFmqgcnZDPfHUZfW2KtfO f9MdDodUgEm2SJoKIC/ZHAYUysD3Dp22B+ZKVClJONd4unzM0EdXGsCdyvgSuuHZMeTG r1iJl1SHT1GWvzC6zM8n0Q2sA3GVd5312k/VvyQIPASuSoP1zI8mnt27S984/Zb1Vn5P kCo8JttupPYR/K0zl/zDV3/PI2WFTz8LJdz7baNSv7b1u1RymZczssXa3sBJI1X3iXn7 q/BTyQzrrz9WkLXSroh3Fx3ucS5wxZiOhPZPifdROgvEbbfHu499DTIutCRUPHAFb47D My1Q== X-Gm-Message-State: APjAAAXaVQn9pb7N5I9SwUUWoDlNr7NAxnZsG0y+m17j4a6UHDQXWQbB /I7rTKQJwIe+rILcU30KL+4U+jeiztGzzO0KlR5k5/NoF9g= X-Google-Smtp-Source: APXvYqwTnlJqyY9Ni8s+vfC75IBcGzvPAVfLNy2Re59jxy8e3MdcZbovUhGXG6UCi1+tdoasq1q3D45PD8PCrl5pf0Y= X-Received: by 2002:ad4:5849:: with SMTP id de9mr4013066qvb.246.1573668855440; Wed, 13 Nov 2019 10:14:15 -0800 (PST) MIME-Version: 1.0 References: <87sgmropu2.fsf@gnu.org> In-Reply-To: <87sgmropu2.fsf@gnu.org> From: zimoun Date: Wed, 13 Nov 2019 19:14:04 +0100 Message-ID: Subject: Re: Bug #21803 Hunting: status? To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.5 (/) On Wed, 13 Nov 2019 at 14:42, Ludovic Court=C3=A8s wrote: > zimoun skribis: > > > From my test with Guix d258d9c7d222e6b64531c14293f41bd8d62ea4f7, > > "guix challenge guitarix" and "guix build --rounds=3D3" do not report > > issues about reproducibility. > > > > And from my knowledge, the waf-based packages are not affected. > > > > Do you agree to close this bug since it is not relevant anymore? > > If you=E2=80=99ve checked that a local build gives the same result severa= l times > in a row (make sure it actually rebuilt things; =E2=80=9Cguix build --rou= nds=3D3 > foo=E2=80=9D does nothing if =E2=80=9Cfoo=E2=80=9D is already in the stor= e), then you can > definitely close it! I think I did but how do you do that cleanly? I am testing with "brute force" method: "guix gc -C" then proceed. I notice unexpected behaviour; not sure it is the right place to report. 1. The first issue is that the two following commands do not populate the same way. (Because my machine is not very powerful, before building I populate the store with the dependencies from substitutes.) --8<---------------cut here---------------start------------->8--- $ guix environment guitarix -- echo Done --8<---------------cut here---------------start------------->8--- --8<---------------cut here---------------start------------->8--- $ guix build `guix show guitarix | recsel -R dependencies` --8<---------------cut here---------------start------------->8--- The main issue is about `gettext-minimal`. (Below, I pinpoint with star (*) which is not common between the both commands and with sharp (#) which appears twice in the same list.) 2. The second issue is the inconsistent outputs: --8<---------------cut here---------------start------------->8--- $ guix build guitarix --no-substitutes --dry-run The following derivations would be built: /gnu/store/ikdd9740fifdcqwmf170gmlrlkirwa8j-guitarix-0.38.1.drv /gnu/store/ismr6xqwsi165phwjx9kbcrmr9lsz61r-module-import.drv /gnu/store/zsigy6yfllikzxmnlii6ivxczlv8k5h3-guitarix2-0.38.1.tar.xz.drv /gnu/store/zya9lhiqqr24lbgkp510v1z9s4qdcqid-module-import-compiled.drv --8<---------------cut here---------------start------------->8--- --8<---------------cut here---------------start------------->8--- $ guix build guitarix --no-substitutes building /gnu/store/4fqc5dydkc4svkl1zjyz5ymnyycfakx8-module-import.drv... successfully built /gnu/store/4fqc5dydkc4svkl1zjyz5ymnyycfakx8-module-impor= t.drv building /gnu/store/s659hxn6zh7havik6bghip7mslarxfcx-ghostscript-9.27.tar.x= z.drv... Starting download of /gnu/store/gz3sh75g8rwvqqhmj7z1wbdrn36bwk1g-ghostscript-9.27.tar.xz >From https://github.com/ArtifexSoftware/ghostpdl-downloads/releases/downloa= d/gs927/ghostscript-9.27.tar.xz... following redirection to `https://github-production-release-asset-2e65be.s3.amazonaws.com/50461376/7= 0f10a80-56c2-11e9-8208-d05d335afc94?X-Amz-Algorithm=3DAWS4-HMAC-SHA256&X-Am= z-Credential=3DAKIAIWNJYAX4CSVEH53A%2F20191113%2Fus-east-1%2Fs3%2Faws4_requ= est&X-Amz-Date=3D20191113T173022Z&X-Amz-Expires=3D300&X-Amz-Signature=3D649= 8073580142d43071eba62060a7379b0dae94f148fc191b1a8ec53f284107a&X-Amz-SignedH= eaders=3Dhost&actor_id=3D0&response-content-disposition=3Dattachment%3B%20f= ilename%3Dghostscript-9.27.tar.xz&response-content-type=3Dapplication%2Foct= et-stream'... downloading from https://github.com/ArtifexSoftware/ghostpdl-downloads/releases/download/gs9= 27/ghostscript-9.27.tar.xz... ghostscript-9.27.tar.xz 31.6MiB 4.9MiB/s 00:02 [###### ] 34.0% ^C --8<---------------cut here---------------start------------->8--- Why `ghostscript` is downloaded and not reported; neither by the two populating commands? Do I miss the obvious? So I add it to the store with "guix build ghostscript" then I run again "guix build guitarix --no-substitutes" and again pieces are missing: --8<---------------cut here---------------start------------->8--- [...] downloading from http://downloads.sourceforge.net/project/cunit/CUnit/2.1-3/CUnit-2.1-3.tar.= bz2 [...] downloading from https://c-ares.haxx.se/download/c-ares-1.15.0.tar.gz [...] downloading from http://www.digip.org/jansson/releases/jansson-2.12.tar.bz= 2 --8<---------------cut here---------------start------------->8--- Then other pieces are missing. I suppose it is related to BAG and depth of the dependencies. Therefore, how is it possible to check the reproducibility of a package without compiling the World? For example, the test suite of Git kills my desktop machine. :-) Thank you in advance. simon -- --8<---------------cut here---------------start------------->8--- $ guix environment guitarix --dry-run -- echo Done substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% The following derivations would be built: /gnu/store/9p90w999xdqyhv6k1x5wp0sq312l10ri-profile.drv /gnu/store/qxhk96270rgn61nv7znbmgj5d4pamzgw-config.scm.drv 116.4 MB would be downloaded: * /gnu/store/zjnz5gg04zfyzn5gi66lay8sgv6i4rj8-module-import-compiled * /gnu/store/05kyg8pg8zzbrn366imllhxavdcwqgsk-mkfontdir-1.0.7 * /gnu/store/0dsc5kh6qfwshfaq01iqrfpdhlaici8n-libfontenc-1.1.4 * /gnu/store/r1p07fn372rcxzvfzqwm44w16n8gcqfc-mkfontscale-1.2.1 * /gnu/store/sclspjcznk50s894irfk2wzn6nfnxa2g-guile-gdbm-ffi-20120209.fa1= d5b6 * /gnu/store/s2hqjjp057l2k6ix3yaa7cc2dpwxpfm7-module-import * /gnu/store/pfqvay49nk9cja05sqw5cwm7fn3w4fn3-module-import-compiled * /gnu/store/zqyr73kc60f2dyj2ykl3ijk86kias0yc-module-import-compiled * /gnu/store/nsrym6zn3yb4390fazx1gq8rg0m8dhkd-llvm-8.0.0 * /gnu/store/vf5lkc27z5rcbvaw6rkdmqisyg923m5r-mesa-19.1.4 * /gnu/store/kjlnb30snlawpb4fb8qwhbzhcpbxlckk-libepoxy-1.5.3 * /gnu/store/4ppvmpyir7qwmhzkfxnqlb27j85rjqyz-gtk+-3.24.10-bin * /gnu/store/wwwnp8025yb7k6qbv28hi1l6qy6j7d9z-module-import-compiled * /gnu/store/iaqmwj2290z5nnrk69bss6r0d9lpr8cs-python2-2.7.16 /gnu/store/fzjnhsfgkqcsqjzan2dxkqgw6fl5kniy-lv2-1.16.0 /gnu/store/p8yabbkcywr8a5pcy3dg6w0mjaw6ddlq-zita-resampler-1.3.0 * /gnu/store/7zlxdamykwrd1vjp3kxv54qyyv7ya6jr-util-macros-1.19.2 /gnu/store/ksjvb9m0ky0g7yv27v70l44h8nj6v1qy-gtkmm-2.24.5 /gnu/store/pxwz526473fynfhwnljs0wb5vd2qcg4c-atkmm-2.28.0 /gnu/store/l8nphg0idd8pfddyad8f92lx8d1hc053-python-wrapper-3.7.4 /gnu/store/ms1q76ikx7f78y7i8crg42lyv88xfvfv-ghostscript-with-cups-9.27 /gnu/store/xc98lvvcbaabn0v1md34hxbdn5ivg72g-cups-filters-1.25.1 /gnu/store/lv9xckn9in3cbswaprv5j9xgsa8wghpr-cups-2.2.11 /gnu/store/vb4g1m42k156gwiwq62hd1db92ndvnch-gtk+-2.24.32 * /gnu/store/b824dq3bccq0bhjli3li0fzi11lg1bh3-xorgproto-2019.1 * /gnu/store/arzn28zwj8bqv2qiid7ybx3aad49c3pd-libpthread-stubs-0.4 /gnu/store/j1ldfckx81mm6fydlhzw03cv7hsr58ya-faust-0.9.90 /gnu/store/h10dlkcf019047d8jmjkw2w0h96zad2d-gperf-3.1 /gnu/store/zc4shgdr8pw9z5rcv9657p37wyha4nqa-fftwf-3.3.8 /gnu/store/dgkwjigfbadm0jn2y9z6d29lq0i3wj97-zita-convolver-3.1.0 /gnu/store/rm9q1vqhg333nwpywsbf017fj88dlgsf-eigen-3.3.5 /gnu/store/3vgaq9ga221mjx21sll3lxqxdgclgws4-flac-1.3.3 /gnu/store/y8wkxd3pmp29k1j0knmg9hnjnrfnm9iy-libsndfile-1.0.28 /gnu/store/f5g4av3mwn7zr81yqr1gn9hpb5d2c4m4-boost-1.70.0 /gnu/store/wrlkvgl0lz7b03gwqf27ql6pjkmj5v6r-bdb-6.2.32 /gnu/store/q1mz5mid5y4y3z12g5ify10ci7h72dnq-jack-0.125.0 * /gnu/store/5686hrxkbsm6ycf1ks9nja3mjjxjpl9a-desktop-file-utils-0.23 /gnu/store/a9rsi05xscg0bq6q0rbhcv5586zvf3li-cairomm-1.12.2 /gnu/store/s0djjrx5x8c12sa1p0wl10crvl7rzs0v-libsigc++-2.10.2 /gnu/store/78w7y0lxar70j512iqw8x3nimzj10yga-python-3.7.4 * /gnu/store/fpj5mspa7jmksixqpnzbvzs3q2vbqq31-glib-2.60.6-bin /gnu/store/b8pr2k0i2zd07zmb7kpffmcimqi337if-glib-2.60.6 /gnu/store/94s92fpkk14y514qwf4f4hnc54qz0zfj-glibmm-2.60.0 /gnu/store/dhnzrhs9vf40p5v09817rbcd3ks07slc-pangomm-2.42.0 * /gnu/store/20ilkjz5kd98zdm6rsk6zdw5p9nh0hq7-perl-xml-parser-2.44 /gnu/store/qw4p5qwd1f1kcwspm455njd4ny7v9gww-sratom-0.6.2 /gnu/store/r0jrq3jvvxrbx7sbqhs168yxaan9311v-sord-0.16.2 /gnu/store/77h391w9aynwwb5j83yakav5m6qi7bbg-lilv-0.24.4 /gnu/store/vfcbn39fwng8d35gvic51f235fxvj7y1-intltool-0.51.0 * /gnu/store/k3m2kz55qiklkyihnnvhxhv0ylsyyaqc-module-import-compiled /gnu/store/6zasp7vh5jww0naybhva026z1967scr7-ladspa-1.13 /gnu/store/v557q2wd91sm5vj3lrwjzajafblklr6w-libxslt-1.1.33 /gnu/store/k2m4q2av9hw73hw2jx6qrxqdyh855398-openssl-1.1.1c /gnu/store/f8aljw2qhv3d1br9czn8v5afbgfdrxkg-cyrus-sasl-2.1.27 /gnu/store/bjxd9jzc560d6i3i35f5yy5mljk0ib6m-openldap-2.4.47 /gnu/store/4m8dlhrzis07787xznx73ang35c3lly1-curl-7.65.3 /gnu/store/dgv36cg3x3pi2v00arwlfcvq3p7id4h5-raptor2-2.0.15 /gnu/store/x5k749kbwbmbd1sn0j6ybpcc9450fba2-lrdf-0.6.1 /gnu/store/pvz6zmy4lwaicjk07999gbsaim0p4iai-serd-0.30.0 The following profile hooks would be built: /gnu/store/5jc3lsfm9mj8smp3a4g4aqkq05zrjsq5-xdg-desktop-database.drv /gnu/store/6csqwjlmnsmpcgcdrxjm841d54xf7pcl-xdg-mime-database.drv /gnu/store/6k5057zfsxqf3kn5iqf27zz91jl7zbmh-info-dir.drv /gnu/store/chzwnq3kl6gc36sh2krlbfvxfga13cq5-gtk-icon-themes.drv /gnu/store/i22j0197hy2byv23f884dd0j6y7r93hp-manual-database.drv /gnu/store/immlg222fg9wpnjb04j6czwp8gviw7as-gtk-im-modules.drv /gnu/store/j7m81fkl3qacc1cnzifqiy0a4hzb8i6s-fonts-dir.drv /gnu/store/j96f9a5m2d7wi8pdvj6d5jvldbzjc3k8-glib-schemas.drv /gnu/store/mf3abgwykhp243r8cbfjwl1w7x6d7dkm-ca-certificate-bundle.drv --8<---------------cut here---------------end--------------->8--- --8<---------------cut here---------------start------------->8--- $ guix build `guix show guitarix | recsel -R dependencies` --dry-run substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% 76.1 MB would be downloaded: /gnu/store/f5g4av3mwn7zr81yqr1gn9hpb5d2c4m4-boost-1.70.0 * /gnu/store/33f8qhxa69dmd43yqdx3wq1b2hqjddgb-curl-7.65.3-doc # /gnu/store/4m8dlhrzis07787xznx73ang35c3lly1-curl-7.65.3 /gnu/store/rm9q1vqhg333nwpywsbf017fj88dlgsf-eigen-3.3.5 /gnu/store/j1ldfckx81mm6fydlhzw03cv7hsr58ya-faust-0.9.90 * /gnu/store/3pfj84hcpw0xfxh8briill4c5mnk51ha-gettext-minimal-0.20.1-doc * /gnu/store/ypwxvcnrsdn0snllv944ckylwx3p1m79-gettext-minimal-0.20.1 /gnu/store/h10dlkcf019047d8jmjkw2w0h96zad2d-gperf-3.1 * /gnu/store/vmwm54y790r3ipbyd1l8qzxhzw0byv7d-gtk+-2.24.32-doc # /gnu/store/vb4g1m42k156gwiwq62hd1db92ndvnch-gtk+-2.24.32 /gnu/store/pxwz526473fynfhwnljs0wb5vd2qcg4c-atkmm-2.28.0 /gnu/store/ms1q76ikx7f78y7i8crg42lyv88xfvfv-ghostscript-with-cups-9.27 /gnu/store/xc98lvvcbaabn0v1md34hxbdn5ivg72g-cups-filters-1.25.1 /gnu/store/lv9xckn9in3cbswaprv5j9xgsa8wghpr-cups-2.2.11 # /gnu/store/vb4g1m42k156gwiwq62hd1db92ndvnch-gtk+-2.24.32 /gnu/store/a9rsi05xscg0bq6q0rbhcv5586zvf3li-cairomm-1.12.2 /gnu/store/s0djjrx5x8c12sa1p0wl10crvl7rzs0v-libsigc++-2.10.2 /gnu/store/fpj5mspa7jmksixqpnzbvzs3q2vbqq31-glib-2.60.6-bin /gnu/store/b8pr2k0i2zd07zmb7kpffmcimqi337if-glib-2.60.6 /gnu/store/94s92fpkk14y514qwf4f4hnc54qz0zfj-glibmm-2.60.0 /gnu/store/dhnzrhs9vf40p5v09817rbcd3ks07slc-pangomm-2.42.0 /gnu/store/ksjvb9m0ky0g7yv27v70l44h8nj6v1qy-gtkmm-2.24.5 /gnu/store/vfcbn39fwng8d35gvic51f235fxvj7y1-intltool-0.51.0 /gnu/store/wrlkvgl0lz7b03gwqf27ql6pjkmj5v6r-bdb-6.2.32 /gnu/store/q1mz5mid5y4y3z12g5ify10ci7h72dnq-jack-0.125.0 /gnu/store/6zasp7vh5jww0naybhva026z1967scr7-ladspa-1.13 /gnu/store/3vgaq9ga221mjx21sll3lxqxdgclgws4-flac-1.3.3 /gnu/store/y8wkxd3pmp29k1j0knmg9hnjnrfnm9iy-libsndfile-1.0.28 /gnu/store/qw4p5qwd1f1kcwspm455njd4ny7v9gww-sratom-0.6.2 /gnu/store/r0jrq3jvvxrbx7sbqhs168yxaan9311v-sord-0.16.2 /gnu/store/pvz6zmy4lwaicjk07999gbsaim0p4iai-serd-0.30.0 /gnu/store/77h391w9aynwwb5j83yakav5m6qi7bbg-lilv-0.24.4 /gnu/store/v557q2wd91sm5vj3lrwjzajafblklr6w-libxslt-1.1.33 /gnu/store/f8aljw2qhv3d1br9czn8v5afbgfdrxkg-cyrus-sasl-2.1.27 /gnu/store/bjxd9jzc560d6i3i35f5yy5mljk0ib6m-openldap-2.4.47 # /gnu/store/4m8dlhrzis07787xznx73ang35c3lly1-curl-7.65.3 /gnu/store/dgv36cg3x3pi2v00arwlfcvq3p7id4h5-raptor2-2.0.15 /gnu/store/x5k749kbwbmbd1sn0j6ybpcc9450fba2-lrdf-0.6.1 /gnu/store/k2m4q2av9hw73hw2jx6qrxqdyh855398-openssl-1.1.1c /gnu/store/78w7y0lxar70j512iqw8x3nimzj10yga-python-3.7.4 /gnu/store/l8nphg0idd8pfddyad8f92lx8d1hc053-python-wrapper-3.7.4 /gnu/store/fzjnhsfgkqcsqjzan2dxkqgw6fl5kniy-lv2-1.16.0 /gnu/store/zc4shgdr8pw9z5rcv9657p37wyha4nqa-fftwf-3.3.8 /gnu/store/dgkwjigfbadm0jn2y9z6d29lq0i3wj97-zita-convolver-3.1.0 /gnu/store/p8yabbkcywr8a5pcy3dg6w0mjaw6ddlq-zita-resampler-1.3.0 --8<---------------cut here---------------end--------------->8--- From debbugs-submit-bounces@debbugs.gnu.org Thu Nov 14 16:09:17 2019 Received: (at 21803) by debbugs.gnu.org; 14 Nov 2019 21:09:17 +0000 Received: from localhost ([127.0.0.1]:35320 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVMMf-0004tm-HK for submit@debbugs.gnu.org; Thu, 14 Nov 2019 16:09:17 -0500 Received: from eggs.gnu.org ([209.51.188.92]:36549) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVMMd-0004tX-GJ for 21803@debbugs.gnu.org; Thu, 14 Nov 2019 16:09:16 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:60110) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1iVMMY-0008II-Dc; Thu, 14 Nov 2019 16:09:10 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=55242 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1iVMMW-0002PZ-Hh; Thu, 14 Nov 2019 16:09:09 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: zimoun Subject: Re: Bug #21803 Hunting: status? References: <87sgmropu2.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 24 Brumaire an 228 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 14 Nov 2019 22:09:06 +0100 In-Reply-To: (zimoun's message of "Wed, 13 Nov 2019 19:14:04 +0100") Message-ID: <87v9rmmah9.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, zimoun skribis: > On Wed, 13 Nov 2019 at 14:42, Ludovic Court=C3=A8s wrote: > >> zimoun skribis: >> >> > From my test with Guix d258d9c7d222e6b64531c14293f41bd8d62ea4f7, >> > "guix challenge guitarix" and "guix build --rounds=3D3" do not report >> > issues about reproducibility. >> > >> > And from my knowledge, the waf-based packages are not affected. >> > >> > Do you agree to close this bug since it is not relevant anymore? >> >> If you=E2=80=99ve checked that a local build gives the same result sever= al times >> in a row (make sure it actually rebuilt things; =E2=80=9Cguix build --ro= unds=3D3 >> foo=E2=80=9D does nothing if =E2=80=9Cfoo=E2=80=9D is already in the sto= re), then you can >> definitely close it! > > I think I did but how do you do that cleanly? > > > > I am testing with "brute force" method: "guix gc -C" then proceed. I > notice unexpected behaviour; not sure it is the right place to report. I would probably do =E2=80=9Cguix build guitarix=E2=80=9D (get the substitu= te) and then =E2=80=9Cguix build guitarix --check --no-grafts -K=E2=80=9D, possibly seve= ral times*, which builds guitarix alone from source. (*) =E2=80=98--rounds=E2=80=99 is ignored when combined with =E2=80=98--che= ck=E2=80=99, go figure=E2=80=A6 > 1. The first issue is that the two following commands do not populate > the same way. > > (Because my machine is not very powerful, before building I populate > the store with the dependencies from substitutes.) > > $ guix environment guitarix -- echo Done That should work. > $ guix build `guix show guitarix | recsel -R dependencies` That gives a different result because =E2=80=98dependencies=E2=80=99 does n= ot show implicit inputs. > Why `ghostscript` is downloaded and not reported; neither by the two > populating commands? This is because of grafts, which lead to a poor UX as things are=E2=80=A6 Perhaps there are genuine issues described in the rest of your message but we=E2=80=99d need to isolate them first. :-) Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 15 06:53:54 2019 Received: (at 21803) by debbugs.gnu.org; 15 Nov 2019 11:53:54 +0000 Received: from localhost ([127.0.0.1]:35726 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVaAk-000766-Gh for submit@debbugs.gnu.org; Fri, 15 Nov 2019 06:53:54 -0500 Received: from mail-qk1-f180.google.com ([209.85.222.180]:33080) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVaAh-00075s-QI for 21803@debbugs.gnu.org; Fri, 15 Nov 2019 06:53:52 -0500 Received: by mail-qk1-f180.google.com with SMTP id 71so7867806qkl.0 for <21803@debbugs.gnu.org>; Fri, 15 Nov 2019 03:53:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=klPCblLmE3nLIApWtlj5fW8m6/He1FxJA9/l2BMOTp8=; b=XVGPExBTMRY9aiEQ/dbRxuI039OasqZY/xCJyf6QKC82l0b6vtTwTfXy94Slw8AoFy 5KG6OoCty77ExYBLu9jBa1n1J24aenGNnpvpsOjXjvaA7iqLNlQ/9sutf7giruSmZH4m iylnNRSCrBmsjhsD2FZoo6vzjq9oIdKh641sGaND0PBCw1CeeqFnnfoT3lAbgXs29ktS Rnh2HoLd2hOKJYyhg4XgcOjdlWwXV0k8F33cPGGsjJnZ0l/IIUbuLfY3bJH0jal5bW7f wCqmcT5LXnnEDbwDctUZSH+vwW9Pn9pTCIfhxkCcDSt4cZnS9POqVKpD0+Vs5OFMj2Ec 5pnA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=klPCblLmE3nLIApWtlj5fW8m6/He1FxJA9/l2BMOTp8=; b=mObwhzqUVXOFlhkexQKD1nbY8c7OaidAi5wW5Jo+3+AWWe25sQOffz5JFv1HsCxQv4 yTj8X6PNPmhdVY9uauInuTsvsMCAwtIdxrKEh+d1dJlMgukzderEKiWd08wtrx7mpnbG suOwZxJMbN/BAPAsiQ3i4uN06Wljkk8xs+FyMf+6njUJMmUFnyytpM7QT+7qYS/4If/D FZxE7Z4EBp9zI90nFzHuzw+gGZSG0slpTB8sQhKQyaHXEL9732cKN9zTrc8NtA6yeNKo FFEYogakJ3AP4wmnMw2nf3y28n8dgeSIN6IpFH2M6nqvQxCkah9pkOpZ1FC+A1ssCDV3 7/Og== X-Gm-Message-State: APjAAAXEjhYTQhfe29KUnibhC6Beh9zON8WWyZfZkyXZd5XJdVrS6h47 H8Sr447kVdHT4ODzUBWkw/Dzuav9dmzbMRC+GZ0= X-Google-Smtp-Source: APXvYqxMgtqTXBBJ/+Xv8YIJ3nYexSj/xEgiuncP0QMapuvqdZDktwbLlQKt1JloNjMiKLbtVZ7t9Dy5pTWt8Q/CFc8= X-Received: by 2002:a37:4146:: with SMTP id o67mr11992486qka.232.1573818826121; Fri, 15 Nov 2019 03:53:46 -0800 (PST) MIME-Version: 1.0 References: <87sgmropu2.fsf@gnu.org> <87v9rmmah9.fsf@gnu.org> In-Reply-To: <87v9rmmah9.fsf@gnu.org> From: zimoun Date: Fri, 15 Nov 2019 12:53:35 +0100 Message-ID: Subject: Re: Bug #21803 Hunting: status? To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Ludo, Thank you for the explanations. On Thu, 14 Nov 2019 at 22:09, Ludovic Court=C3=A8s wrote: > I would probably do =E2=80=9Cguix build guitarix=E2=80=9D (get the substi= tute) and then > =E2=80=9Cguix build guitarix --check --no-grafts -K=E2=80=9D, possibly se= veral times*, > which builds guitarix alone from source. I confirm what you reported: --8<---------------cut here---------------start------------->8--- $ LC_ALL=3DC diff -r --no-dereference /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1 /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1-check File /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw= .so is a symbolic link while file /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1-check/lib/libgx= w.so is a regular file --8<---------------cut here---------------end--------------->8--- As you said, it needs more investigation... :-) > Perhaps there are genuine issues described in the rest of your message > but we=E2=80=99d need to isolate them first. :-) Yes, first things first. :-) And I will open discussion elsewhere because it is not related to this bug. Thanks, simon From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 15 10:35:35 2019 Received: (at 21803) by debbugs.gnu.org; 15 Nov 2019 15:35:35 +0000 Received: from localhost ([127.0.0.1]:37252 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVddE-0008FH-1I for submit@debbugs.gnu.org; Fri, 15 Nov 2019 10:35:35 -0500 Received: from mail-qt1-f172.google.com ([209.85.160.172]:45022) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVddC-0008F5-El for 21803@debbugs.gnu.org; Fri, 15 Nov 2019 10:35:31 -0500 Received: by mail-qt1-f172.google.com with SMTP id o11so11182833qtr.11 for <21803@debbugs.gnu.org>; Fri, 15 Nov 2019 07:35:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=FgJvn+ECQaEsUw6KPagPyPPnRWqygXJrlJxcVd/elAY=; b=GQsc66SiaHVEbdEU7oryXaQzK3ZiCajJmvibijbE+5RZCK8dPCV5NiNnipRHY0nq4W BdTpP3Z4NIv9GLi6r6xuBJtEu6BnlLBnTwNhBzS/OcK+UN7lj1w/JusJCWbR8UnpNJ+m 28Ksq6wvfsvsf6lEOlx2F8jZZr3dQq65DGInolJJTMobP2Y+jvrg4OynusPBhOJa6dS2 /vbNf/KxineE/i451aK6oyZz887E7xdexYRsKLZna/vWZzNfZPbad1RH8VoA95ryMtzM 5FLIuvmX6S1Jle7mPoUIozRx/oCw+1FfX2mJ5yPjiZqMosA6QtHZ4WP32Nrivn5b18lt +c7g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=FgJvn+ECQaEsUw6KPagPyPPnRWqygXJrlJxcVd/elAY=; b=rQ+k45hKHtBTnuzwUQCK3XhmjgMHVcSYJrIJ9BgS/lVUU2J3GkAx3u5vU55bzvhYlP InWJvPOdhTwwTwF2MBmgZ68XXFc608b9Hzt3bSR7IAoQMfjqTKv2YjzCLkZxzSgaIuV0 1ukX0vk6NLFIRAbIm8N5+NCgVjpTzq7uktUu6Wx851/1AvKzgTCoM9ov+4uw8gY2RZpZ Vmn8JWMsxcT2rSCInp+slkuIUbo63g9O/JGd/CQkgdPtOo/G8VgvPXmRsDUX9sMHeEys HqruOvG6sa95FlwloRddVXznzUdNuAap3JlSjBhTWx6OC4hOOPX6uVn5vmEvD4t4QWi2 V2uw== X-Gm-Message-State: APjAAAWV7l6ndf2gximoAqymrPyLy61JFZ2jvpHWNDsqPl7CFgJZ37/7 ZJNzkxMwMcQuszy9ciG9FiWTDLsv8+LkX7h5gE8= X-Google-Smtp-Source: APXvYqyYC65I6gPAkZz6K8QvAl7DMK0jkYYAREKRMobxXPJMOd/4Y4y+7ViQy8YHuwqzGkBJ90VS2/EPEN/ouwz2h5Y= X-Received: by 2002:ac8:93d:: with SMTP id t58mr14433363qth.217.1573832124710; Fri, 15 Nov 2019 07:35:24 -0800 (PST) MIME-Version: 1.0 References: <87sgmropu2.fsf@gnu.org> <87v9rmmah9.fsf@gnu.org> In-Reply-To: From: zimoun Date: Fri, 15 Nov 2019 16:35:13 +0100 Message-ID: Subject: other waf non reproducible: mpv and ardour To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi, I do not know if it is related but these 2 packages using the waf build system are not reproducible too. - mpv - ardour --8<---------------cut here---------------start------------->8--- $ diff -r --no-dereference /gnu/store/gb935w89qyyi4ljyaz40brai2z9wg0fr-mpv-0.30.0 /gnu/store/gb935w89qyyi4ljyaz40brai2z9wg0fr-mpv-0.30.0-check Binary files /gnu/store/gb935w89qyyi4ljyaz40brai2z9wg0fr-mpv-0.30.0/bin/mpv and /gnu/store/gb935w89qyyi4ljyaz40brai2z9wg0fr-mpv-0.30.0-check/bin/mpv differ Binary files /gnu/store/gb935w89qyyi4ljyaz40brai2z9wg0fr-mpv-0.30.0/lib/libmpv.so.1.106.0 and /gnu/store/gb935w89qyyi4ljyaz40brai2z9wg0fr-mpv-0.30.0-check/lib/libmpv.so.1.106.0 differ --8<---------------cut here---------------end--------------->8--- --8<---------------cut here---------------start------------->8--- $ diff -r --no-dereference /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12 /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/ardour-5.12.0 and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/ardour-5.12.0 differ Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/engines/libclearlooks.so and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/engines/libclearlooks.so differ Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/libardour.so.3.0.0 and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/libardour.so.3.0.0 differ Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/libevoral.so.0.0.0 and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/libevoral.so.0.0.0 differ Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/LV2/a-comp.lv2/a-comp.so and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/LV2/a-comp.lv2/a-comp.so differ Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/LV2/a-eq.lv2/a-eq.so and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/LV2/a-eq.lv2/a-eq.so differ Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/LV2/a-fluidsynth.lv2/a-fluidsynth.so and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/LV2/a-fluidsynth.lv2/a-fluidsynth.so differ Binary files /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12/lib/ardour5/LV2/reasonablesynth.lv2/reasonablesynth.so and /gnu/store/7l5isavp1db8q5mv3zq7bmk29l6ld9qp-ardour-5.12-check/lib/ardour5/LV2/reasonablesynth.lv2/reasonablesynth.so differ --8<---------------cut here---------------end--------------->8--- All the best, simon From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 15 14:46:32 2019 Received: (at 21803) by debbugs.gnu.org; 15 Nov 2019 19:46:32 +0000 Received: from localhost ([127.0.0.1]:37411 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVhY7-0005ma-Jy for submit@debbugs.gnu.org; Fri, 15 Nov 2019 14:46:31 -0500 Received: from mail-qv1-f54.google.com ([209.85.219.54]:39559) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iVhY6-0005mM-FH for 21803@debbugs.gnu.org; Fri, 15 Nov 2019 14:46:31 -0500 Received: by mail-qv1-f54.google.com with SMTP id v16so4215566qvq.6 for <21803@debbugs.gnu.org>; Fri, 15 Nov 2019 11:46:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=vICrVZy3+N9ro8epJhm0cGOwbhLL4j86a6ruIOCae5Y=; b=SOT/KNjKaZ8hpRyIdL1J7k6M3j4ST92l9L/TLmgseuZq+WbG3iD6/Yyh5FfJkvkdaL bQ4dauXJPP+L8r8l9LP78AGusd/WtNQDeZ/5MCfYvRhe1lkXFWDp46ubFIgR4TBe87BI lx/BT1/Xa5CIAdf24nPQGivdZMr049kjc3YX/vfTooNE5/EOZfuaDUrTpl/25j1YX5Qo OCE8Jx9Xkjse4Z02e9SU0TOxrrcjjK0nAe6c4vQw5cMEV78ZXS1qrbF6wVmKlSmpiT8C 30kTn3//vszThKfxr5CnQzi79xy0WpYHMmyFmGMbrDIw1jaZ7jExkE+ZHsV+4eMYC65i JIKQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=vICrVZy3+N9ro8epJhm0cGOwbhLL4j86a6ruIOCae5Y=; b=o85G3uCoD8HgPNaLJGzm4ZUzN4VIxiSA+RQ5rWsd92EOQaCQjZ1qquFeMuHibqzZrK 3BbnAFi7ZxfXPT283EhjO5Vjwnt97XeMe//U9x5+dpLA4j+0V7Pl0I4QYNkCe02uZJKX f/y/zy30IDiYsP6ctSxzooTj25jODSYXrJBUHjpt/eSIlmkFB1G0bAeC+WT2mOOvVUxA MVEXcpeIqgnd2Thu8P07xvSA/KUL/DKA1y5cWDPcrLv7vHCoJWmPa9lIm+kV8dBBvDXi fjMVJkKaP3/prco9RIc2KxXBaA5OfSa+r5cHDxxG7pxMNFvtadXK9/eh6vO4FLEQF0Yx iygw== X-Gm-Message-State: APjAAAWbb4Ar9FdnCSqx5BINeKXt8k0nA5CWGjmhEZEXON9wkuyybJHA FfOBHdV0QVHjN2/jNr4vzTaYg9nfhYR6260lQRw= X-Google-Smtp-Source: APXvYqzFdzIToaMwA0hbi8Z+Zc78DP5DivoUPMciiWnW8vW4rjJVr72dBbPDJ25hyZnZXPJX3rkKBTl9e3HPr81DZ4M= X-Received: by 2002:a05:6214:14ac:: with SMTP id bo12mr1228667qvb.67.1573847184740; Fri, 15 Nov 2019 11:46:24 -0800 (PST) MIME-Version: 1.0 References: <87sgmropu2.fsf@gnu.org> <87v9rmmah9.fsf@gnu.org> In-Reply-To: From: zimoun Date: Fri, 15 Nov 2019 20:46:13 +0100 Message-ID: Subject: guitarix non-reproducible hard to reproduce To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Dear, Resume: The command "guix build guitarix" downloads from ci.guix.gnu.org. Then "guix build guitarix --no-grafts -K --check" rebuilds locally. The two differ of one symlink. --8<---------------cut here---------------start------------->8--- diff -r --no-dereference /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1 /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1-check File /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so is a symbolic link while file /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1-check/lib/libgxw.so is a regular file --8<---------------cut here---------------end--------------->8--- Inspect: After more than 10 attempts to reproduce the behaviour where the plain binary is replaced by the symlink, it never happens locally, so I conclude that the bug is really hard to track. Kind of bad luck. :-) My intuition is: the non-determinism comes from the WAF configuration files (./waf or wscript or wafadmin/). The process conditionally enters in functions such as "do_install" or "symlink_as", so maybe something is hidden by Python module "os" or similar. Moreover, note that wscript:l.990 "add_group()" is used after "add_subdirs('libgxw/gxw')". Basically, the output of "--check" is: --8<---------------cut here---------------start------------->8--- [...] * installing build/default/libgxw/gxw/libgxw.so as /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so.0.1 * symlink /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so.0 (-> libgxw.so.0.1) * symlink /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so (-> libgxw.so.0.1) * installing build/default/libgxw/gxw/libgxw.so as /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so * installing build/default/libgxwmm/gxwmm/libgxwmm.so as /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxwmm.so.0.1 [...] --8<---------------cut here---------------end--------------->8--- Here the step (3rd *) "symlink /gnu/store/...-guitarix-0.38.1/lib/libgxw.so (-> libgxw.so.0.1)" is overridden by the next one "installing build/default/libgxw/gxw/libgxw.so as /gnu/store/...-guitarix-0.38.1/lib/libgxw.so". Replaying with "guix environment guitarix" then from "/tmp/guix-build-guitarix-0.38.1.drv-0", the classical "./waf configure --prefix=install" and "./waf build" "./waf install". In this case, one symlink is not done and the other one is overriden by the next step. --8<---------------cut here---------------start------------->8--- [...] * installing build/default/libgxw/gxw/libgxw.so as /tmp/guix-build-guitarix-0.38.1.drv-0/guitarix-0.38.1/install/lib/libgxw.so.0.1 * symlink /tmp/guix-build-guitarix-0.38.1.drv-0/guitarix-0.38.1/install/lib/libgxw.so (-> libgxw.so.0.1) * installing build/default/libgxw/gxw/libgxw.so as /tmp/guix-build-guitarix-0.38.1.drv-0/guitarix-0.38.1/install/lib/libgxw.so * installing build/default/libgxwmm/gxwmm/libgxwmm.so as /tmp/guix-build-guitarix-0.38.1.drv-0/guitarix-0.38.1/install/lib/libgxwmm.so.0.1 [...] --8<---------------cut here---------------end--------------->8--- Interestingly, the 3 last-last evaluations by Cuirass is of the kind "--check". https://ci.guix.gnu.org/build/1818089/details https://ci.guix.gnu.org/build/1871705/details https://ci.guix.gnu.org/build/1903552/details Therefore, if we were comparing on November 3rd, we would conclude differently. ;-) However, the last evaluation is creating the symlink without overriding it. https://ci.guix.gnu.org/build/1920646/details --8<---------------cut here---------------start------------->8--- [...] * installing build/default/libgxw/gxw/libgxw.so as /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so.0.1 * symlink /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so.0 (-> libgxw.so.0.1) * symlink /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxw.so (-> libgxw.so.0.1) * installing build/default/libgxwmm/gxwmm/libgxwmm.so as /gnu/store/16g7l26rpwhza7fm5jm3lz1ycavky9yl-guitarix-0.38.1/lib/libgxwmm.so.0.1 [...] --8<---------------cut here---------------end--------------->8--- Well, even this bug is annoying speaking about reproducibility -- because it it not the *exact* same installation -- it is mitigated by the fact that the same binary is symlinked or not. I will revisit this bug when WAF will fully use Python 3. All the best, simon From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 16 11:12:27 2019 Received: (at 21803) by debbugs.gnu.org; 16 Nov 2019 16:12:27 +0000 Received: from localhost ([127.0.0.1]:39609 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iW0gU-00074A-PQ for submit@debbugs.gnu.org; Sat, 16 Nov 2019 11:12:27 -0500 Received: from eggs.gnu.org ([209.51.188.92]:47651) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iW0gS-00073x-Vz for 21803@debbugs.gnu.org; Sat, 16 Nov 2019 11:12:25 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:50773) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1iW0gN-0003jl-Sv; Sat, 16 Nov 2019 11:12:19 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=47020 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1iW0gN-00050R-FJ; Sat, 16 Nov 2019 11:12:19 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: zimoun Subject: Re: guitarix non-reproducible hard to reproduce References: <87sgmropu2.fsf@gnu.org> <87v9rmmah9.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 26 Brumaire an 228 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Sat, 16 Nov 2019 17:12:18 +0100 In-Reply-To: (zimoun's message of "Fri, 15 Nov 2019 20:46:13 +0100") Message-ID: <87y2wfx0kd.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello! zimoun skribis: > My intuition is: the non-determinism comes from the WAF configuration > files (./waf or wscript or wafadmin/). > > The process conditionally enters in functions such as "do_install" or > "symlink_as", so maybe something is hidden by Python module "os" or > similar. Moreover, note that wscript:l.990 "add_group()" is used after > "add_subdirs('libgxw/gxw')". My intuition :-) is that waf traverses files using directly opendir/readdir, which returns files in an order that=E2=80=99s file system-dependent. That, in turn, leads it to make .so a symlink or not in a non-deterministic fashion. So I would suggest looking for uses of =E2=80=98readdir=E2=80=99 (or anythi= ng equivalent in Python). It would also be worth checking what others involved in the Reproducible Builds effort have done (Debian, openSuSE, etc.). Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 18 13:19:13 2019 Received: (at 21803) by debbugs.gnu.org; 18 Nov 2019 18:19:14 +0000 Received: from localhost ([127.0.0.1]:46215 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iWlcH-0008N6-IV for submit@debbugs.gnu.org; Mon, 18 Nov 2019 13:19:13 -0500 Received: from mail-qv1-f52.google.com ([209.85.219.52]:42896) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iWlcF-0008Mp-Aq for 21803@debbugs.gnu.org; Mon, 18 Nov 2019 13:19:11 -0500 Received: by mail-qv1-f52.google.com with SMTP id n4so3841484qvq.9 for <21803@debbugs.gnu.org>; Mon, 18 Nov 2019 10:19:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Rh+9FklTeBpinZ1jZllO+rrZzaP/ioyrYPMhppiSyU8=; b=MaKlOiRmdHHxuLbK3hXFnPIV0y6U9M7iLhr0oJaafUW8nYa0Crh/I8Af3p8SCL3Oz4 o9rG2tEiT5vN3D3LsymaYn/UTmBtqfwW+pk69NyJ9T65D0AqH+wOo5xRpfH+z4Qzd4aD j0XatCOkdB5fdn3zJTz74IXKjVRdpa3atHmXzabFAM/UczuXwBo1ZOyqrihKsV4p1TdG GglZjTIH7ujbB3fgsOZuzBZWBtkDTnfgYfpK2c1nQQPk41Oxua9m23ajry4dmRhAvZWz VcXk9Eptz4DSJ3Q60RsMBAiLgvWVT0eXEvjv0CsogwUWUclX157lxAln5Ld2NAjmXp2L AOww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Rh+9FklTeBpinZ1jZllO+rrZzaP/ioyrYPMhppiSyU8=; b=aoIjRNJU0JqgnZOrmVfGLcMflnbf+fuTNOBEcg0jlHEfVkThFxA7gJQgHByRT9msd0 OFsU6eTyzjjtOKAOHKGnHwTUO06ParX0iHM1gtf7ReLiLmaix4Ne1cJp26kjbMWjSVuW /zoBsFnjCooMTrnTPvyx/GxKTZGMprKQCpdAKvf+nySxd6TmixnVXUtKseOi5FiJQhok fUWnkG7JeWIpkbRFYqyhnIJWM1xkAFJ6q60ZcRrqRgUrOvWt3lf3eH3Df8GPBu4xuCBj IWVtwsDmTJK0l/GLLbm8jroA23luyTRgJzTkac5A0dSExGNMn0H1Wm1g7YqlYbnElzDR EsQQ== X-Gm-Message-State: APjAAAU+4dtUvDf76FC/MIZl61EWka01CneWKtPR7mkfkshUtfsvpNF8 baQTEqNBPP9aDr/kWCGtWcfMVMFh/LHcXac7vCB05RaP X-Google-Smtp-Source: APXvYqzyiQHvu628CAFO2v9RyM9E6cps6hF9fBWdwIT49YU0gHUCwXskpVlyWAy388im+m6kV+or8CY+G+HipHAgbm0= X-Received: by 2002:ad4:5849:: with SMTP id de9mr2680064qvb.246.1574101145776; Mon, 18 Nov 2019 10:19:05 -0800 (PST) MIME-Version: 1.0 References: <87sgmropu2.fsf@gnu.org> <87v9rmmah9.fsf@gnu.org> <87y2wfx0kd.fsf@gnu.org> In-Reply-To: <87y2wfx0kd.fsf@gnu.org> From: zimoun Date: Mon, 18 Nov 2019 19:18:54 +0100 Message-ID: Subject: Re: guitarix non-reproducible hard to reproduce To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Ludo, On Sat, 16 Nov 2019 at 17:12, Ludovic Court=C3=A8s wrote: > zimoun skribis: > > > My intuition is: the non-determinism comes from the WAF configuration > > files (./waf or wscript or wafadmin/). > > > > The process conditionally enters in functions such as "do_install" or > > "symlink_as", so maybe something is hidden by Python module "os" or > > similar. Moreover, note that wscript:l.990 "add_group()" is used after > > "add_subdirs('libgxw/gxw')". > > My intuition :-) is that waf traverses files using directly > opendir/readdir, which returns files in an order that=E2=80=99s file > system-dependent. That, in turn, leads it to make .so a symlink or not > in a non-deterministic fashion. Yes, it should come from the function 'os.listdir' (readdir). The documentation [1] says: "The list is in arbitrary order." [1] https://docs.python.org/2/library/os.html#os.listdir The function 'os.listdir' is called some times ;-) --8<---------------cut here---------------end--------------->8--- $ egrep -r "os\.listdir\(" wafadmin3/py3kfixes.py: for x in os.listdir(os.path.join(dir,y))= : wafadmin3/Scripting.py: lst=3Dos.listdir(cwd) wafadmin3/Scripting.py: if WSCRIPT_FILE in os.listdir(calldir): wafadmin3/Scripting.py: dirlst=3Dos.listdir(cwd) wafadmin3/Scripting.py: names=3Dos.listdir(src) wafadmin3/Scripting.py: lst=3Dos.listdir('.') wafadmin3/Tools/qt4.py: lst=3Dos.listdir('/usr/local/Trolltech/'= ) wafadmin3/Tools/javaw.py: lst=3Dos.listdir(path) wafadmin3/Utils.py: return os.listdir(s) tools/check_rpc: for f in os.listdir(basedir): src/gx_head/builder/make:for f in os.listdir(__dir__): wafadmin/py3kfixes.py: for x in os.listdir(os.path.join(dir,y)): wafadmin/Scripting.py: lst=3Dos.listdir(cwd) wafadmin/Scripting.py: if WSCRIPT_FILE in os.listdir(calldir): wafadmin/Scripting.py: dirlst=3Dos.listdir(cwd) wafadmin/Scripting.py: names=3Dos.listdir(src) wafadmin/Scripting.py: lst=3Dos.listdir('.') wafadmin/Tools/qt4.py: lst=3Dos.listdir('/usr/local/Trolltech/') wafadmin/Tools/javaw.py: lst=3Dos.listdir(path) wafadmin/Utils.py: return os.listdir(s) --8<---------------cut here---------------end--------------->8--- And do not talk about the function 'walk' which internally use 'listdir'. := -) I have no idea how to address this issue. > It would also be worth checking what others involved in the Reproducible > Builds effort have done (Debian, openSuSE, etc.). Lot of sun for Debian [2] ;-) I mean from what I understand, they do not find any reproducibility issue and they apply only this patch [3]. [2] https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/guit= arix.html [3] https://sources.debian.org/patches/guitarix/0.36.1-1/02-libdl.patch/ Do not know about openSuSE. Cheers, simon From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 18 15:29:49 2019 Received: (at 21803) by debbugs.gnu.org; 18 Nov 2019 20:29:49 +0000 Received: from localhost ([127.0.0.1]:46312 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iWnef-0003F1-0Q for submit@debbugs.gnu.org; Mon, 18 Nov 2019 15:29:49 -0500 Received: from eggs.gnu.org ([209.51.188.92]:47681) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iWnea-0003Ej-K5 for 21803@debbugs.gnu.org; Mon, 18 Nov 2019 15:29:44 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:33147) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1iWneV-000191-7j; Mon, 18 Nov 2019 15:29:39 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=57572 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1iWneU-0002f2-Qw; Mon, 18 Nov 2019 15:29:39 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: zimoun Subject: Re: guitarix non-reproducible hard to reproduce References: <87sgmropu2.fsf@gnu.org> <87v9rmmah9.fsf@gnu.org> <87y2wfx0kd.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 28 Brumaire an 228 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 18 Nov 2019 21:29:36 +0100 In-Reply-To: (zimoun's message of "Mon, 18 Nov 2019 19:18:54 +0100") Message-ID: <875zjhgc7j.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, zimoun skribis: > On Sat, 16 Nov 2019 at 17:12, Ludovic Court=C3=A8s wrote: [...] >> My intuition :-) is that waf traverses files using directly >> opendir/readdir, which returns files in an order that=E2=80=99s file >> system-dependent. That, in turn, leads it to make .so a symlink or not >> in a non-deterministic fashion. > > Yes, it should come from the function 'os.listdir' (readdir). The > documentation [1] says: "The list is in arbitrary order." > > [1] https://docs.python.org/2/library/os.html#os.listdir > > > The function 'os.listdir' is called some times ;-) Hmm. BTW, did you try comparing both build logs, in particular the lines corresponding to the creation of the offending .so file? That might help narrow the search space. Also, we can play with disorderfs to perhaps reproduce the problem locally and be in more favorable debugging conditions. >> It would also be worth checking what others involved in the Reproducible >> Builds effort have done (Debian, openSuSE, etc.). > > Lot of sun for Debian [2] ;-) > I mean from what I understand, they do not find any reproducibility > issue and they apply only this patch [3]. Heh, OK. Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 11 09:57:31 2020 Received: (at 21803) by debbugs.gnu.org; 11 Sep 2020 13:57:31 +0000 Received: from localhost ([127.0.0.1]:44834 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGjYR-0002si-AE for submit@debbugs.gnu.org; Fri, 11 Sep 2020 09:57:31 -0400 Received: from mail-wr1-f52.google.com ([209.85.221.52]:34624) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGjYQ-0002sT-2A for 21803@debbugs.gnu.org; Fri, 11 Sep 2020 09:57:30 -0400 Received: by mail-wr1-f52.google.com with SMTP id t10so11610737wrv.1 for <21803@debbugs.gnu.org>; Fri, 11 Sep 2020 06:57:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:in-reply-to:references:user-agent:date :message-id:mime-version:content-transfer-encoding; bh=WT/o3p4rogiILTMvxvo83GrCn/h2JsIn/iMUa5+htuY=; b=QmFgcbu7kGEhnLt3s/3Pt8NYJ5s2dgJUN6jwr6TKPFMlhV03NYu3lcQpa8TWE0bnpY 7Yt/R7vNTGEWkG9X1Se1mOYZtogKf87HnRijh//dDaDzoEdu+O5/DMyjxP3XONvDQUCS kqh5nSTx+DWdaksb/xbB2QD1hcTlqHCFKbAqCZXoWFoIm8M6pNsYPbt4AB2cvF8AKx/1 Oe0V99Hldo+eQh1gPJPHcLMlH8MlCwxZp3lqZ4EL14oiFXdScTntZHBFbZJZYJPb7jCZ X9gP1E7Tmqc0i1mhj53NBb2i0jf69V3zXXdCh7WKlsAgoDoIZIhZzkKkxGrlCnYKgrty JXyw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references :user-agent:date:message-id:mime-version:content-transfer-encoding; bh=WT/o3p4rogiILTMvxvo83GrCn/h2JsIn/iMUa5+htuY=; b=tKfIelZHB7zFUDbLV0mpl7rO0gKoSn9Esf3UyOJAYYKQdeFVoEb7M6r3fq8dZevJB/ eickSv0P6AjKZt53etSEpI+ViIw5k0r+HH8yqc68GcTUD+Qe+75bHHPRsCoVFQ28IUgR jn86mVHW2yYbwXdMly87vU1XUZUY+wzxFhyYgpJr2p6JwbIoRdK7H0LUMnIdq4Vo5wxd TS5srHYT5wsQre1ddHPJZ4hYrd4yuZhEZQ5R7U5QA9qoH8nvJ/7zrs30GiIpCpFz66nI IpTok/T1RthjT52gH18IJNUyjo9hmj3jV70ES2MUdkgG7S0vhHf+vFFokH4c7lhowMd0 fYyA== X-Gm-Message-State: AOAM533w/SbJSMPzAcON97WPayc5c+ozoC+eo7Gpuj5IHUOJuQVBj5NJ jd7c5abfSDBUoWGNGqIbN9KVQl1zde0= X-Google-Smtp-Source: ABdhPJzFpFRqnWnsri/TzqyNbk8B/5Z3Jr/YNJtfqo6ULnZY9ycGjXgatHiA7UmMqGuaMz1CjcRyHA== X-Received: by 2002:adf:a35d:: with SMTP id d29mr2205674wrb.307.1599832643763; Fri, 11 Sep 2020 06:57:23 -0700 (PDT) Received: from pfiuh02 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id s67sm4806037wmf.38.2020.09.11.06.57.23 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2020 06:57:23 -0700 (PDT) From: zimoun To: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: Re: bug#21803: Guitarix builds non-deterministically In-Reply-To: <87k2q257w0.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Sun, 01 Nov 2015 11:30:39 +0100") References: <87k2q257w0.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) Date: Fri, 11 Sep 2020 15:57:05 +0200 Message-ID: <877dt0h0we.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21803 Cc: 21803@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Dear, On Sun, 01 Nov 2015 at 11:30, ludo@gnu.org (Ludovic Court=C3=A8s) wrote: > Guitarix 0.33.0, as of Guix commit 3c3e697, builds > non-deterministically: > > $ ./pre-inst-env guix challenge guitarix > updating list of substitutes from 'http://hydra.gnu.org'... 100.0% > /gnu/store/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix-0.33.0 contents diff= er: > local hash: 1rh7qxmylsbsaah59h7sclqqxcz0lwsixlc0krkzwhx8gfhlyam6 > http://hydra.gnu.org/nar/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix-0.33= .0: 1cq4k1wdqibwraqk0wkjj6n5hgs9v9zcvwr2wfgxvgxnf5l1rfhf > $ wget -q -O - http://hydra.gnu.org/nar/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-= guitarix-0.33.0 | bunzip2 | guix archive -x t > $ LC_ALL=3DC diff -r /gnu/store/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix= -0.33.0 t > $ LC_ALL=3DC diff -r --no-dereference /gnu/store/6ksnwcqn92z2nf6qw5js7njn= fqlifgpb-guitarix-0.33.0 t > File /gnu/store/6ksnwcqn92z2nf6qw5js7njnfqlifgpb-guitarix-0.33.0/lib/libg= xw.so is a symbolic link while file t/lib/libgxw.so is a regular file > > It appears to create libgxw.so either as a symlink or as a regular file > in a non-deterministic fashion. Guitarix has been updated to 0.41.0 by commit bf592ef506e1db0340dc11faa0514fe80793e6d6. I have tried "guix build guitarix --no-grafts --check -K" at least 10 times without noticing an unreproducible behaviour. Could someone confirm this and then close this almost 5 years old bug? > It would be nice to see why this happens, and whether this affects all > Waf-based packages. I propose to open another bug report to track the waf-based packages issues. All the best, simon From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 11 12:48:25 2020 Received: (at 21803-done) by debbugs.gnu.org; 11 Sep 2020 16:48:25 +0000 Received: from localhost ([127.0.0.1]:45267 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGmDo-0003I2-RF for submit@debbugs.gnu.org; Fri, 11 Sep 2020 12:48:25 -0400 Received: from mail-qk1-f175.google.com ([209.85.222.175]:40759) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGmDl-0003Ho-Pm for 21803-done@debbugs.gnu.org; Fri, 11 Sep 2020 12:48:23 -0400 Received: by mail-qk1-f175.google.com with SMTP id w16so10489319qkj.7 for <21803-done@debbugs.gnu.org>; Fri, 11 Sep 2020 09:48:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=A7T4i6uAp7nrDYWeftSGjZeRtPZTypTd/SMU6ZH4s3M=; b=uDe7EKOXBpwzZc3vDG6JCW1Ys2l0yJGOkeBo+ntPShnPwrlbrOO5556Y3px+hxWZOX S2N9gAjbOLCPp/R/XjOuDssat/Bpg7Ei5iYYio8WFBC2jbPaFWChuKvAiQpqYwBqseC4 pPxyOqd917t5Vtmz19NPmWHe6IRtvhMyrAU+mnAxyNvB4k2utuotlvhuFDnlEKgjGv+i PE8eqfujLUVaRSCpsGx5Lzkunr2y6cW6z+9I5oKd9j1xcbqu5PkY6Vuff8vu56I7nnOV c0GJYTznnagiAdLjIieVRJaT41/P9a6k62WP+in2gluE1ySmXdFylvCconbkfrpy+a7r 03Rw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version; bh=A7T4i6uAp7nrDYWeftSGjZeRtPZTypTd/SMU6ZH4s3M=; b=jpPzmFe/pgZXcdtve/Rpglpys9h2WsO2KONXV5zsaEkDqxscJC4Cs2ViFFVDQCJI2W CyQry/RadsYSOp8etPX0IgG4bZAiCsC/bFrstyGcgOYTb6igQ6aDZUWrw/o/MYrxtMxL N9z87hYTJHHI8s2nCPRF3UxXwDZWCq/+mLnHG5Rd66gkqcEwP6riiLCqnLKPDNbMBLDN akQM/RDWSKAKBGw2uLSqCH2ui0zrPIYB9vSfyVEeDv3Oe2c8L6u5DCUmMy84AYDjTzbR 9LBZVzjE2MkceC1W8m3hAu2xJCQBkMaLdQ7x4pATqg6W4ycPb0vxWcliN05WHNGMXJhF R0PQ== X-Gm-Message-State: AOAM531H9dzDIFqLpRhpy8vETk0NlDTxo6l5EwB595B5nA8cEjo1NsbX iORpRrEAQ7c36/jmVQOtzIgzvYzcN3w= X-Google-Smtp-Source: ABdhPJx3dr0okAuFFz3MEQqDiOs9AP3Dm76r10atDFozRhwa+XBAm7iX55BuETTm+WlaKyqJtHokYQ== X-Received: by 2002:a05:620a:a4e:: with SMTP id j14mr2283017qka.72.1599842895897; Fri, 11 Sep 2020 09:48:15 -0700 (PDT) Received: from hurd (dsl-10-146-200.b2b2c.ca. [72.10.146.200]) by smtp.gmail.com with ESMTPSA id q185sm3248505qke.25.2020.09.11.09.48.15 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2020 09:48:15 -0700 (PDT) From: Maxim Cournoyer To: zimoun Subject: Re: bug#21803: Guitarix builds non-deterministically References: <87k2q257w0.fsf@gnu.org> <877dt0h0we.fsf@gmail.com> Date: Fri, 11 Sep 2020 12:48:55 -0400 In-Reply-To: <877dt0h0we.fsf@gmail.com> (zimoun's message of "Fri, 11 Sep 2020 15:57:05 +0200") Message-ID: <87wo106yyw.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21803-done Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= , 21803-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hello, [...] > Guitarix has been updated to 0.41.0 by commit > bf592ef506e1db0340dc11faa0514fe80793e6d6. > > I have tried "guix build guitarix --no-grafts --check -K" at least 10 > times without noticing an unreproducible behaviour. > > Could someone confirm this and then close this almost 5 years old bug? Confirmed! >> It would be nice to see why this happens, and whether this affects all >> Waf-based packages. > > I propose to open another bug report to track the waf-based packages issues. This sounds reasonable, given this is 5 years old and perhaps not relevant anymore. Closing, thank you! Maxim From unknown Sun Aug 17 22:02:06 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Sat, 10 Oct 2020 11:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator