GNU bug report logs - #25016
Old build daemons lead to non-reproducible builds

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 25016 in the body.
You can then email your comments to 25016 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: guix-sysadmin <at> gnu.org
Cc: bug-guix <at> gnu.org
Subject: Old build daemons lead to non-reproducible builds
Date: Thu, 24 Nov 2016 14:09:50 +0100

Hi!

Old versions of guix-daemon would use /tmp/nix-build-… as the build
directory name instead of /tmp/guix-build-… (commit
7a57c96a1024e6b74359ba561110f19f92b89b06), and versions prior to 0.11.0
could use a different directory prefix (.drv-0, .drv-1, etc.)  whereas
current versions systematically use .drv-0 (commit
cb9601029ea164b86bdf997f7160d494c15d344b).

However, some of our build machines run old daemons, which leads to
discrepancies such has:

--8<---------------cut here---------------start------------->8---
$ wget -O - https://mirror.hydra.gnu.org/nar/3kxg1wvc1dnw9bdnp61pfc6vy14v4ikl-bash-4.4.0-include |bunzip2 |guix archive -x /tmp/foo
[…]
$ diff -ruBb /gnu/store/3kxg1wvc1dnw9bdnp61pfc6vy14v4ikl-bash-4.4.0-include /tmp/foo
diff -ruBb /gnu/store/3kxg1wvc1dnw9bdnp61pfc6vy14v4ikl-bash-4.4.0-include/lib/bash/Makefile.inc /tmp/foo/lib/bash/Makefile.inc
--- /gnu/store/3kxg1wvc1dnw9bdnp61pfc6vy14v4ikl-bash-4.4.0-include/lib/bash/Makefile.inc	1970-01-01 01:00:01.000000000 +0100
+++ /tmp/foo/lib/bash/Makefile.inc	2016-11-24 14:00:26.449665970 +0100
@@ -38,7 +38,7 @@
 headersdir = $(includedir)/$(PACKAGE_NAME)
 
 topdir = ../..
-BUILD_DIR = /tmp/guix-build-bash-4.4.0.drv-0/bash-4.4
+BUILD_DIR = /tmp/nix-build-bash-4.4.0.drv-0/bash-4.4
 srcdir = .
--8<---------------cut here---------------end--------------->8---

This can lead to hash mismatches between what the narinfo claims and
what the nar actually contains (due to caching), which annoys users.

We should update all our build machines to a newer daemon.

Ludo’.

Message #8 received at 25016 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: guix-sysadmin <at> gnu.org
Cc: 25016 <at> debbugs.gnu.org
Subject: Re: bug#25016: Old build daemons lead to non-reproducible builds
Date: Sat, 03 Dec 2016 00:07:56 +0100

ludo <at> gnu.org (Ludovic Courtès) skribis:

> We should update all our build machines to a newer daemon.

Today I updated the daemon on hydra.gnunet.org from 0.9 to 0.11ish.

Ludo’.

Message #11 received at 25016 <at> debbugs.gnu.org (full text, mbox):

From: Andreas Enge <andreas <at> enge.fr>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: guix-sysadmin <at> gnu.org, 25016 <at> debbugs.gnu.org
Subject: Re: Staging freeze
Date: Wed, 4 Jan 2017 12:15:00 +0100

Hello,

On Wed, Jan 04, 2017 at 12:05:10PM +0100, Ludovic Courtès wrote:
> Leo Famulari <leo <at> famulari.name> skribis:
> > On Thu, Dec 29, 2016 at 05:59:52PM +0100, Ludovic Courtès wrote:
> >> Mark, Andreas: could you update guix-daemon on the ARM/MIPS machines you
> >> have root access to and notify 25016 <at> debbugs.gnu.org?
> > In case they were updated without notification,
> We never know!  :-)

I did update the daemon on redhill, but gave up on making it run with systemd,
I had no patience to investigate why it would not start - the symbolic link
instead of a copied file? So now it is just running in a screen. Please let
me know when there is a problem.

Andreas

Message #14 received at 25016 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Andreas Enge <andreas <at> enge.fr>
Cc: guix-sysadmin <at> gnu.org, 25016 <at> debbugs.gnu.org
Subject: Re: Staging freeze
Date: Wed, 04 Jan 2017 16:49:35 +0100

Hi!

Andreas Enge <andreas <at> enge.fr> skribis:

> On Wed, Jan 04, 2017 at 12:05:10PM +0100, Ludovic Courtès wrote:
>> Leo Famulari <leo <at> famulari.name> skribis:
>> > On Thu, Dec 29, 2016 at 05:59:52PM +0100, Ludovic Courtès wrote:
>> >> Mark, Andreas: could you update guix-daemon on the ARM/MIPS machines you
>> >> have root access to and notify 25016 <at> debbugs.gnu.org?
>> > In case they were updated without notification,
>> We never know!  :-)
>
> I did update the daemon on redhill, but gave up on making it run with systemd,
> I had no patience to investigate why it would not start - the symbolic link
> instead of a copied file? So now it is just running in a screen. Please let
> me know when there is a problem.

Awesome, thanks!

Ludo’.

Message #17 received at 25016 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Andreas Enge <andreas <at> enge.fr>
Cc: Ludovic Courtès <ludo <at> gnu.org>, guix-sysadmin <at> gnu.org,
 25016 <at> debbugs.gnu.org
Subject: Re: Staging freeze
Date: Wed, 4 Jan 2017 14:44:57 -0500

[Message part 1 (text/plain, inline)]

On Wed, Jan 04, 2017 at 12:15:00PM +0100, Andreas Enge wrote:
> Hello,
> 
> On Wed, Jan 04, 2017 at 12:05:10PM +0100, Ludovic Courtès wrote:
> > Leo Famulari <leo <at> famulari.name> skribis:
> > > On Thu, Dec 29, 2016 at 05:59:52PM +0100, Ludovic Courtès wrote:
> > >> Mark, Andreas: could you update guix-daemon on the ARM/MIPS machines you
> > >> have root access to and notify 25016 <at> debbugs.gnu.org?
> > > In case they were updated without notification,
> > We never know!  :-)
> 
> I did update the daemon on redhill, but gave up on making it run with systemd,
> I had no patience to investigate why it would not start - the symbolic link
> instead of a copied file? So now it is just running in a screen. Please let
> me know when there is a problem.

Okay, thank you!

If you are around after FOSDEM, I'm happy to take a look at these
systems with you to make them use systemd. I think it's more reliable...
if it works :)

[signature.asc (application/pgp-signature, inline)]

Message #22 received at 25016 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: guix-sysadmin <at> gnu.org
Cc: 25016 <at> debbugs.gnu.org
Subject: Re: bug#25016: Old build daemons lead to non-reproducible builds
Date: Thu, 04 May 2017 23:51:31 +0200

ludo <at> gnu.org (Ludovic Courtès) skribis:

> We should update all our build machines to a newer daemon.

I’ve updated guix.sjd.se from 0.8.3 (!) to 0.12.0-9.25a4, which should
fix the “/tmp/nix-build” issue that was showing up for packages such as
cunit at <https://gnu.org/s/guix/packages/reproducibility.html>.

Ludo’.

Message #25 received at 25016 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: guix-sysadmin <at> gnu.org, 25016 <at> debbugs.gnu.org
Subject: Re: bug#25016: Old build daemons lead to non-reproducible builds
Date: Fri, 05 May 2017 08:53:31 +0200

Ludovic Courtès <ludo <at> gnu.org> writes:

> ludo <at> gnu.org (Ludovic Courtès) skribis:
>
>> We should update all our build machines to a newer daemon.
>
> I’ve updated guix.sjd.se from 0.8.3 (!) to 0.12.0-9.25a4, which should
> fix the “/tmp/nix-build” issue that was showing up for packages such as
> cunit at <https://gnu.org/s/guix/packages/reproducibility.html>.

Wow, that’s quite a jump!

-- 
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.