GNU bug report logs - #19512
Failed substitution yields incomplete store item

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 19512 in the body.
You can then email your comments to 19512 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: David Thompson <dthompson2 <at> worcester.edu>
To: bug-guix <at> gnu.org
Subject: Failed substitution yields incomplete store item
Date: Sun, 04 Jan 2015 18:51:48 -0500

While working on 'guix publish', I managed to mess up the store.  :(

Here's the first substitution that failed due to an invalid eof marker
for some reason:

  dave <at> labrys ~$ sudo _NIX_OPTIONS="substitute-urls=http://192.168.1.157:8080" guix substitute-binary --substitute /gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0 /tmp/guile-toxcore
  
  found valid signature for '/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0', from 'http://192.168.1.157:8080/nar/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0'
  sha256:xl35awxl6kgl5b2eum7kfgqlnap7a7itczpyxptf4kq25pasafka
  downloading `/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0' (0.1 MiB installed)...
  http://192.168.1.157/.../iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0     100.0% of 127.5 KiBguix substitute-binary: error: invalid nar end-of-file marker


When the same command is run again, there's a new error:

  dave <at> labrys ~$ sudo _NIX_OPTIONS="substitute-urls=http://192.168.1.157:8080" guix substitute-binary --substitute /gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0 /tmp/guile-toxcore
  
  found valid signature for '/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0', from 'http://192.168.1.157:8080/nar/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0'
  sha256:xl35awxl6kgl5b2eum7kfgqlnap7a7itczpyxptf4kq25pasafka
  downloading `/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0' (0.1 MiB installed)...
  http://192.168.1.157/.../iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0       6.3% of 127.5 KiBguix substitute-binary: error: mkdir: File exists

Any idea what could be going wrong?

-- 
David Thompson
Web Developer - Free Software Foundation - http://fsf.org
GPG Key: 0FF1D807
Support the FSF: https://fsf.org/donate

Message #8 received at 19512 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: David Thompson <dthompson2 <at> worcester.edu>
Cc: 19512 <at> debbugs.gnu.org
Subject: Re: bug#19512: Failed substitution yields incomplete store item
Date: Mon, 05 Jan 2015 16:28:41 +0100

David Thompson <dthompson2 <at> worcester.edu> skribis:

> While working on 'guix publish', I managed to mess up the store.  :(
>
> Here's the first substitution that failed due to an invalid eof marker
> for some reason:
>
>   dave <at> labrys ~$ sudo _NIX_OPTIONS="substitute-urls=http://192.168.1.157:8080" guix substitute-binary --substitute /gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0 /tmp/guile-toxcore
>   
>   found valid signature for '/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0', from 'http://192.168.1.157:8080/nar/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0'
>   sha256:xl35awxl6kgl5b2eum7kfgqlnap7a7itczpyxptf4kq25pasafka
>   downloading `/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0' (0.1 MiB installed)...
>   http://192.168.1.157/.../iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0     100.0% of 127.5 KiBguix substitute-binary: error: invalid nar end-of-file marker
>
>
> When the same command is run again, there's a new error:
>
>   dave <at> labrys ~$ sudo _NIX_OPTIONS="substitute-urls=http://192.168.1.157:8080" guix substitute-binary --substitute /gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0 /tmp/guile-toxcore
>   
>   found valid signature for '/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0', from 'http://192.168.1.157:8080/nar/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0'
>   sha256:xl35awxl6kgl5b2eum7kfgqlnap7a7itczpyxptf4kq25pasafka
>   downloading `/gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0' (0.1 MiB installed)...
>   http://192.168.1.157/.../iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0       6.3% of 127.5 KiBguix substitute-binary: error: mkdir: File exists
>
> Any idea what could be going wrong?

Nothing!  :-)

The store item that substitute-binary created on the first run is
actually invalid.  You can see that from the fact that you get an error
if you run, say:

  guix gc --references /gnu/store/iw3jn6a1avv78pp5v2cv42vyh0d8zi0g-guile-toxcore-0.1-6a9fbe0

So you can either “rm -rf” it (use with care!), or, better, run ‘guix
gc’, which will automatically remove it and other invalid items.

(A store item is considered valid iff guix-daemon or guix-register has
added it to db.sqlite.  guix-daemon does that upon successful
substitution or build.)

HTH,
Ludo’.

Message #11 received at 19512 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: David Thompson <dthompson2 <at> worcester.edu>
Cc: 19512 <at> debbugs.gnu.org
Subject: Re: bug#19512: Failed substitution yields incomplete store item
Date: Sun, 08 Feb 2015 19:19:54 +0100

Hi!

Did you eventually salvage the store?  What lessons should be taken on
the Guix side?

TIA,
Ludo’.

Message #14 received at 19512 <at> debbugs.gnu.org (full text, mbox):

From: David Thompson <dthompson2 <at> worcester.edu>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 19512 <at> debbugs.gnu.org
Subject: Re: bug#19512: Failed substitution yields incomplete store item
Date: Sun, 08 Feb 2015 14:45:36 -0500

Ludovic Courtès <ludo <at> gnu.org> writes:

> Did you eventually salvage the store?  What lessons should be taken on
> the Guix side?

I haven't gotten to the bottom of it, sorry.

-- 
David Thompson
Web Developer - Free Software Foundation - http://fsf.org
GPG Key: 0FF1D807
Support the FSF: https://fsf.org/donate

Message #19 received at 19512-done <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: David Thompson <dthompson2 <at> worcester.edu>
Cc: 19512-done <at> debbugs.gnu.org
Subject: Re: bug#19512: Failed substitution yields incomplete store item
Date: Sun, 05 Apr 2015 00:03:47 +0200

Closing this bug, thanks.

Ludo’.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.