GNU bug report logs - #33235
Bzip hash error

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 33235 in the body.
You can then email your comments to 33235 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: brettg <at> posteo.net
To: Bug-guix <at> gnu.org
Subject: Bzip hash error
Date: Fri, 02 Nov 2018 03:05:16 +0100

The sha256 has for bzip2 is mismatching on build.

Message #8 received at 33235 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: brettg <at> posteo.net
Cc: 33235 <at> debbugs.gnu.org
Subject: Re: bug#33235: Bzip hash error
Date: Thu, 1 Nov 2018 22:17:01 -0400

[Message part 1 (text/plain, inline)]

On Fri, Nov 02, 2018 at 03:05:16AM +0100, brettg <at> posteo.net wrote:
> The sha256 has for bzip2 is mismatching on build.

Can you give more details? For example, the version of Guix you are
using (`guix describe`), the command you ran, and the command's output?

It's working for me:

$ guix describe
Generation 43	Nov 01 2018 13:58:41	(current)
  guix 361dd8a
    repository URL: https://git.savannah.gnu.org/git/guix.git
    branch: master
    commit: 361dd8a55644be6ee81f3ccd9e55d2951a8693f8
$ guix build --no-grafts -S bzip2 --no-substitutes            
The following derivation will be built:                
   /gnu/store/bp0hyahbn3f60b954rfcz0vqlmc7lhzj-bzip2-1.0.6.tar.gz.drv
building /gnu/store/bp0hyahbn3f60b954rfcz0vqlmc7lhzj-bzip2-1.0.6.tar.gz.drv...

Starting download of /gnu/store/bjpalrv9f49d2k40p7ga0y6dwdys9w5j-bzip2-1.0.6.tar.gz
From https://web.archive.org/web/20180624184806/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz...
following redirection to `https://web.archive.org/web/20180624184835/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz'...
downloading from https://web.archive.org/web/20180624184806/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz...
 bzip2-1.0.6.tar.gz                                                                                                                                          129KiB/s 00:06 | 764KiB transferred
successfully built /gnu/store/bp0hyahbn3f60b954rfcz0vqlmc7lhzj-bzip2-1.0.6.tar.gz.drv
/gnu/store/bjpalrv9f49d2k40p7ga0y6dwdys9w5j-bzip2-1.0.6.tar.gz

[signature.asc (application/pgp-signature, inline)]

Message #13 received at 33235-done <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: brettg <at> posteo.net
Cc: 33235-done <at> debbugs.gnu.org
Subject: Re: bug#33235: Bzip hash error
Date: Thu, 1 Nov 2018 23:09:29 -0400

[Message part 1 (text/plain, inline)]

On Fri, Nov 02, 2018 at 03:29:50AM +0100, brettg <at> posteo.net wrote:
> Hi Leo,
> 
> I’m coming from an installation using guix init, and am typing from mobile.
> I am using the berlin substitutes. I guess my option is to guix pull the
> live iso?

No, I recommend against doing `guix pull` before initializing. We test
that the installer works, but if you update Guix before initialization,
then you void the warranty ;)

The bzip2.org site is offline; the domain registration expired and the
site is gone:

https://git.savannah.gnu.org/cgit/guix.git/commit/?id=7598b678fad2112ea87a85acf755908a59dd4676

I recommend downloading the missing source code from the archives, using
`guix download`. For your reference, here is the full URL:

https://web.archive.org/web/20180624184835/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz

[signature.asc (application/pgp-signature, inline)]

Message #16 received at 33235-done <at> debbugs.gnu.org (full text, mbox):

From: brettg <at> posteo.net
To: Leo Famulari <leo <at> famulari.name>
Cc: 33235-done <at> debbugs.gnu.org
Subject: Re: bug#33235: Bzip hash error
Date: Fri, 02 Nov 2018 04:33:10 +0100

Hi Leo,

Are you perhaps mistaken? the URL for bzip2 is bzip.org not bzip2.org

Regardless, even when pulling from the archive I am still being given an 
incorrect hash.

On 02.11.2018 04:09, Leo Famulari wrote:
> On Fri, Nov 02, 2018 at 03:29:50AM +0100, brettg <at> posteo.net wrote:
>> Hi Leo,
>> 
>> I’m coming from an installation using guix init, and am typing from 
>> mobile.
>> I am using the berlin substitutes. I guess my option is to guix pull 
>> the
>> live iso?
> 
> No, I recommend against doing `guix pull` before initializing. We test
> that the installer works, but if you update Guix before initialization,
> then you void the warranty ;)
> 
> The bzip2.org site is offline; the domain registration expired and the
> site is gone:
> 
> https://git.savannah.gnu.org/cgit/guix.git/commit/?id=7598b678fad2112ea87a85acf755908a59dd4676
> 
> I recommend downloading the missing source code from the archives, 
> using
> `guix download`. For your reference, here is the full URL:
> 
> https://web.archive.org/web/20180624184835/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz

Message #19 received at 33235-done <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: brettg <at> posteo.net
Cc: 33235-done <at> debbugs.gnu.org
Subject: Re: bug#33235: Bzip hash error
Date: Fri, 2 Nov 2018 01:02:39 -0400

[Message part 1 (text/plain, inline)]

On Fri, Nov 02, 2018 at 04:33:10AM +0100, brettg <at> posteo.net wrote:
> Hi Leo,
> 
> Are you perhaps mistaken? the URL for bzip2 is bzip.org not bzip2.org

I mentioned the wrong "short" URLs in my message, but the full URL of
the source code on archive.org was correct.

bzip.org is offline and the source is available on archive.org.

> Regardless, even when pulling from the archive I am still being given an
> incorrect hash.

Can you take a photo of your screen and email it with your mobile?

If so, please show the command you run and the failing part of the
output.

Also, do 
`guix download https://web.archive.org/web/20180624184835/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz`
and show the result.

[signature.asc (application/pgp-signature, inline)]

Message #22 received at 33235-done <at> debbugs.gnu.org (full text, mbox):

From: Björn Höfling <bjoern.hoefling <at> bjoernhoefling.de>
To: brettg <at> posteo.net
Cc: 33235-done <at> debbugs.gnu.org, Leo Famulari <leo <at> famulari.name>
Subject: Re: bug#33235: Bzip hash error
Date: Fri, 2 Nov 2018 12:07:01 +0100

[Message part 1 (text/plain, inline)]

Hi brettg,

I tried with a fresh guixsd 0.15 install and can confirm your problem:

On Fri, 02 Nov 2018 04:33:10 +0100
brettg <at> posteo.net wrote:

> Hi Leo,
> 
> Are you perhaps mistaken? the URL for bzip2 is bzip.org not bzip2.org
> 
> Regardless, even when pulling from the archive I am still being given
> an incorrect hash.

$ guix build -S --no-substitutes bzip2

--> As you see it, there is a hash mismatch
That's because the URL expired and the new "archive.org/..." URL was
added in commit

7598b678fad2112ea87a85acf755908a59dd4676
Committer: Leo Famulari <leo <at> famulari.name>  2018-08-10 22:42:01

Which follows the 0.15.0 release.

If you then look into the log output and open that downloaded file:

less /gnu/store/...-bzip2-1.0.6.tar.gz

you see plain HTML. Of cause, that mismatches.

If there is an error while downloading (i.e. a 404 - not found) then
guix downloader would fallback and try to download the sources from
subistitute servers or even NixOS servers by hashsum. But as we get a
good HTTP return code here, it assumes everything is fine and saves to
the store, not trying anything else.

Now to download the sources from web.archive.org I needed these
steps:

# find out path of guix:
readlink `which guix`

# Then use that directory to authorize berlin:
guix archive --authorize
< /gnu/store/...-guix-0.15.0.../share/guix/berlin.guixsd.org.pub

#Install nss-certs for HTTPS access:
guix package -i nss-certs
# set environment variables, see 6.2.9 X.509 Certificates
export SSL_CERT_DIR="$HOME/.guix-profile/etc/ssl/certs"
export SSL_CERT_FILE="$HOME/.guix-profile/etc/ssl/certs/ca-certificates.crt"

# Now download --with-source
guix build -S
--with-source="https://web.archive.org/web/20180624184835/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz"

# This fails with a stacktrace "wrong type, expected struc", I can't
# copy it out of VM currently.
# 
# Anyway, it downloads the sources and the next:

guix build -S bzip2

# does succeed.

Sorry for the inconveniences with substitutes missing, hope this brings
you a step further?

Björn

[Message part 2 (application/pgp-signature, inline)]

Message #25 received at 33235 <at> debbugs.gnu.org (full text, mbox):

From: swedebugia <swedebugia <at> riseup.net>
To: 33235 <at> debbugs.gnu.org, leo <at> famulari.name, brettg <at> posteo.net
Subject: Re: bug#33235: Bzip hash error
Date: Fri, 2 Nov 2018 14:40:16 +0100

Hi

On 2018-11-02 04:09, Leo Famulari wrote:
> No, I recommend against doing `guix pull` before initializing. We test
> that the installer works, but if you update Guix before initialization,
> then you void the warranty
I suggest we state this VERY clearly in the manual.

-- 
Cheers
Swedebugia

Message #28 received at 33235-done <at> debbugs.gnu.org (full text, mbox):

From: brettg <at> posteo.net
To: Björn Höfling <bjoern.hoefling <at> bjoernhoefling.de>
Cc: 33235-done <at> debbugs.gnu.org, Leo Famulari <leo <at> famulari.name>
Subject: Re: bug#33235: Bzip hash error
Date: Fri, 02 Nov 2018 21:12:30 +0100

Hi bjorn.

Thank you your steps did help in getting it to build with the 
appropairiate hash sums.

However, how do I get the guix system init process to
Use that version of the build we just made? It is still
Wanting to use the incorrect substitute.


On 02.11.2018 12:07, Björn Höfling wrote:
> Hi brettg,
> 
> I tried with a fresh guixsd 0.15 install and can confirm your problem:
> 
> On Fri, 02 Nov 2018 04:33:10 +0100
> brettg <at> posteo.net wrote:
> 
>> Hi Leo,
>> 
>> Are you perhaps mistaken? the URL for bzip2 is bzip.org not bzip2.org
>> 
>> Regardless, even when pulling from the archive I am still being given
>> an incorrect hash.
> 
> $ guix build -S --no-substitutes bzip2
> 
> --> As you see it, there is a hash mismatch
> That's because the URL expired and the new "archive.org/..." URL was
> added in commit
> 
> 7598b678fad2112ea87a85acf755908a59dd4676
> Committer: Leo Famulari <leo <at> famulari.name>  2018-08-10 22:42:01
> 
> Which follows the 0.15.0 release.
> 
> If you then look into the log output and open that downloaded file:
> 
> less /gnu/store/...-bzip2-1.0.6.tar.gz
> 
> you see plain HTML. Of cause, that mismatches.
> 
> If there is an error while downloading (i.e. a 404 - not found) then
> guix downloader would fallback and try to download the sources from
> subistitute servers or even NixOS servers by hashsum. But as we get a
> good HTTP return code here, it assumes everything is fine and saves to
> the store, not trying anything else.
> 
> Now to download the sources from web.archive.org I needed these
> steps:
> 
> # find out path of guix:
> readlink `which guix`
> 
> # Then use that directory to authorize berlin:
> guix archive --authorize
> < /gnu/store/...-guix-0.15.0.../share/guix/berlin.guixsd.org.pub
> 
> #Install nss-certs for HTTPS access:
> guix package -i nss-certs
> # set environment variables, see 6.2.9 X.509 Certificates
> export SSL_CERT_DIR="$HOME/.guix-profile/etc/ssl/certs"
> export 
> SSL_CERT_FILE="$HOME/.guix-profile/etc/ssl/certs/ca-certificates.crt"
> 
> # Now download --with-source
> guix build -S
> --with-source="https://web.archive.org/web/20180624184835/http://www.bzip.org/1.0.6/bzip2-1.0.6.tar.gz"
> 
> # This fails with a stacktrace "wrong type, expected struc", I can't
> # copy it out of VM currently.
> #
> # Anyway, it downloads the sources and the next:
> 
> guix build -S bzip2
> 
> # does succeed.
> 
> Sorry for the inconveniences with substitutes missing, hope this brings
> you a step further?
> 
> Björn

Message #31 received at 33235-done <at> debbugs.gnu.org (full text, mbox):

From: Björn Höfling <bjoern.hoefling <at> bjoernhoefling.de>
To: brettg <at> posteo.net, Leo Famulari <leo <at> famulari.name>,
 33235-done <at> debbugs.gnu.org
Subject: Re: bug#33235: Bzip hash error
Date: Fri, 2 Nov 2018 22:02:39 +0100

[Message part 1 (text/plain, inline)]

Hi brettg,


On Fri, 02 Nov 2018 21:01:05 +0100
brettg <at> posteo.net wrote:

> Hi bjorn.
> 
> Thank you your steps did help in getting it to build with the 
> appropairiate hash sums.
> 
> However, how do I get the guix system init process to
> Use that version of the build we just made? It is still
> Wanting to use the incorrect substitute.

I don't understand this.

When it is already in the store it will be used by Guix (independently
of its source, substitutes or self-compiled).

But it could be that there are two different versions of it, i.e. with
two different store-hashes. For example, one of its dependencies is
different.

Can you post the output of "guix describe" and the log of "guix system
init"?

To get the logs, you can either copy it on USB stick or get it with
ssh/scp, if you started the ssh daemon as described in the installation
manual.

Björn

[Message part 2 (application/pgp-signature, inline)]

Message #34 received at 33235 <at> debbugs.gnu.org (full text, mbox):

From: swedebugia <swedebugia <at> riseup.net>
To: 33235 <at> debbugs.gnu.org, leo <at> famulari.name, brettg <at> posteo.net
Subject: Re: bug#33235: Bzip hash error
Date: Mon, 5 Nov 2018 17:21:57 +0100

On 2018-11-02 14:40, swedebugia wrote:
> Hi
>
> On 2018-11-02 04:09, Leo Famulari wrote:
>> No, I recommend against doing `guix pull` before initializing. We test
>> that the installer works, but if you update Guix before initialization,
>> then you void the warranty
> I suggest we state this VERY clearly in the manual.

Actually guix very loudly warns the user that running guix system init 
before guix pull will downgrade guix.

I solved this by pulling the 0.15 commit and then init.

I suggest we tell binary install users to do this in the manual.

What do you think?

-- 
Cheers
Swedebugia

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.