GNU bug report logs - #25081
Anybody needs help to set up a qemu VM for GNU/Hurd?

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 25081 in the body.
You can then email your comments to 25081 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Svante Signell <svante.signell <at> gmail.com>
To: 24857 <at> debbugs.gnu.org
Cc: bug-gnu-emacs <at> gnu.org,
 Clément Pit--Claudel <clement.pit <at> gmail.com>
Subject: Re: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Thu, 01 Dec 2016 15:52:54 +0100

Hi Clement (and the ML),

I just saw your mail to this bug. Unfortunately I did not get that mail. Do I
have to subscribe to get them?

Anyway, you were just lucky. Try to build it a second time, or even better build
the debian package. Latest version now is 2.25.1+1-3. You'll see the same
problems as me (and the hurd build daemons).

Thanks for trying Hurd out.

On Fri, 2016-11-04 at 21:17 +0100, Svante Signell wrote:
> Hello,
> 
> In order for you to try out the FTBFS problems of emacs24/25 on
> GNU/Hurd, maybe somebody wants to set up a VM image. The easiest way to
> do that would be to read:
> https://people.debian.org/~sthibault/hurd-i386/installer/cdimage/
> or using a pre-installed image: (3GiB)
> tinyurl.com/6dyly5d
> containing debian-hurd.img.tar.gz

Message #10 received at 25081 <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: svante.signell <at> gmail.com
Cc: 25081 <at> debbugs.gnu.org
Subject: Re: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Wed, 7 Dec 2016 14:36:57 -0800

I tried to get a qemu VM running for GNU/Hurd on my platform (Fedora 24 
x86-64), and did not succeed.

The instructions in 
https://people.debian.org/~sthibault/hurd-i386/installer/cdimage/ talk 
about running "apt-get install qemu-kvm". Obviously this won't work on 
Fedora. I'm not a big fan of virtualization to be honest, but after 
messing with it a bit I found that the following Unix shell commands 
sort-of worked:

sudo dnf install @virtualization

qemu-kvm -net user,hostfwd=tcp:127.0.0.1:2222-:22 -net nic -drive 
file=debian-hurd-20160824.img,cache=writeback -m 1G

The latter command outputs the somewhat scary-looking:

WARNING: Image format was not specified for 'debian-hurd-20160824.img' 
and probing guessed raw.
         Automatically detecting the format is dangerous for raw 
images, write operations on block 0 will be restricted.
         Specify the 'raw' format explicitly to remove the restrictions.

and gives me a screen where I can log in as root and type the command 
"password demo" to change the password, and then from another terminal 
window I can run "ssh demo <at> localhost -p 2222" to login to GNU/Hurd, and 
after creating .ssh/authorized_keys with my key, I can run "scp -P 2222 
emacs.tar.gz demo <at> localhost:". (This "emacs.tar.gz" was created by 
running "make dist" followed by "tar cf emacs.tar.gz emacs-26.0.50" on 
my development machine, in the master branch.) Although all this is 
obvious if you're a VM expert and like messing with VMs, it's not 
written down in the instructions. (Plus, I hate having to type 
Ctrl-Alt-G all the time while configuring the VM -- that's not 
documented either.)

On GNU/Hurd I tried several ways to configure Emacs. None worked. I made 
the most progess with this:

tar xf emacs.tar.gz

cd emacs-26.0.50

./configure --without-x --with-gnutls=no

This failed as follows:

checking for library containing tputs... no
configure: error: The required function 'tputs' was not found in any 
library.
The following libraries were tried (in order):
  libtinfo, libncurses, libterminfo, libtermcap, libcurses
Please try installing whichever of these libraries is most appropriate
for your system, together with its header files.
For example, a libncurses-dev(el) or similar package.

At this point I gave up. I don't know where to grab GNU/Hurd packages 
from, and anyway this process is taking more of my time than I would 
like to spend.

Perhaps you could build a GNU/Hurd image that already has all the 
packages needed to develop programs like Emacs, and then send a complete 
standalone recipe that will let someone easily reproduce the Emacs 
problem even if they dislike messing with VMs.

Message #13 received at 25081 <at> debbugs.gnu.org (full text, mbox):

From: Svante Signell <svante.signell <at> gmail.com>
To: Paul Eggert <eggert <at> cs.ucla.edu>, emacs-devel <emacs-devel <at> gnu.org>
Cc: 25081 <at> debbugs.gnu.org
Subject: Re: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Thu, 08 Dec 2016 00:00:06 +0100

Hi, adding emacs-devel to the recipients. I hope you don't mind.

On Wed, 2016-12-07 at 14:36 -0800, Paul Eggert wrote:
> I tried to get a qemu VM running for GNU/Hurd on my platform (Fedora 24 
> x86-64), and did not succeed.
> 
> The instructions in 
> https://people.debian.org/~sthibault/hurd-i386/installer/cdimage/ talk 
> about running "apt-get install qemu-kvm". Obviously this won't work on 
> Fedora. I'm not a big fan of virtualization to be honest, but after 
> messing with it a bit I found that the following Unix shell commands 
> sort-of worked:
> 
> sudo dnf install @virtualization
> 
> qemu-kvm -net user,hostfwd=tcp:127.0.0.1:2222-:22 -net nic -drive 
> file=debian-hurd-20160824.img,cache=writeback -m 1G

I normally use:
qemu-system-x86_64 -enable-kvm -m 2048 -net nic,model=rtl8139 -net
user,hostfwd=tcp::<port>-:22 -drive
cache=writeback,index=0,media=disk,file=<whatever>.img

> The latter command outputs the somewhat scary-looking:
> 
> WARNING: Image format was not specified for 'debian-hurd-20160824.img' 
> and probing guessed raw.
>           Automatically detecting the format is dangerous for raw 
> images, write operations on block 0 will be restricted.
>           Specify the 'raw' format explicitly to remove the restrictions.

This is expected, since qemu does not know exactly in what format the file is
in. Maybe just ignore that warning for now? I (and others) do.

> and gives me a screen where I can log in as root and type the command 
> "password demo" to change the password, and then from another terminal 
> window I can run "ssh demo <at> localhost -p 2222" to login to GNU/Hurd, and 
> after creating .ssh/authorized_keys with my key, I can run "scp -P 2222 
> emacs.tar.gz demo <at> localhost:". (This "emacs.tar.gz" was created by 
> running "make dist" followed by "tar cf emacs.tar.gz emacs-26.0.50" on 
> my development machine, in the master branch.) Although all this is 
> obvious if you're a VM expert and like messing with VMs, it's not 
> written down in the instructions.

It might be easier to use the debian tools:
apt-get update
apt-get dist-upgrade
apt-get build-dep emacs24/emacs25
apt-get source emacs24/emacs25
cd emacs24-24.5+1/emacs25-25.1+1
dpkg-buildpackage -b 2>&1 | tee ../build-whatever.log
...

> (Plus, I hate having to type 
> Ctrl-Alt-G all the time while configuring the VM -- that's not 
> documented either.)

Never used that? Ctrl-Alt toggles mouse focus though.

> On GNU/Hurd I tried several ways to configure Emacs. None worked. I made 
> the most progess with this:
> 
> tar xf emacs.tar.gz
> 
> cd emacs-26.0.50
> 
> ./configure --without-x --with-gnutls=no
> 
> This failed as follows:
> 
> checking for library containing tputs... no
> configure: error: The required function 'tputs' was not found in any 
> library.
> The following libraries were tried (in order):
>    libtinfo, libncurses, libterminfo, libtermcap, libcurses
> Please try installing whichever of these libraries is most appropriate
> for your system, together with its header files.
> For example, a libncurses-dev(el) or similar package.
> 
> At this point I gave up. I don't know where to grab GNU/Hurd packages 
> from, and anyway this process is taking more of my time than I would 
> like to spend.

See above.

> Perhaps you could build a GNU/Hurd image that already has all the 
> packages needed to develop programs like Emacs, and then send a complete 
> standalone recipe that will let someone easily reproduce the Emacs 
> problem even if they dislike messing with VMs.

Likewise.

Otherwise, you can git clone or download and build the tarball as you wrote
above. (With the dependencies installed)

Message #16 received at 25081 <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: svante.signell <at> gmail.com
Cc: 25081 <at> debbugs.gnu.org
Subject: Re: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Wed, 7 Dec 2016 16:45:30 -0800

On 12/07/2016 03:00 PM, Svante Signell wrote:
> Hi, adding emacs-devel to the recipients

I'm not sure emacs-devel is worth bothering over all the details here, 
so I'll drop it from the CC: list for now. We can send emacs-devel a 
summary later as needed.

>
> I normally use:
> qemu-system-x86_64 -enable-kvm -m 2048 -net nic,model=rtl8139 -net
> user,hostfwd=tcp::<port>-:22 -drive
> cache=writeback,index=0,media=disk,file=<whatever>.img

Thanks, that wasn't obvious, I used that. Perhaps make it part of the 
brief HOWTO?

> This is expected, since qemu does not know exactly in what format the file is
> in. Maybe just ignore that warning for now? I (and others) do.
>

I'm a fan of fixing warnings; otherwise I find that I stop paying 
attention to them. Surely there's some option I can give to qemu to 
suppress the warning, and that could be part of the HOWTO?

> It might be easier to use the debian tools: 

I assume these commands need to be run as root on the guest.

> apt-get update
> apt-get dist-upgrade

These work, thanks. The latter takes a looong time. Perhaps this should 
be written down too.

> apt-get build-dep emacs24/emacs25

This fails with 'Reading package lists... Done
E: Unable to find a source package for emacs24/emacs25'. I forged ahead 
by running just "apt-get build-dep emacs25" but that failed with:

E: Failed to fetch 
http://httpredir.debian.org/debian/pool/main/libx/libxdmcp/libxdmcp-dev_1.1.2-1.1_hurd-i386.deb 
Error reading from server. Remote end closed connection [IP: 
5.153.231.35 80]
E: Unable to fetch some archives, maybe run apt-get update or try with 
--fix-missing?
E: Failed to process build dependencies

I tried running "apt-get build-dep emacs25" again. This time it finished.

> apt-get source emacs24/emacs25

I don't want to do this, as I want to build from the master branch. I 
did that, with plain 'configure; make'.

Emacs built and eventually attempted to dump itself, and while it was 
doing so, the operating system crashed. When I attempted to reboot, fsck 
failed. I ran fsck -y by hand (took a while) and rebooted. When the OS 
came back up, temacs was size-0, so I removed it and ran 'make' again. 
This time it worked, in the sense that I can now run Emacs in a tty window.

So, it sounds like we can declare victory against this bug, at least for 
the master branch. At least, it worked for me, if you ignore the OS 
crashing during the build. Possibly the crash was because I didn't 
reboot after the 'apt-get dist-upgrade' (you didn't say to reboot, so I 
didn't....).

Message #19 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Clément Pit--Claudel <clement.pit <at> gmail.com>
To: bug-gnu-emacs <at> gnu.org
Cc: Paul Eggert <eggert <at> cs.ucla.edu>
Subject: Re: bug#25081: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Wed, 7 Dec 2016 19:54:44 -0500

[Message part 1 (text/plain, inline)]

On 2016-12-07 17:36, Paul Eggert wrote:
> At this point I gave up. I don't know where to grab GNU/Hurd packages from, and anyway this process is taking more of my time than I would like to spend.

Hey Paul,

Maybe this helps? I

* …downloaded the GNU Hurd image at https://people.debian.org/~sthibault/hurd-i386/README

* …connected to the qemu VM through SSH:

  kvm -net user,hostfwd=tcp:127.0.0.1:2222-:22 -net nic -drive file=debian-hurd-20160824.img,cache=writeback -m 1G

* …installed emacs' dependencies:

  $ apt install libmagickwand-dev libgtk-3-dev libxpm-dev libjpeg-dev libgif-dev libtiff-dev libgconf2-dev librsvg2-dev libxml2-dev libfreetype6-dev libm17n-dev libotf-dev libsystemd-dev libncurses-dev

* …downloaded emacs' pretest (this was cool)

  cp /ftp://alpha.gnu.org/gnu/emacs/pretest/emacs-25.1.90.tar.xz ./
  tar xf emacs-25.1.90.tar.xz

* …configured

  cd emacs-25.1.90
  ./configure --without-makeinfo

* …compiled

  make -j4

* …started Emacs and ran eww; browsed to gnu.org.

[signature.asc (application/pgp-signature, attachment)]

Message #22 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: Clément Pit--Claudel <clement.pit <at> gmail.com>,
 bug-gnu-emacs <at> gnu.org
Subject: Re: bug#25081: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Wed, 7 Dec 2016 17:01:41 -0800

On 12/07/2016 04:54 PM, Clément Pit--Claudel wrote:
> * …started Emacs and ran eww; browsed to gnu.org.

Wow, so it works with emacs-25 too? Thanks, that's good news. I guess we 
can close the bug report?

Message #25 received at 25081 <at> debbugs.gnu.org (full text, mbox):

From: Glenn Morris <rgm <at> gnu.org>
To: Clément Pit--Claudel <clement.pit <at> gmail.com>
Cc: Paul Eggert <eggert <at> cs.ucla.edu>, 25081 <at> debbugs.gnu.org
Subject: Re: bug#25081: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Wed, 07 Dec 2016 20:05:53 -0500

Clément Pit--Claudel wrote:

> * …compiled
>
>   make -j4

Do you have time to try deleting all the .elc files before you make,
which is closer to what the debian package build does?

Message #28 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Clément Pit--Claudel <clement.pit <at> gmail.com>
To: Paul Eggert <eggert <at> cs.ucla.edu>, bug-gnu-emacs <at> gnu.org
Subject: Re: bug#25081: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Wed, 7 Dec 2016 20:15:17 -0500

[Message part 1 (text/plain, inline)]

On 2016-12-07 20:01, Paul Eggert wrote:
> On 12/07/2016 04:54 PM, Clément Pit--Claudel wrote:
>> * …started Emacs and ran eww; browsed to gnu.org.
> 
> Wow, so it works with emacs-25 too? Thanks, that's good news. I guess we can close the bug report?

Yes… except Svante says it doesn't work with the Debian packages :/ I couldn't test that, because apt-get dist-upgrade crashed the OS before it could complete in the provided VM.

[signature.asc (application/pgp-signature, attachment)]

Message #31 received at 25081 <at> debbugs.gnu.org (full text, mbox):

From: Svante Signell <svante.signell <at> gmail.com>
To: Paul Eggert <eggert <at> cs.ucla.edu>, Clément
 Pit--Claudel <clement.pit <at> gmail.com>
Cc: 24857 <at> debbugs.gnu.org, 25081 <at> debbugs.gnu.org
Subject: Re: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Thu, 08 Dec 2016 10:12:03 +0100

(Adding #24857 and Clement to the recipients list.)

On Wed, 2016-12-07 at 16:45 -0800, Paul Eggert wrote:
> On 12/07/2016 03:00 PM, Svante Signell wrote:
> > Hi, adding emacs-devel to the recipients
> 
> I'm not sure emacs-devel is worth bothering over all the details here, 
> so I'll drop it from the CC: list for now. We can send emacs-devel a 
> summary later as needed.

OK!

> > 
> > I normally use:
> > qemu-system-x86_64 -enable-kvm -m 2048 -net nic,model=rtl8139 -net
> > user,hostfwd=tcp::<port>-:22 -drive
> > cache=writeback,index=0,media=disk,file=<whatever>.img
> 
> Thanks, that wasn't obvious, I used that. Perhaps make it part of the 
> brief HOWTO?

I'll propose that to people who can make these changes.

> > This is expected, since qemu does not know exactly in what format the file
> > is
> > in. Maybe just ignore that warning for now? I (and others) do.
> > 
> 
> I'm a fan of fixing warnings; otherwise I find that I stop paying 
> attention to them. Surely there's some option I can give to qemu to 
> suppress the warning, and that could be part of the HOWTO?

I still haven't bothered to find out which option to pass to qemu. Maybe its
useful to find out and add it to the HOWTO too.

> > It might be easier to use the debian tools: 
> 
> I assume these commands need to be run as root on the guest.
> 
> > apt-get update
> > apt-get dist-upgrade
> 
> These work, thanks. The latter takes a looong time. Perhaps this should 
> be written down too.

Noted!

> > apt-get build-dep emacs24/emacs25

I was too brief here:
apt-get build-dep emacs24
apt-get build-dep emacs25

> This fails with 'Reading package lists... Done
> E: Unable to find a source package for emacs24/emacs25'. I forged ahead 
> by running just "apt-get build-dep emacs25" but that failed with:
> 
> E: Failed to fetch 
> http://httpredir.debian.org/debian/pool/main/libx/libxdmcp/libxdmcp-dev_1.1.2-
> 1.1_hurd-i386.deb 
> Error reading from server. Remote end closed connection [IP: 
> 5.153.231.35 80]
> E: Unable to fetch some archives, maybe run apt-get update or try with 
> --fix-missing?
> E: Failed to process build dependencies
> 
> I tried running "apt-get build-dep emacs25" again. This time it finished.

Probably just a network glitch.

> > apt-get source emacs24/emacs25

As above:
apt-get source emacs24
apt-get source emacs25

> I don't want to do this, as I want to build from the master branch. I 
> did that, with plain 'configure; make'.

So you built from the tarball, right?

> Emacs built and eventually attempted to dump itself, and while it was 
> doing so, the operating system crashed. When I attempted to reboot, fsck 
> failed. I ran fsck -y by hand (took a while) and rebooted. When the OS 
> came back up, temacs was size-0, so I removed it and ran 'make' again. 
> This time it worked, in the sense that I can now run Emacs in a tty window.

I've also successfully built different emacs tarballs and git repos. The problem
is building again, or worse: to build a Debian package, which copies the whole
emacs tree into three different build directories: build-x, build-nox, build-
lucid, as well as rebuilding all *.elc files. See bug #24857, especially
comments #86,89,92,95 of that bug, for more info where Clément Pit--Claudel did
the same as you.

> So, it sounds like we can declare victory against this bug, at least for 
> the master branch. At least, it worked for me, if you ignore the OS 
> crashing during the build. Possibly the crash was because I didn't 
> reboot after the 'apt-get dist-upgrade' (you didn't say to reboot, so I 
> didn't....).

Sorry, I should have added <reboot> after dist-upgrade especially when
gnumach/hurd/glibc are updated.

Message #34 received at 25081-done <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: svante.signell <at> gmail.com, Clément Pit--Claudel
 <clement.pit <at> gmail.com>
Cc: 25081-done <at> debbugs.gnu.org, 24857-done <at> debbugs.gnu.org
Subject: Re: Anybody needs help to set up a qemu VM for GNU/Hurd?
Date: Thu, 8 Dec 2016 07:50:16 -0800

On 12/08/2016 01:12 AM, Svante Signell wrote:
> I've also successfully built different emacs tarballs and git repos. 
> The problem is building again, or worse: to build a Debian package, 
> which copies the whole emacs tree into three different build 
> directories: build-x, build-nox, build-lucid, as well as rebuilding 
> all *.elc files. See bug #24857, especially comments #86,89,92,95 of 
> that bug, for more info where Clément Pit--Claudel did the same as you.

OK, but that appears to be a problem with the Debian build procedure, 
not with Emacs per se.

>> So, it sounds like we can declare victory against this bug, at least for
>> the master branch. At least, it worked for me, if you ignore the OS
>> crashing during the build. Possibly the crash was because I didn't
>> reboot after the 'apt-get dist-upgrade' (you didn't say to reboot, so I
>> didn't....).
> Sorry, I should have added <reboot> after dist-upgrade especially when
> gnumach/hurd/glibc are updated.
>
>

OK. Closing the Emacs bug report.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.