From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 12 03:05:30 2017 Received: (at submit) by debbugs.gnu.org; 12 Jul 2017 07:05:30 +0000 Received: from localhost ([127.0.0.1]:34654 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVBiE-0004Dm-BX for submit@debbugs.gnu.org; Wed, 12 Jul 2017 03:05:30 -0400 Received: from eggs.gnu.org ([208.118.235.92]:45273) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVBiC-0004DZ-Gx for submit@debbugs.gnu.org; Wed, 12 Jul 2017 03:05:28 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dVBi6-0000JN-OK for submit@debbugs.gnu.org; Wed, 12 Jul 2017 03:05:23 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:49030) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dVBi6-0000J9-L5 for submit@debbugs.gnu.org; Wed, 12 Jul 2017 03:05:22 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:36224) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dVBi4-0000Fn-Nc for guix-patches@gnu.org; Wed, 12 Jul 2017 03:05:22 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dVBhz-0000DJ-PD for guix-patches@gnu.org; Wed, 12 Jul 2017 03:05:20 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:58192) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dVBhz-0000Bq-IR for guix-patches@gnu.org; Wed, 12 Jul 2017 03:05:15 -0400 Received: from dayas.3.home (77.118.188.216.wireless.dyn.drei.com [77.118.188.216]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 0B67B1CA0368; Wed, 12 Jul 2017 09:05:10 +0200 (CEST) From: Danny Milosavljevic To: guix-patches@gnu.org Subject: [PATCH] build: Make ISO-9660 image bootable from USB flash drive. Date: Wed, 12 Jul 2017 09:05:08 +0200 Message-Id: <20170712070508.5908-1-dannym@scratchpost.org> X-Mailer: git-send-email 2.13.2 Tags: patch X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit Cc: Danny Milosavljevic X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) * gnu/build/vm.scm (make-iso9660-image): Make image bootable from USB flash drive. --- gnu/build/vm.scm | 2 ++ 1 file changed, 2 insertions(+) diff --git a/gnu/build/vm.scm b/gnu/build/vm.scm index 2d41c5756..b686ef298 100644 --- a/gnu/build/vm.scm +++ b/gnu/build/vm.scm @@ -367,6 +367,8 @@ Grub configuration and OS-DRV as the stuff in it." "var=/tmp/root/var" "run=/tmp/root/run" "--" + ;; Store two copies of the headers + "-boot_image" "any" "partition_offset=16" "-volid" ,(string-upcase volume-id) ,@(if volume-uuid `("-volume_date" "uuid" From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 12 08:20:56 2017 Received: (at 27661) by debbugs.gnu.org; 12 Jul 2017 12:20:56 +0000 Received: from localhost ([127.0.0.1]:34839 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVGdU-0000K3-9Z for submit@debbugs.gnu.org; Wed, 12 Jul 2017 08:20:56 -0400 Received: from eggs.gnu.org ([208.118.235.92]:42603) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVGdS-0000Jo-IU for 27661@debbugs.gnu.org; Wed, 12 Jul 2017 08:20:55 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dVGdJ-0006A2-IT for 27661@debbugs.gnu.org; Wed, 12 Jul 2017 08:20:49 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:50481) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dVGdJ-00069k-AM; Wed, 12 Jul 2017 08:20:45 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:56230 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dVGdI-0001Jb-Lm; Wed, 12 Jul 2017 08:20:45 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Danny Milosavljevic Subject: Re: [bug#27661] [PATCH] build: Make ISO-9660 image bootable from USB flash drive. References: <20170712070508.5908-1-dannym@scratchpost.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 24 Messidor an 225 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Wed, 12 Jul 2017 14:20:43 +0200 In-Reply-To: <20170712070508.5908-1-dannym@scratchpost.org> (Danny Milosavljevic's message of "Wed, 12 Jul 2017 09:05:08 +0200") Message-ID: <87d195etic.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27661 Cc: 27661@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Danny Milosavljevic skribis: > * gnu/build/vm.scm (make-iso9660-image): Make image bootable from USB fla= sh > drive. > --- > gnu/build/vm.scm | 2 ++ > 1 file changed, 2 insertions(+) > > diff --git a/gnu/build/vm.scm b/gnu/build/vm.scm > index 2d41c5756..b686ef298 100644 > --- a/gnu/build/vm.scm > +++ b/gnu/build/vm.scm > @@ -367,6 +367,8 @@ Grub configuration and OS-DRV as the stuff in it." > "var=3D/tmp/root/var" > "run=3D/tmp/root/run" > "--" > + ;; Store two copies of the headers > + "-boot_image" "any" "partition_offset=3D16" I think you=E2=80=99ll have to expound in the comment because it doesn=E2= =80=99t sound trivial. :-) Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 12 09:44:13 2017 Received: (at 27661) by debbugs.gnu.org; 12 Jul 2017 13:44:13 +0000 Received: from localhost ([127.0.0.1]:34898 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVHw4-0002Ij-VZ for submit@debbugs.gnu.org; Wed, 12 Jul 2017 09:44:13 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:55370) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVHw2-0002IW-Lo for 27661@debbugs.gnu.org; Wed, 12 Jul 2017 09:44:11 -0400 Received: from dayas.gmi.oeaw.ac.at (unknown [193.170.94.190]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 5F8E21CA0368; Wed, 12 Jul 2017 15:44:09 +0200 (CEST) From: Danny Milosavljevic To: 27661@debbugs.gnu.org Subject: [PATCH v2] build: Make ISO-9660 image bootable from USB flash drive. Date: Wed, 12 Jul 2017 15:44:05 +0200 Message-Id: <20170712134405.25274-1-dannym@scratchpost.org> X-Mailer: git-send-email 2.13.2 In-Reply-To: <87d195etic.fsf@gnu.org> References: <87d195etic.fsf@gnu.org> Tags: patch X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661 Cc: Danny Milosavljevic X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) * gnu/build/vm.scm (make-iso9660-image): Make image bootable from USB flash drive. --- gnu/build/vm.scm | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/gnu/build/vm.scm b/gnu/build/vm.scm index 2d41c5756..d8c53ef37 100644 --- a/gnu/build/vm.scm +++ b/gnu/build/vm.scm @@ -367,6 +367,19 @@ Grub configuration and OS-DRV as the stuff in it." "var=/tmp/root/var" "run=/tmp/root/run" "--" + ;; Store two copies of the headers. + ;; The resulting ISO-9660 image has a DOS MBR and + ;; one protective partition (with type 0xCD). + ;; Because GuixSD only uses actual partitions + ;; rather than what /proc/partitions returns, work + ;; around it by storing the primary volume + ;; descriptor twice, once where it should be and + ;; once in the partition. + ;; Allegedly, otherwise, many other GNU tools + ;; (automounters etc) would also be confused by + ;; the extra partition so it makes sense to + ;; store two copies in any case. + "-boot_image" "any" "partition_offset=16" "-volid" ,(string-upcase volume-id) ,@(if volume-uuid `("-volume_date" "uuid" From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 12 10:08:15 2017 Received: (at 27661) by debbugs.gnu.org; 12 Jul 2017 14:08:15 +0000 Received: from localhost ([127.0.0.1]:35406 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVIJL-000328-68 for submit@debbugs.gnu.org; Wed, 12 Jul 2017 10:08:15 -0400 Received: from eggs.gnu.org ([208.118.235.92]:54865) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVIJJ-00031n-Nz for 27661@debbugs.gnu.org; Wed, 12 Jul 2017 10:08:14 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dVIJB-0007w6-BJ for 27661@debbugs.gnu.org; Wed, 12 Jul 2017 10:08:08 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=BAYES_40,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:51966) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dVIJB-0007vr-7l; Wed, 12 Jul 2017 10:08:05 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:56850 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dVIJA-00065h-ND; Wed, 12 Jul 2017 10:08:05 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Danny Milosavljevic Subject: Re: [bug#27661] [PATCH v2] build: Make ISO-9660 image bootable from USB flash drive. References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 24 Messidor an 225 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Wed, 12 Jul 2017 16:08:02 +0200 In-Reply-To: <20170712134405.25274-1-dannym@scratchpost.org> (Danny Milosavljevic's message of "Wed, 12 Jul 2017 15:44:05 +0200") Message-ID: <87inixd9z1.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27661 Cc: 27661@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Danny Milosavljevic skribis: > * gnu/build/vm.scm (make-iso9660-image): Make image bootable from USB fla= sh > drive. > --- > gnu/build/vm.scm | 13 +++++++++++++ > 1 file changed, 13 insertions(+) > > diff --git a/gnu/build/vm.scm b/gnu/build/vm.scm > index 2d41c5756..d8c53ef37 100644 > --- a/gnu/build/vm.scm > +++ b/gnu/build/vm.scm > @@ -367,6 +367,19 @@ Grub configuration and OS-DRV as the stuff in it." > "var=3D/tmp/root/var" > "run=3D/tmp/root/run" > "--" > + ;; Store two copies of the headers. > + ;; The resulting ISO-9660 image has a DOS MB= R and > + ;; one protective partition (with type 0xCD). > + ;; Because GuixSD only uses actual partitions > + ;; rather than what /proc/partitions returns= , work > + ;; around it by storing the primary volume > + ;; descriptor twice, once where it should be= and > + ;; once in the partition. > + ;; Allegedly, otherwise, many other GNU tools > + ;; (automounters etc) would also be confused= by > + ;; the extra partition so it makes sense to > + ;; store two copies in any case. > + "-boot_image" "any" "partition_offset=3D16" Now I understand. :-) Perfect, thank you! Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 12 10:15:19 2017 Received: (at control) by debbugs.gnu.org; 12 Jul 2017 14:15:19 +0000 Received: from localhost ([127.0.0.1]:35447 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVIQA-0003FT-U1 for submit@debbugs.gnu.org; Wed, 12 Jul 2017 10:15:19 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:58112) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVIQ8-0003FK-RY for control@debbugs.gnu.org; Wed, 12 Jul 2017 10:15:17 -0400 Received: from localhost (unknown [193.170.94.190]) by dd1012.kasserver.com (Postfix) with ESMTPSA id A45351CA0368 for ; Wed, 12 Jul 2017 16:15:15 +0200 (CEST) Date: Wed, 12 Jul 2017 16:15:15 +0200 From: Danny Milosavljevic To: Message-ID: <20170712161515.31fa886c@scratchpost.org> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: 1.3 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: close 27661 [...] Content analysis details: (1.3 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low trust [85.13.128.8 listed in list.dnswl.org] 1.8 MISSING_SUBJECT Missing Subject: header 0.2 NO_SUBJECT Extra score for no subject X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.3 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: close 27661 [...] Content analysis details: (1.3 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low trust [85.13.128.8 listed in list.dnswl.org] 0.0 TVD_SPACE_RATIO No description available. 1.8 MISSING_SUBJECT Missing Subject: header 0.2 NO_SUBJECT Extra score for no subject close 27661 From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 12 13:29:22 2017 Received: (at 27661-done) by debbugs.gnu.org; 12 Jul 2017 17:29:23 +0000 Received: from localhost ([127.0.0.1]:35717 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVLRy-0001Y6-Nv for submit@debbugs.gnu.org; Wed, 12 Jul 2017 13:29:22 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:46576) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVLRx-0001Xx-54 for 27661-done@debbugs.gnu.org; Wed, 12 Jul 2017 13:29:21 -0400 Received: from localhost (77.118.188.216.wireless.dyn.drei.com [77.118.188.216]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 600D31CA0705; Wed, 12 Jul 2017 19:29:08 +0200 (CEST) Date: Wed, 12 Jul 2017 19:28:27 +0200 From: Danny Milosavljevic To: ludo@gnu.org (Ludovic =?ISO-8859-1?Q?Court=E8s?=) Subject: ISO-9660 image working and ready Message-ID: <20170712192827.22b7c740@scratchpost.org> In-Reply-To: <87inixd9z1.fsf@gnu.org> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Thanks! Pushed. If we want we can (in the future) provide only the iso9660 image on the homepage (for x86_64). It will work from CD and USB flash drive - that should cover all the options. (Usually, ARM systems have a more involved boot process and will not work, neither from SD card nor from CD-ROM - and booting from USB flash drive is out of the question). Of course it would be nice if people could test the iso9660 image a bit (especially on UEFI systems of which I have none). To generate one, for example do this: guix system disk-image -t iso9660 foo.scm # will print the name of the directory that contains "guixsd.iso" in the end. where foo.scm contains: (use-modules (gnu)) (use-package-modules linux bootloaders) (use-service-modules base networking ssh) (operating-system (host-name "beagle-bone-black") (timezone "Europe/Zurich") (locale "en_US.UTF-8") (bootloader (grub-configuration (device "/dev/vda"))) (kernel linux-libre) (file-systems (cons (file-system (mount-point "/") (type "iso9660") (title 'label) (device "gnu-disk-image")) %base-file-systems)) (users (cons* (user-account (name "test") (group "users") (supplementary-groups '("wheel" "video")) (home-directory "/home/test") (password "sa5JEXtYx/rm6")) ; Password is pass. %base-user-accounts)) (services (cons* (dropbear-service) (dhcp-client-service) %base-services))) From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 12 16:38:14 2017 Received: (at 27661-done) by debbugs.gnu.org; 12 Jul 2017 20:38:14 +0000 Received: from localhost ([127.0.0.1]:35859 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVOOj-000639-QJ for submit@debbugs.gnu.org; Wed, 12 Jul 2017 16:38:13 -0400 Received: from aibo.runbox.com ([91.220.196.211]:40680) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVOOi-000631-0s for 27661-done@debbugs.gnu.org; Wed, 12 Jul 2017 16:38:12 -0400 Received: from [10.9.9.211] (helo=mailfront11.runbox.com) by mailtransmit03.runbox with esmtp (Exim 4.86_2) (envelope-from ) id 1dVOOg-0007nI-AK; Wed, 12 Jul 2017 22:38:10 +0200 Received: from [94.242.228.174] (helo=localhost) by mailfront11.runbox.com with esmtpsa (uid:892961 ) (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) id 1dVOOP-0001w5-UK; Wed, 12 Jul 2017 22:37:54 +0200 Date: Wed, 12 Jul 2017 20:37:52 +0000 From: ng0 To: Danny Milosavljevic Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170712203752.4u27xie4mcc3zvmm@abyayala> Mail-Followup-To: Danny Milosavljevic , 27661-done@debbugs.gnu.org References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="bvd2zh7o2hnj3hmy" Content-Disposition: inline In-Reply-To: <20170712192827.22b7c740@scratchpost.org> X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) --bvd2zh7o2hnj3hmy Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Danny Milosavljevic transcribed 1.4K bytes: > Thanks! >=20 > Pushed. >=20 > If we want we can (in the future) provide only the iso9660 image on the h= omepage (for x86_64). >=20 > It will work from CD and USB flash drive - that should cover all the opti= ons. Woo! Thanks for your work on this :) I'll test this tomorrow evening. Exciting news. > (Usually, ARM systems have a more involved boot process and will not work= , neither from SD card nor from CD-ROM - and booting from USB flash drive i= s out of the question). >=20 > Of course it would be nice if people could test the iso9660 image a bit (= especially on UEFI systems of which I have none). >=20 > To generate one, for example do this: >=20 > guix system disk-image -t iso9660 foo.scm # will print the name of the di= rectory that contains "guixsd.iso" in the end. >=20 > where foo.scm contains: >=20 > (use-modules (gnu)) > (use-package-modules linux bootloaders) > (use-service-modules base networking ssh) >=20 > (operating-system > (host-name "beagle-bone-black") > (timezone "Europe/Zurich") > (locale "en_US.UTF-8") >=20 > (bootloader (grub-configuration (device "/dev/vda"))) > (kernel linux-libre) >=20 > (file-systems > (cons > (file-system > (mount-point "/") > (type "iso9660") > (title 'label) > (device "gnu-disk-image")) > %base-file-systems)) >=20 > (users > (cons* > (user-account > (name "test") > (group "users") > (supplementary-groups '("wheel" "video")) > (home-directory "/home/test") > (password "sa5JEXtYx/rm6")) ; Password is pass. > %base-user-accounts)) >=20 > (services > (cons* > (dropbear-service) > (dhcp-client-service) > %base-services))) >=20 >=20 >=20 >=20 --=20 ng0 GnuPG: A88C8ADD129828D7EAC02E52E22F9BBFEE348588 GnuPG: https://n0is.noblogs.org/my-keys https://www.infotropique.org https://krosos.org --bvd2zh7o2hnj3hmy Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEqIyK3RKYKNfqwC5S4i+bv+40hYgFAllmiKAACgkQ4i+bv+40 hYiw4A/+NC0VypR++IoiUSZLnZftT2Zsh82ijh3alDpuvMRzedsCmjjaxGeVC4dj pFRuHGl35ULkBhXu0TpHcMopWd2C6XqBDgw/bbhatlgsikT3u4qBOmmy2En8/xkj KcLGIBKxOXy3rTWMW+vbMwjyralvaOcHK4WjBKuC/ejc8yFlnN2fmbBx3F6Knxcm RFkVklO8LaDXSQ0ULc0FIi/iMxiErtMNx2QPS5m9EnTpHJ2W8eGeq4xOYZ27obCj fwP6vH1x6V8QpjM6nc1yAmAtLDwS6nlKQpAEsodNraEvSVUTW5Ru+HjS80MtN8Ip J2gTnq2rLXAj7b05PAIldevyc/Kc1q912931sNbWM97Uryb+FQaJdnhXHqexCgEe Y6uzYZw1VAYHBIGhVpYh92SpfJfbDwtVv+BvcmmU97DTomgyXdI7S4uorZcTprew xaAF5EFnqGxTFw77EppZSs05hJQ+UqkLzK9F/r3KHBqYJgjxdtNDoGaON+I3diiK eLwwIJ0wmsPWODLcqQHZAQzzzsB4s/Isiw2wWwH0NDYh0FSEyqFEy/xSeGVLh/G5 bf75uP1OK5nKM9LKBuA14Fz/LHGiM4jw6r9e5qOBjMwujIvLrHExiG17KDwFO9pi KxRXwjU57S9Mb6Mq7IBpWfWIEwuAsBRyUoKw2HjuYmkP52upNIs= =gJQd -----END PGP SIGNATURE----- --bvd2zh7o2hnj3hmy-- From debbugs-submit-bounces@debbugs.gnu.org Thu Jul 13 14:54:01 2017 Received: (at 27661-done) by debbugs.gnu.org; 13 Jul 2017 18:54:01 +0000 Received: from localhost ([127.0.0.1]:37353 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVjFQ-0001Ru-Jf for submit@debbugs.gnu.org; Thu, 13 Jul 2017 14:54:00 -0400 Received: from out1-smtp.messagingengine.com ([66.111.4.25]:55765) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVjFO-0001Rm-HO for 27661-done@debbugs.gnu.org; Thu, 13 Jul 2017 14:53:59 -0400 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id E396620975; Thu, 13 Jul 2017 14:53:57 -0400 (EDT) Received: from frontend1 ([10.202.2.160]) by compute5.internal (MEProxy); Thu, 13 Jul 2017 14:53:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.com; h= cc:content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc :x-sasl-enc; s=fm1; bh=PncGXf+5cjgpDC/sRQOR8A3QWKH6mEXgwvv1BclR6 KA=; b=JVUbf19bed8pzYhCSrlumxk8MjO4RfpmvqQEkBefBaSleM5q5AI+EFgpv g+jWpfIr3Qw4gXRMx1awkB431d3nnWnHT+L4+Puo5QAX8IrQvgPyZrs2Nq6pbaDb 5K3sJGU0OPRpkL8VqdfUT5m3atDY0fAHWJgDNMd1KQAthaKEUlekRZaPSFFOSA61 6PHA3eRuX1AMAQq1RUVqTVMB7Kq1GvsxIOwFm4TTdPdwb+6rDRiklJ1AHzZRg0JN hizt6rTrFJ0g6JUu3drEalKdmeW7dR332/Pre+f0q1FTGD/QwFC6tf6Ke8yCLMfb QjcJmYD3rFhOyw0zDUN3zmFXMuIoQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc:x-sasl-enc; s=fm1; bh=PncGXf+5cjgpDC/sRQ OR8A3QWKH6mEXgwvv1BclR6KA=; b=Oh9neuRFTwKx16eejtn97bgrzkISKoD8Hb XQm4ybmH2daTHieLZ5Qn3H24a2LL9hzeAKaepPjYRB+ZxXdPmWgB5kxgdVlfS1Xf +E1kT5KYfPpoTkceHihq44vsJ67fVd0Sf0BM3Jhvo+1rKyAeCUAUf2PUEGw5yGQX BkSTJTNqg65S+9b8Bq3FI2KmQnUYzphfX25Go2/IMQMABkPkCc+Jt5SoPj0LktE1 VFTtrZFwN57R8lM2m0ZyOV85Ymwdce645xpKBzcxBqU2No1h2YTgdvbRcQdxHORE qveC8hq80OZQK+Xrih30MZN1Elj55py6ERop8b96kHth66/7PJTw== X-ME-Sender: X-Sasl-enc: JxMqqkhDwjbPAF2GQg1f5Sgjn8L7WMCrY9B1oZNKmdov 1499972037 Received: from localhost (unknown [188.113.81.93]) by mail.messagingengine.com (Postfix) with ESMTPA id 74EC17E46B; Thu, 13 Jul 2017 14:53:57 -0400 (EDT) From: Marius Bakke To: Danny Milosavljevic , Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= Subject: Re: [bug#27661] ISO-9660 image working and ready In-Reply-To: <20170712192827.22b7c740@scratchpost.org> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> User-Agent: Notmuch/0.24.2 (https://notmuchmail.org) Emacs/25.2.1 (x86_64-unknown-linux-gnu) Date: Thu, 13 Jul 2017 20:53:50 +0200 Message-ID: <87eftkjhhd.fsf@fastmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Danny Milosavljevic writes: > Thanks! > > Pushed. > > If we want we can (in the future) provide only the iso9660 image on the h= omepage (for x86_64). > > It will work from CD and USB flash drive - that should cover all the opti= ons. > > (Usually, ARM systems have a more involved boot process and will not work= , neither from SD card nor from CD-ROM - and booting from USB flash drive i= s out of the question). > > Of course it would be nice if people could test the iso9660 image a bit (= especially on UEFI systems of which I have none). It does not work on UEFI. I tested in qemu like this: qemu-system-x86_64 -bios $(guix build ovmf)/share/firmware/ovmf_x64.bin \ -m 256M -enable-kvm -boot c -cdrom /gnu/store/...-disk-image/guixsd.iso There doesn't seem to be an EFI system partition? How did you dodge my nasty partition hack :) Also, the derivation creates two files alongside the ISO, are those actually required or can we make it it return the ISO directly? Impressive work nonetheless! Many users have asked for ISO support for use with e.g. hosting providers. And it's really cool to be able to create a CDROM/USB, BIOS/UEFI* multi-hybrid at a whim! * Soon=E2=84=A2 --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCgAdFiEEu7At3yzq9qgNHeZDoqBt8qM6VPoFAllnwb4ACgkQoqBt8qM6 VPrcmggArE4RpvaVysuhpoRGgPBLe6bJe4CTV44yNqYF4p8wZgt+ZWvUC0AEgITC nxNyEebAtEaaNfxDK8yT8TZgPb07Bg4u4zsxK7LVWaKtdLXmNk7stW9qHewo07+n tFZmgvewiOa5sODV4yNl3/oB7JWjB8UOPAJO02uqEkM06RZoCNitqA2p37K9snfQ BZfvuV5ac0bGgi0BFz5Ge9odPuxNyde7mi4yRuHiQcXjhIpXfu/QZwHsvQ7qHM+3 T5QIy/iVakSOH0hZYgI9JTfev4padarCSIRTA30YZoUiHkOix/NSeOdRekcEwrHE O5UsqIvlcxRdunHS97hv11Pb2N/W9Q== =sL7n -----END PGP SIGNATURE----- --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 14 03:30:27 2017 Received: (at 27661-done) by debbugs.gnu.org; 14 Jul 2017 07:30:27 +0000 Received: from localhost ([127.0.0.1]:37669 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVv3T-0006a6-Ka for submit@debbugs.gnu.org; Fri, 14 Jul 2017 03:30:27 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:36664) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVv3R-0006Zx-Mm for 27661-done@debbugs.gnu.org; Fri, 14 Jul 2017 03:30:26 -0400 Received: from localhost (77.118.188.216.wireless.dyn.drei.com [77.118.188.216]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 4DFAF1CA04D6; Fri, 14 Jul 2017 09:30:23 +0200 (CEST) Date: Fri, 14 Jul 2017 09:30:21 +0200 From: Danny Milosavljevic To: Marius Bakke Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170714093021.1b162844@scratchpost.org> In-Reply-To: <87eftkjhhd.fsf@fastmail.com> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: Ludovic =?ISO-8859-1?Q?Court=E8s?= , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Hi Marius, On Thu, 13 Jul 2017 20:53:50 +0200 Marius Bakke wrote: > It does not work on UEFI. I tested in qemu like this: >=20 > qemu-system-x86_64 -bios $(guix build ovmf)/share/firmware/ovmf_x64.bin \ > -m 256M -enable-kvm -boot c -cdrom /gnu/store/...-disk-image/guixsd.iso >=20 > There doesn't seem to be an EFI system partition? How did you dodge my > nasty partition hack :) It's not using initialize-harddisk but rather grub-mkrescue and xorriso in = order to create the filesystem. That's because ISO-9660 filesystems are read-only and have to be created *i= ncluding* the entire content in one go. > Also, the derivation creates two files alongside the ISO, are those > actually required=20 No. >or can we make it it return the ISO directly? I don't know how... > Impressive work nonetheless! Many users have asked for ISO support for > use with e.g. hosting providers. And it's really cool to be able to > create a CDROM/USB, BIOS/UEFI* multi-hybrid at a whim! >=20 > * Soon=E2=84=A2 Bug #27689 fixes it a bit if the bootloader used is grub-efi. However, that image then doesn't work with normal (non-EFI) BIOS and neithe= r does it work with "qemu -hda". Unfortunately I can't debug the "qemu -hda" problem properly because it see= ms that when UEFI is in use, "grub linux16" doesn't work any more which mea= ns I can't increase the number of lines on screen anymore (also, there's a = huge penguin in the way) which means I can't see the entire error message t= hat the guest prints. How can I see the entire Linux kernel crash message in qemu (UEFI)? From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 14 03:55:28 2017 Received: (at 27661-done) by debbugs.gnu.org; 14 Jul 2017 07:55:29 +0000 Received: from localhost ([127.0.0.1]:37675 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVvRg-0007Bw-OO for submit@debbugs.gnu.org; Fri, 14 Jul 2017 03:55:28 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:38748) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dVvRd-0007Bl-5J for 27661-done@debbugs.gnu.org; Fri, 14 Jul 2017 03:55:25 -0400 Received: from localhost (77.118.188.216.wireless.dyn.drei.com [77.118.188.216]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 31E531CA03D2; Fri, 14 Jul 2017 09:55:23 +0200 (CEST) Date: Fri, 14 Jul 2017 09:55:21 +0200 From: Danny Milosavljevic To: Marius Bakke Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170714095521.10045e44@scratchpost.org> In-Reply-To: <87eftkjhhd.fsf@fastmail.com> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: Ludovic =?ISO-8859-1?Q?Court=E8s?= , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Debugging: $ qemu-system-x86_64 -bios $(guix build ovmf)/share/firmware/ovmf_x64.bin -m 1G -enable-kvm -hda Zuefi -serial stdio Then add "console=ttyS0" to Linux cmdline in grub menu edit. I get: [ 0.923605] scsi 0:0:0:0: Direct-Access ATA QEMU HARDDISK 2.5+ PQ: 0 ANSI: 5 [ 0.926558] sd 0:0:0:0: [sda] 2215580 512-byte logical blocks: (1.13 GB/1.06 GiB) [ 0.928683] sd 0:0:0:0: [sda] Write Protect is off [ 0.930155] sd 0:0:0:0: Attached scsi generic sg0 type 0 [ 0.931705] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 0.934772] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 [ 0.949039] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray [ 0.952674] cdrom: Uniform CD-ROM driver Revision: 3.20 [ 0.955449] sda: sda1 sda2 sda3 sda4 [ 0.956995] sd 0:0:0:0: [sda] Attached SCSI disk [ 0.959031] sr 1:0:0:0: Attached scsi generic sg1 type 5 GC Warning: Couldn't read /proc/stat Welcome, this is GNU's early boot Guile. Use '--repl' for an initrd REPL. loading '/gnu/store/48d1w55iy2vpcm5ass5lsp8almghszv8-system/boot'... [ 1.235733] attempt to access beyond end of device [ 1.237066] sda1: rw=0, want=949216, limit=76376 [ 1.238565] attempt to access beyond end of device [ 1.240115] sda1: rw=0, want=949216, limit=76376 [ 1.242095] attempt to access beyond end of device [ 1.243545] sda1: rw=0, want=949216, limit=76376 ERROR: In procedure primitive-load: ERROR: In procedure fport_fill_input: Input/output error Partitions are: Disk Zuefi: 1.1 GiB, 1134376960 bytes, 2215580 sectors Units: sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disklabel type: gpt Disk identifier: DB26D0AA-65F4-4CE1-87F8-85CAD51B5C94 Device Start End Sectors Size Type Zuefi1 64 76439 76376 37.3M Microsoft basic data <----- here is a suspect Zuefi2 76440 82199 5760 2.8M EFI System Zuefi3 82200 2214931 2132732 1G Apple HFS/HFS+ Zuefi4 2214932 2215531 600 300K Microsoft basic data Backtrace: Impossible. It did not actually enter the prompt. From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 17 04:22:42 2017 Received: (at 27661-done) by debbugs.gnu.org; 17 Jul 2017 08:22:42 +0000 Received: from localhost ([127.0.0.1]:43173 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dX1Ig-0003dP-3Z for submit@debbugs.gnu.org; Mon, 17 Jul 2017 04:22:42 -0400 Received: from eggs.gnu.org ([208.118.235.92]:40517) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dX1If-0003dA-CC for 27661-done@debbugs.gnu.org; Mon, 17 Jul 2017 04:22:41 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dX1IV-0007k8-E8 for 27661-done@debbugs.gnu.org; Mon, 17 Jul 2017 04:22:36 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:58455) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dX1IV-0007k4-Aj; Mon, 17 Jul 2017 04:22:31 -0400 Received: from [193.50.110.212] (port=51180 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dX1IU-0005lk-S2; Mon, 17 Jul 2017 04:22:31 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Danny Milosavljevic Subject: Re: [bug#27661] ISO-9660 image working and ready References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714093021.1b162844@scratchpost.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 29 Messidor an 225 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Mon, 17 Jul 2017 10:22:29 +0200 In-Reply-To: <20170714093021.1b162844@scratchpost.org> (Danny Milosavljevic's message of "Fri, 14 Jul 2017 09:30:21 +0200") Message-ID: <87bmojfp6i.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Hello, Danny Milosavljevic skribis: >> Also, the derivation creates two files alongside the ISO, are those >> actually required=20 > > No. > >>or can we make it it return the ISO directly? > > I don't know how... I also vote for returning the ISO directly, for consistency with what =E2=80=98guix system disk-image=E2=80=99 does for the other formats. WDYT,= Danny? :-) Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 17 04:25:22 2017 Received: (at 27661-done) by debbugs.gnu.org; 17 Jul 2017 08:25:22 +0000 Received: from localhost ([127.0.0.1]:43177 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dX1LG-0003hy-JF for submit@debbugs.gnu.org; Mon, 17 Jul 2017 04:25:22 -0400 Received: from eggs.gnu.org ([208.118.235.92]:40980) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dX1LF-0003hl-9Y for 27661-done@debbugs.gnu.org; Mon, 17 Jul 2017 04:25:21 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dX1L5-0000qG-4F for 27661-done@debbugs.gnu.org; Mon, 17 Jul 2017 04:25:16 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:58468) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dX1L5-0000qC-1J; Mon, 17 Jul 2017 04:25:11 -0400 Received: from [193.50.110.212] (port=51182 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dX1L4-0005tx-FH; Mon, 17 Jul 2017 04:25:10 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Danny Milosavljevic Subject: Re: [bug#27661] ISO-9660 image working and ready References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714095521.10045e44@scratchpost.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 29 Messidor an 225 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Mon, 17 Jul 2017 10:25:08 +0200 In-Reply-To: <20170714095521.10045e44@scratchpost.org> (Danny Milosavljevic's message of "Fri, 14 Jul 2017 09:55:21 +0200") Message-ID: <8760erfp23.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Danny Milosavljevic skribis: > Debugging: > > $ qemu-system-x86_64 -bios $(guix build ovmf)/share/firmware/ovmf_x64.bin= -m 1G -enable-kvm -hda Zuefi -serial stdio > > Then add "console=3DttyS0" to Linux cmdline in grub menu edit. > > I get: > > [ 0.923605] scsi 0:0:0:0: Direct-Access ATA QEMU HARDDISK = 2.5+ PQ: 0 ANSI: 5 > [ 0.926558] sd 0:0:0:0: [sda] 2215580 512-byte logical blocks: (1.13 G= B/1.06 GiB) > [ 0.928683] sd 0:0:0:0: [sda] Write Protect is off > [ 0.930155] sd 0:0:0:0: Attached scsi generic sg0 type 0 > [ 0.931705] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enable= d, doesn't support DPO or FUA > [ 0.934772] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM = 2.5+ PQ: 0 ANSI: 5 > [ 0.949039] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tr= ay > [ 0.952674] cdrom: Uniform CD-ROM driver Revision: 3.20 > [ 0.955449] sda: sda1 sda2 sda3 sda4 > [ 0.956995] sd 0:0:0:0: [sda] Attached SCSI disk > [ 0.959031] sr 1:0:0:0: Attached scsi generic sg1 type 5 > GC Warning: Couldn't read /proc/stat > Welcome, this is GNU's early boot Guile. > Use '--repl' for an initrd REPL. > loading '/gnu/store/48d1w55iy2vpcm5ass5lsp8almghszv8-system/boot'... > [ 1.235733] attempt to access beyond end of device > [ 1.237066] sda1: rw=3D0, want=3D949216, limit=3D76376 > [ 1.238565] attempt to access beyond end of device > [ 1.240115] sda1: rw=3D0, want=3D949216, limit=3D76376 > [ 1.242095] attempt to access beyond end of device > [ 1.243545] sda1: rw=3D0, want=3D949216, limit=3D76376 > ERROR: In procedure primitive-load: > ERROR: In procedure fport_fill_input: Input/output error It looks like the partition detection code in (gnu build file-systems) tries to read beyond the end of disk or something. Could you try adding a few =E2=80=98pk=E2=80=99 or =E2=80=98format=E2=80=99 calls in there so se= e what=E2=80=99s going on? Alternately, you could run the same QEMU command line that the derivation spawns, so you would get a REPL (and backtrace). For that you can =E2=80=9Cps aux | grep qemu=E2=80=9D while the derivation is buildi= ng, and copy/paste the QEMU command from there. HTH, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 17 05:04:43 2017 Received: (at 27661-done) by debbugs.gnu.org; 17 Jul 2017 09:04:43 +0000 Received: from localhost ([127.0.0.1]:43195 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dX1xL-0004cx-Bk for submit@debbugs.gnu.org; Mon, 17 Jul 2017 05:04:43 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:52668) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dX1xJ-0004cp-Tk for 27661-done@debbugs.gnu.org; Mon, 17 Jul 2017 05:04:42 -0400 Received: from localhost (77.118.197.241.wireless.dyn.drei.com [77.118.197.241]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 36C0A1CA0156; Mon, 17 Jul 2017 11:04:39 +0200 (CEST) Date: Mon, 17 Jul 2017 11:04:34 +0200 From: Danny Milosavljevic To: ludo@gnu.org (Ludovic =?ISO-8859-1?Q?Court=E8s?=) Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170717110434.1576628d@scratchpost.org> In-Reply-To: <8760erfp23.fsf@gnu.org> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714095521.10045e44@scratchpost.org> <8760erfp23.fsf@gnu.org> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Hi Ludo, On Mon, 17 Jul 2017 10:25:08 +0200 ludo@gnu.org (Ludovic Court=C3=A8s) wrote: > It looks like the partition detection code in (gnu build file-systems) > tries to read beyond the end of disk or something. Could you try adding > a few =E2=80=98pk=E2=80=99 or =E2=80=98format=E2=80=99 calls in there so = see what=E2=80=99s going on? Yeah, it tries to read beyond the end of the partition. That's because gru= b-mkrescue creates a tiny fake partition which happens to start where the I= SO-9660 filesystem starts and GuixSD mounts it and tries to boot from it (b= ecause it has a valid volume id). As it is going on booting, the system bo= ot wanders off the end of the partition and Linux tells it that it can't do= that. I've posted bug# 27705 which is the minimal set of patches to get it to wor= k. I just read the root filesystem directly from the whole disk there. By now, I've also tested the resulting image on the bare metal on a real DV= D on a non-EFI, non-Libreboot system. Works fine :) Marius, could you also test it on EFI ? As for fixing the original partitioning problem, I didn't manage to find th= e place yet. As far as I can see, grub-mkrescue uses xorriso which uses mk= isofs to actually generate the ISO image. There's a "protective" DOS MBR g= enerated somewhere, but where. It seems that Xorriso_coordinate_system_are= a and make_isohybrid_mbr are at least related somehow. Also, it's question= able whether it's possible to fix it without creating overlapped partitions= , see below. The resulting partition table is: Disk J: 1.1 GiB, 1137074176 bytes, 2220848 sectors Units: sectors of 1 * 512 =3D 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disklabel type: gpt Disk identifier: F86B53DD-3E7B-4B5E-A4C9-3A1A0AA56D22 Device Start End Sectors Size Type J1 64 76871 76808 37.5M Microsoft basic data <--- GuixSD tried= to use this one as root J2 76872 82631 5760 2.8M EFI System <-- mounts and reads fine a= s FAT FS J3 82632 2220199 2137568 1G Apple HFS/HFS+ <--- can't find valid H= FS on there J4 2220200 2220799 600 300K Microsoft basic data <-- can't mount it P.S. grub-mkrescue (with EFI) has a surprising number of supported architec= tures. It might be that a grub-mkrescue-generated image could also boot on= MIPS, Sparc, PowerPC, ARM64. > Alternately, you could run the same QEMU command line that the > derivation spawns, so you would get a REPL (and backtrace). For that > you can =E2=80=9Cps aux | grep qemu=E2=80=9D while the derivation is buil= ding, and > copy/paste the QEMU command from there. Thanks! Very useful. From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 17 15:28:48 2017 Received: (at 27661-done) by debbugs.gnu.org; 17 Jul 2017 19:28:48 +0000 Received: from localhost ([127.0.0.1]:44818 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXBhI-0001Yf-L5 for submit@debbugs.gnu.org; Mon, 17 Jul 2017 15:28:48 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:48410) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXBhG-0001YU-AG for 27661-done@debbugs.gnu.org; Mon, 17 Jul 2017 15:28:46 -0400 Received: from localhost (77.118.197.241.wireless.dyn.drei.com [77.118.197.241]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 743281CA0026; Mon, 17 Jul 2017 21:28:42 +0200 (CEST) Date: Mon, 17 Jul 2017 21:28:37 +0200 From: Danny Milosavljevic To: ludo@gnu.org (Ludovic =?ISO-8859-1?Q?Court=E8s?=) Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170717212837.10c1d0b3@scratchpost.org> In-Reply-To: <87bmojfp6i.fsf@gnu.org> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714093021.1b162844@scratchpost.org> <87bmojfp6i.fsf@gnu.org> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Hi Ludo, > I also vote for returning the ISO directly, for consistency with what > =E2=80=98guix system disk-image=E2=80=99 does for the other formats. WDY= T, Danny? :-) Sure, I just don't know how to do that. The other two files are "system" a= nd "bootcfg" and contain some kind of list of gnu store paths and single-di= git numbers. Anyone can go ahead and remove those - and make it somehow pi= ck the guixsd.iso ... *shrugs* iso9660-image uses expression->derivation-in-linux-vm to run make-iso9660-i= mage to create /xchg/guixsd.iso - not sure how the other two files came int= o being. I could make iso9660-image delete the two other files after the fact, I gue= ss. But that wouldn't make system-disk-image use just one regular file as = the output - without the directory. load-in-linux-vm has a flag "make-disk-image?". When not set (and in this = case, it's really not set), it does (mkdir output) (copy-recursively "xchg" output) . On the other hand, when set, it creates a huge qemu disk image we don't nee= d. We could special-case "if there's a guixsd.iso in there, take it instead" t= here, but doesn't seem so nice, does it? From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 17 15:58:27 2017 Received: (at 27661-done) by debbugs.gnu.org; 17 Jul 2017 19:58:27 +0000 Received: from localhost ([127.0.0.1]:44854 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXC9z-00045J-IY for submit@debbugs.gnu.org; Mon, 17 Jul 2017 15:58:27 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:50850) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXC9y-00045C-DE for 27661-done@debbugs.gnu.org; Mon, 17 Jul 2017 15:58:26 -0400 Received: from localhost (77.118.197.241.wireless.dyn.drei.com [77.118.197.241]) by dd1012.kasserver.com (Postfix) with ESMTPSA id 633011CA0026; Mon, 17 Jul 2017 21:58:24 +0200 (CEST) Date: Mon, 17 Jul 2017 21:58:19 +0200 From: Danny Milosavljevic To: ludo@gnu.org (Ludovic =?ISO-8859-1?Q?Court=E8s?=) Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170717215819.684a1578@scratchpost.org> In-Reply-To: <20170717212837.10c1d0b3@scratchpost.org> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714093021.1b162844@scratchpost.org> <87bmojfp6i.fsf@gnu.org> <20170717212837.10c1d0b3@scratchpost.org> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) I tried something like the following. But now it throws away the output entirely. That's not an improvement :) But I think this is overcomplicating things - and the easiest way with only aesthetic downsides would be to punt and do nothing... Or we could replace make-disk-image? and make-output-directory? by two parameters "initializer" and "serializer" which would be procedures that could do whatever they wanted. I think that would be overly generic, though :) Also, what amount of rebuilding would any change cause? The procedures modified are already used quite often... diff --git a/gnu/build/vm.scm b/gnu/build/vm.scm index d8c53ef37..2be060902 100644 --- a/gnu/build/vm.scm +++ b/gnu/build/vm.scm @@ -76,6 +76,7 @@ (qemu (qemu-command)) (memory-size 512) linux initrd make-disk-image? + (make-output-directory? #f) (disk-image-size (* 100 (expt 2 20))) (disk-image-format "qcow2") (references-graphs '())) @@ -87,7 +88,9 @@ DISK-IMAGE-SIZE bytes resulting from the execution of BUILDER, which may access it via /dev/hda. REFERENCES-GRAPHS can specify a list of reference-graph files as produced by -the #:references-graphs parameter of 'derivation'." +the #:references-graphs parameter of 'derivation'. + +If CREATE_OUTPUT-DIRECTORY?, creates a directory OUTPUT." (when make-disk-image? (format #t "creating ~a image of ~,2f MiB...~%" disk-image-format (/ disk-image-size (expt 2 20))) @@ -137,8 +140,10 @@ the #:references-graphs parameter of 'derivation'." ;; When MAKE-DISK-IMAGE? is true, the image is in OUTPUT already. (unless make-disk-image? - (mkdir output) - (copy-recursively "xchg" output))) + (if make-output-directory? + (begin + (mkdir output) + (copy-recursively "xchg" output))))) diff --git a/gnu/system/vm.scm b/gnu/system/vm.scm index 66a2448ce..69ebf2377 100644 --- a/gnu/system/vm.scm +++ b/gnu/system/vm.scm @@ -106,6 +106,7 @@ (%guile-for-build)) (make-disk-image? #f) + (make-output-directory? #f) (references-graphs #f) (memory-size 256) (disk-image-format "qcow2") @@ -121,6 +122,9 @@ DISK-IMAGE-FORMAT (e.g., 'qcow2' or 'raw'), of DISK-IMAGE-SIZE bytes and return it. When DISK-IMAGE-SIZE is 'guess, estimate the image size based based on the size of the closure of REFERENCES-GRAPHS. +When MAKE-OUTPUT-DIRECTORY? is true, then create a directory OUTPUT +and copy the contents of /xchg there. + When REFERENCES-GRAPHS is true, it must be a list of file name/store path pairs, as for `derivation'. The files containing the reference graphs are made available under the /xchg CIFS share." @@ -164,6 +168,7 @@ made available under the /xchg CIFS share." #:linux linux #:initrd initrd #:memory-size #$memory-size #:make-disk-image? #$make-disk-image? + #:make-output-directory? #$make-output-directory? #:disk-image-format #$disk-image-format #:disk-image-size size #:references-graphs graphs))))) From debbugs-submit-bounces@debbugs.gnu.org Tue Jul 18 09:09:04 2017 Received: (at 27661-done) by debbugs.gnu.org; 18 Jul 2017 13:09:04 +0000 Received: from localhost ([127.0.0.1]:45530 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXSFM-0001e7-ER for submit@debbugs.gnu.org; Tue, 18 Jul 2017 09:09:04 -0400 Received: from eggs.gnu.org ([208.118.235.92]:59532) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXSFL-0001de-Ca for 27661-done@debbugs.gnu.org; Tue, 18 Jul 2017 09:09:03 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dXSFA-0008DT-To for 27661-done@debbugs.gnu.org; Tue, 18 Jul 2017 09:08:57 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:51982) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dXSFA-0008DN-Q1; Tue, 18 Jul 2017 09:08:52 -0400 Received: from [193.50.110.220] (port=40014 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dXSFA-0007MZ-Bs; Tue, 18 Jul 2017 09:08:52 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Danny Milosavljevic Subject: Re: [bug#27661] ISO-9660 image working and ready References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714093021.1b162844@scratchpost.org> <87bmojfp6i.fsf@gnu.org> <20170717212837.10c1d0b3@scratchpost.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 30 Messidor an 225 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Tue, 18 Jul 2017 15:08:49 +0200 In-Reply-To: <20170717212837.10c1d0b3@scratchpost.org> (Danny Milosavljevic's message of "Mon, 17 Jul 2017 21:28:37 +0200") Message-ID: <87o9shyjry.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Danny, Danny Milosavljevic skribis: >> I also vote for returning the ISO directly, for consistency with what >> =E2=80=98guix system disk-image=E2=80=99 does for the other formats. WD= YT, Danny? :-) > > Sure, I just don't know how to do that. The other two files are > "system" and "bootcfg" and contain some kind of list of gnu store > paths and single-digit numbers. They are =E2=80=9Creferences graphs=E2=80=9D files, describing the closure = of the given store items. I gave it a stab and ended up with the attached patch, which Works For Me=E2=84=A2 and is not unreasonably ugly to my eye. :-) --8<---------------cut here---------------start------------->8--- $ ./pre-inst-env guix system disk-image -t iso9660 gnu/system/install.scm=20 /gnu/store/5pk71pmjp2yshkh0xdfgsnmaxfvdsms1-image.iso ludo@ribbon ~/src/guix/+master$ file /gnu/store/5pk71pmjp2yshkh0xdfgsnmaxfv= dsms1-image.iso /gnu/store/5pk71pmjp2yshkh0xdfgsnmaxfvdsms1-image.iso: DOS/MBR boot sector;= GRand Unified Bootloader, stage1 version 0x79, boot drive 0xbb, stage2 add= ress 0x8e70, 1st sector stage2 0xb8db31c3, stage2 segment 0x201 ISO 9660 CD= -ROM filesystem data (DOS/MBR boot sector) 'GUIXSD_IMAGE' (bootable) --8<---------------cut here---------------end--------------->8--- WDYT? Ludo=E2=80=99. --=-=-= Content-Type: text/x-patch Content-Disposition: inline diff --git a/gnu/build/vm.scm b/gnu/build/vm.scm index 086f38ade..305df5933 100644 --- a/gnu/build/vm.scm +++ b/gnu/build/vm.scm @@ -76,11 +76,13 @@ (qemu (qemu-command)) (memory-size 512) linux initrd make-disk-image? + single-file-output? (disk-image-size (* 100 (expt 2 20))) (disk-image-format "qcow2") (references-graphs '())) "Run BUILDER, a Scheme file, into a VM running LINUX with INITRD, and copy -the result to OUTPUT. +the result to OUTPUT. Unless SINGLE-FILE-OUTPUT? is true, the result is +copied recursively to OUTPUT. When MAKE-DISK-IMAGE? is true, OUTPUT will contain a VM image of DISK-IMAGE-SIZE bytes resulting from the execution of BUILDER, which may @@ -137,8 +139,14 @@ the #:references-graphs parameter of 'derivation'." ;; When MAKE-DISK-IMAGE? is true, the image is in OUTPUT already. (unless make-disk-image? - (mkdir output) - (copy-recursively "xchg" output))) + (if single-file-output? + (let ((graph? (lambda (name stat) + (member (basename name) references-graphs)))) + (copy-file (first (find-files "xchg" (negate graph?))) + output)) + (begin + (mkdir output) + (copy-recursively "xchg" output))))) ;;; @@ -356,7 +364,7 @@ SYSTEM-DIRECTORY is the name of the directory of the 'system' derivation." (define* (make-iso9660-image grub config-file os-drv target #:key (volume-id "GuixSD_image") (volume-uuid #f)) "Given a GRUB package, creates an iso image as TARGET, using CONFIG-FILE as -Grub configuration and OS-DRV as the stuff in it." +GRUB configuration and OS-DRV as the stuff in it." (let ((grub-mkrescue (string-append grub "/bin/grub-mkrescue"))) (mkdir-p "/tmp/root/var/run") (mkdir-p "/tmp/root/run") diff --git a/gnu/system/vm.scm b/gnu/system/vm.scm index ec3fb031a..45006b2ba 100644 --- a/gnu/system/vm.scm +++ b/gnu/system/vm.scm @@ -108,16 +108,18 @@ (guile-for-build (%guile-for-build)) + (single-file-output? #f) (make-disk-image? #f) (references-graphs #f) (memory-size 256) (disk-image-format "qcow2") (disk-image-size 'guess)) "Evaluate EXP in a QEMU virtual machine running LINUX with INITRD (a -derivation). In the virtual machine, EXP has access to all its inputs from the -store; it should put its output files in the `/xchg' directory, which is -copied to the derivation's output when the VM terminates. The virtual machine -runs with MEMORY-SIZE MiB of memory. +derivation). In the virtual machine, EXP has access to all its inputs from +the store; it should put its output files in the `/xchg' directory, which is +copied to the derivation's output when the VM terminates, recursively, unless +SINGLE-FILE-OUTPUT? is true. The virtual machine runs with MEMORY-SIZE MiB of +memory. When MAKE-DISK-IMAGE? is true, then create a QEMU disk image of type DISK-IMAGE-FORMAT (e.g., 'qcow2' or 'raw'), of DISK-IMAGE-SIZE bytes and @@ -167,6 +169,7 @@ made available under the /xchg CIFS share." #:linux linux #:initrd initrd #:memory-size #$memory-size #:make-disk-image? #$make-disk-image? + #:single-file-output? #$single-file-output? #:disk-image-format #$disk-image-format #:disk-image-size size #:references-graphs graphs))))) @@ -222,6 +225,7 @@ INPUTS is a list of inputs (as for packages)." (reboot)))) #:system system #:make-disk-image? #f + #:single-file-output? #t #:references-graphs inputs)) (define* (qemu-image #:key diff --git a/guix/scripts/system.scm b/guix/scripts/system.scm index 65dd92e8b..0fcb6a9b0 100644 --- a/guix/scripts/system.scm +++ b/guix/scripts/system.scm @@ -579,8 +579,12 @@ PATTERN, a string. When PATTERN is #f, display all the system generations." (* 70 (expt 2 20))) #:mappings mappings)) ((disk-image) - (system-disk-image os #:disk-image-size image-size - #:file-system-type file-system-type)))) + (system-disk-image os + #:name (match file-system-type + ("iso9660" "image.iso") + (_ "disk-image")) + #:disk-image-size image-size + #:file-system-type file-system-type)))) (define (maybe-suggest-running-guix-pull) "Suggest running 'guix pull' if this has never been done before." --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Tue Jul 18 10:31:06 2017 Received: (at 27661-done) by debbugs.gnu.org; 18 Jul 2017 14:31:07 +0000 Received: from localhost ([127.0.0.1]:46710 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXTWk-0005iR-O1 for submit@debbugs.gnu.org; Tue, 18 Jul 2017 10:31:06 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:57452) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXTWi-0005iI-67 for 27661-done@debbugs.gnu.org; Tue, 18 Jul 2017 10:31:04 -0400 Received: from localhost (178.113.167.130.wireless.dyn.drei.com [178.113.167.130]) by dd1012.kasserver.com (Postfix) with ESMTPSA id CAF901CA02BE; Tue, 18 Jul 2017 16:31:01 +0200 (CEST) Date: Tue, 18 Jul 2017 16:30:56 +0200 From: Danny Milosavljevic To: ludo@gnu.org (Ludovic =?ISO-8859-1?Q?Court=E8s?=) Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170718163056.77452560@scratchpost.org> In-Reply-To: <87o9shyjry.fsf@gnu.org> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714093021.1b162844@scratchpost.org> <87bmojfp6i.fsf@gnu.org> <20170717212837.10c1d0b3@scratchpost.org> <87o9shyjry.fsf@gnu.org> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Hi Ludo, On Tue, 18 Jul 2017 15:08:49 +0200 ludo@gnu.org (Ludovic Court=C3=A8s) wrot= e: >--- a/gnu/build/vm.scm >+the result to OUTPUT. Unless SINGLE-FILE-OUTPUT? is true, the result is >+copied recursively to OUTPUT. What happens when SINGLE-FILE-OUTPUT? is true? :) I'd say something like, If SINGLE-FILE-OUTPUT? is true, copy a single file from /xchg to OUTPUT. Otherwise, copy the contents of /xchg to a new directory OUTPUT. >+ (if single-file-output? >+ (let ((graph? (lambda (name stat) >+ (member (basename name) references-graphs)))) >+ (copy-file (first (find-files "xchg" (negate graph?))) Maybe raise error when there's more than one possibility? >+derivation). In the virtual machine, EXP has access to all its inputs fr= om >+the store; it should put its output files in the `/xchg' directory, which= is >+copied to the derivation's output when the VM terminates, recursively, un= less >+SINGLE-FILE-OUTPUT? is true.=20 What if it's true? >+++ b/guix/scripts/system.scm [...] >+ (system-disk-image os >+ #:name (match file-system-type >+ ("iso9660" "image.iso") >+ (_ "disk-image")) If we called it "disk-image" in the iso9660 case as well we'd not have this= special case. Do we want to? Overall LGTM! From debbugs-submit-bounces@debbugs.gnu.org Tue Jul 18 16:57:42 2017 Received: (at 27661-done) by debbugs.gnu.org; 18 Jul 2017 20:57:42 +0000 Received: from localhost ([127.0.0.1]:46970 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXZYs-0008Bj-EY for submit@debbugs.gnu.org; Tue, 18 Jul 2017 16:57:42 -0400 Received: from eggs.gnu.org ([208.118.235.92]:47248) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dXZYr-0008BX-1W for 27661-done@debbugs.gnu.org; Tue, 18 Jul 2017 16:57:41 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dXZYh-0007KF-28 for 27661-done@debbugs.gnu.org; Tue, 18 Jul 2017 16:57:35 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=BAYES_40,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:59043) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dXZYg-0007K1-V2; Tue, 18 Jul 2017 16:57:30 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:43990 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1dXZYg-00005K-Dx; Tue, 18 Jul 2017 16:57:30 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Danny Milosavljevic Subject: Re: [bug#27661] ISO-9660 image working and ready References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714093021.1b162844@scratchpost.org> <87bmojfp6i.fsf@gnu.org> <20170717212837.10c1d0b3@scratchpost.org> <87o9shyjry.fsf@gnu.org> <20170718163056.77452560@scratchpost.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 30 Messidor an 225 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Tue, 18 Jul 2017 22:57:27 +0200 In-Reply-To: <20170718163056.77452560@scratchpost.org> (Danny Milosavljevic's message of "Tue, 18 Jul 2017 16:30:56 +0200") Message-ID: <87pocxo43s.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27661-done Cc: Marius Bakke , 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Danny Milosavljevic skribis: > On Tue, 18 Jul 2017 15:08:49 +0200 ludo@gnu.org (Ludovic Court=C3=A8s) wr= ote: >>--- a/gnu/build/vm.scm >>+the result to OUTPUT. Unless SINGLE-FILE-OUTPUT? is true, the result is >>+copied recursively to OUTPUT. > > What happens when SINGLE-FILE-OUTPUT? is true? :) > > I'd say something like, > > If SINGLE-FILE-OUTPUT? is true, copy a single file from /xchg to OUTPUT. > Otherwise, copy the contents of /xchg to a new directory OUTPUT. > >>+ (if single-file-output? >>+ (let ((graph? (lambda (name stat) >>+ (member (basename name) references-graphs)))) >>+ (copy-file (first (find-files "xchg" (negate graph?))) > > Maybe raise error when there's more than one possibility? > >>+derivation). In the virtual machine, EXP has access to all its inputs f= rom >>+the store; it should put its output files in the `/xchg' directory, whic= h is >>+copied to the derivation's output when the VM terminates, recursively, u= nless >>+SINGLE-FILE-OUTPUT? is true.=20 > > What if it's true? All good points, indeed. Pushed with these changes as 8d033e3e1607d5722ef7288208551d0331c8a853. >>+++ b/guix/scripts/system.scm > [...] >>+ (system-disk-image os >>+ #:name (match file-system-type >>+ ("iso9660" "image.iso") >>+ (_ "disk-image")) > > If we called it "disk-image" in the iso9660 case as well we'd not have th= is special case. Do we want to? I find it marginally nicer to have an explicit =E2=80=9C.iso=E2=80=9D suffi= x. I pushed this part as 5058bf56843baf3c0d82fbf0addbb30f00572428. Thank you! Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Thu Jul 20 13:22:52 2017 Received: (at 27661-done) by debbugs.gnu.org; 20 Jul 2017 17:22:52 +0000 Received: from localhost ([127.0.0.1]:49962 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dYFA4-0002uP-2x for submit@debbugs.gnu.org; Thu, 20 Jul 2017 13:22:52 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:51346) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dYFA2-0002uH-Em for 27661-done@debbugs.gnu.org; Thu, 20 Jul 2017 13:22:50 -0400 Received: from localhost (178.113.137.192.wireless.dyn.drei.com [178.113.137.192]) by dd1012.kasserver.com (Postfix) with ESMTPSA id ED26B1CA027A; Thu, 20 Jul 2017 19:22:48 +0200 (CEST) Date: Thu, 20 Jul 2017 19:22:44 +0200 From: Danny Milosavljevic To: adam@vany.ca Subject: Re: [bug#27661] ISO-9660 image working and ready Message-ID: <20170720192244.002d6e6a@scratchpost.org> In-Reply-To: <20170717110434.1576628d@scratchpost.org> References: <87d195etic.fsf@gnu.org> <20170712134405.25274-1-dannym@scratchpost.org> <87inixd9z1.fsf@gnu.org> <20170712192827.22b7c740@scratchpost.org> <87eftkjhhd.fsf@fastmail.com> <20170714095521.10045e44@scratchpost.org> <8760erfp23.fsf@gnu.org> <20170717110434.1576628d@scratchpost.org> X-Mailer: Claws Mail 3.15.0-dirty (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27661-done Cc: 27661-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Hi, Adam Van Ymeren wrote on Mon, 17 Jul 2017 22:34:34 -0400: >No luck booting the prodced guixsd.iso burned to a DVD on my UEFI system. It does boot fine if I disable UEFI boot. >That being said, it's possible that my system just doesn't supporting booting from DVDs in UEFI mode. I'm going to try to rule that out by finding some other iso reported to work on UEFI systems. Hmm, was that with patches from bug# 27695 (grub-hybrid-bootloader) or with patches from bug# 27705 (grub-efi patched to include some grub-pc files) ? From unknown Mon Aug 18 06:57:51 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 18 Aug 2017 11:24:05 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator