GNU bug report logs - #60373
Kernel job for Cuirass

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 60373 in the body.
You can then email your comments to 60373 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: guix-patches <at> gnu.org
Subject: Kernel job for Cuirass
Date: Tue, 27 Dec 2022 21:22:48 -0500

[Message part 1 (text/plain, inline)]

Here are some patches to create a 'kernel-updates' Cuirass
specification, so that CI will build kernel-related things based on
changes to a kernel-updates Git branch.

The first patch creates a manifest of packages named "linux-libre-*" for
the Guix source tree, and the second patch creates the Cuirass spec for
maintenance.git.

I can test the manifest with `guix weather`, but I'm not sure how to
test the Cuirass spec.

Advice is welcome!

[signature.asc (application/pgp-signature, inline)]

Message #8 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: 60373 <at> debbugs.gnu.org
Subject: [PATCH] maint: Add a manifest for everything related to linux-libre.
Date: Tue, 27 Dec 2022 21:25:29 -0500

* etc/kernels-manifest.scm: New file.
* Makefile.am (EXTRA_DIST): Add it.
---
 Makefile.am              |  1 +
 etc/kernels-manifest.scm | 35 +++++++++++++++++++++++++++++++++++
 2 files changed, 36 insertions(+)
 create mode 100644 etc/kernels-manifest.scm

diff --git a/Makefile.am b/Makefile.am
index b54288c0fc..8b026b6da6 100644
--- a/Makefile.am
+++ b/Makefile.am
@@ -689,6 +689,7 @@ EXTRA_DIST +=						\
   etc/guix-install.sh					\
   etc/historical-authorizations				\
   etc/news.scm						\
+  etc/kernels-manifest.scm				\
   etc/release-manifest.scm				\
   etc/source-manifest.scm				\
   etc/system-tests.scm					\
diff --git a/etc/kernels-manifest.scm b/etc/kernels-manifest.scm
new file mode 100644
index 0000000000..6f1b31abb3
--- /dev/null
+++ b/etc/kernels-manifest.scm
@@ -0,0 +1,35 @@
+;;; GNU Guix --- Functional package management for GNU
+;;; Copyright © 2022 Leo Famulari <leo <at> famulari.name>
+;;;
+;;; This file is part of GNU Guix.
+;;;
+;;; GNU Guix is free software; you can redistribute it and/or modify it
+;;; under the terms of the GNU General Public License as published by
+;;; the Free Software Foundation; either version 3 of the License, or (at
+;;; your option) any later version.
+;;;
+;;; GNU Guix is distributed in the hope that it will be useful, but
+;;; WITHOUT ANY WARRANTY; without even the implied warranty of
+;;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+;;; GNU General Public License for more details.
+;;;
+;;; You should have received a copy of the GNU General Public License
+;;; along with GNU Guix.  If not, see <http://www.gnu.org/licenses/>.
+
+;;; This file returns a manifest of packages related to linux-libre.
+;;; Specifically, it selects packages whose names begin with "linux-libre-".
+;;; It is used to assist continuous integration of the kernel packages.
+
+(use-modules (gnu packages)
+             (guix packages)
+             (guix profiles))
+
+(manifest
+  (map package->manifest-entry
+       (fold-packages
+         (lambda (package lst)
+           (if (string-prefix? "linux-libre-"
+                               (package-name package))
+             (cons package lst)
+             lst))
+         '())))
-- 
2.38.1

Message #11 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: 60373 <at> debbugs.gnu.org
Subject: [PATCH] hydra: cuirass: Add 'kernel-updates' jobset.
Date: Tue, 27 Dec 2022 21:29:24 -0500

Can the build field actually contain this kind of list?

Should it contain system-tests? Normally they only run on x86_64, but
this would run them for all systems.

* hydra/modules/sysadmin/services.scm (cuirass-specs): Add
'kernel-updates' jobset.
---
 hydra/modules/sysadmin/services.scm | 9 +++++++++
 1 file changed, 9 insertions(+)

diff --git a/hydra/modules/sysadmin/services.scm b/hydra/modules/sysadmin/services.scm
index d0c5b24..8d143ad 100644
--- a/hydra/modules/sysadmin/services.scm
+++ b/hydra/modules/sysadmin/services.scm
@@ -2,6 +2,7 @@
 ;;;
 ;;; Copyright © 2016-2022 Ludovic Courtès <ludo <at> gnu.org>
 ;;; Copyright © 2017, 2018, 2020, 2022 Ricardo Wurmus <rekado <at> elephly.net>
+;;; Copyright © 2022 Leo Famulari <leo <at> famulari.name>
 ;;;
 ;;; This program is free software: you can redistribute it and/or modify
 ;;; it under the terms of the GNU General Public License as published by
@@ -347,6 +348,14 @@
                         (branch "core-updates"))))
                 (priority 4)
                 (systems '#$systems)))
+            #~())
+     #$@(if (member "kernel-updates" branches)
+            #~((specification
+                (name "kernel-updates")
+                (build '(images system-tests (manifests "etc/kernels-manifest.scm")))
+                (period 7200)
+                (priority 2)
+                (systems '#$systems)))
             #~())))
 
 
-- 
2.38.1

Message #14 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Mathieu Othacehe <othacehe <at> gnu.org>
To: Leo Famulari <leo <at> famulari.name>
Cc: 60373 <at> debbugs.gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Wed, 28 Dec 2022 15:35:18 +0100

Hey Leo,

Good initiative!

> Can the build field actually contain this kind of list?

No sadly it cannot right now. That would require to edit a bit the (gnu
ci) module in Guix so that it allows a list of things to be built
instead of individual subsets. Then a thing or two would need to be
adjusted in Cuirass as well.

> Should it contain system-tests? Normally they only run on x86_64, but
> this would run them for all systems.

What you could do instead is something like:

--8<---------------cut here---------------start------------->8---
((specification
   (name "kernel-updates")
   (build '(manifests "etc/kernels-manifest.scm"))
   (period 7200)
   (priority 2)
   (systems '#$systems))
 (specification
   (name "kernel-updates-images")
   (build 'images)
   (period 7200)
   (priority 2)
   (systems '#$systems))
 (specification
   (name "kernel-updates-tests")
   (build 'system-tests)
   (period 7200)
   (priority 2)
   (systems '("x86_64-linux"))))
--8<---------------cut here---------------end--------------->8---

Then we could think about supporting multiple build subsets.

WDYT?

Thanks,

Mathieu

Message #17 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Wed, 28 Dec 2022 17:50:13 -0500

[Message part 1 (text/plain, inline)]

On Wed, Dec 28, 2022 at 03:35:18PM +0100, Mathieu Othacehe wrote:
> What you could do instead is something like:
> 
> --8<---------------cut here---------------start------------->8---
> ((specification
>    (name "kernel-updates")
>    (build '(manifests "etc/kernels-manifest.scm"))
>    (period 7200)
>    (priority 2)
>    (systems '#$systems))
>  (specification
>    (name "kernel-updates-images")
>    (build 'images)
>    (period 7200)
>    (priority 2)
>    (systems '#$systems))
>  (specification
>    (name "kernel-updates-tests")
>    (build 'system-tests)
>    (period 7200)
>    (priority 2)
>    (systems '("x86_64-linux"))))
> --8<---------------cut here---------------end--------------->8---

That's perfect! I've attached an updated patch.

> Then we could think about supporting multiple build subsets.

Well, your suggested workaround is great, so it's not necessary to add
the functionality.

What's the procedure for making these changes? I can push to guix.git
and maintenance.git, but I'll need assistance putting the changes into
practice.

[v2-0001-hydra-cuirass-Add-jobsets-for-testing-kernel-upda.patch (text/plain, attachment)]

[signature.asc (application/pgp-signature, inline)]

Message #20 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: 60373 <at> debbugs.gnu.org
Subject: [PATCH v2] maint: Add a manifest for everything related to
 linux-libre.
Date: Wed, 28 Dec 2022 17:54:24 -0500

* etc/kernels-manifest.scm: New file.
* Makefile.am (EXTRA_DIST): Add it.
---
 Makefile.am              |  1 +
 etc/kernels-manifest.scm | 35 +++++++++++++++++++++++++++++++++++
 2 files changed, 36 insertions(+)
 create mode 100644 etc/kernels-manifest.scm

diff --git a/Makefile.am b/Makefile.am
index b54288c0fc..8b026b6da6 100644
--- a/Makefile.am
+++ b/Makefile.am
@@ -689,6 +689,7 @@ EXTRA_DIST +=						\
   etc/guix-install.sh					\
   etc/historical-authorizations				\
   etc/news.scm						\
+  etc/kernels-manifest.scm				\
   etc/release-manifest.scm				\
   etc/source-manifest.scm				\
   etc/system-tests.scm					\
diff --git a/etc/kernels-manifest.scm b/etc/kernels-manifest.scm
new file mode 100644
index 0000000000..5fc4f52f2b
--- /dev/null
+++ b/etc/kernels-manifest.scm
@@ -0,0 +1,35 @@
+;;; GNU Guix --- Functional package management for GNU
+;;; Copyright © 2022 Leo Famulari <leo <at> famulari.name>
+;;;
+;;; This file is part of GNU Guix.
+;;;
+;;; GNU Guix is free software; you can redistribute it and/or modify it
+;;; under the terms of the GNU General Public License as published by
+;;; the Free Software Foundation; either version 3 of the License, or (at
+;;; your option) any later version.
+;;;
+;;; GNU Guix is distributed in the hope that it will be useful, but
+;;; WITHOUT ANY WARRANTY; without even the implied warranty of
+;;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+;;; GNU General Public License for more details.
+;;;
+;;; You should have received a copy of the GNU General Public License
+;;; along with GNU Guix.  If not, see <http://www.gnu.org/licenses/>.
+
+;;; This file returns a manifest of packages related to linux-libre.
+;;; Simplistically, it selects packages whose names begin with "linux-libre".
+;;; It is used to assist continuous integration of the kernel packages.
+
+(use-modules (gnu packages)
+             (guix packages)
+             (guix profiles))
+
+(manifest
+  (map package->manifest-entry
+       (fold-packages
+         (lambda (package lst)
+           (if (string-prefix? "linux-libre"
+                               (package-name package))
+             (cons package lst)
+             lst))
+         '())))
-- 
2.38.1

Message #23 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Mathieu Othacehe <othacehe <at> gnu.org>
To: Leo Famulari <leo <at> famulari.name>
Cc: 60373 <at> debbugs.gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Thu, 29 Dec 2022 11:33:37 +0100

Hey,

> What's the procedure for making these changes? I can push to guix.git
> and maintenance.git, but I'll need assistance putting the changes into
> practice.

You can go ahead and I'll take care of reconfiguring Berlin. If you
prefer to do it by yourself, the procedure is the following:

- Log in on Berlin
- Checkout the latest maintenance repository in your home
- Run guix pull
- Run sudo -E guix system reconfigure ~/maintenance/hydra/berlin.scm -L
~/maintenance/hydra/modules/
- Notify sysadmins about the reconfiguration

Thanks,

Mathieu

Message #26 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Thu, 29 Dec 2022 13:54:09 -0500

[Message part 1 (text/plain, inline)]

On Thu, Dec 29, 2022 at 11:33:37AM +0100, Mathieu Othacehe wrote:
> You can go ahead and I'll take care of reconfiguring Berlin. If you
> prefer to do it by yourself, the procedure is the following:

Thanks, I pushed to guix.git and maintenance.git. Can you do the rest?
I'm not free to spend much time on it today.

[signature.asc (application/pgp-signature, inline)]

Message #29 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Wed, 4 Jan 2023 22:48:43 -0500

On Thu, Dec 29, 2022 at 11:33:37AM +0100, Mathieu Othacehe wrote:
> You can go ahead and I'll take care of reconfiguring Berlin. If you
> prefer to do it by yourself, the procedure is the following:
> 
> - Log in on Berlin
> - Checkout the latest maintenance repository in your home
> - Run guix pull
> - Run sudo -E guix system reconfigure ~/maintenance/hydra/berlin.scm -L
> ~/maintenance/hydra/modules/
> - Notify sysadmins about the reconfiguration

Okay, I've gone ahead and reconfigured berlin based on maintenance.git
commit 97cbea05bfc53e8d3fba1d2e1455dda8237eb3c0.

It's not clear to me if I need to restart any services now in order to
make my new Cuirass jobsets effective. A few services were restarted
automatically:

------
[...]
shepherd: Service host-name has been started.
shepherd: Service user-homes has been started.
shepherd: Service sysctl has been started.
shepherd: Service postgres-roles has been started.
[...]
------

Message #32 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Mathieu Othacehe <othacehe <at> gnu.org>
To: Leo Famulari <leo <at> famulari.name>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Thu, 05 Jan 2023 18:37:40 +0100

Hello Leo,

> Okay, I've gone ahead and reconfigured berlin based on maintenance.git
> commit 97cbea05bfc53e8d3fba1d2e1455dda8237eb3c0.

Thanks for taking care of it. I added
0fad0d2cc4e7e440e80bcbcc519184a7a9111347 to the maintenance repository
because "kernel-updates" was not part of the default branches and
reconfigured.

I then restarted the "cuirass" service which is required to install the
new specifications. They are now listed in the web interface. Lets see
if they can be evaluated now ;)

Mathieu

Message #35 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Thu, 5 Jan 2023 20:19:41 -0500

On Thu, Jan 05, 2023 at 06:37:40PM +0100, Mathieu Othacehe wrote:
> Thanks for taking care of it. I added
> 0fad0d2cc4e7e440e80bcbcc519184a7a9111347 to the maintenance repository
> because "kernel-updates" was not part of the default branches and
> reconfigured.

Thanks for your help!

> I then restarted the "cuirass" service which is required to install the
> new specifications. They are now listed in the web interface. Lets see
> if they can be evaluated now ;)

I just pushed to the kernel-updates branch. Now watching the Cuirass web
interface to see how it goes :)

Message #38 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Thu, 5 Jan 2023 22:00:18 -0500

On Thu, Jan 05, 2023 at 08:19:41PM -0500, Leo Famulari wrote:
> I just pushed to the kernel-updates branch. Now watching the Cuirass web
> interface to see how it goes :)

It doesn't look like the kernel-updates job is working right:

https://ci.guix.gnu.org/jobset/kernel-updates

I confirmed the substitutes aren't available on the server.

The images seem to be failing often, but not exclusively on the
kernel-updates branch:

https://ci.guix.gnu.org/jobset/kernel-updates-images
https://ci.guix.gnu.org/jobset/images

Message #41 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Fri, 6 Jan 2023 00:33:39 -0500

On Thu, Jan 05, 2023 at 10:00:18PM -0500, Leo Famulari wrote:
> It doesn't look like the kernel-updates job is working right:
> 
> https://ci.guix.gnu.org/jobset/kernel-updates

I think some modules were missing from kernels-manifest.scm. I added
them in commit 8be0a97a8139fdd4d196092008b98668f1a8b2bb, reconfigured,
and restarted Cuirass.

Message #44 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Fri, 6 Jan 2023 01:27:59 -0500

On Fri, Jan 06, 2023 at 12:33:39AM -0500, Leo Famulari wrote:
> I think some modules were missing from kernels-manifest.scm. I added
> them in commit 8be0a97a8139fdd4d196092008b98668f1a8b2bb, reconfigured,
> and restarted Cuirass.

It didn't help, unfortunately.

Message #47 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Mathieu Othacehe <othacehe <at> gnu.org>
To: Leo Famulari <leo <at> famulari.name>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Sat, 07 Jan 2023 15:47:08 +0100

Hello,

> It doesn't look like the kernel-updates job is working right:
>
> https://ci.guix.gnu.org/jobset/kernel-updates

That's because of a typo fixed on the maintenance repository with:
fa9b904b7b7cc9ccacb4ff1bfcfe92d6266b5f05.

Is it not advertised anywhere but there is a way to test that. You can
modify the following file:

--8<---------------cut here---------------start------------->8---
--- a/build-aux/cuirass/evaluate.scm
+++ b/build-aux/cuirass/evaluate.scm
@@ -96,7 +96,9 @@ (define derivation
                             inferior store
                             `(lambda (store)
                                (cuirass-jobs store
-                                             '((subset . all)
+                                             '((subset
+                                                . (manifests
+                                                   "etc/kernels-manifest.scm"))
--8<---------------cut here---------------end--------------->8---

then run `make cuirass-jobs` and the computed derivations will be
printed in the cuirass-jobs/jobs-<system>.scm files.

> The images seem to be failing often, but not exclusively on the
> kernel-updates branch:
>
> https://ci.guix.gnu.org/jobset/kernel-updates-images
> https://ci.guix.gnu.org/jobset/images

Yes, same for the tests, it is very likely of this issue:
https://issues.guix.gnu.org/48468, which is under investigation.

Thanks,

Mathieu

Message #50 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Mathieu Othacehe <othacehe <at> gnu.org>
To: Leo Famulari <leo <at> famulari.name>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Sat, 07 Jan 2023 15:50:14 +0100

Hey Leo,

> I think some modules were missing from kernels-manifest.scm. I added
> them in commit 8be0a97a8139fdd4d196092008b98668f1a8b2bb, reconfigured,
> and restarted Cuirass.

Note that in that specific case, i.e modifying a manifest that is part
of Guix, it is not necessary to reconfigure Berlin.

The reason is that Cuirass role is to checkout the latest Guix then
evaluate the etc/kernel-manifest.scm file in an inferior, and build the
resulting derivations.

In that case, pushing the edited manifest to Guix's git then waiting for
the next evaluation of the specification is enough :)

Thanks,

Mathieu

Message #53 received at 60373 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mathieu Othacehe <othacehe <at> gnu.org>
Cc: 60373 <at> debbugs.gnu.org, guix-sysadmin <at> gnu.org
Subject: Re: bug#60373: Kernel job for Cuirass
Date: Sat, 7 Jan 2023 13:38:52 -0500

On Sat, Jan 07, 2023 at 03:47:08PM +0100, Mathieu Othacehe wrote:
> That's because of a typo fixed on the maintenance repository with:
> fa9b904b7b7cc9ccacb4ff1bfcfe92d6266b5f05.

🤦 Thank you Mathieu!

> 
> Is it not advertised anywhere but there is a way to test that. You can
> modify the following file:
> 
> --8<---------------cut here---------------start------------->8---
> --- a/build-aux/cuirass/evaluate.scm
> +++ b/build-aux/cuirass/evaluate.scm
> @@ -96,7 +96,9 @@ (define derivation
>                              inferior store
>                              `(lambda (store)
>                                 (cuirass-jobs store
> -                                             '((subset . all)
> +                                             '((subset
> +                                                . (manifests
> +                                                   "etc/kernels-manifest.scm"))
> --8<---------------cut here---------------end--------------->8---
> 
> then run `make cuirass-jobs` and the computed derivations will be
> printed in the cuirass-jobs/jobs-<system>.scm files.

Awesome, I will try it out.

> > The images seem to be failing often, but not exclusively on the
> > kernel-updates branch:
> >
> > https://ci.guix.gnu.org/jobset/kernel-updates-images
> > https://ci.guix.gnu.org/jobset/images
> 
> Yes, same for the tests, it is very likely of this issue:
> https://issues.guix.gnu.org/48468, which is under investigation.

Yes, I found these issues later. I hope we can solve them soon!

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.