From unknown Mon Jun 23 07:51:51 2025 X-Loop: help-debbugs@gnu.org Subject: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources Resent-From: Maxim Cournoyer Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 23 Oct 2023 02:58:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 66692 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 66692@debbugs.gnu.org X-Debbugs-Original-To: bug-guix Received: via spool by submit@debbugs.gnu.org id=B.169802986932381 (code B ref -1); Mon, 23 Oct 2023 02:58:02 +0000 Received: (at submit) by debbugs.gnu.org; 23 Oct 2023 02:57:49 +0000 Received: from localhost ([127.0.0.1]:48682 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qul8X-0008QB-4H for submit@debbugs.gnu.org; Sun, 22 Oct 2023 22:57:49 -0400 Received: from lists.gnu.org ([2001:470:142::17]:35800) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qul8T-0008Pw-18 for submit@debbugs.gnu.org; Sun, 22 Oct 2023 22:57:47 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qul7v-00031A-0r for bug-guix@gnu.org; Sun, 22 Oct 2023 22:57:11 -0400 Received: from mail-qv1-xf36.google.com ([2607:f8b0:4864:20::f36]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qul7t-0007ZP-Db for bug-guix@gnu.org; Sun, 22 Oct 2023 22:57:10 -0400 Received: by mail-qv1-xf36.google.com with SMTP id 6a1803df08f44-66cfef11a25so15713746d6.3 for ; Sun, 22 Oct 2023 19:57:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1698029827; x=1698634627; darn=gnu.org; h=mime-version:message-id:date:subject:to:from:from:to:cc:subject :date:message-id:reply-to; bh=GwvlMMRu8R357lIrpVQrQFPS3ekQMVJWcqCg/pHoACw=; b=NY0Cfzp+f0ac3vZ4ojUfKNvfa8Al8z6gR/Zy9j5CyJmnCGPg0CmlL3/e5f8WUjvfsd iKXFbQqMlOq8jMC5VxA0gHk+cbBqEJon3v5O7tcqf73SqTcnNtpnAlp+6COr3DlzQdXb jsLBiGhmJMrMqAQKnzi4aO4E5o6mzfECb8PJpm3Ouwm+xtUsdX4w9l9QLkRkmy67VNc2 rQGrffsZxkDfo3ku6UBFZihHNfNzSCIV7hDU06cD6GA97b8jx2uDRzXyLkY4IgQHU8Ox XYSql3rbu4jremQxMgRd8JVlsO6Nx5YTaydIjTEsOW2y0H0W/jUKMMAW1NG5apx9ujkB ZG9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698029827; x=1698634627; h=mime-version:message-id:date:subject:to:from:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=GwvlMMRu8R357lIrpVQrQFPS3ekQMVJWcqCg/pHoACw=; b=NlE1H3gpdaAvXz+JhUx++3/msJ2rEIuy7rcUCNW2nb8o0U1YsXLQTUsJxBhW9a70qx 9z07P3cyciWdHP4gVycw8zFn1qP6+4+S3DZkkOGbvb4O/mw5EurZ5xIjCbsabVneQHUZ GVPiNzyWMgORJOSfmmNHY3uZcfGct7dqzxPDY5/lxvo778DUxuNhYAgSlG9Ms9ji0PPi iSwdMCxca7QzxK7yni0bNL4W/7MGceUyvFnTCgNdiOy9JwdadaH5M41G9j+VWLkG2Brj EDXmcQ+BBG+on6W0hNZbgW57lphGM6Xc5zoU/SwnpVJaFCG/96uS8nEieMgM51t0CLix 0bYA== X-Gm-Message-State: AOJu0YwtlX1c5fMovlqdJzl1nAC+wx9uJ88oj2YrkWGRNF92QUf0KyeW Xv77srHXQS44a6xof/teJKnL8Byl5N8dhA== X-Google-Smtp-Source: AGHT+IEHo6znQN8uAxWU0Z77Y+0CGFK+/w2pcJ5FnYIyAdIvCyI534IoYXP94fHvrfvyx/L9Y6BY7A== X-Received: by 2002:a05:622a:11d4:b0:41b:8416:ea2a with SMTP id n20-20020a05622a11d400b0041b8416ea2amr8814758qtk.40.1698029827581; Sun, 22 Oct 2023 19:57:07 -0700 (PDT) Received: from hurd (dsl-205-236-230-191.b2b2c.ca. [205.236.230.191]) by smtp.gmail.com with ESMTPSA id jd26-20020a05622a719a00b003f6ac526568sm2419430qtb.39.2023.10.22.19.57.06 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 22 Oct 2023 19:57:07 -0700 (PDT) From: Maxim Cournoyer Date: Sun, 22 Oct 2023 22:57:06 -0400 Message-ID: <87ttqi82rh.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2607:f8b0:4864:20::f36; envelope-from=maxim.cournoyer@gmail.com; helo=mail-qv1-xf36.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hi, I've noticed build failure events from Cuirass such as: --8<---------------cut here---------------start------------->8--- . [ ?: Cuirass ] Build u-boot-sifive-unmatched.x86_64-linux on master is broken. R. [ ?: Cuirass ] Build u-boot-am335x-boneblack.x86_64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-a20-olinuxino-lime.x86_64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-wandboard.powerpc64le-linux on master is broken. . [ ?: Cuirass ] Build u-boot-qemu-riscv64-smode.aarch64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-rpi-2-efi.powerpc64le-linux on master is broken. . [ ?: Cuirass ] Build u-boot-qemu-arm.x86_64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-rpi-2.x86_64-linux on master is broken. --8<---------------cut here---------------end--------------->8--- There are a few more, and they were triggered by applying a patch (that only touches the patman tool) in this commit: . The build failures are not captured in the logs, which appear truncated, e.g. from (log empty -- builder: sjd-p9, worker N38vG7OW) or from (builder: hydra-guix-107, worker 4CWieLpQ) which ends with: --8<---------------cut here---------------start------------->8--- /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_fixsfsi_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_fixsfsi.visT /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_fixunssfsi_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_fixunssfsi.visT mv -f _arm_truncdfsf2.visT _arm_truncdfsf2.vis /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_floatdidf_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_floatdidf.visT mv -f _arm_negsf2.visT _arm_negsf2.vis mv -f _arm_addsubsf3.visT _arm_addsubsf3.vis /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_floatdisf_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_floatdisf.visT /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_floatundi --8<---------------cut here---------------end--------------->8--- These appear to be some problem with the CI software (probably not hardware, as many workers across different architectures suffered the same problem) rather than packaging problems. I didn't see anything useful in /var/log/cuirass.log or /var/log/cuirass-remote-worker.log berlin. I haven't checked the logs on the builders. -- Thanks, Maxim From unknown Mon Jun 23 07:51:51 2025 X-Loop: help-debbugs@gnu.org Subject: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 23 Oct 2023 20:51:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66692 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Maxim Cournoyer Cc: 66692@debbugs.gnu.org Received: via spool by 66692-submit@debbugs.gnu.org id=B66692.16980942384761 (code B ref 66692); Mon, 23 Oct 2023 20:51:02 +0000 Received: (at 66692) by debbugs.gnu.org; 23 Oct 2023 20:50:38 +0000 Received: from localhost ([127.0.0.1]:51985 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qv1sj-0001Ei-7P for submit@debbugs.gnu.org; Mon, 23 Oct 2023 16:50:38 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:60262) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qv1sf-0001EO-Tn for 66692@debbugs.gnu.org; Mon, 23 Oct 2023 16:50:35 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qv1s7-0004Hb-Cz; Mon, 23 Oct 2023 16:49:59 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=5xkj3ex/rOWjQRuEPvvx2ebD1zC6rv2TRoeAn0/bTWU=; b=VvV+siyxZA91Kp+i0xIj re97fM9uDqEIqyOK+OMCwDWYUrExFljCsty8ldo+XLX4YLaVJqjVzYRrBhGSQNx72v0mKVSMLqKCS IMngTk1M0DgMEwlziAoFP5OL2NLWGo1NAanAlp+3ZEh+bTNvbsHu4SAhCoYEFc+hNHuMtKvkAX7TS GGFYtsOw26hmRcZZaSIEouWEwIK/3Vn/1w413ex4yQaUVY0mWS2GWVaWsfPXCmL64SkTpB+L99sRF 3/O/c4VP53+1t8iiojdidlSZHBLc1Yo0SR4DjC4PBZ+nfqQFhHZPY9R7mN10vbKu23HaSR23NmS4A 5ctozqRzeBkGuw==; From: Ludovic =?UTF-8?Q?Court=C3=A8s?= In-Reply-To: <87ttqi82rh.fsf@gmail.com> (Maxim Cournoyer's message of "Sun, 22 Oct 2023 22:57:06 -0400") References: <87ttqi82rh.fsf@gmail.com> Date: Mon, 23 Oct 2023 22:49:56 +0200 Message-ID: <87pm15dpxn.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, Maxim Cournoyer skribis: > The build failures are not captured in the logs, which appear truncated, > e.g. from (log empty -- > builder: sjd-p9, worker N38vG7OW)=20 On sjd-p9, I get: --8<---------------cut here---------------start------------->8--- root@sjd-p9:~# journalctl -u cuirass-remote-worker.service |grep -C2 s167lh= 0w0azfxx83ri8k0mn2gj57i5rl Oct 23 00:06:21 sjd-p9 cuirass[531]: N38vG7OW: derivation /gnu/store/kcv6hf= qz94f1vdw24viw7d9ih6v9zi1j-libkmahjongg-23.04.3.drv build succeeded. Oct 23 00:06:21 sjd-p9 cuirass[531]: N38vG7OW: request work. Oct 23 00:06:21 sjd-p9 cuirass[531]: N38vG7OW: building derivation `/gnu/st= ore/s167lh0w0azfxx83ri8k0mn2gj57i5rl-u-boot-rpi-4-32b-2023.07.02.drv' (syst= em: powerpc64le-linux) Oct 23 00:06:32 sjd-p9 cuirass[531]: C2q41fts: ping tcp://10.0.0.1:5555. Oct 23 00:06:32 sjd-p9 cuirass[531]: BrnR2Sju: ping tcp://10.0.0.1:5555. -- Oct 23 00:34:16 sjd-p9 cuirass[531]: vA6cYbb5: request work. Oct 23 00:34:16 sjd-p9 cuirass[531]: vA6cYbb5: building derivation `/gnu/st= ore/lj4h1g1zq235l6i8mjh88s1ylvj7ksxd-u-boot-pine64-plus-2023.07.02.drv' (sy= stem: powerpc64le-linux) Oct 23 00:34:29 sjd-p9 cuirass[531]: N38vG7OW: derivation /gnu/store/s167lh= 0w0azfxx83ri8k0mn2gj57i5rl-u-boot-rpi-4-32b-2023.07.02.drv build failed. Oct 23 00:34:29 sjd-p9 cuirass[531]: N38vG7OW: request work. Oct 23 00:34:29 sjd-p9 cuirass[531]: N38vG7OW: building derivation `/gnu/st= ore/dy8g5pi1gv8dza1av9957ic6zzj4l88j-u-boot-tools-2023.07.02.drv' (system: = powerpc64le-linux) root@sjd-p9:~# guix build --log-file /gnu/store/s167lh0w0azfxx83ri8k0mn2gj5= 7i5rl-u-boot-rpi-4-32b-2023.07.02.drv https://ci.guix.gnu.org/log/0yzfwl2b017gsnf60wvr7dnn2g26wrj7-u-boot-rpi-4-3= 2b-2023.07.02 --8<---------------cut here---------------end--------------->8--- So it looks as though the build was attempted and failed, but there=E2=80= =99s no local build log in /var/log/guix/drvs, meaning that, most likely, no build process was even started. The log of guix-daemon provide few hints: --8<---------------cut here---------------start------------->8--- root@sjd-p9:~# journalctl -u guix-daemon |grep 'Oct 23 00:' [...] Oct 23 00:06:21 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:06:21 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:06:55 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:07:51 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:16:25 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:17:15 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:33:42 sjd-p9 guix-daemon[2097426]: SIGPOLL Oct 23 00:33:42 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:33:49 sjd-p9 guix-daemon[2097426]: unexpected build daemon error:= interrupted by the user Oct 23 00:34:16 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:34:16 sjd-p9 guix-daemon[1990649]: SIGPOLL Oct 23 00:34:23 sjd-p9 guix-daemon[1990649]: unexpected build daemon error:= interrupted by the user Oct 23 00:34:29 sjd-p9 guix-daemon[2052532]: SIGPOLL Oct 23 00:34:29 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:34:30 sjd-p9 guix-daemon[2052532]: unexpected build daemon error:= interrupted by the user Oct 23 00:34:38 sjd-p9 guix-daemon[1996946]: SIGPOLL Oct 23 00:34:38 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:34:38 sjd-p9 guix-daemon[1996946]: unexpected build daemon error:= interrupted by the user Oct 23 00:34:45 sjd-p9 guix-daemon[2248556]: SIGPOLL Oct 23 00:34:45 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:34:45 sjd-p9 guix-daemon[2248556]: unexpected build daemon error:= interrupted by the user Oct 23 00:35:33 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root Oct 23 00:36:46 sjd-p9 guix-daemon[534]: accepted connection from pid 531, = user root --8<---------------cut here---------------end--------------->8--- One possibility would have been that =E2=80=98guix gc=E2=80=99 was running,= preventing the build process from starting (=E2=80=9Cbig GC lock=E2=80=9D taken); howe= ver, if this were the case, we=E2=80=99d see a connection from a different process in the guix-daemon log. > or from (builder: > hydra-guix-107, worker 4CWieLpQ) which ends with: Here we get: --8<---------------cut here---------------start------------->8--- root@hydra-guix-107 ~# grep -C2 jy463789qf42dn4zk5i5jzry2lf82ypy /var/log/c= uirass-remote-worker.log 2023-10-23 00:17:34 vDKeRcHy: no available build. 2023-10-23 00:17:46 4CWieLpQ: request work. 2023-10-23 00:17:46 4CWieLpQ: building derivation `/gnu/store/jy463789qf42d= n4zk5i5jzry2lf82ypy-u-boot-cubietruck-2023.07.02.drv' (system: x86_64-linux) 2023-10-23 00:18:03 zARGXQMa: request work. 2023-10-23 00:18:03 zARGXQMa: no available build. -- 2023-10-23 00:27:35 vDKeRcHy: request work. 2023-10-23 00:27:35 vDKeRcHy: no available build. 2023-10-23 00:27:42 4CWieLpQ: derivation /gnu/store/jy463789qf42dn4zk5i5jzr= y2lf82ypy-u-boot-cubietruck-2023.07.02.drv build failed. 2023-10-23 00:27:42 4CWieLpQ: request work. 2023-10-23 00:27:42 4CWieLpQ: no available build. root@hydra-guix-107 ~# ls /var/log/guix/drvs/*/*u-boot-cubietruck-2023* ls: cannot access '/var/log/guix/drvs/*/*u-boot-cubietruck-2023*': No such = file or directory --8<---------------cut here---------------end--------------->8--- And likewise: --8<---------------cut here---------------start------------->8--- root@hydra-guix-107 ~# grep -C2 '10-23 00:27:' /var/log/guix-daemon.log 2023-10-23 00:17:46 accepted connection from pid 64022, user root 2023-10-23 00:19:34 accepted connection from pid 64022, user root 2023-10-23 00:27:42 SIGPOLL 2023-10-23 00:27:45 unexpected build daemon error: interrupted by the user 2023-10-23 00:33:33 accepted connection from pid 18016, user hydra 2023-10-23 00:33:34 accepted connection from pid 18035, user hydra --8<---------------cut here---------------end--------------->8--- But hey, as a matter of fact, =E2=80=98cuirass remote-server=E2=80=99 on be= rlin was restarted at around that time, as can be seen in /var/log/cuirass-remote-server.log: --8<---------------cut here---------------start------------->8--- 2023-10-23 00:26:06 0 items queued for eventual download 2023-10-23 00:26:55 period update: 0 resumable, 0 failed builds. 2023-10-23 00:26:58 error: failed to start worker/database proxy: Invalid a= rgument 2023-10-23 00:26:59 increased maximum number of open files from 1024 to 2048 2023-10-23 00:26:59 listening for build logs on port 5556 2023-10-23 00:26:59 deleting old build logs from '/var/cache/cuirass/remote= /'... 2023-10-23 00:28:49 selected 1115 build logs to remove 2023-10-23 00:28:49 WARNING: (cuirass scripts remote-server): imported modu= le (fibers) overrides core binding `sleep' 2023-10-23 00:28:49 starting fetch worker with up to 8 concurrent downloads 2023-10-23 00:28:49 build failed: '/gnu/store/qlmhcyk9ac30464v99i2ys0irs7jz= 3lg-u-boot-am335x-evm-2023.07.02.drv' 2023-10-23 00:28:49 build failed: '/gnu/store/dl3far2xa4paq6nl6pp9iklpxrwg1= wy2-ungoogled-chromium-wayland-112.0.5615.165-1.drv' 2023-10-23 00:28:50 build failed: '/gnu/store/y9fwzzgvyhvrmf0avihm6944j8rvp= g6m-u-boot-mx6cuboxi-2023.07.02.drv' 2023-10-23 00:28:50 build failed: '/gnu/store/5bhl5q86j6bkqx8zybq29khndhf05= 0jm-u-boot-rpi-2-2023.07.02.drv' 2023-10-23 00:28:50 build failed: '/gnu/store/16d5vq3dlzy1f4s7vazlfg6358bl8= dlc-u-boot-qemu-arm-2023.07.02.drv' 2023-10-23 00:28:51 build failed: '/gnu/store/i88vczhcnlz462cmpls8qgx5n3ssw= 7rc-u-boot-qemu-arm-2023.07.02.drv' 2023-10-23 00:28:51 build failed: '/gnu/store/jy463789qf42dn4zk5i5jzry2lf82= ypy-u-boot-cubietruck-2023.07.02.drv' 2023-10-23 00:28:51 build failed: '/gnu/store/i1ri2nkh1bcfzynmggbjg0rjlyi12= 1y8-u-boot-rpi-3-32b-2023.07.02.drv' 2023-10-23 00:28:51 build failed: '/gnu/store/q08xw052r484c1c1nj31sx0fg5yf2= py9-openjdk-18.0.2.drv' 2023-10-23 00:28:52 build failed: '/gnu/store/5j4pp2b5dx2ykw4na2wbmiwp84g0h= i4i-u-boot-am335x-boneblack-2023.07.02.drv' 2023-10-23 00:28:52 build failed: '/gnu/store/nqp61id4bavvcsib307rw5234myl7= ykr-u-boot-rpi-3-32b-efi-2023.07.02.drv' 2023-10-23 00:28:52 build failed: '/gnu/store/9h7x080cn44ik79mrzycbg2x0dvvg= igc-u-boot-a20-olinuxino-lime-2023.07.02.drv' 2023-10-23 00:28:52 build failed: '/gnu/store/mkwy8ywa6mrw5zdxwr88skyw94afg= aqv-u-boot-novena-2023.07.02.drv' 2023-10-23 00:28:53 build failed: '/gnu/store/lfjp146k0z0w2yqd3y6m2mv09fq01= 948-u-boot-sifive-unmatched-2023.07.02.drv' 2023-10-23 00:28:53 build failed: '/gnu/store/425ykg0ci4i612ryc7z79as94vipp= 9rb-u-boot-rpi-2-efi-2023.07.02.drv' 2023-10-23 00:28:57 build failed: '/gnu/store/7fyq24jsmvclnapjgf1li43w6dmm5= n06-u-boot-mx6cuboxi-2023.07.02.drv' [=E2=80=A6] 2023-10-23 00:34:29 build failed: '/gnu/store/s167lh0w0azfxx83ri8k0mn2gj57i= 5rl-u-boot-rpi-4-32b-2023.07.02.drv' --8<---------------cut here---------------end--------------->8--- /var/log/messages shows that =E2=80=98remote-server=E2=80=99 failed and was= respawned (the failure manifests as =E2=80=9Cfailed to start worker/database proxy=E2= =80=9D in the cuirass-remote-server.log excerpt above): --8<---------------cut here---------------start------------->8--- Oct 23 00:24:33 localhost vmunix: [12534110.756389] BTRFS error (device sde= 2): parent transid verify failed on logical 30457856 mirror 2 wanted 61709 = found 11 Oct 23 00:24:33 localhost vmunix: [12534110.768173] BTRFS error (device sde= 2): parent transid verify failed on logical 30457856 mirror 1 wanted 61709 = found 11 Oct 23 00:24:34 localhost vmunix: [12534110.779454] BTRFS error (device sde= 2): parent transid verify failed on logical 30457856 mirror 2 wanted 61709 = found 11 Oct 23 00:24:59 localhost ntpd[1953]: Soliciting pool server 81.169.208.5 Oct 23 00:26:04 localhost ntpd[1953]: Soliciting pool server 141.98.136.83 Oct 23 00:26:58 localhost shepherd[1]: Service cuirass-remote-server (PID 9= 2414) exited with 1.=20 Oct 23 00:26:58 localhost shepherd[1]: Respawning cuirass-remote-server.=20 Oct 23 00:26:58 localhost shepherd[1]: Starting service user-homes...=20 Oct 23 00:26:58 localhost shepherd[1]: Service user-homes has been started.= =20 Oct 23 00:26:58 localhost shepherd[1]: Service user-homes started.=20 Oct 23 00:26:58 localhost shepherd[1]: Service user-homes running with valu= e #t.=20 Oct 23 00:26:58 localhost shepherd[1]: Starting service postgres-roles...=20 Oct 23 00:26:58 localhost shepherd[1]: Service postgres-roles has been star= ted.=20 Oct 23 00:26:58 localhost shepherd[1]: Service postgres-roles started.=20 Oct 23 00:26:58 localhost shepherd[1]: Service postgres-roles running with = value #t.=20 Oct 23 00:26:58 localhost shepherd[1]: Starting service cuirass-remote-serv= er...=20 Oct 23 00:26:58 localhost shepherd[1]: Service cuirass-remote-server has be= en started.=20 Oct 23 00:26:58 localhost shepherd[1]: Service cuirass-remote-server starte= d.=20 Oct 23 00:26:58 localhost shepherd[1]: Service cuirass-remote-server runnin= g with value 63052.=20 Oct 23 00:26:59 localhost vmunix: [12534255.969754] validate_extent_buffer:= 58 callbacks suppressed Oct 23 00:26:59 localhost vmunix: [12534255.969764] BTRFS error (device sde= 2): parent transid verify failed on logical 30457856 mirror 1 wanted 61709 = found 11 --8<---------------cut here---------------end--------------->8--- To summarize: 1. =E2=80=98cuirass remote-server=E2=80=99 failed for some unknown reason= and was respawned. 2. All the ongoing and about-to-be-started builds carried out by worker processes at that point were marked as failed. We can improve on both parts. To be continued=E2=80=A6 Ludo=E2=80=99. From unknown Mon Jun 23 07:51:51 2025 X-Loop: help-debbugs@gnu.org Subject: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 23 Oct 2023 21:16:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66692 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Maxim Cournoyer Cc: 66692@debbugs.gnu.org Received: via spool by 66692-submit@debbugs.gnu.org id=B66692.16980957068504 (code B ref 66692); Mon, 23 Oct 2023 21:16:01 +0000 Received: (at 66692) by debbugs.gnu.org; 23 Oct 2023 21:15:06 +0000 Received: from localhost ([127.0.0.1]:52029 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qv2GP-0002B0-PZ for submit@debbugs.gnu.org; Mon, 23 Oct 2023 17:15:06 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:40834) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qv2GK-0001xE-PN for 66692@debbugs.gnu.org; Mon, 23 Oct 2023 17:15:04 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qv2Fm-0008FC-3w; Mon, 23 Oct 2023 17:14:26 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=bROM2ZSlYmjQpdqnschsy6FusdB41bI1at7f5c1DM+o=; b=UfGaTGYaUHw3Wxqjema3 yEdAqnJ33ZW19TCVV4M+9o3v5MrUbw2jBY1E+ptoU10cSlnUcZ/VwbcRWtXE4Ui8A5Aewv8DZGWDB znGRIc03/bp/E+rLKYkMK8STRsZHSkZeJ0ZpA0Qwk0zqOCioa+c5PeZEvq5kPzQbRgDKmy3SOUXk1 PI9hPtw2hKEWh3jVEalgxx5yJ1UiYuMeNKlroIL4Zlgzb2bbtIs7Q4f84uQIGbsX+blxNDrWLdk4N EmYlys3yGOW0VNzogUW66XzXK9dWzW8rhwOIIfb8u+fwVj7Hbp97LnGtAQC2nENFCuP/N+rFbg1PX TO5xZRSIo8SeEQ==; From: Ludovic =?UTF-8?Q?Court=C3=A8s?= In-Reply-To: <87pm15dpxn.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Mon, 23 Oct 2023 22:49:56 +0200") References: <87ttqi82rh.fsf@gmail.com> <87pm15dpxn.fsf@gnu.org> Date: Mon, 23 Oct 2023 23:14:23 +0200 Message-ID: <87lebtdosw.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Ludovic Court=C3=A8s skribis: > /var/log/cuirass-remote-server.log: > > 2023-10-23 00:26:06 0 items queued for eventual download > 2023-10-23 00:26:55 period update: 0 resumable, 0 failed builds. > 2023-10-23 00:26:58 error: failed to start worker/database proxy: Invalid= argument EINVAL here most likely comes from replying to a sender with invalid ID, due to ZMQ_ROUTER_MANDATORY, exactly what Cuirass commit 40f70d28aed55c404cca6a0760860fb4942e6bee fixed and aimed to catch. Ludo=E2=80=99. From unknown Mon Jun 23 07:51:51 2025 X-Loop: help-debbugs@gnu.org Subject: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources Resent-From: Maxim Cournoyer Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 24 Oct 2023 01:00:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66692 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 66692@debbugs.gnu.org Received: via spool by 66692-submit@debbugs.gnu.org id=B66692.169810919020002 (code B ref 66692); Tue, 24 Oct 2023 01:00:01 +0000 Received: (at 66692) by debbugs.gnu.org; 24 Oct 2023 00:59:50 +0000 Received: from localhost ([127.0.0.1]:52589 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qv5lu-0005CY-6n for submit@debbugs.gnu.org; Mon, 23 Oct 2023 20:59:50 -0400 Received: from mail-qt1-x82e.google.com ([2607:f8b0:4864:20::82e]:49512) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qv5lq-0005CG-5r for 66692@debbugs.gnu.org; Mon, 23 Oct 2023 20:59:48 -0400 Received: by mail-qt1-x82e.google.com with SMTP id d75a77b69052e-41cd4446cf5so22637741cf.3 for <66692@debbugs.gnu.org>; Mon, 23 Oct 2023 17:59:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1698109151; x=1698713951; darn=debbugs.gnu.org; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=er03/g4VDZPINm8YJY3hpOQMrN4hiDDZXidInegXo2A=; b=HiXxIlKCVyPfNK4HpwKlTJc0zrc17MY+a9uoFlwhsJWJpbGOdGfV2zi1WTIqPIeGL1 EXf10gxpo9dzzunx2fN3dUp6N7MOglhvY+1mTPxY/UjJZu+fm8NCQqAKKGjVrS67lWFH Ol6B61im+CuuLvX5O0meXfl7qQcpmGz9wIr+BNtqEb0coZ1mRvVt7Um9IA+HU2EqfWjz JcHfRDFHAfRKm+EevQhcpv1it3a3gWwNvqQseSo4lbvxljQ1zNpK3ZaOw248Y6ndkRoz 4F6R18YTjnEvfbhFWow3LylQGhPaHRN0F0dw2J4GEld/gdnL2n2Kdlu6tt0DOyj6YGcU 5QIw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698109151; x=1698713951; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:to:from:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=er03/g4VDZPINm8YJY3hpOQMrN4hiDDZXidInegXo2A=; b=YaQZGZmJGYCnZPqQ7yo334FnhrWmNpvzS8deKN22kHw7gSVQvhwkJ5ZuM1/6FCyikD vL0OESDW+3C7nvaR0azR1+FCPYUZ4GNNOwQTQAsq53DTsQKK8ceGf6rjVV4NJ/NEyY9Y lxYG34LKpo/nuzYm0tqY89AU6PFj1RqIW3em8Ak/Y0SndyuKRlwGlgO1SnkyzRP0GqAZ zd5DzQJuPDgBhLJmL8zk8rXklf2iZcAK1RLoy2xbSCxTEanOVZASWnqLQVTenNARwsH+ zvZlMlHnYJgmY1Ar9IAWXtHauna2LM0b72fhaIo4znrJQBqXpgwdbT2mXN3hv8AxguDB pUhA== X-Gm-Message-State: AOJu0YwS7D7m9FNLW8rzoTjHDA1f4dugu8y0Zmbl9x95oWaoXDJYJPIL eZBzvenVqXrffI503ajJdzcVcPDOVwS3XA== X-Google-Smtp-Source: AGHT+IFwrqC/4fn2IPb/w9xeEtwWeoej1FFvfbqIpmvuqmmiaVtOikh5wf7uT9xUVOoz63rnksCY+Q== X-Received: by 2002:a0c:aa1a:0:b0:66d:1d4d:5a6 with SMTP id d26-20020a0caa1a000000b0066d1d4d05a6mr8566736qvb.0.1698109151029; Mon, 23 Oct 2023 17:59:11 -0700 (PDT) Received: from hurd (dsl-10-148-194.b2b2c.ca. [72.10.148.194]) by smtp.gmail.com with ESMTPSA id g20-20020ad457b4000000b0065d0dcc28e3sm3264676qvx.73.2023.10.23.17.59.10 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 23 Oct 2023 17:59:10 -0700 (PDT) From: Maxim Cournoyer In-Reply-To: <87lebtdosw.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Mon, 23 Oct 2023 23:14:23 +0200") References: <87ttqi82rh.fsf@gmail.com> <87pm15dpxn.fsf@gnu.org> <87lebtdosw.fsf@gnu.org> Date: Mon, 23 Oct 2023 20:59:09 -0400 Message-ID: <87o7go6dk2.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Ludovic! Ludovic Court=C3=A8s writes: > Ludovic Court=C3=A8s skribis: > >> /var/log/cuirass-remote-server.log: >> >> 2023-10-23 00:26:06 0 items queued for eventual download >> 2023-10-23 00:26:55 period update: 0 resumable, 0 failed builds. >> 2023-10-23 00:26:58 error: failed to start worker/database proxy: Invali= d argument > > EINVAL here most likely comes from replying to a sender with invalid ID, > due to ZMQ_ROUTER_MANDATORY, exactly what Cuirass commit > 40f70d28aed55c404cca6a0760860fb4942e6bee fixed and aimed to catch. Thanks for picking up the investigation. Does that mean that the above fix was partial and that there likely is a use after free somewhere else? It's good at least that this ZMQ_ROUTER_MANDATORY option catches that. (Also, these scary Btrfs errors are a reminder that the file system got corrupted at some point and should be recreated at some point -- I hope they are not related to the problem at hand but we should keep an eye on things). --=20 Thanks, Maxim From unknown Mon Jun 23 07:51:51 2025 X-Loop: help-debbugs@gnu.org Subject: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 24 Oct 2023 20:28:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66692 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Maxim Cournoyer Cc: 66692@debbugs.gnu.org Received: via spool by 66692-submit@debbugs.gnu.org id=B66692.169817926823864 (code B ref 66692); Tue, 24 Oct 2023 20:28:01 +0000 Received: (at 66692) by debbugs.gnu.org; 24 Oct 2023 20:27:48 +0000 Received: from localhost ([127.0.0.1]:56777 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qvO0C-0006Cp-9l for submit@debbugs.gnu.org; Tue, 24 Oct 2023 16:27:48 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:37236) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qvO09-0006Ca-Ay for 66692@debbugs.gnu.org; Tue, 24 Oct 2023 16:27:46 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qvNzZ-0005Pr-TI; Tue, 24 Oct 2023 16:27:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=+7fnWnqNNsoeqMfj4tKKRWRmb2yf+zb900l7FDtS7N0=; b=VWUGY2WHLtBUx/qdTbqP h3hppUZEeelZVwnq+8r1Na8pslDAzllzBa7IwB0Uxus5D45++vheqAnqmBeSSkYcIxLsGB1USy/k/ dn3dd54+nJsrGmC6vY1O0cZWK/xxrVjr0GrDRpHRIdGKIgFnmYmLnR882LvQhn0mdkaQZkFqvhnpG 4Pa83v3mXXDWdJ+hDwPUxEloUKgm7cikKdQyhMIBQx45oZfJi089IbaF/KYVQV8hyl6urv8IZe9Bm GBBoZmhvkHcZ4l8shp2uNnEXIr58EbScpZuAD2YQaufxxn+fk6ltcUstaSJFYI/WY7/9l+U9eX7XD xoxV+WsbsOvvmQ==; From: Ludovic =?UTF-8?Q?Court=C3=A8s?= In-Reply-To: <87o7go6dk2.fsf@gmail.com> (Maxim Cournoyer's message of "Mon, 23 Oct 2023 20:59:09 -0400") References: <87ttqi82rh.fsf@gmail.com> <87pm15dpxn.fsf@gnu.org> <87lebtdosw.fsf@gnu.org> <87o7go6dk2.fsf@gmail.com> Date: Tue, 24 Oct 2023 22:27:07 +0200 Message-ID: <877cnb6a1w.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, Maxim Cournoyer skribis: > Ludovic Court=C3=A8s writes: > >> Ludovic Court=C3=A8s skribis: >> >>> /var/log/cuirass-remote-server.log: >>> >>> 2023-10-23 00:26:06 0 items queued for eventual download >>> 2023-10-23 00:26:55 period update: 0 resumable, 0 failed builds. >>> 2023-10-23 00:26:58 error: failed to start worker/database proxy: Inval= id argument >> >> EINVAL here most likely comes from replying to a sender with invalid ID, >> due to ZMQ_ROUTER_MANDATORY, exactly what Cuirass commit >> 40f70d28aed55c404cca6a0760860fb4942e6bee fixed and aimed to catch. > > Thanks for picking up the investigation. Does that mean that the above > fix was partial and that there likely is a use after free somewhere > else? Yes, the fix in Cuirass above was insufficient, though you had to be truly unlucky for use-after-free to happen this quickly. Anyway, I had also proposed a fix in guile-simple-zmq, which the upgrade in Guix commit 04215779baaa21f10bd5f20999761dc506e449d8 pulls in. I have yet to reconfigure on berlin. In the meantime I=E2=80=99ll look at the worker side of this issue. Ludo=E2=80=99. From unknown Mon Jun 23 07:51:51 2025 X-Loop: help-debbugs@gnu.org Subject: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sat, 28 Oct 2023 09:57:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66692 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Maxim Cournoyer Cc: 66692@debbugs.gnu.org Received: via spool by 66692-submit@debbugs.gnu.org id=B66692.169848698012346 (code B ref 66692); Sat, 28 Oct 2023 09:57:01 +0000 Received: (at 66692) by debbugs.gnu.org; 28 Oct 2023 09:56:20 +0000 Received: from localhost ([127.0.0.1]:37785 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qwg3H-0003D4-W0 for submit@debbugs.gnu.org; Sat, 28 Oct 2023 05:56:20 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:45206) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qwg3G-0003Cp-I9 for 66692@debbugs.gnu.org; Sat, 28 Oct 2023 05:56:19 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qwg2f-0005YF-AH; Sat, 28 Oct 2023 05:55:41 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=ONPdnIjCEqVSCRk4Huch6vEv+r9HryzwIinziiDnlZo=; b=JEs+djhDMrWsdTLZ2NBt okiCcTfbsW0hMMtzz5FblQuTAm+0eioW2YMbvIt5bgwBXPiUnc87JQ9Eh2MC/8wZE5Q+i2tA/Mj1s PL83c3aIZBDRcoVHm/DxsxTqZ29WaX72sBZKlFZSmWGtaA2eMR5tXl8WH4ncTzkKTqIjFjFjJyg10 xRQWk5E/4VRmXV2gkyQURseExVDlj0NYAt37Q6TWe0uPyKFltnaTVikF0/6h9sxnGyDltOJV/6lG0 29myKxbjf75YNKPWspN7kV7CrvjT962tzCHSeX4QFqWETmLuPVRP2XI/3J+FhR5ojV7DakIpabC8R haUEkLtf7eJBpw==; From: Ludovic =?UTF-8?Q?Court=C3=A8s?= In-Reply-To: <87pm15dpxn.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Mon, 23 Oct 2023 22:49:56 +0200") References: <87ttqi82rh.fsf@gmail.com> <87pm15dpxn.fsf@gnu.org> Date: Sat, 28 Oct 2023 11:55:38 +0200 Message-ID: <874jib9ilh.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, Ludovic Court=C3=A8s skribis: > 2. All the ongoing and about-to-be-started builds carried out by > worker processes at that point were marked as failed. This part of the problem was a bit more subtle.q When =E2=80=98cuirass remote-server=E2=80=99 goes away, =E2=80=98cuirass re= mote-worker=E2=80=99 keeps going if it was building something. In that case the build log will be lost (because the direct connection to the server was cut), but the worker eventually notifies the server of build success/failure (ZeroMQ, makes sure those messages are eventually sent, when the server is back). The bug was that the worker could in some cases, when the server is down, send a =E2=80=9Cbuild failed=E2=80=9D message even though the bug had= not completed. This is fixed by these Cuirass commits: 2eb3e13 * remote-worker: Discard log anytime =E2=80=98send-log=E2=80=99 t= hrows. 4cc37f5 * remote-worker: Ignore the return value of =E2=80=98build-deriva= tions&=E2=80=99. 3bbb5c8 * store: =E2=80=98build-derivations&=E2=80=99 enforces synchroniz= ation with the build. (I have yet to update the =E2=80=98cuirass=E2=80=99 package and to deploy i= t on ci.guix. It=E2=80=99s been running for a few days at .) Ludo=E2=80=99. From unknown Mon Jun 23 07:51:51 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: Maxim Cournoyer Subject: bug#66692: closed (Re: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources) Message-ID: References: <87sf5s5k47.fsf@gnu.org> <87ttqi82rh.fsf@gmail.com> X-Gnu-PR-Message: they-closed 66692 X-Gnu-PR-Package: guix Reply-To: 66692@debbugs.gnu.org Date: Mon, 30 Oct 2023 13:14:02 +0000 Content-Type: multipart/mixed; boundary="----------=_1698671642-15488-1" This is a multi-part message in MIME format... ------------=_1698671642-15488-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #66692: [cuirass] Spurious failed builds following patching u-boot sources which was filed against the guix package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 66692@debbugs.gnu.org. --=20 66692: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D66692 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1698671642-15488-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 66692-done) by debbugs.gnu.org; 30 Oct 2023 13:13:57 +0000 Received: from localhost ([127.0.0.1]:44506 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qxS5c-00041R-T2 for submit@debbugs.gnu.org; Mon, 30 Oct 2023 09:13:57 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:58274) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qxS5a-00041B-Fj for 66692-done@debbugs.gnu.org; Mon, 30 Oct 2023 09:13:55 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qxS4x-0000p0-RA; Mon, 30 Oct 2023 09:13:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=dtgvsORRh/pFT0mw1CNIeRUDWBnVU5pVtMQB+dkSVg8=; b=G3BoPqSUkMCd0WODh3yS XNOaovkG5U7AIixOvldBK1GrN31lDncbHNAdpN4BxGxgtpA4SYaUSRx8RKi9Fvab9qhY6AUA6ox/v KMw5ZlzPUyeV+DUm0LFYdrGgV9dRyyEWjuLqPFS8kLYWQ9s9yxo0m66TjspHzXjJJErhB6LWWRxNv F1JmOQF+yRFTu+0m4KqDXpHVzL1twiIRTsVekjYdpuHSIOFpf7aMHNdrdZ9XjitgtuDE2a1NhYnYT LZNPQo4g/eyYe4KslANyWWSLLpVVN6zYEJb/A8MnUuqQ4fpSqcjQTexr2YtRY+YwoPAvhMo24GGJW CwESzlKY7NAYbA==; From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Maxim Cournoyer Subject: Re: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources In-Reply-To: <874jib9ilh.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Sat, 28 Oct 2023 11:55:38 +0200") References: <87ttqi82rh.fsf@gmail.com> <87pm15dpxn.fsf@gnu.org> <874jib9ilh.fsf@gnu.org> Date: Mon, 30 Oct 2023 14:13:12 +0100 Message-ID: <87sf5s5k47.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 66692-done Cc: 66692-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Ludovic Court=C3=A8s skribis: > This is fixed by these Cuirass commits: > > 2eb3e13 * remote-worker: Discard log anytime =E2=80=98send-log=E2=80=99= throws. > 4cc37f5 * remote-worker: Ignore the return value of =E2=80=98build-deri= vations&=E2=80=99. > 3bbb5c8 * store: =E2=80=98build-derivations&=E2=80=99 enforces synchron= ization with the build. > > (I have yet to update the =E2=80=98cuirass=E2=80=99 package and to deploy= it on ci.guix. > It=E2=80=99s been running for a few days at .) I=E2=80=99ve done that just a couple of hours ago, running Cuirass 1.2.0 on= both berlin and the x86_64 nodes listed in =E2=80=98berlin-nodes.scm=E2=80=99. Ludo=E2=80=99. ------------=_1698671642-15488-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 23 Oct 2023 02:57:49 +0000 Received: from localhost ([127.0.0.1]:48682 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qul8X-0008QB-4H for submit@debbugs.gnu.org; Sun, 22 Oct 2023 22:57:49 -0400 Received: from lists.gnu.org ([2001:470:142::17]:35800) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qul8T-0008Pw-18 for submit@debbugs.gnu.org; Sun, 22 Oct 2023 22:57:47 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qul7v-00031A-0r for bug-guix@gnu.org; Sun, 22 Oct 2023 22:57:11 -0400 Received: from mail-qv1-xf36.google.com ([2607:f8b0:4864:20::f36]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qul7t-0007ZP-Db for bug-guix@gnu.org; Sun, 22 Oct 2023 22:57:10 -0400 Received: by mail-qv1-xf36.google.com with SMTP id 6a1803df08f44-66cfef11a25so15713746d6.3 for ; Sun, 22 Oct 2023 19:57:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1698029827; x=1698634627; darn=gnu.org; h=mime-version:message-id:date:subject:to:from:from:to:cc:subject :date:message-id:reply-to; bh=GwvlMMRu8R357lIrpVQrQFPS3ekQMVJWcqCg/pHoACw=; b=NY0Cfzp+f0ac3vZ4ojUfKNvfa8Al8z6gR/Zy9j5CyJmnCGPg0CmlL3/e5f8WUjvfsd iKXFbQqMlOq8jMC5VxA0gHk+cbBqEJon3v5O7tcqf73SqTcnNtpnAlp+6COr3DlzQdXb jsLBiGhmJMrMqAQKnzi4aO4E5o6mzfECb8PJpm3Ouwm+xtUsdX4w9l9QLkRkmy67VNc2 rQGrffsZxkDfo3ku6UBFZihHNfNzSCIV7hDU06cD6GA97b8jx2uDRzXyLkY4IgQHU8Ox XYSql3rbu4jremQxMgRd8JVlsO6Nx5YTaydIjTEsOW2y0H0W/jUKMMAW1NG5apx9ujkB ZG9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698029827; x=1698634627; h=mime-version:message-id:date:subject:to:from:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=GwvlMMRu8R357lIrpVQrQFPS3ekQMVJWcqCg/pHoACw=; b=NlE1H3gpdaAvXz+JhUx++3/msJ2rEIuy7rcUCNW2nb8o0U1YsXLQTUsJxBhW9a70qx 9z07P3cyciWdHP4gVycw8zFn1qP6+4+S3DZkkOGbvb4O/mw5EurZ5xIjCbsabVneQHUZ GVPiNzyWMgORJOSfmmNHY3uZcfGct7dqzxPDY5/lxvo778DUxuNhYAgSlG9Ms9ji0PPi iSwdMCxca7QzxK7yni0bNL4W/7MGceUyvFnTCgNdiOy9JwdadaH5M41G9j+VWLkG2Brj EDXmcQ+BBG+on6W0hNZbgW57lphGM6Xc5zoU/SwnpVJaFCG/96uS8nEieMgM51t0CLix 0bYA== X-Gm-Message-State: AOJu0YwtlX1c5fMovlqdJzl1nAC+wx9uJ88oj2YrkWGRNF92QUf0KyeW Xv77srHXQS44a6xof/teJKnL8Byl5N8dhA== X-Google-Smtp-Source: AGHT+IEHo6znQN8uAxWU0Z77Y+0CGFK+/w2pcJ5FnYIyAdIvCyI534IoYXP94fHvrfvyx/L9Y6BY7A== X-Received: by 2002:a05:622a:11d4:b0:41b:8416:ea2a with SMTP id n20-20020a05622a11d400b0041b8416ea2amr8814758qtk.40.1698029827581; Sun, 22 Oct 2023 19:57:07 -0700 (PDT) Received: from hurd (dsl-205-236-230-191.b2b2c.ca. [205.236.230.191]) by smtp.gmail.com with ESMTPSA id jd26-20020a05622a719a00b003f6ac526568sm2419430qtb.39.2023.10.22.19.57.06 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 22 Oct 2023 19:57:07 -0700 (PDT) From: Maxim Cournoyer To: bug-guix Subject: [cuirass] Spurious failed builds following patching u-boot sources Date: Sun, 22 Oct 2023 22:57:06 -0400 Message-ID: <87ttqi82rh.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2607:f8b0:4864:20::f36; envelope-from=maxim.cournoyer@gmail.com; helo=mail-qv1-xf36.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hi, I've noticed build failure events from Cuirass such as: --8<---------------cut here---------------start------------->8--- . [ ?: Cuirass ] Build u-boot-sifive-unmatched.x86_64-linux on master is broken. R. [ ?: Cuirass ] Build u-boot-am335x-boneblack.x86_64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-a20-olinuxino-lime.x86_64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-wandboard.powerpc64le-linux on master is broken. . [ ?: Cuirass ] Build u-boot-qemu-riscv64-smode.aarch64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-rpi-2-efi.powerpc64le-linux on master is broken. . [ ?: Cuirass ] Build u-boot-qemu-arm.x86_64-linux on master is broken. . [ ?: Cuirass ] Build u-boot-rpi-2.x86_64-linux on master is broken. --8<---------------cut here---------------end--------------->8--- There are a few more, and they were triggered by applying a patch (that only touches the patman tool) in this commit: . The build failures are not captured in the logs, which appear truncated, e.g. from (log empty -- builder: sjd-p9, worker N38vG7OW) or from (builder: hydra-guix-107, worker 4CWieLpQ) which ends with: --8<---------------cut here---------------start------------->8--- /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_fixsfsi_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_fixsfsi.visT /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_fixunssfsi_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_fixunssfsi.visT mv -f _arm_truncdfsf2.visT _arm_truncdfsf2.vis /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_floatdidf_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_floatdidf.visT mv -f _arm_negsf2.visT _arm_negsf2.vis mv -f _arm_addsubsf3.visT _arm_addsubsf3.vis /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_floatdisf_s.o | gawk 'NF == 3 && $2 !~ /^[UN]$/ && $3 !~ /.*_compat/ && $3 !~ /.*@.*/ { print "\t.hidden", $3 }' > _arm_floatdisf.visT /tmp/guix-build-gcc-cross-arm-linux-gnueabihf-11.3.0.drv-0/build/./gcc/nm -pg _arm_floatundi --8<---------------cut here---------------end--------------->8--- These appear to be some problem with the CI software (probably not hardware, as many workers across different architectures suffered the same problem) rather than packaging problems. I didn't see anything useful in /var/log/cuirass.log or /var/log/cuirass-remote-worker.log berlin. I haven't checked the logs on the builders. -- Thanks, Maxim ------------=_1698671642-15488-1-- From unknown Mon Jun 23 07:51:51 2025 X-Loop: help-debbugs@gnu.org Subject: bug#66692: closed (Re: bug#66692: [cuirass] Spurious failed builds following patching u-boot sources) Resent-From: Maxim Cournoyer Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 31 Oct 2023 13:33:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66692 X-GNU-PR-Package: guix X-GNU-PR-Keywords: Cc: 66692@debbugs.gnu.org, Ludovic =?UTF-8?Q?Court=C3=A8s?= Received: via spool by 66692-submit@debbugs.gnu.org id=B66692.169875914615824 (code B ref 66692); Tue, 31 Oct 2023 13:33:02 +0000 Received: (at 66692) by debbugs.gnu.org; 31 Oct 2023 13:32:26 +0000 Received: from localhost ([127.0.0.1]:47739 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qxor3-00047A-NH for submit@debbugs.gnu.org; Tue, 31 Oct 2023 09:32:26 -0400 Received: from mail-qt1-x832.google.com ([2607:f8b0:4864:20::832]:55598) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qxor0-00046x-U6 for 66692@debbugs.gnu.org; Tue, 31 Oct 2023 09:32:24 -0400 Received: by mail-qt1-x832.google.com with SMTP id d75a77b69052e-41cd8bd5727so36998701cf.3 for <66692@debbugs.gnu.org>; Tue, 31 Oct 2023 06:31:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1698759103; x=1699363903; darn=debbugs.gnu.org; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:from:from:to:cc:subject:date :message-id:reply-to; bh=ykkz1Oxv0KEKwOYcQvqGsk9bzTGDujZSerG2+Q8EiFA=; b=MT83PMF67t5si1Zf1jVAAEzPpykx186TChxAjgNBsq5dyKLGpd2fnFTv2mYE9GjGc9 OgdCIcqA99bZNlIfm89V3qFjIjmCzyRzRyX4eOX1tg63GUQiWipNwuvFZXO2MLCIJgs2 7ktdAHREQmEbiqHTuZuBJ8kYKU3qULqNpUxQLwLQW7ErFMNOArJHUpw+heHmZTnO8iaj IIYUJvzkuH1yO4xU6FtNeR+0H4D3Rv+yaQvi/WuuaCnpRim/RN9l4OXvRMyUEtBuBMC7 x7xp8/gcNJbDKU1Um6T+PPx1NvEzY/MknzeVs8A8kRwcijuSsTUN9tkyeiY2uF7It47w R2xQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698759103; x=1699363903; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:from:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=ykkz1Oxv0KEKwOYcQvqGsk9bzTGDujZSerG2+Q8EiFA=; b=GhrjE02FRf3ZfUhA0WzZlZYfGPRtDbgoDALhjvge61ZqL7L80khGh7eFpv+e2Jxwab uuTOBxRWItjZpaffiqVlon5kx5k/aJaVhMAkayUzIg/zkJHyZ32qSrcX97e78bdpsYZR Hg+Kow5jGwzT/lheLy5TwJYo3+sNyem1Xgs6nIFKsOYeYif11R66Prml+JnR1VAjd95s WSoqVuwrMJSC/ATb1W/0gQO1pZD/zZhGYn0RZqCEjbj0gfsehU1KXTqVeU2zl2B5tpeX KAwqNfP6yeLoYliUG6xL44VFYI65IvoubW7S4r73TaCNWvESPdqDMi/7ech9AoeTykaA oUXA== X-Gm-Message-State: AOJu0YzuJYvAPnWKEHVcVFnk1DNoRbEmsZ0RNA5xwJ1jQJU1WNyn5VNw GVvfZ+d4LnD33UzQiqOrB9U= X-Google-Smtp-Source: AGHT+IEK9zApa1MO7sWvA6lkagmq2jSTo8Ttf81RvZQjYQfP793OQaan7MYdG5ztP/G8LZBjeoj+CA== X-Received: by 2002:a05:622a:196:b0:41e:2d4d:def7 with SMTP id s22-20020a05622a019600b0041e2d4ddef7mr16430846qtw.5.1698759103556; Tue, 31 Oct 2023 06:31:43 -0700 (PDT) Received: from hurd (dsl-10-128-239.b2b2c.ca. [72.10.128.239]) by smtp.gmail.com with ESMTPSA id n25-20020ac86759000000b0041b12d5fd91sm492118qtp.55.2023.10.31.06.31.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 31 Oct 2023 06:31:43 -0700 (PDT) From: Maxim Cournoyer In-Reply-To: (GNU bug Tracking System's message of "Mon, 30 Oct 2023 13:14:02 +0000") References: <87sf5s5k47.fsf@gnu.org> <87ttqi82rh.fsf@gmail.com> Date: Tue, 31 Oct 2023 09:31:42 -0400 Message-ID: <87h6m6uddt.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 1.2 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: Hi, > Ludovic =?UTF-8?Q?Court=C3=A8s?= skribis: > >> This is fixed by these Cuirass commits: >> >> 2eb3e13 * remote-worker: Discard log anytime =?UTF-8?Q?=E2=80=98send-log=E2=80=99?= throws. >> 4cc37f5 * remote-worker: Ignore the return value [...] Content analysis details: (1.2 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (maxim.cournoyer[at]gmail.com) 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record 1.2 MISSING_HEADERS Missing To: header -0.0 SPF_PASS SPF: sender matches SPF record -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at https://www.dnswl.org/, no trust [2607:f8b0:4864:20:0:0:0:832 listed in] [list.dnswl.org] X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.2 (/) Hi, > Ludovic Court=C3=A8s skribis: > >> This is fixed by these Cuirass commits: >> >> 2eb3e13 * remote-worker: Discard log anytime =E2=80=98send-log=E2=80= =99 throws. >> 4cc37f5 * remote-worker: Ignore the return value of =E2=80=98build-der= ivations&=E2=80=99. >> 3bbb5c8 * store: =E2=80=98build-derivations&=E2=80=99 enforces synchro= nization with the build. >> >> (I have yet to update the =E2=80=98cuirass=E2=80=99 package and to deplo= y it on ci.guix. >> It=E2=80=99s been running for a few days at .) > > I=E2=80=99ve done that just a couple of hours ago, running Cuirass 1.2.0 = on both > berlin and the x86_64 nodes listed in =E2=80=98berlin-nodes.scm=E2=80=99. Awesome, thanks for all the fixes toward Cuirass! --=20 Maxim