From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" Resent-From: "Timo Wilken" Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 29 Nov 2023 21:38:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 67538@debbugs.gnu.org X-Debbugs-Original-To: Received: via spool by submit@debbugs.gnu.org id=B.170129386913925 (code B ref -1); Wed, 29 Nov 2023 21:38:02 +0000 Received: (at submit) by debbugs.gnu.org; 29 Nov 2023 21:37:49 +0000 Received: from localhost ([127.0.0.1]:51667 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8SFg-0003cW-En for submit@debbugs.gnu.org; Wed, 29 Nov 2023 16:37:49 -0500 Received: from lists.gnu.org ([2001:470:142::17]:35412) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8SFd-0003cH-86 for submit@debbugs.gnu.org; Wed, 29 Nov 2023 16:37:46 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1r8SFN-0003MG-DK for bug-guix@gnu.org; Wed, 29 Nov 2023 16:37:30 -0500 Received: from mx2.mythic-beasts.com ([2a00:1098:0:82:1000:0:2:1]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1r8SFH-00077a-Rt for bug-guix@gnu.org; Wed, 29 Nov 2023 16:37:28 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=twilken.net ; s=mythic-beasts-k1; h=To:From:Subject:Date; bh=pcUtfr0Sr+FQCoy5wrZC/UlLwB77vVTeo9HhBISNTBU=; b=EAlhV8XlGupj7N4m9QAwE0+P9A dL2kDTNJbeqO30vxCFOjFeAwKjtTIevnMpdsQ69XTzhyyOlc0YItoqywIb3d9oA+/NloiQQcT2vMF Z/eROTgI8vCFzGKy9RIhVesPVWKRobXNu0lNGjb52mKQ8FKLMYO4nygf2HrZP7Eislift0ety54nL XVS1Tp4vzEaIqZ5lLq29rky4BAlY3v3i6PwPnc4bG++4o4RQKlJDJLtZwXxifZfybtxsTqjL5F0AC p4OHV+rkc9eF1iElWI1KIfVoxcrOD0aqf7NIk8PMsbg/7AMqDeFAYBMV8G7lBgP4mcGAAAU2JwJRy QBLxz4wA==; Received: by mailhub-hex-d.mythic-beasts.com with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r8SFE-00CShC-QV for bug-guix@gnu.org; Wed, 29 Nov 2023 21:37:21 +0000 Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=UTF-8 Date: Wed, 29 Nov 2023 22:37:16 +0100 From: "Timo Wilken" Message-Id: X-Mailer: aerc 0.15.2 X-BlackCat-Spam-Score: 7 X-Spam-Status: No, score=0.7 Received-SPF: pass client-ip=2a00:1098:0:82:1000:0:2:1; envelope-from=timo@twilken.net; helo=mx2.mythic-beasts.com X-Spam_score_int: -28 X-Spam_score: -2.9 X-Spam_bar: -- X-Spam_report: (-2.9 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEXHASH_WORD=1, PDS_BTC_ID=0.499, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 1.2 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: I run Guix System on a remote server, and I've just had Shepherd hang itself completely during a "guix system reconfigure" -- see the terminal log below. This is the system Shepherd, i.e. PID 1, so it hanging is obviously not good. Content analysis details: (1.2 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.0 SPF_HELO_PASS SPF: HELO matches SPF record 1.0 SPF_SOFTFAIL SPF: sender does not match SPF record (softfail) -0.0 T_SCC_BODY_TEXT_LINE No description available. 0.2 PDS_BTC_ID FP reduced Bitcoin ID X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.2 (/) I run Guix System on a remote server, and I've just had Shepherd hang itsel= f completely during a "guix system reconfigure" -- see the terminal log below= . This is the system Shepherd, i.e. PID 1, so it hanging is obviously not goo= d. I was debugging some nginx/certbot-related issues, which is the reason for = the many invocations of "guix system reconfigure/roll-back/switch-generation". I have since force-restarted the machine through /proc/sysrq-trigger. If so= me information is missing, it may have to wait until this happens to me again, sorry! --8<---------------cut here---------------start------------->8--- $ cd src/tw-channel $ sudo guix system reconfigure -L . tw/system/X.scm $ sudo guix system roll-back # 76 -> 75 $ sudo guix system roll-back # 75 -> 74 $ sudo guix system roll-back # 74 -> 73 $ sudo guix system switch-generation 76 $ edit tw/system/X.scm $ sudo guix system reconfigure -L . tw/system/X.scm --allow-downgrades guix system: warning: moving channel 'tw' from 6f4319548e425318c057fce48a3b= 39ceee4dd2ee to unrelated commit 8449867c353192d0c8313d67b3a02549f941ec56 substitute: updating substitutes from 'https://[...]'... 100.0% substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 10= 0.0% The following derivations will be built: /gnu/store/ygrlqslg9f5jwv50vjya2wbkzcxi260n-system.drv /gnu/store/0lvgfm2k4bgs5m338fq5dh7j5n7bhbm5-activate.scm.drv /gnu/store/gshibgm70parbj4x6y1x42qvq7n8x7c9-activate-service.scm.drv /gnu/store/z228g6557hg6nmmg1x9i2yp60q6c43qx-nginx.conf.drv /gnu/store/5s28r9s2mawd423q2azi4cdf203fi4f4-provenance.drv /gnu/store/jziijs3yg8q78fyn853pdzybpp73d5rd-boot.drv /gnu/store/58da936wr8zf9501x3m39pqbi7n866b2-shepherd.conf.drv /gnu/store/fp8cxrqhp58wwsbi75k3369a1yx8ldxy-shepherd-nginx.go.drv /gnu/store/fyday4l5if26p6ghhra331iyj48s7f0p-shepherd-nginx.scm.drv /gnu/store/ri2j9rv5d19x98ig1mc7yc3mpiknv88n-grub.cfg.drv building /gnu/store/5s28r9s2mawd423q2azi4cdf203fi4f4-provenance.drv... building /gnu/store/z228g6557hg6nmmg1x9i2yp60q6c43qx-nginx.conf.drv... building /gnu/store/gshibgm70parbj4x6y1x42qvq7n8x7c9-activate-service.scm.d= rv... building /gnu/store/fyday4l5if26p6ghhra331iyj48s7f0p-shepherd-nginx.scm.drv= ... building /gnu/store/0lvgfm2k4bgs5m338fq5dh7j5n7bhbm5-activate.scm.drv... building /gnu/store/fp8cxrqhp58wwsbi75k3369a1yx8ldxy-shepherd-nginx.go.drv.= .. building /gnu/store/58da936wr8zf9501x3m39pqbi7n866b2-shepherd.conf.drv... building /gnu/store/jziijs3yg8q78fyn853pdzybpp73d5rd-boot.drv... building /gnu/store/ygrlqslg9f5jwv50vjya2wbkzcxi260n-system.drv... building /gnu/store/ri2j9rv5d19x98ig1mc7yc3mpiknv88n-grub.cfg.drv... /gnu/store/6r0j6h4938hz5mddp61b61fw632dndzz-system /gnu/store/253irqhvid0hkafig7ws4i81zmdsls37-grub.cfg activating system... The following derivation will be built: /gnu/store/wdpjdsxxkb2cyp2y9ffqwhkpf7ajb55k-switch-to-system.scm.drv building /gnu/store/wdpjdsxxkb2cyp2y9ffqwhkpf7ajb55k-switch-to-system.scm.d= rv... making '/gnu/store/6r0j6h4938hz5mddp61b61fw632dndzz-system' the current sys= tem... setting up setuid programs in '/run/setuid-programs'... populating /etc from /gnu/store/9yypp4bzsfprdq4vwjcj3f9jcj5dldk3-etc... `/gnu/store/vxwqfm0fb8nj9flz272iwx8nwa82dsx4-openssh-authorized-keys/[x]' -= > `/etc/ssh/authorized_keys.d/[x]' `/gnu/store/vxwqfm0fb8nj9flz272iwx8nwa82dsx4-openssh-authorized-keys/[y]' -= > `/etc/ssh/authorized_keys.d/[y]' /var/lib/certbot/renew-certificates may need to be run creating nginx log directory '/var/log/nginx' creating nginx run directory '/var/run/nginx' creating nginx temp directories '/var/run/nginx/{client_body,proxy,fastcgi,= uwsgi,scgi}_temp' nginx: the configuration file /gnu/store/hkldki7rxg82i9nb3flsq6x58h81p2qr-n= ginx.conf syntax is ok nginx: configuration file /gnu/store/hkldki7rxg82i9nb3flsq6x58h81p2qr-nginx= .conf test is successful The following derivation will be built: /gnu/store/dnz992gzxhpaq7xjcakdi53rdannsimf-install-bootloader.scm.drv building /gnu/store/dnz992gzxhpaq7xjcakdi53rdannsimf-install-bootloader.scm= .drv... guix system: bootloader successfully installed on '(/boot/efi)' The following derivation will be built: /gnu/store/q76v0yrh6vnbjiq2fw236lvn5mc2nl32-upgrade-shepherd-services.scm= .drv building /gnu/store/q76v0yrh6vnbjiq2fw236lvn5mc2nl32-upgrade-shepherd-servi= ces.scm.drv... shepherd: Removing service 'fcgiwrap'... shepherd: Done. [ at this point, the process hangs ] --8<---------------cut here---------------end--------------->8--- The mentioned derivation /gnu/store/q76v0yrh6vnbjiq2fw236lvn5mc2nl32-upgrade-shepherd-services.scm.d= rv builds the following upgrade-shepherd-services.scm: --8<---------------cut here---------------start------------->8--- ;; /gnu/store/qi2g4figwfn44nrlsaxgjn4p9sps6qv8-upgrade-shepherd-services.sc= m [ %load-path mangling omitted ] (begin (use-modules (gnu services herd) (srfi srfi-1)) (parameterize ((shepherd-message-port (%make-void-port "w"))) (load-services/safe '("/gnu/store/855sxj4rkzq41ypp39q5z3qgpbzgy6i7-shepherd-file-systems.= scm" "/gnu/store/3vmb6s4wcxn1kw4388knzi6cpi48yz7c-shepherd-user-file-sys= tems.scm" "/gnu/store/ji7i741ckxdmvpj4rkldhv5xxdjxpbcn-shepherd-file-system--= boot-efi.scm" "/gnu/store/9pg4xp2ja9kjlrnm7j4a62hr07hsm3wg-shepherd-file-system--= var-backups.scm" "/gnu/store/13b2181gh9qwvmar5zwlh8vvzamd7agc-shepherd-file-system--= var-data.scm" "/gnu/store/6bqzwfdbiqj0k4ry25732b5iggna84x1-shepherd-file-system--= dev-pts.scm" "/gnu/store/i8lf3s32nihq66k87ghyk4xzbrdqrc3d-shepherd-file-system--= sys-kernel-debug.scm" "/gnu/store/rbx4h30awmx1mmdhf3i5sl7bihxxf199-shepherd-file-system--= dev-shm.scm" "/gnu/store/r73iq9cm3jca3lppfr4dbzxrdppmbyxi-shepherd-file-system--= sys-firmware-efi-efivars.scm" "/gnu/store/hy3c2bzpqyw4fjmkkpwm129dl190q1bl-shepherd-file-system--= gnu-store.scm" "/gnu/store/spdzdw9zd10mjg0lw1ifbjrf7f1gzd4g-shepherd-root-file-sys= tem.scm" "/gnu/store/9xd2x4p0yf2ldxmalh6yv83dfxhx6rz7-shepherd-user-processe= s.scm" "/gnu/store/jhah6x7spssyi5nzydf1hs38nqa0vfp0-shepherd-host-name.scm= " "/gnu/store/xjgk0d8ngxlkajv2w04ana4b1ib4jvk0-shepherd-user-homes.sc= m" "/gnu/store/xzn8j3gqs7rq6mp47gbagjslivwd02mg-shepherd-pam.scm" "/gnu/store/9lk622pwjbasiwi7zddk934pidp13cdc-shepherd-sysctl.scm" "/gnu/store/g0n4mlv609mgm4qy78rk134bw1bhly63-shepherd-udev.scm" "/gnu/store/wam791y3vj8qm76gi9ig6xyj0hhcj1mm-shepherd-nscd.scm" "/gnu/store/3wqlshnwf351mnk9xk6yxwf0rrlkvgk6-shepherd-guix-daemon.s= cm" "/gnu/store/5xa2i1km0ssnk3dcmxfqwanxc932mzki-shepherd-urandom-seed.= scm" "/gnu/store/c4hf75wf5fl2jydcqnva86p6gmj0k42x-shepherd-loopback.scm" "/gnu/store/vbn734scz28hr2w7s5c3d5s9iwrjvr7f-shepherd-term-tty6.scm= " "/gnu/store/fykgc2858d85v88yg8nscnax1sca7isd-shepherd-term-tty5.scm= " "/gnu/store/42ahwwdz9xr3idimfxqhq2dz8z503sx8-shepherd-term-tty4.scm= " "/gnu/store/7ar0dyx3a9wywx7jq98krcr7qwqla24w-shepherd-term-tty3.scm= " "/gnu/store/8lavcb8j4ka56gr34yfd70r87c500dkw-shepherd-term-tty2.scm= " "/gnu/store/zw340ia655wj0d6zp13367i8x19qshxl-shepherd-term-tty1.scm= " "/gnu/store/qs4gb2mfvj5pibr7c3dx0s0nr0lr19v4-shepherd-term-console.= scm" "/gnu/store/vwaw1dh8a8586f881j0sf53d5vybzwyx-shepherd-syslogd.scm" "/gnu/store/hfaqh39gg6r0r2sd1b3r9ayahhy2ziqv-shepherd-console-font-= tty1.scm" "/gnu/store/ch4bw5h8ks3ksbp1949aqpn1vbsqvy2k-shepherd-console-font-= tty2.scm" "/gnu/store/yqgcx129chxcx8wv1vwpvvd05iqgqlyw-shepherd-console-font-= tty3.scm" "/gnu/store/pxbywc0ivqfd5gncrby5pw52lda5pqay-shepherd-console-font-= tty4.scm" "/gnu/store/rfxbsv7cfp9zcskimljh52h5bz1ask62-shepherd-console-font-= tty5.scm" "/gnu/store/q443gll57ca462a7zzl5yqaiw7l5g5yg-shepherd-console-font-= tty6.scm" "/gnu/store/dpipig0pn7mh72ml4b2avbnij3cwz3p2-shepherd-virtual-termi= nal.scm" "/gnu/store/b4ndxky2waskw7yr5svq400dbwg6xdxs-shepherd-wireguard-wg0= .scm" "/gnu/store/984irchd8kigp0cwv31jffwgvlcxcb6m-shepherd-ntpd.scm" "/gnu/store/rralzs460d1b5djwl80cc2s6nz6jd1nm-shepherd-networking.sc= m" "/gnu/store/515z3jc702qcsjqqrysm7j1nx6wrjrh3-shepherd-prometheus-no= de-exporter.scm" "/gnu/store/4600gcbra51adqkbc4rprvhnfwnz8ls0-shepherd-ssh-daemon-ss= h-sshd.scm" "/gnu/store/pahrcqwxm7656r5g9njxs33ry6qncpmq-shepherd-php-fpm.scm" "/gnu/store/2wmvz4m7nbpri2dcksrsrmrj7i7fxg03-shepherd-mysql.scm" "/gnu/store/gf70rxc0b2myp84968c2dm3xhjmm5j66-shepherd-mysql-upgrade= .scm" "/gnu/store/6v44ghv8wmm3q9a916bj6fdw6sqh8lmn-shepherd-syncthing-syn= cthing.scm" "/gnu/store/y5mmqzdb3j2imshbmn2bh95pbz10i08l-shepherd-transmission-= daemon-transmission-bittorrent.scm" "/gnu/store/38lb7bwzm1g6nm3x9kgl628jrj8p2x1v-shepherd-git-daemon.sc= m" "/gnu/store/z8b6002pmlw72zxxd8cz7snh341h2nmq-shepherd-thermald.scm" "/gnu/store/d84dy6wa4z7ikwfjkd68s83idppfkgf6-shepherd-tor.scm" "/gnu/store/cwags534rgmig8lvynan15y1sp610g9q-shepherd-mcron.scm" "/gnu/store/pl3s5va584g1bira7k7swgzpb0qxq9g0-shepherd-nginx.scm"))) (for-each unload-service '(fcgiwrap)) (for-each start-service '(host-name user-homes sysctl mysql-upgrade nginx= ))) --8<---------------cut here---------------end--------------->8--- Putting the above together with the output above, it seems that Shepherd processes the (for-each unload-service '(fcgiwrap)) line fine, but gets stu= ck before it can run (start-service 'host-name). Here is the output of "guix describe". "tw" is my own personal channel, and I've redacted one unofficial channel. --8<---------------cut here---------------start------------->8--- $ guix describe Generation 35 Nov 29 2023 00:49:37 (current) guix cd46757 repository URL: https://git.savannah.gnu.org/git/guix.git branch: master commit: cd46757c1a0f886848fbb6828c028dd2a2532767 tw 8449867 repository URL: [redacted] branch: master commit: 8449867c353192d0c8313d67b3a02549f941ec56 [redacted channel] a7f7269 repository URL: [redacted] branch: master commit: a7f7269f5f19c306c5082461b03797c2e92edf6f --8<---------------cut here---------------end--------------->8--- Asking on IRC, I was pointed to https://issues.guix.gnu.org/66684. This iss= ue matches some of my symptoms (for me, Shepherd becomes completely unresponsi= ve while consuming 0% CPU), but I can't see any symptoms of the system time having changed. I run the Guix-standard ntpd. Here's the tail of /var/log/messages leading up to the hang. The first line ("shepherd[1]: Service nginx failed to start") is from the "sudo guix syste= m switch-generation 76" command. The following messages, up until "shepherd[1= ]: Done." are from the final "sudo guix system reconfigure". The messages afte= r that are from other system services (Syncthing, mostly). All times are UTC+= 1. --8<---------------cut here---------------start------------->8--- Nov 29 21:19:34 localhost shepherd[1]: Service nginx failed to start.=20 Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/hosts` was delet= ed, removing watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/hosts` was creat= ed, adding watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as deleted, removing watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as deleted, removing watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as created, adding watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as created, adding watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as written to Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/services` was de= leted, removing watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/services` was cr= eated, adding watch Nov 29 21:20:42 localhost nscd: 20914 monitored file `/etc/services` was wr= itten to Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/hosts` was delet= ed, removing watch Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/hosts` was creat= ed, adding watch Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as deleted, removing watch Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as deleted, removing watch Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as created, adding watch Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/nsswitch.conf` w= as created, adding watch Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/services` was de= leted, removing watch Nov 29 21:21:45 localhost nscd: 20914 monitored file `/etc/services` was cr= eated, adding watch Nov 29 21:21:47 localhost shepherd[1]: Evaluating user expression (register= -services (primitive-load "/gnu/st?") ?).=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= ms.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for user-file-= systems.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/boot/efi.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/var/backups. Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/var/data.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/dev/pts.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/sys/kernel/debug.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/dev/shm.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/sys/firmware/efi/efivars.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for file-syste= m-/gnu/store.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for root-file-= system.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for user-proce= sses.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for pam.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for udev.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for nscd.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for guix-daemo= n.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for urandom-se= ed.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for loopback.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for term-tty6.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for term-tty5.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for term-tty4.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for term-tty3.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for term-tty2.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for term-tty1.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for term-conso= le.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for syslogd.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for console-fo= nt-tty1.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for console-fo= nt-tty2.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for console-fo= nt-tty3.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for console-fo= nt-tty4.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for console-fo= nt-tty5.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for console-fo= nt-tty6.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for virtual-te= rminal.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for wireguard-= wg0.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for ntpd.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for networking= .=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for prometheus= -node-exporter.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for ssh-daemon= .=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for php-fpm.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for mysql.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for syncthing-= syncthing.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for transmissi= on-daemon.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for git-daemon= .=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for thermald.= =20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for tor.=20 Nov 29 21:21:47 localhost shepherd[1]: Recording replacement for mcron.=20 Nov 29 21:21:47 localhost shepherd[1]: Removing service 'fcgiwrap'...=20 Nov 29 21:21:47 localhost shepherd[1]: Stopping service fcgiwrap...=20 Nov 29 21:21:47 localhost shepherd[1]: Service fcgiwrap stopped.=20 Nov 29 21:21:47 localhost shepherd[1]: Service fcgiwrap is now stopped.=20 Nov 29 21:21:47 localhost shepherd[1]: Done.=20 Nov 29 21:22:03 localhost shepherd[1]: Accepted connection on 0.0.0.0:[sync= thing port] from [...] Nov 29 21:23:23 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Lost prima= ry connection to [...] Nov 29 21:23:23 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Connection= to [...] Nov 29 21:23:24 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Establishe= d secure connection to [...] Nov 29 21:23:24 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Device [..= .] Nov 29 21:42:05 localhost -- MARK -- Nov 29 21:49:09 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Lost prima= ry connection to [...] Nov 29 21:49:09 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Connection= to [...] Nov 29 21:49:44 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Establishe= d secure connection to [...] Nov 29 21:49:44 localhost shepherd[1]: [syncthing] [P7WXJ] INFO: Device [..= .] Nov 29 22:02:05 localhost -- MARK -- --8<---------------cut here---------------end--------------->8--- From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" References: In-Reply-To: Resent-From: Attila Lendvai Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 29 Nov 2023 21:55:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: "67538@debbugs.gnu.org" <67538@debbugs.gnu.org> Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170129488116007 (code B ref 67538); Wed, 29 Nov 2023 21:55:02 +0000 Received: (at 67538) by debbugs.gnu.org; 29 Nov 2023 21:54:41 +0000 Received: from localhost ([127.0.0.1]:51677 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8SW1-0004A7-46 for submit@debbugs.gnu.org; Wed, 29 Nov 2023 16:54:41 -0500 Received: from mail-4323.proton.ch ([185.70.43.23]:38377) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8SVw-00049p-6w for 67538@debbugs.gnu.org; Wed, 29 Nov 2023 16:54:38 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lendvai.name; s=protonmail; t=1701294861; x=1701554061; bh=9u+ZyfEi41GmJVeQCre4GCClLhh/PEHFAnrPNiT6O0g=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector; b=dW+2doHaMRQi1w1bGPrKrMCRytpTRWW320V/UMTjoee3SJg6rF9EaGv/7mff+Li0K 9XD0x1ZEYaLuC7WJSHeLJ6C7AHPpuWMhsnWvbDijiljnAd0uRKAnmvp3Yayyw1Xgrf iSgjebqB7pPLWxI+RjYWr7dvv6ZhEAHUvx17zO+LT/EmyKaxr80wV4QasoG1RF8aXE oy9kI8zrYbTGn5qtrHJu4269F0IllH/oIMGekEcyEX6TMaE5CA+Bz2cMafZgR5eJQP AH7bHryL3SAKAkrGKJuNGPkOWXe/fGJ3Zn3mRly/DGdAy7+Le35rj7Jn9U86Pais6k idbniN1VAd7gA== Date: Wed, 29 Nov 2023 21:54:11 +0000 From: Attila Lendvai Message-ID: <2jFNivEClEPAr1CXZOBcuLfjxhZLnGqmelVGcxgU-iWgrw5scO18hnVBGeJVKSiCRAXpSH-KsMOAGjLtLZ-CjwPqdKwEdojXNxLhib04jaA=@lendvai.name> Feedback-ID: 28384833:user:proton MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) i've also experienced this, and someone else on IRC also described the same= behavior. that makes three of us. i don't think it's relevant, but i'm also using syncthing. my suspicion is that it's due to some error coming from a start GEXP that s= omehow derails shepherd's event loop. --=20 =E2=80=A2 attila lendvai =E2=80=A2 PGP: 963F 5D5F 45C7 DFCD 0A39 -- The use of power is only needed when you want to do something harmful, othe= rwise love is enough to get everything done. From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" References: In-Reply-To: Resent-From: Michal Atlas Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 30 Nov 2023 02:41:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 67538@debbugs.gnu.org Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170131205323751 (code B ref 67538); Thu, 30 Nov 2023 02:41:02 +0000 Received: (at 67538) by debbugs.gnu.org; 30 Nov 2023 02:40:53 +0000 Received: from localhost ([127.0.0.1]:51916 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8Wyy-0006Az-DW for submit@debbugs.gnu.org; Wed, 29 Nov 2023 21:40:53 -0500 Received: from mout01.posteo.de ([185.67.36.65]:45397) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8TUR-0005pZ-6z for 67538@debbugs.gnu.org; Wed, 29 Nov 2023 17:57:08 -0500 Received: from submission (posteo.de [185.67.36.169]) by mout01.posteo.de (Postfix) with ESMTPS id 2E12A240027 for <67538@debbugs.gnu.org>; Wed, 29 Nov 2023 23:56:53 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1701298613; bh=PRee0r9qcAmaF1iGOE8l0sg879kXgY9eYpinm8Myj8w=; h=Date:From:To:Subject:Message-ID:MIME-Version: Content-Transfer-Encoding:From; b=RLDXU9KM8FAEf2g4wgLjRKf8mWAxtJIRwXBX5SBupGNzcjavHv20LCYVIhDrp4SGU uzbfSDt5dfR41o0BHYKWMdijV4WkXao7SY75wpvXcPtBUbB30heEhTJwCdimp24cnN zFea3W7Ja7faYn1hfHlOJBc04CXJLM+VknYYtl26gWXeeJ3D1oxIrnktQ9lSUf79nq Lhvb81MkeZK9cs4WRs9lQZuLabxb9EZJ33TBAnpQiOpM6Aft5hlAChx92T4pz5uULx 4+qwdRz+t6txINdCOOo+5hJ4FRlCxgAo2DpS0mEsZ2sXL250o8YoIEn6Z6Bhcs9P2y 9lDIlL1NNvM4Q== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4SgZT04cLGz6tvd for <67538@debbugs.gnu.org>; Wed, 29 Nov 2023 23:56:51 +0100 (CET) Date: Wed, 29 Nov 2023 22:56:50 +0000 From: Michal Atlas Message-ID: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=----BCUMD61UH32UNUYSYEYOJPBIY1ICJL Content-Transfer-Encoding: 7bit X-Spam-Score: -2.3 (--) X-Mailman-Approved-At: Wed, 29 Nov 2023 21:40:51 -0500 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) ------BCUMD61UH32UNUYSYEYOJPBIY1ICJL Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable I've been experiencing this occasionally ever since I started using guix=2E= It happens on all of my machines and across different setups=2E I don't use syncthing so it's probably not that=2E The set of services I have has changed so much I'd have trouble identifyin= g a singular service that was in all of the instances of this occurring sav= e for those in %desktop-services=2E iirc I once managed to get a debugger out when it happened and it's stuck = waiting in one of the epoll/select/alike calls, sadly don't remember exactl= y which one=2E Will investigate next time it happens=2E The only remedy I know is indeed SysRq=2E So that's at least 4 people now ------BCUMD61UH32UNUYSYEYOJPBIY1ICJL Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
I've been experiencing this oc= casionally ever since I started using guix=2E It happens on all of my machi= nes and across different setups=2E

I don't use syncthing so it's pro= bably not that=2E

The set of services I have has changed so much I'd= have trouble identifying a singular service that was in all of the instanc= es of this occurring save for those in %desktop-services=2E

iirc I o= nce managed to get a debugger out when it happened and it's stuck waiting i= n one of the epoll/select/alike calls, sadly don't remember exactly which o= ne=2E Will investigate next time it happens=2E

The only remedy I kno= w is indeed SysRq=2E

So that's at least 4 people now
------BCUMD61UH32UNUYSYEYOJPBIY1ICJL-- From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" Resent-From: Attila Lendvai Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 30 Nov 2023 11:25:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: "67538@debbugs.gnu.org" <67538@debbugs.gnu.org> Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170134346920775 (code B ref 67538); Thu, 30 Nov 2023 11:25:02 +0000 Received: (at 67538) by debbugs.gnu.org; 30 Nov 2023 11:24:29 +0000 Received: from localhost ([127.0.0.1]:52527 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8f9h-0005P0-7U for submit@debbugs.gnu.org; Thu, 30 Nov 2023 06:24:29 -0500 Received: from mail-40136.proton.ch ([185.70.40.136]:22411) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8f9d-0005Oj-Nb for 67538@debbugs.gnu.org; Thu, 30 Nov 2023 06:24:27 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lendvai.name; s=protonmail; t=1701343450; x=1701602650; bh=h1rqxVyIfGlLX0NrL1CDLkV6yzwHDeQXjgIKkfzyySU=; h=Date:To:From:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=vCmrg5DL+pZeQg3xMIjJmJayql9BezVomiQ7S2w6u6wuoPKzcMGp2klj9XZPiuN52 tY9zBypg6iJEkEUa/3oREmOI3qX2eTHb4lhhQoRM2gQyf1J+F2qITw4Qrz3duGoFHG WQFdkmjlACnghgAkBaJ+6ixRRpWvbG2qw+8pckmwQccqmaVt0dM02bd156Rr7Xf4/g h1ynq4c+/24NmEkn/aBfhiacS4K7UGCbydneJ1J46beenWGxieqUhYqg/wu3JnBh7v pM/siwUHg5kC1sYKRI5x96nWe8TU/0uRdCnVq3a6nUr85ppr9N7PqdgKeKjXw6+lny LoblhbTmahjow== Date: Thu, 30 Nov 2023 11:23:56 +0000 From: Attila Lendvai Message-ID: In-Reply-To: <2jFNivEClEPAr1CXZOBcuLfjxhZLnGqmelVGcxgU-iWgrw5scO18hnVBGeJVKSiCRAXpSH-KsMOAGjLtLZ-CjwPqdKwEdojXNxLhib04jaA=@lendvai.name> References: <2jFNivEClEPAr1CXZOBcuLfjxhZLnGqmelVGcxgU-iWgrw5scO18hnVBGeJVKSiCRAXpSH-KsMOAGjLtLZ-CjwPqdKwEdojXNxLhib04jaA=@lendvai.name> Feedback-ID: 28384833:user:proton MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) > > my suspicion is that it's due to some error coming from a start > > GEXP that somehow derails shepherd's event loop. [...] > iirc I once managed to get a debugger out when it happened and it's > stuck waiting in one of the epoll/select/alike calls, ...or one of the start/stop GEXP's calls something that (sometimes?) blocks= indefinitely (which violates the API of shepherd). --=20 =E2=80=A2 attila lendvai =E2=80=A2 PGP: 963F 5D5F 45C7 DFCD 0A39 -- Child labor was not abolished, it was changed from productive work to count= er-productive brainwashing, and made universal: compulsory public schooling= . From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" Resent-From: Simon Streit Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 30 Nov 2023 12:56:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Attila Lendvai Cc: "67538@debbugs.gnu.org" <67538@debbugs.gnu.org> Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170134892219255 (code B ref 67538); Thu, 30 Nov 2023 12:56:01 +0000 Received: (at 67538) by debbugs.gnu.org; 30 Nov 2023 12:55:22 +0000 Received: from localhost ([127.0.0.1]:52603 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8gZd-00050T-Ij for submit@debbugs.gnu.org; Thu, 30 Nov 2023 07:55:21 -0500 Received: from smtprelay05.ispgateway.de ([80.67.18.28]:23376) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1r8gZb-00050J-Mg for 67538@debbugs.gnu.org; Thu, 30 Nov 2023 07:55:20 -0500 Received: from [80.153.58.194] (helo=milk) by smtprelay05.ispgateway.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96.1) (envelope-from ) id 1r8gZR-0003wA-12; Thu, 30 Nov 2023 13:55:09 +0100 From: Simon Streit In-Reply-To: <2jFNivEClEPAr1CXZOBcuLfjxhZLnGqmelVGcxgU-iWgrw5scO18hnVBGeJVKSiCRAXpSH-KsMOAGjLtLZ-CjwPqdKwEdojXNxLhib04jaA=@lendvai.name> (Attila Lendvai's message of "Wed, 29 Nov 2023 21:54:11 +0000") References: <2jFNivEClEPAr1CXZOBcuLfjxhZLnGqmelVGcxgU-iWgrw5scO18hnVBGeJVKSiCRAXpSH-KsMOAGjLtLZ-CjwPqdKwEdojXNxLhib04jaA=@lendvai.name> Gcc: nnfolder+archive:sent.2023-11 Date: Thu, 30 Nov 2023 13:55:08 +0100 Message-ID: User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Df-Sender: c2ltb25AbmV0cGFuaWMub3Jn X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Attila Lendvai writes: > i've also experienced this, and someone else on IRC also described the > same behavior. that makes three of us. I can confirm it too. It looks as if shepherd hangs when something changes. But it doesn't happen all the time. It also happens sometimes when configuring a home environment. There it is not much of a problem to restart shepherd. But that doesn't work on a system level. There I have to hard reset the system. > i don't think it's relevant, but i'm also using syncthing. I'm not sure about this either. I've noticed too that the service syncthing will sometimes hang when stopping or restarting. This could be a different issue with the service itself. While thinking of it: I don't use syncthing in my system declaration anymore. It move over to my home environment. The hanging still happens. Regards -- Simon From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" Resent-From: "Timo Wilken" Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 14 Dec 2023 22:57:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: <67538@debbugs.gnu.org>, <67230@debbugs.gnu.org>, <65178@debbugs.gnu.org> Cc: Attila Lendvai Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.17025945822344 (code B ref 67538); Thu, 14 Dec 2023 22:57:02 +0000 Received: (at 67538) by debbugs.gnu.org; 14 Dec 2023 22:56:22 +0000 Received: from localhost ([127.0.0.1]:51172 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rDucu-0000bh-Do for submit@debbugs.gnu.org; Thu, 14 Dec 2023 17:56:22 -0500 Received: from mx1.mythic-beasts.com ([2a00:1098:0:86:1000:0:2:1]:49767) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rDucq-0000bK-Ap; Thu, 14 Dec 2023 17:56:19 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=twilken.net ; s=mythic-beasts-k1; h=From:Subject:To:Date; bh=8z5HewkU1Mq3/XpscCM+dru8CbY1u5Jnno2aJ/YMBww=; b=ehTzDoTFO4ewfyZCjrn0g/BSGq +htAwN+Ggu4bV2OCWCiTu662xBbjyeHyVAs3gaDCgnzekrplQQZbE5WHAj/AickOwfx02nbGu5f8I PQ2o5n+5u7J4al8ZnqDNEP4RHvVqAF9Li7ouQwZfIz73CYauCcbXbfRKOFQz+f0jnBvz+6Zy/ODRe TF4PTBZU7tdcDopVj4hmhYrcP3U5aRdjQHHPXyebxO3e512rTYO3Z7wIz8Lkzci/2nvkPxU1ef8sW 5FjBh3TKoaprEa7bnecGc36/hy+d51KQpLQB+BqJxtnsvBt74NPPxX95IChMFNNoObWvjFLiA40pX Qa2RThXQ==; Received: by mailhub-cam-d.mythic-beasts.com with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rDuck-001snI-3Y; Thu, 14 Dec 2023 22:56:10 +0000 Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=UTF-8 Date: Thu, 14 Dec 2023 23:55:47 +0100 References: In-Reply-To: From: "Timo Wilken" Message-Id: X-Mailer: aerc 0.15.2 X-BlackCat-Spam-Score: 7 X-Spam-Status: No, score=0.7 X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) After a bit of searching, it looks like 67538, 67230 and 65178 may be the s= ame issue. Attila Lendvai wrote: > > > my suspicion is that it's due to some error coming from a start > > > GEXP that somehow derails shepherd's event loop. > > > > iirc I once managed to get a debugger out when it happened and it's > > stuck waiting in one of the epoll/select/alike calls, > > ...or one of the start/stop GEXP's calls something that (sometimes?) bloc= ks > indefinitely (which violates the API of shepherd). Same symptoms here again. For context: this time I was trying to deploy some OCI/Docker containers us= ing Guix' `oci-container-service-type', specifically a Shepherd service called "conduit". My code is here: https://cgit.twilken.net/dotfiles/log/?h=3Dmatrix-containers (Specifically, commits bf94f7872a1df293bd904bbd2c1ef7229f4f98a8 and c87dcdae79c6266ac3dac70af08fbef5eb21629b.) This is with Guix commit 1b2505217cf222d98cc960b8510660976a01cfa1. I first ran "guix system reconfigure -L . tw/system/lud.scm" with commit bf94f7872a1df293bd904bbd2c1ef7229f4f98a8, which had a bug (an env var was wrong, so the container failed to start). This worked as expected in that Shepherd tried to start the service, which failed, so Shepherd disabled it. Then, I fixed the env var and re-ran "guix system reconfigure -L . tw/system/lud.scm" with commit c87dcdae79c6266ac3dac70af08fbef5eb21629b. Shepherd loaded the new "conduit" service fine, as far as I can tell, but didn't restart it because it was still disabled. I then enabled and started the service manually. Enabling worked fine, but = on start, I got no terminal output from Shepherd, and it hung. I still had an error in my setup (directory permissions were wrong), and I = got a message in /var/log/messages to that effect: --8<---------------cut here---------------start------------->8--- Dec 14 21:33:50 localhost shepherd[1]: Service conduit is currently disable= d.=20 Dec 14 21:34:04 localhost shepherd[1]: Enabled service conduit.=20 Dec 14 21:34:07 localhost shepherd[1]: Starting service user-homes...=20 Dec 14 21:34:07 localhost shepherd[1]: Service user-homes has been started.= =20 Dec 14 21:34:07 localhost shepherd[1]: Service user-homes started.=20 Dec 14 21:34:07 localhost shepherd[1]: Service user-homes running with valu= e #t.=20 Dec 14 21:34:07 localhost shepherd[1]: Starting service conduit...=20 Dec 14 21:34:07 localhost shepherd[1]: Service conduit has been started.=20 Dec 14 21:34:07 localhost shepherd[1]: Service conduit started.=20 Dec 14 21:34:07 localhost shepherd[1]: Service conduit running with value 1= 3226.=20 Dec 14 21:34:07 localhost shepherd[1]: [docker] conduit: [...] "IO error: W= hile open a file for appending: /var/lib/matrix-conduit/LOG: Permission den= ied" --8<---------------cut here---------------end--------------->8--- ...showing that Shepherd had at least tried to start the new container. The container is not running, though (due to the error shown above), and nothin= g with PID 13226 is running. The "herd start conduit" command did not return, and ^C-ing it did not help= . Afterwards, every "herd" command also hung without any output. Here are the last four lines of the output of "sudo strace -s1000 herd stat= us" on such a hung machine: --8<---------------cut here---------------start------------->8--- connect(10, {sa_family=3DAF_UNIX, sun_path=3D"/var/run/shepherd/socket"}, 2= 6) =3D 0 getcwd("/home/timo", 100) =3D 11 write(10, "(shepherd-command (version 0) (action status) (service root) (ar= guments ()) (directory \"/home/timo\"))", 101) =3D 101 read(10, --8<---------------cut here---------------end--------------->8--- The "read(10, " call never completes. At least in this case, Shepherd still seems to be processing inbound inet connections, so I can open new SSH connections to the machine. Attaching to PID 1 with strace shows it is stuck in "epoll_wait(13, " (unsurprisingly, fd 13 points to "anon_inode:[eventpoll]"). Here's a backtr= ace of all threads in "gdb -p 1": --8<---------------cut here---------------start------------->8--- (gdb) info threads Id Target Id Frame=20 * 1 Thread 0x7f786544c380 (LWP 1) "shepherd" 0x00007f7865552626 in = epoll_wait () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 2 Thread 0x7f7864e16640 (LWP 186) "GC-marker-0" 0x00007f78654cf16a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 3 Thread 0x7f7864615640 (LWP 187) "GC-marker-1" 0x00007f78654cf16a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 4 Thread 0x7f7863e14640 (LWP 188) "GC-marker-2" 0x00007f78654cf16a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 5 Thread 0x7f78634c6640 (LWP 190) "shepherd" 0x00007f786554300c in = read () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 (gdb) thread apply all bt Thread 5 (Thread 0x7f78634c6640 (LWP 190) "shepherd"): #0 0x00007f786554300c in read () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqc= k7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007f7865a48cc7 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #2 0x00007f78659427d1 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007f786594438c in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007f786594e83c in GC_do_blocking () from /gnu/store/k1ha4n9v8d7myii= szvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #5 0x00007f7865a65455 in scm_without_guile () from /gnu/store/n24l8hxn6nvb= 7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #6 0x00007f7865a4d570 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #7 0x00007f7865a71390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #8 0x00007f7865a7edb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #9 0x00007f78659e5b3e in scm_call_with_unblocked_asyncs () from /gnu/store= /n24l8hxn6nvb7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #10 0x00007f7865a71390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #11 0x00007f7865a7edb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #12 0x00007f7865a6b0f3 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #13 0x00007f78659e7e1a in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #14 0x00007f7865a71390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #15 0x00007f7865a7edb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #16 0x00007f78659e95ca in scm_call_2 () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #17 0x00007f7865a90092 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #18 0x00007f7865a6be1f in scm_c_catch () from /gnu/store/n24l8hxn6nvb7lz7zj= lyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #19 0x00007f78659ea396 in scm_c_with_continuation_barrier () from /gnu/stor= e/n24l8hxn6nvb7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #20 0x00007f7865a6b049 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #21 0x00007f786594e7fa in GC_call_with_stack_base () from /gnu/store/k1ha4n= 9v8d7myiiszvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #22 0x00007f7865a64c5d in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #23 0x00007f78654d23aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #24 0x00007f7865552f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 4 (Thread 0x7f7863e14640 (LWP 188) "GC-marker-2"): #0 0x00007f78654cf16a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007f78654d17e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007f7865948740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007f7865948897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007f78654d23aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007f7865552f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 3 (Thread 0x7f7864615640 (LWP 187) "GC-marker-1"): #0 0x00007f78654cf16a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007f78654d17e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007f7865948740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007f7865948897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007f78654d23aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007f7865552f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 2 (Thread 0x7f7864e16640 (LWP 186) "GC-marker-0"): #0 0x00007f78654cf16a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007f78654d17e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007f7865948740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007f7865948897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007f78654d23aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007f7865552f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 1 (Thread 0x7f786544c380 (LWP 1) "shepherd"): #0 0x00007f7865552626 in epoll_wait () from /gnu/store/ln6hxqjvz6m9gdd9s97= pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007f7862bb9335 in ?? () from /gnu/store/h4nsywbhn8b4qyh40fhykk3q40q= kr3wd-guile-fibers-1.3.1/lib/guile/3.0/extensions/fibers-epoll.so #2 0x00007f78659427d1 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007f786594438c in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007f786594e83c in GC_do_blocking () from /gnu/store/k1ha4n9v8d7myii= szvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #5 0x00007f7865a65455 in scm_without_guile () from /gnu/store/n24l8hxn6nvb= 7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #6 0x00007f7862bb96ce in ?? () from /gnu/store/h4nsywbhn8b4qyh40fhykk3q40q= kr3wd-guile-fibers-1.3.1/lib/guile/3.0/extensions/fibers-epoll.so #7 0x00007f78606246c2 in ?? () #8 0x00007f78620ba628 in ?? () #9 0x00007f7860627610 in ?? () #10 0x00007f786520ad80 in ?? () #11 0x00007f7865a14edc in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #12 0x00007f7865a71215 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #13 0x00007f7865a7edb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #14 0x00007f78659e9977 in scm_primitive_eval () from /gnu/store/n24l8hxn6nv= b7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #15 0x00007f7865a1dff9 in scm_primitive_load () from /gnu/store/n24l8hxn6nv= b7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #16 0x00007f7865a71390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #17 0x00007f7865a7edb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #18 0x00007f78659e9977 in scm_primitive_eval () from /gnu/store/n24l8hxn6nv= b7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #19 0x00007f78659ef846 in scm_eval () from /gnu/store/n24l8hxn6nvb7lz7zjlyd= 7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #20 0x00007f7865a4e3e6 in scm_shell () from /gnu/store/n24l8hxn6nvb7lz7zjly= d7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #21 0x00007f7865a008cc in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #22 0x00007f78659e7e1a in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #23 0x00007f7865a71390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #24 0x00007f7865a7edb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #25 0x00007f78659e95ca in scm_call_2 () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #26 0x00007f7865a90092 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #27 0x00007f7865a6be1f in scm_c_catch () from /gnu/store/n24l8hxn6nvb7lz7zj= lyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #28 0x00007f78659ea396 in scm_c_with_continuation_barrier () from /gnu/stor= e/n24l8hxn6nvb7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #29 0x00007f7865a6b049 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #30 0x00007f786594e7fa in GC_call_with_stack_base () from /gnu/store/k1ha4n= 9v8d7myiiszvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #31 0x00007f7865a653f8 in scm_with_guile () from /gnu/store/n24l8hxn6nvb7lz= 7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #32 0x00007f7865a098e5 in scm_boot_guile () from /gnu/store/n24l8hxn6nvb7lz= 7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #33 0x00000000004010f7 in ?? () #34 0x00007f78654761f7 in __libc_start_call_main () from /gnu/store/ln6hxqj= vz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #35 0x00007f78654762ac in __libc_start_main_impl () from /gnu/store/ln6hxqj= vz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #36 0x0000000000401171 in ?? () --8<---------------cut here---------------end--------------->8--- Unrelatedly, I also have another Shepherd on a different machine that becam= e stuck after I ran a bunch of "guix system reconfigure" commands. The backtraces there, if it helps: --8<---------------cut here---------------start------------->8--- (gdb) info threads=20 Id Target Id Frame=20 * 1 Thread 0x7ffaceef2380 (LWP 1) "shepherd" 0x00007fface938626 in = epoll_wait () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 2 Thread 0x7fface1aa640 (LWP 231) "GC-marker-0" 0x00007fface8b516a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 3 Thread 0x7ffacd9a9640 (LWP 232) "GC-marker-1" 0x00007fface8b516a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 4 Thread 0x7ffacd1a8640 (LWP 233) "GC-marker-2" 0x00007fface8b516a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 5 Thread 0x7ffacc9a7640 (LWP 234) "GC-marker-3" 0x00007fface8b516a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 6 Thread 0x7ffacc1a6640 (LWP 235) "GC-marker-4" 0x00007fface8b516a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 7 Thread 0x7ffacb9a5640 (LWP 236) "GC-marker-5" 0x00007fface8b516a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 8 Thread 0x7ffacb1a4640 (LWP 237) "GC-marker-6" 0x00007fface8b516a in = __futex_abstimed_wait_common () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 9 Thread 0x7ffaca832640 (LWP 249) "shepherd" 0x00007fface92900c in = read () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 10 Thread 0x7ffac89ca640 (LWP 26693) "shepherd" 0x00007fface92900c in = read () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.= 6 (gdb) thread apply all bt Thread 10 (Thread 0x7ffac89ca640 (LWP 26693) "shepherd"): #0 0x00007fface92900c in read () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqc= k7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007ffacedf0e57 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #2 0x00007ffaced3c7d1 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced3e38c in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007ffaced4883c in GC_do_blocking () from /gnu/store/k1ha4n9v8d7myii= szvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #5 0x00007ffacee62455 in scm_without_guile () from /gnu/store/n24l8hxn6nvb= 7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #6 0x00007ffacedf903d in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #7 0x00007ffacede4e1a in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #8 0x00007ffac6832022 in ?? () #9 0x00007fface4d97f0 in ?? () #10 0x00007ffac94766c0 in ?? () #11 0x00007fface5f4b40 in ?? () #12 0x00007ffacee11edc in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #13 0x00007ffacee6e215 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #14 0x00007ffacee7bdb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #15 0x00007ffacede65ca in scm_call_2 () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #16 0x00007ffacee8d092 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #17 0x00007ffacee68e1f in scm_c_catch () from /gnu/store/n24l8hxn6nvb7lz7zj= lyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #18 0x00007ffacede7396 in scm_c_with_continuation_barrier () from /gnu/stor= e/n24l8hxn6nvb7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #19 0x00007ffacee68049 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #20 0x00007ffaced487fa in GC_call_with_stack_base () from /gnu/store/k1ha4n= 9v8d7myiiszvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #21 0x00007ffacee623f8 in scm_with_guile () from /gnu/store/n24l8hxn6nvb7lz= 7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #22 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #23 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 9 (Thread 0x7ffaca832640 (LWP 249) "shepherd"): #0 0x00007fface92900c in read () from /gnu/store/ln6hxqjvz6m9gdd9s97pivlqc= k7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007ffacee45cc7 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #2 0x00007ffaced3c7d1 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced3e38c in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007ffaced4883c in GC_do_blocking () from /gnu/store/k1ha4n9v8d7myii= szvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #5 0x00007ffacee62455 in scm_without_guile () from /gnu/store/n24l8hxn6nvb= 7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #6 0x00007ffacee4a570 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #7 0x00007ffacee6e390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #8 0x00007ffacee7bdb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #9 0x00007ffacede2b3e in scm_call_with_unblocked_asyncs () from /gnu/store= /n24l8hxn6nvb7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #10 0x00007ffacee6e390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #11 0x00007ffacee7bdb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #12 0x00007ffacee680f3 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #13 0x00007ffacede4e1a in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #14 0x00007ffacee6e390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #15 0x00007ffacee7bdb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #16 0x00007ffacede65ca in scm_call_2 () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #17 0x00007ffacee8d092 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #18 0x00007ffacee68e1f in scm_c_catch () from /gnu/store/n24l8hxn6nvb7lz7zj= lyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #19 0x00007ffacede7396 in scm_c_with_continuation_barrier () from /gnu/stor= e/n24l8hxn6nvb7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #20 0x00007ffacee68049 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #21 0x00007ffaced487fa in GC_call_with_stack_base () from /gnu/store/k1ha4n= 9v8d7myiiszvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #22 0x00007ffacee61c5d in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #23 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #24 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 8 (Thread 0x7ffacb1a4640 (LWP 237) "GC-marker-6"): #0 0x00007fface8b516a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007fface8b77e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007ffaced42740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced42897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 7 (Thread 0x7ffacb9a5640 (LWP 236) "GC-marker-5"): #0 0x00007fface8b516a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007fface8b77e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 --Type for more, q to quit, c to continue without paging--c #2 0x00007ffaced42740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced42897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 6 (Thread 0x7ffacc1a6640 (LWP 235) "GC-marker-4"): #0 0x00007fface8b516a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007fface8b77e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007ffaced42740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced42897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 5 (Thread 0x7ffacc9a7640 (LWP 234) "GC-marker-3"): #0 0x00007fface8b516a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007fface8b77e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007ffaced42740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced42897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 4 (Thread 0x7ffacd1a8640 (LWP 233) "GC-marker-2"): #0 0x00007fface8b516a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007fface8b77e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007ffaced42740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced42897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 3 (Thread 0x7ffacd9a9640 (LWP 232) "GC-marker-1"): #0 0x00007fface8b516a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007fface8b77e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007ffaced42740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced42897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 2 (Thread 0x7fface1aa640 (LWP 231) "GC-marker-0"): #0 0x00007fface8b516a in __futex_abstimed_wait_common () from /gnu/store/l= n6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007fface8b77e8 in pthread_cond_wait@@GLIBC_2.3.2 () from /gnu/store= /ln6hxqjvz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #2 0x00007ffaced42740 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced42897 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007fface8b83aa in start_thread () from /gnu/store/ln6hxqjvz6m9gdd9s= 97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #5 0x00007fface938f7c in clone3 () from /gnu/store/ln6hxqjvz6m9gdd9s97pivl= qck7hzs99-glibc-2.35/lib/libc.so.6 Thread 1 (Thread 0x7ffaceef2380 (LWP 1) "shepherd"): #0 0x00007fface938626 in epoll_wait () from /gnu/store/ln6hxqjvz6m9gdd9s97= pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #1 0x00007ffac9efc335 in ?? () from /gnu/store/h4nsywbhn8b4qyh40fhykk3q40q= kr3wd-guile-fibers-1.3.1/lib/guile/3.0/extensions/fibers-epoll.so #2 0x00007ffaced3c7d1 in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #3 0x00007ffaced3e38c in ?? () from /gnu/store/k1ha4n9v8d7myiiszvl2ic7xnb5= 6l219-libgc-8.2.2/lib/libgc.so.1 #4 0x00007ffaced4883c in GC_do_blocking () from /gnu/store/k1ha4n9v8d7myii= szvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #5 0x00007ffacee62455 in scm_without_guile () from /gnu/store/n24l8hxn6nvb= 7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #6 0x00007ffac9efc6ce in ?? () from /gnu/store/h4nsywbhn8b4qyh40fhykk3q40q= kr3wd-guile-fibers-1.3.1/lib/guile/3.0/extensions/fibers-epoll.so #7 0x00007ffac76416c2 in ?? () #8 0x00007ffac934f594 in ?? () #9 0x00007ffac9476d83 in ?? () #10 0x00007fface5f4d80 in ?? () #11 0x00007ffacee11edc in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #12 0x00007ffacee6e652 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #13 0x00007ffacee7bdb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #14 0x00007ffacede6977 in scm_primitive_eval () from /gnu/store/n24l8hxn6nv= b7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #15 0x00007ffacee1aff9 in scm_primitive_load () from /gnu/store/n24l8hxn6nv= b7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #16 0x00007ffacee6e390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #17 0x00007ffacee7bdb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #18 0x00007ffacede6977 in scm_primitive_eval () from /gnu/store/n24l8hxn6nv= b7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #19 0x00007ffacedec846 in scm_eval () from /gnu/store/n24l8hxn6nvb7lz7zjlyd= 7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #20 0x00007ffacee4b3e6 in scm_shell () from /gnu/store/n24l8hxn6nvb7lz7zjly= d7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #21 0x00007ffacedfd8cc in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #22 0x00007ffacede4e1a in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #23 0x00007ffacee6e390 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #24 0x00007ffacee7bdb5 in scm_call_n () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #25 0x00007ffacede65ca in scm_call_2 () from /gnu/store/n24l8hxn6nvb7lz7zjl= yd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #26 0x00007ffacee8d092 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #27 0x00007ffacee68e1f in scm_c_catch () from /gnu/store/n24l8hxn6nvb7lz7zj= lyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #28 0x00007ffacede7396 in scm_c_with_continuation_barrier () from /gnu/stor= e/n24l8hxn6nvb7lz7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #29 0x00007ffacee68049 in ?? () from /gnu/store/n24l8hxn6nvb7lz7zjlyd7i05kh= rm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #30 0x00007ffaced487fa in GC_call_with_stack_base () from /gnu/store/k1ha4n= 9v8d7myiiszvl2ic7xnb56l219-libgc-8.2.2/lib/libgc.so.1 #31 0x00007ffacee623f8 in scm_with_guile () from /gnu/store/n24l8hxn6nvb7lz= 7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #32 0x00007ffacee068e5 in scm_boot_guile () from /gnu/store/n24l8hxn6nvb7lz= 7zjlyd7i05khrm0i4-guile-3.0.9/lib/libguile-3.0.so.1 #33 0x00000000004010f7 in ?? () #34 0x00007fface85c1f7 in __libc_start_call_main () from /gnu/store/ln6hxqj= vz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #35 0x00007fface85c2ac in __libc_start_main_impl () from /gnu/store/ln6hxqj= vz6m9gdd9s97pivlqck7hzs99-glibc-2.35/lib/libc.so.6 #36 0x0000000000401171 in ?? () --8<---------------cut here---------------end--------------->8--- From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" Resent-From: Attila Lendvai Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 15 Dec 2023 19:49:03 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Timo Wilken Cc: 67538@debbugs.gnu.org, 67230@debbugs.gnu.org, 65178@debbugs.gnu.org Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170266968619781 (code B ref 67538); Fri, 15 Dec 2023 19:49:03 +0000 Received: (at 67538) by debbugs.gnu.org; 15 Dec 2023 19:48:06 +0000 Received: from localhost ([127.0.0.1]:53491 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rEEAH-00058s-Nv for submit@debbugs.gnu.org; Fri, 15 Dec 2023 14:48:06 -0500 Received: from mail-4317.proton.ch ([185.70.43.17]:57179) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rEEAE-00056J-NM; Fri, 15 Dec 2023 14:48:04 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lendvai.name; s=protonmail; t=1702669675; x=1702928875; bh=O8Z3rqp1bdi18fahdJZnfCQzQ4NCgGCQqp1S/S/neYw=; h=Date:To:From:Cc:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=gdEhyJyGXl56Sjkhk+h7wCtMaga8Nl3yGKKJDLK6qxmTGtwM969s+rOBZ0OM+HAg8 LDARHBY1RgkkYeV0UCtXyKTcPesaq1GE+tmiSzA5je3Kbw8/+LjsYG4sGSlQr6e9rf w4R0fJG4iWEDGANBGWa568FZClDTt51UryatSEatkBl/bv0FJBuKS4gSciQkKUNwUS oL9hitR/+Plt3IshHh/ZPexEfr7iYuHkyOnO+lyrH3ytt8s8gAChRz/FqcQUMLC+Cp Fhi1LjlmV9FqSbKm3kW4kAKoGTs4/ZRtRZ0b8P7CIgIe687rx/r6ZXeDF56tAOVBEq 0GYZbSz8wCOAw== Date: Fri, 15 Dec 2023 19:47:43 +0000 From: Attila Lendvai Message-ID: In-Reply-To: References: Feedback-ID: 28384833:user:proton MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) i think i have found the root cause of this, as documented here: https://is= sues.guix.gnu.org/67839 that issue contains patches for shepherd to reproduce it in its test suite. --=20 =E2=80=A2 attila lendvai =E2=80=A2 PGP: 963F 5D5F 45C7 DFCD 0A39 -- =E2=80=9CWhat divides libertarians from everybody else is not a belief abou= t rights or what rights people have, because the judgments libertarians mak= e about the state are the same as the judgments almost everyone makes about= private agents. So it's not that we believe in rights that other people do= n't believe in, or that other people believe in rights that we don't believ= e in. It's that other people think the state is exempt from the moral princ= iples that apply to non-government agents.=E2=80=9D =09=E2=80=94 Michael Huemer From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" Resent-From: "Timo Wilken" Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 15 Dec 2023 20:34:03 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: "Attila Lendvai" Cc: 67538@debbugs.gnu.org, 67230@debbugs.gnu.org, 67839@debbugs.gnu.org, 65178@debbugs.gnu.org Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170267243622561 (code B ref 67538); Fri, 15 Dec 2023 20:34:03 +0000 Received: (at 67538) by debbugs.gnu.org; 15 Dec 2023 20:33:56 +0000 Received: from localhost ([127.0.0.1]:53593 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rEEse-0005rn-C6 for submit@debbugs.gnu.org; Fri, 15 Dec 2023 15:33:56 -0500 Received: from mx2.mythic-beasts.com ([2a00:1098:0:82:1000:0:2:1]:39599) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rEEsb-0005rP-8t; Fri, 15 Dec 2023 15:33:54 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=twilken.net ; s=mythic-beasts-k1; h=To:From:Subject:Date; bh=jC0InzQ7oEP9Z7WFVgDGj++WwCHyrN863tnSo3uvUWU=; b=rBeynNr3NeGoKZ+sKMQHfaYS8q HNj4tq/4ZJvYcwhEn++Vpw8d9TYIKUBVYDxoI1UQTlyskwz92mRudiXkMdB9VB9Zp09cwvELWd00o HwDPiHLQGSD8rp4tphQREpUuoVi8yv9HFahxbFzSmJ6ujzVWerLWrzugacwNwwKO7IHxoUmjs8wGN Qomf/YfAF+YZNvAoq+PvUoNMu2/OG2MjSbk/AjJX1xchl8aE58VEEESOARZq1l70zrzHe7D+KqhVX 3P5qgi7Qyx/5xzRrbqeuIaaWy3Kl7L4XHFmS65IAV+s+Rwsg663Z8ELRb6USEjDKdmem+ATwOlVrW twoeT0Nw==; Received: by mailhub-hex-d.mythic-beasts.com with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rEEsT-0019KS-Ny; Fri, 15 Dec 2023 20:33:46 +0000 Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=UTF-8 Date: Fri, 15 Dec 2023 21:33:15 +0100 From: "Timo Wilken" Message-Id: X-Mailer: aerc 0.15.2 References: In-Reply-To: X-BlackCat-Spam-Score: 7 X-Spam-Status: No, score=0.7 X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Fri Dec 15, 2023 at 8:47 PM CET, Attila Lendvai wrote: > i think i have found the root cause of this, as documented here: https://= issues.guix.gnu.org/67839 > > that issue contains patches for shepherd to reproduce it in its test suit= e. Thank you very much for this, Attila! Are the patch in 67839 and/or your branch "attila" linked from there in a state that I could test them locally? Would it be valuable to you if I ran = a patched Shepherd and sent logs and/or backtraces as I encountered them? From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: Shepherd stops responding during "guix system reconfigure" Resent-From: Attila Lendvai Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 15 Dec 2023 21:25:05 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Timo Wilken Cc: 67538@debbugs.gnu.org, 67230@debbugs.gnu.org, 67839@debbugs.gnu.org, 65178@debbugs.gnu.org Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170267549125539 (code B ref 67538); Fri, 15 Dec 2023 21:25:05 +0000 Received: (at 67538) by debbugs.gnu.org; 15 Dec 2023 21:24:51 +0000 Received: from localhost ([127.0.0.1]:53676 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rEFfv-0006dq-BD for submit@debbugs.gnu.org; Fri, 15 Dec 2023 16:24:51 -0500 Received: from mail-4323.proton.ch ([185.70.43.23]:56601) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rEFfs-0006dP-A4 for 67538@debbugs.gnu.org; Fri, 15 Dec 2023 16:24:50 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lendvai.name; s=protonmail; t=1702675480; x=1702934680; bh=y3yAYaeQdcJALa8ThMhZGisB2wRnQmTrZGz2x9iZ8K0=; h=Date:To:From:Cc:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=aB4FHXQE24zHZx2Ff3xO1GVshSHX9h9s09FakwGFwp2WA2s3PS+7lI1pJZRf6Yj2A Xbdr1EXGaKzTF1t0HDK0QbbpPxamHBGtMxmZcUqpiM8r6dawoYB5lxaWQ0/UCp3rLy CnEgrfrHvxPAldF0+0zjLNmgjtp3B7c7FgAAvDfdpIQ2/wOwnwizlfWtrITzD6VVQb 0REsYCFtH2oCFRZoOWUrZFIl9lN668bNiu5EQz5c9MOD2OsG2mXuaZVgBC+m9gGYrX cUQSrBEguWJYI/pVGBDW+17Hb4IOZ+Uy2oRE0iKUT0+pNvUgD9mobEvcFKZHia013a JkyxW2hUZDgUQ== Date: Fri, 15 Dec 2023 21:24:15 +0000 From: Attila Lendvai Message-ID: In-Reply-To: References: Feedback-ID: 28384833:user:proton MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) > Thank you very much for this, Attila! you're welcome! :) > Are the patch in 67839 and/or your branch "attila" linked from there in a > state that I could test them locally? Would it be valuable to you if I ra= n a > patched Shepherd and sent logs and/or backtraces as I encountered them? it's nice of you, but not really. now that we have a failing test case in s= hepherd's unit tests that can reproduce it much easier. with #67839 you would only get you an extra "Assertion failed" message over= master, without much useful output. as for my branch, it would emit a lot of useful log, including backtraces, = but i keep force-pushing into it. i'm running my servers with it, though, s= o if you feel really adventurous, and want to join the debugging, then you = can try... otherwise it's too much in flux. what we need to focus on now is making shepherd's test suite run clean agai= n, one way or another. then i can test it in a real life environment, and r= eport back with any possible findings. --=20 =E2=80=A2 attila lendvai =E2=80=A2 PGP: 963F 5D5F 45C7 DFCD 0A39 -- =E2=80=9CIgnorance might be bliss for the ignorant, but for the rest of us = it's a fucking pain in the ass.=E2=80=9D =09=E2=80=94 Ricky Gervais From unknown Sun Jun 22 04:34:35 2025 X-Loop: help-debbugs@gnu.org Subject: bug#67538: bug#65419: [Shepherd] Non-responding service control fiber Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 19 Dec 2023 23:01:04 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 67538 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Attila Lendvai Cc: 65419@debbugs.gnu.org, 67538@debbugs.gnu.org, 67230@debbugs.gnu.org, 65178@debbugs.gnu.org, Timo Wilken Received: via spool by 67538-submit@debbugs.gnu.org id=B67538.170302686312482 (code B ref 67538); Tue, 19 Dec 2023 23:01:04 +0000 Received: (at 67538) by debbugs.gnu.org; 19 Dec 2023 23:01:03 +0000 Received: from localhost ([127.0.0.1]:37905 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rFj5C-0003ER-6M for submit@debbugs.gnu.org; Tue, 19 Dec 2023 18:01:02 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:60394) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rFj58-0002z6-Bk; Tue, 19 Dec 2023 18:00:59 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rFj4y-0001GS-Ln; Tue, 19 Dec 2023 18:00:48 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=w63XYmztouUSzqY1oreGa6rT5OCUyf/8O1Q2DFXvZco=; b=sDf917C7Prk+nbOdBFgI BkJm/o/FPyW/WoNhmOgRuej/q6od7QzGRAZaCG5uFgjjtQ+u3W9Oq8c5xh+YcXzL49or/iqZAqEHk DJS18HV/xPnOQN6ljccRAywZxukB+iJMk79vOY0NjhLSZcmkdkolvuQdBJfYxx65GMr57oYSiTjZB lQFnlbvOHIeVZv9J3eb0wiPF1nIJonnXjuK/buzfuUvqyQxOiMMFyKeQb5i6o2j58kakdDxVGqwex EPK5UxZnQQEhjBHvp9o/viyF0NIdP1TDsiQgaF7qg33r3VyFBtH3QWdf6uPPY6WqhxZZj2ApmYPIf w1c2qnEOV02UTw==; From: Ludovic =?UTF-8?Q?Court=C3=A8s?= In-Reply-To: (Attila Lendvai's message of "Fri, 15 Dec 2023 19:47:43 +0000") References: Date: Wed, 20 Dec 2023 00:00:36 +0100 Message-ID: <87plz1hk6j.fsf_-_@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, Attila Lendvai skribis: > i think i have found the root cause of this, as documented here: https://= issues.guix.gnu.org/67839 > > that issue contains patches for shepherd to reproduce it in its test suit= e. Yes, it looks like this long-standing and hard-to-debug issue may well be fixed now, thumbs up Attila!! We have accumulated quite a few fixes by now so I think I=E2=80=99ll release 0.10.3 hopefully in 2023 and otherwise soon after. Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Sun Jan 07 05:36:06 2024 Received: (at control) by debbugs.gnu.org; 7 Jan 2024 10:36:06 +0000 Received: from localhost ([127.0.0.1]:60664 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rMQVi-0001G4-Cx for submit@debbugs.gnu.org; Sun, 07 Jan 2024 05:36:06 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:59384) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rMQVg-0001FZ-He for control@debbugs.gnu.org; Sun, 07 Jan 2024 05:36:05 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rMQVV-00037k-Jq for control@debbugs.gnu.org; Sun, 07 Jan 2024 05:35:53 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-version:Subject:From:To:Date:in-reply-to: references; bh=SMCoYeTTSg852CN/7fMWs/YJZ4am0OEcUt/tqDXi07k=; b=MqnuEPbDCT2ots gxzVclvbBk2EL+rVnH4Quf+ULrFRnPZlXjw7CBi3pnR05ZUR7j0u7Rw99XzTQLJ1503Cf6ARVB3Ji 0aU1Ex46hHyGhB4N4qDbkb1KQ1B50TVxKHzNNTFdDrWfMSZcscoIeltrFJisZfsFKWNDhZJmtUBbQ ELhJfX/yZfnHaAl4WLJZI//WTUnxFhvhbIcSgFaqsD/cz+fZoxQSfu75zKpcjOB2x663k6ZZZTXRd HY+/RQ0u7czX26pu5fHVAyC1NVuGfTclVfXRQ1Z3ydl8TyjgyEe5nXKFsSra+JW+aY2fSPIz2nw6O dRhsQlTun4qYGPHxoBfw==; Date: Sun, 07 Jan 2024 11:35:50 +0100 Message-Id: <87le91e8hl.fsf@gnu.org> To: control@debbugs.gnu.org From: =?utf-8?Q?Ludovic_Court=C3=A8s?= Subject: control message for bug #67538 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) close 67538 quit