Subject: [cuirass] cuirass-web crashes, nginx returns 502

From: Maxim Cournoyer <[email-masked]>
Date: Fri, 11 Oct 2024 11:07:58 +0900

Hi,

It's been a few days since Cuirass appears to frequently go down (at
least its web interface), causing the web server to return 502
errors. Looking at /var/log/cuirass-web.log on berlin, we see:

--8<---------------cut here---------------start------------->8---
2024-10-08 22:26:12 pool 'database' (7f5ea788b8d0): 2% contention (5031/236527)
2024-10-08 22:26:12 pool 'bridge-connection' (7f5ea7669c90): 0% contention (0/940)
2024-10-08 22:26:52 GET /
2024-10-08 22:27:01 warning: getting evaluations absolute summaries took 8.95831 seconds
2024-10-08 22:27:07 GET /search
2024-10-08 22:27:09 job search request took 0.805779 seconds
2024-10-08 22:27:20 GET /sites/favicon.ico
2024-10-08 22:27:23 GET /sites/favicon.png
2024-10-08 22:27:26 GET /workers
2024-10-08 22:27:27 GET /build/6042227/details
2024-10-08 22:27:27 GET /build/6037987/details
2024-10-08 22:27:37 GET /build/514481/log
2024-10-08 22:27:44 GET /build/2276728/log/raw
2024-10-08 22:27:46 GET /build/1228573/log
2024-10-08 22:27:54 GET /build/537230/log/raw
2024-10-08 22:28:07 GET /build/326759/log
2024-10-08 22:28:09 GET /build/329285/details
2024-10-08 22:28:12 GET /build/326759/restart
2024-10-08 22:28:59 GET /build/1199473/log/raw
2024-10-08 22:29:10 GET /build/1402193/restart
2024-10-08 22:29:18 GET /build/1939620/log
2024-10-08 22:29:19 GET /build/2355642/log/raw
2024-10-08 22:29:20 GET /build/1370278/details
2024-10-08 22:29:24 GET /
2024-10-08 22:29:28 GET /build/422349/details
2024-10-08 22:29:30 GET /build/2025024/log/raw
2024-10-08 22:29:31 GET /build/589716/restart
2024-10-11 00:16:27 running Fibers on 4 kernel threads
2024-10-11 00:16:27 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:27 listening on 127.0.0.1:8081
2024-10-11 00:16:27 error: fatal: uncaught exception 'system-error' in 'web' fiber!
2024-10-11 00:16:27 error: exception arguments: ("connect" "~A" ("No such file or directory") (2))
2024-10-11 00:16:27 heap: 12.18 MiB; threads: 9; file descriptors: 44
2024-10-11 00:16:27 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:27 In fibers.scm:
2024-10-11 00:16:27      78:4 19 (%run-fibers _ 10 #<procedure finished? ()> _)
2024-10-11 00:16:27 In fibers/interrupts.scm:
2024-10-11 00:16:27      69:4 18 (with-interrupts/thread-cputime _ _ #<procedure yield-?> ?)
2024-10-11 00:16:27 In fibers/scheduler.scm:
2024-10-11 00:16:27    305:26 17 (run-scheduler #<<scheduler> events-impl: #<<epoll> fd?> ?)
2024-10-11 00:16:27 In ice-9/boot-9.scm:
2024-10-11 00:16:27   1747:15 16 (with-exception-handler #<procedure 7f8b1a763ea0 at ic?> ?)
2024-10-11 00:16:27   1752:10 15 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:27 In fibers/scheduler.scm:
2024-10-11 00:16:27    269:10 14 (next-task)
2024-10-11 00:16:27 In fibers.scm:
2024-10-11 00:16:27     172:8 13 (_)
2024-10-11 00:16:27 In ice-9/boot-9.scm:
2024-10-11 00:16:27   1747:15 12 (with-exception-handler #<procedure 7f8b1a763b40 at ic?> ?)
2024-10-11 00:16:27   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:27 In cuirass/http.scm:
2024-10-11 00:16:27   1494:29 10 (run-cuirass-server #:host _ #:port _ # _)
2024-10-11 00:16:27 In srfi/srfi-1.scm:
2024-10-11 00:16:27    548:20  9 (unfold #<procedure 7f8b156a8360 at cuirass/http.scm:1?> ?)
2024-10-11 00:16:27 In cuirass/http.scm:
2024-10-11 00:16:27    1482:7  8 (_ _)
2024-10-11 00:16:27 In ice-9/suspendable-ports.scm:
2024-10-11 00:16:27    741:14  7 (_ #<input-output: socket 43> _ . _)
2024-10-11 00:16:27 In unknown file:
2024-10-11 00:16:27            6 (connect #<input-output: socket 43> 1 "/var/run/cuirass?")
2024-10-11 00:16:27 In ice-9/boot-9.scm:
2024-10-11 00:16:27   1685:16  5 (raise-exception _ #:continuable? _)
2024-10-11 00:16:27   1780:13  4 (_ #<&compound-exception components: (#<&external-error?>)
2024-10-11 00:16:27    2137:6  3 (_ _ . _)
2024-10-11 00:16:27   1747:15  2 (with-exception-handler #<procedure 7f8b1a7630c0 at ic?> ?)
2024-10-11 00:16:27 In cuirass/utils.scm:
2024-10-11 00:16:27    212:23  1 (_)
2024-10-11 00:16:27 In unknown file:
2024-10-11 00:16:27            0 (make-stack #t)
2024-10-11 00:16:27 ERROR: In procedure make-stack:
2024-10-11 00:16:27 In procedure connect: No such file or directory
2024-10-11 00:16:27 running Fibers on 4 kernel threads
2024-10-11 00:16:28 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:28 listening on 127.0.0.1:8081
2024-10-11 00:16:28 error: fatal: uncaught exception 'system-error' in 'web' fiber!
2024-10-11 00:16:28 error: exception arguments: ("connect" "~A" ("No such file or directory") (2))
2024-10-11 00:16:28 heap: 12.18 MiB; threads: 9; file descriptors: 44
2024-10-11 00:16:28 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:28 In fibers.scm:
2024-10-11 00:16:28      78:4 19 (%run-fibers _ 10 #<procedure finished? ()> _)
2024-10-11 00:16:28 In fibers/interrupts.scm:
2024-10-11 00:16:28      69:4 18 (with-interrupts/thread-cputime _ _ #<procedure yield-?> ?)
2024-10-11 00:16:28 In fibers/scheduler.scm:
2024-10-11 00:16:28    305:26 17 (run-scheduler #<<scheduler> events-impl: #<<epoll> fd?> ?)
2024-10-11 00:16:28 In ice-9/boot-9.scm:
2024-10-11 00:16:28   1747:15 16 (with-exception-handler #<procedure 7f1953e48f30 at ic?> ?)
2024-10-11 00:16:28   1752:10 15 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:28 In fibers/scheduler.scm:
2024-10-11 00:16:28    269:10 14 (next-task)
2024-10-11 00:16:28 In fibers.scm:
2024-10-11 00:16:28     172:8 13 (_)
2024-10-11 00:16:28 In ice-9/boot-9.scm:
2024-10-11 00:16:28   1747:15 12 (with-exception-handler #<procedure 7f1953e48de0 at ic?> ?)
2024-10-11 00:16:28   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:28 In cuirass/http.scm:
2024-10-11 00:16:28   1494:29 10 (run-cuirass-server #:host _ #:port _ # _)
2024-10-11 00:16:28 In srfi/srfi-1.scm:
2024-10-11 00:16:28    548:20  9 (unfold #<procedure 7f194e5c8360 at cuirass/http.scm:1?> ?)
2024-10-11 00:16:28 In cuirass/http.scm:
2024-10-11 00:16:28    1482:7  8 (_ _)
2024-10-11 00:16:28 In ice-9/suspendable-ports.scm:
2024-10-11 00:16:28    741:14  7 (_ #<input-output: socket 43> _ . _)
2024-10-11 00:16:28 In unknown file:
2024-10-11 00:16:28            6 (connect #<input-output: socket 43> 1 "/var/run/cuirass?")
2024-10-11 00:16:28 In ice-9/boot-9.scm:
2024-10-11 00:16:28   1685:16  5 (raise-exception _ #:continuable? _)
2024-10-11 00:16:28   1780:13  4 (_ #<&compound-exception components: (#<&external-error?>)
2024-10-11 00:16:28    2137:6  3 (_ _ . _)
2024-10-11 00:16:28   1747:15  2 (with-exception-handler #<procedure 7f194ed159f0 at ic?> ?)
2024-10-11 00:16:28 In cuirass/utils.scm:
2024-10-11 00:16:28    212:23  1 (_)
2024-10-11 00:16:28 In unknown file:
2024-10-11 00:16:28            0 (make-stack #t)
2024-10-11 00:16:28 ERROR: In procedure make-stack:
2024-10-11 00:16:28 In procedure connect: No such file or directory
2024-10-11 00:16:28 running Fibers on 4 kernel threads
2024-10-11 00:16:28 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:28 listening on 127.0.0.1:8081
2024-10-11 00:16:28 error: fatal: uncaught exception 'system-error' in 'web' fiber!
2024-10-11 00:16:28 error: exception arguments: ("connect" "~A" ("No such file or directory") (2))
2024-10-11 00:16:28 In fibers.scm:
2024-10-11 00:16:28 heap: 12.18 MiB; threads: 9; file descriptors: 44
2024-10-11 00:16:28 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:28      78:4 19 (%run-fibers _ 10 #<procedure finished? ()> _)
2024-10-11 00:16:28 In fibers/interrupts.scm:
2024-10-11 00:16:28      69:4 18 (with-interrupts/thread-cputime _ _ #<procedure yield-?> ?)
2024-10-11 00:16:28 In fibers/scheduler.scm:
2024-10-11 00:16:28    305:26 17 (run-scheduler #<<scheduler> events-impl: #<<epoll> fd?> ?)
2024-10-11 00:16:28 In ice-9/boot-9.scm:
2024-10-11 00:16:28   1747:15 16 (with-exception-handler #<procedure 7fa3a04f5f30 at ic?> ?)
2024-10-11 00:16:28   1752:10 15 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:28 In fibers/scheduler.scm:
2024-10-11 00:16:28    269:10 14 (next-task)
2024-10-11 00:16:28 In fibers.scm:
2024-10-11 00:16:28     172:8 13 (_)
2024-10-11 00:16:28 In ice-9/boot-9.scm:
2024-10-11 00:16:28   1747:15 12 (with-exception-handler #<procedure 7fa3a04f5de0 at ic?> ?)
2024-10-11 00:16:28   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:28 In cuirass/http.scm:
2024-10-11 00:16:28   1494:29 10 (run-cuirass-server #:host _ #:port _ # _)
2024-10-11 00:16:28 In srfi/srfi-1.scm:
2024-10-11 00:16:28    548:20  9 (unfold #<procedure 7fa39b59b360 at cuirass/http.scm:1?> ?)
2024-10-11 00:16:28 In cuirass/http.scm:
2024-10-11 00:16:28    1482:7  8 (_ _)
2024-10-11 00:16:28 In ice-9/suspendable-ports.scm:
2024-10-11 00:16:28    741:14  7 (_ #<input-output: socket 43> _ . _)
2024-10-11 00:16:28 In unknown file:
2024-10-11 00:16:28            6 (connect #<input-output: socket 43> 1 "/var/run/cuirass?")
2024-10-11 00:16:28 In ice-9/boot-9.scm:
2024-10-11 00:16:28   1685:16  5 (raise-exception _ #:continuable? _)
2024-10-11 00:16:28   1780:13  4 (_ #<&compound-exception components: (#<&external-error?>)
2024-10-11 00:16:28    2137:6  3 (_ _ . _)
2024-10-11 00:16:28   1747:15  2 (with-exception-handler #<procedure 7fa39be229f0 at ic?> ?)
2024-10-11 00:16:28 In cuirass/utils.scm:
2024-10-11 00:16:28    212:23  1 (_)
2024-10-11 00:16:28 In unknown file:
2024-10-11 00:16:28            0 (make-stack #t)
2024-10-11 00:16:28 ERROR: In procedure make-stack:
2024-10-11 00:16:28 In procedure connect: No such file or directory
2024-10-11 00:16:29 running Fibers on 4 kernel threads
2024-10-11 00:16:29 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:29 listening on 127.0.0.1:8081
2024-10-11 00:16:29 error: fatal: uncaught exception 'system-error' in 'web' fiber!
2024-10-11 00:16:29 error: exception arguments: ("connect" "~A" ("No such file or directory") (2))
2024-10-11 00:16:29 In fibers.scm:
2024-10-11 00:16:29 heap: 12.18 MiB; threads: 9; file descriptors: 44
2024-10-11 00:16:29 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:29      78:4 19 (%run-fibers _ 10 #<procedure finished? ()> _)
2024-10-11 00:16:29 In fibers/interrupts.scm:
2024-10-11 00:16:29      69:4 18 (with-interrupts/thread-cputime _ _ #<procedure yield-?> ?)
2024-10-11 00:16:29 In fibers/scheduler.scm:
2024-10-11 00:16:29    305:26 17 (run-scheduler #<<scheduler> events-impl: #<<epoll> fd?> ?)
2024-10-11 00:16:29 In ice-9/boot-9.scm:
2024-10-11 00:16:29   1747:15 16 (with-exception-handler #<procedure 7fa1b20f7f30 at ic?> ?)
2024-10-11 00:16:29   1752:10 15 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:29 In fibers/scheduler.scm:
2024-10-11 00:16:29    269:10 14 (next-task)
2024-10-11 00:16:29 In fibers.scm:
2024-10-11 00:16:29     172:8 13 (_)
2024-10-11 00:16:29 In ice-9/boot-9.scm:
2024-10-11 00:16:29   1747:15 12 (with-exception-handler #<procedure 7fa1b20f7de0 at ic?> ?)
2024-10-11 00:16:29   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:29 In cuirass/http.scm:
2024-10-11 00:16:29   1494:29 10 (run-cuirass-server #:host _ #:port _ # _)
2024-10-11 00:16:29 In srfi/srfi-1.scm:
2024-10-11 00:16:29    548:20  9 (unfold #<procedure 7fa1ad17a360 at cuirass/http.scm:1?> ?)
2024-10-11 00:16:29 In cuirass/http.scm:
2024-10-11 00:16:29    1482:7  8 (_ _)
2024-10-11 00:16:29 In ice-9/suspendable-ports.scm:
2024-10-11 00:16:29    741:14  7 (_ #<input-output: socket 43> _ . _)
2024-10-11 00:16:29 In unknown file:
2024-10-11 00:16:29            6 (connect #<input-output: socket 43> 1 "/var/run/cuirass?")
2024-10-11 00:16:29 In ice-9/boot-9.scm:
2024-10-11 00:16:29   1685:16  5 (raise-exception _ #:continuable? _)
2024-10-11 00:16:29   1780:13  4 (_ #<&compound-exception components: (#<&external-error?>)
2024-10-11 00:16:29    2137:6  3 (_ _ . _)
2024-10-11 00:16:29   1747:15  2 (with-exception-handler #<procedure 7fa1ad8fe9f0 at ic?> ?)
2024-10-11 00:16:29 In cuirass/utils.scm:
2024-10-11 00:16:29    212:23  1 (_)
2024-10-11 00:16:29 In unknown file:
2024-10-11 00:16:29            0 (make-stack #t)
2024-10-11 00:16:29 ERROR: In procedure make-stack:
2024-10-11 00:16:29 In procedure connect: No such file or directory
2024-10-11 00:16:29 running Fibers on 4 kernel threads
2024-10-11 00:16:30 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:30 listening on 127.0.0.1:8081
2024-10-11 00:16:30 error: fatal: uncaught exception 'system-error' in 'web' fiber!
2024-10-11 00:16:30 error: exception arguments: ("connect" "~A" ("No such file or directory") (2))
2024-10-11 00:16:30 heap: 12.18 MiB; threads: 9; file descriptors: 44
2024-10-11 00:16:30 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:30 In fibers.scm:
2024-10-11 00:16:30      78:4 19 (%run-fibers _ 10 #<procedure finished? ()> _)
2024-10-11 00:16:30 In fibers/interrupts.scm:
2024-10-11 00:16:30      69:4 18 (with-interrupts/thread-cputime _ _ #<procedure yield-?> ?)
2024-10-11 00:16:30 In fibers/scheduler.scm:
2024-10-11 00:16:30    305:26 17 (run-scheduler #<<scheduler> events-impl: #<<epoll> fd?> ?)
2024-10-11 00:16:30 In ice-9/boot-9.scm:
2024-10-11 00:16:30   1747:15 16 (with-exception-handler #<procedure 7ff6d7b63ea0 at ic?> ?)
2024-10-11 00:16:30   1752:10 15 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:30 In fibers/scheduler.scm:
2024-10-11 00:16:30    269:10 14 (next-task)
2024-10-11 00:16:30 In fibers.scm:
2024-10-11 00:16:30     172:8 13 (_)
2024-10-11 00:16:30 In ice-9/boot-9.scm:
2024-10-11 00:16:30   1747:15 12 (with-exception-handler #<procedure 7ff6d7b63b40 at ic?> ?)
2024-10-11 00:16:30   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:30 In cuirass/http.scm:
2024-10-11 00:16:30   1494:29 10 (run-cuirass-server #:host _ #:port _ # _)
2024-10-11 00:16:30 In srfi/srfi-1.scm:
2024-10-11 00:16:30    548:20  9 (unfold #<procedure 7ff6d2aa8360 at cuirass/http.scm:1?> ?)
2024-10-11 00:16:30 In cuirass/http.scm:
2024-10-11 00:16:30    1482:7  8 (_ _)
2024-10-11 00:16:30 In ice-9/suspendable-ports.scm:
2024-10-11 00:16:30    741:14  7 (_ #<input-output: socket 43> _ . _)
2024-10-11 00:16:30 In unknown file:
2024-10-11 00:16:30            6 (connect #<input-output: socket 43> 1 "/var/run/cuirass?")
2024-10-11 00:16:30 In ice-9/boot-9.scm:
2024-10-11 00:16:30   1685:16  5 (raise-exception _ #:continuable? _)
2024-10-11 00:16:30   1780:13  4 (_ #<&compound-exception components: (#<&external-error?>)
2024-10-11 00:16:30    2137:6  3 (_ _ . _)
2024-10-11 00:16:30   1747:15  2 (with-exception-handler #<procedure 7ff6d7b630c0 at ic?> ?)
2024-10-11 00:16:30 In cuirass/utils.scm:
2024-10-11 00:16:30    212:23  1 (_)
2024-10-11 00:16:30 In unknown file:
2024-10-11 00:16:30            0 (make-stack #t)
2024-10-11 00:16:30 ERROR: In procedure make-stack:
2024-10-11 00:16:30 In procedure connect: No such file or directory
2024-10-11 00:16:30 running Fibers on 4 kernel threads
2024-10-11 00:16:30 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:30 listening on 127.0.0.1:8081
2024-10-11 00:16:30 error: fatal: uncaught exception 'system-error' in 'web' fiber!
2024-10-11 00:16:30 error: exception arguments: ("connect" "~A" ("No such file or directory") (2))
2024-10-11 00:16:30 heap: 12.18 MiB; threads: 9; file descriptors: 44
2024-10-11 00:16:30 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:30 In fibers.scm:
2024-10-11 00:16:30      78:4 19 (%run-fibers _ 10 #<procedure finished? ()> _)
2024-10-11 00:16:30 In fibers/interrupts.scm:
2024-10-11 00:16:30      69:4 18 (with-interrupts/thread-cputime _ _ #<procedure yield-?> ?)
2024-10-11 00:16:30 In fibers/scheduler.scm:
2024-10-11 00:16:30    305:26 17 (run-scheduler #<<scheduler> events-impl: #<<epoll> fd?> ?)
2024-10-11 00:16:30 In ice-9/boot-9.scm:
2024-10-11 00:16:30   1747:15 16 (with-exception-handler #<procedure 7fbbc34f7f30 at ic?> ?)
2024-10-11 00:16:30   1752:10 15 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:30 In fibers/scheduler.scm:
2024-10-11 00:16:30    269:10 14 (next-task)
2024-10-11 00:16:30 In fibers.scm:
2024-10-11 00:16:30     172:8 13 (_)
2024-10-11 00:16:30 In ice-9/boot-9.scm:
2024-10-11 00:16:30   1747:15 12 (with-exception-handler #<procedure 7fbbc34f7de0 at ic?> ?)
2024-10-11 00:16:30   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:30 In cuirass/http.scm:
2024-10-11 00:16:30   1494:29 10 (run-cuirass-server #:host _ #:port _ # _)
2024-10-11 00:16:30 In srfi/srfi-1.scm:
2024-10-11 00:16:30    548:20  9 (unfold #<procedure 7fbbbe590360 at cuirass/http.scm:1?> ?)
2024-10-11 00:16:30 In cuirass/http.scm:
2024-10-11 00:16:30    1482:7  8 (_ _)
2024-10-11 00:16:30 In ice-9/suspendable-ports.scm:
2024-10-11 00:16:30    741:14  7 (_ #<input-output: socket 43> _ . _)
2024-10-11 00:16:30 In unknown file:
2024-10-11 00:16:30            6 (connect #<input-output: socket 43> 1 "/var/run/cuirass?")
2024-10-11 00:16:30 In ice-9/boot-9.scm:
2024-10-11 00:16:30   1685:16  5 (raise-exception _ #:continuable? _)
2024-10-11 00:16:30   1780:13  4 (_ #<&compound-exception components: (#<&external-error?>)
2024-10-11 00:16:30    2137:6  3 (_ _ . _)
2024-10-11 00:16:30   1747:15  2 (with-exception-handler #<procedure 7fbbbecff9f0 at ic?> ?)
2024-10-11 00:16:30 In cuirass/utils.scm:
2024-10-11 00:16:30    212:23  1 (_)
2024-10-11 00:16:30 In unknown file:
2024-10-11 00:16:30            0 (make-stack #t)
2024-10-11 00:16:30 ERROR: In procedure make-stack:
2024-10-11 00:16:30 In procedure connect: No such file or directory
2024-10-11 00:16:31 running Fibers on 4 kernel threads
2024-10-11 00:16:31 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:31 listening on 127.0.0.1:8081
2024-10-11 00:16:31 error: fatal: uncaught exception 'system-error' in 'web' fiber!
2024-10-11 00:16:31 error: exception arguments: ("connect" "~A" ("No such file or directory") (2))
2024-10-11 00:16:31 heap: 12.18 MiB; threads: 9; file descriptors: 44
2024-10-11 00:16:31 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 00:16:31 In fibers.scm:
2024-10-11 00:16:31      78:4 19 (%run-fibers _ 10 #<procedure finished? ()> _)
2024-10-11 00:16:31 In fibers/interrupts.scm:
2024-10-11 00:16:31      69:4 18 (with-interrupts/thread-cputime _ _ #<procedure yield-?> ?)
2024-10-11 00:16:31 In fibers/scheduler.scm:
2024-10-11 00:16:31    305:26 17 (run-scheduler #<<scheduler> events-impl: #<<epoll> fd?> ?)
2024-10-11 00:16:31 In ice-9/boot-9.scm:
2024-10-11 00:16:31   1747:15 16 (with-exception-handler #<procedure 7feaa0af7f30 at ic?> ?)
2024-10-11 00:16:31   1752:10 15 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:31 In fibers/scheduler.scm:
2024-10-11 00:16:31    269:10 14 (next-task)
2024-10-11 00:16:31 In fibers.scm:
2024-10-11 00:16:31     172:8 13 (_)
2024-10-11 00:16:31 In ice-9/boot-9.scm:
2024-10-11 00:16:31   1747:15 12 (with-exception-handler #<procedure 7feaa0af7de0 at ic?> ?)
2024-10-11 00:16:31   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
2024-10-11 00:16:31 In cuirass/http.scm:
2024-10-11 00:16:31   1494:29 10 (run-cuirass-server #:host _ #:port _ # _)
2024-10-11 00:16:31 In srfi/srfi-1.scm:
2024-10-11 00:16:31    548:20  9 (unfold #<procedure 7fea9bb6a360 at cuirass/http.scm:1?> ?)
2024-10-11 00:16:31 In cuirass/http.scm:
2024-10-11 00:16:31    1482:7  8 (_ _)
2024-10-11 00:16:31 In ice-9/suspendable-ports.scm:
2024-10-11 00:16:31    741:14  7 (_ #<input-output: socket 43> _ . _)
2024-10-11 00:16:31 In unknown file:
2024-10-11 00:16:31            6 (connect #<input-output: socket 43> 1 "/var/run/cuirass?")
2024-10-11 00:16:31 In ice-9/boot-9.scm:
2024-10-11 00:16:31   1685:16  5 (raise-exception _ #:continuable? _)
2024-10-11 00:16:31   1780:13  4 (_ #<&compound-exception components: (#<&external-error?>)
2024-10-11 00:16:31    2137:6  3 (_ _ . _)
2024-10-11 00:16:31   1747:15  2 (with-exception-handler #<procedure 7fea9c28e9f0 at ic?> ?)
2024-10-11 00:16:31 In cuirass/utils.scm:
2024-10-11 00:16:31    212:23  1 (_)
2024-10-11 00:16:31 In unknown file:
2024-10-11 00:16:31            0 (make-stack #t)
2024-10-11 00:16:31 ERROR: In procedure make-stack:
2024-10-11 00:16:31 In procedure connect: No such file or directory
--8<---------------cut here---------------end--------------->8---

I've attempted to restart just cuirass-web with 'herd restart cuirass-web' to have it
usable again for the moment, but I got:

--8<---------------cut here---------------start------------->8---
# herd restart cuirass-web
Password: 
Service cuirass-web is not running.
Service user-homes has been started.
Service postgres-roles has been started.
# herd start cuirass-web 
Service user-homes has been started.
Service postgres-roles has been started.
herd: error: failed to start service cuirass-web
--8<---------------cut here---------------end--------------->8---

Trying harder:

--8<---------------cut here---------------start------------->8---
# herd restart cuirass
Service user-homes has been started.
Service postgres-roles has been started.
Service cuirass has been started.
Service user-homes has been started.
Service postgres-roles has been started.
Service cuirass-remote-server has been started.

# herd status cuirass-web
Status of cuirass-web:
  It is stopped since 12:16:31 AM (4 hours ago).
  It is disabled.
  Provides (cuirass-web).
  Requires (user-processes cuirass).
  Will be respawned.
  Last respawned on 12:16:30 AM (4 hours ago).
maxim@berlin ~$ sudo herd enable cuirass-web
Enabled service cuirass-web.
maxim@berlin ~$ sudo herd start cuirass-web
Service user-homes has been started.
Service postgres-roles has been started.
Service cuirass-web has been started.
--8<---------------cut here---------------end--------------->8---

And the /var/log/cuirass-web.log now shows its processing requests:

--8<---------------cut here---------------start------------->8---
2024-10-11 04:20:19 running Fibers on 4 kernel threads
2024-10-11 04:20:19 WARNING: (cuirass utils): imported module (fibers) overrides core binding `sleep'
2024-10-11 04:20:19 listening on 127.0.0.1:8081
2024-10-11 04:20:19 connected to bridge at '/var/run/cuirass/bridge' (8 connection pool)
2024-10-11 04:20:19 heap: 12.18 MiB; threads: 9; file descriptors: 45
2024-10-11 04:20:19 WARNING: (cuirass scripts web): imported module (fibers) overrides core binding `sleep'
2024-10-11 04:20:22 GET /build/1791603/log/raw
2024-10-11 04:20:49 GET /
2024-10-11 04:21:21 GET /
--8<---------------cut here---------------end--------------->8---

-- 
Thanks,
Maxim