From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: ludo@gnu.org (Ludovic =?UTF-8?Q?Court=C3=A8s?=) Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 27 Aug 2018 22:34:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 32548@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.153540922210740 (code B ref -1); Mon, 27 Aug 2018 22:34:01 +0000 Received: (at submit) by debbugs.gnu.org; 27 Aug 2018 22:33:42 +0000 Received: from localhost ([127.0.0.1]:34546 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fuQ4s-0002n9-Eq for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:42 -0400 Received: from eggs.gnu.org ([208.118.235.92]:38205) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fuQ4q-0002mw-6H for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:40 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fuQ4k-0008LF-6r for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:34 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:45524) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1fuQ4k-0008L1-3E for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:34 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:59174) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fuQ4j-00061W-AB for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:33 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fuQ4i-0008Hz-NP for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:33 -0400 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:54985) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fuQ4i-0008HN-IZ for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:32 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=36998 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1fuQ4i-0003HQ-A6 for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:32 -0400 From: ludo@gnu.org (Ludovic =?UTF-8?Q?Court=C3=A8s?=) X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 11 Fructidor an 226 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 28 Aug 2018 00:33:30 +0200 Message-ID: <87pny3783p.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.0 (------) As discussed earlier today on IRC with Cl=C3=A9ment, we could add performan= ce monitoring capabilities to Cuirass. Interesting metrics would be: =E2=80=A2 time of push to time of evaluation completion; =E2=80=A2 time of evaluation completion to time of build completion. We could visualize that per job over time. Perhaps these are also stats that =E2=80=98guix weather=E2=80=99 could display. Ludo=E2=80=99. From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sun, 06 Sep 2020 14:43:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: ludo@gnu.org (Ludovic =?UTF-8?Q?Court=C3=A8s?=) Cc: 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.15994033676044 (code B ref 32548); Sun, 06 Sep 2020 14:43:01 +0000 Received: (at 32548) by debbugs.gnu.org; 6 Sep 2020 14:42:47 +0000 Received: from localhost ([127.0.0.1]:46774 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kEvsU-0001ZP-VN for submit@debbugs.gnu.org; Sun, 06 Sep 2020 10:42:47 -0400 Received: from eggs.gnu.org ([209.51.188.92]:44310) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kEvsT-0001ZD-8F for 32548@debbugs.gnu.org; Sun, 06 Sep 2020 10:42:45 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:51241) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kEvsN-00042k-CQ; Sun, 06 Sep 2020 10:42:39 -0400 Received: from [2a01:e0a:19b:d9a0:9d9d:97cc:d92a:8ac0] (port=42200 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kEvsM-0004q2-Vz; Sun, 06 Sep 2020 10:42:39 -0400 From: Mathieu Othacehe References: <87pny3783p.fsf@gnu.org> Date: Sun, 06 Sep 2020 16:42:37 +0200 In-Reply-To: <87pny3783p.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Tue, 28 Aug 2018 00:33:30 +0200") Message-ID: <87d02zge5e.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, > As discussed earlier today on IRC with Cl=C3=A9ment, we could add perform= ance > monitoring capabilities to Cuirass. Interesting metrics would be: > > =E2=80=A2 time of push to time of evaluation completion; > > =E2=80=A2 time of evaluation completion to time of build completion. Small update on that one. With Cuirass commit 154232bc767d002f69aa6bb1cdddfd108b98584b, we now have the following timestamps: * Checkout commit time. * Evaluation creation. * Evaluation checkouts completion. * Evaluation completion. For the first timestamp, I'm using Guile-Git to extract the commit time, which is not the commit push time. In fact, I think there is no such thing as "commit push time" in git. We can still compute the metric 'time of commit to time of evaluation completion', but it's less relevant than the proposed 'time of push to time of evaluation completion'. The other proposed metric, 'time of evaluation completion to time of build completion' can now be computed. Regarding the actual computation and reporting of those metrics, I'm still considering different options. I'd like to have a look to Guile-prometheus that is written by Christopher. Thanks, Mathieu From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Christopher Baines Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sun, 06 Sep 2020 18:52:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: Ludovic =?UTF-8?Q?Court=C3=A8s?= , 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.159941827622399 (code B ref 32548); Sun, 06 Sep 2020 18:52:01 +0000 Received: (at 32548) by debbugs.gnu.org; 6 Sep 2020 18:51:16 +0000 Received: from localhost ([127.0.0.1]:47169 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kEzky-0005pD-JR for submit@debbugs.gnu.org; Sun, 06 Sep 2020 14:51:16 -0400 Received: from mira.cbaines.net ([212.71.252.8]:46944) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kEzkt-0005p1-Fe for 32548@debbugs.gnu.org; Sun, 06 Sep 2020 14:51:14 -0400 Received: from localhost (unknown [46.237.162.226]) by mira.cbaines.net (Postfix) with ESMTPSA id 4F8D227BBE7; Sun, 6 Sep 2020 19:51:10 +0100 (BST) Received: from localhost (localhost [local]) by localhost (OpenSMTPD) with ESMTPA id 19ea1c7b; Sun, 6 Sep 2020 18:51:08 +0000 (UTC) References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> User-agent: mu4e 1.4.13; emacs 26.3 From: Christopher Baines In-reply-to: <87d02zge5e.fsf@gnu.org> Date: Sun, 06 Sep 2020 19:51:05 +0100 Message-ID: <87y2lmlox2.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mathieu Othacehe writes: > Hello, > >> As discussed earlier today on IRC with Cl=C3=A9ment, we could add perfor= mance >> monitoring capabilities to Cuirass. Interesting metrics would be: >> >> =E2=80=A2 time of push to time of evaluation completion; >> >> =E2=80=A2 time of evaluation completion to time of build completion. > > Small update on that one. With Cuirass commit > 154232bc767d002f69aa6bb1cdddfd108b98584b, we now have the following > timestamps: > > * Checkout commit time. > * Evaluation creation. > * Evaluation checkouts completion. > * Evaluation completion. > > For the first timestamp, I'm using Guile-Git to extract the commit time, > which is not the commit push time. In fact, I think there is no such > thing as "commit push time" in git. I had this issue with the Guix Data Service as well, it uses the timestamp in the email sent by the Savannah git hook, which is the closest I've got to "commit push time". > We can still compute the metric 'time of commit to time of evaluation > completion', but it's less relevant than the proposed 'time of push to > time of evaluation completion'. As someone can commit, then potentially push those commits hours later, assuming no one else has pushed, this data might be a bit noisy. Time between Curiass noticing the new commit to the evaluation completion might be cleaner. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEEPonu50WOcg2XVOCyXiijOwuE9XcFAl9VL5lfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcACgkQXiijOwuE 9XckjQ/+IB9r2/HsVcnXPQ794Vs8AAm1yp6xalHSAxYct41+S+YusCWODECbPj/j 0aE1q/TUDGkZ5K8VzlSrEJnfNzbyQXva6wfBKW1tbdfgGL+q7J4wQnq2ntnp4YPK YrWtbQpnXdJT/9cCH2aOeR8pN+gSBO2YbV+PGNOuzxXEJmmBmHkX5oQdmy79I5va 8rwoStXEilKqQtkxpLWBbEpHf6jzMAeLyJivSHxLFkCm4ZPNxsz74ObGHdV25Ivr gCoizfecW/rKXBmJkI3utVdsJJNuaf1S2kPTaaWrt/1jPMJ/lSXSzwOCovIffS1Q lSzXP7KA9F7bBAUHJu93+MeFCpKMBG5FkbI61ZfGqP449NpKPf/BqvWG99hHKe2J nP+tuubW5fRc9fsbZ51qtIvJenI7OyvrThuKx1K0v/3oE1aaQdGcQiR6FeB51QeS wQFn7Q4X7KmejhZsJ6BsPlRdJdN1BfkUJdzeYDOXyEk9b2NZKXn/DAs2/KsWVWAm XnUOOglm3bsEwdPJ6v22YIogSfnCCoHIZHKgvdATLHPEHI54e5td9GCEk5DpwYwh GjqFU/XamR4IRiozzN2x5dqOlxQKeSor/+8ByN5qDteOj1XH/Q4JADSdeZ6fs/pO ITs7C3cK/TRR80mM/S44DACBZ2PFtUjmwnhFkYy5ZOUWL8IaY/4= =xr6N -----END PGP SIGNATURE----- --=-=-=-- From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 07 Sep 2020 08:12:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Christopher Baines Cc: Mathieu Othacehe , 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.159946631316993 (code B ref 32548); Mon, 07 Sep 2020 08:12:02 +0000 Received: (at 32548) by debbugs.gnu.org; 7 Sep 2020 08:11:53 +0000 Received: from localhost ([127.0.0.1]:47842 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kFCFl-0004Q0-Gd for submit@debbugs.gnu.org; Mon, 07 Sep 2020 04:11:53 -0400 Received: from eggs.gnu.org ([209.51.188.92]:59122) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kFCFj-0004Pl-Sa for 32548@debbugs.gnu.org; Mon, 07 Sep 2020 04:11:52 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:37539) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kFCFe-00015A-Lc; Mon, 07 Sep 2020 04:11:46 -0400 Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (port=54580 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kFCFd-0002B2-6W; Mon, 07 Sep 2020 04:11:46 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= In-Reply-To: <87y2lmlox2.fsf@cbaines.net> (Christopher Baines's message of "Sun, 06 Sep 2020 19:51:05 +0100") References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 22 Fructidor an 228 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 07 Sep 2020 10:11:39 +0200 Message-ID: <874koarop0.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, Christopher Baines skribis: > Mathieu Othacehe writes: > >> Hello, >> >>> As discussed earlier today on IRC with Cl=C3=A9ment, we could add perfo= rmance >>> monitoring capabilities to Cuirass. Interesting metrics would be: >>> >>> =E2=80=A2 time of push to time of evaluation completion; >>> >>> =E2=80=A2 time of evaluation completion to time of build completion. >> >> Small update on that one. With Cuirass commit >> 154232bc767d002f69aa6bb1cdddfd108b98584b, we now have the following >> timestamps: >> >> * Checkout commit time. >> * Evaluation creation. >> * Evaluation checkouts completion. >> * Evaluation completion. >> >> For the first timestamp, I'm using Guile-Git to extract the commit time, >> which is not the commit push time. In fact, I think there is no such >> thing as "commit push time" in git. > > I had this issue with the Guix Data Service as well, it uses the > timestamp in the email sent by the Savannah git hook, which is the > closest I've got to "commit push time". Neat. >> We can still compute the metric 'time of commit to time of evaluation >> completion', but it's less relevant than the proposed 'time of push to >> time of evaluation completion'. > > As someone can commit, then potentially push those commits hours later, > assuming no one else has pushed, this data might be a bit noisy. Time > between Curiass noticing the new commit to the evaluation completion > might be cleaner. Agreed. We regularly push commits that are weeks or months old (sometimes years), so there might be too many outliers when looking at the commit time. Thanks for pushing this, Mathieu! Ludo=E2=80=99. From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 10 Sep 2020 13:27:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: Christopher Baines , 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.159974440226520 (code B ref 32548); Thu, 10 Sep 2020 13:27:01 +0000 Received: (at 32548) by debbugs.gnu.org; 10 Sep 2020 13:26:42 +0000 Received: from localhost ([127.0.0.1]:37696 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGMb4-0006tg-0c for submit@debbugs.gnu.org; Thu, 10 Sep 2020 09:26:42 -0400 Received: from eggs.gnu.org ([209.51.188.92]:32898) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGMb2-0006tT-Ll for 32548@debbugs.gnu.org; Thu, 10 Sep 2020 09:26:40 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:58479) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kGMaw-00083x-41; Thu, 10 Sep 2020 09:26:34 -0400 Received: from [2a01:e0a:19b:d9a0:9d9d:97cc:d92a:8ac0] (port=56598 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kGMav-0006kp-26; Thu, 10 Sep 2020 09:26:33 -0400 From: Mathieu Othacehe References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> Date: Thu, 10 Sep 2020 15:26:30 +0200 In-Reply-To: <874koarop0.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Mon, 07 Sep 2020 10:11:39 +0200") Message-ID: <87k0x14vax.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, > Agreed. We regularly push commits that are weeks or months old > (sometimes years), so there might be too many outliers when looking at > the commit time. Yes, so I used checkout time instead of commit time with af12a80599346968fb9f52edb33b48dd26852788. I also turned Evaluation 'in_progress' field into 'status' field. This way it's much easier to create some metrics on evaluations. It also allows to distinguish between 'aborted' and 'failed' evaluations. Thanks, Mathieu From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 14 Sep 2020 13:35:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= , mail@cbaines.net Cc: 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160009046628963 (code B ref 32548); Mon, 14 Sep 2020 13:35:02 +0000 Received: (at 32548) by debbugs.gnu.org; 14 Sep 2020 13:34:26 +0000 Received: from localhost ([127.0.0.1]:53152 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHock-0007X5-F6 for submit@debbugs.gnu.org; Mon, 14 Sep 2020 09:34:26 -0400 Received: from eggs.gnu.org ([209.51.188.92]:50628) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHocj-0007Wt-I6 for 32548@debbugs.gnu.org; Mon, 14 Sep 2020 09:34:26 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:51904) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kHocd-0001U2-E7; Mon, 14 Sep 2020 09:34:19 -0400 Received: from [2a01:e0a:19b:d9a0:9d9d:97cc:d92a:8ac0] (port=58358 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kHocd-0001Qz-16; Mon, 14 Sep 2020 09:34:19 -0400 From: Mathieu Othacehe References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> Date: Mon, 14 Sep 2020 15:34:17 +0200 In-Reply-To: <87k0x14vax.fsf@gnu.org> (Mathieu Othacehe's message of "Thu, 10 Sep 2020 15:26:30 +0200") Message-ID: <87tuw05vom.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, I just pushed support for computing and displaying metrics in Cuirass. I started with two metrics: * Builds per day * Average evaluation speed per specification. Those metrics can now be seen at: https://ci.guix.gnu.org/metrics and are updated every hour. I plan to add more metrics such as: - Evaluation completion percentage. - Evaluation completion speed. - Failed evaluations percentage. - Pending builds per day. Don't hesitate to comment or propose other metrics. Thanks, Mathieu From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: zimoun Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 14 Sep 2020 14:11:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: Ludovic =?UTF-8?Q?Court=C3=A8s?= , Christopher Baines , 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160009263419334 (code B ref 32548); Mon, 14 Sep 2020 14:11:01 +0000 Received: (at 32548) by debbugs.gnu.org; 14 Sep 2020 14:10:34 +0000 Received: from localhost ([127.0.0.1]:55647 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHpBi-00051m-2r for submit@debbugs.gnu.org; Mon, 14 Sep 2020 10:10:34 -0400 Received: from mail-qv1-f42.google.com ([209.85.219.42]:44917) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHpBg-00051X-1l for 32548@debbugs.gnu.org; Mon, 14 Sep 2020 10:10:32 -0400 Received: by mail-qv1-f42.google.com with SMTP id j10so8974492qvk.11 for <32548@debbugs.gnu.org>; Mon, 14 Sep 2020 07:10:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=i55LgkmmDBkqkA/a1Jn2eWs5v/t9XumfIl1oa/FH2wg=; b=TmtQeAbC6v1doMJa8nJ0hfHs+XQhngrSHCjeYxtOtGw9z+WZd8VR/ICeT8yfM/gM/G iScO3aY6kPw8JtBC/SH5M9fA+toqKPpXB4Qnsp//7PUFsbjX404UFUYHxNHpaD2nE/TS V9uwCX095LlWcLkM7PW72ndS79xFABKTL8G6EkbgLm11rD0xOR0ZGta+Xg5fUNdaIC2H ZMQlZ5/ANIeg88rElv6RGGpZlqFrefXdPx3nNy93NsdmUiaUebJzAkrw87+IReLdc/It wCDwRlyI+gbXHFir3fnsZnDTGybFV5cNE2imeefDPGrT7AzEsbIzDoLtj1JoPplr8STO FRfg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=i55LgkmmDBkqkA/a1Jn2eWs5v/t9XumfIl1oa/FH2wg=; b=puq9QsWqMTzK/wdkL9M9TbB4D+s4ad+DbyYW0+h1yQz/tGJoY2LvsYoislaQD6cXvV 4JAhqjhyXOwlWHcDdeNR6qw5jQnDnrTthr7Zt1xQr0Vt8l7WlkPoSow78JK35SXT4vG5 lROSdbuIWW/tOQAnEUNR5XnseMx7XdM6AWmkHaBbvsvxz4H7PS2nSa9q7z296GyEwOca 8w05NDWeukcJMtsY1jT6RETnRs0H9kzmzjrqMQ6fimwPcch6vy5jEfEB9GeRsWUV6oB+ 2a8vRqTPxoRiqdZkHIYUoQCEJ8uoAOlFFwh7ZTQCudoDtDFvYOgrw3XwnzeG5a5bQ3lS xozg== X-Gm-Message-State: AOAM532AmKRrCosuSyvZmPOVs8mDRiy/afgehoGOhvy7OUL5j5Oo47Fu Zylqg2CFPmutefxWe+wWHA5QoI+V2g6yPJMflbQ= X-Google-Smtp-Source: ABdhPJx7IjxMmVcStKl8sPIGcmKhohYy7rtLSKewEVogwJxAKnqbh/NbcnfvtXaouIUZGnLaxhbFoXzwb0DBtRqpQDc= X-Received: by 2002:a0c:cc13:: with SMTP id r19mr13085927qvk.15.1600092626306; Mon, 14 Sep 2020 07:10:26 -0700 (PDT) MIME-Version: 1.0 References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> In-Reply-To: <87tuw05vom.fsf@gnu.org> From: zimoun Date: Mon, 14 Sep 2020 16:10:14 +0200 Message-ID: Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Mathieu, Really cool! On Mon, 14 Sep 2020 at 15:35, Mathieu Othacehe wrote: > * Builds per day > * Average evaluation speed per specification. Something interesting could be: min and max (of 100 evaluations). The standard error deviation too but I am not sure it is easy to interpret with a quick look. Instead, the median could be interesting. For example, consider these 2 evaluations: https://ci.guix.gnu.org/build/2094496/details https://ci.guix.gnu.org/build/3035986/details Well, if there is say 99 evaluations of first "kind" and 1 of second kind, the average is: (99*849 + 1_595_796_252) / 100 = 15_958_803.03 which does not really represent the effective workload. Well, I will try to give a look if I can schedule a moment. :-) > Those metrics can now be seen at: > > https://ci.guix.gnu.org/metrics Nice plot! > I plan to add more metrics such as: > > - Evaluation completion percentage. > - Evaluation completion speed. > - Failed evaluations percentage. > - Pending builds per day. Cool! Maybe time between commit time (not author time) and start of the build. Cheers, simon From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 14 Sep 2020 19:29:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: mail@cbaines.net, 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160011168620124 (code B ref 32548); Mon, 14 Sep 2020 19:29:02 +0000 Received: (at 32548) by debbugs.gnu.org; 14 Sep 2020 19:28:06 +0000 Received: from localhost ([127.0.0.1]:56303 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHu90-0005EV-90 for submit@debbugs.gnu.org; Mon, 14 Sep 2020 15:28:06 -0400 Received: from eggs.gnu.org ([209.51.188.92]:40424) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHu8y-0005Dp-Gl for 32548@debbugs.gnu.org; Mon, 14 Sep 2020 15:28:04 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:58804) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kHu8t-0005kf-2v; Mon, 14 Sep 2020 15:27:59 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=33406 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kHu8r-0001Xz-LA; Mon, 14 Sep 2020 15:27:58 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 29 Fructidor an 228 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 14 Sep 2020 21:27:47 +0200 In-Reply-To: <87tuw05vom.fsf@gnu.org> (Mathieu Othacehe's message of "Mon, 14 Sep 2020 15:34:17 +0200") Message-ID: <87o8m8b1l8.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi! Mathieu Othacehe skribis: > I just pushed support for computing and displaying metrics in Cuirass. I > started with two metrics: > > * Builds per day > * Average evaluation speed per specification. > > Those metrics can now be seen at: > > https://ci.guix.gnu.org/metrics > > and are updated every hour. This is very cool, thumbs up! > I plan to add more metrics such as: > > - Evaluation completion percentage. > - Evaluation completion speed. > - Failed evaluations percentage. > - Pending builds per day. That=E2=80=99d be awesome. As discussed on IRC, builds per day should be compared to new derivations per day. For example, if on a day there=E2=80=99s 100 new derivations and we only manage to build 10 of them, we have a problem. BTW, in cuirass.log I noticed this: --8<---------------cut here---------------start------------->8--- 2020-09-14T21:16:21 Updating metric average-eval-duration-per-spec (guix-mo= dular-master) to 414.8085106382979. 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (kernel-updates). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (kernel-updates). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (kernel-updates). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (staging-staging). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (staging-staging). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (staging-staging). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (version-1.0.1). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (version-1.0.1). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (version-1.0.1). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (version-1.1.0). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (version-1.1.0). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (version-1.1.0). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (wip-desktop). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (wip-desktop). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (wip-desktop). --8<---------------cut here---------------end--------------->8--- Perhaps it can=E2=80=99t compute an average yet for these jobsets? Thanks! Ludo=E2=80=99. From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: "Bonface M. K." Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 16 Sep 2020 02:22:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: zimoun Cc: Mathieu Othacehe , 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160022289217884 (code B ref 32548); Wed, 16 Sep 2020 02:22:01 +0000 Received: (at 32548) by debbugs.gnu.org; 16 Sep 2020 02:21:32 +0000 Received: from localhost ([127.0.0.1]:32810 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIN4P-0004e8-AP for submit@debbugs.gnu.org; Tue, 15 Sep 2020 22:21:32 -0400 Received: from mail-wr1-f43.google.com ([209.85.221.43]:39631) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIN4N-0004dw-Mw for 32548@debbugs.gnu.org; Tue, 15 Sep 2020 22:21:16 -0400 Received: by mail-wr1-f43.google.com with SMTP id a17so5224634wrn.6 for <32548@debbugs.gnu.org>; Tue, 15 Sep 2020 19:21:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=L0udhfrMFtvldrDujUIoEQ9/WqpeWZqAVg4ClqJJ/GE=; b=Rg0+NUlQLYwe84oU27Ny2ngVsV7e8wFdDMeXJk8tVnF4CAIicJ148rLXC7j5ibXyoF 15RyJOTiCWCuq3pWccJ+0x0GJYKRTYgRSMOJ+kx37D1ilQeMPYkont8LxK8Jh91v0OBd t8Iktdy76sy7rA+wxEgXS9Gr7Jo80iNZtOSO3WHM2MUw7PbFFMD5BK8h+ifBvCTTaPB0 wtxhgwIm5mtW9TYDmskulgqSDJEDe8DqIDkkEiRB939ZP7DyH6CeLiW8T1FTzlw+d8LL a7tqAH23ms4egO2tzBek5Ia78V+ARzybzVT5VYJUOcbYdP9LwqqEutKayM2njnnULa7q tsAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version; bh=L0udhfrMFtvldrDujUIoEQ9/WqpeWZqAVg4ClqJJ/GE=; b=i80ZeDIxlqaCrSFrSvO1K9X/jRv9KQfpzGOT3a/BY9HbQPQCLxlnTFFgeRcxoVsK1Y JXIEug7uy1TdW7SOFU9VEe534bgUFV5wR85S6K3c6vK5S5xUvwYFORgippO6e9q1RNo1 1RFG/BgQZTFVS18abbLWfvzJv53+NVN4BJSfQTQYYe6/jWsCe7R/6znuZ6SKfxZ/c4n+ qkQe13Axk/EQcOCtOeKOiUBcBJG8k+Nr0Ic2rhnkr3gVc/SE4FJZIOCVFY8HUCIc/evh G6rufOvS+FGKDuVAaWDavvgV3J8uD1iU9OiiT7v0VxRoRNsemFx9zlIBw/HrUogAqUvW OYlw== X-Gm-Message-State: AOAM53265d1Q2EeeBmWUgycJzFAaKpqiNO3F2ZaZ2+reM+o/oEf0rYF3 voHFgvsU5M76o9OSDSgneoWyytw77F3Ccesn X-Google-Smtp-Source: ABdhPJxKQxPowG+eqsrIiI2Q0WYJStsRS18dN5yTg89+UGTXpKVims9mFulbXTNajHnK5XWFqwpdkg== X-Received: by 2002:adf:dd82:: with SMTP id x2mr25623909wrl.419.1600222869528; Tue, 15 Sep 2020 19:21:09 -0700 (PDT) Received: from susa ([41.80.81.102]) by smtp.gmail.com with ESMTPSA id 63sm1732029wrh.71.2020.09.15.19.21.07 (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 15 Sep 2020 19:21:08 -0700 (PDT) From: "Bonface M. K." References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> Date: Wed, 16 Sep 2020 05:21:01 +0300 In-Reply-To: (zimoun's message of "Mon, 14 Sep 2020 16:10:14 +0200") Message-ID: <867dsu5unm.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain Content-Transfer-Encoding: quoted-printable Hi all. zimoun writes: > Hi Mathieu, > > Really cool! > > On Mon, 14 Sep 2020 at 15:35, Mathieu Othacehe wrote: > >> * Builds per day >> * Average evaluation speed per specification. > > Something interesting could be: min and max (of 100 evaluations). > The standard error deviation too but I am not sure it is easy to > interpret with a quick look. Instead, the median could be > interesting. > > For example, consider these 2 evaluations: > > https://ci.guix.gnu.org/build/2094496/details > https://ci.guix.gnu.org/build/3035986/details > I'm getting a 504 Gateway Time-out error when visiting the above links(at the time of sending this email). > Well, if there is say 99 evaluations of first "kind" and 1 of second > kind, the average is: > (99*849 + 1_595_796_252) / 100 =3D 15_958_803.03 > which does not really represent the effective workload. > > Well, I will try to give a look if I can schedule a moment. :-) > > >> Those metrics can now be seen at: >> >> https://ci.guix.gnu.org/metrics > > Nice plot! > > >> I plan to add more metrics such as: >> >> - Evaluation completion percentage. >> - Evaluation completion speed. >> - Failed evaluations percentage. >> - Pending builds per day. > > Cool! > Maybe time between commit time (not author time) and start of the build. > > > Cheers, > simon > > > > =2D-=20 Bonface M. K. (https://www.bonfacemunyoki.com) Chief Emacs Mchochezi GPG key =3D D4F09EB110177E03C28E2FE1F5BBAE1E0392253F --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQJNBAEBCAA3FiEE1PCesRAXfgPCji/h9buuHgOSJT8FAl9hdpEZHGJvbmZhY2Vt dW55b2tpQGdtYWlsLmNvbQAKCRD1u64eA5IlP+z1D/wLFJVaZ+AMvA1NKSgb0kaz 5iJo2yGLDz6tjgo1Y0VxJLTcmQ4mJ1+b8SAfGNwK5H1qwEBaA2X8nTxKCeZZ/8zC 67lima2VZMAIcNUZ2iwhwV1xVOxPVrDI4fo3fKlZzhyvoxZyR+4k/n5n6Ig2XveE yHUu2MyF2NfdSjuWtXHbUrENzVl1xXq5Bta7euqPjij8Qt0/1RkXfQf9JE21dZ6+ ei/YI2y8UOsC9Gp44XfJydR4qlOA62YCJ0n+8bh/qZEUNzKM+rbvWeApkQnkHQDP iVCxvZADQLlYYbGnMYnzJxNz671tZx7O//Xjorfp3turBBodpq5XGKEfHzQySwJu PuRFWL9IaXgRWN84nzYgSfYCWuhg0oVycYJkfNfDiyXTwV8bkMUw+tsBN4BHjhIA hYZS17qkYn9Mu4fgMrjYFiY1tW0G1AxgT4QWlS/cpo9BTmB98YrN+vdRmYDuYAb6 m0aJvMuFwsceqo3gfhV/ZwMI3qQ/SrXY+RedahUsLukz+PgawfwYvTXuRyI4LAnh 7Qy2bbIi7NWuwtNpMCWzGUIzuF7P7uTK6Qqmzzt5/0ofLsaEZrfh4bP/xu7ArDFO 7ynEe610QCUjNhuzfgzq/gJySGzup19xqNvZTUeUOz+o1Og0KjfcG3F5xqEQQoru BqMpDDM0mLZiAWr7C55DCA== =cn3h -----END PGP SIGNATURE----- --=-=-=-- From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Andreas Enge Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 16 Sep 2020 15:58:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: Ludovic =?UTF-8?Q?Court=C3=A8s?= , mail@cbaines.net, 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160027183310101 (code B ref 32548); Wed, 16 Sep 2020 15:58:02 +0000 Received: (at 32548) by debbugs.gnu.org; 16 Sep 2020 15:57:13 +0000 Received: from localhost ([127.0.0.1]:35750 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIZo1-0002cr-Am for submit@debbugs.gnu.org; Wed, 16 Sep 2020 11:57:13 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:53464) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIZo0-0002cj-8C for 32548@debbugs.gnu.org; Wed, 16 Sep 2020 11:57:12 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id C538711499; Wed, 16 Sep 2020 17:57:10 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id EBrnskGLtwuA; Wed, 16 Sep 2020 17:57:10 +0200 (CEST) Received: from jurong (unknown [IPv6:2001:910:103f::de6]) by hera.aquilenet.fr (Postfix) with ESMTPSA id B97CC11491; Wed, 16 Sep 2020 17:57:09 +0200 (CEST) Date: Wed, 16 Sep 2020 17:56:39 +0200 From: Andreas Enge Message-ID: <20200916155639.GA16338@jurong> References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87tuw05vom.fsf@gnu.org> X-Spam-Score: 0.7 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.3 (/) On Mon, Sep 14, 2020 at 03:34:17PM +0200, Mathieu Othacehe wrote: > I just pushed support for computing and displaying metrics in Cuirass. I > started with two metrics: > * Builds per day > * Average evaluation speed per specification. > Those metrics can now be seen at: > https://ci.guix.gnu.org/metrics Congratulations, that looks like a very useful start already! (And the number of builds has doubled since yesterday, so someone already put it to good use!) How about also adding metrics per build machine? I have the impression, for instance, that the aarch64 machine in my living room is not used. If this is confirmed, we could take appropriate action (uncomment it in /etc/machines.scm :-), compare to other used machines, change the scheduling in the daemon, or even turn it off to conserve energy should it turn out that we have too much build power...). Andreas From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 17 Sep 2020 07:11:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Andreas Enge Cc: 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.16003266567135 (code B ref 32548); Thu, 17 Sep 2020 07:11:01 +0000 Received: (at 32548) by debbugs.gnu.org; 17 Sep 2020 07:10:56 +0000 Received: from localhost ([127.0.0.1]:37182 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIo4G-0001r1-1N for submit@debbugs.gnu.org; Thu, 17 Sep 2020 03:10:56 -0400 Received: from eggs.gnu.org ([209.51.188.92]:35274) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIo4E-0001qn-Vm for 32548@debbugs.gnu.org; Thu, 17 Sep 2020 03:10:55 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:59434) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kIo49-00007f-0g; Thu, 17 Sep 2020 03:10:49 -0400 Received: from [2a01:e0a:19b:d9a0:9d9d:97cc:d92a:8ac0] (port=37926 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kIo45-0002kJ-7F; Thu, 17 Sep 2020 03:10:48 -0400 From: Mathieu Othacehe References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> <20200916155639.GA16338@jurong> Date: Thu, 17 Sep 2020 09:10:40 +0200 In-Reply-To: <20200916155639.GA16338@jurong> (Andreas Enge's message of "Wed, 16 Sep 2020 17:56:39 +0200") Message-ID: <87een098un.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello Andreas, > Congratulations, that looks like a very useful start already! > (And the number of builds has doubled since yesterday, so someone already > put it to good use!) Thanks for your feedback :) > How about also adding metrics per build machine? I have the impression, > for instance, that the aarch64 machine in my living room is not used. > If this is confirmed, we could take appropriate action (uncomment it in > /etc/machines.scm :-), compare to other used machines, change the scheduling > in the daemon, or even turn it off to conserve energy should it turn out > that we have too much build power...). Yes I would really like to have something like: https://hydra.nixos.org/machines, with a build rate for every machine. However, it cannot be done without structural changes to how offloading is handled. For now it's working this way: Cuirass -> guix-daemon -> guix offload -> build machines Which means that Cuirass has almost no information about offloaded builds. We are currently starting discussions about inviting the Guix Build Coordinator to the party. That could maybe help us implement what you are proposing, among other things. Thanks, Mathieu From unknown Wed Sep 10 21:37:06 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: ludo@gnu.org (Ludovic =?UTF-8?Q?Court=C3=A8s?=) Subject: bug#32548: closed (Re: bug#32548: Cuirass: Performance monitoring) Message-ID: References: <877dss90ne.fsf@gnu.org> <87pny3783p.fsf@gnu.org> X-Gnu-PR-Message: they-closed 32548 X-Gnu-PR-Package: guix Reply-To: 32548@debbugs.gnu.org Date: Thu, 17 Sep 2020 10:09:02 +0000 Content-Type: multipart/mixed; boundary="----------=_1600337342-24060-1" This is a multi-part message in MIME format... ------------=_1600337342-24060-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #32548: Cuirass: Performance monitoring which was filed against the guix package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 32548@debbugs.gnu.org. --=20 32548: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D32548 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1600337342-24060-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 32548-done) by debbugs.gnu.org; 17 Sep 2020 10:08:02 +0000 Received: from localhost ([127.0.0.1]:37353 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIqpe-0006E7-5V for submit@debbugs.gnu.org; Thu, 17 Sep 2020 06:08:02 -0400 Received: from eggs.gnu.org ([209.51.188.92]:52842) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kIqpa-0006Di-2H for 32548-done@debbugs.gnu.org; Thu, 17 Sep 2020 06:08:00 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:33600) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kIqpU-0003DT-G9; Thu, 17 Sep 2020 06:07:52 -0400 Received: from [2a01:e0a:19b:d9a0:9d9d:97cc:d92a:8ac0] (port=41724 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kIqpT-000708-UK; Thu, 17 Sep 2020 06:07:52 -0400 From: Mathieu Othacehe To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#32548: Cuirass: Performance monitoring References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> <87o8m8b1l8.fsf@gnu.org> Date: Thu, 17 Sep 2020 12:07:49 +0200 In-Reply-To: <87o8m8b1l8.fsf@gnu.org> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?= =?utf-8?Q?s?= message of "Mon, 14 Sep 2020 21:27:47 +0200") Message-ID: <877dss90ne.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 32548-done Cc: 32548-done@debbugs.gnu.org, mail@cbaines.net X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hey Ludo, > As discussed on IRC, builds per day should be compared to new > derivations per day. For example, if on a day there=E2=80=99s 100 new > derivations and we only manage to build 10 of them, we have a problem. I added this line, and they sadly do not overlap :( > 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-sp= ec (version-1.1.0). > 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duratio= n-per-spec (wip-desktop). > 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-durati= on-per-spec (wip-desktop). > 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-sp= ec (wip-desktop). > > Perhaps it can=E2=80=99t compute an average yet for these jobsets? Yes as soon as those evaluations will be repaired, we should be able to compute those metrics. I chose to keep the error messages as a remainder. I added various other metrics and updated the "/metrics" page. Once we have a better view, we should think of adding thresholds on those metrics. Closing this one! Thanks, Mathieu --=20 https://othacehe.org ------------=_1600337342-24060-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 27 Aug 2018 22:33:42 +0000 Received: from localhost ([127.0.0.1]:34546 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fuQ4s-0002n9-Eq for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:42 -0400 Received: from eggs.gnu.org ([208.118.235.92]:38205) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fuQ4q-0002mw-6H for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:40 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fuQ4k-0008LF-6r for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:34 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:45524) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1fuQ4k-0008L1-3E for submit@debbugs.gnu.org; Mon, 27 Aug 2018 18:33:34 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:59174) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fuQ4j-00061W-AB for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:33 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fuQ4i-0008Hz-NP for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:33 -0400 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:54985) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fuQ4i-0008HN-IZ for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:32 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=36998 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1fuQ4i-0003HQ-A6 for bug-guix@gnu.org; Mon, 27 Aug 2018 18:33:32 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: bug-guix@gnu.org Subject: Cuirass: Performance monitoring X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 11 Fructidor an 226 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 28 Aug 2018 00:33:30 +0200 Message-ID: <87pny3783p.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.0 (------) As discussed earlier today on IRC with Cl=C3=A9ment, we could add performan= ce monitoring capabilities to Cuirass. Interesting metrics would be: =E2=80=A2 time of push to time of evaluation completion; =E2=80=A2 time of evaluation completion to time of build completion. We could visualize that per job over time. Perhaps these are also stats that =E2=80=98guix weather=E2=80=99 could display. Ludo=E2=80=99. ------------=_1600337342-24060-1-- From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 17 Sep 2020 20:23:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: 32548-done@debbugs.gnu.org, mail@cbaines.net Received: via spool by 32548-done@debbugs.gnu.org id=D32548.160037413529905 (code D ref 32548); Thu, 17 Sep 2020 20:23:01 +0000 Received: (at 32548-done) by debbugs.gnu.org; 17 Sep 2020 20:22:15 +0000 Received: from localhost ([127.0.0.1]:39209 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kJ0Q3-0007mH-AG for submit@debbugs.gnu.org; Thu, 17 Sep 2020 16:22:15 -0400 Received: from eggs.gnu.org ([209.51.188.92]:58252) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kJ0Q1-0007m5-Q7 for 32548-done@debbugs.gnu.org; Thu, 17 Sep 2020 16:22:14 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:45254) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kJ0Pw-0000vL-HJ; Thu, 17 Sep 2020 16:22:08 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=40258 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kJ0Pr-0003uH-K4; Thu, 17 Sep 2020 16:22:04 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> <87o8m8b1l8.fsf@gnu.org> <877dss90ne.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Jour du =?UTF-8?Q?G=C3=A9nie?= de =?UTF-8?Q?l'Ann=C3=A9e?= 228 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 17 Sep 2020 22:22:01 +0200 In-Reply-To: <877dss90ne.fsf@gnu.org> (Mathieu Othacehe's message of "Thu, 17 Sep 2020 12:07:49 +0200") Message-ID: <87y2l85f2u.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi, Mathieu Othacehe skribis: >> As discussed on IRC, builds per day should be compared to new >> derivations per day. For example, if on a day there=E2=80=99s 100 new >> derivations and we only manage to build 10 of them, we have a problem. > > I added this line, and they sadly do not overlap :( It seems less bad than I thought though, and the rendering is pretty. :-) >> 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-s= pec (version-1.1.0). >> 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-durati= on-per-spec (wip-desktop). >> 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-durat= ion-per-spec (wip-desktop). >> 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-s= pec (wip-desktop). >> >> Perhaps it can=E2=80=99t compute an average yet for these jobsets? > > Yes as soon as those evaluations will be repaired, we should be able to > compute those metrics. I chose to keep the error messages as a > remainder. Makes sense. > I added various other metrics and updated the "/metrics" page. Once we > have a better view, we should think of adding thresholds on those > metrics. Excellent. Thanks a lot for closing this gap! Ludo=E2=80=99. From unknown Wed Sep 10 21:37:06 2025 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 18 Sep 2020 12:22:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: Andreas Enge , 32548@debbugs.gnu.org Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160043170728986 (code B ref 32548); Fri, 18 Sep 2020 12:22:02 +0000 Received: (at 32548) by debbugs.gnu.org; 18 Sep 2020 12:21:47 +0000 Received: from localhost ([127.0.0.1]:41157 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kJFOc-0007XS-MD for submit@debbugs.gnu.org; Fri, 18 Sep 2020 08:21:46 -0400 Received: from eggs.gnu.org ([209.51.188.92]:51436) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kJFOa-0007XC-Sz for 32548@debbugs.gnu.org; Fri, 18 Sep 2020 08:21:45 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:45121) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kJFOV-0002AR-GM; Fri, 18 Sep 2020 08:21:39 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=43262 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kJFOU-0002WV-Nu; Fri, 18 Sep 2020 08:21:38 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> <20200916155639.GA16338@jurong> <87een098un.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Jour du Travail de =?UTF-8?Q?l'Ann=C3=A9e?= 228 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Fri, 18 Sep 2020 14:21:37 +0200 In-Reply-To: <87een098un.fsf@gnu.org> (Mathieu Othacehe's message of "Thu, 17 Sep 2020 09:10:40 +0200") Message-ID: <87mu1nxoku.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hi Mathieu! Mathieu Othacehe skribis: >> How about also adding metrics per build machine? I have the impression, >> for instance, that the aarch64 machine in my living room is not used. >> If this is confirmed, we could take appropriate action (uncomment it in >> /etc/machines.scm :-), compare to other used machines, change the schedu= ling >> in the daemon, or even turn it off to conserve energy should it turn out >> that we have too much build power...). > > Yes I would really like to have something like: > https://hydra.nixos.org/machines, with a build rate for every machine. +1! > However, it cannot be done without structural changes to how offloading > is handled. For now it's working this way: > > Cuirass -> guix-daemon -> guix offload -> build machines > > Which means that Cuirass has almost no information about offloaded > builds. In practice, it could parse the offload events that it gets; a bit of a hack, but good enough. However=E2=80=A6 > We are currently starting discussions about inviting the Guix Build > Coordinator to the party. =E2=80=A6 this sounds like the better option longer-term. Ludo=E2=80=99.