From unknown Sat Jun 21 05:19:21 2025 X-Loop: help-debbugs@gnu.org Subject: bug#42137: cuirass: monitor evaluation status Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 30 Jun 2020 12:05:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 42137 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 42137@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.159351865729490 (code B ref -1); Tue, 30 Jun 2020 12:05:02 +0000 Received: (at submit) by debbugs.gnu.org; 30 Jun 2020 12:04:17 +0000 Received: from localhost ([127.0.0.1]:50370 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jqEzp-0007fZ-3v for submit@debbugs.gnu.org; Tue, 30 Jun 2020 08:04:17 -0400 Received: from lists.gnu.org ([209.51.188.17]:47906) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jqEzn-0007fS-33 for submit@debbugs.gnu.org; Tue, 30 Jun 2020 08:04:16 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34830) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jqEzm-0001A0-U9 for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:49185) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jqEzm-0007pm-KF for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 Received: from lfbn-ann-1-356-169.w86-200.abo.wanadoo.fr ([86.200.73.169]:55358 helo=meru) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1jqEzl-0005ns-VT for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 From: Mathieu Othacehe Date: Tue, 30 Jun 2020 14:04:10 +0200 Message-ID: <875zb82211.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, With Hydra, it is possible for a derivation to have the status of all "still succeeding jobs", "newly failing jobs", "newly succeeding jobs". In a word, have a quick overview of an evaluation status. You can have a look to https://hydra.nixos.org/jobset/nixos/release-19.09-small where it's easy to see that 1591716 caused two test failures, that were fixed right after. In Cuirass, it's only possible to know the status of triggered builds, for each evaluation. For the last two months, the system installation were almost all broken, I think that if we have had a page showing the full status of system tests evaluation by evaluation, we could have avoided this situation. Also having the "newly failing jobs" list would allow to mail the people that have commited changes between the last evaluation. Of course this is easier said than done, it might imply to update our database structure among other things. WDYT? Thanks, Mathieu From unknown Sat Jun 21 05:19:21 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: Mathieu Othacehe Subject: bug#42137: closed (Re: bug#42137: cuirass: monitor evaluation status) Message-ID: References: <87czuz534i.fsf@gnu.org> <875zb82211.fsf@gnu.org> X-Gnu-PR-Message: they-closed 42137 X-Gnu-PR-Package: guix Reply-To: 42137@debbugs.gnu.org Date: Mon, 12 Apr 2021 08:17:01 +0000 Content-Type: multipart/mixed; boundary="----------=_1618215421-4478-1" This is a multi-part message in MIME format... ------------=_1618215421-4478-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #42137: cuirass: monitor evaluation status which was filed against the guix package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 42137@debbugs.gnu.org. --=20 42137: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D42137 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1618215421-4478-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 42137-done) by debbugs.gnu.org; 12 Apr 2021 08:16:55 +0000 Received: from localhost ([127.0.0.1]:56337 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lVrkd-00019t-56 for submit@debbugs.gnu.org; Mon, 12 Apr 2021 04:16:55 -0400 Received: from eggs.gnu.org ([209.51.188.92]:46342) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lVrka-00019g-TP for 42137-done@debbugs.gnu.org; Mon, 12 Apr 2021 04:16:54 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:49880) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lVrkV-0004Ck-LS for 42137-done@debbugs.gnu.org; Mon, 12 Apr 2021 04:16:47 -0400 Received: from [2a01:e0a:19b:d9a0:9576:8bbf:4795:82ee] (port=57958 helo=meije) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1lVrkV-0000gU-1p for 42137-done@debbugs.gnu.org; Mon, 12 Apr 2021 04:16:47 -0400 From: Mathieu Othacehe To: 42137-done@debbugs.gnu.org Subject: Re: bug#42137: cuirass: monitor evaluation status References: <875zb82211.fsf@gnu.org> Date: Mon, 12 Apr 2021 10:16:45 +0200 In-Reply-To: <875zb82211.fsf@gnu.org> (Mathieu Othacehe's message of "Tue, 30 Jun 2020 14:04:10 +0200") Message-ID: <87czuz534i.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 42137-done X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Hello, > Also having the "newly failing jobs" list would allow to mail the people > that have commited changes between the last evaluation. > > Of course this is easier said than done, it might imply to update our > database structure among other things. This has been implemented with a new "Jobs" table and the associated dashboard views. Thanks, Mathieu ------------=_1618215421-4478-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 30 Jun 2020 12:04:17 +0000 Received: from localhost ([127.0.0.1]:50370 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jqEzp-0007fZ-3v for submit@debbugs.gnu.org; Tue, 30 Jun 2020 08:04:17 -0400 Received: from lists.gnu.org ([209.51.188.17]:47906) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jqEzn-0007fS-33 for submit@debbugs.gnu.org; Tue, 30 Jun 2020 08:04:16 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34830) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jqEzm-0001A0-U9 for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:49185) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jqEzm-0007pm-KF for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 Received: from lfbn-ann-1-356-169.w86-200.abo.wanadoo.fr ([86.200.73.169]:55358 helo=meru) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1jqEzl-0005ns-VT for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 From: Mathieu Othacehe To: bug-guix@gnu.org Subject: cuirass: monitor evaluation status Date: Tue, 30 Jun 2020 14:04:10 +0200 Message-ID: <875zb82211.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, With Hydra, it is possible for a derivation to have the status of all "still succeeding jobs", "newly failing jobs", "newly succeeding jobs". In a word, have a quick overview of an evaluation status. You can have a look to https://hydra.nixos.org/jobset/nixos/release-19.09-small where it's easy to see that 1591716 caused two test failures, that were fixed right after. In Cuirass, it's only possible to know the status of triggered builds, for each evaluation. For the last two months, the system installation were almost all broken, I think that if we have had a page showing the full status of system tests evaluation by evaluation, we could have avoided this situation. Also having the "newly failing jobs" list would allow to mail the people that have commited changes between the last evaluation. Of course this is easier said than done, it might imply to update our database structure among other things. WDYT? Thanks, Mathieu ------------=_1618215421-4478-1--