From unknown Fri Jun 13 10:23:40 2025 X-Loop: help-debbugs@gnu.org Subject: bug#52250: [cuirass] Feature request: Compare evaluations in the web interface Resent-From: Leo Famulari Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 02 Dec 2021 21:45:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 52250 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 52250@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.163848147126791 (code B ref -1); Thu, 02 Dec 2021 21:45:01 +0000 Received: (at submit) by debbugs.gnu.org; 2 Dec 2021 21:44:31 +0000 Received: from localhost ([127.0.0.1]:49474 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mstsU-0006y3-QO for submit@debbugs.gnu.org; Thu, 02 Dec 2021 16:44:31 -0500 Received: from lists.gnu.org ([209.51.188.17]:45422) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mstsT-0006xv-1y for submit@debbugs.gnu.org; Thu, 02 Dec 2021 16:44:29 -0500 Received: from eggs.gnu.org ([209.51.188.92]:57310) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mstsQ-0004BX-Bj for bug-guix@gnu.org; Thu, 02 Dec 2021 16:44:28 -0500 Received: from wout1-smtp.messagingengine.com ([64.147.123.24]:45395) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mstsM-000206-PS for bug-guix@gnu.org; Thu, 02 Dec 2021 16:44:25 -0500 Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.west.internal (Postfix) with ESMTP id 667423201D07; Thu, 2 Dec 2021 16:44:20 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Thu, 02 Dec 2021 16:44:20 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=date:from:to:subject:message-id:mime-version:content-type; s= mesmtp; bh=lJ1nOWpsARuqru00Wx5cWBEPeO2nBg9FCqCvqes2xDs=; b=KsWHv fWtVVrDE3WBT0ft4mdJJwKdnkPPDIB+Q7dHvfH4qPA0FD1W2Daev3Wo/yUgu8j52 97B068sXiKw8+FvkRCTXX4Hj1f1gYU8mFf6ng+ccxB9p/leNJ8yxbxQhKVt6ZMVJ m48wX5wP37OaKSkC1uu6Ox8ouhcQf6YyZBeMmE= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=lJ1nOWpsARuqru00Wx5cWBEPeO2nB g9FCqCvqes2xDs=; b=EB3ZwdIXszIEcjlVR4xO5ZKfG2gk+pnz9+DTmhec99tbg f6UOW3hExupKfkDZQpLZlsl5dldRHOD8UbnfOJ8P4hvYNF11NSkDySpMVEL9Dp04 hS556wzY0pqJB3iXLcRKebWjGunkwAYX603tEBFmDa90FdUHsBAp7oDl+q2s+LXP 0JaiEsCeZFDawgw043Z0IlbxkWKCF+8RL3Q+NmDk1luo5EkpUV1dJ04WQpRsy0F0 QQp6hFsl1LjSBG4TWIg7ZG7FZyonP1SH/CCW10zxg3y+uvZN2LDIhOv6thcB3UeM EWprKchnTv4yXeLbr67PZQzOI2VDfuhFGHQi6dZvg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvuddrieehgdduhedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepnfgvohcuhfgrmhhulhgrrhhiuceolhgvohesfhgrmhhulhgrrhhi rdhnrghmvgeqnecuggftrfgrthhtvghrnhepueeiudeijeduffdvhfejvdegvdehgffgje dvveekfeefleefkeeuieejudevtedunecuffhomhgrihhnpehgnhhurdhorhhgnecuvehl uhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomheplhgvohesfhgrmh hulhgrrhhirdhnrghmvg X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 2 Dec 2021 16:44:19 -0500 (EST) Date: Thu, 2 Dec 2021 16:44:17 -0500 From: Leo Famulari Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Received-SPF: pass client-ip=64.147.123.24; envelope-from=leo@famulari.name; helo=wout1-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.4 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.4 (--) As Mark mentioned recently in #33362 [0], the Cuirass web interface is still missing an important feature compared to Hyrda: "[...] the ability to compare the results of two evaluations and show the *differences* between those results, i.e. to enumerate the newly failing jobs, the newly succeeding jobs, and the newly aborted jobs." I remember using this capability in Hydra and it made the branching workflow much more efficient than is currently possible. [0] https://issues.guix.gnu.org/33362#11 From unknown Fri Jun 13 10:23:40 2025 X-Loop: help-debbugs@gnu.org Subject: bug#52250: [cuirass] Feature request: Compare evaluations in the web interface Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 03 Dec 2021 10:05:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 52250 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Leo Famulari Cc: 52250@debbugs.gnu.org Received: via spool by 52250-submit@debbugs.gnu.org id=B52250.163852585927844 (code B ref 52250); Fri, 03 Dec 2021 10:05:01 +0000 Received: (at 52250) by debbugs.gnu.org; 3 Dec 2021 10:04:19 +0000 Received: from localhost ([127.0.0.1]:50057 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mt5QR-0007F0-9f for submit@debbugs.gnu.org; Fri, 03 Dec 2021 05:04:19 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41666) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mt5QO-0007Eh-Oh for 52250@debbugs.gnu.org; Fri, 03 Dec 2021 05:04:17 -0500 Received: from [2001:470:142:3::e] (port=54328 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mt5QJ-0000nr-FG; Fri, 03 Dec 2021 05:04:11 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=bMLmvFdi+WXdne2GYAHyn8cKiCGRnHgUMWWjW5yR6pc=; b=pdYCV1y5HLIPiPMmjoB9 ymsXbsJ5M9Eu9cp9PNK1lUdUSqPSb0HSeoZ13Aigt6b9fsalFNyNab0+pruwDUvkDOgGyzyZOzD4H 93jnSbr6wLtexhIFz7AS7Lc79XA4GtxDAaAIJEnwrC9bVIvjpxMoR8Ad8VIW7Wk22ugmmesFvYvCa 6NQJK/wrEa/ncHIjNsLp3GMngR8Cg6+axB1Jgbd7vyjGmqDK1z5SQkpSHuw6723U327VOFWL/MEPo KNDIyWM/+/THC5W2hnIvdoqmBqscng3+NSJNWzUIuWxnUUQ/s/YP8Nesf8typswk41lQD36gP+eDw oTQTVHUEbldTdg==; Received: from [2a01:e0a:19b:d9a0:45b5:a14a:5c75:5737] (port=32918 helo=meije) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mt5QI-0003qJ-R8; Fri, 03 Dec 2021 05:04:11 -0500 From: Mathieu Othacehe References: Date: Fri, 03 Dec 2021 11:04:07 +0100 In-Reply-To: (Leo Famulari's message of "Thu, 2 Dec 2021 16:44:17 -0500") Message-ID: <874k7qt36w.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello Leo, > "[...] the ability to compare the results of two evaluations > and show the *differences* between those results, i.e. to enumerate the > newly failing jobs, the newly succeeding jobs, and the newly aborted > jobs." Yes that's something we should definitely add to Cuirass. On the database side, the Jobs table gives the list of all the builds related to an evaluation. Implementing an evaluation diff (new derivations, newly successful derivations, newly failing derivations, removed derivations) should just be a matter of displaying data nicely. The not so trivial part is how to make it somehow user friendly in the Web UI. The rest of the interface isn't super easy to understand and I fear that it will add an extra layer of complexity if not integrated properly. A first implementation could be a completely separate page, with two text inputs to enter evaluation A and evaluation B ids. Then, when clicking on a "GO" button the diff would be displayed under an array with different tabulations. WDYT? Thanks, Mathieu From unknown Fri Jun 13 10:23:40 2025 X-Loop: help-debbugs@gnu.org Subject: bug#52250: [cuirass] Feature request: Compare evaluations in the web interface Resent-From: Leo Famulari Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 03 Dec 2021 22:32:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 52250 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: 52250@debbugs.gnu.org Received: via spool by 52250-submit@debbugs.gnu.org id=B52250.163857070529423 (code B ref 52250); Fri, 03 Dec 2021 22:32:02 +0000 Received: (at 52250) by debbugs.gnu.org; 3 Dec 2021 22:31:45 +0000 Received: from localhost ([127.0.0.1]:52369 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mtH5Y-0007eI-Jx for submit@debbugs.gnu.org; Fri, 03 Dec 2021 17:31:44 -0500 Received: from wout2-smtp.messagingengine.com ([64.147.123.25]:50707) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mtH5P-0007dw-F9 for 52250@debbugs.gnu.org; Fri, 03 Dec 2021 17:31:31 -0500 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id 8491732002E2; Fri, 3 Dec 2021 17:31:16 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Fri, 03 Dec 2021 17:31:16 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=mesmtp; bh=6QAK7PG3YPk/Q9HrPJVQOuAc z8evLLH4br+pXVG3dVA=; b=CBjRYQKxCEYxi3twoh8EtOzqaR/GEyS/rX91oG6S d3QOwmmje3fI5EPHYQWEkU4RNHE2FbLLDbJ0LWkveWAFvDPTXd5dJ5sNd19c2M3Q IoItFSZl+jneRKzcwhR1n5b3tzhUVFV/GrJpH3GEil9PIJhiHriR5Vp/Hjopt141 ww0= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=6QAK7P G3YPk/Q9HrPJVQOuAcz8evLLH4br+pXVG3dVA=; b=WEa2eK56PsUqGtQqSUFVNZ 4FYF9CXmnTSIdvXt6H8dAjKfTh39m5OZlUF2krEmMAP9whx0omACelOMuo/PMVkG FhsJBBjj7VcJILBt6XuqMKF6OenKbfHAeXIA7SZHqSYwEsoeQzi62ouYsU/9JOvS LC9ZGWEnE3aCeCGTe+CWHARp8bpLSFWmFVEU3+P6pcmoqT/KFBSxgPtFkyh86ycV JUMQQNJxHywedgdH+C4QChmwoVzsJgUOoN9kQ7rKaU8ukaei6R7C9M5bqrLQsjcV J4irHLfIEUHrSjviIwZkIGEEP8Yixvf+JBhhicGtwNx/PvSgluUHzDe6MlYAYT3g == X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvuddrieejgdduieegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvffukfhfgggtuggjsehttdertddttddvnecuhfhrohhmpefnvghoucfh rghmuhhlrghrihcuoehlvghosehfrghmuhhlrghrihdrnhgrmhgvqeenucggtffrrghtth gvrhhnpefhffejveejjeefheeileegjefgtedttddtudegheeuueeludejfeejvdffhfeu heenucffohhmrghinhepnhhigihoshdrohhrghenucevlhhushhtvghrufhiiigvpedtne curfgrrhgrmhepmhgrihhlfhhrohhmpehlvghosehfrghmuhhlrghrihdrnhgrmhgv X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Fri, 3 Dec 2021 17:31:15 -0500 (EST) Date: Fri, 3 Dec 2021 17:31:13 -0500 From: Leo Famulari Message-ID: References: <874k7qt36w.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <874k7qt36w.fsf@gnu.org> X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) On Fri, Dec 03, 2021 at 11:04:07AM +0100, Mathieu Othacehe wrote: > The not so trivial part is how to make it somehow user friendly in the > Web UI. The rest of the interface isn't super easy to understand and I > fear that it will add an extra layer of complexity if not integrated > properly. Take a look at how Hydra does it: https://hydra.nixos.org/eval/1727596 See the "Compare to..." button in the upper right? I think we should just copy what they do. That interface was convenient and efficient for us in the past.