From debbugs-submit-bounces@debbugs.gnu.org Wed Sep 21 16:22:35 2016 Received: (at submit) by debbugs.gnu.org; 21 Sep 2016 20:22:35 +0000 Received: from localhost ([127.0.0.1]:59972 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bmo2N-0004f0-K8 for submit@debbugs.gnu.org; Wed, 21 Sep 2016 16:22:35 -0400 Received: from eggs.gnu.org ([208.118.235.92]:46185) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bmo2L-0004el-Of for submit@debbugs.gnu.org; Wed, 21 Sep 2016 16:22:34 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1bmo2F-0005sB-Jr for submit@debbugs.gnu.org; Wed, 21 Sep 2016 16:22:28 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-3.1 required=5.0 tests=BAYES_20,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:43388) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bmo2F-0005rh-H1 for submit@debbugs.gnu.org; Wed, 21 Sep 2016 16:22:27 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1bmo2C-0001o4-Bz; Wed, 21 Sep 2016 16:22:24 -0400 From: Glenn Morris To: submit@debbugs.gnu.org Subject: unstable test results (on hydra) X-Spook: bullion e-cash Disaster Lexis-Nexis Tsunami Warning X-Ran: FZuS^Edm~&L2H^~]ZA&E:4^Vuhs;ve|!qao%0k~^C&-X27"ED6gA63QuD[3s}n-AFLR%h: X-Hue: green X-Debbugs-No-Ack: yes X-Attribution: GM Date: Wed, 21 Sep 2016 16:22:24 -0400 Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -8.1 (--------) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -8.1 (--------) Package: emacs Version: 25.1 On hydra (at least), some tests fail in one iteration and succeed in the next, for no clear reason. This cause noise on the emacs-buildstatus mailing list and makes it harder to spot real problems. Someone (TM) should look into this and try to figure out if the tests really have a problem, or if the problematic ones should just be disabled on hydra. eieio-test-37-obsolete-name-in-constructor is one I have noticed several times. Failed: http://hydra.nixos.org/build/40880158 Passed: http://hydra.nixos.org/build/40890883 There were no relevant changes between those builds. From debbugs-submit-bounces@debbugs.gnu.org Wed Jan 11 14:41:46 2017 Received: (at 24503) by debbugs.gnu.org; 11 Jan 2017 19:41:46 +0000 Received: from localhost ([127.0.0.1]:50206 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cROmI-0001o2-8p for submit@debbugs.gnu.org; Wed, 11 Jan 2017 14:41:46 -0500 Received: from eggs.gnu.org ([208.118.235.92]:55799) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cROmH-0001np-1J for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 14:41:45 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cROmB-00067k-0J for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 14:41:39 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-5.1 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:55484) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cROm7-00065M-VR; Wed, 11 Jan 2017 14:41:35 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1cROm7-0004g9-0R; Wed, 11 Jan 2017 14:41:35 -0500 From: Glenn Morris Subject: Re: bug#24503: unstable test results (on hydra) References: to: Stefan Monnier X-Spook: Kennedy password White Water PLO Albright domestic X-Ran: H*KmTVJz}z3WX4{1zgd`KT!?Q?+4LKs+qay(;njwt80n^cUD<1%eE]Ltjb=WQmQ/rO7MT= X-Hue: blue X-Attribution: GM Date: Wed, 11 Jan 2017 14:41:34 -0500 In-Reply-To: (Glenn Morris's message of "Wed, 21 Sep 2016 16:22:24 -0400") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -8.2 (--------) X-Debbugs-Envelope-To: 24503 Cc: 24503@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -8.2 (--------) Hi Stefan, Do you have any idea why eieio-test-37-obsolete-name-in-constructor sometimes (randomly?) fails with: (eieio--testing "toto") -> [eieio-class-tag--eieio--testing] rather than ("toto" 2) ? Eg http://hydra.nixos.org/build/46213612/log/raw From debbugs-submit-bounces@debbugs.gnu.org Wed Jan 11 16:45:39 2017 Received: (at 24503) by debbugs.gnu.org; 11 Jan 2017 21:45:39 +0000 Received: from localhost ([127.0.0.1]:50242 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRQiB-0004l1-2m for submit@debbugs.gnu.org; Wed, 11 Jan 2017 16:45:39 -0500 Received: from pruche.dit.umontreal.ca ([132.204.246.22]:35066) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRQi9-0004kr-4K for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 16:45:38 -0500 Received: from pastel.home (lechon.iro.umontreal.ca [132.204.27.242]) by pruche.dit.umontreal.ca (8.14.7/8.14.1) with ESMTP id v0BLjZPD031362; Wed, 11 Jan 2017 16:45:35 -0500 Received: by pastel.home (Postfix, from userid 20848) id 752D560309; Wed, 11 Jan 2017 16:45:35 -0500 (EST) From: Stefan Monnier To: Glenn Morris Subject: Re: bug#24503: unstable test results (on hydra) Message-ID: References: Date: Wed, 11 Jan 2017 16:45:35 -0500 In-Reply-To: (Glenn Morris's message of "Wed, 11 Jan 2017 14:41:34 -0500") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-NAI-Spam-Flag: NO X-NAI-Spam-Threshold: 5 X-NAI-Spam-Score: 0 X-NAI-Spam-Rules: 2 Rules triggered EDT_SA_DN_PASS=0, RV5916=0 X-NAI-Spam-Version: 2.3.0.9418 : core <5916> : inlines <5623> : streams <1728665> : uri <2356606> X-Spam-Score: -4.5 (----) X-Debbugs-Envelope-To: 24503 Cc: 24503@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -4.5 (----) > Do you have any idea why eieio-test-37-obsolete-name-in-constructor > sometimes (randomly?) fails with: > (eieio--testing "toto") -> [eieio-class-tag--eieio--testing] > rather than ("toto" 2) ? Hmm... not off the top of my head no. I'll have to dig deeper to give you a better answer, Stefan From debbugs-submit-bounces@debbugs.gnu.org Wed Jan 11 17:10:02 2017 Received: (at 24503) by debbugs.gnu.org; 11 Jan 2017 22:10:02 +0000 Received: from localhost ([127.0.0.1]:50268 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRR5m-0005ON-GR for submit@debbugs.gnu.org; Wed, 11 Jan 2017 17:10:02 -0500 Received: from eggs.gnu.org ([208.118.235.92]:33308) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRR5l-0005Nv-Dm for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 17:10:01 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cRR5f-0003cx-Mc for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 17:09:56 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-5.1 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:57223) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cRR5d-0003cd-Lp; Wed, 11 Jan 2017 17:09:53 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1cRR5d-0000bf-5t; Wed, 11 Jan 2017 17:09:53 -0500 From: Glenn Morris To: Stefan Monnier Subject: Re: bug#24503: unstable test results (on hydra) References: X-Spook: Artistic Assassins Gunfight Wave Mahmoud Ahmadinejad DMAT X-Ran: )TTvTrAav'uudt.(%8m>>BJyI;sm%Qy&$rdXR$b0w^KC-V5k4:)()W}04FLF;}t8DDIJLZ X-Hue: cyan X-Debbugs-No-Ack: yes X-Attribution: GM Date: Wed, 11 Jan 2017 17:09:53 -0500 In-Reply-To: (Stefan Monnier's message of "Wed, 11 Jan 2017 16:45:35 -0500") Message-ID: <3fh9552qq6.fsf@fencepost.gnu.org> User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -8.2 (--------) X-Debbugs-Envelope-To: 24503 Cc: 24503@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -8.2 (--------) I've failed to reproduce this issue myself in 1000+ trials. So maybe it is some hydra-specific weirdness, though I can't see how. If all else fails, the test can just be skipped there. From debbugs-submit-bounces@debbugs.gnu.org Wed Jan 11 18:06:51 2017 Received: (at 24503) by debbugs.gnu.org; 11 Jan 2017 23:06:51 +0000 Received: from localhost ([127.0.0.1]:50408 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRRyl-0003aR-Ee for submit@debbugs.gnu.org; Wed, 11 Jan 2017 18:06:51 -0500 Received: from chene.dit.umontreal.ca ([132.204.246.20]:60549) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRRyi-0003aH-Qg for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 18:06:49 -0500 Received: from fmsmemgm.homelinux.net (lechon.iro.umontreal.ca [132.204.27.242]) by chene.dit.umontreal.ca (8.14.7/8.14.1) with ESMTP id v0BN6kJ3021443; Wed, 11 Jan 2017 18:06:47 -0500 Received: by fmsmemgm.homelinux.net (Postfix, from userid 20848) id 9D263AE119; Wed, 11 Jan 2017 18:06:46 -0500 (EST) From: Stefan Monnier To: Glenn Morris Subject: Re: bug#24503: unstable test results (on hydra) Message-ID: References: <3fh9552qq6.fsf@fencepost.gnu.org> Date: Wed, 11 Jan 2017 18:06:46 -0500 In-Reply-To: <3fh9552qq6.fsf@fencepost.gnu.org> (Glenn Morris's message of "Wed, 11 Jan 2017 17:09:53 -0500") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.1.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-NAI-Spam-Flag: NO X-NAI-Spam-Threshold: 5 X-NAI-Spam-Score: 0 X-NAI-Spam-Rules: 2 Rules triggered EDT_SA_DN_PASS=0, RV5916=0 X-NAI-Spam-Version: 2.3.0.9418 : core <5916> : inlines <5623> : streams <1728673> : uri <2356636> X-Spam-Score: -4.5 (----) X-Debbugs-Envelope-To: 24503 Cc: 24503@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -4.5 (----) > I've failed to reproduce this issue myself in 1000+ trials. So maybe > it is some hydra-specific weirdness, though I can't see how. > If all else fails, the test can just be skipped there. It could be due to a parallel-make issue where sometimes we load a .el file and sometimes we load a .elc file depending on the relative order of execution of the various parallel commands. Stefan "who still haven't looked at the actual code, so is just talking about very general ideas" From debbugs-submit-bounces@debbugs.gnu.org Wed Jan 11 18:16:50 2017 Received: (at 24503) by debbugs.gnu.org; 11 Jan 2017 23:16:50 +0000 Received: from localhost ([127.0.0.1]:50415 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRS8Q-0003pS-DA for submit@debbugs.gnu.org; Wed, 11 Jan 2017 18:16:50 -0500 Received: from eggs.gnu.org ([208.118.235.92]:45653) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRS8O-0003pF-RH for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 18:16:49 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cRS8I-00027O-W4 for 24503@debbugs.gnu.org; Wed, 11 Jan 2017 18:16:43 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-5.1 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:57835) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cRS8G-00026X-E0; Wed, 11 Jan 2017 18:16:40 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1cRS8F-0007af-CB; Wed, 11 Jan 2017 18:16:39 -0500 From: Glenn Morris To: Stefan Monnier Subject: Re: bug#24503: unstable test results (on hydra) References: <3fh9552qq6.fsf@fencepost.gnu.org> X-Spook: offensive information warfare Southwest weapons of mass X-Ran: uy;Ywe2Rn/,,xn4nR&!-{m{;?f\j$ZyxVhBSOzSh|Vm7esNYqw,-`iyBM#sC!_Z.J'D{HO X-Hue: cyan X-Debbugs-No-Ack: yes X-Attribution: GM Date: Wed, 11 Jan 2017 18:16:39 -0500 In-Reply-To: (Stefan Monnier's message of "Wed, 11 Jan 2017 18:06:46 -0500") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -8.2 (--------) X-Debbugs-Envelope-To: 24503 Cc: 24503@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -8.2 (--------) Stefan Monnier wrote: > It could be due to a parallel-make issue where sometimes we load a .el > file and sometimes we load a .elc file depending on the relative order > of execution of the various parallel commands. I think hydra builds are single-core. But obviously we need to wait till you can have a proper look. :) From debbugs-submit-bounces@debbugs.gnu.org Wed Apr 19 17:38:57 2017 Received: (at 24503) by debbugs.gnu.org; 19 Apr 2017 21:38:57 +0000 Received: from localhost ([127.0.0.1]:57508 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1d0xJR-0007Vf-BF for submit@debbugs.gnu.org; Wed, 19 Apr 2017 17:38:57 -0400 Received: from eggs.gnu.org ([208.118.235.92]:38349) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1d0xJP-0007VT-Uu for 24503@debbugs.gnu.org; Wed, 19 Apr 2017 17:38:56 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1d0xJJ-0006YC-PS for 24503@debbugs.gnu.org; Wed, 19 Apr 2017 17:38:50 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:53771) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1d0xJJ-0006Y6-MQ for 24503@debbugs.gnu.org; Wed, 19 Apr 2017 17:38:49 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1d0xJJ-0002qA-4b; Wed, 19 Apr 2017 17:38:49 -0400 From: Glenn Morris To: 24503@debbugs.gnu.org Subject: Re: bug#24503: unstable test results (on hydra) References: <3fh9552qq6.fsf@fencepost.gnu.org> X-Spook: Decapitated Strain Panama Lon Horiuchi Project Monarch X-Ran: 7|A\?!6a0d(uEs@@D_eqjI,h.*7.7_-Eg_TzB-h4sU*7A`)8TS<4Lz^:x@G2Q<\58bi@p` X-Hue: green X-Attribution: GM Date: Wed, 19 Apr 2017 17:38:48 -0400 In-Reply-To: (Glenn Morris's message of "Wed, 11 Jan 2017 18:16:39 -0500") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 24503 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Another one I've seen intermittently fail: Test eieio-test-method-order-list-6 condition: (error "eieio-test-methodinvoke.el: Test Failed: ((:STATIC C) (:STATIC C-base1) (:STATIC C-base2)) != ((:STATIC C))") Eg http://hydra.nixos.org/build/51808781 From debbugs-submit-bounces@debbugs.gnu.org Tue Nov 28 12:57:50 2017 Received: (at 24503) by debbugs.gnu.org; 28 Nov 2017 17:57:50 +0000 Received: from localhost ([127.0.0.1]:35007 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eJk8k-0006oz-AU for submit@debbugs.gnu.org; Tue, 28 Nov 2017 12:57:50 -0500 Received: from eggs.gnu.org ([208.118.235.92]:46003) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eJk8i-0006on-GF for 24503@debbugs.gnu.org; Tue, 28 Nov 2017 12:57:48 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1eJk8X-0005Yg-QU for 24503@debbugs.gnu.org; Tue, 28 Nov 2017 12:57:43 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:50115) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eJk8X-0005Yb-Ma for 24503@debbugs.gnu.org; Tue, 28 Nov 2017 12:57:37 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1eJk8X-0003gf-C5; Tue, 28 Nov 2017 12:57:37 -0500 From: Glenn Morris To: 24503@debbugs.gnu.org Subject: Re: bug#24503: unstable test results (on hydra) References: <3fh9552qq6.fsf@fencepost.gnu.org> X-Spook: CDMA undercover E. Coli mailbomb passwd red noise X-Ran: \iL@k6/3m=~=~MU_}3\Yksy68OO@P]}#=RD%W$k&`yY/0p4P=wiaao-/23u;/"[q:* X-Hue: red X-Attribution: GM Date: Tue, 28 Nov 2017 12:57:37 -0500 In-Reply-To: (Glenn Morris's message of "Wed, 19 Apr 2017 17:38:48 -0400") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 24503 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Tests that "randomly" fail, like the ones mentioned in this report, are a problem for downstream distributions that run "make check" and pay attention to the results (I sometimes think they pay more attention than Emacs does). They can waste their time investigating things that seem to be platform-specific just because they happen to fail once on a particular architecture. Eg https://bugs.debian.org/879020 So we do a disservice to the wider community with these tests that sometimes fail. If they aren't good enough to be enabled on Emacs's own CI system, they probably aren't good enough full-stop, and should be disabled by default for everyone. From debbugs-submit-bounces@debbugs.gnu.org Wed Nov 29 08:36:08 2017 Received: (at 24503) by debbugs.gnu.org; 29 Nov 2017 13:36:08 +0000 Received: from localhost ([127.0.0.1]:35782 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eK2X2-0006fE-0o for submit@debbugs.gnu.org; Wed, 29 Nov 2017 08:36:08 -0500 Received: from mail-io0-f177.google.com ([209.85.223.177]:35640) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eK2X0-0006ej-4s for 24503@debbugs.gnu.org; Wed, 29 Nov 2017 08:36:06 -0500 Received: by mail-io0-f177.google.com with SMTP id q15so3700738ioh.2 for <24503@debbugs.gnu.org>; Wed, 29 Nov 2017 05:36:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=IH7Ov5OiIzd6rQx1XPNNiPxCfV2HbYP37xbpMTdyQbQ=; b=S64PKQpzm6H2NGC7lcVWST4l1316XPWlEkeyWo1pxL8TGoXgyUjZ5+vd77/k4fROfQ AtRpm4zlXXwq2gTtRoFAnUAKEMa60Mkl3QlQyoKcARz4jK8jl9Amyu7/k7hJGGOCd32C ZpyZAHEITtdyJAyVzYrpxef5fOlMlCTYXS2O4Rf5DVHazHyeuXc1cy9TpYq0ikpzci0U D8wnfO/uVbwAOrH+qBG2OlsCKwHnoi62jWJP7PrfqudhzFVk4EgHTzfgv0xnSebEYvSC sLM+L76FceWAuQs0MtDNrS0RQc5pTS2sbPn27xbTBr4VqxCx0cB/KO6VIxPtpMUpIc3b EtyA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:references:date :in-reply-to:message-id:user-agent:mime-version; bh=IH7Ov5OiIzd6rQx1XPNNiPxCfV2HbYP37xbpMTdyQbQ=; b=ZvFxe3xbmKDieHsniFhO0PgNf0KcJrfsD5N6HH37u5TQhhBceCs6ch/I4JtRAqkB9b QQha9MHv2d9CktNvcxBlvAZ0n7dHpuUBh0o2/PzTpS9lPQwblyXiJLiIXR3Hl/WqZ2YU zphFKjAeaRIBWDjiFvm4g3Ao7nfVcNX5prVu8f8nACAjgIsWdEa/pqBTjcRbfy18rdXF IfAHRzB0TpSdfKDfgDjmSqDZhITNil/6E8IGixw0fPQdipgSvrxHl09qm6LOq0t3A96l 78GMyqxw0yErpExSWzWQabmYODxHfMVUG5usfmzhg7tGkjpLHEOx59jXhKgQnySCYaPz GIMg== X-Gm-Message-State: AJaThX4oR7k0D4inEVgkPednntyHqDSYVVNp9bPonE0ZaesVI/fxX9SR OdmyO2XTbM8j3YoEVBWJLLxfj7xD X-Google-Smtp-Source: AGs4zMbsrDu88tKnTikSkKHrLre2XUHQg4FAfIzbTLNW/nQle2ehNOztKX2dMjjcDdS9cX6dxdjsDw== X-Received: by 10.107.134.208 with SMTP id q77mr3322237ioi.20.1511962560242; Wed, 29 Nov 2017 05:36:00 -0800 (PST) Received: from zebian ([45.2.119.34]) by smtp.googlemail.com with ESMTPSA id b74sm1032540itd.19.2017.11.29.05.35.58 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 29 Nov 2017 05:35:59 -0800 (PST) From: Noam Postavsky To: Glenn Morris Subject: Re: bug#24503: unstable test results (on hydra) References: <3fh9552qq6.fsf@fencepost.gnu.org> Date: Wed, 29 Nov 2017 08:35:58 -0500 In-Reply-To: (Glenn Morris's message of "Tue, 28 Nov 2017 12:57:37 -0500") Message-ID: <87tvxdjjgh.fsf@users.sourceforge.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.0.90 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.1 (/) X-Debbugs-Envelope-To: 24503 Cc: 24503@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.1 (/) Glenn Morris writes: > Tests that "randomly" fail, like the ones mentioned in this report, are > a problem for downstream distributions that run "make check" and pay > attention to the results (I sometimes think they pay more attention than > Emacs does). They can waste their time investigating things that seem to > be platform-specific just because they happen to fail once on a > particular architecture. > > Eg > https://bugs.debian.org/879020 > > So we do a disservice to the wider community with these tests that > sometimes fail. If they aren't good enough to be enabled on Emacs's own > CI system, they probably aren't good enough full-stop, and should be > disabled by default for everyone. Hmm, I can't see any reason for these tests to fail in a non-deterministic way. This sounds like it could be a serious bug. And if happens on machines other than the Hydra ones, the bug is almost certainly in Emacs. I think we need to add some logging statements to figure out what is going. I will try to figure how to do that. From debbugs-submit-bounces@debbugs.gnu.org Mon Dec 04 01:43:45 2017 Received: (at control) by debbugs.gnu.org; 4 Dec 2017 06:43:45 +0000 Received: from localhost ([127.0.0.1]:44210 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eLkTg-0006qG-Sd for submit@debbugs.gnu.org; Mon, 04 Dec 2017 01:43:44 -0500 Received: from mail-it0-f53.google.com ([209.85.214.53]:46818) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eLkTf-0006p4-Ay for control@debbugs.gnu.org; Mon, 04 Dec 2017 01:43:44 -0500 Received: by mail-it0-f53.google.com with SMTP id t1so10186387ite.5 for ; Sun, 03 Dec 2017 22:43:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:subject:date:message-id:mime-version; bh=fRXGoolr5ywZMedMNaD5UQcU5QzR2WIMdDj16Mxu3HQ=; b=NYEAOLpGb/Db2Tro4+3cOpy0+A/+/3O3Lk9guDOkyz9sv7douFpV4MCgpds688rndT OcCaIR71TjCW6ETeHFznCasuW2Lkd7jua3y6Jg1J3dHg9Ud299dy/+7tC96c5RcLsTef KHG3kZzkc3IsNiyKKnP/ip1VSD1zlBmEIOUojUX9679gonUyZuY4zaxD9FnVmV4XCF/k wwpHE9eypljOWfScV+yN9JvWm+1qv0ozO8dJKBv2Yr0pQI0nUUiE2UryNBVcKW5AFqZH 8s1eOXG46xvafuTDgmLWYDT12cmitPhESfic9JODn2hrEsGxR6JF5dBxn/CRHRJpDmfl 5ihQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:subject:date:message-id :mime-version; bh=fRXGoolr5ywZMedMNaD5UQcU5QzR2WIMdDj16Mxu3HQ=; b=nECXrHr+q1uKNRliunSmQYBkyJ7hRwSwfOGm2F5OnBxJDiOKw+DFEHhBV9BXccJqXA CuLzEvP/pNzR6xPBoJrNbmohPB7Q+f16g7FI3g+NmQ0qUlMSphf88C1JSH8dPOTDIWw/ evdT3L4rr917Zs5jO7pcZzyzeMSJw65COmUM2R6xhU1FPU8eGMktFEbUAM85pMztqDcp ftAVZI973KTLWhikkDPQIfuNgUtOJWvAQjPvBOjk4pZvtmLpe/fdUJVOqsjCRGm84ido Lf2Cb4W1wJtUT3g6AkdMaVwwLnRlwpzGqwqGYWSh6ipDkStLxFJkAcWGyVmGCjo+cqU2 qMgw== X-Gm-Message-State: AJaThX7NkeYRnoU/u/eobmIJ9vVN0Wy+GzsX8VyAzZEkBPCeHmfw1KS5 xfwwmCu51tVB7olTtopuwXdSYQ== X-Google-Smtp-Source: AGs4zMY22ptsmMnk/uNsDz7mCXIybshAwLsER1JKmzaQToLH7KkVSp1c3AxoXycvY/+gwG+3eumExA== X-Received: by 10.107.142.16 with SMTP id q16mr21898084iod.138.1512369817561; Sun, 03 Dec 2017 22:43:37 -0800 (PST) Received: from zebian ([45.2.119.34]) by smtp.googlemail.com with ESMTPSA id o73sm3498332ito.4.2017.12.03.22.43.36 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 03 Dec 2017 22:43:36 -0800 (PST) From: Noam Postavsky To: control@debbugs.gnu.org Subject: control message for bug #27878 Date: Mon, 04 Dec 2017 01:43:35 -0500 Message-ID: <87po7vgfhk.fsf@users.sourceforge.net> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.6 (/) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.6 (/) severity 27878 normal merge 27878 24503 quit From debbugs-submit-bounces@debbugs.gnu.org Tue Jan 09 23:02:14 2018 Received: (at 24503-done) by debbugs.gnu.org; 10 Jan 2018 04:02:14 +0000 Received: from localhost ([127.0.0.1]:50151 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eZ7ag-0005Tm-66 for submit@debbugs.gnu.org; Tue, 09 Jan 2018 23:02:14 -0500 Received: from eggs.gnu.org ([208.118.235.92]:59089) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eZ7ae-0005TY-HF for 24503-done@debbugs.gnu.org; Tue, 09 Jan 2018 23:02:12 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1eZ7aY-0004d3-Kr for 24503-done@debbugs.gnu.org; Tue, 09 Jan 2018 23:02:07 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:42984) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eZ7aY-0004cm-IA for 24503-done@debbugs.gnu.org; Tue, 09 Jan 2018 23:02:06 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1eZ7aY-0008Bq-1s; Tue, 09 Jan 2018 23:02:06 -0500 From: Glenn Morris To: 24503-done@debbugs.gnu.org Subject: Re: bug#24503: unstable test results (on hydra) References: <3fh9552qq6.fsf@fencepost.gnu.org> X-Spook: Freeh Nuclear threat Homeland Defense Social media IRA X-Ran: 3:+_90C["BY$/ViMn|nl_3WuR+Z).Tm+m2SEp5RGizU(N}+)PdRoUFS_g}@nK3X[_gUWG2 X-Hue: brightwhite X-Debbugs-No-Ack: yes X-Attribution: GM Date: Tue, 09 Jan 2018 23:02:05 -0500 In-Reply-To: (Glenn Morris's message of "Tue, 28 Nov 2017 12:57:37 -0500") Message-ID: <9jshbe8ipu.fsf@fencepost.gnu.org> User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 24503-done X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Version: 26.0.91 I've tagged the relevant tests as unstable and skipped them by default. I will tag more tests as unstable if and when they come up. From debbugs-submit-bounces@debbugs.gnu.org Tue Jan 09 23:21:12 2018 Received: (at 24503) by debbugs.gnu.org; 10 Jan 2018 04:21:12 +0000 Received: from localhost ([127.0.0.1]:50167 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eZ7t2-0005vG-47 for submit@debbugs.gnu.org; Tue, 09 Jan 2018 23:21:12 -0500 Received: from mail-it0-f41.google.com ([209.85.214.41]:35993) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eZ7t0-0005v4-2o for 24503@debbugs.gnu.org; Tue, 09 Jan 2018 23:21:10 -0500 Received: by mail-it0-f41.google.com with SMTP id p124so7246991ite.1 for <24503@debbugs.gnu.org>; Tue, 09 Jan 2018 20:21:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=jafMtnzZIRtO1X4WSJHJZHxmf+3ef3wjyqLlU6d9gIU=; b=dM7tYXQxqRsATgwvFPVNeUAYlhSsax16GMFThsbA1UYKjc81lioBEejBu/1tr+OBap 3HfXKsr9owWhR2x+9dwf6ujKEX4mbIT0RUvIwSHKeRA+qBoFForDMYCufu8cm48BsPuh QOw0W2Q3BEPkuArcK3T3y4FsIotSAzluesUSVacx+O1DJQ1C9/0PpQQwincCnMFS3wyF xKOR5D1MEO2qqEL4nQGHu1MZMpOBoU/u6SdW1tfVJZaqhJgyyAMsfboz8gO/QQfPya1T n9d0s4vKw0jgCXVr1bQDhnk8LmrXTEghH3aQncqa3gf5J4epd+JFcStVvHxi+fI1+4fZ C0ZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:references:date :in-reply-to:message-id:user-agent:mime-version; bh=jafMtnzZIRtO1X4WSJHJZHxmf+3ef3wjyqLlU6d9gIU=; b=miYjHyH/svuIQST1sDWrIOJo6/jbFbkdYLAayJdFhIz/Tf8qjMMJjWihwdnzw2nU7a Z49qq3mdVv8mTnL4oamqS0pyIjA6wVO/Gq8HSy0oHi+O9UqzrqkRGBMVEwUtSf1eN0ud d23/wofUr6GF+3n2iAVE3mYo2j+jJTKp9LY6BL+oRR3tg5QfpQrNO2EiiMqSm9Jl/zbQ JFri5Eq445AA7ewG9IDv9h4R3h880A/1UPx8d3vvHrQ0jaJ+LXCE3AA0byxKmfdar2s0 89JEOlzCbV0YDsYbz1cge0bdPyeuBrKTu2W/A+YgFkUL+2RnksWZ4UtiLDYWWJR8Etiu dS4w== X-Gm-Message-State: AKGB3mKP7vRBIT8br5BwHSabypASMR5vZnDCf/sQUtU9aLaVMeEM+nP+ gEMIFz2pDBHjhNftM4zGrNau8A== X-Google-Smtp-Source: ACJfBovzpxplZEGsHkKTYKEK6QUQd5VPxh5f+yEB8lsfsfQD1wyUaLUZfNz34LEotv9F/iyvtDRpdg== X-Received: by 10.36.50.73 with SMTP id j70mr16714489ita.149.1515558064234; Tue, 09 Jan 2018 20:21:04 -0800 (PST) Received: from zebian ([45.2.119.34]) by smtp.googlemail.com with ESMTPSA id 103sm9292600iot.4.2018.01.09.20.21.02 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Tue, 09 Jan 2018 20:21:03 -0800 (PST) From: Noam Postavsky To: Glenn Morris Subject: Re: bug#24503: unstable test results (on hydra) References: <3fh9552qq6.fsf@fencepost.gnu.org> <87tvxdjjgh.fsf@users.sourceforge.net> Date: Tue, 09 Jan 2018 23:21:02 -0500 In-Reply-To: <87tvxdjjgh.fsf@users.sourceforge.net> (Noam Postavsky's message of "Wed, 29 Nov 2017 08:35:58 -0500") Message-ID: <87lgh6pcnl.fsf@users.sourceforge.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.0.90 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: 24503 Cc: 24503@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.5 (/) Noam Postavsky writes: > Hmm, I can't see any reason for these tests to fail in a > non-deterministic way. This sounds like it could be a serious bug. And > if happens on machines other than the Hydra ones, the bug is almost > certainly in Emacs. I think we need to add some logging statements to > figure out what is going. I will try to figure how to do that. I didn't see any failures since I added tracing code [1: cfa50d30f2], probably the tracing itself changed something which somehow prevents the bug from triggering. [1: cfa50d30f2]: 2017-12-03 15:39:02 -0500 ; Tracing for eieio-test random failure (Bug#24503) https://git.savannah.gnu.org/cgit/emacs.git/commit/?id=cfa50d30f2876ca30158082e9a91d19e804a7e09 From unknown Mon Jun 23 18:30:32 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Wed, 07 Feb 2018 12:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator