GNU bug report logs - #24503
unstable test results (on hydra)

Previous Next

Full log

Message #27 received at 24503 <at> debbugs.gnu.org (full text, mbox):

From: Noam Postavsky <npostavs <at> users.sourceforge.net>
To: Glenn Morris <rgm <at> gnu.org>
Cc: 24503 <at> debbugs.gnu.org
Subject: Re: bug#24503: unstable test results (on hydra)
Date: Wed, 29 Nov 2017 08:35:58 -0500

Glenn Morris <rgm <at> gnu.org> writes:

> Tests that "randomly" fail, like the ones mentioned in this report, are
> a problem for downstream distributions that run "make check" and pay
> attention to the results (I sometimes think they pay more attention than
> Emacs does). They can waste their time investigating things that seem to
> be platform-specific just because they happen to fail once on a
> particular architecture.
>
> Eg
> https://bugs.debian.org/879020
>
> So we do a disservice to the wider community with these tests that
> sometimes fail. If they aren't good enough to be enabled on Emacs's own
> CI system, they probably aren't good enough full-stop, and should be
> disabled by default for everyone.

Hmm, I can't see any reason for these tests to fail in a
non-deterministic way.  This sounds like it could be a serious bug.  And
if happens on machines other than the Hydra ones, the bug is almost
certainly in Emacs.  I think we need to add some logging statements to
figure out what is going.  I will try to figure how to do that.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.