GNU bug report logs - #36616
27.0.50; Say how many tests failed

Previous Next

Package: emacs;

Reported by: Lars Ingebrigtsen <larsi <at> gnus.org>

Date: Fri, 12 Jul 2019 14:12:02 UTC

Severity: wishlist

Tags: fixed

Found in version 27.0.50

Fixed in version 27.1

Done: Lars Ingebrigtsen <larsi <at> gnus.org>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 36616 in the body.
You can then email your comments to 36616 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox

Report forwarded to bug-gnu-emacs <at> gnu.org:
bug#36616; Package emacs. (Fri, 12 Jul 2019 14:12:02 GMT) Full text and rfc822 format available.
Acknowledgement sent to Lars Ingebrigtsen <larsi <at> gnus.org>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs <at> gnu.org. (Fri, 12 Jul 2019 14:12:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: bug-gnu-emacs <at> gnu.org
Subject: 27.0.50; Say how many tests failed
Date: Fri, 12 Jul 2019 16:11:32 +0200

When saying "make test" you get this:

---

SUMMARY OF TEST RESULTS
-----------------------
Files examined: 240
Ran 3255 tests, 3210 results as expected, 45 skipped

---

After getting out my slide rule I see that that all adds up, but perhaps
this should say explicitly "0 failed"?  Since that's what we're
interested in.



-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no
Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#36616; Package emacs. (Fri, 12 Jul 2019 14:51:01 GMT) Full text and rfc822 format available.

Message #8 received at 36616 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: 36616 <at> debbugs.gnu.org
Subject: Re: bug#36616: 27.0.50; Say how many tests failed
Date: Fri, 12 Jul 2019 17:49:35 +0300

> From: Lars Ingebrigtsen <larsi <at> gnus.org>
> Date: Fri, 12 Jul 2019 16:11:32 +0200
> 
> SUMMARY OF TEST RESULTS
> -----------------------
> Files examined: 240
> Ran 3255 tests, 3210 results as expected, 45 skipped
> 
> ---
> 
> After getting out my slide rule I see that that all adds up, but perhaps
> this should say explicitly "0 failed"?  Since that's what we're
> interested in.

I'm not sure, because there can be expected failures as well.
Maybe "0 unexpected results"?
Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#36616; Package emacs. (Fri, 12 Jul 2019 14:59:02 GMT) Full text and rfc822 format available.

Message #11 received at 36616 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: 36616 <at> debbugs.gnu.org
Subject: Re: bug#36616: 27.0.50; Say how many tests failed
Date: Fri, 12 Jul 2019 16:58:04 +0200

Eli Zaretskii <eliz <at> gnu.org> writes:

> I'm not sure, because there can be expected failures as well.
> Maybe "0 unexpected results"?

Hm...  But aren't expected failures successes?  :-)

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no
Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#36616; Package emacs. (Fri, 12 Jul 2019 18:14:02 GMT) Full text and rfc822 format available.

Message #14 received at 36616 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: 36616 <at> debbugs.gnu.org
Subject: Re: bug#36616: 27.0.50; Say how many tests failed
Date: Fri, 12 Jul 2019 21:13:08 +0300

> From: Lars Ingebrigtsen <larsi <at> gnus.org>
> Cc: 36616 <at> debbugs.gnu.org
> Date: Fri, 12 Jul 2019 16:58:04 +0200
> 
> Eli Zaretskii <eliz <at> gnu.org> writes:
> 
> > I'm not sure, because there can be expected failures as well.
> > Maybe "0 unexpected results"?
> 
> Hm...  But aren't expected failures successes?  :-)

No, they are failures.  But expected.
Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#36616; Package emacs. (Fri, 12 Jul 2019 23:57:01 GMT) Full text and rfc822 format available.

Message #17 received at 36616 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: 36616 <at> debbugs.gnu.org
Subject: Re: bug#36616: 27.0.50; Say how many tests failed
Date: Sat, 13 Jul 2019 01:56:18 +0200

I've now made it output the data on unexpected results (and skipped)
unconditionally.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no
Added tag(s) fixed. Request was from Lars Ingebrigtsen <larsi <at> gnus.org> to control <at> debbugs.gnu.org. (Fri, 12 Jul 2019 23:57:02 GMT) Full text and rfc822 format available.
bug marked as fixed in version 27.1, send any further explanations to 36616 <at> debbugs.gnu.org and Lars Ingebrigtsen <larsi <at> gnus.org> Request was from Lars Ingebrigtsen <larsi <at> gnus.org> to control <at> debbugs.gnu.org. (Fri, 12 Jul 2019 23:57:02 GMT) Full text and rfc822 format available.
bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Sat, 10 Aug 2019 11:24:04 GMT) Full text and rfc822 format available.
This bug report was last modified 5 years and 312 days ago.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.