GNU bug report logs - #11745
the new test-suite summary is confusing

Previous Next

Full log

View this message in rfc822 format

From: help-debbugs <at> gnu.org (GNU bug Tracking System)
To: Alexandre Duret-Lutz <adl <at> lrde.epita.fr>
Subject: bug#11745: closed (Re: bug#11745: the new test-suite summary is
 confusing)
Date: Sat, 06 Jun 2020 22:49:02 +0000

[Message part 1 (text/plain, inline)]

Your bug report

#11745: the new test-suite summary is confusing

which was filed against the automake package, has been closed.

The explanation is attached below, along with your original report.
If you require more details, please reply to 11745 <at> debbugs.gnu.org.

-- 
11745: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=11745
GNU Bug Tracking System
Contact help-debbugs <at> gnu.org with problems

[Message part 2 (message/rfc822, inline)]

From: Karl Berry <karl <at> freefriends.org>
To: jim <at> meyering.net
Cc: adl <at> lrde.epita.fr, 11745 <at> debbugs.gnu.org
Subject: Re: bug#11745: the new test-suite summary is confusing
Date: Sat, 6 Jun 2020 16:48:40 -0600

      AM_TESTSUITE_SUMMARY_HEADER = ' for $(PACKAGE_STRING)'

I went back and forth on which quotes to use :).
Ok, accepted, pushed, thanks :). -k

[Message part 3 (message/rfc822, inline)]

From: Alexandre Duret-Lutz <adl <at> lrde.epita.fr>
To: bug-automake <at> gnu.org
Subject: the new test-suite summary is confusing
Date: Tue, 19 Jun 2012 18:47:07 +0200

Hi!

I have a project that contains 8 different test-suites, each in its
own directory.  Some test suite are big, other are small, but they
test different parts of the project and I like being able to run "make
check" in the relevant directory.  They are run sequentially (with
SUBDIRS) when "make check" is run from the top-level.

I upgraded to Automake 1.12.1 to discover the each of these test-suite
now displays a huge summary like:

============================================================================
Testsuite summary for spot 0.9.1a
============================================================================
# TOTAL: 2
# PASS:  2
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================

Instead of the older one-line summary I'm used too.

I can live with the extra verbosity, but I find the initial header
saying "Testsuite summary for spot 0.9.1a" in each of the test suites
very confusing.  The above in definitely *not* a testsuite summary for
the project, it's only a test summary for one directory.

I think the easiest fix would be to change the header to just
"Testsuite summary", without mentioning the package.

Another option could be to let the test-suite be named in Makefile.am.
Maybe introduce
    TESTS_DISPLAY_NAME = $(PACKAGE_STRING)
and use
    echo "Testsuite summary for $(TESTS_DISPLAY_NAME)"
so that people with multiple test-suites can give them different names.

-- 
Alexandre Duret-Lutz

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.