GNU bug report logs - #49309
Feature Request: Automake script based tests to print the test name before running it

Previous Next

Full log

View this message in rfc822 format

From: help-debbugs <at> gnu.org (GNU bug Tracking System)
To: Kasper k <kasperkantz <at> outlook.com>
Subject: bug#49309: closed (Re: bug#49309: Feature Request: Automake
 script based tests to print the test name before running it)
Date: Wed, 29 Sep 2021 01:29:03 +0000

[Message part 1 (text/plain, inline)]

Your bug report

#49309: Feature Request: Automake script based tests to print the test name before running it

which was filed against the automake package, has been closed.

The explanation is attached below, along with your original report.
If you require more details, please reply to 49309 <at> debbugs.gnu.org.

-- 
49309: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=49309
GNU Bug Tracking System
Contact help-debbugs <at> gnu.org with problems

[Message part 2 (message/rfc822, inline)]

From: Karl Berry <karl <at> freefriends.org>
To: 49309 <at> debbugs.gnu.org
Subject: Re: bug#49309: Feature Request: Automake script based tests to print
 the test name before running it
Date: Tue, 28 Sep 2021 19:28:13 -0600

  make AM_TESTS_ENVIRONMENT='echo RUNNING: "$$f";' check 

I added this to the manual as another example of using
[AM_]TESTS_ENVIRONMENT.  Closing the bug ... --thanks, karl.

[Message part 3 (message/rfc822, inline)]

From: Kasper k <kasperkantz <at> outlook.com>
To: "bug-automake <at> gnu.org" <bug-automake <at> gnu.org>
Subject: Feature Request: Automake script based tests to print the test name
 before running it
Date: Thu, 1 Jul 2021 03:01:30 +0000

Hello automake devs,

In script based testsuites (https://www.gnu.org/software/automake/manual/html_node/Scripts_002dbased-Testsuites.html#Scripts_002dbased-Testsuites), when we run `make check` it prints one of the following string for each test: PASS <testname>, FAIL <testname>, XFAIL <testname> or SKIP <testname>.

However, in some cases (long running test, flaky test, other inconclusive ones for more involved reasons), it is essential to know which test is currently in flight. Especially in CI systems, where flakiness every now and then, due to external factors, is almost unavoidable.

It would be very helpful if a new option AM_TESTS_NAME=1 is provided, which would change the stdout output from:

    <blank stdout and wait for test execution to complete>
     PASS (or FAIL/XFAIL/SKIP) $name

to something like:

    RUNNING $name
    <blank stdout and wait for test execution to complete>
     PASS (or FAIL/XFAIL/SKIP) $name

this way we can easily find out the name of test (or multiple of them; in case of parallel execution) which is (are) currently running.

Thanks,
/K

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.