GNU bug report logs - #71422
no easy way to generate a test-suite.log without skipped tests

Previous Next

Full log

View this message in rfc822 format

From: help-debbugs <at> gnu.org (GNU bug Tracking System)
To: Karl Berry <karl <at> freefriends.org>
Cc: tracker <at> debbugs.gnu.org
Subject: bug#71422: closed (no easy way to generate a test-suite.log
 without skipped tests)
Date: Mon, 17 Jun 2024 17:08:02 +0000

[Message part 1 (text/plain, inline)]

Your message dated Mon, 17 Jun 2024 11:07:08 -0600
with message-id <202406171707.45HH78s7750865 <at> freefriends.org>
and subject line Re: bug#71422: no easy way to generate a test-suite.log without skipped tests
has caused the debbugs.gnu.org bug report #71422,
regarding no easy way to generate a test-suite.log without skipped tests
to be marked as done.

(If you believe you have received this mail in error, please contact
help-debbugs <at> gnu.org.)


-- 
71422: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=71422
GNU Bug Tracking System
Contact help-debbugs <at> gnu.org with problems

[Message part 2 (message/rfc822, inline)]

From: Bruno Haible <bruno <at> clisp.org>
To: bug-automake <at> gnu.org
Subject: no easy way to generate a test-suite.log without skipped tests
Date: Fri, 07 Jun 2024 18:26:15 +0200

[Message part 3 (text/plain, inline)]

Hi,

In my projects that use Automake and the "parallel" test driver, often
I have 1000 unit tests, of which 100-150 are skipped and 1-5 fail.
When analyzing the "make check" results, the generated test-suite.log
is more handy to use than the 1000 different <test>.log files. However,
before I get an overview of the results, I have to eliminate the logs
of the SKIPped tests (because the 1-5 failures are intermixed with
the 100-150 SKIPped test logs). This is a process that takes 1-2 minutes
each time.

I could write a script that post-processes the test-suite.log to eliminate
them. But it is better if the logs of the SKIPped tests wouldn't appear
in the file in the first place. The SKIPped tests are uninteresting
in my case.

Here is a patch that allows the package maintainer to eliminate the
SKIPped test logs, thus making test-suite.log more useful: either
by running
  make check IGNORE_SKIPPED_LOGS=1
or by defining in the Makefile (or Makefile.am):
  IGNORE_SKIPPED_LOGS = 1

It includes a unit test, documentation updates, and passes "make check".

[0001-automake-Allow-omitting-the-logs-of-skipped-tests-fr.patch (text/x-patch, attachment)]

[Message part 5 (message/rfc822, inline)]

From: Karl Berry <karl <at> freefriends.org>
To: bruno <at> clisp.org
Cc: 71422 <at> debbugs.gnu.org
Subject: Re: bug#71422: no easy way to generate a test-suite.log without
 skipped tests
Date: Mon, 17 Jun 2024 11:07:08 -0600

    Here is a patch that allows the package maintainer to eliminate the
    SKIPped test logs, thus making test-suite.log more useful: either
    by running
      make check IGNORE_SKIPPED_LOGS=1
    or by defining in the Makefile (or Makefile.am):
      IGNORE_SKIPPED_LOGS = 1

Thanks Bruno. I installed this (with minor wording tweaks). -k

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.