From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 07 18:48:04 2024 Received: (at submit) by debbugs.gnu.org; 7 Jun 2024 22:48:04 +0000 Received: from localhost ([127.0.0.1]:41602 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sFiNO-00023Z-S9 for submit@debbugs.gnu.org; Fri, 07 Jun 2024 18:48:03 -0400 Received: from lists.gnu.org ([209.51.188.17]:56060) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sFiNK-00022o-R9 for submit@debbugs.gnu.org; Fri, 07 Jun 2024 18:48:00 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sFiN4-0004hM-Sy for bug-automake@gnu.org; Fri, 07 Jun 2024 18:47:43 -0400 Received: from mo4-p00-ob.smtp.rzone.de ([81.169.146.160]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sFcPy-00065D-Mc for bug-automake@gnu.org; Fri, 07 Jun 2024 12:26:21 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1717777575; cv=none; d=strato.com; s=strato-dkim-0002; b=XkFScQ+j76Jk6kOwrUBvKsdL+ttUzDH+Fsgc8lzk8dpyVE2/c4uHk8NuvST89Flz77 3rpXAIfqwPYoM1ug+zjSCEMbq9JNv6AHqu4e6VqezXirzaeRZD8skQj+Wc1xVD9HgEqU Z/jZ4tXs8CS6cLCS+9QWh1Y0Gx5Z/mCEGuT/LM/pimrW+ojQmqIDVg0Tgu70lymRcCJ1 Ev9lqyVJ8p2WTLENNDs5SO74sI4w1Z51BM4HSfkJ4wqyKDQXV3lbk29rBCyZTnJMFCuQ bwq8bVr2ADLLT/iL/fgjXPk6Ng7/+t8pnhdyO+4vD/bQ+WDNehOARCDnokdJuPvl599Y ngQA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1717777575; s=strato-dkim-0002; d=strato.com; h=Message-ID:Date:Subject:To:From:Cc:Date:From:Subject:Sender; bh=2GQvQ6vfC420xtenVgcQq6KZkMqkQBT+UreJeog/R/0=; b=FLtW2UGqwmQH9FrBV8uboElSpLJXaNx5b5wtz+Xsg+usu3fN3W7IBDqDnsO7nGwjtn 7UzVDJCHhZUPeBdVtvhyyYm+FerfUSKuX3yIatdt4j/61TDPOtN+D0viMV6EImudvSzF GXn9dMrvVIT9AA2phdKV1s8IzLefyJvPwkObJq1YST1QBeXQaW6uLI89pFmrkP6aaRvX TDFFC8m1kxBGtL3yR/VvuEGPdrRUPo6rtlib+JG15YA7iY3UPR7KVvjjJLUfLuBb8dKR vLDd/QO2sr5Z6hmbqm+IbVjaCYQl0O+CO28xsxlzMEQzdNX8kDRdc8WICnk/l0bjGAM7 +SVw== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=none X-RZG-CLASS-ID: mo00 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1717777575; s=strato-dkim-0002; d=clisp.org; h=Message-ID:Date:Subject:To:From:Cc:Date:From:Subject:Sender; bh=2GQvQ6vfC420xtenVgcQq6KZkMqkQBT+UreJeog/R/0=; b=VRZ6XTIHZuULVnWD3xazPAq0QqL3wRD3wQwT7Fh8eYsFQuBMH449hQRpmm0FvIcVfP P6oaRl6t/GL+eYvTPfUdeELuk7VQFvdBGpXt2UKxDFTK+zdyvMy3Ru/JhyyqzFVvoUhG Fq9dNp3SA4NoaAliyIsGMGiGurQ3PtLYkwZCbaOz/wlpx0tGpQfYb/PF8y68Lh86VfJD xTKF4RNU1jMGiQJADX2f6tBOPT0pqeJqq+NuGzWnqeZTEtu7e+gvT5dcOuvnD4XCRpQI Pw+enpRvqzS3dX2CbizbP/cyB6EIGqttVDheIZLuYHGBPTcguhFqHs9WFhTFbfV8wAdf 216Q== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; t=1717777575; s=strato-dkim-0003; d=clisp.org; h=Message-ID:Date:Subject:To:From:Cc:Date:From:Subject:Sender; bh=2GQvQ6vfC420xtenVgcQq6KZkMqkQBT+UreJeog/R/0=; b=VDP9QrJe6pGmYH/PHTtZXgDFrgbxBQeov0UtULDcbJ1uMveZHM4deE5yxGR5qmbJX6 RDxMDUBvDa7DP3Q+kSCg== X-RZG-AUTH: ":Ln4Re0+Ic/6oZXR1YgKryK8brlshOcZlIWs+iCP5vnk6shH0WWb0LN8XZoH94zq68+3cfpPF2vLq62YMtAvpDl1tKFoizRw+OQ==" Received: from nimes.localnet by smtp.strato.de (RZmta 50.5.0 AUTH) with ESMTPSA id N0957e057GQF116 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate); Fri, 7 Jun 2024 18:26:15 +0200 (CEST) From: Bruno Haible To: bug-automake@gnu.org Subject: no easy way to generate a test-suite.log without skipped tests Date: Fri, 07 Jun 2024 18:26:15 +0200 Message-ID: <2131754.VsPgYW4pTa@nimes> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="nextPart10477411.qUNvkh4Gvn" Content-Transfer-Encoding: 7Bit Received-SPF: none client-ip=81.169.146.160; envelope-from=bruno@clisp.org; helo=mo4-p00-ob.smtp.rzone.de X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) This is a multi-part message in MIME format. --nextPart10477411.qUNvkh4Gvn Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" Hi, In my projects that use Automake and the "parallel" test driver, often I have 1000 unit tests, of which 100-150 are skipped and 1-5 fail. When analyzing the "make check" results, the generated test-suite.log is more handy to use than the 1000 different .log files. However, before I get an overview of the results, I have to eliminate the logs of the SKIPped tests (because the 1-5 failures are intermixed with the 100-150 SKIPped test logs). This is a process that takes 1-2 minutes each time. I could write a script that post-processes the test-suite.log to eliminate them. But it is better if the logs of the SKIPped tests wouldn't appear in the file in the first place. The SKIPped tests are uninteresting in my case. Here is a patch that allows the package maintainer to eliminate the SKIPped test logs, thus making test-suite.log more useful: either by running make check IGNORE_SKIPPED_LOGS=1 or by defining in the Makefile (or Makefile.am): IGNORE_SKIPPED_LOGS = 1 It includes a unit test, documentation updates, and passes "make check". --nextPart10477411.qUNvkh4Gvn Content-Disposition: attachment; filename="0001-automake-Allow-omitting-the-logs-of-skipped-tests-fr.patch" Content-Transfer-Encoding: 7Bit Content-Type: text/x-patch; charset="UTF-8"; name="0001-automake-Allow-omitting-the-logs-of-skipped-tests-fr.patch" >From e5ed5248fe4fa5fed521e16929694c9d169540b2 Mon Sep 17 00:00:00 2001 From: Bruno Haible Date: Fri, 7 Jun 2024 15:31:26 +0200 Subject: [PATCH] automake: Allow omitting the logs of skipped tests from test-suite.log. * doc/automake.texi (Parallel Test Harness): Describe the contents of test-suite.log. Mention IGNORE_SKIPPED_LOGS. (Command-line arguments for test drivers): Document the --collect-skipped-logs option. * lib/test-driver (print_usage): Document --collect-skipped-logs. (collect_skipped_logs): New variable. (gcopy): Use collect_skipped_logs. * lib/am/check.am (am__common_driver_flags): Add the contents of am__collect_skipped_logs. (am__check_pre): Set am__collect_skipped_logs. * t/parallel-tests-without-skipped-logs.sh: New file, based on t/parallel-tests-no-color-in-log.sh. * t/list-of-tests.mk (handwritten_TESTS): Add it. * NEWS: Mention the change. --- NEWS | 4 ++ doc/automake.texi | 14 ++++-- lib/am/check.am | 6 +++ lib/test-driver | 7 ++- t/list-of-tests.mk | 1 + t/parallel-tests-without-skipped-logs.sh | 63 ++++++++++++++++++++++++ 6 files changed, 90 insertions(+), 5 deletions(-) create mode 100644 t/parallel-tests-without-skipped-logs.sh diff --git a/NEWS b/NEWS index 2da4cc769..55f692695 100644 --- a/NEWS +++ b/NEWS @@ -48,6 +48,10 @@ New in 1.17: console message about bug reporting on failure has a bit more detail. (bug#68746) + - When using the (default) "parallel" test driver, you can now choose to + omit the output of skipped tests from test-suite.log, by defining the + variable IGNORE_SKIPPED_LOGS to a non-empty value. + * Bugs fixed - Generated file timestamp checks handle filesystems with sub-second diff --git a/doc/automake.texi b/doc/automake.texi index 4f7029fff..fc009ae4d 100644 --- a/doc/automake.texi +++ b/doc/automake.texi @@ -9742,14 +9742,13 @@ versions. @node Parallel Test Harness @subsection Parallel Test Harness -By default, Automake generated a parallel (concurrent) test harness. It +By default, Automake generates a parallel (concurrent) test harness. It features automatic collection of the test scripts output in @file{.log} files, concurrent execution of tests with @code{make -j}, specification of inter-test dependencies, lazy reruns of tests that have not completed in a prior run, and hard errors for exceptional failures. @anchor{Basics of test metadata} -@vindex TEST_SUITE_LOG @vindex TESTS @cindex @file{.log} files @cindex @file{.trs} files @@ -9768,10 +9767,15 @@ its standard output and its standard error. The @file{.trs} file will contain, among the other things, the results of the test cases run by the script. +@vindex TEST_SUITE_LOG +@vindex IGNORE_SKIPPED_LOGS The parallel test harness will also create a summary log file, @code{TEST_SUITE_LOG}, which defaults to @file{test-suite.log} and requires a @file{.log} suffix. This file depends upon all the @file{.log} and @file{.trs} files created for the test scripts listed in @code{TESTS}. +It contains the output of all tests that failed, encountered a hard error, +succeeded unexpectedly, or -- unless the variable @code{IGNORE_SKIPPED_LOGS} +is set to a non-empty value -- were skipped. @vindex VERBOSE As with the serial harness above, by default one status line is printed @@ -10162,6 +10166,9 @@ exists @emph{before} the test driver is called. Whether the console output should be colorized or not (@pxref{Simple tests and color-tests}, to learn when this option gets activated and when it doesn't). +@item --collect-skipped-logs @{yes|no@} +Whether to include the logs of skipped tests in the global +@file{test-suite.log} file. @item --expect-failure @{yes|no@} Whether the tested program is expected to fail. @item --enable-hard-errors @{yes|no@} @@ -10179,7 +10186,8 @@ be run, and all the following ones are command-line options and arguments for this program. Note that the exact semantics attached to the @option{--color-tests}, -@option{--expect-failure} and @option{--enable-hard-errors} options are +@option{--collect-skipped-logs}, @option{--expect-failure}, and +@option{--enable-hard-errors} options are left up to the individual test drivers. Still, having a behaviour compatible or at least similar to that provided by the default driver is advised, as that would offer a better consistency and a more pleasant diff --git a/lib/am/check.am b/lib/am/check.am index b6fa3aaad..e35ff1e8b 100644 --- a/lib/am/check.am +++ b/lib/am/check.am @@ -172,6 +172,7 @@ am__sh_e_setup = case $$- in *e*) set +e;; esac # Default flags passed to test drivers. am__common_driver_flags = \ --color-tests "$$am__color_tests" \ + $$am__collect_skipped_logs \ --enable-hard-errors "$$am__enable_hard_errors" \ --expect-failure "$$am__expect_failure" @@ -197,6 +198,11 @@ if test -f "./$$f"; then dir=./; \ elif test -f "$$f"; then dir=; \ else dir="$(srcdir)/"; fi; \ tst=$$dir$$f; log='$@'; \ +if test -n '$(IGNORE_SKIPPED_LOGS)'; then \ + am__collect_skipped_logs='--collect-skipped-logs no'; \ +else \ + am__collect_skipped_logs=''; \ +fi; \ if test -n '$(DISABLE_HARD_ERRORS)'; then \ am__enable_hard_errors=no; \ else \ diff --git a/lib/test-driver b/lib/test-driver index 2d45c984a..e04b5a210 100755 --- a/lib/test-driver +++ b/lib/test-driver @@ -1,7 +1,7 @@ #! /bin/sh # test-driver - basic testsuite driver script. -scriptversion=2018-03-07.03; # UTC +scriptversion=2024-06-07.11; # UTC # Copyright (C) 2011-2024 Free Software Foundation, Inc. # @@ -44,6 +44,7 @@ print_usage () Usage: test-driver --test-name NAME --log-file PATH --trs-file PATH [--expect-failure {yes|no}] [--color-tests {yes|no}] + [--collect-skipped-logs {yes|no}] [--enable-hard-errors {yes|no}] [--] TEST-SCRIPT [TEST-SCRIPT-ARGUMENTS] @@ -57,6 +58,7 @@ log_file= # Where to save the output of the test script. trs_file= # Where to save the metadata of the test run. expect_failure=no color_tests=no +collect_skipped_logs=yes enable_hard_errors=yes while test $# -gt 0; do case $1 in @@ -66,6 +68,7 @@ while test $# -gt 0; do --log-file) log_file=$2; shift;; --trs-file) trs_file=$2; shift;; --color-tests) color_tests=$2; shift;; + --collect-skipped-logs) collect_skipped_logs=$2; shift;; --expect-failure) expect_failure=$2; shift;; --enable-hard-errors) enable_hard_errors=$2; shift;; --) shift; break;; @@ -121,7 +124,7 @@ fi case $tweaked_estatus:$expect_failure in 0:yes) col=$red res=XPASS recheck=yes gcopy=yes;; 0:*) col=$grn res=PASS recheck=no gcopy=no;; - 77:*) col=$blu res=SKIP recheck=no gcopy=yes;; + 77:*) col=$blu res=SKIP recheck=no gcopy=$collect_skipped_logs;; 99:*) col=$mgn res=ERROR recheck=yes gcopy=yes;; *:yes) col=$lgn res=XFAIL recheck=no gcopy=yes;; *:*) col=$red res=FAIL recheck=yes gcopy=yes;; diff --git a/t/list-of-tests.mk b/t/list-of-tests.mk index 9f6a08685..bfca492f9 100644 --- a/t/list-of-tests.mk +++ b/t/list-of-tests.mk @@ -815,6 +815,7 @@ t/parallel-tests-fork-bomb.sh \ t/parallel-tests-empty-testlogs.sh \ t/parallel-tests-driver-install.sh \ t/parallel-tests-no-color-in-log.sh \ +t/parallel-tests-without-skipped-logs.sh \ t/parallel-tests-no-spurious-summary.sh \ t/parallel-tests-exit-statuses.sh \ t/parallel-tests-console-output.sh \ diff --git a/t/parallel-tests-without-skipped-logs.sh b/t/parallel-tests-without-skipped-logs.sh new file mode 100644 index 000000000..86c7d9c53 --- /dev/null +++ b/t/parallel-tests-without-skipped-logs.sh @@ -0,0 +1,63 @@ +#! /bin/sh +# Copyright (C) 2011-2024 Free Software Foundation, Inc. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2, or (at your option) +# any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see . + +# Colorized output from the testsuite report shouldn't end up in log files. + +. test-init.sh + +cat >>configure.ac <Makefile.am <<'END' +LOG_COMPILER = $(SHELL) +AUTOMAKE_OPTIONS = color-tests +TESTS = pass fail saltata xpass xfail error +XFAIL_TESTS = xpass xfail +END + +echo 'exit 0' > pass +echo 'exit 0' > xpass +echo 'exit 1' > fail +echo 'exit 1' > xfail +echo 'exit 77' > saltata +echo 'exit 99' > error + +$ACLOCAL +$AUTOCONF +$AUTOMAKE --add-missing + +# Check that IGNORE_SKIPPED_LOGS works when given on the command line. + +./configure +run_make -e FAIL check IGNORE_SKIPPED_LOGS=true +grep saltata test-suite.log && exit 1 + +rm -f test-suite.log + +# Check that IGNORE_SKIPPED_LOGS works when given in the Makefile. + +cat >>Makefile.am <<'END' +IGNORE_SKIPPED_LOGS = true +END + +$AUTOMAKE --add-missing + +./configure +run_make -e FAIL check +grep saltata test-suite.log && exit 1 + +: -- 2.34.1 --nextPart10477411.qUNvkh4Gvn-- From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 08 04:17:06 2024 Received: (at submit) by debbugs.gnu.org; 8 Jun 2024 08:17:06 +0000 Received: from localhost ([127.0.0.1]:56485 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sFrG6-00052B-8f for submit@debbugs.gnu.org; Sat, 08 Jun 2024 04:17:06 -0400 Received: from lists.gnu.org ([209.51.188.17]:47508) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sFrG4-000521-0N for submit@debbugs.gnu.org; Sat, 08 Jun 2024 04:17:05 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sFrFn-00064r-HD for bug-automake@gnu.org; Sat, 08 Jun 2024 04:16:47 -0400 Received: from woodpecker.gentoo.org ([140.211.166.183] helo=smtp.gentoo.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_CHACHA20_POLY1305:256) (Exim 4.90_1) (envelope-from ) id 1sFrFl-0005iA-6Y for bug-automake@gnu.org; Sat, 08 Jun 2024 04:16:46 -0400 From: Sam James To: Bruno Haible Subject: Re: no easy way to generate a test-suite.log without skipped tests In-Reply-To: <2131754.VsPgYW4pTa@nimes> (Bruno Haible's message of "Fri, 07 Jun 2024 18:26:15 +0200") Organization: Gentoo References: <2131754.VsPgYW4pTa@nimes> Date: Sat, 08 Jun 2024 09:16:27 +0100 Message-ID: <874ja3n92c.fsf@gentoo.org> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=140.211.166.183; envelope-from=sam@gentoo.org; helo=smtp.gentoo.org X-Spam_score_int: -41 X-Spam_score: -4.2 X-Spam_bar: ---- X-Spam_report: (-4.2 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.7 (-) X-Debbugs-Envelope-To: submit Cc: bug-automake@gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.7 (--) --=-=-= Content-Type: text/plain Bruno Haible writes: > Hi, > > In my projects that use Automake and the "parallel" test driver, often > I have 1000 unit tests, of which 100-150 are skipped and 1-5 fail. > When analyzing the "make check" results, the generated test-suite.log > is more handy to use than the 1000 different .log files. However, > before I get an overview of the results, I have to eliminate the logs > of the SKIPped tests (because the 1-5 failures are intermixed with > the 100-150 SKIPped test logs). This is a process that takes 1-2 minutes > each time. Thanks for proposing this. I'd find this useful too. > > I could write a script that post-processes the test-suite.log to eliminate > them. But it is better if the logs of the SKIPped tests wouldn't appear > in the file in the first place. The SKIPped tests are uninteresting > in my case. > > Here is a patch that allows the package maintainer to eliminate the > SKIPped test logs, thus making test-suite.log more useful: either > by running > make check IGNORE_SKIPPED_LOGS=1 > or by defining in the Makefile (or Makefile.am): > IGNORE_SKIPPED_LOGS = 1 > > It includes a unit test, documentation updates, and passes "make check". > > [2. text/x-patch; 0001-automake-Allow-omitting-the-logs-of-skipped-tests-fr.patch]... --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iOUEARYKAI0WIQQlpruI3Zt2TGtVQcJzhAn1IN+RkAUCZmQTXF8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0MjVB NkJCODhERDlCNzY0QzZCNTU0MUMyNzM4NDA5RjUyMERGOTE5MA8cc2FtQGdlbnRv by5vcmcACgkQc4QJ9SDfkZDEcQD+OFtKB/9JqXQ79qaPJfl2K9kqt3On2A17ySG6 S+U7zIUA/Ry7QZchwNzm3tl3ge22ou+Dni59YwmV5IoFssZI8gYC =c2EC -----END PGP SIGNATURE----- --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Mon Jun 17 13:07:21 2024 Received: (at 71422) by debbugs.gnu.org; 17 Jun 2024 17:07:21 +0000 Received: from localhost ([127.0.0.1]:35281 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sJFpB-0006BE-4W for submit@debbugs.gnu.org; Mon, 17 Jun 2024 13:07:21 -0400 Received: from frenzy.freefriends.org ([198.99.81.75]:39198 helo=freefriends.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sJFp8-0006B0-KR; Mon, 17 Jun 2024 13:07:19 -0400 X-Envelope-From: karl@freefriends.org Received: from freefriends.org (localhost [127.0.0.1]) by freefriends.org (8.16.1/8.16.1) with ESMTPS id 45HH788t750866 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Mon, 17 Jun 2024 11:07:08 -0600 Received: (from apache@localhost) by freefriends.org (8.16.1/8.14.7/Submit) id 45HH78s7750865; Mon, 17 Jun 2024 11:07:08 -0600 Date: Mon, 17 Jun 2024 11:07:08 -0600 Message-Id: <202406171707.45HH78s7750865@freefriends.org> From: Karl Berry To: bruno@clisp.org Subject: Re: bug#71422: no easy way to generate a test-suite.log without skipped tests In-Reply-To: <2131754.VsPgYW4pTa@nimes> X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 71422 Cc: 71422@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Here is a patch that allows the package maintainer to eliminate the SKIPped test logs, thus making test-suite.log more useful: either by running make check IGNORE_SKIPPED_LOGS=1 or by defining in the Makefile (or Makefile.am): IGNORE_SKIPPED_LOGS = 1 Thanks Bruno. I installed this (with minor wording tweaks). -k From unknown Fri Sep 05 20:37:03 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Tue, 16 Jul 2024 11:24:12 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator