From unknown Mon Aug 18 00:05:47 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#14019 <14019@debbugs.gnu.org> To: bug#14019 <14019@debbugs.gnu.org> Subject: Status: conditional tests and parallel test harness Reply-To: bug#14019 <14019@debbugs.gnu.org> Date: Mon, 18 Aug 2025 07:05:47 +0000 retitle 14019 conditional tests and parallel test harness reassign 14019 automake submitter 14019 Sven Verdoolaege severity 14019 minor tag 14019 patch thanks From debbugs-submit-bounces@debbugs.gnu.org Thu Mar 21 20:36:36 2013 Received: (at submit) by debbugs.gnu.org; 22 Mar 2013 00:36:36 +0000 Received: from localhost ([127.0.0.1]:39567 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UIpyE-0003Pj-Mm for submit@debbugs.gnu.org; Thu, 21 Mar 2013 20:36:35 -0400 Received: from eggs.gnu.org ([208.118.235.92]:59776) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UILlh-0005cF-VH for submit@debbugs.gnu.org; Wed, 20 Mar 2013 12:21:39 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UILjt-0007Sn-W3 for submit@debbugs.gnu.org; Wed, 20 Mar 2013 12:19:52 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_LOW autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:35935) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UILjt-0007Sh-TD for submit@debbugs.gnu.org; Wed, 20 Mar 2013 12:19:45 -0400 Received: from eggs.gnu.org ([208.118.235.92]:42827) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UILjm-0002Ln-Ul for bug-automake@gnu.org; Wed, 20 Mar 2013 12:19:45 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UILjj-0007QQ-Ul for bug-automake@gnu.org; Wed, 20 Mar 2013 12:19:38 -0400 Received: from rhcavspool01.kulnet.kuleuven.be ([134.58.240.193]:38607 helo=cavspool01.kulnet.kuleuven.be) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UILjj-0007Pv-Mp for bug-automake@gnu.org; Wed, 20 Mar 2013 12:19:35 -0400 Received: from cavuit01.kulnet.kuleuven.be (rhcavuit01.kulnet.kuleuven.be [134.58.240.129]) by cavspool01.kulnet.kuleuven.be (Postfix) with ESMTP id F3E9F6696 for ; Wed, 20 Mar 2013 17:10:40 +0100 (CET) X-KULeuven-Envelope-From: skimo@kotnet.org X-KULeuven-Scanned: Found to be clean X-KULeuven-ID: 6307F1380DB.A5559 X-KULeuven-Information: Katholieke Universiteit Leuven Received: from icts-p-smtps-1.cc.kuleuven.be (icts-p-smtps-1e.kulnet.kuleuven.be [134.58.240.33]) by cavuit01.kulnet.kuleuven.be (Postfix) with ESMTP id 6307F1380DB for ; Wed, 20 Mar 2013 17:10:16 +0100 (CET) Received: from purples.kotnet.org (unknown [10.92.82.72]) by icts-p-smtps-1.cc.kuleuven.be (Postfix) with ESMTP id 425CC4050 for ; Wed, 20 Mar 2013 17:10:14 +0100 (CET) Received: by purples.kotnet.org (Postfix, from userid 1000) id E0DEC34A3; Wed, 20 Mar 2013 17:10:13 +0100 (CET) Date: Wed, 20 Mar 2013 17:10:13 +0100 X-Kuleuven: This mail passed the K.U.Leuven mailcluster From: Sven Verdoolaege To: bug-automake@gnu.org Subject: conditional tests and parallel test harness Message-ID: <20130320161013.GI11610MdfPADPa@purples> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="qD3brAgIG4LbUq6d" Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-12-10) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 208.118.235.17 X-Spam-Score: -5.5 (-----) X-Debbugs-Envelope-To: submit X-Mailman-Approved-At: Thu, 21 Mar 2013 20:36:31 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.9 (------) --qD3brAgIG4LbUq6d Content-Type: text/plain; charset=us-ascii Content-Disposition: inline The parallel test harness doesn't seem to like conditional tests. I get the following output using the attached configure.ac and Makefile.am: $ ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking that generated files are newer than configure... done configure: creating ./config.status config.status: creating Makefile config.status: creating pet_test.sh $ make check make check-TESTS make[1]: Entering directory `/tmp/pet-0.03' make[2]: Entering directory `/tmp/pet-0.03' make[3]: Entering directory `/tmp/pet-0.03' make[3]: Nothing to be done for `pet_test.sh.log'. make[3]: Leaving directory `/tmp/pet-0.03' fatal: making test-suite.log: failed to create pet_test.sh.trs fatal: making test-suite.log: failed to create pet_test.sh.log make[2]: *** [test-suite.log] Error 1 make[2]: Leaving directory `/tmp/pet-0.03' make[1]: *** [check-TESTS] Error 2 make[1]: Leaving directory `/tmp/pet-0.03' make: *** [check-am] Error 2 This is with automake 1.13.1 and autoconf 2.68. The same input works fine with automake 1.11.3: $ ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes configure: creating ./config.status config.status: creating Makefile config.status: creating pet_test.sh $ make check make check-TESTS make[1]: Entering directory `/tmp/pet-0.03' PASS: pet_test.sh ============= 1 test passed ============= make[1]: Leaving directory `/tmp/pet-0.03' Is it no longer allowed to have conditional tests as in TESTS = @extra_tests@ EXTRA_TESTS = pet_test.sh or is anything missing from my input? Thanks in advance, skimo --qD3brAgIG4LbUq6d Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="configure.ac" AC_INIT([pet], [0.03], [isl-development@googlegroups.com]) AC_CONFIG_AUX_DIR([build-aux]) AM_INIT_AUTOMAKE([foreign]) AC_SUBST(extra_tests) extra_tests="pet_test.sh" AC_CONFIG_FILES(Makefile) AC_CONFIG_FILES([pet_test.sh], [chmod +x pet_test.sh]) AC_OUTPUT --qD3brAgIG4LbUq6d Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="Makefile.am" TESTS = @extra_tests@ EXTRA_TESTS = pet_test.sh EXTRA_DIST = pet_test.sh.in --qD3brAgIG4LbUq6d Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="pet_test.sh.in" #!/bin/sh EXEEXT=@EXEEXT@ srcdir=@srcdir@ --qD3brAgIG4LbUq6d-- From debbugs-submit-bounces@debbugs.gnu.org Sat Apr 20 15:22:13 2013 Received: (at 14019) by debbugs.gnu.org; 20 Apr 2013 19:22:13 +0000 Received: from localhost ([127.0.0.1]:33909 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UTdMS-00048j-LY for submit@debbugs.gnu.org; Sat, 20 Apr 2013 15:22:13 -0400 Received: from mail-wi0-f170.google.com ([209.85.212.170]:36944) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UTdMQ-00048T-0b; Sat, 20 Apr 2013 15:22:11 -0400 Received: by mail-wi0-f170.google.com with SMTP id l13so2643775wie.3 for ; Sat, 20 Apr 2013 12:17:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=sGdmNeU3tCYCP52FubbfSWUwjY8/4Zg5IlrltrB+IaE=; b=MiSu1IvbA2kj0/8533qE0ZWDGa49EmhccLoPB+GRrslVG8fjh0PQcKiZvUTJrWfJd7 NHZzf0hDVDXwyxZPtqBBxPGXPLf9mse2i6ytj/wBDgud2zA52qcIaMAJpFqytHcN+LSt Wnq7u4juiravUVPbc+OzAFx5OOVnmJPZhv6wcwYVSHDA2fSv0qg4gnFeUL4INw84Llze r3L0Wpg+olsBSY4P99t0yabYCZZV/PQdHvTwXVvXeN5zs2vRT2dr8nCI+nOIb1UwrgfN HLRxYixIeJv5JRWMkx6f8Xsj1gV2ebG9uhUfVbGpK32fdYQTJO1Zme/CoUeOeKQ3AiBw VE5w== X-Received: by 10.194.89.169 with SMTP id bp9mr37147678wjb.57.1366485447505; Sat, 20 Apr 2013 12:17:27 -0700 (PDT) Received: from [192.168.178.20] (host93-95-dynamic.6-79-r.retail.telecomitalia.it. [79.6.95.93]) by mx.google.com with ESMTPS id ed6sm11496483wib.9.2013.04.20.12.17.25 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 20 Apr 2013 12:17:26 -0700 (PDT) Message-ID: <5172E9C4.4020200@gmail.com> Date: Sat, 20 Apr 2013 21:17:24 +0200 From: Stefano Lattarini MIME-Version: 1.0 To: Sven Verdoolaege Subject: Re: bug#14019: conditional tests and parallel test harness References: <20130320161013.GI11610MdfPADPa@purples> In-Reply-To: <20130320161013.GI11610MdfPADPa@purples> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Spam-Score: 0.1 (/) X-Debbugs-Envelope-To: 14019 Cc: 14019@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) severity 14019 minor thanks Hi Sven, sorry for the shameful delay. On 03/20/2013 05:10 PM, Sven Verdoolaege wrote: > The parallel test harness doesn't seem to like conditional tests. > Not if they don't have extensions declared with TEST_EXTENSIONS. This is just a limitation you'll have to live with, sorry (it's not a burdensome one IMHO). OTOH, I don't see this limitation documented anywhere in the manual, which is not very user-friendly, and certainly explains your confusion. I'm thus not closing this report, since I plan to address this shortcoming sooner or later. In the meantime, suggestions about where to place such advice and how to formulate it would be very welcome. > > [SNIP] > > Is it no longer allowed to have conditional tests as in > > TESTS = @extra_tests@ > EXTRA_TESTS = pet_test.sh > > or is anything missing from my input? > If you add "TEST_EXTENSIONS = .sh", everything should work again. Can you confirm this is the case? > Thanks in advance, > > skimo Best regards, and HTH (albeit belatedly), Stefano From debbugs-submit-bounces@debbugs.gnu.org Sun Apr 21 07:13:34 2013 Received: (at 14019) by debbugs.gnu.org; 21 Apr 2013 11:13:34 +0000 Received: from localhost ([127.0.0.1]:34790 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UTsD8-0005bz-GP for submit@debbugs.gnu.org; Sun, 21 Apr 2013 07:13:34 -0400 Received: from rhcavuit02.kulnet.kuleuven.be ([134.58.240.130]:60348 helo=cavuit02.kulnet.kuleuven.be) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UTsD5-0005bl-QC for 14019@debbugs.gnu.org; Sun, 21 Apr 2013 07:13:33 -0400 X-KULeuven-Envelope-From: skimo@kotnet.org X-Spam-Status: not spam, SpamAssassin (not cached, score=-48.725, required 5, autolearn=disabled, LOCAL_SMTPS -50.00, RDNS_NONE 1.27, URIBL_BLOCKED 0.00) X-KULeuven-Scanned: Found to be clean X-KULeuven-ID: 136FB128036.A60CD X-KULeuven-Information: Katholieke Universiteit Leuven Received: from icts-p-smtps-2.cc.kuleuven.be (icts-p-smtps-2e.kulnet.kuleuven.be [134.58.240.34]) by cavuit02.kulnet.kuleuven.be (Postfix) with ESMTP id 136FB128036; Sun, 21 Apr 2013 13:08:45 +0200 (CEST) Received: from purples.kotnet.org (unknown [10.92.82.72]) by icts-p-smtps-2.cc.kuleuven.be (Postfix) with ESMTP id 0CBAA2004C; Sun, 21 Apr 2013 13:08:42 +0200 (CEST) Received: by purples.kotnet.org (Postfix, from userid 1000) id 3E0971A1D; Sun, 21 Apr 2013 13:08:41 +0200 (CEST) Date: Sun, 21 Apr 2013 13:08:40 +0200 X-Kuleuven: This mail passed the K.U.Leuven mailcluster From: Sven Verdoolaege To: Stefano Lattarini Subject: Re: bug#14019: conditional tests and parallel test harness Message-ID: <20130421110840.GM21712MdfPADPa@purples> References: <20130320161013.GI11610MdfPADPa@purples> <5172E9C4.4020200@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5172E9C4.4020200@gmail.com> User-Agent: Mutt/1.5.21 (2012-12-30) X-Spam-Score: 0.1 (/) X-Debbugs-Envelope-To: 14019 Cc: 14019@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) On Sat, Apr 20, 2013 at 09:17:24PM +0200, Stefano Lattarini wrote: > On 03/20/2013 05:10 PM, Sven Verdoolaege wrote: > > Is it no longer allowed to have conditional tests as in > > > > TESTS = @extra_tests@ > > EXTRA_TESTS = pet_test.sh > > > > or is anything missing from my input? > > > If you add "TEST_EXTENSIONS = .sh", everything should work again. > Can you confirm this is the case? Thanks. That fixes the problem. skimo From debbugs-submit-bounces@debbugs.gnu.org Thu Apr 25 15:14:43 2013 Received: (at 14019) by debbugs.gnu.org; 25 Apr 2013 19:14:43 +0000 Received: from localhost ([127.0.0.1]:43477 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UVRcw-0001n4-Tp for submit@debbugs.gnu.org; Thu, 25 Apr 2013 15:14:43 -0400 Received: from mail-bk0-f44.google.com ([209.85.214.44]:49666) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UVRcu-0001mu-NA; Thu, 25 Apr 2013 15:14:41 -0400 Received: by mail-bk0-f44.google.com with SMTP id jk14so1303901bkc.3 for ; Thu, 25 Apr 2013 12:09:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=JAsRslQFpA3OpL8Zmt2QYH6RIT89JTGSOyqTON/7IVQ=; b=AO0W9+8aQM/eeR6+QrZGoK8PKJziXzu8pOtwynR3UHhAOtMPyhIzswsgWz0XyPXN7y 5gRg4Vg8jaGEypJ1JJpnG5g2OHthfCg/1qHqLDoj8Ab4GJCN+7sJKbCnbq2GAphpefd7 t/4Dw+FRDYAm1JfrQ1CKxMXfscnbb2vPqujXoai9yexSY7W3ufefEA9lwrFZEQsovzGs sxRpjPSTvytUi+zwcyF69tL/r5ROOfszT9p457FB4/TYQ/o/W1gSDu7vyIj8uHwHH6Kf Jc7KBvlXXNH2cv3f6P/8j3vkA/ePSPh3x076zz+8lWqk5JVEKtql1WrgLNXpuAF6SRbk w/ow== X-Received: by 10.204.167.144 with SMTP id q16mr16939797bky.25.1366916970654; Thu, 25 Apr 2013 12:09:30 -0700 (PDT) Received: from [192.168.178.20] (host93-95-dynamic.6-79-r.retail.telecomitalia.it. [79.6.95.93]) by mx.google.com with ESMTPSA id m11sm2156883bkz.0.2013.04.25.12.09.28 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 25 Apr 2013 12:09:29 -0700 (PDT) Message-ID: <51797F67.2050706@gmail.com> Date: Thu, 25 Apr 2013 21:09:27 +0200 From: Stefano Lattarini MIME-Version: 1.0 To: Sven Verdoolaege Subject: Re: bug#14019: conditional tests and parallel test harness References: <20130320161013.GI11610MdfPADPa@purples> <5172E9C4.4020200@gmail.com> <20130421110840.GM21712MdfPADPa@purples> In-Reply-To: <20130421110840.GM21712MdfPADPa@purples> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Spam-Score: -1.2 (-) X-Debbugs-Envelope-To: 14019 Cc: 14019@debbugs.gnu.org, "automake-patches@gnu.org" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) tags 14019 + patch close 14019 stop On 04/21/2013 01:08 PM, Sven Verdoolaege wrote: > On Sat, Apr 20, 2013 at 09:17:24PM +0200, Stefano Lattarini wrote: >> On 03/20/2013 05:10 PM, Sven Verdoolaege wrote: >>> Is it no longer allowed to have conditional tests as in >>> >>> TESTS = @extra_tests@ >>> EXTRA_TESTS = pet_test.sh >>> >>> or is anything missing from my input? >>> >> If you add "TEST_EXTENSIONS = .sh", everything should work again. >> Can you confirm this is the case? > > Thanks. That fixes the problem. > Thanks for confirming. And the patch below fixes the documentation issue. I'm thus closing this report. Regards, Stefano ---- 8< ---- 8<---- 8<---- 8<---- 8<---- 8<---- 8<---- 8<---- 8<---- 8< ---- >From 915bf025b0fcc35e19648126da66f12d68cf2633 Mon Sep 17 00:00:00 2001 Message-Id: <915bf025b0fcc35e19648126da66f12d68cf2633.1366916929.git.stefano.lattarini@gmail.com> From: Stefano Lattarini Date: Thu, 25 Apr 2013 21:03:40 +0200 Subject: [PATCH] docs: issues with configure substitutions in TESTS Motivated by automake bug#14019. * doc/automake.texi: Currently, when the parallel test harness is in use, configure substitutions in TESTS definitions can only work if they expand to tests that ends with a suffix listed in TEST_EXTENSIONS. Document this limitation. Signed-off-by: Stefano Lattarini --- doc/automake.texi | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/doc/automake.texi b/doc/automake.texi index d420d28..f7a0a28 100644 --- a/doc/automake.texi +++ b/doc/automake.texi @@ -9099,6 +9099,12 @@ followed by any number of alphabetic characters. For example, @samp{.sh}, @samp{.T} and @samp{.t1} are valid extensions, while @samp{.x-y}, @samp{.6c} and @samp{.t.1} are not. +@cindex Configure substitutions in @code{TESTS} +It is important to note that, due to current limitations (unlikely to be +lifted), configure substitutions in the definition of @code{TESTS} can +only work if they will expand to a list of tests that have a suffix listed +in @code{TEST_EXTENSIONS}. + @vindex _LOG_COMPILE @vindex _LOG_COMPILER @vindex _LOG_FLAGS -- 1.8.2.1.610.g562af5b From unknown Mon Aug 18 00:05:47 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 24 May 2013 11:24:03 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator