From unknown Sun Jun 22 11:40:47 2025 X-Loop: help-debbugs@gnu.org Subject: bug#13478: Don't deprecate or remove 'serial-tests' Resent-From: "Richard W.M. Jones" Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bug-automake@gnu.org Resent-Date: Thu, 17 Jan 2013 18:18:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 13478 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: 13478@debbugs.gnu.org X-Debbugs-Original-To: bug-automake@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.135844667930099 (code B ref -1); Thu, 17 Jan 2013 18:18:02 +0000 Received: (at submit) by debbugs.gnu.org; 17 Jan 2013 18:17:59 +0000 Received: from localhost ([127.0.0.1]:37270 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Tvu2F-0007pK-Pn for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:59 -0500 Received: from eggs.gnu.org ([208.118.235.92]:39312) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Tvu29-0007p7-Fr for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:54 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Tvu1N-0003nm-WC for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:06 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-106.9 required=5.0 tests=BAYES_00, RCVD_IN_DNSWL_HI, RP_MATCHES_RCVD, USER_IN_WHITELIST autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:35275) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Tvu1N-0003nZ-TV for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:01 -0500 Received: from eggs.gnu.org ([208.118.235.92]:50588) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Tvu1J-0006Ep-Fw for bug-automake@gnu.org; Thu, 17 Jan 2013 13:17:01 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Tvu1F-0003lE-4z for bug-automake@gnu.org; Thu, 17 Jan 2013 13:16:57 -0500 Received: from mx1.redhat.com ([209.132.183.28]:60746) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Tvu1E-0003kt-SL for bug-automake@gnu.org; Thu, 17 Jan 2013 13:16:53 -0500 Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id r0HIGqCw029731 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Thu, 17 Jan 2013 13:16:52 -0500 Received: from localhost (vpn1-5-145.ams2.redhat.com [10.36.5.145]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id r0HIGpk9007956 for ; Thu, 17 Jan 2013 13:16:51 -0500 Date: Thu, 17 Jan 2013 18:16:48 +0000 From: "Richard W.M. Jones" Message-ID: <20130117181648.GA7536@rhmail.home.annexia.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-12-10) X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 208.118.235.17 X-Spam-Score: -4.2 (----) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -5.5 (-----) For some reason this is marked as deprecated. This is bad: parallel tests are fine for tiny tests which use only a little bit of memory. However if your tests are very large and use a lot of RAM then running them in parallel can cause them to fail unnecessarily. The libguestfs test suite is exactly like this: parallel tests causes it to fail because you end up running multiple parallel VMs. Serial tests is the right way to go for us. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming blog: http://rwmj.wordpress.com Fedora now supports 80 OCaml packages (the OPEN alternative to F#) From unknown Sun Jun 22 11:40:47 2025 X-Loop: help-debbugs@gnu.org Subject: bug#13478: Don't deprecate or remove 'serial-tests' Resent-From: Stefano Lattarini Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bug-automake@gnu.org Resent-Date: Thu, 17 Jan 2013 18:28:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 13478 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: "Richard W.M. Jones" Cc: 13478@debbugs.gnu.org Received: via spool by 13478-submit@debbugs.gnu.org id=B13478.135844726331063 (code B ref 13478); Thu, 17 Jan 2013 18:28:01 +0000 Received: (at 13478) by debbugs.gnu.org; 17 Jan 2013 18:27:43 +0000 Received: from localhost ([127.0.0.1]:37280 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1TvuBi-00084x-51 for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:27:42 -0500 Received: from mail-bk0-f53.google.com ([209.85.214.53]:63693) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1TvuBb-00084h-9p for 13478@debbugs.gnu.org; Thu, 17 Jan 2013 13:27:40 -0500 Received: by mail-bk0-f53.google.com with SMTP id j5so1554604bkw.40 for <13478@debbugs.gnu.org>; Thu, 17 Jan 2013 10:26:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=Dm+nYKuKg/PsDvxqIzkkfkc1DvDfdPHAIV6zbF68T6M=; b=B6zac/4U330nkEYKHAFqzTRXn62htP/JTzqr1OFH+cF3dgfPccVLgRrxIFMYewOmQj lMahQfYFSkDVRc3Fm8z6XqnzuGRidFLUAdagDUkRqfGTC+yLvwURV/G7E9otHwU+PCd0 f0tyZy/T/e1tqAtc+iGA+IZ4jV6wIHnlCEDYfTGMeJCox7Tod3USXoxMnW1Usk/J+EjO yUKpGBRiN4UPgn/gMpY3S6t0/o9hdyCguWXRftkzEzx4JOOqnDpKnE+pLasd2Y3criSG EzeiMVfkM1yDjMtK+9Yn1Z5/7zgo4IHEgOjGzHIOk7MZdHF6exZOS7zdn1w4WuJ/Ldm6 RVMw== X-Received: by 10.204.147.79 with SMTP id k15mr1763279bkv.55.1358447211095; Thu, 17 Jan 2013 10:26:51 -0800 (PST) Received: from [192.168.178.20] (host137-94-dynamic.4-87-r.retail.telecomitalia.it. [87.4.94.137]) by mx.google.com with ESMTPS id l17sm2129876bkw.12.2013.01.17.10.26.49 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 17 Jan 2013 10:26:50 -0800 (PST) Message-ID: <50F84260.9090701@gmail.com> Date: Thu, 17 Jan 2013 19:26:40 +0100 From: Stefano Lattarini MIME-Version: 1.0 References: <20130117181648.GA7536@rhmail.home.annexia.org> In-Reply-To: <20130117181648.GA7536@rhmail.home.annexia.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Spam-Score: 0.1 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: 0.1 (/) On 01/17/2013 07:16 PM, Richard W.M. Jones wrote: > > For some reason this is marked as deprecated. > > This is bad: parallel tests are fine for tiny tests which use only a > little bit of memory. However if your tests are very large and use a > lot of RAM then running them in parallel can cause them to fail > unnecessarily. > > The libguestfs test suite is exactly like this: parallel tests causes > it to fail because you end up running multiple parallel VMs. Serial > tests is the right way to go for us. > This is a documentation problem, mostly (and my fault BTW, but let's move on). We should say that 'paralle-tests' is "encouraged", rather than saying that 'serial-tests' is "deprecated". In fact, there are no plan to ever remove it, or even give runtime warnings upon its usage. Patches to the manual would be most welcome. Best regards, Stefano From unknown Sun Jun 22 11:40:47 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.428 (Entity 5.428) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: "Richard W.M. Jones" Subject: bug#13478: closed ([PATCH] docs: serial-tests are not deprecated, just discouraged (was: Re: bug#13478: Don't deprecate or remove 'serial-tests')) Message-ID: References: <50F928D7.6070608@gmail.com> <20130117181648.GA7536@rhmail.home.annexia.org> X-Gnu-PR-Message: they-closed 13478 X-Gnu-PR-Package: automake Reply-To: 13478@debbugs.gnu.org Date: Fri, 18 Jan 2013 10:51:02 +0000 Content-Type: multipart/mixed; boundary="----------=_1358506262-24777-1" This is a multi-part message in MIME format... ------------=_1358506262-24777-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #13478: Don't deprecate or remove 'serial-tests' which was filed against the automake package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 13478@debbugs.gnu.org. --=20 13478: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D13478 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1358506262-24777-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 13478-done) by debbugs.gnu.org; 18 Jan 2013 10:50:59 +0000 Received: from localhost ([127.0.0.1]:38009 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Tw9XH-0006RQ-1u for submit@debbugs.gnu.org; Fri, 18 Jan 2013 05:50:59 -0500 Received: from mail-lb0-f177.google.com ([209.85.217.177]:62316) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Tw9XE-0006RI-JA for 13478-done@debbugs.gnu.org; Fri, 18 Jan 2013 05:50:58 -0500 Received: by mail-lb0-f177.google.com with SMTP id gm6so451083lbb.22 for <13478-done@debbugs.gnu.org>; Fri, 18 Jan 2013 02:50:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=fAaffEIhcfo5aO6hrrpZWR828FGnOwj3mRscnzDQOl4=; b=IHeJl8sP4a1FzeXYpF6GHFpdGo8v4Upg/bBTQZqrlmDT/xJ+7ROJcxgJM4gPxT5KDS Yz9cKi8wKoaw6rffgIWpzY2XWPeUTTm96ek99bX7kjkSvDfbZnbDcuHDTr125n0r59iT TpoTuT6aIoj4C5IRET6fb3aTDivWlHbDnrCCpqrnSlxMBBpvE+TxJQsrp5ColmarimaU P2/883GgzjZhTXWNxBIhQerageSevndq1FmX9kY03Hq0aPWeJOaajqPkbQNSr8O0VDzh GvDTP/XCnBJX6dH3m80wGqNOWApSFj/qgSs4sQpPS+iLX4SEegdWjRuuW/4WvEU33kta IMug== X-Received: by 10.112.39.129 with SMTP id p1mr3570056lbk.26.1358506209477; Fri, 18 Jan 2013 02:50:09 -0800 (PST) Received: from [192.168.178.21] (host137-94-dynamic.4-87-r.retail.telecomitalia.it. [87.4.94.137]) by mx.google.com with ESMTPS id to7sm1831007lab.13.2013.01.18.02.50.07 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 18 Jan 2013 02:50:08 -0800 (PST) Message-ID: <50F928D7.6070608@gmail.com> Date: Fri, 18 Jan 2013 11:49:59 +0100 From: Stefano Lattarini MIME-Version: 1.0 To: "Richard W.M. Jones" Subject: [PATCH] docs: serial-tests are not deprecated, just discouraged (was: Re: bug#13478: Don't deprecate or remove 'serial-tests') References: <20130117181648.GA7536@rhmail.home.annexia.org> <50F84260.9090701@gmail.com> In-Reply-To: <50F84260.9090701@gmail.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Spam-Score: -2.6 (--) X-Debbugs-Envelope-To: 13478-done Cc: "automake-patches@gnu.org" , 13478-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) On 01/17/2013 07:26 PM, Stefano Lattarini wrote: > On 01/17/2013 07:16 PM, Richard W.M. Jones wrote: >> >> For some reason this is marked as deprecated. >> >> This is bad: parallel tests are fine for tiny tests which use only a >> little bit of memory. However if your tests are very large and use a >> lot of RAM then running them in parallel can cause them to fail >> unnecessarily. >> >> The libguestfs test suite is exactly like this: parallel tests causes >> it to fail because you end up running multiple parallel VMs. Serial >> tests is the right way to go for us. >> > This is a documentation problem, mostly (and my fault BTW, but let's move on). > We should say that 'paralle-tests' is "encouraged", rather than saying that > 'serial-tests' is "deprecated". In fact, there are no plan to ever remove it, > or even give runtime warnings upon its usage. > Fixed by the patch below. I'm thus closing this bug report. Thanks, Stefano ---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ----- >From e195e54eb13dd781413ffc617716b4cfe320c0b7 Mon Sep 17 00:00:00 2001 Message-Id: From: Stefano Lattarini Date: Fri, 18 Jan 2013 11:39:28 +0100 Subject: [PATCH] docs: serial-tests are not deprecated, just discouraged We don't plan to remove support for them, nor to have the serial-tests option give any kind of runtime warning, so don't alarm the users still using serial tests with pointless "deprecation" or "obsolescence" warnings. Fixes automake bug#13478. * doc/automake.texi: Adjust. * THANKS: Update. Signed-off-by: Stefano Lattarini --- THANKS | 1 + doc/automake.texi | 16 ++++++++++------ 2 files changed, 11 insertions(+), 6 deletions(-) diff --git a/THANKS b/THANKS index 58745e7..21ea373 100644 --- a/THANKS +++ b/THANKS @@ -331,6 +331,7 @@ Reuben Thomas rrt@sc3d.org Rich Wales richw@webcom.com Richard Boulton richard@tartarus.org Richard Dawe rich@phekda.freeserve.co.uk +Richard W.M. Jones rjones@redhat.com Rob Savoye rob@cygnus.com Robert Bihlmeyer robbe@orcus.priv.at Robert Boehne rboehne@ricardo-us.com diff --git a/doc/automake.texi b/doc/automake.texi index ffc6819..3b830d5 100644 --- a/doc/automake.texi +++ b/doc/automake.texi @@ -319,7 +319,7 @@ Support for test suites Simple Tests * Scripts-based Testsuites:: Automake-specific concepts and terminology -* Serial Test Harness:: Older (and obsolescent) serial test harness +* Serial Test Harness:: Older (and discouraged) serial test harness * Parallel Test Harness:: Generic concurrent test harness Using the TAP test protocol @@ -8806,7 +8806,7 @@ terminology)? @menu * Scripts-based Testsuites:: Automake-specific concepts and terminology -* Serial Test Harness:: Older (and obsolescent) serial test harness +* Serial Test Harness:: Older (and discouraged) serial test harness * Parallel Test Harness:: Generic concurrent test harness @end menu @@ -8979,12 +8979,16 @@ by the tests, not the tests themselves. Of course you can set @code{TESTS = $(check_PROGRAMS)} if all your programs are test cases. @node Serial Test Harness -@subsection Older (and obsolescent) serial test harness +@subsection Older (and discouraged) serial test harness @cindex @option{serial-tests}, Using -@emph{This harness is obsolescent}, and kept for backward-compatibility -reasons only. The user is strongly advised to just use the parallel test -harness instead (@pxref{Parallel Test Harness}). +First, note that today the use of this harness is strongly discouraged in +favour of the parallel test harness (@pxref{Parallel Test Harness}). +Still, there are @emph{few} situations when the advantages offered by +the parallel harness are irrelevant, and when test concurrency can +even cause tricky problems. In those cases, it might make sense to +still use the serial harness, for simplicity and reliability (we still +suggest trying to give the parallel harness a shot though). The serial test harness is enabled by the Automake option @option{serial-tests}. It operates by simply running the tests serially, -- 1.8.1.rc3.192.g2d0029e ------------=_1358506262-24777-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 17 Jan 2013 18:17:59 +0000 Received: from localhost ([127.0.0.1]:37270 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Tvu2F-0007pK-Pn for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:59 -0500 Received: from eggs.gnu.org ([208.118.235.92]:39312) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Tvu29-0007p7-Fr for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:54 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Tvu1N-0003nm-WC for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:06 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-106.9 required=5.0 tests=BAYES_00, RCVD_IN_DNSWL_HI, RP_MATCHES_RCVD, USER_IN_WHITELIST autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:35275) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Tvu1N-0003nZ-TV for submit@debbugs.gnu.org; Thu, 17 Jan 2013 13:17:01 -0500 Received: from eggs.gnu.org ([208.118.235.92]:50588) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Tvu1J-0006Ep-Fw for bug-automake@gnu.org; Thu, 17 Jan 2013 13:17:01 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Tvu1F-0003lE-4z for bug-automake@gnu.org; Thu, 17 Jan 2013 13:16:57 -0500 Received: from mx1.redhat.com ([209.132.183.28]:60746) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Tvu1E-0003kt-SL for bug-automake@gnu.org; Thu, 17 Jan 2013 13:16:53 -0500 Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id r0HIGqCw029731 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Thu, 17 Jan 2013 13:16:52 -0500 Received: from localhost (vpn1-5-145.ams2.redhat.com [10.36.5.145]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id r0HIGpk9007956 for ; Thu, 17 Jan 2013 13:16:51 -0500 Date: Thu, 17 Jan 2013 18:16:48 +0000 From: "Richard W.M. Jones" To: bug-automake@gnu.org Subject: Don't deprecate or remove 'serial-tests' Message-ID: <20130117181648.GA7536@rhmail.home.annexia.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-12-10) X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 208.118.235.17 X-Spam-Score: -4.2 (----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -5.5 (-----) For some reason this is marked as deprecated. This is bad: parallel tests are fine for tiny tests which use only a little bit of memory. However if your tests are very large and use a lot of RAM then running them in parallel can cause them to fail unnecessarily. The libguestfs test suite is exactly like this: parallel tests causes it to fail because you end up running multiple parallel VMs. Serial tests is the right way to go for us. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming blog: http://rwmj.wordpress.com Fedora now supports 80 OCaml packages (the OPEN alternative to F#) ------------=_1358506262-24777-1--