From debbugs-submit-bounces@debbugs.gnu.org Fri May 18 14:41:57 2012 Received: (at submit) by debbugs.gnu.org; 18 May 2012 18:41:57 +0000 Received: from localhost ([127.0.0.1]:33119 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SVS7g-0001LR-Gd for submit@debbugs.gnu.org; Fri, 18 May 2012 14:41:57 -0400 Received: from eggs.gnu.org ([208.118.235.92]:37305) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SVS6z-0001KG-J8 for submit@debbugs.gnu.org; Fri, 18 May 2012 14:41:15 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SVS6V-0007Tc-8X for submit@debbugs.gnu.org; Fri, 18 May 2012 14:40:45 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.6 required=5.0 tests=BAYES_00,FROM_12LTRDOM, RCVD_IN_DNSWL_HI autolearn=ham version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:34337) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SVS6V-0007TW-1w for submit@debbugs.gnu.org; Fri, 18 May 2012 14:40:43 -0400 Received: from eggs.gnu.org ([208.118.235.92]:54975) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SVS6S-0008Gl-Pm for bug-automake@gnu.org; Fri, 18 May 2012 14:40:42 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SVS6Q-0007SH-8i for bug-automake@gnu.org; Fri, 18 May 2012 14:40:40 -0400 Received: from cp-out8.libero.it ([212.52.84.108]:41638) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SVS6P-0007Qr-S8 for bug-automake@gnu.org; Fri, 18 May 2012 14:40:38 -0400 X-CTCH-Spam: Unknown X-CTCH-RefID: str=0001.0A0B020C.4FB697A2.003E,ss=1,re=0.000,fgs=0 X-libjamoibt: 1555 Received: from [192.168.1.29] (151.76.43.35) by cp-out8.libero.it (8.5.133) id 4FB2CA0D006B1852 for bug-automake@gnu.org; Fri, 18 May 2012 20:40:33 +0200 Message-ID: <1337366433.6715.9.camel@vortex> Subject: Testsuite summary for GNU Automake 1.12 From: Guido Trentalancia To: bug-automake@gnu.org Date: Fri, 18 May 2012 20:40:33 +0200 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.4.0.1 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.6 (------) X-Debbugs-Envelope-To: submit X-Mailman-Approved-At: Fri, 18 May 2012 14:41:54 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.9 (------) ============================================================================ Testsuite summary for GNU Automake 1.12 ============================================================================ # TOTAL: 2968 # PASS: 2833 # SKIP: 89 # XFAIL: 42 # FAIL: 4 # XPASS: 0 # ERROR: 0 ============================================================================ See ./test-suite.log Please report to bug-automake@gnu.org ============================================================================ ./lib/test-driver: line 95: 8767 Segmentation fault "$@" > $log_file 2>&1 FAIL: t/pm/Condition-t.pl ./lib/test-driver: line 95: 8815 Segmentation fault "$@" > $log_file 2>&1 FAIL: t/pm/DisjConditions-t.pl FAIL: t/cond29.sh FAIL: t/cond29 ============== Running from installcheck: no Using TAP: no PATH = /usr/src/automake-1.12/t/ax:/usr/src/automake-1.12/t/wrap:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin ++ pwd /usr/src/automake-1.12/t/cond29.dir + echo AC_PROG_CC + cat + ulimit -v 1 + sh -c : ./t/cond29.sh: line 39: 613 Killed sh -c ":" + ulimit -v 150000 + sh -c : + ulimit -v 150000 + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test x = x ++ printf '%s\n' ' /^$/b # Nothing to do for empty lines. x # Get x into pattern space. /^$/{ # No prior x, go prepare it. g # Copy this 1st non-blank line into pattern space. s/^\([ ]*\).*/x\1/ # Prepare x in pattern space. } # Now: x in pattern and in hold. G # Build x\n in pattern space, and h # duplicate it into hold space. s/\n.*$// # Restore x in pattern space, and x # exchange with the above duplicate in hold space. s/^x\(.*\)\n\1// # Remove leading from . s/^x.*\n// # Restore when there is no leading . ' ++ sed -e 's/ *# .*//' + sed_unindent_prog=' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C01], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C02], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C03], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C04], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C05], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C06], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C07], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C08], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C09], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C10], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C11], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C12], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C13], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C14], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C15], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C16], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C17], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C18], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C19], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C20], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C21], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C22], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C23], [:])' + for i in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 + unindent + test 'x /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' = x + sed ' /^$/b x /^$/{ g s/^\([ ]*\).*/x\1/ } G h s/\n.*$// x s/^x\(.*\)\n\1// s/^x.*\n//' + echo 'AM_CONDITIONAL([C24], [:])' + aclocal-1.12 -Werror + automake-1.12 --foreign -Werror -Wall Out of memory! ./t/cond29.sh: line 61: 686 Segmentation fault $AUTOMAKE + exit_status=139 + set +e + cd /usr/src/automake-1.12 + test no = yes + case $am_explicit_skips in + test 139 -eq 0 + keep_testdirs=yes + am_keeping_testdirs + case $keep_testdirs in + return 0 + set +x cond29: exit 139 From debbugs-submit-bounces@debbugs.gnu.org Sun May 27 14:02:43 2012 Received: (at 11512) by debbugs.gnu.org; 27 May 2012 18:02:43 +0000 Received: from localhost ([127.0.0.1]:45690 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SYhne-0003Q0-7i for submit@debbugs.gnu.org; Sun, 27 May 2012 14:02:43 -0400 Received: from mail-bk0-f44.google.com ([209.85.214.44]:47214) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SYhnY-0003Pl-45 for 11512@debbugs.gnu.org; Sun, 27 May 2012 14:02:40 -0400 Received: by bkty8 with SMTP id y8so1696611bkt.3 for <11512@debbugs.gnu.org>; Sun, 27 May 2012 11:01:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:mime-version:to:cc:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=FyUq1/Hw34G5GYHQw3kuZ4k1BAtJkpfMlGgc9itvOwY=; b=Y6xcNIhEREpQ3xAykRtBf/SnUFNInf0qA35IE/JMhcAGUoy8sSGczFMNxX7dDO62ad LWQwT/pN8MsEIPZt7NqNL879OVKtW8IcSex05hpMbDv7461eI4BcVOyvd6F/9qYwE1LE +CcQYgcIJWtT0R+qK9eGBfA45gj6HPYfVawLdQx45gGfOLddLyrf1uuCJjxIfE65UFzw gBewMbtFqtbGTzI8op5WVmTuexMzNkX5HuiB8i8LUzGyhe2WbDL9YJxyxuBEC3mcQPli O5z1urJLNRvoYFc9kM5cCBUazyV86pFTa6UjfZK3d7sdYUryRQQI7Z67ye/jPBW0410h aG5w== Received: by 10.204.152.196 with SMTP id h4mr2352803bkw.131.1338141677211; Sun, 27 May 2012 11:01:17 -0700 (PDT) Received: from [95.244.95.30] (host30-95-dynamic.244-95-r.retail.telecomitalia.it. [95.244.95.30]) by mx.google.com with ESMTPS id ig1sm11639637bkc.4.2012.05.27.11.01.15 (version=SSLv3 cipher=OTHER); Sun, 27 May 2012 11:01:16 -0700 (PDT) Message-ID: <4FC26BE3.5090104@gmail.com> Date: Sun, 27 May 2012 20:01:07 +0200 From: Stefano Lattarini MIME-Version: 1.0 To: Guido Trentalancia Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 References: <1337366433.6715.9.camel@vortex> In-Reply-To: <1337366433.6715.9.camel@vortex> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Score: -2.6 (--) X-Debbugs-Envelope-To: 11512 Cc: 11512@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) tags 11512 moreinfo severity 11512 minor thanks Hi Guido, thanks for the report, and sorry for the delay. On 05/18/2012 08:40 PM, Guido Trentalancia wrote: > ============================================================================ > Testsuite summary for GNU Automake 1.12 > ============================================================================ > # TOTAL: 2968 > # PASS: 2833 > # SKIP: 89 > # XFAIL: 42 > # FAIL: 4 > # XPASS: 0 > # ERROR: 0 > ============================================================================ > See ./test-suite.log > Please report to bug-automake@gnu.org > ============================================================================ > What system are you on exactly? A lots of useful debugging information about your system and the tools you are using should have been saved by the test harness in the 't/get-sysconf.log' file; could you please post its content here? > ./lib/test-driver: line 95: 8767 Segmentation fault "$@" > > $log_file 2>&1 > FAIL: t/pm/Condition-t.pl > > ./lib/test-driver: line 95: 8815 Segmentation fault "$@" > > $log_file 2>&1 > FAIL: t/pm/DisjConditions-t.pl > Huh? This sounds like you perl is segfaulting when executing these tests ... Strange. Does this happen reliably and consistently, or in a racy way? Does it happens also if you run run the test cases by hand? As with: $ perl -Mstrict -I lib -w t/pm/DisjConditions-t.pl > FAIL: t/cond29.sh > > FAIL: t/cond29 > ============== > > Running from installcheck: no > Using TAP: no > PATH > = /usr/src/automake-1.12/t/ax:/usr/src/automake-1.12/t/wrap:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin > ++ pwd > /usr/src/automake-1.12/t/cond29.dir > + echo AC_PROG_CC > + cat > + ulimit -v 1 > + sh -c : > ./t/cond29.sh: line 39: 613 Killed sh -c ":" > + ulimit -v 150000 > + sh -c : > + ulimit -v 150000 > > [SNIP] > > + echo 'AM_CONDITIONAL([C24], [:])' > + aclocal-1.12 -Werror > + automake-1.12 --foreign -Werror -Wall > Out of memory! > ./t/cond29.sh: line 61: 686 Segmentation fault $AUTOMAKE > + exit_status=139 > What happens if you raise the ulimit above to (say) 500000? What if you bing it down to (say) 50000? Or 10000? > + set +e > + cd /usr/src/automake-1.12 > + test no = yes > + case $am_explicit_skips in > + test 139 -eq 0 > + keep_testdirs=yes > + am_keeping_testdirs > + case $keep_testdirs in > + return 0 > + set +x > cond29: exit 139 > Regards, Stefano From debbugs-submit-bounces@debbugs.gnu.org Mon May 28 18:36:55 2012 Received: (at submit) by debbugs.gnu.org; 28 May 2012 22:36:55 +0000 Received: from localhost ([127.0.0.1]:47291 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZ8YZ-0003Zu-9f for submit@debbugs.gnu.org; Mon, 28 May 2012 18:36:55 -0400 Received: from eggs.gnu.org ([208.118.235.92]:57757) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZ8YX-0003Zj-At for submit@debbugs.gnu.org; Mon, 28 May 2012 18:36:53 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZ8X8-00006p-RG for submit@debbugs.gnu.org; Mon, 28 May 2012 18:35:28 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_HI, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:46509) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZ8X8-00006g-O7 for submit@debbugs.gnu.org; Mon, 28 May 2012 18:35:26 -0400 Received: from eggs.gnu.org ([208.118.235.92]:39553) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZ8X6-00065a-S0 for bug-automake@gnu.org; Mon, 28 May 2012 18:35:26 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZ8X4-00006P-D4 for bug-automake@gnu.org; Mon, 28 May 2012 18:35:24 -0400 Received: from hostingsmtp02.register.it ([81.88.50.243]:58436 helo=hostingsmtp.register.it) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZ8X4-00005v-2Z for bug-automake@gnu.org; Mon, 28 May 2012 18:35:22 -0400 Received: (qmail 30639 invoked from network); 28 May 2012 22:35:10 -0000 Received: from unknown (HELO vivaldi36.register.it) by hostingsmtp.register.it with ESMTP; 28 May 2012 22:35:10 -0000 Received: (from popuser@localhost) by vivaldi36.register.it (8.13.8/8.12.11/Submit) id q4SMZAn1007304; Tue, 29 May 2012 00:35:10 +0200 Message-Id: <201205282235.q4SMZAn1007304@vivaldi36.register.it> From: "Guido Trentalancia" To: stefano.lattarini@gmail.com Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 Date: Tue, 29 May 2012 00:35:10 +0200 X-RID: bStjJyU7Y24lKCV0biNydEArZDvoZw==|bStjJyU7Y24lKCV0biNydA==|8vknOuDgJ12j4Cde|TElBTUJFVw== MIME-Version: 1.0 X-Priority: 3 X-Mailer: Webmail Client v1.5 Content-Type: text/plain; charset="iso-8859-1" X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.9 (------) X-Debbugs-Envelope-To: submit Cc: bug-automake@gnu.org, 11512@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: Guido Trentalancia List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.9 (------) >----- Original Message ----- >From: stefano.lattarini@gmail.com >To: guido@trentalancia.com Cc: 11512@debbugs.gnu.org >Data: Sun, 27 May 2012 20:01:07 +0200 >Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 >tags 11512 moreinfo >severity 11512 minor >thanks > >Hi Guido, thanks for the report, and sorry for the delay. > >On 05/18/2012 08:40 PM, Guido Trentalancia wrote: >> ============================================================================ >> Testsuite summary for GNU Automake 1.12 >> ============================================================================ >> # TOTAL: 2968 >> # PASS: 2833 >> # SKIP: 89 >> # XFAIL: 42 >> # FAIL: 4 >> # XPASS: 0 >> # ERROR: 0 >> ============================================================================ >> See ./test-suite.log >> Please report to bug-automake@gnu.org >> ============================================================================ >> >What system are you on exactly? A lots of useful debugging information >about your system and the tools you are using should have been saved by >the test harness in the 't/get-sysconf.log' file; could you please post >its content here? > >> ./lib/test-driver: line 95: 8767 Segmentation fault "$@" > >> $log_file 2>&1 >> FAIL: t/pm/Condition-t.pl >> >> ./lib/test-driver: line 95: 8815 Segmentation fault "$@" > >> $log_file 2>&1 >> FAIL: t/pm/DisjConditions-t.pl >> >Huh? This sounds like you perl is segfaulting when executing these tests ... >Strange. Does this happen reliably and consistently, or in a racy way? >Does it happens also if you run run the test cases by hand? As with: > > $ perl -Mstrict -I lib -w t/pm/DisjConditions-t.pl The above mentioned perl test failures were due to a broken perl installation. After re-installing perl, they complete successfully, so please ignore the above. The only test which fails is t/cond29.sh. >> FAIL: t/cond29.sh >> >> FAIL: t/cond29 >> ============== It keeps failing unless the ulimit on virtual memory is increased to 500000 as you suggested... >> Running from installcheck: no >> Using TAP: no >> PATH >> = /usr/src/automake-1.12/t/ax:/usr/src/automake-1.12/t/wrap:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin >> ++ pwd >> /usr/src/automake-1.12/t/cond29.dir >> + echo AC_PROG_CC >> + cat >> + ulimit -v 1 >> + sh -c : >> ./t/cond29.sh: line 39: 613 Killed sh -c ":" >> + ulimit -v 150000 >> + sh -c : >> + ulimit -v 150000 >> >> [SNIP] >> >> + echo 'AM_CONDITIONAL([C24], [:])' >> + aclocal-1.12 -Werror >> + automake-1.12 --foreign -Werror -Wall >> Out of memory! >> ./t/cond29.sh: line 61: 686 Segmentation fault $AUTOMAKE >> + exit_status=139 >> >What happens if you raise the ulimit above to (say) 500000? The t/cond29.sh test completes successfully with ulimit -v 500000. >What if you bring it down to (say) 50000? Or 10000? With 50000 it also fails (it's less than the actual 150000 value). With 300000 and 200000 it still completes successfully... So, the ulimit -v value needs to be increased from 150000 to at least 200000. However, it's quite ugly to hard-code memory limits in the test code. The default on my bash version 4.2 patchlevel 28 is unlimited virtual memory, can you not avoid limiting it, for example as follows: --- automake-1.12/t/cond29.sh 2012-04-21 16:38:05.000000000 +0200 +++ automake-1.12-work/t/cond29.sh 2012-05-29 00:24:10.248959036 +0200 @@ -36,9 +36,6 @@ EOF # that 70 MB is enough for x86_64 Fedora 16, that gives tools and # libraries plenty of room to grow. Suggested by Jim Meyering in # automake bug#10374. -(ulimit -v 1; sh -c ":") && skip_ "no adequate 'ulimit' builtin found" -(ulimit -v 150000; sh -c ":") || skip_ "no adequate 'ulimit' builtin found" -ulimit -v 150000 for i in 01 02 03 04 05 06 07 08 09 10 >> + set +e >> + cd /usr/src/automake-1.12 >> + test no = yes >> + case $am_explicit_skips in >> + test 139 -eq 0 >> + keep_testdirs=yes >> + am_keeping_testdirs >> + case $keep_testdirs in >> + return 0 >> + set +x >> cond29: exit 139 >> > >Regards, > Stefano Regards, Guido From debbugs-submit-bounces@debbugs.gnu.org Tue May 29 04:03:28 2012 Received: (at submit) by debbugs.gnu.org; 29 May 2012 08:03:28 +0000 Received: from localhost ([127.0.0.1]:47507 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZHOp-0000hA-DP for submit@debbugs.gnu.org; Tue, 29 May 2012 04:03:28 -0400 Received: from eggs.gnu.org ([208.118.235.92]:52464) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZHOm-0000gy-Mr for submit@debbugs.gnu.org; Tue, 29 May 2012 04:03:25 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZHND-0003jk-O5 for submit@debbugs.gnu.org; Tue, 29 May 2012 04:01:57 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, RCVD_IN_DNSWL_HI,T_DKIM_INVALID autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:52312) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZHND-0003jY-I3 for submit@debbugs.gnu.org; Tue, 29 May 2012 04:01:47 -0400 Received: from eggs.gnu.org ([208.118.235.92]:53863) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZHN3-0005ou-L8 for bug-automake@gnu.org; Tue, 29 May 2012 04:01:47 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZHMm-0003WN-PP for bug-automake@gnu.org; Tue, 29 May 2012 04:01:37 -0400 Received: from mail-ey0-f169.google.com ([209.85.215.169]:49567) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZHMm-0003V5-GH for bug-automake@gnu.org; Tue, 29 May 2012 04:01:20 -0400 Received: by eaan1 with SMTP id n1so997851eaa.0 for ; Tue, 29 May 2012 01:01:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:mime-version:to:cc:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=cDRKsqu5FY3KjBzLPvK2Qd8Yrmecspuig6iakXlVnVs=; b=z8YviumhnGxL7IdrYhW5aRTHGTRco6wt0O3lZ7E8oKbkZsORXdOwPp0lE4wn1oAcs8 1DZinc6vMY/yQ217FFzXEu+tfaPCTGPeBDuCPai3elpzov7C3YPh4qcqf7s6yUfUR107 0bTQqfBpnxJB46flnLdJNDTWqUTeCrqbXA9eSzwMTk3/9KgA9jf+tv4gpH72G6IwNsY1 Pvf921znC0lnzCTRmD59cwcuTI/JuQZWGocxscjaJnFb+ypH70sa8aTuV08sB6kVEpN3 Fj18717ANUBoj33bdUPBTmcE3+AhjINfo6VzzKqErsUVSxPCmyNPoMFPmU3f4eT63JNv 9nHg== Received: by 10.14.48.11 with SMTP id u11mr3419909eeb.186.1338278478102; Tue, 29 May 2012 01:01:18 -0700 (PDT) Received: from [95.244.95.46] (host46-95-dynamic.244-95-r.retail.telecomitalia.it. [95.244.95.46]) by mx.google.com with ESMTPS id e45sm18000686eeb.6.2012.05.29.01.01.14 (version=SSLv3 cipher=OTHER); Tue, 29 May 2012 01:01:16 -0700 (PDT) Message-ID: <4FC48243.3040508@gmail.com> Date: Tue, 29 May 2012 10:01:07 +0200 From: Stefano Lattarini MIME-Version: 1.0 To: Guido Trentalancia Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 References: <201205282235.q4SMZAn1007304@vivaldi36.register.it> In-Reply-To: <201205282235.q4SMZAn1007304@vivaldi36.register.it> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.1 (------) X-Debbugs-Envelope-To: submit Cc: bug-automake@gnu.org, 11512@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.1 (------) On 05/29/2012 12:35 AM, Guido Trentalancia wrote: > > [SNIP] > > The above mentioned perl test failures were due to a broken perl > installation. After re-installing perl, they complete successfully, > so please ignore the above. > OK. > The only test which fails is t/cond29.sh. > >>> FAIL: t/cond29.sh >>> >>> FAIL: t/cond29 >>> ============== > > It keeps failing unless the ulimit on virtual memory is increased to 500000 as you suggested... > >>> Running from installcheck: no >>> Using TAP: no >>> PATH >>> = /usr/src/automake-1.12/t/ax:/usr/src/automake-1.12/t/wrap:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin >>> ++ pwd >>> /usr/src/automake-1.12/t/cond29.dir >>> + echo AC_PROG_CC >>> + cat >>> + ulimit -v 1 >>> + sh -c : >>> ./t/cond29.sh: line 39: 613 Killed sh -c ":" >>> + ulimit -v 150000 >>> + sh -c : >>> + ulimit -v 150000 >>> >>> [SNIP] >>> >>> + echo 'AM_CONDITIONAL([C24], [:])' >>> + aclocal-1.12 -Werror >>> + automake-1.12 --foreign -Werror -Wall >>> Out of memory! >>> ./t/cond29.sh: line 61: 686 Segmentation fault $AUTOMAKE >>> + exit_status=139 >>> >> What happens if you raise the ulimit above to (say) 500000? > > The t/cond29.sh test completes successfully with ulimit -v 500000. > > With 300000 and 200000 it still completes successfully... > OK, so this is just a testsuite weakness, and not a "real" bug. Good. > So, the ulimit -v value needs to be increased from 150000 to at > least 200000. > > However, it's quite ugly to hard-code memory limits in the test code. > Quite true. Maybe the best fix is to remove the 'ulimit' usages, and make this tests (and the few other ones oriented at checking Automake performances) only run if the user/developer explicitly ask for them, say by exporting AM_RUN_PERF_TESTS to "yes". > The default on my bash version 4.2 patchlevel 28 is unlimited virtual > memory, can you not avoid limiting it, for example as follows: > > --- automake-1.12/t/cond29.sh 2012-04-21 16:38:05.000000000 +0200 > +++ automake-1.12-work/t/cond29.sh 2012-05-29 00:24:10.248959036 +0200 > @@ -36,9 +36,6 @@ EOF > # that 70 MB is enough for x86_64 Fedora 16, that gives tools and > # libraries plenty of room to grow. Suggested by Jim Meyering in > # automake bug#10374. > -(ulimit -v 1; sh -c ":") && skip_ "no adequate 'ulimit' builtin found" > -(ulimit -v 150000; sh -c ":") || skip_ "no adequate 'ulimit' builtin found" > -ulimit -v 150000 > The problem is that if we do so, then, in the unlikely possibility that the bug this test case is checking against represents itself, the test will end up crashing the tester's machine. Not nice. Thanks, Stefano From debbugs-submit-bounces@debbugs.gnu.org Tue May 29 06:09:25 2012 Received: (at submit) by debbugs.gnu.org; 29 May 2012 10:09:25 +0000 Received: from localhost ([127.0.0.1]:47599 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZJMi-0003Vw-Df for submit@debbugs.gnu.org; Tue, 29 May 2012 06:09:25 -0400 Received: from eggs.gnu.org ([208.118.235.92]:35519) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZJMN-0003Ur-QS for submit@debbugs.gnu.org; Tue, 29 May 2012 06:09:23 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZJKw-0008Oy-6n for submit@debbugs.gnu.org; Tue, 29 May 2012 06:07:36 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, RCVD_IN_DNSWL_HI,T_DKIM_INVALID autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:53683) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZJKw-0008Os-0g for submit@debbugs.gnu.org; Tue, 29 May 2012 06:07:34 -0400 Received: from eggs.gnu.org ([208.118.235.92]:54530) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZJKt-00015i-T6 for bug-automake@gnu.org; Tue, 29 May 2012 06:07:33 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZJKq-0008OC-9z for bug-automake@gnu.org; Tue, 29 May 2012 06:07:31 -0400 Received: from mail-ey0-f169.google.com ([209.85.215.169]:51930) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZJKp-0008Nu-Tc; Tue, 29 May 2012 06:07:28 -0400 Received: by eaan1 with SMTP id n1so1052724eaa.0 for ; Tue, 29 May 2012 03:07:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:mime-version:to:cc:subject:references :in-reply-to:content-type; bh=tbOFP7LT0vqcdJ6zRK2RIBxn03S1Y4Bsldcpy0UPxII=; b=j3FNCycQkltjk/CLV6Yqgf5hJdYSJ0D+pVOqfrWQidQRjZ+9Xkq5nzQdzhW2XyF3Wu U1opkdaiZggzOWfDQlS+lSl8HU7ClsDRmch+8qlJ1/+qAT7oLQPSnKAlpvFI48uwOJ7t wNlxKPoxdr1GZ4GQWtnYYT3090nkiNp26mGdUKAh5wNkZR3MGQGJRblV2p/vSClbQnJF sI8r44D6radRe6XDBWYkiDNCqLSj0gW7jc9KU9WYxJ6XSUICup4z2CPHOpMRf/md7Dpz ljic0AEUOo39wSZg96mMje89ixGSmK6k2GFS2h1xG5PbsNchkmNlyzxPzxYlX6o3mpaJ lt3Q== Received: by 10.14.39.65 with SMTP id c41mr3995818eeb.83.1338286042805; Tue, 29 May 2012 03:07:22 -0700 (PDT) Received: from [87.14.90.172] (host172-90-dynamic.14-87-r.retail.telecomitalia.it. [87.14.90.172]) by mx.google.com with ESMTPS id u10sm46998141eem.1.2012.05.29.03.07.20 (version=SSLv3 cipher=OTHER); Tue, 29 May 2012 03:07:21 -0700 (PDT) Message-ID: <4FC49FCE.3060505@gmail.com> Date: Tue, 29 May 2012 12:07:10 +0200 From: Stefano Lattarini MIME-Version: 1.0 To: Guido Trentalancia Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 References: <201205282235.q4SMZAn1007304@vivaldi36.register.it> <4FC48243.3040508@gmail.com> In-Reply-To: <4FC48243.3040508@gmail.com> Content-Type: multipart/mixed; boundary="------------010005010908090501020809" X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.1 (------) X-Debbugs-Envelope-To: submit Cc: bug-automake@gnu.org, 11512@debbugs.gnu.org, "automake-patches@gnu.org" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.1 (------) This is a multi-part message in MIME format. --------------010005010908090501020809 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit tags 11512 + patch tags 11512 - moreinfo thanks On 05/29/2012 10:01 AM, Stefano Lattarini wrote: > > Maybe the best fix is to remove the 'ulimit' usages, and > make this tests (and the few other ones oriented at checking Automake > performances) only run if the user/developer explicitly ask for them, > say by exporting AM_RUN_PERF_TESTS to "yes". > Done in the attached patch. I will push shortly if there are no objections. Regards, Stefano --------------010005010908090501020809 Content-Type: text/x-diff; name="0001-perf-beginning-of-a-performance-testsuite.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename*0="0001-perf-beginning-of-a-performance-testsuite.patch" >From ff022f46d098098bc17100332e2c96ebef715dff Mon Sep 17 00:00:00 2001 Message-Id: From: Stefano Lattarini Date: Tue, 29 May 2012 11:58:02 +0200 Subject: [PATCH] perf: beginning of a performance testsuite Some tests in the Automake testsuite already aims only at verifying the performance, rather than the correctness, of some operations. Still, they are somewhat shoehorned and forced into the PASS/FAIL framework (say, with the 'ulimit' shell builtin used to verify some operation doesn't take up too much time or memory), but that is conceptually a stretch, and has already caused problems in practice (see automake bug#11512 for an example). So we start moving the "performance tests" out of the testsuite proper, and make them run only "on demand" (when the user exports the variable 'AM_TESTSUITE_PERF' to "yes"). Ideally, we should provide those tests with a custom runner/driver that measures and displays the relevant performance information, but doing that correctly and with the right APIs is definitely more difficult, so we leave it for a later step (an hope we'll take such a step eventually). * t/cond29.sh: Move ... * t/perf/cond.sh: ... here, and adjust. * t/testsuite-recheck-speed.sh: Move ... * t/perf/testsuite-recheck.sh: ... here. * t/testsuite-summary-speed.sh: Move ... * t/perf/testsuite-summary.sh: ... here. * t/list-of-tests.mk (perf_TESTS): New variable, listing the tests in the 't/perf' directory. (handwritten_TESTS): Adjust. * defs: Skip any tests in the 't/perf/' subdirectory unless the 'AM_TESTSUITE_PERF' variable is set to "yes" or "y". * .gitignore: Update. Signed-off-by: Stefano Lattarini --- .gitignore | 2 ++ defs | 10 ++++++++++ t/list-of-tests.mk | 9 ++++++--- t/{cond29.sh => perf/cond.sh} | 7 ------- .../testsuite-recheck.sh} | 0 .../testsuite-summary.sh} | 0 6 files changed, 18 insertions(+), 10 deletions(-) rename t/{cond29.sh => perf/cond.sh} (80%) rename t/{testsuite-recheck-speed.sh => perf/testsuite-recheck.sh} (100%) rename t/{testsuite-summary-speed.sh => perf/testsuite-summary.sh} (100%) diff --git a/.gitignore b/.gitignore index 78b7aff..130b390 100644 --- a/.gitignore +++ b/.gitignore @@ -45,6 +45,8 @@ /t/*.trs /t/pm/*.log /t/pm/*.trs +/t/perf/*.log +/t/perf/*.trs cscope.files cscope.in.out cscope.out diff --git a/defs b/defs index 24d3fd2..612855e 100644 --- a/defs +++ b/defs @@ -730,6 +730,16 @@ require_compiler_ () ## required by them. ## ## ----------------------------------------------------------- ## +# Performance tests must be enabled explicitly. +case $argv0 in + */perf/*) + case $AM_TESTSUITE_PERF in + [yY]|[yY]es|1) ;; + *) skip_ "performance tests not explicitly enabled" ;; + esac + ;; +esac + # Look for (and maybe set up) required tools and/or system features; skip # the current test if they are not found. for tool in : $required diff --git a/t/list-of-tests.mk b/t/list-of-tests.mk index e9f8d23..52bdaf9 100644 --- a/t/list-of-tests.mk +++ b/t/list-of-tests.mk @@ -61,6 +61,11 @@ t/pm/Version2.pl \ t/pm/Version3.pl \ t/pm/Wrap.pl +perf_TESTS = \ +t/perf/cond.sh \ +t/perf/testsuite-recheck.sh \ +t/perf/testsuite-summary.sh + # The order here is mostly alphabetical, with the deliberate exception # that tests having a high runtime (especially TAP tests that run various # checks sequentially) are listed early; this improves performance on @@ -68,6 +73,7 @@ t/pm/Wrap.pl handwritten_TESTS = \ t/get-sysconf.sh \ $(perl_TESTS) \ +$(perf_TESTS) \ t/instspc.tap \ t/aclocal.sh \ t/aclocal3.sh \ @@ -275,7 +281,6 @@ t/cond25.sh \ t/cond26.sh \ t/cond27.sh \ t/cond28.sh \ -t/cond29.sh \ t/cond30.sh \ t/cond31.sh \ t/cond32.sh \ @@ -785,8 +790,6 @@ t/testsuite-summary-color.sh \ t/testsuite-summary-count.sh \ t/testsuite-summary-count-many.sh \ t/testsuite-summary-reference-log.sh \ -t/testsuite-recheck-speed.sh \ -t/testsuite-summary-speed.sh \ t/test-driver-acsubst.sh \ t/test-driver-cond.sh \ t/test-driver-custom-no-extra-driver.sh \ diff --git a/t/cond29.sh b/t/perf/cond.sh similarity index 80% rename from t/cond29.sh rename to t/perf/cond.sh index ee9bf9b..7c8261e 100755 --- a/t/cond29.sh +++ b/t/perf/cond.sh @@ -32,13 +32,6 @@ EOF # to define a01_DEPENDENCIES, a02_DEPENDENCIES, a03_OBJECTS, # a04_OBJECTS, and to rewrite bin_PROGRAM), eating all memory, swap, # or cpu time it can found. -# Limit memory available to spawned processes to ~ 150 MB. Considering -# that 70 MB is enough for x86_64 Fedora 16, that gives tools and -# libraries plenty of room to grow. Suggested by Jim Meyering in -# automake bug#10374. -(ulimit -v 1; sh -c ":") && skip_ "no adequate 'ulimit' builtin found" -(ulimit -v 150000; sh -c ":") || skip_ "no adequate 'ulimit' builtin found" -ulimit -v 150000 for i in \ 01 02 03 04 05 06 07 08 09 10 \ diff --git a/t/testsuite-recheck-speed.sh b/t/perf/testsuite-recheck.sh similarity index 100% rename from t/testsuite-recheck-speed.sh rename to t/perf/testsuite-recheck.sh diff --git a/t/testsuite-summary-speed.sh b/t/perf/testsuite-summary.sh similarity index 100% rename from t/testsuite-summary-speed.sh rename to t/perf/testsuite-summary.sh -- 1.7.9.5 --------------010005010908090501020809-- From debbugs-submit-bounces@debbugs.gnu.org Tue May 29 11:23:53 2012 Received: (at submit) by debbugs.gnu.org; 29 May 2012 15:23:53 +0000 Received: from localhost ([127.0.0.1]:48506 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZOH3-0007GD-C8 for submit@debbugs.gnu.org; Tue, 29 May 2012 11:23:53 -0400 Received: from eggs.gnu.org ([208.118.235.92]:51524) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZOH1-0007G2-SC for submit@debbugs.gnu.org; Tue, 29 May 2012 11:23:52 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZOFT-0002LG-5W for submit@debbugs.gnu.org; Tue, 29 May 2012 11:22:22 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_HI, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:36906) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZOFT-0002Ky-2E for submit@debbugs.gnu.org; Tue, 29 May 2012 11:22:15 -0400 Received: from eggs.gnu.org ([208.118.235.92]:56447) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZOFN-0001nD-0d for bug-automake@gnu.org; Tue, 29 May 2012 11:22:14 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZOFI-0002Dv-0x for bug-automake@gnu.org; Tue, 29 May 2012 11:22:08 -0400 Received: from hostingsmtp01.register.it ([81.88.50.242]:60904 helo=hostingsmtp.register.it) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZOFH-0002DO-N4 for bug-automake@gnu.org; Tue, 29 May 2012 11:22:03 -0400 Received: (qmail 17346 invoked from network); 29 May 2012 15:21:55 -0000 Received: from unknown (HELO vivaldi29.register.it) by hostingsmtp.register.it with ESMTP; 29 May 2012 15:21:55 -0000 Received: (from popuser@localhost) by vivaldi29.register.it (8.13.8/8.12.11/Submit) id q4TFLstj013232; Tue, 29 May 2012 17:21:54 +0200 Message-Id: <201205291521.q4TFLstj013232@vivaldi29.register.it> From: "Guido Trentalancia" To: stefano.lattarini@gmail.com Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 Date: Tue, 29 May 2012 17:21:54 +0200 X-RID: bStjJyU7Y24lKCV0biNydEArZDvoZw==|bStjJyU7Y24lKCV0biNydA==|XSzgJz0w4Cddo+AnXg==|TElBTUJFVw== MIME-Version: 1.0 X-Priority: 3 X-Mailer: Webmail Client v1.5 Content-Type: text/plain; charset="iso-8859-1" X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.9 (------) X-Debbugs-Envelope-To: submit Cc: bug-automake@gnu.org, 11512@debbugs.gnu.org, automake-patches@gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: Guido Trentalancia List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.9 (------) >----- Original Message ----- >From: stefano.lattarini@gmail.com >To: guido@trentalancia.com Cc: 11512@debbugs.gnu.org,bug-automake@gnu.org,automake-patches@gnu.org >Data: Tue, 29 May 2012 12:07:10 +0200 >Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 >tags 11512 + patch >tags 11512 - moreinfo >thanks > >On 05/29/2012 10:01 AM, Stefano Lattarini wrote: >> >> Maybe the best fix is to remove the 'ulimit' usages, and >> make this tests (and the few other ones oriented at checking Automake >> performances) only run if the user/developer explicitly ask for them, >> say by exporting AM_RUN_PERF_TESTS to "yes". >> >Done in the attached patch. I will push shortly if there are no >objections. The attached 0001-perf-beginning-of-a-performance-testsuite.patch patch looks conceptually fine to me. >Regards, > Stefano Thanks. Guido From debbugs-submit-bounces@debbugs.gnu.org Tue May 29 11:36:23 2012 Received: (at submit) by debbugs.gnu.org; 29 May 2012 15:36:23 +0000 Received: from localhost ([127.0.0.1]:48538 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZOT8-0007Z2-MA for submit@debbugs.gnu.org; Tue, 29 May 2012 11:36:22 -0400 Received: from eggs.gnu.org ([208.118.235.92]:56603) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SZOT7-0007Yr-5x for submit@debbugs.gnu.org; Tue, 29 May 2012 11:36:21 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZORa-0000Dm-H1 for submit@debbugs.gnu.org; Tue, 29 May 2012 11:34:52 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_HI, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:46903) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZORa-0000Db-Dt for submit@debbugs.gnu.org; Tue, 29 May 2012 11:34:46 -0400 Received: from eggs.gnu.org ([208.118.235.92]:45047) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZORV-00082p-Hq for bug-automake@gnu.org; Tue, 29 May 2012 11:34:46 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SZORS-0000Am-To for bug-automake@gnu.org; Tue, 29 May 2012 11:34:40 -0400 Received: from hostingsmtp04.register.it ([81.88.50.245]:52931 helo=hostingsmtp.register.it) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SZORS-00009y-K2 for bug-automake@gnu.org; Tue, 29 May 2012 11:34:38 -0400 Received: (qmail 21869 invoked from network); 29 May 2012 15:34:30 -0000 Received: from unknown (HELO vivaldi27.register.it) by hostingsmtp.register.it with ESMTP; 29 May 2012 15:34:30 -0000 Received: (from popuser@localhost) by vivaldi27.register.it (8.13.8/8.12.11/Submit) id q4TFYTwI013308; Tue, 29 May 2012 17:34:29 +0200 Message-Id: <201205291534.q4TFYTwI013308@vivaldi27.register.it> From: "Guido Trentalancia" To: stefano.lattarini@gmail.com Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 Date: Tue, 29 May 2012 17:34:29 +0200 X-RID: bStjJyU7Y24lKCV0biNydEArZDvoZw==|bStjJyU7Y24lKCV0biNydA==|XSzgJz0w4Cddo+AnXg==|TElBTUJFVw== MIME-Version: 1.0 X-Priority: 3 X-Mailer: Webmail Client v1.5 Content-Type: text/plain; charset="iso-8859-1" X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.9 (------) X-Debbugs-Envelope-To: submit Cc: bug-automake@gnu.org, 11512@debbugs.gnu.org, automake-patches@gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: Guido Trentalancia List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.9 (------) >----- Original Message ----- >From: stefano.lattarini@gmail.com >To: guido@trentalancia.com Cc: 11512@debbugs.gnu.org,bug-automake@gnu.org,automake-patches@gnu.org >Data: Tue, 29 May 2012 12:07:10 +0200 >Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 >tags 11512 + patch >tags 11512 - moreinfo >thanks > >On 05/29/2012 10:01 AM, Stefano Lattarini wrote: >> >> Maybe the best fix is to remove the 'ulimit' usages, and >> make this tests (and the few other ones oriented at checking Automake >> performances) only run if the user/developer explicitly ask for them, >> say by exporting AM_RUN_PERF_TESTS to "yes". >> >Done in the attached patch. I will push shortly if there are no >objections. The attached 0001-perf-beginning-of-a-performance-testsuite.patch patch looks conceptually fine to me. >Regards, > Stefano Thanks. Guido From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 01 05:05:42 2012 Received: (at submit) by debbugs.gnu.org; 1 Jun 2012 09:05:42 +0000 Received: from localhost ([127.0.0.1]:52813 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SaNnh-0004Vu-Pu for submit@debbugs.gnu.org; Fri, 01 Jun 2012 05:05:42 -0400 Received: from eggs.gnu.org ([208.118.235.92]:36151) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SaNnf-0004Vi-SF for submit@debbugs.gnu.org; Fri, 01 Jun 2012 05:05:40 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SaNlt-0002Hu-9U for submit@debbugs.gnu.org; Fri, 01 Jun 2012 05:03:55 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, RCVD_IN_DNSWL_HI,T_DKIM_INVALID autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:58548) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SaNlt-0002Hg-3i for submit@debbugs.gnu.org; Fri, 01 Jun 2012 05:03:49 -0400 Received: from eggs.gnu.org ([208.118.235.92]:34131) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SaNlq-0003sc-Ue for bug-automake@gnu.org; Fri, 01 Jun 2012 05:03:48 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1SaNlp-0002H0-08 for bug-automake@gnu.org; Fri, 01 Jun 2012 05:03:46 -0400 Received: from mail-bk0-f41.google.com ([209.85.214.41]:36138) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1SaNlo-0002Gi-Ix; Fri, 01 Jun 2012 05:03:44 -0400 Received: by bkcjm19 with SMTP id jm19so1931071bkc.0 for ; Fri, 01 Jun 2012 02:03:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:mime-version:to:cc:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=qs6aN7SZu3C3BsgzbpzpP4bdjs2HcoFGnMpTWsA61mE=; b=v0dlhlFnJdPK+DKE+d8qzc+t4W1erKI2KqAOJzMwHVrZWawL3MxXI3UEaTDmsFr/JN uB5lmsmX+q51sA7yz0krSnalVF6EjiavKmQJsiS04SqYHsyHjr96JS336Qtb9jksQdYT ibJfr1oLVQ7fFaJ2zPX5b3BxuRtEjqXK/lpbQ8EhugI/eFzq95QvIUAuOIAc+cGzC2yh /bGrgN68EyqgRolMxHYp/3KWQXetyj1zzKf10acQ9KrKMolKvg0mbhCmEvQqEibQMefE zNbz+y3rIfF16y5M1vsE/bRB03KkqakGvtdpr6X3SeA1dYQCiqfBnrXrbOZA1m05Zaky W/TQ== Received: by 10.204.148.74 with SMTP id o10mr928440bkv.111.1338541420480; Fri, 01 Jun 2012 02:03:40 -0700 (PDT) Received: from [87.8.100.238] (host238-100-dynamic.8-87-r.retail.telecomitalia.it. [87.8.100.238]) by mx.google.com with ESMTPS id e20sm1180018bkw.3.2012.06.01.02.03.37 (version=SSLv3 cipher=OTHER); Fri, 01 Jun 2012 02:03:38 -0700 (PDT) Message-ID: <4FC88562.80103@gmail.com> Date: Fri, 01 Jun 2012 11:03:30 +0200 From: Stefano Lattarini MIME-Version: 1.0 To: Guido Trentalancia Subject: Re: bug#11512: Testsuite summary for GNU Automake 1.12 References: <201205291534.q4TFYTwI013308@vivaldi27.register.it> In-Reply-To: <201205291534.q4TFYTwI013308@vivaldi27.register.it> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.1 (------) X-Debbugs-Envelope-To: submit Cc: bug-automake@gnu.org, automake-patches@gnu.org, 11512-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.1 (------) On 05/29/2012 05:34 PM, Guido Trentalancia wrote: > > The attached 0001-perf-beginning-of-a-performance-testsuite.patch patch looks conceptually fine to me. > I've pushed the patch, and I'm thus closing this bug report. Thanks, Stefano From unknown Wed Sep 10 10:36:05 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 29 Jun 2012 11:24:02 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator