GNU bug report logs - #14760
GNU Automake 1.14 testsuite failures on -current NetBSD/amd64

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 14760 in the body.
You can then email your comments to 14760 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Nicolas Joly <njoly <at> pasteur.fr>
To: bug-automake <at> gnu.org
Subject: GNU Automake 1.14 testsuite failures on -current NetBSD/amd64
Date: Mon, 1 Jul 2013 17:05:48 +0200

[Message part 1 (text/plain, inline)]

Hi,

Just got 2 failures running Automake 1.14 testsuite on -current
NetBSD/amd64.

Testsuite summary for GNU Automake 1.14
============================================================================
# TOTAL: 3036
# PASS:  2844
# SKIP:  150
# XFAIL: 40
# FAIL:  2
# XPASS: 0
# ERROR: 0
============================================================================

njoly <at> lynche [src/automake-1.14]> grep '^FAIL:'test-suite.log
FAIL: t/parallel-tests-concurrency
FAIL: t/silent-custom
njoly <at> lynche [src/automake-1.14]> uname -a
NetBSD lynche.sis.pasteur.fr 6.99.23 NetBSD 6.99.23 (LYNCHE) #3: Mon Jul  1 11:47:39 CEST 2013  njoly <at> lynche.sis.pasteur.fr.sis.pasteur.fr:/local/src/NetBSD/obj.amd64/sys/arch/amd64/compile/LYNCHE amd64

Thanks.

-- 
Nicolas Joly

Biology IT Center
Institut Pasteur, Paris.

[test-suite.log (text/plain, attachment)]

Message #8 received at 14760 <at> debbugs.gnu.org (full text, mbox):

From: Stefano Lattarini <stefano.lattarini <at> gmail.com>
To: Nicolas Joly <njoly <at> pasteur.fr>
Cc: "automake-patches <at> gnu.org" <automake-patches <at> gnu.org>,
 14760 <at> debbugs.gnu.org
Subject: Re: bug#14760: GNU Automake 1.14 testsuite failures on -current
 NetBSD/amd64
Date: Sun, 21 Jul 2013 23:50:47 +0100

tags 14760 + moreinfo
thanks

On 07/01/2013 04:05 PM, Nicolas Joly wrote:
> 
> Hi,
>
Hi Nicolas, sorry for the shameful delay.

> Just got 2 failures running Automake 1.14 testsuite on -current
> NetBSD/amd64.
> 
> [SNIP]
>
> FAIL: t/silent-custom
>
Does the patch below help with this failure?

(As for the other failure, I'll take a look later -- might be
few minutes, might be few days).

Thanks,
  Stefano

---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ---- 8< ----

From ac0e09477ca1614892799c91c327fff0ba83ad19 Mon Sep 17 00:00:00 2001
Message-Id: <ac0e09477ca1614892799c91c327fff0ba83ad19.1374445534.git.stefano.lattarini <at> gmail.com>
From: Stefano Lattarini <stefano.lattarini <at> gmail.com>
Date: Sun, 7 Jul 2013 11:37:37 +0100
Subject: [PATCH] tests: fix a spurious failure on NetBSD-current

Reported in automake bug#14760.

* tests/silent-custom.sh: Be prepared to handle creative
quoting in the output of the shell run for the make recipes
when the shell traces are active ("set -x").

Signed-off-by: Stefano Lattarini <stefano.lattarini <at> gmail.com>
---
 t/silent-custom.sh | 14 ++++++++++++--
 1 file changed, 12 insertions(+), 2 deletions(-)

diff --git a/t/silent-custom.sh b/t/silent-custom.sh
index 7ce3ffc..b00e388 100644
--- a/t/silent-custom.sh
+++ b/t/silent-custom.sh
@@ -80,8 +80,18 @@ do_check ()
   else
     $FGREP 'GEN ' output && exit 1
     $FGREP 'cp ./foo.in foo' output
-    $FGREP "rm -f sub/0.h sub/1.h sub/2.h" output
-    $FGREP "generate-header --flags sub/0.h sub/1.h sub/2.h" output
+    # Be prepared to handle "creative quoting" in the shell traces.
+    # See automake bug#14760.
+    ok=false
+    for q in '' \' \"; do
+      files="${q}sub/0.h${q} ${q}sub/1.h${q} ${q}sub/2.h${q}"
+      $FGREP "rm -f $files" output || continue
+      $FGREP "generate-header --flags $files" output || continue
+      ok=:
+      break
+    done
+    $ok || exit 1
+    unset ok
   fi
 }

-- 
1.8.3.1.605.g85318f5

Message #13 received at 14760 <at> debbugs.gnu.org (full text, mbox):

From: Stefano Lattarini <stefano.lattarini <at> gmail.com>
To: Nicolas Joly <njoly <at> pasteur.fr>
Cc: 14760 <at> debbugs.gnu.org
Subject: Re: bug#14760: GNU Automake 1.14 testsuite failures on -current
 NetBSD/amd64
Date: Mon, 22 Jul 2013 00:08:44 +0100

On 07/01/2013 04:05 PM, Nicolas Joly wrote:
> 
> Hi,
> 
> Just got 2 failures running Automake 1.14 testsuite on -current
> NetBSD/amd64.
>
> [SNIP]
>
> FAIL: t/parallel-tests-concurrency
> ==================================
>
> Running from installcheck: no
> Test Protocol: none
> PATH = /local/src/automake-1.14/t/wrap:/local/src/automake-1.14/t/ax:/home/njoly/bin:/local/bin:/local/sbin:/usr/pkg/bin:/usr/pkg/sbin:/usr/X11R7/bin:/usr/bin:/usr/sbin:/bin:/sbin
> ++ pwd
> /local/src/automake-1.14/t/parallel-tests-concurrency.dir
> + case $MAKE in
> + using_gmake
> + case $am__using_gmake in
> + grep GNU
> + make --version -v
> usage: make [-BeikNnqrstWX]
>             [-C directory] [-D variable] [-d flags] [-f makefile]
>             [-I directory] [-J private] [-j max_jobs] [-m directory] [-T file]
>             [-V variable] [variable=value] [target ...]
> + am__using_gmake=no
> + return 1
> + unindent
> + test x = x
> ++ sed -e 's/  *# .*//'
> ++ printf '%s\n' '
>   /^$/b                    # Nothing to do for empty lines.
>   x                        # Get x<indent> into pattern space.
>   /^$/{                    # No prior x<indent>, go prepare it.
>     g                      # Copy this 1st non-blank line into pattern space.
>     s/^\([	 ]*\).*/x\1/   # Prepare x<indent> in pattern space.
>   }                        # Now: x<indent> in pattern and <line> in hold.
>   G                        # Build x<indent>\n<line> in pattern space, and
>   h                        # duplicate it into hold space.
>   s/\n.*$//                # Restore x<indent> in pattern space, and
>   x                        # exchange with the above duplicate in hold space.
>   s/^x\(.*\)\n\1//         # Remove leading <indent> from <line>.
>   s/^x.*\n//               # Restore <line> when there is no leading <indent>.
> '
> + sed_unindent_prog='
>   /^$/b
>   x
>   /^$/{
>     g
>     s/^\([	 ]*\).*/x\1/
>   }
>   G
>   h
>   s/\n.*$//
>   x
>   s/^x\(.*\)\n\1//
>   s/^x.*\n//'
> + sed '
>   /^$/b
>   x
>   /^$/{
>     g
>     s/^\([	 ]*\).*/x\1/
>   }
>   G
>   h
>   s/\n.*$//
>   x
>   s/^x\(.*\)\n\1//
>   s/^x.*\n//'
> + for j in '"-j"' '"-j "' NONE
> + test x-j = xNONE
> + run_make -M -- -j2 all
> + am__make_redirect_stdout=no
> + am__make_redirect_stderr=no
> + am__make_redirect_stdall=no
> + am__make_flags=
> + am__make_rc_exp=0
> + am_make_rc=0
> + test 4 -gt 0
> + case $1 in
> + am__make_redirect_stdall=yes
> + shift
> + test 3 -gt 0
> + case $1 in
> + shift
> + break
> + using_gmake
> + case $am__using_gmake in
> + return 1
> + for am__x in '"$@"'
> + case $am__x in
> + for am__x in '"$@"'
> + case $am__x in
> + unset am__x
> + test x '!=' x
> + : exec make -j2 all
> + set +x
> + test 0 -eq 253
> + test yes = yes
> + cat output
> --- one ---
> --- two ---
> echo ok > two
> --- one ---
> sleep 2 && test -f two
> + case $am__make_rc_exp in
> + test 0 -ge 0
> + test 0 -le 255
> + test 0 -eq 0
> + /usr/bin/grep -E -i '(warning|error):|-j["\'\''` ]' output
> + break
> + rm -f one output Makefile
> + cat
> + cat
> + cat
> + chmod a+x ./x
> + mkdir sub
> + for i in 1 2 3
> + echo 'TESTS += foo1.test'
> + cp x foo1.test
> + echo 'TESTS += zap1'
> + cp x zap1
> + echo 'TESTS += sub/bar1.test'
> + cp x sub/bar1.test
> + echo 'TESTS += sub/mu1'
> + cp x sub/mu1
> + for i in 1 2 3
> + echo 'TESTS += foo2.test'
> + cp x foo2.test
> + echo 'TESTS += zap2'
> + cp x zap2
> + echo 'TESTS += sub/bar2.test'
> + cp x sub/bar2.test
> + echo 'TESTS += sub/mu2'
> + cp x sub/mu2
> + for i in 1 2 3
> + echo 'TESTS += foo3.test'
> + cp x foo3.test
> + echo 'TESTS += zap3'
> + cp x zap3
> + echo 'TESTS += sub/bar3.test'
> + cp x sub/bar3.test
> + echo 'TESTS += sub/mu3'
> + cp x sub/mu3
> + aclocal-1.14 -Werror
> + autoconf
> + automake-1.14 --foreign -Werror -Wall -a
> parallel-tests: installing './test-driver'
> + for build in serial parallel
> + mkdir serial
> + cd serial
> + ../configure
> checking for a BSD-compatible install... /usr/bin/install -c
> checking whether build environment is sane... yes
> checking for a thread-safe mkdir -p... ../install-sh -c -d
> checking for gawk... no
> checking for mawk... no
> checking for nawk... no
> checking for awk... awk
> checking whether make sets $(MAKE)... yes
> checking whether make supports nested variables... yes
> checking that generated files are newer than configure... done
> configure: creating ./config.status
> config.status: creating Makefile
> + make
> + cd ..
> + for build in serial parallel
> + mkdir parallel
> + cd parallel
> + ../configure
> checking for a BSD-compatible install... /usr/bin/install -c
> checking whether build environment is sane... yes
> checking for a thread-safe mkdir -p... ../install-sh -c -d
> checking for gawk... no
> checking for mawk... no
> checking for nawk... no
> checking for awk... awk
> checking whether make sets $(MAKE)... yes
> checking whether make supports nested variables... yes
> checking that generated files are newer than configure... done
> configure: creating ./config.status
> config.status: creating Makefile
> + make
> + cd ..
> + cd serial
> + cd ../parallel
> + sleep 2
> + make -j1 check
> make  check-TESTS
> PASS: foo1.test
> + run_make -O -- -j4 check
> + am__make_redirect_stdout=no
> + am__make_redirect_stderr=no
> + am__make_redirect_stdall=no
> + am__make_flags=
> + am__make_rc_exp=0
> + am_make_rc=0
> + test 4 -gt 0
> + case $1 in
> + am__make_redirect_stdout=yes
> + shift
> + test 3 -gt 0
> + case $1 in
> + shift
> + break
> + using_gmake
> + case $am__using_gmake in
> + return 1
> + for am__x in '"$@"'
> + case $am__x in
> + for am__x in '"$@"'
> + case $am__x in
> + unset am__x
> + test x '!=' x
> + : exec make -j4 check
> + set +x
> PASS: zap1
> PASS: sub/bar1.test
> PASS: sub/mu1
> PASS: foo2.test
> PASS: zap2
> PASS: sub/bar2.test
> PASS: sub/mu2
> PASS: foo3.test
> PASS: zap3
> PASS: sub/bar3.test
> PASS: sub/mu3
> ============================================================================
> Testsuite summary for parallel-tests-concurrency 1.0
> ============================================================================
> # TOTAL: 12
> # PASS:  12
> # SKIP:  0
> # XFAIL: 0
> # FAIL:  0
> # XPASS: 0
> # ERROR: 0
> ============================================================================
> + test 0 -eq 253
> + test no = yes
> + test yes = yes
> + cat stdout
> --- check-am ---
> make  check-TESTS
> --- check-TESTS ---
> PASS: foo1.test
> PASS: zap1
> PASS: sub/bar1.test
> PASS: sub/mu1
> PASS: foo2.test
> PASS: zap2
> PASS: sub/bar2.test
> PASS: sub/mu2
> PASS: foo3.test
> PASS: zap3
> PASS: sub/bar3.test
> PASS: sub/mu3
> ============================================================================
> Testsuite summary for parallel-tests-concurrency 1.0
> ============================================================================
> # TOTAL: 12
> # PASS:  12
> # SKIP:  0
> # XFAIL: 0
> # FAIL:  0
> # XPASS: 0
> # ERROR: 0
> ============================================================================
> + test no = yes
> + case $am__make_rc_exp in
> + test 0 -ge 0
> + test 0 -le 255
> + test 0 -eq 0
> + cd ..
> + kill -0 23026
> ./t/parallel-tests-concurrency.sh: line 100: kill: (23026) - No such process
> + am_exit_trap 1
> + exit_status=1
> + set +e
> + cd /local/src/automake-1.14
> + test none = tap
> + case $am_explicit_skips in
> + test 1 -eq 0
> + keep_testdirs=yes
> + am_keeping_testdirs
> + case $keep_testdirs in
> + return 0
> + set +x
> parallel-tests-concurrency: exit 1
>
I must admit I currently have no idea about what might be the root
cause of this failure.  So, few questions to try to shed more light
on the issue:

  1. Is the failure consistently reproducible?

  2. Is the failure present only when you run the test from make,
     or also when you run it "directly" (that is, through a
     ./runtest invocation)?

  3. If the failure is racy, does it happen more often under a
     loaded system and/or when the Automake testsuite is run in
     low priority, or is that irrelevant?

  4. Any other hypothesis/suggestion you want to share?

Thanks,
  Stefano

Message #16 received at 14760 <at> debbugs.gnu.org (full text, mbox):

From: Nicolas Joly <njoly <at> pasteur.fr>
To: Stefano Lattarini <stefano.lattarini <at> gmail.com>
Cc: Nicolas Joly <njoly <at> pasteur.fr>,
 "automake-patches <at> gnu.org" <automake-patches <at> gnu.org>, 14760 <at> debbugs.gnu.org
Subject: Re: bug#14760: GNU Automake 1.14 testsuite failures on -current
 NetBSD/amd64
Date: Mon, 22 Jul 2013 15:49:14 +0200

On Sun, Jul 21, 2013 at 11:50:47PM +0100, Stefano Lattarini wrote:
> tags 14760 + moreinfo
> thanks
> 
> On 07/01/2013 04:05 PM, Nicolas Joly wrote:
> > 
> > Hi,
> >
> Hi Nicolas, sorry for the shameful delay.

No worries, i had almost no time these days to have a closer look
myself.

> > Just got 2 failures running Automake 1.14 testsuite on -current
> > NetBSD/amd64.
> > 
> > [SNIP]
> >
> > FAIL: t/silent-custom
> >
> Does the patch below help with this failure?

Yes, thanks. With your patch applied, t/silent-custom testcase is
successful.

njoly <at> lynche [src/automake-1.14]> make -k recheck
FAIL: t/parallel-tests-concurrency.sh
PASS: t/silent-custom.sh
============================================================================
Testsuite summary for GNU Automake 1.14
============================================================================

-- 
Nicolas Joly

Biology IT Center
Institut Pasteur, Paris.

Message #19 received at 14760 <at> debbugs.gnu.org (full text, mbox):

From: Nicolas Joly <njoly <at> pasteur.fr>
To: Stefano Lattarini <stefano.lattarini <at> gmail.com>
Cc: Nicolas Joly <njoly <at> pasteur.fr>, 14760 <at> debbugs.gnu.org
Subject: Re: bug#14760: GNU Automake 1.14 testsuite failures on -current
 NetBSD/amd64
Date: Mon, 22 Jul 2013 16:32:50 +0200

[Message part 1 (text/plain, inline)]

On Mon, Jul 22, 2013 at 12:08:44AM +0100, Stefano Lattarini wrote:
> On 07/01/2013 04:05 PM, Nicolas Joly wrote:
> > 
> > Hi,
> > 
> > Just got 2 failures running Automake 1.14 testsuite on -current
> > NetBSD/amd64.
> >
> > [SNIP]
> >
> > FAIL: t/parallel-tests-concurrency
> > ==================================
> >
> > Running from installcheck: no
> > Test Protocol: none
> > PATH = /local/src/automake-1.14/t/wrap:/local/src/automake-1.14/t/ax:/home/njoly/bin:/local/bin:/local/sbin:/usr/pkg/bin:/usr/pkg/sbin:/usr/X11R7/bin:/usr/bin:/usr/sbin:/bin:/sbin
> > ++ pwd
> > /local/src/automake-1.14/t/parallel-tests-concurrency.dir
> > + case $MAKE in
> > + using_gmake
> > + case $am__using_gmake in
> > + grep GNU
> > + make --version -v
> > usage: make [-BeikNnqrstWX]
> >             [-C directory] [-D variable] [-d flags] [-f makefile]
> >             [-I directory] [-J private] [-j max_jobs] [-m directory] [-T file]
> >             [-V variable] [variable=value] [target ...]
> > + am__using_gmake=no
> > + return 1
> > + unindent
> > + test x = x
> > ++ sed -e 's/  *# .*//'
> > ++ printf '%s\n' '
> >   /^$/b                    # Nothing to do for empty lines.
> >   x                        # Get x<indent> into pattern space.
> >   /^$/{                    # No prior x<indent>, go prepare it.
> >     g                      # Copy this 1st non-blank line into pattern space.
> >     s/^\([	 ]*\).*/x\1/   # Prepare x<indent> in pattern space.
> >   }                        # Now: x<indent> in pattern and <line> in hold.
> >   G                        # Build x<indent>\n<line> in pattern space, and
> >   h                        # duplicate it into hold space.
> >   s/\n.*$//                # Restore x<indent> in pattern space, and
> >   x                        # exchange with the above duplicate in hold space.
> >   s/^x\(.*\)\n\1//         # Remove leading <indent> from <line>.
> >   s/^x.*\n//               # Restore <line> when there is no leading <indent>.
> > '
> > + sed_unindent_prog='
> >   /^$/b
> >   x
> >   /^$/{
> >     g
> >     s/^\([	 ]*\).*/x\1/
> >   }
> >   G
> >   h
> >   s/\n.*$//
> >   x
> >   s/^x\(.*\)\n\1//
> >   s/^x.*\n//'
> > + sed '
> >   /^$/b
> >   x
> >   /^$/{
> >     g
> >     s/^\([	 ]*\).*/x\1/
> >   }
> >   G
> >   h
> >   s/\n.*$//
> >   x
> >   s/^x\(.*\)\n\1//
> >   s/^x.*\n//'
> > + for j in '"-j"' '"-j "' NONE
> > + test x-j = xNONE
> > + run_make -M -- -j2 all
> > + am__make_redirect_stdout=no
> > + am__make_redirect_stderr=no
> > + am__make_redirect_stdall=no
> > + am__make_flags=
> > + am__make_rc_exp=0
> > + am_make_rc=0
> > + test 4 -gt 0
> > + case $1 in
> > + am__make_redirect_stdall=yes
> > + shift
> > + test 3 -gt 0
> > + case $1 in
> > + shift
> > + break
> > + using_gmake
> > + case $am__using_gmake in
> > + return 1
> > + for am__x in '"$@"'
> > + case $am__x in
> > + for am__x in '"$@"'
> > + case $am__x in
> > + unset am__x
> > + test x '!=' x
> > + : exec make -j2 all
> > + set +x
> > + test 0 -eq 253
> > + test yes = yes
> > + cat output
> > --- one ---
> > --- two ---
> > echo ok > two
> > --- one ---
> > sleep 2 && test -f two
> > + case $am__make_rc_exp in
> > + test 0 -ge 0
> > + test 0 -le 255
> > + test 0 -eq 0
> > + /usr/bin/grep -E -i '(warning|error):|-j["\'\''` ]' output
> > + break
> > + rm -f one output Makefile
> > + cat
> > + cat
> > + cat
> > + chmod a+x ./x
> > + mkdir sub
> > + for i in 1 2 3
> > + echo 'TESTS += foo1.test'
> > + cp x foo1.test
> > + echo 'TESTS += zap1'
> > + cp x zap1
> > + echo 'TESTS += sub/bar1.test'
> > + cp x sub/bar1.test
> > + echo 'TESTS += sub/mu1'
> > + cp x sub/mu1
> > + for i in 1 2 3
> > + echo 'TESTS += foo2.test'
> > + cp x foo2.test
> > + echo 'TESTS += zap2'
> > + cp x zap2
> > + echo 'TESTS += sub/bar2.test'
> > + cp x sub/bar2.test
> > + echo 'TESTS += sub/mu2'
> > + cp x sub/mu2
> > + for i in 1 2 3
> > + echo 'TESTS += foo3.test'
> > + cp x foo3.test
> > + echo 'TESTS += zap3'
> > + cp x zap3
> > + echo 'TESTS += sub/bar3.test'
> > + cp x sub/bar3.test
> > + echo 'TESTS += sub/mu3'
> > + cp x sub/mu3
> > + aclocal-1.14 -Werror
> > + autoconf
> > + automake-1.14 --foreign -Werror -Wall -a
> > parallel-tests: installing './test-driver'
> > + for build in serial parallel
> > + mkdir serial
> > + cd serial
> > + ../configure
> > checking for a BSD-compatible install... /usr/bin/install -c
> > checking whether build environment is sane... yes
> > checking for a thread-safe mkdir -p... ../install-sh -c -d
> > checking for gawk... no
> > checking for mawk... no
> > checking for nawk... no
> > checking for awk... awk
> > checking whether make sets $(MAKE)... yes
> > checking whether make supports nested variables... yes
> > checking that generated files are newer than configure... done
> > configure: creating ./config.status
> > config.status: creating Makefile
> > + make
> > + cd ..
> > + for build in serial parallel
> > + mkdir parallel
> > + cd parallel
> > + ../configure
> > checking for a BSD-compatible install... /usr/bin/install -c
> > checking whether build environment is sane... yes
> > checking for a thread-safe mkdir -p... ../install-sh -c -d
> > checking for gawk... no
> > checking for mawk... no
> > checking for nawk... no
> > checking for awk... awk
> > checking whether make sets $(MAKE)... yes
> > checking whether make supports nested variables... yes
> > checking that generated files are newer than configure... done
> > configure: creating ./config.status
> > config.status: creating Makefile
> > + make
> > + cd ..
> > + cd serial
> > + cd ../parallel
> > + sleep 2
> > + make -j1 check
> > make  check-TESTS
> > PASS: foo1.test
> > + run_make -O -- -j4 check
> > + am__make_redirect_stdout=no
> > + am__make_redirect_stderr=no
> > + am__make_redirect_stdall=no
> > + am__make_flags=
> > + am__make_rc_exp=0
> > + am_make_rc=0
> > + test 4 -gt 0
> > + case $1 in
> > + am__make_redirect_stdout=yes
> > + shift
> > + test 3 -gt 0
> > + case $1 in
> > + shift
> > + break
> > + using_gmake
> > + case $am__using_gmake in
> > + return 1
> > + for am__x in '"$@"'
> > + case $am__x in
> > + for am__x in '"$@"'
> > + case $am__x in
> > + unset am__x
> > + test x '!=' x
> > + : exec make -j4 check
> > + set +x
> > PASS: zap1
> > PASS: sub/bar1.test
> > PASS: sub/mu1
> > PASS: foo2.test
> > PASS: zap2
> > PASS: sub/bar2.test
> > PASS: sub/mu2
> > PASS: foo3.test
> > PASS: zap3
> > PASS: sub/bar3.test
> > PASS: sub/mu3
> > ============================================================================
> > Testsuite summary for parallel-tests-concurrency 1.0
> > ============================================================================
> > # TOTAL: 12
> > # PASS:  12
> > # SKIP:  0
> > # XFAIL: 0
> > # FAIL:  0
> > # XPASS: 0
> > # ERROR: 0
> > ============================================================================
> > + test 0 -eq 253
> > + test no = yes
> > + test yes = yes
> > + cat stdout
> > --- check-am ---
> > make  check-TESTS
> > --- check-TESTS ---
> > PASS: foo1.test
> > PASS: zap1
> > PASS: sub/bar1.test
> > PASS: sub/mu1
> > PASS: foo2.test
> > PASS: zap2
> > PASS: sub/bar2.test
> > PASS: sub/mu2
> > PASS: foo3.test
> > PASS: zap3
> > PASS: sub/bar3.test
> > PASS: sub/mu3
> > ============================================================================
> > Testsuite summary for parallel-tests-concurrency 1.0
> > ============================================================================
> > # TOTAL: 12
> > # PASS:  12
> > # SKIP:  0
> > # XFAIL: 0
> > # FAIL:  0
> > # XPASS: 0
> > # ERROR: 0
> > ============================================================================
> > + test no = yes
> > + case $am__make_rc_exp in
> > + test 0 -ge 0
> > + test 0 -le 255
> > + test 0 -eq 0
> > + cd ..
> > + kill -0 23026
> > ./t/parallel-tests-concurrency.sh: line 100: kill: (23026) - No such process
> > + am_exit_trap 1
> > + exit_status=1
> > + set +e
> > + cd /local/src/automake-1.14
> > + test none = tap
> > + case $am_explicit_skips in
> > + test 1 -eq 0
> > + keep_testdirs=yes
> > + am_keeping_testdirs
> > + case $keep_testdirs in
> > + return 0
> > + set +x
> > parallel-tests-concurrency: exit 1
> >
> I must admit I currently have no idea about what might be the root
> cause of this failure.  So, few questions to try to shed more light
> on the issue:
> 
>   1. Is the failure consistently reproducible?

Yes.

njoly <at> lynche [src/automake-1.14]> make -k recheck
FAIL: t/parallel-tests-concurrency.sh
============================================================================
Testsuite summary for GNU Automake 1.14
============================================================================

>   2. Is the failure present only when you run the test from make,
>      or also when you run it "directly" (that is, through a
>      ./runtest invocation)?

Same failure with runtest :

njoly <at> lynche [src/automake-1.14]> ./runtest t/parallel-tests-concurrency.sh
[...]
+ kill -0 5934
./t/parallel-tests-concurrency.sh: line 100: kill: (5934) - No such process
+ am_exit_trap 1
+ exit_status=1
+ set +e
[...]
+ case $keep_testdirs in
+ return 0
+ set +x
parallel-tests-concurrency: exit 1

>   3. If the failure is racy, does it happen more often under a
>      loaded system and/or when the Automake testsuite is run in
>      low priority, or is that irrelevant?

Doesn't seems relevant.

>   4. Any other hypothesis/suggestion you want to share?

Seems to be $MAKE related ... The test succeed with gmake, but fail
with NetBSD make. Both logs attached for review.

Thanks.

-- 
Nicolas Joly

Biology IT Center
Institut Pasteur, Paris.

[gmake.log (text/plain, attachment)]

[make.log (text/plain, attachment)]

Message #22 received at 14760 <at> debbugs.gnu.org (full text, mbox):

From: Stefano Lattarini <stefano.lattarini <at> gmail.com>
To: Nicolas Joly <njoly <at> pasteur.fr>
Cc: "automake-patches <at> gnu.org" <automake-patches <at> gnu.org>,
 14760 <at> debbugs.gnu.org
Subject: Re: bug#14760: GNU Automake 1.14 testsuite failures on -current
 NetBSD/amd64
Date: Tue, 23 Jul 2013 20:38:12 +0100

On 07/22/2013 02:49 PM, Nicolas Joly wrote:
> On Sun, Jul 21, 2013 at 11:50:47PM +0100, Stefano Lattarini wrote:
>> tags 14760 + moreinfo
>> thanks
>>
>> On 07/01/2013 04:05 PM, Nicolas Joly wrote:
>>>
>>> Hi,
>>>
>> Hi Nicolas, sorry for the shameful delay.
> 
> No worries, i had almost no time these days to have a closer look
> myself.
> 
>>> Just got 2 failures running Automake 1.14 testsuite on -current
>>> NetBSD/amd64.
>>>
>>> [SNIP]
>>>
>>> FAIL: t/silent-custom
>>>
>> Does the patch below help with this failure?
> 
> Yes, thanks. With your patch applied, t/silent-custom testcase is
> successful.
> 
> njoly <at> lynche [src/automake-1.14]> make -k recheck
> FAIL: t/parallel-tests-concurrency.sh
> PASS: t/silent-custom.sh
> ============================================================================
> Testsuite summary for GNU Automake 1.14
> ============================================================================
>
Thanks for letting me know.  I'll apply the patch then, but also
keep the bug open until the still-present failure is solved (or
at least understood).

Regards,
  Stefano

Message #25 received at 14760 <at> debbugs.gnu.org (full text, mbox):

From: Stefano Lattarini <stefano.lattarini <at> gmail.com>
To: 11524 <at> debbugs.gnu.org
Cc: Dagobert Michelsen <dam <at> opencsw.org>, David Fang <fang <at> csl.cornell.edu>,
 Mostafa <mostafa_working_away <at> yahoo.com>, 15681 <at> debbugs.gnu.org,
 Automake List <automake <at> gnu.org>, Nicolas Joly <njoly <at> pasteur.fr>,
 16447 <at> debbugs.gnu.org, 14760 <at> debbugs.gnu.org, Thomas Jahns <jahns <at> dkrz.de>,
 14079 <at> debbugs.gnu.org
Subject: Declaring limited "bug bankruptcy" for Automake
Date: Sat, 20 Dec 2014 01:49:15 +0100

tags 11524 wontfix
tags 14079 wontfix
tags 14760 wontfix
tags 16447 wontfix
tags 15681 wontfix
close 11524
close 14079
close 14760
close 15681
close 16447
stop

Due to my lack of time to dedicate to Automake, I'm declaring
a limited bug bankruptcy on old bugs, in case they deal with
testsuite-only glitches on exotic platforms, or with minor
documentation glitches.  Apologies to the original reporters.

That said, if you have time, feel free to re-run the testsuite
on the master branch and open new bugs for any failure you
still see there.  Also make sure to add as much detail as
possible (e.g., the content of the relevant files for failed
tests, rather than just the content of the .log files
associated to the tests).

Thanks, and apologies,
  Stefano

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.