Subject: Re: bug#10443: [PATCH] Quote 'like this', not `like this'.

From: Paul Eggert <[email-masked]>
Date: Fri, 06 Jan 2012 11:18:58 -0800

On 01/06/12 11:01, Stefano Lattarini wrote:
>> > FAIL: lzma.test
>> > FAIL: tap-summary-color.test
>> >
> These are new to me.
> 
>> > I can send more details if you like.
>> >
> Yes please, that would be much appreciated.

I can't reproduce the lzma failure now; that's weird.

There is a dependency problem, but I don't think that's
the same problem as it also affects tap-summary-color.
But after I do an explicit "make defs-static" the lzma.test works.
Maybe *.test needs to depend on defs-static?

Anyway, here's the failure output I got first:

$ VERBOSE=yes make check-TESTS TESTS='lzma tap-summary-color'
make[1]: Entering directory `/home/eggert/src/gnu/automake/tests'
ERROR: lzma.test
FAIL: tap-summary-color.test
==============================================
   GNU Automake 1.11a: tests/test-suite.log   
==============================================

# TOTAL: 2
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 1

.. contents:: :depth: 2

ERROR: lzma
===========

./lzma.test: ./defs-static: not found in current directory

FAIL: tap-summary-color
=======================

./tap-summary-color.test: line 20: ./defs-static: No such file or directory

============================================================================
Testsuite summary for GNU Automake 1.11a
============================================================================
# TOTAL: 2
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 1
============================================================================
See tests/test-suite.log
Please report to [email-masked]
============================================================================

I then did "make defs-static", and then:

$ VERBOSE=yes make check-TESTS TESTS='lzma tap-summary-color'
make[1]: Entering directory `/home/eggert/src/gnu/automake/tests'
PASS: lzma.test
FAIL: tap-summary-color.test
==============================================
   GNU Automake 1.11a: tests/test-suite.log   
==============================================

# TOTAL: 2
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

FAIL: tap-summary-color
=======================

Running from installcheck: no
Using TAP: no
PATH = /home/eggert/src/gnu/automake/tests:/home/eggert/bin:/home/eggert/opt/Linux-x86_64/merged/bin:/usr/lib64/ccache:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin
+++ pwd
/home/eggert/src/gnu/automake/tests/tap-summary-color.dir
++ br=============================================================================
++ case $use_colors in
++ fetch_tap_driver
++ case $am_tap_implementation in
++ sed '1s|#!.*|#! /bin/sh|' /home/eggert/src/gnu/automake/lib/tap-driver.sh
++ chmod a+x tap-driver
++ sed 10q tap-driver
#! /bin/sh
# Copyright (C) 2011 Free Software Foundation, Inc.
#
# This program is free software; you can redistribute it and/or modify
# it under the terms of the GNU General Public License as published by
# the Free Software Foundation; either version 2, or (at your option)
# any later version.
#
# This program is distributed in the hope that it will be useful,
# but WITHOUT ANY WARRANTY; without even the implied warranty of
++ cat
++ cat
++ test yes = yes
++ red=''
++ grn=''
++ lgn=''
++ blu=''
++ mgn=''
++ brg=''
++ std=''
++ echo AUTOMAKE_OPTIONS = color-tests
++ success_header='============================================================================
Testsuite summary for GNU AutoTAP 5.12
============================================================================'
++ success_footer='============================================================================'
++ failure_header='============================================================================
Testsuite summary for GNU AutoTAP 5.12
============================================================================'
++ failure_footer='============================================================================
See ./test-suite.log
Please report to [email-masked]
============================================================================'
++ aclocal-1.11a -Werror
++ autoconf -B /no/such/dir -B /no/such/dir
++ automake-1.11a --foreign -Werror -Wall --add-missing
++ ./configure
checking for a BSD-compatible install... /home/eggert/opt/Linux-x86_64/merged/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /home/eggert/opt/Linux-x86_64/merged/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
++ echo 1..1
++ echo ok
++ do_check --pass
++ case $#,$1 in
++ expect_failure=no
++ shift
++ cat
++ cat all.test
1..1
ok
++ st=0
++ test yes = yes
++ make_cmd='env AM_COLOR_TESTS=always make -e'
++ env AM_COLOR_TESTS=always make -e check
++ cat stdout
make  check-TESTS
make[1]: Entering directory `/home/eggert/src/gnu/automake/tests/tap-summary-color.dir'
make[2]: Entering directory `/home/eggert/src/gnu/automake/tests/tap-summary-color.dir'
PASS: all.test 1
============================================================================
Testsuite summary for GNU AutoTAP 5.12
============================================================================
# TOTAL: 1
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================
make[2]: Leaving directory `/home/eggert/src/gnu/automake/tests/tap-summary-color.dir'
make[1]: Leaving directory `/home/eggert/src/gnu/automake/tests/tap-summary-color.dir'
++ test no = yes
++ test 0 -eq 0
++ /usr/bin/perl -w /home/eggert/src/gnu/automake/tests/extract-testsuite-summary stdout
++ cat summary.exp
============================================================================
Testsuite summary for GNU AutoTAP 5.12
============================================================================
# TOTAL: 1
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================
++ cat summary.got
============================================================================
Testsuite summary for GNU AutoTAP 5.12
============================================================================
# TOTAL: 1
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================
++ test yes = yes
++ compare=cmp
++ cmp summary.exp summary.got
summary.exp summary.got differ: char 1, line 1
++ Exit 1
++ set +e
++ test 77 = 1
++ exit 1
++ exit 1
+ exit_status=1
+ set +e
+ cd /home/eggert/src/gnu/automake/tests
+ test no = yes
+ case $am_explicit_skips in
+ test 1 -eq 0
+ keep_testdirs=yes
+ am_keeping_testdirs
+ case $keep_testdirs in
+ return 0
+ set +x
tap-summary-color: exit 1

============================================================================
Testsuite summary for GNU Automake 1.11a
============================================================================
# TOTAL: 2
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0
============================================================================
See tests/test-suite.log
Please report to [email-masked]
============================================================================
make[1]: *** [test-suite.log] Error 1
make[1]: Leaving directory `/home/eggert/src/gnu/automake/tests'
make: *** [check-TESTS] Error 2
1081-penguin $