GNU bug report logs - #20716
TAP Protocol skip is not recognized.

Previous Next

To reply to this bug, email your comments to 20716 AT debbugs.gnu.org.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: "Arthur Schwarz" <aschwarz1309 <at> att.net>
To: <bug-automake <at> gnu.org>
Subject: TAP Protocol skip is not recognized.
Date: Mon, 1 Jun 2015 15:07:41 -0700

http://testanything.org/

DIRECTIVES

Directives are special notes that follow a # on the test line. Only two are
currently defined: TODO and SKIP. Note that these two keywords are not
case-sensitive.

The tap-driver.sh does accept 'ok # skip' but requires 'ok # SKIP'. The TAP
standard says that skip is not case sensitive (it is case insensitive?).

It is reported as XPASS (because TAP_LOG_DRIVER_FLAGS = --expect-failure
yes) but a test-plan of 1..0 is reported as SKIP. This seems inconsistent. 

If I have
    1..1
    ok # SKIP

Is reported as

XPASS: test2.tap 1
=================================
Testsuite summary for test 0.5
=================================
# TOTAL: 1
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 1
# ERROR: 0
=================================
See src/test-suite.log
================================

test2.trs
:global-test-result: FAIL
:recheck: yes
:copy-in-global-log: yes
:test-result: XPASS

while
    1..0

Is reported as

SKIP: test2.tap
=================================
Testsuite summary for test 0.5
=================================
# TOTAL: 1
# PASS:  0
# SKIP:  1
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
=================================

Test2.tap
:global-test-result: SKIP
:recheck: no
:copy-in-global-log: yes
:test-result: SKIP

And what is also interesting is that the output is also different. No
test-suite.log file (seems ok except I would expect some indication) and,
since this is the TAP protocol, I would expect that Diagnostics would be
captured in a test-suite.log as is indicated in the ':copy-in-global-log:'
yes metadata tag.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.