GNU bug report logs - #44545
Many Test Failures @3d62df2

Previous Next

To reply to this bug, email your comments to 44545 AT debbugs.gnu.org.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Fred Wright <fw <at> fwright.net>
To: bug-dejagnu <at> gnu.org
Subject: Many Test Failures @3d62df2
Date: Mon, 9 Nov 2020 18:23:00 -0800 (PST)

[Message part 1 (text/plain, inline)]

The built-in tests are currently failing on multiple platforms.  The 
attached cases cover three versions of Linux (run on VMs), plus one on OSX 
(native).  Also note that the CentOS and Fedora cases return zero exit 
statuses in spite of the failures.

These were all run in git repos, to ensure that #44544 was irrelevant.

Fred Wright

[MacLinux-config.log (application/octet-stream, attachment)]

[MacLinux-check.log (text/plain, attachment)]

[MacCent-config.log (text/plain, attachment)]

[MacCent-check.log (text/plain, attachment)]

[MacFed-config.log (text/plain, attachment)]

[MacFed-check.log (text/plain, attachment)]

[MacPro-config.log (text/plain, attachment)]

[MacPro-check.log (text/plain, attachment)]

Message #8 received at 44545 <at> debbugs.gnu.org (full text, mbox):

From: Jacob Bachmeyer <jcb62281 <at> gmail.com>
To: Fred Wright <fw <at> fwright.net>
Cc: 44545 <at> debbugs.gnu.org
Subject: Re: bug#44545: Many Test Failures @3d62df2
Date: Tue, 10 Nov 2020 21:36:40 -0600

Fred Wright wrote:
> The built-in tests are currently failing on multiple platforms.  The 
> attached cases cover three versions of Linux (run on VMs), plus one on 
> OSX (native).  Also note that the CentOS and Fedora cases return zero 
> exit statuses in spite of the failures.

The CentOS and Fedora test runs correctly return successful exit 
status:  some of the launcher tests are not being run because the test 
driver is detecting that the testing environment has not been properly 
set up.  They are reported as "unsupported" tests when this occurs, 
since this condition was expected to indicate that symbolic links are 
unavailable.

You are correct that the testing environment should be properly set up 
and the tests should run on GNU/Linux systems, assuming that the 
filesystem in use supports symlinks.  The cause was traced to misuse of 
relative file names when constructing symbolic links and should be fixed 
in current master at Savannah as of commit 
e14ab2646f02530efb93037f1fee5c20f5af4121.  This should resolve the issue 
on Fedora and CentOS, and help to narrow the scope for the issues on 
Ubuntu and MacOS X.

To debug the remaining issues, I will also need the .sum and .log files 
produced by DejaGnu for the failing tests.  If current master fixes the 
test environment errors (resolving the issues observed on Fedora and 
CentOS) and all else remains the same, I will need the 
report-card.{log,sum} files from an Ubuntu run and the 
{launcher,report-card}.{log,sum} files from a MacOS X run to further 
investigate this issue.


-- Jacob

Message #11 received at 44545 <at> debbugs.gnu.org (full text, mbox):

From: Fred Wright <fw <at> fwright.net>
To: Jacob Bachmeyer <jcb62281 <at> gmail.com>
Cc: 44545 <at> debbugs.gnu.org
Subject: Re: bug#44545: Many Test Failures @3d62df2
Date: Wed, 11 Nov 2020 17:26:34 -0800 (PST)

[Message part 1 (text/plain, inline)]

On Tue, 10 Nov 2020, Jacob Bachmeyer wrote:

> Fred Wright wrote:
>> The built-in tests are currently failing on multiple platforms.  The 
>> attached cases cover three versions of Linux (run on VMs), plus one on OSX 
>> (native).  Also note that the CentOS and Fedora cases return zero exit 
>> statuses in spite of the failures.
[...]
> To debug the remaining issues, I will also need the .sum and .log files 
> produced by DejaGnu for the failing tests.  If current master fixes the test 
> environment errors (resolving the issues observed on Fedora and CentOS) and 
> all else remains the same, I will need the report-card.{log,sum} files from 
> an Ubuntu run and the {launcher,report-card}.{log,sum} files from a MacOS X 
> run to further investigate this issue.

I've attached archives of *.log and *.sum from the Ubuntu and OSX 
failures.

CentOS and Fedora now run clean.

Fred Wright

[MacLinux.tar.gz (application/x-gzip, attachment)]

[MacPro.tar.gz (application/x-gzip, attachment)]

Message #16 received at 44545 <at> debbugs.gnu.org (full text, mbox):

From: Jacob Bachmeyer <jcb62281 <at> gmail.com>
To: Fred Wright <fw <at> fwright.net>
Cc: 44545 <at> debbugs.gnu.org
Subject: Re: bug#44545: Many Test Failures @3d62df2
Date: Thu, 03 Jun 2021 23:28:38 -0500

My apologies for the lengthy delay in responding; for unknown reasons 
your previous email on this issue did not reach me and I have just now 
discovered it while checking bugs in the Web interface while closing 
bugs resolved during the 1.6.3 release candidate series.

The issues on Mac OSX and Ubuntu appear to be related to odd behavior in 
Ubuntu's awk and limitations of the MacOS X expr compared to their 
regular GNU equivalents.  Similar problems were encountered on Solaris 
and solutions to the problems on Solaris 10 were integrated into the 
fifth release candidate for 1.6.3; please test 
<URL:ftp://alpha.gnu.org/gnu/dejagnu/dejagnu-1.6.3-rc5.tar.gz> and 
indicate if these problems continue to occur.


-- Jacob

Message #19 received at 44545 <at> debbugs.gnu.org (full text, mbox):

From: Fred Wright <fw <at> fwright.net>
To: Jacob Bachmeyer <jcb62281 <at> gmail.com>
Cc: 44545 <at> debbugs.gnu.org
Subject: Re: bug#44545: Many Test Failures @3d62df2
Date: Mon, 14 Jun 2021 20:47:59 -0700 (PDT)

[Message part 1 (text/plain, inline)]

On Thu, 3 Jun 2021, Jacob Bachmeyer wrote:

> My apologies for the lengthy delay in responding; for unknown reasons your 
> previous email on this issue did not reach me and I have just now discovered 
> it while checking bugs in the Web interface while closing bugs resolved 
> during the 1.6.3 release candidate series.
>
> The issues on Mac OSX and Ubuntu appear to be related to odd behavior in 
> Ubuntu's awk and limitations of the MacOS X expr compared to their regular 
> GNU equivalents.  Similar problems were encountered on Solaris and solutions 
> to the problems on Solaris 10 were integrated into the fifth release 
> candidate for 1.6.3; please test 
> <URL:ftp://alpha.gnu.org/gnu/dejagnu/dejagnu-1.6.3-rc5.tar.gz> and indicate 
> if these problems continue to occur.

I ran the tests on a number of platforms, mostly identified in the 
attached plat.txt file (though CentOS and Fedora don't identify teh 
distro in uname).  All BSD systems failed "make" (error output 
attached).  Of the others, only OSX 10.4 PPC was an actual failure, though 
there's a bunch of warning output in some other cases.

Fred Wright

[plat.txt (text/plain, attachment)]

[bsderr.txt (text/plain, attachment)]

[check1.txt (text/plain, attachment)]

[check2.txt (text/plain, attachment)]

Message #22 received at 44545 <at> debbugs.gnu.org (full text, mbox):

From: Jacob Bachmeyer <jcb62281 <at> gmail.com>
To: Fred Wright <fw <at> fwright.net>
Cc: 44545 <at> debbugs.gnu.org
Subject: Re: bug#44545: Many Test Failures @3d62df2
Date: Tue, 15 Jun 2021 18:28:05 -0500

Fred Wright wrote:
> I ran the tests on a number of platforms, mostly identified in the 
> attached plat.txt file (though CentOS and Fedora don't identify teh 
> distro in uname).  All BSD systems failed "make" (error output attached).

This appears to be a limitation of BSD make, and the usual solution I 
found in a BSD discussion forum seems to be to install GNU make, which 
BSDs often package as "gmake".

> Of the others, only OSX 10.4 PPC was an actual failure, 

This looks like a limitation in MacOS X 10.4 awk; please send the 
report-card.log from that failed test.  As nothing else fails, 
dejagnu-report-card is a new feature, and MacOS X 10.4 is a very old 
nonfree system, the only bug here is that configure fails to detect a 
problem.

> though there's a bunch of warning output in some other cases.

Can you clarify what the warnings are?  The only match for "warn" is the 
bit of code that Automake uses to emit a warning if running runtest fails.



-- Jacob

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.