GNU bug report logs - #57301
28.1; 12 unexpected test results on emacs 28.1

Previous Next

To reply to this bug, email your comments to 57301 AT debbugs.gnu.org.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: gitmux <at> mail.stemux.com
To: bug-gnu-emacs <at> gnu.org
Subject: 28.1; 12 unexpected test results on emacs 28.1
Date: Fri, 19 Aug 2022 07:33:56 -0500

[Message part 1 (text/plain, inline)]

Dear GNU Emacs,

        When executing `make check`, there are 12 unexpected tests.
The configuration, compilation, and test occurs with `compile.sh'.
`output.txt' is the resulting output. The other four attached files
contain the `unexpected results'. Version 28.1 is acquired from
`mirror://gnu/emacs/emacs-28.1.tar.xz'.

[compile.sh (application/x-sh, attachment)]

[output.txt (text/plain, attachment)]

[fns-tests.log (text/plain, attachment)]

[emacs-tests.log (text/plain, attachment)]

[info-xref-tests.log (text/plain, attachment)]

[mml-sec-tests.log (text/plain, attachment)]

[Message part 8 (text/plain, inline)]

Thank you,
Git Mux

Message #8 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Kangas <stefankangas <at> gmail.com>
To: gitmux <at> mail.stemux.com, 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Fri, 19 Aug 2022 11:14:46 -0700

gitmux <at> mail.stemux.com writes:

>         When executing `make check`, there are 12 unexpected tests.
> The configuration, compilation, and test occurs with `compile.sh'.
> `output.txt' is the resulting output. The other four attached files
> contain the `unexpected results'. Version 28.1 is acquired from
> `mirror://gnu/emacs/emacs-28.1.tar.xz'.

Thanks for the bug report.

Could you please also send the full output of `M-x report-emacs-bug'?

Message #13 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: "Basil L. Contovounesios" <contovob <at> tcd.ie>
To: gitmux <at> mail.stemux.com
Cc: 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Sat, 20 Aug 2022 15:37:50 +0300

gitmux <at> mail.stemux.com [2022-08-19 07:33 -0500] wrote:

> Running 7 tests (2022-08-19 06:35:19-0500, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))')
>   skipped  1/7  emacs-tests/bwrap/allows-stdout (0.000239 sec)
>    passed  2/7  emacs-tests/seccomp/absent-file (0.026424 sec)
> Test emacs-tests/seccomp/allows-stdout backtrace:
>   signal(ert-test-failed (((should (eql status 0)) :form (eql "Bad sys
>   ert-fail(((should (eql status 0)) :form (eql "Bad system call" 0) :v
>   #f(compiled-function () #<bytecode -0xfefa61c58ebb889>)()
>   ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
>   ert-run-test(#s(ert-test :name emacs-tests/seccomp/allows-stdout :do
>   ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ... ...))
>   ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
>   ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
>   ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
>   eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
>   command-line-1(("-L" ":." "-l" "ert" "-l" "src/emacs-tests" "--eval"
>   command-line()
>   normal-top-level()
> Test emacs-tests/seccomp/allows-stdout condition:
>     Info: Process output:
>           
>     (ert-test-failed
>      ((should
>        (eql status 0))
>       :form
>       (eql "Bad system call" 0)
>       :value nil))
>    FAILED  3/7  emacs-tests/seccomp/allows-stdout (0.026337 sec)
>    passed  4/7  emacs-tests/seccomp/empty-file (0.018653 sec)
>    passed  5/7  emacs-tests/seccomp/file-too-large (0.043209 sec)
>    passed  6/7  emacs-tests/seccomp/forbids-subprocess (0.020086 sec)
>    passed  7/7  emacs-tests/seccomp/invalid-file-size (0.019868 sec)
>
> Ran 7 tests, 5 results as expected, 1 unexpected, 1 skipped (2022-08-19 06:35:20-0500, 0.239446 sec)
>
> 1 unexpected results:
>    FAILED  emacs-tests/seccomp/allows-stdout
>
> 1 skipped results:
>   SKIPPED  emacs-tests/bwrap/allows-stdout

This could be https://bugs.gnu.org/51073
or https://bugs.gnu.org/56359.

-- 
Basil

Message #16 received at submit <at> debbugs.gnu.org (full text, mbox):

From: gitmux <at> mail.stemux.com
To: bug-gnu-emacs <at> gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Sat, 20 Aug 2022 08:17:51 -0500

Dear Emacs,

Below is the output from `report-emacs-bug' from `./src/emacs'

""""""""""""""""""""

In GNU Emacs 28.1 (build 1, x86_64-pc-linux-musl,
GTK+ Version 3.24.34, cairo version 1.16.0)
 of 2022-08-19 built on Mux.stemux.com
Windowing system distributor 'The X.Org Foundation', version 11.0.12101004
System Description: Exherbo Linux

Configured using:
 'configure --without-tiff --without-modules --without-selinux
 --without-gnutls'

Configured features:
CAIRO DBUS FREETYPE GIF GLIB GMP GSETTINGS HARFBUZZ JPEG JSON LCMS2
LIBXML2 NOTIFY INOTIFY PDUMPER PNG RSVG SECCOMP SOUND THREADS
TOOLKIT_SCROLL_BARS X11 XDBE XIM XPM GTK3 ZLIB

Important settings:
  locale-coding-system: nil

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  show-paren-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  indent-tabs-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message rmc puny dired dired-loaddefs
rfc822 mml mml-sec epa derived epg rfc6068 epg-config gnus-util rmail
rmail-loaddefs auth-source cl-seq eieio eieio-core cl-macs
eieio-loaddefs password-cache json map text-property-search time-date
subr-x seq byte-opt gv bytecomp byte-compile cconv mm-decode mm-bodies
mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader cl-loaddefs
cl-lib sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils
iso-transl tooltip eldoc paren electric uniquify ediff-hook vc-hooks
lisp-float-type elisp-mode mwheel term/x-win x-win term/common-win x-dnd
tool-bar dnd fontset image regexp-opt fringe tabulated-list replace
newcomment text-mode lisp-mode prog-mode register page tab-bar menu-bar
rfn-eshadow isearch easymenu timer select scroll-bar mouse jit-lock
font-lock syntax font-core term/tty-colors frame minibuffer cl-generic
cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao
korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech
european ethiopic indian cyrillic chinese composite emoji-zwj charscript
charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray
cl-preloaded nadvice button loaddefs faces cus-face macroexp files
window text-properties overlay sha1 md5 base64 format env code-pages
mule custom widget hashtable-print-readable backquote threads dbusbind
inotify lcms2 dynamic-setting system-font-setting font-render-setting
cairo move-toolbar gtk x-toolkit x multi-tty make-network-process emacs)

Memory information:
((conses 16 50418 5734)
 (symbols 48 6625 1)
 (strings 32 18530 3046)
 (string-bytes 1 624738)
 (vectors 16 13704)
 (vector-slots 8 185411 12312)
 (floats 8 21 42)
 (intervals 56 196 0)
 (buffers 992 10))

""""""""""""""""""""

Thank you,
Git Mux

Message #19 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: gitmux <at> mail.stemux.com
Cc: 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Sun, 21 Aug 2022 14:21:35 +0200

gitmux <at> mail.stemux.com writes:

> In GNU Emacs 28.1 (build 1, x86_64-pc-linux-musl,
> GTK+ Version 3.24.34, cairo version 1.16.0)
>  of 2022-08-19 built on Mux.stemux.com
> Windowing system distributor 'The X.Org Foundation', version 11.0.12101004
> System Description: Exherbo Linux

I don't think we have any users that regularly test using a musl OS, so
I guess these problems are to be expected.  (I saw test failures in
string-collate* for instance, which is something where we defer to libc
for sorting, I think.)

It'd be more useful to have reports about these test failures for the
"master" branch instead of emacs-28.1.  Would it be possible for you to
run "make check" there instead?

Message #22 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: archmux <at> Mux.stemux.com
To: "Lars Ingebrigtsen" <larsi <at> gnus.org>
Cc: gitmux <at> mail.stemux.com, 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Mon, 22 Aug 2022 17:49:27 -0500

[Message part 1 (text/plain, inline)]

Dear Lars Ingebrigtsen,

The emacs "master" branch is acquired with `git clone https://git.savannah.gnu.org/git/emacs.git'.

`make` results in error.

`make` is run from `compile.sh`.

[compile.sh (text/x-shellscript, attachment)]

[configure-output.txt (text/plain, attachment)]

[compile-output.txt (text/plain, attachment)]

[Message part 5 (text/plain, inline)]

`man seccomp_rule_add_array' states:

""""""""""""""""""""
       int seccomp_rule_add_array(scmp_filter_ctx ctx,
                                  uint32_t action, int syscall,
                                  unsigned int arg_cnt,
                                  const struct scmp_arg_cmp *arg_array);
""""""""""""""""""""

Thank you,
Git Mux

Message #25 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: archmux <at> Mux.stemux.com
Cc: gitmux <at> mail.stemux.com, 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Tue, 23 Aug 2022 12:37:22 +0200

archmux <at> Mux.stemux.com writes:

> checking build system type... x86_64-pc-linux-musl

[...]

> seccomp_rule_add_array (SCMP_ACT_ALLOW, SCMP_SYS (exit), 1, {}): Invalid argument
> make[1]: *** [Makefile:466: seccomp-filter.bpf] Error 1
> make[1]: *** Waiting for unfinished jobs....
> seccomp_rule_add_array (SCMP_ACT_ALLOW, SCMP_SYS (exit), 1, {}): Invalid argument
> make[1]: *** [Makefile:466: seccomp-filter-exec.bpf] Error 1
> make[1]: Leaving directory '/home/archmux/Internet/Git/Editor/emacs/lib-src'
> make: *** [Makefile:463: lib-src] Error 2
> `man seccomp_rule_add_array' states:
>
> """"""""""""""""""""
>        int seccomp_rule_add_array(scmp_filter_ctx ctx,
>                                   uint32_t action, int syscall,
>                                   unsigned int arg_cnt,
>                                   const struct scmp_arg_cmp *arg_array);
> """"""""""""""""""""

I guess it's an issue with building under musl.  As I've said before, we
don't have anybody building Emacs under musl (as far as I know), so if
these problems are to be fixed, somebody using that will have to propose
patches.

Message #28 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: Robert Pluim <rpluim <at> gmail.com>
To: Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: archmux <at> Mux.stemux.com, gitmux <at> mail.stemux.com, 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Tue, 23 Aug 2022 16:32:09 +0200

>>>>> On Tue, 23 Aug 2022 12:37:22 +0200, Lars Ingebrigtsen <larsi <at> gnus.org> said:

    Lars> archmux <at> Mux.stemux.com writes:
    >> checking build system type... x86_64-pc-linux-musl

    Lars> [...]

    >> seccomp_rule_add_array (SCMP_ACT_ALLOW, SCMP_SYS (exit), 1, {}): Invalid argument
    >> make[1]: *** [Makefile:466: seccomp-filter.bpf] Error 1
    >> make[1]: *** Waiting for unfinished jobs....
    >> seccomp_rule_add_array (SCMP_ACT_ALLOW, SCMP_SYS (exit), 1, {}): Invalid argument
    >> make[1]: *** [Makefile:466: seccomp-filter-exec.bpf] Error 1
    >> make[1]: Leaving directory '/home/archmux/Internet/Git/Editor/emacs/lib-src'
    >> make: *** [Makefile:463: lib-src] Error 2
    >> `man seccomp_rule_add_array' states:
    >> 
    >> """"""""""""""""""""
    >> int seccomp_rule_add_array(scmp_filter_ctx ctx,
    >> uint32_t action, int syscall,
    >> unsigned int arg_cnt,
    >> const struct scmp_arg_cmp *arg_array);
    >> """"""""""""""""""""

    Lars> I guess it's an issue with building under musl.  As I've said before, we
    Lars> don't have anybody building Emacs under musl (as far as I know), so if
    Lars> these problems are to be fixed, somebody using that will have to propose
    Lars> patches.

Which distribution is this? Emacs master builds seccomp fine under
Alpine 3.16, which is musl based (although I had to install coreutils
to get a 'sort' that understands '-C').

Robert
-- 

Message #31 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: archmux <at> Mux.stemux.com
To: "Robert Pluim" <rpluim <at> gmail.com>
Cc: Lars Ingebrigtsen <larsi <at> gnus.org>, gitmux <at> mail.stemux.com,
 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Wed, 24 Aug 2022 17:49:42 -0500

Dear Robert Pluim,

	This is compiled on Exherbo linux (https://www.exherbo.org/).

Thank you,
Git Mux

Message #34 received at 57301 <at> debbugs.gnu.org (full text, mbox):

From: Robert Pluim <rpluim <at> gmail.com>
To: archmux <at> Mux.stemux.com
Cc: Lars Ingebrigtsen <larsi <at> gnus.org>, gitmux <at> mail.stemux.com,
 57301 <at> debbugs.gnu.org
Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1
Date: Thu, 25 Aug 2022 10:04:17 +0200

>>>>> On Wed, 24 Aug 2022 17:49:42 -0500, archmux <at> Mux.stemux.com said:

    Git Mux> Dear Robert Pluim,

    Git Mux> 	This is compiled on Exherbo linux (https://www.exherbo.org/).

<sigh> Yet Another Linux Distribution. Alpine was easy for me to test,
exherbo considerably less so, so if you can figure out why the one
works and the other doesnʼt that would be helpful.

Robert
-- 

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.