Subject: Re: bug#57301: 28.1; 12 unexpected test results on emacs 28.1

From: "Basil L. Contovounesios" <[email-masked]>
Date: Sat, 20 Aug 2022 15:37:50 +0300

[email-masked] [2022-08-19 07:33 -0500] wrote:

> Running 7 tests (2022-08-19 06:35:19-0500, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))')
>   skipped  1/7  emacs-tests/bwrap/allows-stdout (0.000239 sec)
>    passed  2/7  emacs-tests/seccomp/absent-file (0.026424 sec)
> Test emacs-tests/seccomp/allows-stdout backtrace:
>   signal(ert-test-failed (((should (eql status 0)) :form (eql "Bad sys
>   ert-fail(((should (eql status 0)) :form (eql "Bad system call" 0) :v
>   #f(compiled-function () #<bytecode -0xfefa61c58ebb889>)()
>   ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
>   ert-run-test(#s(ert-test :name emacs-tests/seccomp/allows-stdout :do
>   ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ... ...))
>   ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
>   ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
>   ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
>   eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
>   command-line-1(("-L" ":." "-l" "ert" "-l" "src/emacs-tests" "--eval"
>   command-line()
>   normal-top-level()
> Test emacs-tests/seccomp/allows-stdout condition:
>     Info: Process output:
>           
>     (ert-test-failed
>      ((should
>        (eql status 0))
>       :form
>       (eql "Bad system call" 0)
>       :value nil))
>    FAILED  3/7  emacs-tests/seccomp/allows-stdout (0.026337 sec)
>    passed  4/7  emacs-tests/seccomp/empty-file (0.018653 sec)
>    passed  5/7  emacs-tests/seccomp/file-too-large (0.043209 sec)
>    passed  6/7  emacs-tests/seccomp/forbids-subprocess (0.020086 sec)
>    passed  7/7  emacs-tests/seccomp/invalid-file-size (0.019868 sec)
>
> Ran 7 tests, 5 results as expected, 1 unexpected, 1 skipped (2022-08-19 06:35:20-0500, 0.239446 sec)
>
> 1 unexpected results:
>    FAILED  emacs-tests/seccomp/allows-stdout
>
> 1 skipped results:
>   SKIPPED  emacs-tests/bwrap/allows-stdout

This could be https://bugs.gnu.org/51073
or https://bugs.gnu.org/56359.

-- 
Basil