From unknown Sat Aug 16 18:48:07 2025 X-Loop: help-debbugs@gnu.org Subject: bug#30700: 27.0.50; Broken tests on macOS Resent-From: Philipp Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sun, 04 Mar 2018 19:06:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 30700 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: 30700@debbugs.gnu.org X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.152019031715858 (code B ref -1); Sun, 04 Mar 2018 19:06:02 +0000 Received: (at submit) by debbugs.gnu.org; 4 Mar 2018 19:05:17 +0000 Received: from localhost ([127.0.0.1]:44678 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1esYwe-00047i-Qn for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:17 -0500 Received: from eggs.gnu.org ([208.118.235.92]:49709) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1esYwd-00047U-Py for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:16 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1esYwX-0002Gx-AB for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:10 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: * X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_50, FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,T_DKIM_INVALID autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:54236) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1esYwX-0002Gr-69 for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:09 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:40679) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1esYwV-0003Rh-M1 for bug-gnu-emacs@gnu.org; Sun, 04 Mar 2018 14:05:09 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1esYwU-0002GD-4n for bug-gnu-emacs@gnu.org; Sun, 04 Mar 2018 14:05:07 -0500 Received: from mail-wm0-x22b.google.com ([2a00:1450:400c:c09::22b]:55842) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1esYwT-0002G2-Rs for bug-gnu-emacs@gnu.org; Sun, 04 Mar 2018 14:05:06 -0500 Received: by mail-wm0-x22b.google.com with SMTP id q83so11907006wme.5 for ; Sun, 04 Mar 2018 11:05:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id:mime-version; bh=VEvWsuitUDj+1UU8OFflwInrm2q/zfoHBaFTqV9JILA=; b=Fh2/2mFofHbOP3LwoSq0YwRDKjxPTSHeUg41hlu/mGO3HZ/8AkVfj5PBcz3DihMmHO eImYIW9Vwbf/42SJNQryXzOUKk3IYxIkzDemlL3U5RhA8tGIEVzzjtFmjR7WLYJG7Dw6 VVBy566QXQG1wkZ9BFBhMi1T9LbwxlEQ1uXuExAxmH7i+xGx+SbC8jHIUmKyQHs7oell cqURqdHVrFKAk90JalZyTXPobmb80eoFeprHiOsf4L+BoP736xqTIyWG4NilROw8Jtwi aWvZGSD42QigLshtnbz5th3eozDF5yfeevRKRvVULsVHrhemnHlVXNsYae2RUlR0xS9c xKWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version; bh=VEvWsuitUDj+1UU8OFflwInrm2q/zfoHBaFTqV9JILA=; b=UjYhLwVbgit0UrADG5rpEpG0z4sgBamJwGcI0/TTG/dqj4beobCvy7h9q4Mq0leGEj e8rRcBvae9LporeU9M1LwIkkY7SyL4p8AUXYdgg326w2xuoc10613qMHc+KW288d2Foa giBRAwnGquU6hu+JlLl9xd4AsOiksjvIj/8LJYxXdFCTxR63woQi8l2LKiq0jhXWzFtX 4EKcNlghQajpLojjqxhAQY94VbAuoZOAhjsuLo6v7AwyncNa6iqYsH9+b4CRwH4Mx/L4 SX/jt+IvtR85DsaU/VTmUT7VCZZQHLKwFvfuyJuxS+g2EKwjSj6rmGoZD37Ziqziy8DZ ataw== X-Gm-Message-State: AElRT7HeyPkditej3Vg1rQ1dAL4seYov3wdIHj/LYmO/m0yAy1F2XdZI hdiT1YmJYutvOsvLUiW5BvED+NrP X-Google-Smtp-Source: AG47ELvttR4bEEA6UfAhQRR3FWfkA9N7hCiNJsoUeQN/qEOFBzojeKlCqkAEqmSAm7H2ZdENERNxaQ== X-Received: by 10.28.71.83 with SMTP id u80mr6732072wma.24.1520190304041; Sun, 04 Mar 2018 11:05:04 -0800 (PST) Received: from p ([2001:4c50:25a:2900:44ef:cbd1:2898:4675]) by smtp.gmail.com with ESMTPSA id y28sm10799656wrd.46.2018.03.04.11.05.02 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 04 Mar 2018 11:05:03 -0800 (PST) From: Philipp Date: Sun, 04 Mar 2018 20:05:02 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -3.8 (---) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.8 (---) The following tests fail for me on macOS with a recent master build: network-stream-tests: Test echo-server-with-dns backtrace: make-network-process(:name "server" :server t :noquery t :family ipv make-server("p") (let* ((server (make-server (system-name))) (port (aref (process-con (closure (t) nil (let* ((server (make-server (system-name))) (port ( ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name echo-server-with-dns :documentation n ert-run-or-rerun-test(#s(ert--stats :selector (not (or (tag :expensi ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/network-stream-t command-line() normal-top-level() Test echo-server-with-dns condition: (error "p/0 nodename nor servname provided, or not known") The macOS firewall prevents creating the server here. Probably we should just skip this test on macOS. flymake-tests: 3 unexpected results: FAILED included-c-header-files FAILED warning-predicate-function-gcc FAILED warning-predicate-rx-gcc These tests fail because they seem to invoke GCC, and on macOS GCC is actually Clang, so the output format is different from what's expected. I'd suggest two fixes: 1. Instead of invoking GCC, save GCC's output once in a checked-in file. That makes the test more robust and reproducible because it no longer depends on the behavior of external programs. 2. Make Flymake work with the Clang output, i.e. remove the hard dependency on GCC. In GNU Emacs 27.0.50 (build 57, x86_64-apple-darwin17.4.0, NS appkit-1561.20 Version 10.13.3 (Build 17D102)) of 2018-03-02 built on p Repository revision: e58f9a45d6a31be4ca379e10a866766e0993f49e Windowing system distributor 'Apple', version 10.3.1561 System Description: Mac OS X 10.13.3 Recent messages: For information about GNU Emacs and the GNU system, type C-h C-a. Configured using: 'configure --with-modules --without-pop --with-mailutils --enable-gcc-warnings=yes --enable-checking --enable-check-lisp-object-type 'CFLAGS=-ggdb3 -O0'' Configured features: NOTIFY ACL GNUTLS LIBXML2 ZLIB TOOLKIT_SCROLL_BARS NS MODULES THREADS JSON Important settings: value of $LANG: de_DE.UTF-8 locale-coding-system: utf-8-unix Major mode: Lisp Interaction Minor modes in effect: tooltip-mode: t global-eldoc-mode: t eldoc-mode: t electric-indent-mode: t mouse-wheel-mode: t tool-bar-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t blink-cursor-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t line-number-mode: t transient-mark-mode: t Load-path shadows: None found. Features: (shadow sort mail-extr emacsbug message rmc puny seq byte-opt gv bytecomp byte-compile cconv cl-loaddefs cl-lib dired dired-loaddefs format-spec rfc822 mml easymenu mml-sec password-cache epa derived epg epg-config gnus-util rmail rmail-loaddefs mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils elec-pair time-date tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/ns-win ns-win ucs-normalize mule-util term/common-win tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode lisp-mode prog-mode register page menu-bar rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core term/tty-colors frame cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray minibuffer cl-preloaded nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote kqueue cocoa ns multi-tty make-network-process emacs) Memory information: ((conses 16 204785 6390) (symbols 48 20096 1) (miscs 40 56 156) (strings 32 28897 1948) (string-bytes 1 771870) (vectors 16 35249) (vector-slots 8 722256 13436) (floats 8 52 64) (intervals 56 211 0) (buffers 992 11)) From unknown Sat Aug 16 18:48:07 2025 X-Loop: help-debbugs@gnu.org Subject: bug#30700: 27.0.50; Broken tests on macOS Resent-From: Glenn Morris Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Mon, 05 Mar 2018 22:49:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 30700 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Philipp Cc: 30700@debbugs.gnu.org Received: via spool by 30700-submit@debbugs.gnu.org id=B30700.15202901256274 (code B ref 30700); Mon, 05 Mar 2018 22:49:02 +0000 Received: (at 30700) by debbugs.gnu.org; 5 Mar 2018 22:48:45 +0000 Received: from localhost ([127.0.0.1]:46388 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1esyuT-0001d8-KX for submit@debbugs.gnu.org; Mon, 05 Mar 2018 17:48:45 -0500 Received: from eggs.gnu.org ([208.118.235.92]:49618) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1esyuR-0001cw-Vu for 30700@debbugs.gnu.org; Mon, 05 Mar 2018 17:48:44 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1esyuM-0006Pq-9D for 30700@debbugs.gnu.org; Mon, 05 Mar 2018 17:48:38 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:35182) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1esyuK-0006PL-Rl; Mon, 05 Mar 2018 17:48:36 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.82) (envelope-from ) id 1esyuK-0001W1-7l; Mon, 05 Mar 2018 17:48:36 -0500 From: Glenn Morris References: X-Spook: Drug cartel AVN Emergency Broadcast System Red Cross INS X-Ran: 4TcyL7wKp}sGTb>|nymrpuWx.9RorA{TuDnODM+DFYo/Tz1#Ztz^DKQO215qe$LOfMaz37 X-Hue: magenta X-Attribution: GM Date: Mon, 05 Mar 2018 17:48:35 -0500 In-Reply-To: (Philipp's message of "Sun, 04 Mar 2018 20:05:02 +0100") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Philipp wrote: > 1. Instead of invoking GCC, save GCC's output once in a checked-in file. > That makes the test more robust and reproducible because it no longer > depends on the behavior of external programs. To me, part of the point of tests like these is to flag when changes (or local variations in behaviour) in the external tool necessitate changes in Emacs. From unknown Sat Aug 16 18:48:07 2025 X-Loop: help-debbugs@gnu.org Subject: bug#30700: 27.0.50; Broken tests on macOS Resent-From: Alan Third Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Mon, 19 Mar 2018 13:00:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 30700 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Philipp Cc: 30700@debbugs.gnu.org Received: via spool by 30700-submit@debbugs.gnu.org id=B30700.152146436532473 (code B ref 30700); Mon, 19 Mar 2018 13:00:02 +0000 Received: (at 30700) by debbugs.gnu.org; 19 Mar 2018 12:59:25 +0000 Received: from localhost ([127.0.0.1]:40831 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1exuNo-0008Rg-K8 for submit@debbugs.gnu.org; Mon, 19 Mar 2018 08:59:24 -0400 Received: from mail-wm0-f43.google.com ([74.125.82.43]:52066) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1exuNl-0008RS-T0 for 30700@debbugs.gnu.org; Mon, 19 Mar 2018 08:59:22 -0400 Received: by mail-wm0-f43.google.com with SMTP id h21so14944940wmd.1 for <30700@debbugs.gnu.org>; Mon, 19 Mar 2018 05:59:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=cc8oqCSxA85k5wtvxoO3ZNU6V++tKC0UXY+3UXpI4sE=; b=i2neIiplDk4N2g8ZwXal1kLmOwsHC7nGsvZfNEzFkrIlGBhvzvZWpM/XnyltisEEls tWKvN1zfFqZ9OOpszFrVwCiLJIBI7aMDO2PcP2ir9BfVkZDnqXtKtE/orb5dt4QZo0kq mroUuBlBfNe12d5ZuQTBXtkGD0BFixXzxgdDpgBnM3OdkHNhC0tuzgZ2Ta3/aOg2Fc7G 5CNpqCilMOtvaQegj9bEtWsePDGwlc3I53Kmzy832uwpw+PLSXw5WwAAWaDDgzG+mJe0 vnZGl0z/e86EOIw9a7F35g6QnwuXZWDBN2SuuPvQPnskGkEN3C+zMmH3kKMQ2zp8Cv51 KDYA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=cc8oqCSxA85k5wtvxoO3ZNU6V++tKC0UXY+3UXpI4sE=; b=ZiBSjVmelYi1RrDDFh7VuTWh9CcC07AExQFhIH2fStJPGroiUzPSYQGKi6IwueW9Bn FUT/gJBhl1ctDB/hX5M4EZbF1QmuubG3i3jAUfBf5VHj2cAmsdL/IOzijPHm5U6Wlx7M tu4y8+khZEUj1fMOQy39etESitMn22m9Se4MN2j81x5xopVbIlQQ74Toa8yYWaUX0xUr o5bdiSzs+dJqxdyNVsIuDO19WdZUQ2wn3J3L3xVvS00tFjaJ2VRqrnx4GdbZcFSb39m8 lXZUagoVALDveQB4cNUutJCZoGvpwJvlAEIqxRdRmxNY4HhaGpnslqcC0DU/ZbwghTlw Q66g== X-Gm-Message-State: AElRT7FiInh6rNaJP9UWdNxbnjoY+aJwDc/fbly3jy43eDPttZNYDODy iE1fXwb9GRIZd+opM8+I/mQ= X-Google-Smtp-Source: AG47ELsrbfKyBDc+0AQCG0Dzq5nqfBvSjPZ8w+ryV32fGKR6mreBZHWDyFcHI6rSKztpzgjcAFWZ5g== X-Received: by 10.28.209.193 with SMTP id i184mr9181688wmg.100.1521464355920; Mon, 19 Mar 2018 05:59:15 -0700 (PDT) Received: from breton.holly.idiocy.org (ip6-2001-08b0-03f8-8129-c04a-d02f-79d4-a9c8.holly.idiocy.org. [2001:8b0:3f8:8129:c04a:d02f:79d4:a9c8]) by smtp.gmail.com with ESMTPSA id 1sm370005wmj.35.2018.03.19.05.59.15 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 19 Mar 2018 05:59:15 -0700 (PDT) Date: Mon, 19 Mar 2018 12:59:13 +0000 From: Alan Third Message-ID: <20180319125913.GA22163@breton.holly.idiocy.org> References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.9.3 (2018-01-21) X-Spam-Score: 0.5 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.5 (/) On Sun, Mar 04, 2018 at 08:05:02PM +0100, Philipp wrote: > > The following tests fail for me on macOS with a recent master build: > > network-stream-tests: > > Test echo-server-with-dns backtrace: > make-network-process(:name "server" :server t :noquery t :family ipv > make-server("p") > (let* ((server (make-server (system-name))) (port (aref (process-con > (closure (t) nil (let* ((server (make-server (system-name))) (port ( > ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test > ert-run-test(#s(ert-test :name echo-server-with-dns :documentation n > ert-run-or-rerun-test(#s(ert--stats :selector (not (or (tag :expensi > ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co > ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) > ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un > eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( > command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/network-stream-t > command-line() > normal-top-level() > Test echo-server-with-dns condition: > (error "p/0 nodename nor servname provided, or not known") > > The macOS firewall prevents creating the server here. Probably we > should just skip this test on macOS. Are you sure that’s what’s going on? The other server tests appear to work. I would expect this one to fail on my set up because the DNS entry for my computer only has an IPv6 address, but this test seems to rely on IPv4. > flymake-tests: > > 3 unexpected results: > FAILED included-c-header-files > FAILED warning-predicate-function-gcc > FAILED warning-predicate-rx-gcc > > These tests fail because they seem to invoke GCC, and on macOS GCC is > actually Clang, so the output format is different from what's expected. They work in an interactive emacs session. I just manually ran through the first one to see if there’s anything clearly different going on but it seems right. I don’t understand why they fail from ‘make check’. -- Alan Third From unknown Sat Aug 16 18:48:07 2025 X-Loop: help-debbugs@gnu.org Subject: bug#30700: 27.0.50; Broken tests on macOS Resent-From: Alan Third Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sun, 06 Jan 2019 22:41:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 30700 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Philipp Cc: 30700@debbugs.gnu.org Received: via spool by 30700-submit@debbugs.gnu.org id=B30700.15468144337544 (code B ref 30700); Sun, 06 Jan 2019 22:41:01 +0000 Received: (at 30700) by debbugs.gnu.org; 6 Jan 2019 22:40:33 +0000 Received: from localhost ([127.0.0.1]:47409 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ggH5s-0001xc-Sx for submit@debbugs.gnu.org; Sun, 06 Jan 2019 17:40:33 -0500 Received: from mail-wr1-f44.google.com ([209.85.221.44]:42129) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ggH5r-0001xQ-82 for 30700@debbugs.gnu.org; Sun, 06 Jan 2019 17:40:31 -0500 Received: by mail-wr1-f44.google.com with SMTP id q18so41389098wrx.9 for <30700@debbugs.gnu.org>; Sun, 06 Jan 2019 14:40:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20161025; h=sender:from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version:content-transfer-encoding; bh=PeWtdttefphoLfgyc26TzXInjcgo2OOzwjYo5afT6M0=; b=lnYJcHFS2c5UTuz82FFkC9BOdyLYvsl8krJrWSijoLMXs+OyP3yE7LMou4FP8uPO77 6NvbuVpMV064jrK6dlI+Jw+ltHV9F+3JQbQd8P6IiX1vH/B1CDIfY4JKaot5lyqElj/e S1jSMNnyx3jJSKnG08bAyqecCx5zjX20Vlv4pzxe2UODm2P8Xsp6+/9h96jolOAJ83r6 MoMmyyZZPlK1PTVgpMxBOCu99Un7ZKLW1haLpc8FE252+2ty4yTI2hi9KDYshrEruwlE emU6gSbc/pmbysW9JRq8lrBpAojcJpe7Z9d30uqr6c8uaRLyYgRlvjpe9iqvQphwZ8rm d/rA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:references:date :in-reply-to:message-id:user-agent:mime-version :content-transfer-encoding; bh=PeWtdttefphoLfgyc26TzXInjcgo2OOzwjYo5afT6M0=; b=SY+n7V7RdpDLBO1jsYye20jLO2LLtJ6k+lgIWPOIbWHo55s8lAU1cB6LX7RyfR3Xfj 7R2WH/eZburleYPRsuresZHewVKk8JDrbh22f6xLvejyGlvr0m9Vj0CDzUhqq5M9SAXn KV4BTAXaWY4d450QgVucjIHx1z3NSozCX9gMCh00NAYYf4rw5TWNjGcKCmzaKpOi8yHJ wtM/nDMnuvRjHtI9/fizT7Mjcgj5fl/skyMLpl0hBggPv0lf+yBt2+Id64b7xs01wFv2 trcy2T818iCa66NSPaTtDv8rrkVnhpjseS8JE+xQcLGOtrf5MGTlRRkCtUWhSOtSSQHl waYw== X-Gm-Message-State: AJcUukcVjnap+7a6wrJqOZ4k03dHeBmXZ0ir8+OINr3l5YGhcbr1JPV+ llHa7elmdjShkgFo9rbJIvbdxf5VCxw= X-Google-Smtp-Source: ALg8bN5+7dPC//yUSXvBP1FFlTO8Waxa4BpB8+5gJjqQJy6+Iri05VgpMtVXkZTZEeTjgVQTy3cDfg== X-Received: by 2002:adf:ef50:: with SMTP id c16mr49781985wrp.198.1546814425111; Sun, 06 Jan 2019 14:40:25 -0800 (PST) Received: from breton.holly.idiocy.org (ip6-2001-08b0-03f8-8129-1541-cca6-a016-9790.holly.idiocy.org. [2001:8b0:3f8:8129:1541:cca6:a016:9790]) by smtp.gmail.com with ESMTPSA id l19sm6325340wme.21.2019.01.06.14.40.23 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 06 Jan 2019 14:40:24 -0800 (PST) From: Alan Third References: <20180319125913.GA22163@breton.holly.idiocy.org> Date: Sun, 06 Jan 2019 22:40:17 +0000 In-Reply-To: <20180319125913.GA22163@breton.holly.idiocy.org> (Alan Third's message of "Mon, 19 Mar 2018 12:59:13 +0000") Message-ID: User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.0.50 (darwin) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Alan Third writes: > On Sun, Mar 04, 2018 at 08:05:02PM +0100, Philipp wrote: >>=20 >> The following tests fail for me on macOS with a recent master build: >>=20 >> network-stream-tests: >>=20 >> Test echo-server-with-dns backtrace: >> make-network-process(:name "server" :server t :noquery t :family ipv >> make-server("p") >> (let* ((server (make-server (system-name))) (port (aref (process-con >> (closure (t) nil (let* ((server (make-server (system-name))) (port ( >> ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test >> ert-run-test(#s(ert-test :name echo-server-with-dns :documentation n >> ert-run-or-rerun-test(#s(ert--stats :selector (not (or (tag :expensi >> ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co >> ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) >> ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un >> eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( >> command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/network-stream-t >> command-line() >> normal-top-level() >> Test echo-server-with-dns condition: >> (error "p/0 nodename nor servname provided, or not known") >>=20 >> The macOS firewall prevents creating the server here. Probably we >> should just skip this test on macOS. > > Are you sure that=E2=80=99s what=E2=80=99s going on? The other server tes= ts appear to > work. I would expect this one to fail on my set up because the DNS > entry for my computer only has an IPv6 address, but this test seems to > rely on IPv4. Looking further into this, if I change ":family" in make-server, either by removing it, or changing it to 'ipv6, I get the following: (file-error "make client process failed" "Connection refused" :name "foo" :buffer #> :host "breton.holly.idiocy.org" :service ...) which implies the server is being created, but then the client can't connect. Looking at netstat I can't see the port. Turning off the macOS firewall makes no difference to any tests. --=20 Alan Third From unknown Sat Aug 16 18:48:07 2025 X-Loop: help-debbugs@gnu.org Subject: bug#30700: 27.0.50; Broken tests on macOS Resent-From: Philipp Stephani Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Apr 2019 18:57:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 30700 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Alan Third Cc: 30700@debbugs.gnu.org Received: via spool by 30700-submit@debbugs.gnu.org id=B30700.155552738928329 (code B ref 30700); Wed, 17 Apr 2019 18:57:02 +0000 Received: (at 30700) by debbugs.gnu.org; 17 Apr 2019 18:56:29 +0000 Received: from localhost ([127.0.0.1]:40755 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hGpjR-0007Mr-7D for submit@debbugs.gnu.org; Wed, 17 Apr 2019 14:56:29 -0400 Received: from mail-ot1-f53.google.com ([209.85.210.53]:43294) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hGpjO-0007Mc-Ce for 30700@debbugs.gnu.org; Wed, 17 Apr 2019 14:56:27 -0400 Received: by mail-ot1-f53.google.com with SMTP id u15so21639072otq.10 for <30700@debbugs.gnu.org>; Wed, 17 Apr 2019 11:56:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=EoHsL2hX9mFhV8UiJmF4BdGfyo/Ym5twYQcNWB+ayC8=; b=QtV01vTO3hr8+7nurpqyfQTaKQXGAUbXsP7A+I5P/vzDdoh2sB+J2TUcrBhSnUSupx ZVneBvj4nnThuwVF4NTPr3sxrJKHscoUUfh24wWdctSF5k5JZZXuqhKXVvEx6VLDh2j7 GXNn1pQRlBuWvIRb4sy65eMMv5VLk54/7gtZG0WcltuW+Bb85uG1XezqwzTUfiJn0OZO Ln5xvRa/6BQUBhXzzhP48n5aW6gnJPMpF1lyBOmpK46Bzo9ooRBGXVAjKgPeOdb1GAIs Cy524mnSBj32izITbH2GguZpJeuv8RvNmByz/haV8nW+QJ8W0itMMoIGOGSa8Dbu5Ym1 sCMQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=EoHsL2hX9mFhV8UiJmF4BdGfyo/Ym5twYQcNWB+ayC8=; b=raXgD8I/q3COdiHr7Zmj1E7yTP+38SkIzYm9rb6G7pO+Np4ae8h7+XOfA1Z951ZVPB IFiuvGL+vh+7LaADV3zzG+jLgJ68m6ZAUOESJL1GM68D93G3KREY5WZH2mNkjupCAWSy sE4EoHkk6bW4N6rgpRhPpiRmExFzKvaeSzYuLnITPT8Ih62yJlessvOzcbN6x++K9a93 meE961cAeKiNoCXT6BbZyqGnhFG5fFmCYBMBzqjOleqQDJ+u/5OWw7VDBWiOYPNgy6aK 0arEQK9Y8qJNHhYkMRq0Gy0qrzufHV5DnLFbgPqmpeS/7JMzpybVoVC7jkBvwPtP8Sji qd/w== X-Gm-Message-State: APjAAAXRDWYzaC7RYNuJx4NS9oSsDXSSJwVZZMjVUKyf2FlpiKnr9PxW N++wiTx7Jdw0wOeNPsqiS6pJ1SG3cCnTTQVq9vo= X-Google-Smtp-Source: APXvYqyDt+T7CsaJO8ly0zXPZYDgMiqweVvJTlWt0uR2zikUGzTl62bCTM2dEMWHYXPU//gjBJEHdCCLajaXoAp/WvI= X-Received: by 2002:a9d:6a43:: with SMTP id h3mr58191417otn.270.1555527378583; Wed, 17 Apr 2019 11:56:18 -0700 (PDT) MIME-Version: 1.0 References: <20180319125913.GA22163@breton.holly.idiocy.org> In-Reply-To: From: Philipp Stephani Date: Wed, 17 Apr 2019 20:56:07 +0200 Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.3 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Am So., 6. Jan. 2019 um 23:40 Uhr schrieb Alan Third : > > Alan Third writes: > > > On Sun, Mar 04, 2018 at 08:05:02PM +0100, Philipp wrote: > >> > >> The following tests fail for me on macOS with a recent master build: > >> > >> network-stream-tests: > >> > >> Test echo-server-with-dns backtrace: > >> make-network-process(:name "server" :server t :noquery t :family ipv > >> make-server("p") > >> (let* ((server (make-server (system-name))) (port (aref (process-con > >> (closure (t) nil (let* ((server (make-server (system-name))) (port ( > >> ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test > >> ert-run-test(#s(ert-test :name echo-server-with-dns :documentation n > >> ert-run-or-rerun-test(#s(ert--stats :selector (not (or (tag :expensi > >> ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co > >> ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) > >> ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un > >> eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( > >> command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/network-stream-t > >> command-line() > >> normal-top-level() > >> Test echo-server-with-dns condition: > >> (error "p/0 nodename nor servname provided, or not known") > >> > >> The macOS firewall prevents creating the server here. Probably we > >> should just skip this test on macOS. > > > > Are you sure that=E2=80=99s what=E2=80=99s going on? The other server t= ests appear to > > work. I would expect this one to fail on my set up because the DNS > > entry for my computer only has an IPv6 address, but this test seems to > > rely on IPv4. > > Looking further into this, if I change ":family" in make-server, either > by removing it, or changing it to 'ipv6, I get the following: > > (file-error "make client process failed" "Connection refused" :name > "foo" :buffer #> :host "breton.holly.idiocy.org" > :service ...) > > which implies the server is being created, but then the client can't > connect. Looking at netstat I can't see the port. > > Turning off the macOS firewall makes no difference to any tests. The reason why I suspected the firewall is that I when running the tests I get a firewall warning whether I want to allow gnutls-serv to accept incoming requests. Does that warning not appear on your system? From unknown Sat Aug 16 18:48:07 2025 X-Loop: help-debbugs@gnu.org Subject: bug#30700: 27.0.50; Broken tests on macOS Resent-From: Philipp Stephani Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Apr 2019 19:26:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 30700 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: 30700@debbugs.gnu.org Received: via spool by 30700-submit@debbugs.gnu.org id=B30700.155552915731328 (code B ref 30700); Wed, 17 Apr 2019 19:26:01 +0000 Received: (at 30700) by debbugs.gnu.org; 17 Apr 2019 19:25:57 +0000 Received: from localhost ([127.0.0.1]:40772 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hGqBw-00089E-Tq for submit@debbugs.gnu.org; Wed, 17 Apr 2019 15:25:57 -0400 Received: from mail-oi1-f172.google.com ([209.85.167.172]:34013) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1hGqBv-000890-Hj for 30700@debbugs.gnu.org; Wed, 17 Apr 2019 15:25:56 -0400 Received: by mail-oi1-f172.google.com with SMTP id v10so20995266oib.1 for <30700@debbugs.gnu.org>; Wed, 17 Apr 2019 12:25:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=RSP5cPAmSyaESKcx9qHBu8th7ifERLSlvCzaTvJvl3E=; b=dTT+UMSx0cTBivPHQ1LhZZMT4UDkd3JE6x3/16XKrQyPieErMBSSEI6edK6o/RuiF3 ifaEplrRZMixOuwNhlOSZoBS7i9cTwPmTEb9gTlPfuKVwvJh51ukJEEOJ2wCWGreUbIT FSmc6j8hYaLuD7wq76ZeN//WWuUVrtRKpSwa+jW3/W5tFZc45rg0emVzoitDbtpNaOyw 5j8GmgoA9/3fnsSZowOlJi6LPvOaiAqBo9fMVvGdBArvTzukLTSvi+S0SGwbslbPK1OM +kLcCTctlNdYPMx6Lgt+rkFwmPM8xXACW3kS+OA5L9BBNvzCAWiSThLIG70l1NAy0X0x 4uCg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=RSP5cPAmSyaESKcx9qHBu8th7ifERLSlvCzaTvJvl3E=; b=QtouTY1B/tfVXbne9CIA+e0oFCUieYxUQ+0iXIj8KX7Tr3So+oJr6PcK2zqIvEl1kh 3z9wKjMBEd4kjjkUgqViIkA7W5t44mfy2/MkzHcYTDqKxho8IU2jmnkrF/wsRPccmuNV JykH9kcpTzcvfQ0BJVQsP6FKKI9Z+XXpuR7s27SlH2yKszP4Fy0W19p1RQdCQ6yE6Y4r WV0c39lZtQxbhWdEZ7ksMUhFl807nGkFmY6FyNOSlg528Vls6JtXB857tAwg0EPSIIRJ LTOUYSi2dh2vEvXBfDJ3PqcjkpxJxg31rcLF9YAKhG54vujpE40KhC7Ybc4ZskZep5AD 9tIA== X-Gm-Message-State: APjAAAWxPhgTcKmwsclWCr1IoO+ccnSwWIAfdWRL33EgWpOJO7bRkNbv w/Lc8+gth4PxqOc1tIB8u9Ib6pxpWqytf0l///bPMKqo X-Google-Smtp-Source: APXvYqw1eUlIn5sQLBCqA8jFqdzx6WBbeQzHSN1+3K5dUhgkVAZD/q8azdNYkhTI3RefLfRmVWeM2w6GinFhRTgNibU= X-Received: by 2002:aca:47d7:: with SMTP id u206mr173696oia.9.1555529148905; Wed, 17 Apr 2019 12:25:48 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Philipp Stephani Date: Wed, 17 Apr 2019 21:25:37 +0200 Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.2 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.8 (/) Am So., 4. M=C3=A4rz 2018 um 20:06 Uhr schrieb Philipp : > > > The following tests fail for me on macOS with a recent master build: An update: I've run the testsuite again. The errors I got this time are: Test tramp-test19-directory-files-and-attributes backtrace: signal(ert-test-failed (((should (tramp--test-file-attributes-equal- ert-fail(((should (tramp--test-file-attributes-equal-p (file-attribu #f(compiled-function () #)() ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name tramp-test19-directory-files-and-attr ert-run-or-rerun-test(#s(ert--stats :selector (not ...) :tests [... ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/tramp-tests" "-- command-line() normal-top-level() Test tramp-test19-directory-files-and-attributes condition: (ert-test-failed ((should (tramp--test-file-attributes-equal-p (file-attributes ...) (cdr elt))) :form (tramp--test-file-attributes-equal-p (t 5 501 20 (0 0 0 1000) (23735 29792) (23735 29792) 160 "drwxr-xr-x" nil ...) (t 5 501 20 (0 0 0 1000) (23735 29792) (23735 29792) 160 "drwxr-xr-x" nil ...)) :value nil)) FAILED 25/46 tramp-test19-directory-files-and-attributes (1.931638 sec= ) When using the explainer for equal, I get (list-elt 10 (different-types 8887934387 (4547 . 7603))) i.e. the inode numbers are different. I also don't understand why it used the dotted format for the RHS; with big integers this should never be necessary. Test tramp-test22-file-times backtrace: signal(ert-test-failed (((should (equal (nth 5 (file-attributes tmp- ert-fail(((should (equal (nth 5 (file-attributes tmp-name1)) (second #f(compiled-function () #)() ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name tramp-test22-file-times :documentatio ert-run-or-rerun-test(#s(ert--stats :selector (not ...) :tests [... ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/tramp-tests" "-- command-line() normal-top-level() Test tramp-test22-file-times condition: (ert-test-failed ((should (equal (nth 5 ...) (seconds-to-time 1))) :form (equal (0 1) (0 1 0 0)) :value nil :explanation (proper-lists-of-different-length 2 4 (0 1) (0 1 0 0) first-mismatch-at 2))) FAILED 28/46 tramp-test22-file-times (2.090504 sec) These are two different representations of the same time. Probably something should normalize the return values to the canonical format. Test echo-server-with-dns backtrace: make-network-process(:name "server" :server t :noquery t :family ipv make-server("p") #f(compiled-function () #)() ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name echo-server-with-dns :documentation n ert-run-or-rerun-test(#s(ert--stats :selector (not ...) :tests [... ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/network-stream-t command-line() normal-top-level() Test echo-server-with-dns condition: (error "p/0 nodename nor servname provided, or not known") FAILED 5/24 echo-server-with-dns (0.003934 sec) Same as before. Test shadow-test08-shadow-todo backtrace: signal(ert-test-failed (((should (member (cons file (shadow-contract ert-fail(((should (member (cons file (shadow-contract-file-name (con #f(compiled-function () #)() ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name shadow-test08-shadow-todo :documentat ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ...)) :te ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/shadowfile-tests" "- command-line() normal-top-level() Test shadow-test08-shadow-todo condition: (ert-test-failed ((should (member (cons file ...) shadow-files-to-copy)) :form (member ("/var/folders/ks/sxl3n3w51td0ry21j3tjs1wh0000gn/T/shadowfile-testso= znrLv" . "/cluster2:/var/folders/ks/sxl3n3w51td0ry21j3tjs1wh0000gn/T/shadowfile-te= stsoznrLv") nil) :value nil)) FAILED 9/10 shadow-test08-shadow-todo (0.170742 sec) Test shadow-test09-shadow-copy-files backtrace: signal(ert-test-failed (((should (looking-at (regexp-quote "(setq sh ert-fail(((should (looking-at (regexp-quote "(setq shadow-files-to-c #f(compiled-function () #)() ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name shadow-test09-shadow-copy-files :docu ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ...)) :te ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/shadowfile-tests" "- command-line() normal-top-level() Test shadow-test09-shadow-copy-files condition: (ert-test-failed ((should (looking-at (regexp-quote "(setq shadow-files-to-copy nil)"))) :form (looking-at "(setq shadow-files-to-copy nil)") :value nil)) FAILED 10/10 shadow-test09-shadow-copy-files (2.697340 sec) I don't understand these yet. That is, some tests are fixed, but there are also a few new failures. From unknown Sat Aug 16 18:48:07 2025 X-Loop: help-debbugs@gnu.org Subject: bug#30700: 27.0.50; Broken tests on macOS References: In-Reply-To: Resent-From: Stefan Kangas Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 09 Oct 2019 14:14:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 30700 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Philipp Stephani Cc: 30700@debbugs.gnu.org Received: via spool by 30700-submit@debbugs.gnu.org id=B30700.157063042525621 (code B ref 30700); Wed, 09 Oct 2019 14:14:02 +0000 Received: (at 30700) by debbugs.gnu.org; 9 Oct 2019 14:13:45 +0000 Received: from localhost ([127.0.0.1]:53795 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iICim-0006fA-J7 for submit@debbugs.gnu.org; Wed, 09 Oct 2019 10:13:45 -0400 Received: from mail-pf1-f171.google.com ([209.85.210.171]:43666) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iICik-0006ex-Ae for 30700@debbugs.gnu.org; Wed, 09 Oct 2019 10:13:42 -0400 Received: by mail-pf1-f171.google.com with SMTP id a2so1704143pfo.10 for <30700@debbugs.gnu.org>; Wed, 09 Oct 2019 07:13:42 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=dnFGW1yICzmD1W3TSb6vRjxT6eMX9lk9PrTjsXV7iUM=; b=taM4P9wEqLc6K5BYGWLTjSX8xtVZUdt914VljE8eUHbi5M01Pjt8/D0w+ktwP2VZYn /KJMb03d8mYPTrLvOxY6o7FTlI4BphxBlHRM1WfkaqutN0dwTYT3nfefh9X1r+OmDFtz QQYixcUHtNw7QPh3L0PSSp63i3alXMA8sVgjsVEjsWqeXteKHibsRqSvc9DEPXD4cdJ/ mhrF8h9KHMm6IsXRxmwguvjYsLdAGgpNguKHgzP7n13moXUxc8htOQhvTariYrpuQa/V lX9ewciqV85JzRreyjy829GzorTFzJbdgO8UxvlqP3p1nlDS5Tra1WRMGguFD9xv7UdB eBwQ== X-Gm-Message-State: APjAAAWOyf7VVsJrBHv7wfSR5RVmw/QfY8SV3kVR1Goj832dbm72ryvD na4cj2JLsKkRsARlExmrPINAPexmduYaggIEVGw= X-Google-Smtp-Source: APXvYqzulBfz4FyAcAEmenYlVAurXySuJCTn0X0vqRBgIxpo7PSgJUBGowoHH9vPOo5PN+pk9Ego5pI3nkFytkqa0Tw= X-Received: by 2002:a62:8305:: with SMTP id h5mr3938217pfe.190.1570630416449; Wed, 09 Oct 2019 07:13:36 -0700 (PDT) MIME-Version: 1.0 From: Stefan Kangas Date: Wed, 9 Oct 2019 16:13:25 +0200 Message-ID: Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.2 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.8 (/) Philipp Stephani writes: >> The following tests fail for me on macOS with a recent master build: > > An update: I've run the testsuite again. The errors I got this time are: > FAILED 25/46 tramp-test19-directory-files-and-attributes (1.931638 sec) > FAILED 28/46 tramp-test22-file-times (2.090504 sec) > These are two different representations of the same time. Probably > something should normalize the return values to the canonical format. These do not fail for me after the fixes applied for Bug#36940. > FAILED 5/24 echo-server-with-dns (0.003934 sec) > > Same as before. I'm not seeing this failure. > FAILED 9/10 shadow-test08-shadow-todo (0.170742 sec) > FAILED 10/10 shadow-test09-shadow-copy-files (2.697340 sec) > > I don't understand these yet. These no longer fails for me after the fixes applied for Bug#37202. --- As a general suggestion, perhaps it's easier if we can track the failures in one bug per package and platform, instead of having them all per platform. That way, I believe that they will be more visible to the relevant maintainers in the bug tracker, and it will be easier to find out what is still failing without having to sift through a mass of information regarding separate issues. (Compare the response Bug#37202 got with the one you received here for one data point.) If you agree with the above, could I suggest that we close this bug report, since most issues are fixed, and that if you are still seeing the echo-server-with-dns test failure, that you open a new one specifically for that? Best regards, Stefan Kangas From unknown Sat Aug 16 18:48:07 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: Philipp Subject: bug#30700: closed (Re: bug#30700: 27.0.50; Broken tests on macOS) Message-ID: References: <87ftivrxgv.fsf@marxist.se> X-Gnu-PR-Message: they-closed 30700 X-Gnu-PR-Package: emacs Reply-To: 30700@debbugs.gnu.org Date: Mon, 11 Nov 2019 01:53:02 +0000 Content-Type: multipart/mixed; boundary="----------=_1573437182-16200-1" This is a multi-part message in MIME format... ------------=_1573437182-16200-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #30700: 27.0.50; Broken tests on macOS which was filed against the emacs package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 30700@debbugs.gnu.org. --=20 30700: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D30700 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1573437182-16200-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 30700-done) by debbugs.gnu.org; 11 Nov 2019 01:52:26 +0000 Received: from localhost ([127.0.0.1]:52892 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iTysT-0004CT-TW for submit@debbugs.gnu.org; Sun, 10 Nov 2019 20:52:26 -0500 Received: from host.gofardesign.uk ([208.79.239.190]:48656) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1iTysT-0004CI-57 for 30700-done@debbugs.gnu.org; Sun, 10 Nov 2019 20:52:25 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=marxist.se; s=default; h=Content-Type:MIME-Version:Message-ID:Date:References: In-Reply-To:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=5zOrCdwjUl3H+fPj1QCZHMzTuewQeVjE1nOCAJu9pdU=; b=kUql6boEfWsmE7dh7kWbjFYtML utK7gASvpaNJWYEK8pAh6VcwqHoACdAK4516om93UBXUccFLXA2nHI9QB0GHHDoRRk2m9JNurJU0j n/YlI/zDjcXFglK3sNW8klHgUAIeOgV2e6poPs4ry/KD5ILnRsf+DZp+w3VefNPvNSfQ=; Received: from h-70-69.a785.priv.bahnhof.se ([155.4.70.69]:51036 helo=localhost) by host.gofardesign.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.92) (envelope-from ) id 1iTysN-0005hz-5s; Sun, 10 Nov 2019 19:52:19 -0600 From: Stefan Kangas To: Philipp Stephani Subject: Re: bug#30700: 27.0.50; Broken tests on macOS In-Reply-To: (Stefan Kangas's message of "Wed, 9 Oct 2019 16:13:25 +0200") References: User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.0.50 (gnu/linux) Date: Mon, 11 Nov 2019 02:52:16 +0100 Message-ID: <87ftivrxgv.fsf@marxist.se> MIME-Version: 1.0 Content-Type: text/plain X-OutGoing-Spam-Status: No, score=-1.0 X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - host.gofardesign.uk X-AntiAbuse: Original Domain - debbugs.gnu.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - marxist.se X-Get-Message-Sender-Via: host.gofardesign.uk: authenticated_id: stefan@marxist.se X-Authenticated-Sender: host.gofardesign.uk: stefan@marxist.se X-Source: X-Source-Args: X-Source-Dir: X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 30700-done Cc: 30700-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Stefan Kangas writes: > If you agree with the above, could I suggest that we close this bug > report, since most issues are fixed, and that if you are still seeing > the echo-server-with-dns test failure, that you open a new one > specifically for that? No objections within 4 weeks, so I'm now closing this bug report. If you are still seeing any failures for which there are not already open bugs, please open individual bug reports for each issue. Thanks in advance. Best regards, Stefan Kangas ------------=_1573437182-16200-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 4 Mar 2018 19:05:17 +0000 Received: from localhost ([127.0.0.1]:44678 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1esYwe-00047i-Qn for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:17 -0500 Received: from eggs.gnu.org ([208.118.235.92]:49709) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1esYwd-00047U-Py for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:16 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1esYwX-0002Gx-AB for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:10 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: * X-Spam-Status: No, score=1.1 required=5.0 tests=BAYES_50, FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,T_DKIM_INVALID autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:54236) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1esYwX-0002Gr-69 for submit@debbugs.gnu.org; Sun, 04 Mar 2018 14:05:09 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:40679) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1esYwV-0003Rh-M1 for bug-gnu-emacs@gnu.org; Sun, 04 Mar 2018 14:05:09 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1esYwU-0002GD-4n for bug-gnu-emacs@gnu.org; Sun, 04 Mar 2018 14:05:07 -0500 Received: from mail-wm0-x22b.google.com ([2a00:1450:400c:c09::22b]:55842) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1esYwT-0002G2-Rs for bug-gnu-emacs@gnu.org; Sun, 04 Mar 2018 14:05:06 -0500 Received: by mail-wm0-x22b.google.com with SMTP id q83so11907006wme.5 for ; Sun, 04 Mar 2018 11:05:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id:mime-version; bh=VEvWsuitUDj+1UU8OFflwInrm2q/zfoHBaFTqV9JILA=; b=Fh2/2mFofHbOP3LwoSq0YwRDKjxPTSHeUg41hlu/mGO3HZ/8AkVfj5PBcz3DihMmHO eImYIW9Vwbf/42SJNQryXzOUKk3IYxIkzDemlL3U5RhA8tGIEVzzjtFmjR7WLYJG7Dw6 VVBy566QXQG1wkZ9BFBhMi1T9LbwxlEQ1uXuExAxmH7i+xGx+SbC8jHIUmKyQHs7oell cqURqdHVrFKAk90JalZyTXPobmb80eoFeprHiOsf4L+BoP736xqTIyWG4NilROw8Jtwi aWvZGSD42QigLshtnbz5th3eozDF5yfeevRKRvVULsVHrhemnHlVXNsYae2RUlR0xS9c xKWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version; bh=VEvWsuitUDj+1UU8OFflwInrm2q/zfoHBaFTqV9JILA=; b=UjYhLwVbgit0UrADG5rpEpG0z4sgBamJwGcI0/TTG/dqj4beobCvy7h9q4Mq0leGEj e8rRcBvae9LporeU9M1LwIkkY7SyL4p8AUXYdgg326w2xuoc10613qMHc+KW288d2Foa giBRAwnGquU6hu+JlLl9xd4AsOiksjvIj/8LJYxXdFCTxR63woQi8l2LKiq0jhXWzFtX 4EKcNlghQajpLojjqxhAQY94VbAuoZOAhjsuLo6v7AwyncNa6iqYsH9+b4CRwH4Mx/L4 SX/jt+IvtR85DsaU/VTmUT7VCZZQHLKwFvfuyJuxS+g2EKwjSj6rmGoZD37Ziqziy8DZ ataw== X-Gm-Message-State: AElRT7HeyPkditej3Vg1rQ1dAL4seYov3wdIHj/LYmO/m0yAy1F2XdZI hdiT1YmJYutvOsvLUiW5BvED+NrP X-Google-Smtp-Source: AG47ELvttR4bEEA6UfAhQRR3FWfkA9N7hCiNJsoUeQN/qEOFBzojeKlCqkAEqmSAm7H2ZdENERNxaQ== X-Received: by 10.28.71.83 with SMTP id u80mr6732072wma.24.1520190304041; Sun, 04 Mar 2018 11:05:04 -0800 (PST) Received: from p ([2001:4c50:25a:2900:44ef:cbd1:2898:4675]) by smtp.gmail.com with ESMTPSA id y28sm10799656wrd.46.2018.03.04.11.05.02 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 04 Mar 2018 11:05:03 -0800 (PST) From: Philipp To: bug-gnu-emacs@gnu.org Subject: 27.0.50; Broken tests on macOS Date: Sun, 04 Mar 2018 20:05:02 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -3.8 (---) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.8 (---) The following tests fail for me on macOS with a recent master build: network-stream-tests: Test echo-server-with-dns backtrace: make-network-process(:name "server" :server t :noquery t :family ipv make-server("p") (let* ((server (make-server (system-name))) (port (aref (process-con (closure (t) nil (let* ((server (make-server (system-name))) (port ( ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name echo-server-with-dns :documentation n ert-run-or-rerun-test(#s(ert--stats :selector (not (or (tag :expensi ert-run-tests((not (or (tag :expensive-test) (tag :unstable))) #f(co ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable))) ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/net/network-stream-t command-line() normal-top-level() Test echo-server-with-dns condition: (error "p/0 nodename nor servname provided, or not known") The macOS firewall prevents creating the server here. Probably we should just skip this test on macOS. flymake-tests: 3 unexpected results: FAILED included-c-header-files FAILED warning-predicate-function-gcc FAILED warning-predicate-rx-gcc These tests fail because they seem to invoke GCC, and on macOS GCC is actually Clang, so the output format is different from what's expected. I'd suggest two fixes: 1. Instead of invoking GCC, save GCC's output once in a checked-in file. That makes the test more robust and reproducible because it no longer depends on the behavior of external programs. 2. Make Flymake work with the Clang output, i.e. remove the hard dependency on GCC. In GNU Emacs 27.0.50 (build 57, x86_64-apple-darwin17.4.0, NS appkit-1561.20 Version 10.13.3 (Build 17D102)) of 2018-03-02 built on p Repository revision: e58f9a45d6a31be4ca379e10a866766e0993f49e Windowing system distributor 'Apple', version 10.3.1561 System Description: Mac OS X 10.13.3 Recent messages: For information about GNU Emacs and the GNU system, type C-h C-a. Configured using: 'configure --with-modules --without-pop --with-mailutils --enable-gcc-warnings=yes --enable-checking --enable-check-lisp-object-type 'CFLAGS=-ggdb3 -O0'' Configured features: NOTIFY ACL GNUTLS LIBXML2 ZLIB TOOLKIT_SCROLL_BARS NS MODULES THREADS JSON Important settings: value of $LANG: de_DE.UTF-8 locale-coding-system: utf-8-unix Major mode: Lisp Interaction Minor modes in effect: tooltip-mode: t global-eldoc-mode: t eldoc-mode: t electric-indent-mode: t mouse-wheel-mode: t tool-bar-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t blink-cursor-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t line-number-mode: t transient-mark-mode: t Load-path shadows: None found. Features: (shadow sort mail-extr emacsbug message rmc puny seq byte-opt gv bytecomp byte-compile cconv cl-loaddefs cl-lib dired dired-loaddefs format-spec rfc822 mml easymenu mml-sec password-cache epa derived epg epg-config gnus-util rmail rmail-loaddefs mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils elec-pair time-date tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/ns-win ns-win ucs-normalize mule-util term/common-win tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode lisp-mode prog-mode register page menu-bar rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core term/tty-colors frame cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray minibuffer cl-preloaded nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote kqueue cocoa ns multi-tty make-network-process emacs) Memory information: ((conses 16 204785 6390) (symbols 48 20096 1) (miscs 40 56 156) (strings 32 28897 1948) (string-bytes 1 771870) (vectors 16 35249) (vector-slots 8 722256 13436) (floats 8 52 64) (intervals 56 211 0) (buffers 992 11)) ------------=_1573437182-16200-1--