From unknown Fri Aug 15 15:36:49 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#15991 <15991@debbugs.gnu.org> To: bug#15991 <15991@debbugs.gnu.org> Subject: Status: 24.3.50; Wishlist: Make test suite user-friendlier Reply-To: bug#15991 <15991@debbugs.gnu.org> Date: Fri, 15 Aug 2025 22:36:49 +0000 retitle 15991 24.3.50; Wishlist: Make test suite user-friendlier reassign 15991 emacs submitter 15991 Eli Zaretskii severity 15991 wishlist thanks From debbugs-submit-bounces@debbugs.gnu.org Thu Nov 28 15:05:17 2013 Received: (at submit) by debbugs.gnu.org; 28 Nov 2013 20:05:17 +0000 Received: from localhost ([127.0.0.1]:49193 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Vm7pt-0002iH-7A for submit@debbugs.gnu.org; Thu, 28 Nov 2013 15:05:17 -0500 Received: from eggs.gnu.org ([208.118.235.92]:34146) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Vm7pq-0002i1-Ob for submit@debbugs.gnu.org; Thu, 28 Nov 2013 15:05:15 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Vm7pc-0004LO-1V for submit@debbugs.gnu.org; Thu, 28 Nov 2013 15:05:09 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:36316) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Vm7pb-0004LK-VA for submit@debbugs.gnu.org; Thu, 28 Nov 2013 15:04:59 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:35843) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Vm7pU-0005Dh-Jj for bug-gnu-emacs@gnu.org; Thu, 28 Nov 2013 15:04:59 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Vm7pK-0004K8-Dx for bug-gnu-emacs@gnu.org; Thu, 28 Nov 2013 15:04:52 -0500 Received: from mtaout23.012.net.il ([80.179.55.175]:60264) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Vm7pK-0004K2-5Y for bug-gnu-emacs@gnu.org; Thu, 28 Nov 2013 15:04:42 -0500 Received: from conversion-daemon.a-mtaout23.012.net.il by a-mtaout23.012.net.il (HyperSendmail v2007.08) id <0MWZ00600P0LJ000@a-mtaout23.012.net.il> for bug-gnu-emacs@gnu.org; Thu, 28 Nov 2013 22:04:40 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout23.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0MWZ006WTP3QHC40@a-mtaout23.012.net.il> for bug-gnu-emacs@gnu.org; Thu, 28 Nov 2013 22:04:40 +0200 (IST) Date: Thu, 28 Nov 2013 22:04:26 +0200 From: Eli Zaretskii Subject: 24.3.50; Wishlist: Make test suite user-friendlier X-012-Sender: halo1@inter.net.il To: bug-gnu-emacs@gnu.org Message-id: <83pppk8f91.fsf@gnu.org> X-detected-operating-system: by eggs.gnu.org: Solaris 10 X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Eli Zaretskii List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) This is a wishlist feature request: make the test suite easier to use when some tests fail, and there's a need to investigate why and debug them. When you see any failures, the first thing you want to do is run only one test that failed at a time. But there's no way to do that, so it seems, except by copying a (quite complex) command line from the Makefile, while manually expanding every variable that's involved in that. Also, suppose one needs to run Emacs under a debugger for running a test -- there doesn't seem to be a convenient way of doing that, either. Once again, start Emacs manually in GDB, then copy/paste the command line there, and be sure to set the environment variables, like EMACS_TEST_DIRECTORY before starting GDB. Wait, and what if the test forks, and you need to attach GDB to the correct Emacs process? Another possible improvement would be for each test to automatically save the log of its run, including any error messages, to a file. As things are now, one needs to do that manually as well, using shell magic and/or 'tee', as the full log is extremely voluminous. I wish all this could be easier, and I wish there would be a README in that directory with instructions of how to do all that. A good example of both the facilities and their README documentation can be found in the Cairo distribution (look in the test/ subdirectory). Thanks in advance. In GNU Emacs 24.3.50.81 (i686-pc-mingw32) of 2013-11-28 on HOME-C4E4A596F7 Bzr revision: 115269 eliz@gnu.org-20131128194015-2eu4ceuanrqt0qwr Windowing system distributor `Microsoft Corp.', version 5.1.2600 Configured using: `configure --prefix=/d/usr --enable-checking=yes,glyphs 'CFLAGS=-O0 -gdwarf-2 -g3'' Important settings: value of $LANG: ENU locale-coding-system: cp1255 default enable-multibyte-characters: t Major mode: Lisp Interaction Minor modes in effect: tooltip-mode: t mouse-wheel-mode: t tool-bar-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t blink-cursor-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t line-number-mode: t transient-mark-mode: t Recent input: M-x r e p o r t - e m Recent messages: For information about GNU Emacs and the GNU system, type C-h C-a. Load-path shadows: None found. Features: (shadow sort gnus-util mail-extr emacsbug message format-spec rfc822 mml easymenu mml-sec mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils time-date tooltip ediff-hook vc-hooks lisp-float-type mwheel dos-w32 ls-lisp w32-common-fns disp-table w32-win w32-vars tool-bar dnd fontset image regexp-opt fringe tabulated-list newcomment lisp-mode prog-mode register page menu-bar rfn-eshadow timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core frame cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese case-table epa-hook jka-cmpr-hook help simple abbrev minibuffer nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote make-network-process w32notify w32 multi-tty emacs) From debbugs-submit-bounces@debbugs.gnu.org Thu Nov 28 15:13:36 2013 Received: (at 15991) by debbugs.gnu.org; 28 Nov 2013 20:13:36 +0000 Received: from localhost ([127.0.0.1]:49199 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Vm7xw-0002v3-GZ for submit@debbugs.gnu.org; Thu, 28 Nov 2013 15:13:36 -0500 Received: from fencepost.gnu.org ([208.118.235.10]:43960 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Vm7xt-0002uv-Q0 for 15991@debbugs.gnu.org; Thu, 28 Nov 2013 15:13:34 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1Vm7xr-0007WH-Qb; Thu, 28 Nov 2013 15:13:31 -0500 From: Glenn Morris To: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> X-Spook: Merlin data haven Sundevil Capricorn Axis of Evil INS X-Ran: yIsq~->|Q=.lOlU4>*]<_PG,cvf#/Wj5G;:c!waAL8{I*ok|D9oW09S7q4hy^fp]|rr^zt X-Hue: red X-Debbugs-No-Ack: yes X-Attribution: GM Date: Thu, 28 Nov 2013 15:13:31 -0500 In-Reply-To: <83pppk8f91.fsf@gnu.org> (Eli Zaretskii's message of "Thu, 28 Nov 2013 22:04:26 +0200") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) There was a patch for some of this (eg running one test). http://lists.gnu.org/archive/html/emacs-devel/2013-08/msg00339.html (It feels to me like one of things that will never get installed...) From debbugs-submit-bounces@debbugs.gnu.org Thu Nov 28 17:32:13 2013 Received: (at 15991) by debbugs.gnu.org; 28 Nov 2013 22:32:13 +0000 Received: from localhost ([127.0.0.1]:49306 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1VmA85-0006Yk-9X for submit@debbugs.gnu.org; Thu, 28 Nov 2013 17:32:13 -0500 Received: from ironport2-out.teksavvy.com ([206.248.154.181]:29959) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1VmA82-0006YV-VM for 15991@debbugs.gnu.org; Thu, 28 Nov 2013 17:32:11 -0500 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Av8EABK/CFHO+KEh/2dsb2JhbABEvw4Xc4IeAQEBAQIBAQJTIwULCw4mEhQUBA0kiB4GDMEhkQoDiGGKfoNKjVGBXoMV X-IPAS-Result: Av8EABK/CFHO+KEh/2dsb2JhbABEvw4Xc4IeAQEBAQIBAQJTIwULCw4mEhQUBA0kiB4GDMEhkQoDiGGKfoNKjVGBXoMV X-IronPort-AV: E=Sophos;i="4.84,565,1355115600"; d="scan'208";a="40642231" Received: from 206-248-161-33.dsl.teksavvy.com (HELO pastel.home) ([206.248.161.33]) by ironport2-out.teksavvy.com with ESMTP/TLS/ADH-AES256-SHA; 28 Nov 2013 17:32:04 -0500 Received: by pastel.home (Postfix, from userid 20848) id B60BE604BC; Thu, 28 Nov 2013 17:32:04 -0500 (EST) From: Stefan Monnier To: Glenn Morris Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier Message-ID: References: <83pppk8f91.fsf@gnu.org> Date: Thu, 28 Nov 2013 17:32:04 -0500 In-Reply-To: (Glenn Morris's message of "Thu, 28 Nov 2013 15:13:31 -0500") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.3.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.3 (/) X-Debbugs-Envelope-To: 15991 Cc: Eli Zaretskii , 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.3 (/) > There was a patch for some of this (eg running one test). > http://lists.gnu.org/archive/html/emacs-devel/2013-08/msg00339.html Don't know it hasn't been installed yet, indeed, Stefan From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 02:05:57 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 06:05:58 +0000 Received: from localhost ([127.0.0.1]:32869 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X02on-0002WD-4g for submit@debbugs.gnu.org; Thu, 26 Jun 2014 02:05:57 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:43795 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X02ok-0002W1-TM for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 02:05:55 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X02ok-0003pr-1y; Thu, 26 Jun 2014 02:05:54 -0400 From: Glenn Morris To: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> X-Spook: asset PET ASDIC munitions SSL Mafia mania FSF X-Ran: U2tC>NVd$TOIm4k*Od+_v9d7$[CN1nd>4Y,gHP~tSWV*hcqa%ET3/+L3Qvopy(Vr&kEWbb X-Hue: cyan X-Attribution: GM Date: Thu, 26 Jun 2014 02:05:53 -0400 In-Reply-To: <83pppk8f91.fsf@gnu.org> (Eli Zaretskii's message of "Thu, 28 Nov 2013 22:04:26 +0200") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -4.3 (----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -4.3 (----) Eli Zaretskii wrote: > When you see any failures, the first thing you want to do is run only > one test that failed at a time. [...] > Another possible improvement would be for each test to automatically > save the log of its run, including any error messages, to a file. Now you can run `make foo.log' to run the foo.el tests. > Also, suppose one needs to run Emacs under a debugger for running a > test -- there doesn't seem to be a convenient way of doing that, > either. Once again, start Emacs manually in GDB, then copy/paste the > command line there, and be sure to set the environment variables, like > EMACS_TEST_DIRECTORY before starting GDB. Wait, and what if the test > forks, and you need to attach GDB to the correct Emacs process? Haven't done anything about this. From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 11:09:21 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 15:09:21 +0000 Received: from localhost ([127.0.0.1]:33832 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0BIa-0005ur-3Q for submit@debbugs.gnu.org; Thu, 26 Jun 2014 11:09:21 -0400 Received: from mtaout21.012.net.il ([80.179.55.169]:54192) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0BIT-0005uH-Ad for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 11:09:14 -0400 Received: from conversion-daemon.a-mtaout21.012.net.il by a-mtaout21.012.net.il (HyperSendmail v2007.08) id <0N7S00F00713WG00@a-mtaout21.012.net.il> for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 18:09:03 +0300 (IDT) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout21.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0N7S00FT67F2RY70@a-mtaout21.012.net.il>; Thu, 26 Jun 2014 18:09:02 +0300 (IDT) Date: Thu, 26 Jun 2014 18:08:47 +0300 From: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier In-reply-to: X-012-Sender: halo1@inter.net.il To: Glenn Morris Message-id: <83fvirpv28.fsf@gnu.org> References: <83pppk8f91.fsf@gnu.org> X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Eli Zaretskii List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Glenn Morris > Cc: 15991@debbugs.gnu.org > Date: Thu, 26 Jun 2014 02:05:53 -0400 > > Eli Zaretskii wrote: > > > When you see any failures, the first thing you want to do is run only > > one test that failed at a time. > [...] > > Another possible improvement would be for each test to automatically > > save the log of its run, including any error messages, to a file. > > Now you can run `make foo.log' to run the foo.el tests. Thank you. Perhaps this should be mentioned in some README. From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 11:21:06 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 15:21:06 +0000 Received: from localhost ([127.0.0.1]:33838 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0BTx-0006J1-8R for submit@debbugs.gnu.org; Thu, 26 Jun 2014 11:21:06 -0400 Received: from mout.gmx.net ([212.227.15.15]:63738) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0BTq-0006IW-LE for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 11:20:59 -0400 Received: from detlef.gmx.de ([87.146.53.246]) by mail.gmx.com (mrgmx002) with ESMTPSA (Nemesis) id 0M8edX-1Wnzx23VpL-00wFri; Thu, 26 Jun 2014 17:20:44 +0200 From: Michael Albinus To: Glenn Morris Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> Date: Thu, 26 Jun 2014 17:20:37 +0200 In-Reply-To: (Glenn Morris's message of "Thu, 26 Jun 2014 02:05:53 -0400") Message-ID: <87lhsjvgsa.fsf@gmx.de> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K0:VTic3pO6FxCEQDMjxjgJ7XrjviWESj0JxdnAkZIPoT7T7hUzaWE 1JKyxejp4ENdT1OZD8KlTNI8SGaxRbfHVwHQ3BRIYMTFFPUiYWMBs5uIzlYkN9d8PDYSgN5 HQ9EqSLK57emUMdugAXj19OwF01nBM95uJMw/7mZti5o+REGkYRn7UbPrBPfeXfNlaTrFO+ hwy+LfTD2Wuo7l76TORmA== X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 15991 Cc: Eli Zaretskii , 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) Glenn Morris writes: > Now you can run `make foo.log' to run the foo.el tests. Yes, but you must also force the target, or remove the log file prior the make call: ~/src/emacs> make -B -C test/automated tramp-tests.log From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 11:42:41 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 15:42:41 +0000 Received: from localhost ([127.0.0.1]:33876 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Boq-00074t-2u for submit@debbugs.gnu.org; Thu, 26 Jun 2014 11:42:41 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:54104 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Boj-00074b-Gq for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 11:42:34 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0Boi-0003OW-0X; Thu, 26 Jun 2014 11:42:28 -0400 From: Glenn Morris To: Michael Albinus Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> X-Spook: Afghanistan basement 9/11 S Box nuclear hackers Legion of X-Ran: nFQ;1}q|\eOzy,H3:sZ%m*2_K]DH|[3\G9`m@/}@4CXv?{@~+hU:NH8tg$$vLtNS-DqX)l X-Hue: blue X-Debbugs-No-Ack: yes X-Attribution: GM Date: Thu, 26 Jun 2014 11:42:27 -0400 In-Reply-To: <87lhsjvgsa.fsf@gmx.de> (Michael Albinus's message of "Thu, 26 Jun 2014 17:20:37 +0200") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: Eli Zaretskii , 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Michael Albinus wrote: > Yes, but you must also force the target, or remove the log file prior > the make call: > > ~/src/emacs> make -B -C test/automated tramp-tests.log Yes, the issue is that the log depends only on the test source file, not on "all of Emacs". From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 11:50:13 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 15:50:13 +0000 Received: from localhost ([127.0.0.1]:33885 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Bw8-0007MC-8Q for submit@debbugs.gnu.org; Thu, 26 Jun 2014 11:50:13 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:54254 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Bw1-0007Lb-GE for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 11:50:06 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0Bw0-0004iu-1A; Thu, 26 Jun 2014 11:50:00 -0400 From: Glenn Morris To: Michael Albinus Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> X-Spook: Vickie Weaver Putin Islam Abduganievich Karimov Watergate X-Ran: XyBQ!K5"lE?,8Ha$-ApF=,x^\cMmMbA{E2Zz!k@ X-Hue: red X-Debbugs-No-Ack: yes X-Attribution: GM Date: Thu, 26 Jun 2014 11:49:59 -0400 In-Reply-To: (Glenn Morris's message of "Thu, 26 Jun 2014 11:42:27 -0400") Message-ID: <6osimru0uw.fsf@fencepost.gnu.org> User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Glenn Morris wrote: >> ~/src/emacs> make -B -C test/automated tramp-tests.log > > Yes, the issue is that the log depends only on the test source file, > not on "all of Emacs". I mean, we could force it so that the tests are simply run every time, but I wasn't sure if that was preferable. From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 12:44:24 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 16:44:24 +0000 Received: from localhost ([127.0.0.1]:33924 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0CmY-000142-Lf for submit@debbugs.gnu.org; Thu, 26 Jun 2014 12:44:23 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:55675 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0CmR-00013d-PC for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 12:44:16 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0CmR-0001Hf-2C; Thu, 26 Jun 2014 12:44:11 -0400 From: Glenn Morris To: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> X-Spook: Aldergrove Medco anarchy Rubin bomb enemy of the state X-Ran: 9lZl2w@xi[!:K^_t8+v@G94`w~W*9!WpVasW;#%M"te[fwQ/dVrs!]["W7t=Oz}*z=n{)t X-Hue: red X-Debbugs-No-Ack: yes X-Attribution: GM Date: Thu, 26 Jun 2014 12:44:10 -0400 In-Reply-To: (Glenn Morris's message of "Thu, 26 Jun 2014 02:05:53 -0400") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) > Also, suppose one needs to run Emacs under a debugger for running a > test -- there doesn't seem to be a convenient way of doing that, > either. Once again, start Emacs manually in GDB, then copy/paste the > command line there, and be sure to set the environment variables, like > EMACS_TEST_DIRECTORY before starting GDB. Wait, and what if the test > forks, and you need to attach GDB to the correct Emacs process? (But none of the Emacs Makefiles provide any such gdb facility?) All I can suggest here is that the Makefile define a GDB variable, normally empty, that you can set to "gdb" on the make command-line when you want to. From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 12:58:20 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 16:58:20 +0000 Received: from localhost ([127.0.0.1]:33938 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0D03-0001iI-VJ for submit@debbugs.gnu.org; Thu, 26 Jun 2014 12:58:19 -0400 Received: from mtaout26.012.net.il ([80.179.55.182]:55452) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Czx-0001hm-VK for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 12:58:14 -0400 Received: from conversion-daemon.mtaout26.012.net.il by mtaout26.012.net.il (HyperSendmail v2007.08) id <0N7S00E00BZ14700@mtaout26.012.net.il> for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 19:54:07 +0300 (IDT) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by mtaout26.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0N7S00DQCCA7OW10@mtaout26.012.net.il>; Thu, 26 Jun 2014 19:54:07 +0300 (IDT) Date: Thu, 26 Jun 2014 19:57:48 +0300 From: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier In-reply-to: X-012-Sender: halo1@inter.net.il To: Glenn Morris Message-id: <8361jnpq0j.fsf@gnu.org> References: <83pppk8f91.fsf@gnu.org> X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Eli Zaretskii List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Glenn Morris > Cc: 15991@debbugs.gnu.org > Date: Thu, 26 Jun 2014 12:44:10 -0400 > > > > Also, suppose one needs to run Emacs under a debugger for running a > > test -- there doesn't seem to be a convenient way of doing that, > > either. Once again, start Emacs manually in GDB, then copy/paste the > > command line there, and be sure to set the environment variables, like > > EMACS_TEST_DIRECTORY before starting GDB. Wait, and what if the test > > forks, and you need to attach GDB to the correct Emacs process? > > (But none of the Emacs Makefiles provide any such gdb facility?) Most Emacs programs are interactive, so it's relatively easy to run them under a debugger. The test suite runs Emacs with a non-trivial and quite long command line, so it's harder. > All I can suggest here is that the Makefile define a GDB variable, > normally empty, that you can set to "gdb" on the make command-line when > you want to. I guess it would be OK, if $GDB could be set to "gdb --args". Thanks. From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 26 13:00:48 2014 Received: (at 15991) by debbugs.gnu.org; 26 Jun 2014 17:00:48 +0000 Received: from localhost ([127.0.0.1]:33947 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0D2P-0001qb-5P for submit@debbugs.gnu.org; Thu, 26 Jun 2014 13:00:47 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:55973 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0D2H-0001qE-66 for 15991@debbugs.gnu.org; Thu, 26 Jun 2014 13:00:38 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0D2G-0005R7-6i; Thu, 26 Jun 2014 13:00:32 -0400 From: Glenn Morris To: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <8361jnpq0j.fsf@gnu.org> X-Spook: White Water United Nations Ft. Knox spy explosion CESID X-Ran: y)V-n<^{Z8S/fOO6oDjRe\@5x@85bnB\CXQgy[|5>D%U=xJpU{U=(ii{T^x@Yunp2KQ7b^ X-Hue: red X-Debbugs-No-Ack: yes X-Attribution: GM Date: Thu, 26 Jun 2014 13:00:32 -0400 In-Reply-To: <8361jnpq0j.fsf@gnu.org> (Eli Zaretskii's message of "Thu, 26 Jun 2014 19:57:48 +0300") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Eli Zaretskii wrote: >> All I can suggest here is that the Makefile define a GDB variable, >> normally empty, that you can set to "gdb" on the make command-line when >> you want to. > > I guess it would be OK, if $GDB could be set to "gdb --args". Thanks. Could you do it? :) I confess I don't know quite where you want it to go... From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 01:47:14 2014 Received: (at submit) by debbugs.gnu.org; 27 Jun 2014 05:47:14 +0000 Received: from localhost ([127.0.0.1]:34197 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0P0D-0005mu-Q9 for submit@debbugs.gnu.org; Fri, 27 Jun 2014 01:47:14 -0400 Received: from eggs.gnu.org ([208.118.235.92]:59030) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0P0B-0005mZ-27 for submit@debbugs.gnu.org; Fri, 27 Jun 2014 01:47:11 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1X0Ozv-0001wq-PM for submit@debbugs.gnu.org; Fri, 27 Jun 2014 01:47:05 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50 autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:49198) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X0Ozv-0001wm-Mf for submit@debbugs.gnu.org; Fri, 27 Jun 2014 01:46:55 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:60700) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X0Ozo-00052l-0C for bug-gnu-emacs@gnu.org; Fri, 27 Jun 2014 01:46:55 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1X0Ozg-0001hG-I1 for bug-gnu-emacs@gnu.org; Fri, 27 Jun 2014 01:46:47 -0400 Received: from mout.kundenserver.de ([212.227.17.10]:62575) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X0Ozg-0001gJ-9V for bug-gnu-emacs@gnu.org; Fri, 27 Jun 2014 01:46:40 -0400 Received: from [192.168.178.32] (brln-4dbc73d6.pool.mediaWays.net [77.188.115.214]) by mrelayeu.kundenserver.de (node=mreue101) with ESMTP (Nemesis) id 0Mbyf0-1XHWAW43t8-00JIVB; Fri, 27 Jun 2014 07:46:27 +0200 Message-ID: <53AD0515.3050600@easy-emacs.de> Date: Fri, 27 Jun 2014 07:45:57 +0200 From: =?ISO-8859-1?Q?Andreas_R=F6hler?= User-Agent: Mozilla/5.0 (X11; Linux i686; rv:24.0) Gecko/20100101 Icedove/24.6.0 MIME-Version: 1.0 To: bug-gnu-emacs@gnu.org Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <8361jnpq0j.fsf@gnu.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Provags-ID: V02:K0:OwX5lBrM3S8OnfIU9jAJKVj/x+P2f+gKgTSUhVdNVvX mKgHYmHO/s0Jk1z/79fXZYaLZrZG+/c4/F/0HP6aDDrkj4lmLT GsAmfSQ21FQGeQR0od7o5ACyoE/lHCo/aGUr0jpPtIeMMNdK5s m1U3qOptq8PVQTBMVCZBHs3Kowj/ywYT0TRFS4bUe8002N8aVH lHStQQijS6XUv3ivT1aJyW4o4xZD5wdChYC9nbXPmIx8dZz+Eh W7IW3QLJwOZzwoEslvQvcLs5YkoD7WmSNb48gKaXseXu7zGwCU LbTgpyACAoMv5edWGdWy1oaUdfm9mIFMRrCfwcPBfj+HVTZC84 GS91qn4nLuty6lcsKf8FyvNf5I6AjMrel7NqpgTNF X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [generic] X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) On 26.06.2014 19:00, Glenn Morris wrote: > Eli Zaretskii wrote: > >>> All I can suggest here is that the Makefile define a GDB variable, >>> normally empty, that you can set to "gdb" on the make command-line when >>> you want to. >> >> I guess it would be OK, if $GDB could be set to "gdb --args". Thanks. > > Could you do it? :) > I confess I don't know quite where you want it to go... > > > > Hi, testing and debugging are quite different things. IMO it's not a good idea mixing these. What about making ert offer an appropriate listing of available tests? Thanks, Andreas From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 02:00:29 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 06:00:29 +0000 Received: from localhost ([127.0.0.1]:34207 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0PD2-0006Fp-Us for submit@debbugs.gnu.org; Fri, 27 Jun 2014 02:00:29 -0400 Received: from mtaout20.012.net.il ([80.179.55.166]:36041) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0PCy-0006FS-Kg for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 02:00:25 -0400 Received: from conversion-daemon.a-mtaout20.012.net.il by a-mtaout20.012.net.il (HyperSendmail v2007.08) id <0N7T00K00CBHKP00@a-mtaout20.012.net.il> for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 09:00:18 +0300 (IDT) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout20.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0N7T00K2LCOH8670@a-mtaout20.012.net.il>; Fri, 27 Jun 2014 09:00:18 +0300 (IDT) Date: Fri, 27 Jun 2014 09:00:04 +0300 From: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier In-reply-to: <53AD0515.3050600@easy-emacs.de> X-012-Sender: halo1@inter.net.il To: Andreas =?iso-8859-1?Q?R=F6hler?= Message-id: <8338eqq4d7.fsf@gnu.org> MIME-version: 1.0 Content-type: text/plain; charset=iso-8859-1 Content-transfer-encoding: 8BIT References: <83pppk8f91.fsf@gnu.org> <8361jnpq0j.fsf@gnu.org> <53AD0515.3050600@easy-emacs.de> X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Eli Zaretskii List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > Date: Fri, 27 Jun 2014 07:45:57 +0200 > From: Andreas Röhler > > >> I guess it would be OK, if $GDB could be set to "gdb --args". Thanks. > > > > Could you do it? :) > > I confess I don't know quite where you want it to go... > > testing and debugging are quite different things. > IMO it's not a good idea mixing these. I'm not sure I understand what you are saying. When a test fails, don't you want to debug Emacs to understand why and find a solution? So yes, testing and debugging are different things, but when a test fails, one frequently needs to debug Emacs. From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 03:23:28 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 07:23:29 +0000 Received: from localhost ([127.0.0.1]:34266 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0QVM-0000m7-CR for submit@debbugs.gnu.org; Fri, 27 Jun 2014 03:23:28 -0400 Received: from mout.gmx.net ([212.227.17.21]:49908) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0QVJ-0000lj-Dw for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 03:23:27 -0400 Received: from detlef.gmx.de ([87.146.53.250]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0LviG8-1WbLXL3o9U-017YoI; Fri, 27 Jun 2014 09:23:16 +0200 From: Michael Albinus To: Glenn Morris Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> Date: Fri, 27 Jun 2014 09:23:10 +0200 In-Reply-To: <6osimru0uw.fsf@fencepost.gnu.org> (Glenn Morris's message of "Thu, 26 Jun 2014 11:49:59 -0400") Message-ID: <87tx76stnl.fsf@gmx.de> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K0:iH+6yYI4nC3zVwdFze5rO/P4O/SS+25hfTZGtcXNWvSE70C7HT/ 6/DUGlfEtuJ2+t6TyAA4UR3thgmPlF3Zsp4Igx8qBxllHBsge5grBLf8Kn5/67HxSUDShT1 eU9rC9EJWPh7bmxIOS2uQQmwog34MRzYrESsgh23k+OvV03CMGIbKmLW0ZlVKREAQiecglX MmECp47QSYVYo+W3aoweQ== X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) Glenn Morris writes: > Glenn Morris wrote: > >>> ~/src/emacs> make -B -C test/automated tramp-tests.log >> >> Yes, the issue is that the log depends only on the test source file, >> not on "all of Emacs". > > I mean, we could force it so that the tests are simply run every time, > but I wasn't sure if that was preferable. I believe it is desirable to run the tests unconditionally when invoked via make. People call "make check" for a reason. Maybe you could even offer the test package name as target. Then one could call "make -C test/automated tramp-tests", There is another issue. By redirecting the output to a file, the password prompt for tramp-tests isn't visible anymore. This is a real regression, because these tests are intended to run for different remote file names. Could you pipe the test output through tee or something like this? I don't know how portable this would be, 'tho. Best regards, Michael. From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 03:50:49 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 07:50:49 +0000 Received: from localhost ([127.0.0.1]:34280 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Qvo-0001lE-Be for submit@debbugs.gnu.org; Fri, 27 Jun 2014 03:50:49 -0400 Received: from mtaout26.012.net.il ([80.179.55.182]:36811) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Qvk-0001ko-2w for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 03:50:45 -0400 Received: from conversion-daemon.mtaout26.012.net.il by mtaout26.012.net.il (HyperSendmail v2007.08) id <0N7T00O00HEC6800@mtaout26.012.net.il> for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 10:46:40 +0300 (IDT) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by mtaout26.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0N7T00JOAHLSFN50@mtaout26.012.net.il>; Fri, 27 Jun 2014 10:46:40 +0300 (IDT) Date: Fri, 27 Jun 2014 10:50:23 +0300 From: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier In-reply-to: <87tx76stnl.fsf@gmx.de> X-012-Sender: halo1@inter.net.il To: Michael Albinus Message-id: <831tuapz9c.fsf@gnu.org> References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 15991 Cc: rgm@gnu.org, 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Eli Zaretskii List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Michael Albinus > Date: Fri, 27 Jun 2014 09:23:10 +0200 > Cc: 15991@debbugs.gnu.org > > Could you pipe the test output through tee or something like this? I > don't know how portable this would be, 'tho. It should be portable for every platform that supports running the test suite, since that requires a shell that can handle this. From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 04:57:41 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 08:57:41 +0000 Received: from localhost ([127.0.0.1]:34300 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0RyW-00048D-Pr for submit@debbugs.gnu.org; Fri, 27 Jun 2014 04:57:41 -0400 Received: from mout.gmx.net ([212.227.15.18]:53308) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0RyS-00047r-PW for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 04:57:38 -0400 Received: from detlef.gmx.de ([87.146.53.250]) by mail.gmx.com (mrgmx002) with ESMTPSA (Nemesis) id 0MHX4u-1WxABQ07au-003IyP; Fri, 27 Jun 2014 10:57:28 +0200 From: Michael Albinus To: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> <831tuapz9c.fsf@gnu.org> Date: Fri, 27 Jun 2014 10:57:20 +0200 In-Reply-To: <831tuapz9c.fsf@gnu.org> (Eli Zaretskii's message of "Fri, 27 Jun 2014 10:50:23 +0300") Message-ID: <87pphuspan.fsf@gmx.de> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K0:55jSLFZoMBfzddCt1oeh/uL+Da/SbOvQA4Vn9uU19CX5w83zE2n mGMd7id0L6hM/xcx9pd8uPxT62DkSuEVMjBhgjYdDRTmS8YvYkjA8/S7yXra66NcYvPw+Li OG7Y+6/4hw7th6kqMpDbaWioI74TX/EkgtlEQmI84vyJpJt50B0RHhzH+c3GnnqKsZqfIdy VBV5+VWNKLITLVG1h/yHw== X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 15991 Cc: rgm@gnu.org, 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) Eli Zaretskii writes: >> Could you pipe the test output through tee or something like this? I >> don't know how portable this would be, 'tho. > > It should be portable for every platform that supports running the > test suite, since that requires a shell that can handle this. Sure. But if there is a platform which does not support it, this additional pipe could be suppressed on that platform. To be decided during configure. Best regards, Michael. From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 06:00:57 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 10:00:57 +0000 Received: from localhost ([127.0.0.1]:34334 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Sxk-0006PK-3q for submit@debbugs.gnu.org; Fri, 27 Jun 2014 06:00:56 -0400 Received: from mout.kundenserver.de ([212.227.17.24]:50568) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0Sxh-0006Ot-Gw for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 06:00:54 -0400 Received: from [192.168.178.32] (brln-4dbc73d6.pool.mediaWays.net [77.188.115.214]) by mrelayeu.kundenserver.de (node=mreue102) with ESMTP (Nemesis) id 0Lzs5j-1WeriY1sbj-0155uv; Fri, 27 Jun 2014 12:00:45 +0200 Message-ID: <53AD40B3.3060503@easy-emacs.de> Date: Fri, 27 Jun 2014 12:00:19 +0200 From: =?ISO-8859-1?Q?Andreas_R=F6hler?= User-Agent: Mozilla/5.0 (X11; Linux i686; rv:24.0) Gecko/20100101 Icedove/24.6.0 MIME-Version: 1.0 To: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <8361jnpq0j.fsf@gnu.org> <53AD0515.3050600@easy-emacs.de> <8338eqq4d7.fsf@gnu.org> In-Reply-To: <8338eqq4d7.fsf@gnu.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Provags-ID: V02:K0:i+PnMpwtItCf9USZ8yQpBPo1pUB1RCOIefMKx+F85fq FHvQ+TCnYx0w2F0fYRA6as5ysaEZj+l6Q0VPyZauDx726TX3+p gDSpx01sNy+m9F711vuRc/b0KIONv1HJq51k0vVwA7oCVT321t 5CPhHZsvAzI7grkSgJ/NHklSbZf4vlt8gh67AkoqEaM+DPTB+s c85oP2boVC+x4POf0aARHT/muDdOgp70J6JdR/Hrxgx1e5KYMs vQp66Zys9ladmN1Gqj4Hc70zBNpQ314r7DfLdy2N/0nI0AjPcg U7AaQLHrkN0n6MDAmQ51+34ZkGZ7wuZ5HPW1grAupR8eRhraue Lq5GguJMTpUqyfDFE2niV//uIieeZo3Qn9RbaFdte X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On 27.06.2014 08:00, Eli Zaretskii wrote: >> Date: Fri, 27 Jun 2014 07:45:57 +0200 >> From: Andreas Röhler >> >>>> I guess it would be OK, if $GDB could be set to "gdb --args". Thanks. >>> >>> Could you do it? :) >>> I confess I don't know quite where you want it to go... >> >> testing and debugging are quite different things. >> IMO it's not a good idea mixing these. > > I'm not sure I understand what you are saying. When a test fails, > don't you want to debug Emacs to understand why and find a solution? > > So yes, testing and debugging are different things, but when a test > fails, one frequently needs to debug Emacs. > > That depends. IIUC it's about making it more user friendly. Perspective of users is different from core developers. So if, say 10 from 100 tests fail, it doesn't mean to start a debug. Maybe just taking notice and look, if it matters for current task. We had that matter already WRT steep learning curve. Keeping things apart if possible is important. Best, Andreas From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 06:33:53 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 10:33:53 +0000 Received: from localhost ([127.0.0.1]:34352 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0TTc-0007bn-Py for submit@debbugs.gnu.org; Fri, 27 Jun 2014 06:33:53 -0400 Received: from mtaout21.012.net.il ([80.179.55.169]:61916) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0TTX-0007bM-O2 for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 06:33:50 -0400 Received: from conversion-daemon.a-mtaout21.012.net.il by a-mtaout21.012.net.il (HyperSendmail v2007.08) id <0N7T00K00OPVVV00@a-mtaout21.012.net.il> for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 13:33:41 +0300 (IDT) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout21.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0N7T00KWWPC4RT70@a-mtaout21.012.net.il>; Fri, 27 Jun 2014 13:33:41 +0300 (IDT) Date: Fri, 27 Jun 2014 13:33:27 +0300 From: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier In-reply-to: <53AD40B3.3060503@easy-emacs.de> X-012-Sender: halo1@inter.net.il To: Andreas =?iso-8859-1?Q?R=F6hler?= Message-id: <831tua8ww8.fsf@gnu.org> MIME-version: 1.0 Content-type: text/plain; charset=iso-8859-1 Content-transfer-encoding: 8BIT References: <83pppk8f91.fsf@gnu.org> <8361jnpq0j.fsf@gnu.org> <53AD0515.3050600@easy-emacs.de> <8338eqq4d7.fsf@gnu.org> <53AD40B3.3060503@easy-emacs.de> X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Eli Zaretskii List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > Date: Fri, 27 Jun 2014 12:00:19 +0200 > From: Andreas Röhler > CC: 15991@debbugs.gnu.org > > > I'm not sure I understand what you are saying. When a test fails, > > don't you want to debug Emacs to understand why and find a solution? > > > > So yes, testing and debugging are different things, but when a test > > fails, one frequently needs to debug Emacs. > > > > > > That depends. IIUC it's about making it more user friendly. > Perspective of users is different from core developers. > > So if, say 10 from 100 tests fail, it doesn't mean to start a debug. > Maybe just taking notice and look, if it matters for current task. If someone just wants to take a look, they can do just that. No one is forcing them to say "make foo.log DEBUG=1" and run the foo test under a debugger. This is an optional feature, as should be clear from reading the original bug report and this discussion. > We had that matter already WRT steep learning curve. > Keeping things apart if possible is important. Not sure how is this related to the issue at hand. Maybe you should read the whole discussion. From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 11:57:40 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 15:57:40 +0000 Received: from localhost ([127.0.0.1]:35159 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0YWx-0002N5-S8 for submit@debbugs.gnu.org; Fri, 27 Jun 2014 11:57:40 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:60813 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0YWw-0002Mw-3C for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 11:57:38 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0YWu-00078I-VR; Fri, 27 Jun 2014 11:57:37 -0400 From: Glenn Morris To: Michael Albinus Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> X-Spook: BCCI SCUD missile csim domestic disruption Blowpipe CDC X-Ran: H7YSm&2Zx-Tl=2Mf_#C8@vBE_tlVaem'Jh^~>PH{G8WC+$|tS_j8 X-Hue: white X-Debbugs-No-Ack: yes X-Attribution: GM Date: Fri, 27 Jun 2014 11:57:36 -0400 In-Reply-To: <87tx76stnl.fsf@gmx.de> (Michael Albinus's message of "Fri, 27 Jun 2014 09:23:10 +0200") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Michael Albinus wrote: > I believe it is desirable to run the tests unconditionally when invoked > via make. People call "make check" for a reason. I suppose you are right, and this is consistent with how it used to behave. > Maybe you could even offer the test package name as target. Then one > could call "make -C test/automated tramp-tests", You can already do make -C test/automated tramp-tests.log I don't think removing the ".log" is worth it. > There is another issue. By redirecting the output to a file, the > password prompt for tramp-tests isn't visible anymore. This is a real > regression, because these tests are intended to run for different remote > file names. Could you pipe the test output through tee or something like > this? I don't know how portable this would be, 'tho. Not sure I understand. Do you want to interact, ie type a password? I think tests that require interaction are a Bad Thing. Are these optional tests that do not normally run? From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 14:13:09 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 18:13:09 +0000 Received: from localhost ([127.0.0.1]:35242 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0ae0-0006jE-VK for submit@debbugs.gnu.org; Fri, 27 Jun 2014 14:13:08 -0400 Received: from mout.gmx.net ([212.227.15.18]:53754) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0adv-0006ia-4M for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 14:13:03 -0400 Received: from detlef.gmx.de ([87.146.53.250]) by mail.gmx.com (mrgmx003) with ESMTPSA (Nemesis) id 0M54L0-1WkYuw3IZq-00zGsS; Fri, 27 Jun 2014 20:12:45 +0200 From: Michael Albinus To: Glenn Morris Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> Date: Fri, 27 Jun 2014 20:12:38 +0200 In-Reply-To: (Glenn Morris's message of "Fri, 27 Jun 2014 11:57:36 -0400") Message-ID: <8738eq8bmx.fsf@gmx.de> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K0:ss+krNdbjW/fN55rEyzgHe9zf8sHpbb93v6cf2oF2h+TV2rMbYf Fm984bQbUaCsXr2bEnhEFJfq4lq0vN1eKxCLP9AKCELtpnLANZT1NSCd+H7kYYPJrKmFqnU lAycrfj0PJ/unRvpjcnVIdC7w6YyT/KDj6jHwDXpGKX9f5qcKIAOTev8NTNLU7hGAVz28f/ 3f5yiF0oaDUYXKMZPagqg== X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) Glenn Morris writes: >> I believe it is desirable to run the tests unconditionally when invoked >> via make. People call "make check" for a reason. > > I suppose you are right, and this is consistent with how it used to behave. Nope. When you cal "make check" a second time, no test runs again, 'cause the log files exist already. >> Maybe you could even offer the test package name as target. Then one >> could call "make -C test/automated tramp-tests", > > You can already do > > make -C test/automated tramp-tests.log Again, it works only when there is no log file. The second time you call it, nothing happens: ~/src/emacs> make -C test/automated tramp-tests.log make: Entering directory `/usr/local/src/emacs/test/automated' make: `tramp-tests.log' is up to date. make: Leaving directory `/usr/local/src/emacs/test/automated' > I don't think removing the ".log" is worth it. If you want to rerun a test, you must remove the log file manually. Inconvenient. >> There is another issue. By redirecting the output to a file, the >> password prompt for tramp-tests isn't visible anymore. This is a real >> regression, because these tests are intended to run for different remote >> file names. Could you pipe the test output through tee or something like >> this? I don't know how portable this would be, 'tho. > > Not sure I understand. Do you want to interact, ie type a password? > I think tests that require interaction are a Bad Thing. > Are these optional tests that do not normally run? Nope. See the commentary section of tramp-test.el. Try ~/src/emacs> env REMOTE_TEMPORARY_FILE_DIRECTORY=/sudo::/tmp make -C test/automated tramp-tests.log It will ask you for the sudo password, but you don't see the prompt. Best regards, Michael. From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 14:24:56 2014 Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 18:24:56 +0000 Received: from localhost ([127.0.0.1]:35262 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0apU-00075d-1L for submit@debbugs.gnu.org; Fri, 27 Jun 2014 14:24:56 -0400 Received: from mout.gmx.net ([212.227.15.15]:64049) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0apR-00075P-C2 for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 14:24:54 -0400 Received: from detlef.gmx.de ([87.146.53.250]) by mail.gmx.com (mrgmx001) with ESMTPSA (Nemesis) id 0M936L-1WoBoh0roz-00CPHd; Fri, 27 Jun 2014 20:24:46 +0200 From: Michael Albinus To: Glenn Morris Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> <8738eq8bmx.fsf@gmx.de> Date: Fri, 27 Jun 2014 20:24:41 +0200 In-Reply-To: <8738eq8bmx.fsf@gmx.de> (Michael Albinus's message of "Fri, 27 Jun 2014 20:12:38 +0200") Message-ID: <87y4wi6wie.fsf@gmx.de> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K0:K6WjG0AlD8RhcBb4KddxYlwAgxfEUNPettTegh8ZyZr7U7tWPQq gV638gJZyngImBu+wyvJcZZrxWKS20rs1ugfek0uj/yiE5Lva+BXlsG2UiKhKkyE1hn8Y3c WjOXAO2q+rryU23EzGMo5ID13F7bKzx3WYxqKVnCePlRI9GBmNFDPOhMnRu4/eUYExvA7+d MTEPAzG20qBlwdLzW5oDg== X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) Michael Albinus writes: > Glenn Morris writes: > >>> I believe it is desirable to run the tests unconditionally when invoked >>> via make. People call "make check" for a reason. >> >> I suppose you are right, and this is consistent with how it used to behave. > > Nope. When you cal "make check" a second time, no test runs again, > 'cause the log files exist already. Forget this. I haven't seen your latest change. Thanks! Best regards, Michael. From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 27 21:13:09 2014 Received: (at 15991) by debbugs.gnu.org; 28 Jun 2014 01:13:09 +0000 Received: from localhost ([127.0.0.1]:35483 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0hCX-0003nb-GS for submit@debbugs.gnu.org; Fri, 27 Jun 2014 21:13:09 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:44252 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0hCU-0003nJ-3b for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 21:13:07 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0hCT-00034u-4t; Fri, 27 Jun 2014 21:13:05 -0400 From: Glenn Morris To: Michael Albinus Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> <8738eq8bmx.fsf@gmx.de> X-Spook: kilo class CESID Bruxelles AK-47 Axis of Evil corporate X-Ran: Q5crzkiF3|Ft6)YZwRb9kz>|C=D)#\Qh)&_IC#d2yq`x,Am'DaKPNPR=2l*V=q!#&In@MQ X-Hue: red X-Debbugs-No-Ack: yes X-Attribution: GM Date: Fri, 27 Jun 2014 21:13:04 -0400 Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Michael Albinus wrote: >> make -C test/automated tramp-tests.log > > Again, it works only when there is no log file. OK, now you can do `make tramp-tests' to always run the tests. > ~/src/emacs> env REMOTE_TEMPORARY_FILE_DIRECTORY=/sudo::/tmp make -C test/automated tramp-tests.log > > It will ask you for the sudo password, but you don't see the prompt. So, you do want to run interactive tests. Is it not more natural to run such tests from an interactive Emacs, with M-x ert? We could add the "tee" thing, I suppose. From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 28 13:12:06 2014 Received: (at 15991) by debbugs.gnu.org; 28 Jun 2014 17:12:07 +0000 Received: from localhost ([127.0.0.1]:36290 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0wAY-00087R-Ds for submit@debbugs.gnu.org; Sat, 28 Jun 2014 13:12:06 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:58867 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0wAW-00087I-2V for 15991@debbugs.gnu.org; Sat, 28 Jun 2014 13:12:04 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0wAV-0007Tx-6A; Sat, 28 Jun 2014 13:12:03 -0400 From: Glenn Morris To: Michael Albinus Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> <8738eq8bmx.fsf@gmx.de> X-Spook: White House Dateline satellite imagery keyhole Geraldton X-Ran: YvlRH0_0[^V.B>m(g!\!G%(WI(dj>.WT5s)t'V.oDU.1JYSAcY, (Glenn Morris's message of "Fri, 27 Jun 2014 21:13:04 -0400") Message-ID: <1c7g41rmak.fsf@fencepost.gnu.org> User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) I changed it so that `make tramp-tests': i) always runs the tests, and ii) does no logging at all (ie, writes to stdout). Whereas `make tramp-tests.log' writes to the .log file, only if that is out of date. I think that makes sense? Almost anything is possible of course, but I don't want to add too many different options for running things, in case it all gets too confusing. From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 28 13:19:35 2014 Received: (at 15991) by debbugs.gnu.org; 28 Jun 2014 17:19:35 +0000 Received: from localhost ([127.0.0.1]:36295 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0wHn-0008L9-CF for submit@debbugs.gnu.org; Sat, 28 Jun 2014 13:19:35 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:58953 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0wHm-0008L1-4B for 15991@debbugs.gnu.org; Sat, 28 Jun 2014 13:19:34 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X0wHl-0000CL-4O; Sat, 28 Jun 2014 13:19:33 -0400 From: Glenn Morris To: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <8361jnpq0j.fsf@gnu.org> X-Spook: militia covert video plutonium ANZUS pre-emptive BCCI X-Ran: ]rb`#Bdw=QgCh=zk%p%]Otu9>?#U@PQu{=9'y|i&".'nUb[\AYtB\aVN+[@Xi{t~Tn9;Q= X-Hue: green X-Debbugs-No-Ack: yes X-Attribution: GM Date: Sat, 28 Jun 2014 13:19:33 -0400 In-Reply-To: <8361jnpq0j.fsf@gnu.org> (Eli Zaretskii's message of "Thu, 26 Jun 2014 19:57:48 +0300") Message-ID: User-Agent: Gnus (www.gnus.org), GNU Emacs (www.gnu.org/software/emacs/) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Eli Zaretskii wrote: >> All I can suggest here is that the Makefile define a GDB variable, >> normally empty, that you can set to "gdb" on the make command-line when >> you want to. > > I guess it would be OK, if $GDB could be set to "gdb --args". Thanks. I added $GDB at what seems like the right place. I think this issue is done now. From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 28 13:42:26 2014 Received: (at 15991) by debbugs.gnu.org; 28 Jun 2014 17:42:26 +0000 Received: from localhost ([127.0.0.1]:36306 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0wdt-0000YO-Eq for submit@debbugs.gnu.org; Sat, 28 Jun 2014 13:42:26 -0400 Received: from mtaout20.012.net.il ([80.179.55.166]:46481) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0wdr-0000YA-7Z for 15991@debbugs.gnu.org; Sat, 28 Jun 2014 13:42:24 -0400 Received: from conversion-daemon.a-mtaout20.012.net.il by a-mtaout20.012.net.il (HyperSendmail v2007.08) id <0N7W00F003A95300@a-mtaout20.012.net.il> for 15991@debbugs.gnu.org; Sat, 28 Jun 2014 20:42:16 +0300 (IDT) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout20.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0N7W00EQ63UGZT40@a-mtaout20.012.net.il>; Sat, 28 Jun 2014 20:42:16 +0300 (IDT) Date: Sat, 28 Jun 2014 20:42:06 +0300 From: Eli Zaretskii Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier In-reply-to: X-012-Sender: halo1@inter.net.il To: Glenn Morris Message-id: <83vbrl53td.fsf@gnu.org> References: <83pppk8f91.fsf@gnu.org> <8361jnpq0j.fsf@gnu.org> X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Eli Zaretskii List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Glenn Morris > Cc: 15991@debbugs.gnu.org > Date: Sat, 28 Jun 2014 13:19:33 -0400 > > Eli Zaretskii wrote: > > >> All I can suggest here is that the Makefile define a GDB variable, > >> normally empty, that you can set to "gdb" on the make command-line when > >> you want to. > > > > I guess it would be OK, if $GDB could be set to "gdb --args". Thanks. > > I added $GDB at what seems like the right place. > > I think this issue is done now. Yes, thanks again. From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 28 22:37:02 2014 Received: (at control) by debbugs.gnu.org; 29 Jun 2014 02:37:02 +0000 Received: from localhost ([127.0.0.1]:36399 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X14zF-00005a-Ll for submit@debbugs.gnu.org; Sat, 28 Jun 2014 22:37:01 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:37704 ident=Debian-exim) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X14zD-00005R-Fd for control@debbugs.gnu.org; Sat, 28 Jun 2014 22:37:00 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1X14zD-0007DJ-8Q for control@debbugs.gnu.org; Sat, 28 Jun 2014 22:36:59 -0400 Date: Sat, 28 Jun 2014 22:36:59 -0400 Message-Id: Subject: control message for bug 15991 To: X-Mailer: mail (GNU Mailutils 2.1) From: Glenn Morris X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) close 15991 24.5 From debbugs-submit-bounces@debbugs.gnu.org Sun Jun 29 09:30:35 2014 Received: (at 15991) by debbugs.gnu.org; 29 Jun 2014 13:30:35 +0000 Received: from localhost ([127.0.0.1]:36517 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X1FBi-0004LB-5H for submit@debbugs.gnu.org; Sun, 29 Jun 2014 09:30:35 -0400 Received: from mout.gmx.net ([212.227.17.21]:52096) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X1FBV-0004Ki-ED for 15991@debbugs.gnu.org; Sun, 29 Jun 2014 09:30:23 -0400 Received: from detlef.gmx.de ([93.209.73.168]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0Ldspr-1WKFJl3XXv-00j0A9; Sun, 29 Jun 2014 15:30:15 +0200 From: Michael Albinus To: Glenn Morris Subject: Re: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> <8738eq8bmx.fsf@gmx.de> <1c7g41rmak.fsf@fencepost.gnu.org> Date: Sun, 29 Jun 2014 15:30:07 +0200 In-Reply-To: <1c7g41rmak.fsf@fencepost.gnu.org> (Glenn Morris's message of "Sat, 28 Jun 2014 13:12:03 -0400") Message-ID: <87ha337sio.fsf@gmx.de> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Provags-ID: V03:K0:aXXpDJLHQKfKfBP8ZELjTB1Bxztu+UM2T8Mq0vJ/RSwfOOPJ31v dyDC5YbTEhz/GcAzGNK+8HZpjC1eLHZirT8A8zMsevdpt7zRPnQIamuP7FXpxJ121nwGbes RNL4DhggN19gsCaZ7r5GHNJ+cC+gDwsT7yCdHh4yUPlBCV3J2hsbLgSa0j8pv8PqVnmDOUn k61cbkxqwZWRAa12cTDHQ== X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 15991 Cc: 15991@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) Glenn Morris writes: > I changed it so that `make tramp-tests': i) always runs the tests, and > ii) does no logging at all (ie, writes to stdout). > > Whereas `make tramp-tests.log' writes to the .log file, only if that is > out of date. > > I think that makes sense? > > Almost anything is possible of course, but I don't want to add too many > different options for running things, in case it all gets too confusing. That works perfectly, thanks a lot! Best regards, Michael. From unknown Fri Aug 15 15:36:49 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Mon, 28 Jul 2014 11:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 04 12:35:32 2014 Received: (at control) by debbugs.gnu.org; 4 Oct 2014 16:35:32 +0000 Received: from localhost ([127.0.0.1]:33183 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1XaSIt-0002m9-8U for submit@debbugs.gnu.org; Sat, 04 Oct 2014 12:35:31 -0400 Received: from fencepost.gnu.org ([208.118.235.10]:60039) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1XaSIr-0002lz-Gi for control@debbugs.gnu.org; Sat, 04 Oct 2014 12:35:29 -0400 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1XaSIq-0005r2-MO; Sat, 04 Oct 2014 12:35:28 -0400 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <21552.8656.554316.921175@gnu.org> Date: Sat, 4 Oct 2014 12:35:28 -0400 From: Glenn Morris To: GNU bug tracker automated control server Subject: Update Emacs archived fixed bugs for 24.5 version number change X-Debbugs-No-Ack: yes X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) unarchive 18304 fixed 18304 25.1 notfixed 18304 24.5 unarchive 12008 fixed 12008 25.1 notfixed 12008 24.5 unarchive 17110 fixed 17110 25.1 notfixed 17110 24.5 unarchive 17218 fixed 17218 25.1 notfixed 17218 24.5 unarchive 18222 fixed 18222 25.1 notfixed 18222 24.5 unarchive 18023 fixed 18023 25.1 notfixed 18023 24.5 unarchive 17225 fixed 17225 25.1 notfixed 17225 24.5 unarchive 16626 fixed 16626 25.1 notfixed 16626 24.5 unarchive 18326 fixed 18326 25.1 notfixed 18326 24.5 unarchive 18227 fixed 18227 25.1 notfixed 18227 24.5 unarchive 16328 fixed 16328 25.1 notfixed 16328 24.5 unarchive 17333 fixed 17333 25.1 notfixed 17333 24.5 unarchive 13837 fixed 13837 25.1 notfixed 13837 24.5 unarchive 17641 fixed 17641 25.1 notfixed 17641 24.5 unarchive 18341 fixed 18341 25.1 notfixed 18341 24.5 unarchive 18349 fixed 18349 25.1 notfixed 18349 24.5 unarchive 2151 fixed 2151 25.1 notfixed 2151 24.5 unarchive 5853 fixed 5853 25.1 notfixed 5853 24.5 unarchive 17857 fixed 17857 25.1 notfixed 17857 24.5 unarchive 17858 fixed 17858 25.1 notfixed 17858 24.5 unarchive 17859 fixed 17859 25.1 notfixed 17859 24.5 unarchive 17160 fixed 17160 25.1 notfixed 17160 24.5 unarchive 2263 fixed 2263 25.1 notfixed 2263 24.5 unarchive 18368 fixed 18368 25.1 notfixed 18368 24.5 unarchive 17772 fixed 17772 25.1 notfixed 17772 24.5 unarchive 17276 fixed 17276 25.1 notfixed 17276 24.5 unarchive 15991 fixed 15991 25.1 notfixed 15991 24.5 unarchive 17699 fixed 17699 25.1 notfixed 17699 24.5 From unknown Fri Aug 15 15:36:49 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Sun, 02 Nov 2014 12:24:09 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator