From unknown Tue Jun 17 20:19:59 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#11745 <11745@debbugs.gnu.org> To: bug#11745 <11745@debbugs.gnu.org> Subject: Status: the new test-suite summary is confusing Reply-To: bug#11745 <11745@debbugs.gnu.org> Date: Wed, 18 Jun 2025 03:19:59 +0000 retitle 11745 the new test-suite summary is confusing reassign 11745 automake submitter 11745 Alexandre Duret-Lutz severity 11745 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Tue Jun 19 13:05:22 2012 Received: (at submit) by debbugs.gnu.org; 19 Jun 2012 17:05:22 +0000 Received: from localhost ([127.0.0.1]:48859 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Sh1rl-00040v-JR for submit@debbugs.gnu.org; Tue, 19 Jun 2012 13:05:22 -0400 Received: from eggs.gnu.org ([208.118.235.92]:57841) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Sh1dx-0003gi-Ia for submit@debbugs.gnu.org; Tue, 19 Jun 2012 12:51:06 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Sh1aY-0008Kx-Vi for submit@debbugs.gnu.org; Tue, 19 Jun 2012 12:47:42 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, RCVD_IN_DNSWL_HI,T_DKIM_INVALID autolearn=unavailable version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:53283) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Sh1aY-0008Kq-Ph for submit@debbugs.gnu.org; Tue, 19 Jun 2012 12:47:34 -0400 Received: from eggs.gnu.org ([208.118.235.92]:46954) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Sh1aX-00080P-2W for bug-automake@gnu.org; Tue, 19 Jun 2012 12:47:34 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Sh1aV-0008K5-1P for bug-automake@gnu.org; Tue, 19 Jun 2012 12:47:32 -0400 Received: from mail-ob0-f169.google.com ([209.85.214.169]:61747) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Sh1aU-0008JZ-Qs for bug-automake@gnu.org; Tue, 19 Jun 2012 12:47:30 -0400 Received: by obbtb8 with SMTP id tb8so4820365obb.0 for ; Tue, 19 Jun 2012 09:47:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:from:date:x-google-sender-auth:message-id :subject:to:content-type; bh=r9EX669BDuFAaCRTo+PRrizkkz4ZG8qhUmpptmBq/6g=; b=ZSCZiK2x7Q128cLL7WePQVLsgbEEYrPfyvEp+FYhLb+PXQs94GgEAYoPqGGpTRH9Of +s08fWGn4XSI/aRF6kH3OpqumaZjMbtaY1jGSNyj7rQ2zS/YCG9GGgGcSiZ/ECMgiAyJ PtA2TWARihbnnKcK5KJ5WMORz7tnqtQ3kyMbyAr8zTr1gc1HqPkSx2BcI4HAOtJydL14 l/0syoQBg2WXXE7oGXekYxMvzbo3VuEy/VJT2fTCQ+EcXlt+jc/gfkEDrPAHH28HYNCz Lw9BA0Ue5OhY/LSL0z4QZPnwjI8lJREYLyppibno6u1jbq6SMCeGRj83x0qyDgKxIfcn D2dQ== Received: by 10.182.45.72 with SMTP id k8mr20522776obm.51.1340124447796; Tue, 19 Jun 2012 09:47:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.13.10 with HTTP; Tue, 19 Jun 2012 09:47:07 -0700 (PDT) From: Alexandre Duret-Lutz Date: Tue, 19 Jun 2012 18:47:07 +0200 X-Google-Sender-Auth: Yh9TkLgF5gQo0qecf8It9k7ePCM Message-ID: Subject: the new test-suite summary is confusing To: bug-automake@gnu.org Content-Type: text/plain; charset=ISO-8859-1 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-Received-From: 208.118.235.17 X-Spam-Score: -6.1 (------) X-Debbugs-Envelope-To: submit X-Mailman-Approved-At: Tue, 19 Jun 2012 13:05:19 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.1 (------) Hi! I have a project that contains 8 different test-suites, each in its own directory. Some test suite are big, other are small, but they test different parts of the project and I like being able to run "make check" in the relevant directory. They are run sequentially (with SUBDIRS) when "make check" is run from the top-level. I upgraded to Automake 1.12.1 to discover the each of these test-suite now displays a huge summary like: ============================================================================ Testsuite summary for spot 0.9.1a ============================================================================ # TOTAL: 2 # PASS: 2 # SKIP: 0 # XFAIL: 0 # FAIL: 0 # XPASS: 0 # ERROR: 0 ============================================================================ Instead of the older one-line summary I'm used too. I can live with the extra verbosity, but I find the initial header saying "Testsuite summary for spot 0.9.1a" in each of the test suites very confusing. The above in definitely *not* a testsuite summary for the project, it's only a test summary for one directory. I think the easiest fix would be to change the header to just "Testsuite summary", without mentioning the package. Another option could be to let the test-suite be named in Makefile.am. Maybe introduce TESTS_DISPLAY_NAME = $(PACKAGE_STRING) and use echo "Testsuite summary for $(TESTS_DISPLAY_NAME)" so that people with multiple test-suites can give them different names. -- Alexandre Duret-Lutz From debbugs-submit-bounces@debbugs.gnu.org Mon Jun 01 21:44:29 2020 Received: (at 11745) by debbugs.gnu.org; 2 Jun 2020 01:44:29 +0000 Received: from localhost ([127.0.0.1]:37462 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jfvyf-0008Ez-4J for submit@debbugs.gnu.org; Mon, 01 Jun 2020 21:44:29 -0400 Received: from freefriends.org ([96.88.95.60]:39340) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jfvyc-0008Eq-Ta for 11745@debbugs.gnu.org; Mon, 01 Jun 2020 21:44:27 -0400 X-Envelope-From: karl@freefriends.org Received: from freefriends.org (freefriends.org [96.88.95.60]) by freefriends.org (8.14.7/8.14.7) with ESMTP id 0521iPSO012174 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 1 Jun 2020 19:44:25 -0600 Received: (from apache@localhost) by freefriends.org (8.14.7/8.14.7/Submit) id 0521iNkq012173; Mon, 1 Jun 2020 19:44:23 -0600 Date: Mon, 1 Jun 2020 19:44:23 -0600 Message-Id: <202006020144.0521iNkq012173@freefriends.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="MM0m98Ak5m" Content-Transfer-Encoding: 7bit From: Karl Berry To: adl@lrde.epita.fr Subject: Re: the new test-suite summary is confusing In-Reply-To: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 11745 Cc: 11745@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) --MM0m98Ak5m Content-Type: text/plain; charset=us-ascii Content-Description: message body text Content-Transfer-Encoding: 7bit Hi Alexandre and all - regarding https://debbugs.gnu.org/cgi/bugreport.cgi?bug=11745 (12 years ago, oh well). I upgraded to Automake 1.12.1 to discover the each of these test-suite [directories] now displays a huge summary like: ============================================================================ Testsuite summary for spot 0.9.1a ... The above in definitely *not* a testsuite summary for the project, it's only a test summary for one directory. Agreed, but: I think the easiest fix would be to change the header to just "Testsuite summary", without mentioning the package. I don't think that's the right fix. In TeX Live, we have many different packages, all in one Automake tree, and if every testsuite summary just said "TeX Live", it would be difficult to discern what the summary was reporting on. That is, the TL make check output starts like this: Testsuite summary for Kpathsea 6.3.3/dev .. Testsuite summary for zlib (TeX Live) 1.2.11 .. Testsuite summary for lua53 (TeX Live) 5.3.5 If all of those just said "TeX Live", it wouldn't be good. I don't think we should change the default form of the Automake header line at this late date, since some packages (and plenty of AM's own tests) might well be expecting what's currently output. So I propose to define a new variable in lib/am/check.am: AM_TESTSUITE_SUMMARY_HEADER = " for $(PACKAGE_STRING)" so the default is unchanged. I made a simple test (t/testsuite-summary-header.sh) that checks various settings of the new variable behave as expected, in particular, setting it to the empty string for your case. Proposed patch attached. make check and make distcheck still pass. Jim, anyone, any comments? --thanks, karl. --MM0m98Ak5m Content-Type: application/octet-stream Content-Disposition: attachment; filename="summary-hdr.patch" Content-Transfer-Encoding: base64 RnJvbSA2NjIyZmNiZmIwMjIwNmQxYjhhODE0ZmRhZGJhMDc0NDQ4Y2RiYTY0IE1vbiBTZXAg MTcgMDA6MDA6MDAgMjAwMQpGcm9tOiBLYXJsIEJlcnJ5IDxrYXJsQGZyZWVmcmllbmRzLm9y Zz4KRGF0ZTogTW9uLCAxIEp1biAyMDIwIDE4OjQyOjQ1IC0wNzAwClN1YmplY3Q6IFtQQVRD SF0gYXV0b21ha2U6IHN1cHBvcnQgQU1fVEVTVFNVSVRFX1NVTU1BUllfSEVBREVSIG92ZXJy aWRlLgoKVGhpcyBjaGFuZ2UgaGFuZGxlcyBodHRwczovL2J1Z3MuZ251Lm9yZy8xMTc0NS4K CiogbGliL2FtL2NoZWNrLmFtIChBTV9URVNUU1VJVEVfU1VNTUFSWV9IRUFERVIpOiBuZXcg dmFyaWFibGUuCkRlZmF1bHQgdmFsdWUgaXMgIiBmb3IgJChQQUNLQUdFX1NUUklORykiLCBp bmNsdWRpbmcgcXVvdGVzLAp0byBrZWVwIHRoZSBkZWZhdWx0IG91dHB1dCB0aGUgc2FtZS4K KCQoVEVTVF9TVUlURV9MT0cpKTogdXNlIGl0LCB1bnF1b3RlZC4KKiBkb2MvYXV0b21ha2Uu dGV4aSAoU2NyaXB0cy1iYXNlZCBUZXN0c3VpdGVzKTogZG9jdW1lbnQgaXQuCiogTkVXUzog bWVudGlvbiBpdC4KKiB0L3Rlc3RzdWl0ZS1zdW1tYXJ5LWhlYWRlci5zaDogbmV3IHRlc3Qu CiogdC9saXN0LW9mLXRlc3RzLm1rIChoYW5kd3JpdHRlbl90ZXN0cyk6IGFkZCBpdC4KKiB0 L2F4L3Rlc3RzdWl0ZS1zdW1tYXJ5LWNoZWNrcy5zaDogZml4IHR5cG8uCi0tLQogTkVXUyAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgfCAgNSArKysKIGRvYy9hdXRvbWFrZS50ZXhp ICAgICAgICAgICAgICAgIHwgMzEgKysrKysrKysrKysrKy0KIGxpYi9hbS9jaGVjay5hbSAg ICAgICAgICAgICAgICAgIHwgIDUgKystCiB0L2F4L3Rlc3RzdWl0ZS1zdW1tYXJ5LWNoZWNr cy5zaCB8ICAyICstCiB0L2xpc3Qtb2YtdGVzdHMubWsgICAgICAgICAgICAgICB8ICAxICsK IHQvdGVzdHN1aXRlLXN1bW1hcnktaGVhZGVyLnNoICAgIHwgOTEgKysrKysrKysrKysrKysr KysrKysrKysrKysrKysrKysrKysrKysrKwogNiBmaWxlcyBjaGFuZ2VkLCAxMzEgaW5zZXJ0 aW9ucygrKSwgNCBkZWxldGlvbnMoLSkKIGNyZWF0ZSBtb2RlIDEwMDY0NCB0L3Rlc3RzdWl0 ZS1zdW1tYXJ5LWhlYWRlci5zaAoKZGlmZiAtLWdpdCBhL05FV1MgYi9ORVdTCmluZGV4IDg2 NTBkYjAuLmYzNjAxMWMgMTAwNjQ0Ci0tLSBhL05FV1MKKysrIGIvTkVXUwpAQCAtNjQsNiAr NjQsMTEgQEAKIAogTmV3IGluID8uPy4/OgogCisqIE5ldyBmZWF0dXJlcyBhZGRlZAorCisg IC0gSW4gdGhlIHRlc3RzdWl0ZSBzdW1tYXJ5LCB0aGUgImZvciAkKFBBQ0tBR0VfU1RSSU5H KSIgc3VmZml4CisgICAgY2FuIGJlIG92ZXJyaWRkZW4gd2l0aCB0aGUgQU1fVEVTVFNVSVRF X1NVTU1BUllfSEVBREVSIHZhcmlhYmxlLgorCiAqIEJ1Z3MgZml4ZWQKIAogICAtIEJyb2tl biBsaW5rcyBpbiBtYW51YWwgZml4ZWQgb3IgcmVtb3ZlZCwgYW5kIG5ldyBzY3JpcHQKZGlm ZiAtLWdpdCBhL2RvYy9hdXRvbWFrZS50ZXhpIGIvZG9jL2F1dG9tYWtlLnRleGkKaW5kZXgg MjMyNzIxZS4uZjc2YThmNyAxMDA2NDQKLS0tIGEvZG9jL2F1dG9tYWtlLnRleGkKKysrIGIv ZG9jL2F1dG9tYWtlLnRleGkKQEAgLTg5NDAsNyArODk0MCw3IEBAIGltcGxlbWVudGF0aW9u LCBhbmQgY2FuIHRodXMgb25seSBiZSBhcyBnb29kIGFzIHRob3NlIGFyZS4KIEJ5IGRlZmF1 bHQsIG9ubHkgdGhlIGV4aXQgc3RhdHVzZXMgb2YgdGhlIHRlc3Qgc2NyaXB0cyBhcmUgY29u c2lkZXJlZCB3aGVuCiBkZXRlcm1pbmluZyB0aGUgdGVzdHN1aXRlIG91dGNvbWUuICBCdXQg QXV0b21ha2UgYWxsb3dzIGFsc28gdGhlIHVzZSBvZgogbW9yZSBjb21wbGV4IHRlc3QgcHJv dG9jb2xzLCBlaXRoZXIgc3RhbmRhcmQgKEBweHJlZntVc2luZyB0aGUgVEFQIHRlc3QKLXBy b3RvY29sfSkgb3IgY3VzdG9tIChAcHhyZWZ7Q3VzdG9tIFRlc3QgRHJpdmVyc30pLiAgTm90 ZSB0aGF0IHlvdSBjYW4ndAorcHJvdG9jb2x9KSBvciBjdXN0b20gKEBweHJlZntDdXN0b20g VGVzdCBEcml2ZXJzfSkuICBZb3UgY2FuJ3QKIGVuYWJsZSBzdWNoIHByb3RvY29scyB3aGVu IHRoZSBzZXJpYWwgaGFybmVzcyBpcyB1c2VkLCB0aG91Z2guCiBJbiB0aGUgcmVzdCBvZiB0 aGlzIHNlY3Rpb24gd2UgYXJlIGdvaW5nIHRvIGNvbmNlbnRyYXRlIG1vc3RseSBvbgogcHJv dG9jb2wtbGVzcyB0ZXN0cywgc2luY2Ugd2UgY292ZXIgdGVzdCBwcm90b2NvbHMgaW4gYSBs YXRlciBzZWN0aW9uCkBAIC04OTk4LDcgKzg5OTgsMzQgQEAgWEZBSUw6IG11LnRhcCAyICMg VE9ETyBmcm9ibmljYXRpb24gbm90IHlldCBpbXBsZW1lbnRlZAogQG5vaW5kZW50CiBBIHRl c3RzdWl0ZSBzdW1tYXJ5IChleHBlY3RlZCB0byByZXBvcnQgYXQgbGVhc3QgdGhlIG51bWJl ciBvZiBydW4sCiBza2lwcGVkIGFuZCBmYWlsZWQgdGVzdHMpIHdpbGwgYmUgcHJpbnRlZCBh dCB0aGUgZW5kIG9mIHRoZSB0ZXN0c3VpdGUKLXJ1bi4KK3J1bi4gIEJ5IGRlZmF1bHQsIHRo ZSBmaXJzdCBsaW5lIG9mIHRoZSBzdW1tYXJ5IGhhcyB0aGUgZm9ybToKKworQGV4YW1wbGUK K1Rlc3RzdWl0ZSBzdW1tYXJ5IGZvciBAdmFye3BhY2thZ2Utc3RyaW5nfQorQGVuZCBleGFt cGxlCisKK0BjIFNlZSBhdXRvbWFrZSBidWcjMTE3NDUuCitAdmluZGV4IEFNX1RFU1RTVUlU RV9TVU1NQVJZX0hFQURFUgorQG5vaW5kZW50Cit3aGVyZSBAdmFye3BhY2thZ2Utc3RyaW5n fSBpcyB0aGUgbmFtZSBhbmQgdmVyc2lvbiBvZiB0aGUgcGFja2FnZS4gIElmCit5b3UgaGF2 ZSBzZXZlcmFsIGluZGVwZW5kZW50IHRlc3Qgc3VpdGVzIGZvciBkaWZmZXJlbnQgcGFydHMg b2YgdGhlCitwYWNrYWdlLCB0aG91Z2gsIGl0IGNhbiBiZSBtaXNsZWFkaW5nIGZvciBlYWNo IHN1aXRlIHRvIGltcGx5IGl0IGlzCitmb3IgdGhlIHdob2xlIHBhY2thZ2UuICBPciwgaW4g Y29tcGxleCBwcm9qZWN0cywgeW91IG1heSB3aXNoIHRvIGFkZAordGhlIGN1cnJlbnQgZGly ZWN0b3J5IG9yIG90aGVyIGluZm9ybWF0aW9uIHRvIHRoZSB0ZXN0c3VpdGUgaGVhZGVyCits aW5lLiAgU28geW91IGNhbiBvdmVycmlkZSB0aGUgQHNhbXB7IGZvciBAdmFye3BhY2thZ2Ut c3RyaW5nfX0gc3VmZml4CitvbiB0aGF0IGxpbmUgYnkgc2V0dGluZyB0aGUgQGNvZGV7QU1f VEVTVFNVSVRFX1NVTU1BUllfSEVBREVSfQordmFyaWFibGUuICBUaGUgdmFsdWUgb2YgdGhp cyB2YXJpYWJsZSBpcyB1c2VkIHVucXVvdGVkIGluIGEgc2hlbGwgZWNobworY29tbWFuZCwg c28geW91IG11c3QgaW5jbHVkZSBhbnkgbmVjZXNzYXJ5IHF1b3Rlcy4gIEZvciBleGFtcGxl LCB0aGUKK2RlZmF1bHQgdmFsdWUgaXMKKworQGV4YW1wbGUKK0FNX1RFU1RTVUlURV9TVU1N QVJZX0hFQURFUiA9ICIgZm9yICQoUEFDS0FHRV9TVFJJTkcpIgorQGVuZCBleGFtcGxlCisK K0Bub2luZGVudAoraW5jbHVkaW5nIHRoZSBkb3VibGUgcXVvdGVzIChpbnRlcnByZXRlZCBi eSB0aGUgc2hlbGwpIGFuZCB0aGUgbGVhZGluZworc3BhY2UgKHNpbmNlIHRoZSB2YWx1ZSBp cyBvdXRwdXQgZGlyZWN0bHkgYWZ0ZXIgdGhlIEBzYW1we1Rlc3RzdWl0ZQorc3VtbWFyeX0p LiAgVGhlIEBjb2RleyQoUEFDS0FHRV9TVFJJTkcpfSBpcyBzdWJzdGl0dXRlZCBieSBAY29k ZXttYWtlfS4KIAogQGFuY2hvcntTaW1wbGUgdGVzdHMgYW5kIGNvbG9yLXRlc3RzfQogQHZp bmRleCBBTV9DT0xPUl9URVNUUwpkaWZmIC0tZ2l0IGEvbGliL2FtL2NoZWNrLmFtIGIvbGli L2FtL2NoZWNrLmFtCmluZGV4IDFjN2U5NTIuLjFiYjU0ZTIgMTAwNjQ0Ci0tLSBhL2xpYi9h bS9jaGVjay5hbQorKysgYi9saWIvYW0vY2hlY2suYW0KQEAgLTI0Myw2ICsyNDMsOSBAQCBh bS0tZm5vcmQgJChURVNUX0xPR1MpICQoVEVTVF9MT0dTOi5sb2c9LnRycyk6ICQoYW1fX2Zv cmNlX3JlY2hlY2spCiBhbS0tZm9yY2UtcmVjaGVjazoKIAlAOgogCisjIyBFeGlzdHMgb25s eSB0byBiZSBvdmVycmlkZGVuLiAgU2VlIGJ1ZyMxMTc0NS4KK0FNX1RFU1RTVUlURV9TVU1N QVJZX0hFQURFUiA9ICIgZm9yICQoUEFDS0FHRV9TVFJJTkcpIgorCiAkKFRFU1RfU1VJVEVf TE9HKTogJChURVNUX0xPR1MpCiAJQCQoYW1fX3NldF9URVNUU19iYXNlcyk7IFwKICMjIEhl bHBlciBzaGVsbCBmdW5jdGlvbiwgdGVsbHMgd2hldGhlciBhIHBhdGggcmVmZXJzIHRvIGFu IGV4aXN0aW5nLApAQCAtMzc1LDcgKzM3OCw3IEBAICQoVEVTVF9TVUlURV9MT0cpOiAkKFRF U1RfTE9HUykKICMjIE11bHRpIGxpbmUgY29sb3JpbmcgaXMgcHJvYmxlbWF0aWMgd2l0aCAi bGVzcyAtUiIsIHNvIHdlIHJlYWxseSBuZWVkCiAjIyB0byBjb2xvciBlYWNoIGxpbmUgaW5k aXZpZHVhbGx5LgogCWVjaG8gIiQke2NvbH0kJGJyJCR7c3RkfSI7IAkJCQkJXAotCWVjaG8g IiQke2NvbH1UZXN0c3VpdGUgc3VtbWFyeSBmb3IgJChQQUNLQUdFX1NUUklORykkJHtzdGR9 IjsJXAorCWVjaG8gIiQke2NvbH1UZXN0c3VpdGUgc3VtbWFyeSIkKEFNX1RFU1RTVUlURV9T VU1NQVJZX0hFQURFUikiJCR7c3RkfSI7CVwKIAllY2hvICIkJHtjb2x9JCRiciQke3N0ZH0i OyAJCQkJCVwKICMjIFRoaXMgaXMgZXhwZWN0ZWQgdG8gZ28gdG8gdGhlIGNvbnNvbGUsIHNv IGl0IG1pZ2h0IGhhdmUgdG8gYmUgY29sb3JpemVkLgogCWNyZWF0ZV90ZXN0c3VpdGVfcmVw b3J0IC0tbWF5YmUtY29sb3I7CQkJCVwKZGlmZiAtLWdpdCBhL3QvYXgvdGVzdHN1aXRlLXN1 bW1hcnktY2hlY2tzLnNoIGIvdC9heC90ZXN0c3VpdGUtc3VtbWFyeS1jaGVja3Muc2gKaW5k ZXggMzBkYmE3NS4uMGI1OTY3YSAxMDA2NDQKLS0tIGEvdC9heC90ZXN0c3VpdGUtc3VtbWFy eS1jaGVja3Muc2gKKysrIGIvdC9heC90ZXN0c3VpdGUtc3VtbWFyeS1jaGVja3Muc2gKQEAg LTE1LDcgKzE1LDcgQEAKICMgYWxvbmcgd2l0aCB0aGlzIHByb2dyYW0uICBJZiBub3QsIHNl ZSA8aHR0cHM6Ly93d3cuZ251Lm9yZy9saWNlbnNlcy8+LgogCiAjIENoZWNrIHRoZSB0ZXN0 c3VpdGUgc3VtbWFyeSB3aXRoIHRoZSBwYXJhbGxlbCB0ZXN0IGhhcm5lc3MuICBUaGlzCi0j IHNjcmlwdCBpcyBtZWFudCB0byBiZSBzb3VyY2VkIGJ5IG90aGVyIHRlc3Qgc2NyaXB0LCBz byB0aGF0IGl0IGNhbgorIyBzY3JpcHQgaXMgbWVhbnQgdG8gYmUgc291cmNlZCBieSBvdGhl ciB0ZXN0IHNjcmlwdHMsIHNvIHRoYXQgaXQgY2FuCiAjIGJlIHVzZWQgdG8gY2hlY2sgZGlm ZmVyZW50IHNjZW5hcmlvcyAoY29sb3JpemVkIGFuZCBub24tY29sb3JpemVkCiAjIHRlc3Rz dWl0ZSBvdXRwdXQsIHBhY2thZ2VzIHdpdGggYW5kIHdpdGhvdXQgYnVnLXJlcG9ydCBhZGRy ZXNzZXMsCiAjIHRlc3RzdWl0ZXMgaW4gc3ViZGlyZWN0b3JpZXMsIC4uLikKZGlmZiAtLWdp dCBhL3QvbGlzdC1vZi10ZXN0cy5tayBiL3QvbGlzdC1vZi10ZXN0cy5tawppbmRleCA0M2Vh MjQ1Li4xNjA4MzEzIDEwMDY0NAotLS0gYS90L2xpc3Qtb2YtdGVzdHMubWsKKysrIGIvdC9s aXN0LW9mLXRlc3RzLm1rCkBAIC04MTcsNiArODE3LDcgQEAgdC90ZXN0cy1lbnZpcm9ubWVu dC1iYWNrY29tcGF0LnNoIFwKIHQvdGVzdHN1aXRlLXN1bW1hcnktY29sb3Iuc2ggXAogdC90 ZXN0c3VpdGUtc3VtbWFyeS1jb3VudC5zaCBcCiB0L3Rlc3RzdWl0ZS1zdW1tYXJ5LWNvdW50 LW1hbnkuc2ggXAordC90ZXN0c3VpdGUtc3VtbWFyeS1oZWFkZXIuc2ggXAogdC90ZXN0c3Vp dGUtc3VtbWFyeS1yZWZlcmVuY2UtbG9nLnNoIFwKIHQvdGVzdC1kcml2ZXItYWNzdWJzdC5z aCBcCiB0L3Rlc3QtZHJpdmVyLWNvbmQuc2ggXApkaWZmIC0tZ2l0IGEvdC90ZXN0c3VpdGUt c3VtbWFyeS1oZWFkZXIuc2ggYi90L3Rlc3RzdWl0ZS1zdW1tYXJ5LWhlYWRlci5zaApuZXcg ZmlsZSBtb2RlIDEwMDY0NAppbmRleCAwMDAwMDAwLi5mMTk0MDg2Ci0tLSAvZGV2L251bGwK KysrIGIvdC90ZXN0c3VpdGUtc3VtbWFyeS1oZWFkZXIuc2gKQEAgLTAsMCArMSw5MSBAQAor IyEgL2Jpbi9zaAorIyBDb3B5cmlnaHQgKEMpIDIwMTEtMjAyMCBGcmVlIFNvZnR3YXJlIEZv dW5kYXRpb24sIEluYy4KKyMKKyMgVGhpcyBwcm9ncmFtIGlzIGZyZWUgc29mdHdhcmU7IHlv dSBjYW4gcmVkaXN0cmlidXRlIGl0IGFuZC9vciBtb2RpZnkKKyMgaXQgdW5kZXIgdGhlIHRl cm1zIG9mIHRoZSBHTlUgR2VuZXJhbCBQdWJsaWMgTGljZW5zZSBhcyBwdWJsaXNoZWQgYnkK KyMgdGhlIEZyZWUgU29mdHdhcmUgRm91bmRhdGlvbjsgZWl0aGVyIHZlcnNpb24gMiwgb3Ig KGF0IHlvdXIgb3B0aW9uKQorIyBhbnkgbGF0ZXIgdmVyc2lvbi4KKyMKKyMgVGhpcyBwcm9n cmFtIGlzIGRpc3RyaWJ1dGVkIGluIHRoZSBob3BlIHRoYXQgaXQgd2lsbCBiZSB1c2VmdWws CisjIGJ1dCBXSVRIT1VUIEFOWSBXQVJSQU5UWTsgd2l0aG91dCBldmVuIHRoZSBpbXBsaWVk IHdhcnJhbnR5IG9mCisjIE1FUkNIQU5UQUJJTElUWSBvciBGSVRORVNTIEZPUiBBIFBBUlRJ Q1VMQVIgUFVSUE9TRS4gIFNlZSB0aGUKKyMgR05VIEdlbmVyYWwgUHVibGljIExpY2Vuc2Ug Zm9yIG1vcmUgZGV0YWlscy4KKyMKKyMgWW91IHNob3VsZCBoYXZlIHJlY2VpdmVkIGEgY29w eSBvZiB0aGUgR05VIEdlbmVyYWwgUHVibGljIExpY2Vuc2UKKyMgYWxvbmcgd2l0aCB0aGlz IHByb2dyYW0uICBJZiBub3QsIHNlZSA8aHR0cHM6Ly93d3cuZ251Lm9yZy9saWNlbnNlcy8+ LgorCisjIENoZWNrIHRoYXQgd2UgY2FuIG92ZXJyaWRlIHRoZSAiVGVzdHN1aXRlIHN1bW1h cnkiIGhlYWRlciBsaW5lLAorIyBwZXIgYnVnIzExNzQ1LgorCisuIHRlc3QtbGliLnNoCisK K3VzZV9jb2xvcnM9bm87IHVzZV92cGF0aD1ubworLiB0ZXN0c3VpdGUtc3VtbWFyeS1jaGVj a3Muc2gKKworLi9jb25maWd1cmUKKworIyBDdXQgZG93biBmcm9tIGRvX2NoZWNrIGluIGF4 L3Rlc3RzdWl0ZS1zdW1tYXJ5LWNoZWNrcy5zaAorIyBzbyB0aGF0IHdlIGNhbiBwYXNzIGEg bWFrZSB2YXJpYWJsZSBzZXR0aW5nIGluICQxLgorIworZG9faGVhZGVyX2NoZWNrICgpCit7 CisgIGNhdCA+IHN1bW1hcnkuZXhwCisgIHJ1bl9tYWtlIC1PIC1lIElHTk9SRSBjaGVjayAi JDEiCisgIHRlc3QgJGFtX21ha2VfcmMgLWVxIDAgfHwgZXhpdCAxCisgICRQRVJMICIkYW1f dGVzdGF1eF9zcmNkaXIiL2V4dHJhY3QtdGVzdHN1aXRlLXN1bW1hcnkucGwgc3Rkb3V0ID5z dW1tYXJ5LmdvdCBcCisgICB8fCBmYXRhbF8gImNhbm5vdCBleHRyYWN0IHRlc3RzdWl0ZSBz dW1tYXJ5IgorICBjYXQgc3VtbWFyeS5leHAKKyAgY2F0IHN1bW1hcnkuZ290CisgIGNvbXBh cmU9ZGlmZgorICAkY29tcGFyZSBzdW1tYXJ5LmV4cCBzdW1tYXJ5LmdvdCB8fCBleGl0IDEK K30KKworIyBXZSBkb24ndCBhY3R1YWxseSBydW4gYW55IHRlc3RzLCBvbmx5IGludGVyZXN0 ZWQgaW4gdGhlIGhlYWRlciBsaW5lLgorcmVzdWx0cz0iXAorIyBUT1RBTDogMAorIyBQQVNT OiAgMAorIyBTS0lQOiAgMAorIyBYRkFJTDogMAorIyBGQUlMOiAgMAorIyBYUEFTUzogMAor IyBFUlJPUjogMCIKKyMKK3N1Y2Nlc3NfZm9vdGVyPSR7YnJ9CisKKyMgQ2hlY2sgdGhlIGRl ZmF1bHQuCitoZWFkZXI9IlwKKyR7YnJ9CitUZXN0c3VpdGUgc3VtbWFyeSBmb3IgR05VIEF1 dG9Gb28gNy4xCiske2JyfSIKKyMKK2RvX2hlYWRlcl9jaGVjayAnanVua3Zhcj1qdW5rdmFs JyA8PEVORAorJGhlYWRlcgorJHJlc3VsdHMKKyRzdWNjZXNzX2Zvb3RlcgorRU5ECisKKyMg RWxpZGUgdGhlICJmb3IgJChQQUNLQUdFX1NUUklORykiLgoraGVhZGVyX21pbj0iXAorJHti cn0KK1Rlc3RzdWl0ZSBzdW1tYXJ5Ciske2JyfSIKKyMKK2RvX2hlYWRlcl9jaGVjayAnQU1f VEVTVFNVSVRFX1NVTU1BUllfSEVBREVSPSIiJyA8PEVORAorJGhlYWRlcl9taW4KKyRyZXN1 bHRzCiskc3VjY2Vzc19mb290ZXIKK0VORAorCisjIEFkZCBhIHN1ZmZpeC4KK2hlYWRlcl9t b3JlPSJcCiske2JyfQorVGVzdHN1aXRlIHN1bW1hcnkgZm9yIEdOVSBBdXRvRm9vIDcuMSAo aGkpCiske2JyfSIKKyMKK2RvX2hlYWRlcl9jaGVjayAnQU1fVEVTVFNVSVRFX1NVTU1BUllf SEVBREVSPSIgZm9yICQoUEFDS0FHRV9TVFJJTkcpIChoaSkiJyA8PEVORAorJGhlYWRlcl9t b3JlCiskcmVzdWx0cworJHN1Y2Nlc3NfZm9vdGVyCitFTkQKKworOgotLSAKMS44LjMuMQo= --MM0m98Ak5m-- From debbugs-submit-bounces@debbugs.gnu.org Fri Jun 05 23:30:10 2020 Received: (at 11745) by debbugs.gnu.org; 6 Jun 2020 03:30:10 +0000 Received: from localhost ([127.0.0.1]:50445 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jhPX8-0007WH-H0 for submit@debbugs.gnu.org; Fri, 05 Jun 2020 23:30:10 -0400 Received: from mail-wr1-f53.google.com ([209.85.221.53]:46136) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jhPX6-0007V2-8M for 11745@debbugs.gnu.org; Fri, 05 Jun 2020 23:30:09 -0400 Received: by mail-wr1-f53.google.com with SMTP id x6so11582537wrm.13 for <11745@debbugs.gnu.org>; Fri, 05 Jun 2020 20:30:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=BjcEjWDD+AeVakViGpmNjl5gAjJAqCQzz3/hbRiR2vE=; b=aXqA9v5Q0g2SmPuXAcvd6r8Ra3jYyRikXL943jMycHHFW1rpMEfWrWDrUy0hkTr9ok c6H6kO1Ag/h7I7XoDAktonhGwpJbLoKEtki9Aq6G4S1+jF1Pp0jbNA04zQSycjGd4msY AOYFFYBwcTVuMRDMiFgidbWvlAAIAC0NJ8EoDenHUlx8y/xR1w3JC40kibb+MNFICMxE Sqy8go2POBexemUYCERBMo13C4mSa0P2iwjVUjhHSpITIrdZs0msI0MOX5887/8b/+by ua8a+EmTXUsisTuhH+l4Cdhi80iXXyIhXwGUdvMB/5hU6LE5blRMZtl5CjFYrxECe1pQ wcAA== X-Gm-Message-State: AOAM530z/6mzwbr3WYqnxk+O58XigUfhuaIFA2lCYbH8HCtjTYalTa6o drm6MmJdGKVfe0dmPMysAa77ntzfHkMqfwauRus= X-Google-Smtp-Source: ABdhPJxbSrhwDd7rIEXWbGON3rWNjq15Pp0VvgygZ/eCQ7PANlugx2qlrHJGAFdjVgwo/nIhL/y85bvfOVLun72WKkQ= X-Received: by 2002:a05:6000:87:: with SMTP id m7mr12761274wrx.306.1591414202474; Fri, 05 Jun 2020 20:30:02 -0700 (PDT) MIME-Version: 1.0 References: <202006020144.0521iNkq012173@freefriends.org> In-Reply-To: <202006020144.0521iNkq012173@freefriends.org> From: Jim Meyering Date: Fri, 5 Jun 2020 20:29:50 -0700 Message-ID: Subject: Re: bug#11745: the new test-suite summary is confusing To: Karl Berry Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: 11745 Cc: adl@lrde.epita.fr, 11745@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.5 (/) On Mon, Jun 1, 2020 at 6:46 PM Karl Berry wrote: > Hi Alexandre and all - regarding > https://debbugs.gnu.org/cgi/bugreport.cgi?bug=11745 (12 years ago, oh well). > > I upgraded to Automake 1.12.1 to discover the each of these test-suite > [directories] now displays a huge summary like: > ============================================================================ > Testsuite summary for spot 0.9.1a > ... > The above in definitely *not* a testsuite summary for > the project, it's only a test summary for one directory. > > Agreed, but: > > I think the easiest fix would be to change the header to just > "Testsuite summary", without mentioning the package. > > I don't think that's the right fix. In TeX Live, we have many different > packages, all in one Automake tree, and if every testsuite summary just > said "TeX Live", it would be difficult to discern what the summary was > reporting on. That is, the TL make check output starts like this: > Testsuite summary for Kpathsea 6.3.3/dev > .. > Testsuite summary for zlib (TeX Live) 1.2.11 > .. > Testsuite summary for lua53 (TeX Live) 5.3.5 > > If all of those just said "TeX Live", it wouldn't be good. > > > I don't think we should change the default form of the Automake header > line at this late date, since some packages (and plenty of AM's own > tests) might well be expecting what's currently output. > > So I propose to define a new variable in lib/am/check.am: > AM_TESTSUITE_SUMMARY_HEADER = " for $(PACKAGE_STRING)" > so the default is unchanged. Thanks, Karl! This looks great. Only one minor suggestion: to use single quotes there, rather than double: AM_TESTSUITE_SUMMARY_HEADER = ' for $(PACKAGE_STRING)' so that the replacement value is less likely to require additional escaping. From debbugs-submit-bounces@debbugs.gnu.org Sat Jun 06 18:48:46 2020 Received: (at 11745) by debbugs.gnu.org; 6 Jun 2020 22:48:46 +0000 Received: from localhost ([127.0.0.1]:52707 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jhhcM-00034O-2r for submit@debbugs.gnu.org; Sat, 06 Jun 2020 18:48:46 -0400 Received: from freefriends.org ([96.88.95.60]:35904) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jhhcL-00034C-1R; Sat, 06 Jun 2020 18:48:45 -0400 X-Envelope-From: karl@freefriends.org Received: from freefriends.org (freefriends.org [96.88.95.60]) by freefriends.org (8.14.7/8.14.7) with ESMTP id 056MmfcO029786 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 6 Jun 2020 16:48:42 -0600 Received: (from apache@localhost) by freefriends.org (8.14.7/8.14.7/Submit) id 056MmeFL029785; Sat, 6 Jun 2020 16:48:40 -0600 Date: Sat, 6 Jun 2020 16:48:40 -0600 Message-Id: <202006062248.056MmeFL029785@freefriends.org> From: Karl Berry To: jim@meyering.net Subject: Re: bug#11745: the new test-suite summary is confusing In-Reply-To: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 11745 Cc: adl@lrde.epita.fr, 11745@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) AM_TESTSUITE_SUMMARY_HEADER = ' for $(PACKAGE_STRING)' I went back and forth on which quotes to use :). Ok, accepted, pushed, thanks :). -k From unknown Tue Jun 17 20:19:59 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Sun, 05 Jul 2020 11:24:05 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator