From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it Resent-From: Kasper k Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Thu, 01 Jul 2021 07:23:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: 49309@debbugs.gnu.org X-Debbugs-Original-To: "bug-automake@gnu.org" Received: via spool by submit@debbugs.gnu.org id=B.1625124167415 (code B ref -1); Thu, 01 Jul 2021 07:23:02 +0000 Received: (at submit) by debbugs.gnu.org; 1 Jul 2021 07:22:47 +0000 Received: from localhost ([127.0.0.1]:59430 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lyr26-00006d-OM for submit@debbugs.gnu.org; Thu, 01 Jul 2021 03:22:46 -0400 Received: from lists.gnu.org ([209.51.188.17]:39248) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lyn2H-0001v0-Sg for submit@debbugs.gnu.org; Wed, 30 Jun 2021 23:06:42 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34688) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lyn2H-0002dM-Nd for bug-automake@gnu.org; Wed, 30 Jun 2021 23:06:41 -0400 Received: from mail-dm6nam11olkn20804.outbound.protection.outlook.com ([2a01:111:f400:7eaa::804]:52192 helo=NAM11-DM6-obe.outbound.protection.outlook.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lyn2E-00059x-Fu for bug-automake@gnu.org; Wed, 30 Jun 2021 23:06:41 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aQnaspgrH8/aJehtZo3ON5exw329Th65V53s9nqyZM9LNKIsGAudrgxkMr46WW2GIp8Xx8ouoAvmjHahbuSU6Us72k+CzK+zJhjCdklD/iJXZwQx/3JNVCx9m+SvQFxD3l9YDb4BuBV1H0h8QCnFdCAKrsbe9P7+2yi8t3aEQ17B5xIgDfTg6ns9g14RZpuo6AbWj4gHqadUkmNIGM/hEDy4nfE5CW5lGq9IqPL78jWb8R2v5VAGB4W3+ob9UAkJ0EXiAUYXiFmrtesAOy1ceKW2/HSvZw9Nf9HrZQuY6wHrtSkNposHI3sXYbrd1cTcRsoPEO0oci9fJy7SIeJwsA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KleL/lbXa1+zXR/C8M8VirjZzw7vkhPay5+6PSBULtM=; b=hXt1J1EN3O25IPIcvbura4ZgeNxOznmyJ1tcBcmi7vk8U+MBZk7pixAZbAEgc20onFapXEwF6IyhbwoFbnk3SYnuKnGwG8mW78Na4MP2+q33nQooGiPrNOXwvmwaHLhmg6hFuwNL/ys+27ronz7SwaIFeWMatbh7mihMIQPCFVKp0YPg8vTyVQT2FmvqHPKTtl824GZ342bnTYJ6Kx04NAepBxyaAIk6Xy4c3jpbyvTHOT5yDLo5M8zmmTCDd6ixm30mrdR2ALeE3ihXrvveIBFJjOjFWREJL8kQOh7dwFtdKI6rPCfHkvep07j1YkwYKbNG7Va/jFXxDjcWzk8mJQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KleL/lbXa1+zXR/C8M8VirjZzw7vkhPay5+6PSBULtM=; b=MvCiIUr9c/p7VH/Arh1XL3Z+eLQ7XalkX7yvDif3Vq7qZbF7GNOZaWB21HpchQ0jt2SHNaeCEVmkuoV7Uht9Rsm+mkUQnDJdVincjtpCUzDpltl3rVVDcGftCw6aHyPLFLFSC2QMXB1YuET5vmYQJJZ+jTt5c7oLqGWVJzIvkEqfgbv9w5ePm489RXyZmV2INfRvpRyFkmsikZK83UDolV+pt+B4LAOCDYkHpAFeibxG8nC1hp/892vc+MPY4KFmg6x0NudOa8yI83197Uq6r9KsPun38SSjb2DCav+NhNd5qzi6TzhZhMKQWxdDMGHbmgtazkzmppoFEKa2PWwtWQ== Received: from BN8NAM11FT033.eop-nam11.prod.protection.outlook.com (2a01:111:e400:fc4b::40) by BN8NAM11HT178.eop-nam11.prod.protection.outlook.com (2a01:111:e400:fc4b::483) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22; Thu, 1 Jul 2021 03:01:30 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com (2a01:111:e400:fc4b::41) by BN8NAM11FT033.mail.protection.outlook.com (2a01:111:e400:fc4b::405) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22 via Frontend Transport; Thu, 1 Jul 2021 03:01:30 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff]) by SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff%3]) with mapi id 15.20.4287.023; Thu, 1 Jul 2021 03:01:30 +0000 From: Kasper k Thread-Topic: Feature Request: Automake script based tests to print the test name before running it Thread-Index: AQHXbiIZMuA/BLVLtE+fylkODTwfqA== Date: Thu, 1 Jul 2021 03:01:30 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:446E24CAFF6FEA3806DA9E3E1C4F4A44ECE1D577430AF818E939827228E6BF83; UpperCasedChecksum:A31CFE82003DA4330AFE97228D3813AC4D34DFE27B7EC06DC15BB790945AFCB5; SizeAsReceived:6800; Count:42 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [2vdUgyRcgS8rXcNj3GHjywPZVHIXEAP7] x-ms-publictraffictype: Email x-incomingheadercount: 42 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: 86ed05eb-fe00-4e6a-d12a-08d93c3c868c x-ms-traffictypediagnostic: BN8NAM11HT178: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 4dIFmIX7bN1FabwTzaEw3+rVT9C5Gy0dhAYLeqSYC3G/P1MCDfuVmqokJg49OzGu3YXpoID9kCDxmIbUSiTZq17RVCcb4TIKu+9g92S6mKyeSFcftPp0eoxPeCVhtfBSCoZXlNs2TI24NvXHEFGM3Bec0Er/KQVKRBzt5S/yBX17AxZbV0Sz8BeZ6P5bX/h6tR9nHTRkzyADVJpSCbmTZ9sT4N0ZFHiUNbQQDwzDaYja2TBKlkZmsD2FJT2GmjIMYuMr9Jd5QH8gFZxYDpP3npKTvLQ3AVcOadI/3TNscgmCwnNuEuKwLkvONCC1naExpbRbNksJhx71bc4dv4nEmCECqt4mNOHdpkNnTr5BMp5RfFeWofn4J2+lxaiiYp2L6TAxIva8wMKnIkZhNOxdvAQ/xIC5zgh4LQjHiL2MFcO/vkXAf0DNIb8i8gg3gpIlA1qVhiICl953EdCZgDUflOIlzVOwQWSDpvQ85GLQ8GToM4dtcE+J18E7uTlPvjSRXv+mZQMnAW+08XToagaP3w== x-ms-exchange-antispam-messagedata: eIWh9tWjJb+ZuSi2RHLqGIE08shk+y4o1hovbp2Rs3shfHJfx3cmqv3p+G3tlyxIvZWEKQczI/FAXi82N3bzH1gEmach8EN2M/ghlR6PA7qyrsuo9dEeckfmxEdXPXeE/n4V49HMcT5sOo62tVujcA== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT033.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 86ed05eb-fe00-4e6a-d12a-08d93c3c868c X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Jul 2021 03:01:30.0716 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8NAM11HT178 Received-SPF: pass client-ip=2a01:111:f400:7eaa::804; envelope-from=kasperkantz@outlook.com; helo=NAM11-DM6-obe.outbound.protection.outlook.com X-Spam_score_int: 6 X-Spam_score: 0.6 X-Spam_bar: / X-Spam_report: (0.6 / 5.0 requ) BAYES_50=0.8, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.5 (/) X-Mailman-Approved-At: Thu, 01 Jul 2021 03:22:45 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) Hello automake devs,=0A= =0A= In script based testsuites (https://www.gnu.org/software/automake/manual/ht= ml_node/Scripts_002dbased-Testsuites.html#Scripts_002dbased-Testsuites), wh= en we run `make check` it prints one of the following string for each test:= PASS , FAIL , XFAIL or SKIP .=0A= =0A= However, in some cases (long running test, flaky test, other inconclusive o= nes for more involved reasons), it is essential to know which test is curre= ntly in flight. Especially in CI systems, where flakiness every now and the= n, due to external factors, is almost unavoidable.=0A= =0A= It would be very helpful if a new option AM_TESTS_NAME=3D1 is provided, whi= ch would change the stdout output from:=0A= =0A= =0A= PASS (or FAIL/XFAIL/SKIP) $name=0A= =0A= to something like:=0A= =0A= RUNNING $name=0A= =0A= PASS (or FAIL/XFAIL/SKIP) $name=0A= =0A= this way we can easily find out the name of test (or multiple of them; in c= ase of parallel execution) which is (are) currently running.=0A= =0A= Thanks,=0A= /K= From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it Resent-From: Peter Johansson Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Thu, 01 Jul 2021 13:31:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: Kasper k , 49309@debbugs.gnu.org Received: via spool by 49309-submit@debbugs.gnu.org id=B49309.16251462185782 (code B ref 49309); Thu, 01 Jul 2021 13:31:01 +0000 Received: (at 49309) by debbugs.gnu.org; 1 Jul 2021 13:30:18 +0000 Received: from localhost ([127.0.0.1]:59980 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lywlm-0001VC-1X for submit@debbugs.gnu.org; Thu, 01 Jul 2021 09:30:18 -0400 Received: from mail-pj1-f53.google.com ([209.85.216.53]:38452) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lywlh-0001UR-GH for 49309@debbugs.gnu.org; Thu, 01 Jul 2021 09:30:17 -0400 Received: by mail-pj1-f53.google.com with SMTP id cs1-20020a17090af501b0290170856e1a8aso6936542pjb.3 for <49309@debbugs.gnu.org>; Thu, 01 Jul 2021 06:30:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=TjH/kvJVXfI4a2nYdU7K2UQyOdvA5k2vd2jexyrg3+E=; b=eEGhuzt4nG4A/6D5oEHQp1EaHP/fIJ39v3yyqCCQXLzZKmlFycMkNutd4pYOPa/RBr I5FBY74Z7dMGr8hl+oOwJhZv9UGuXgnzWxfH30x8sBTOn4KiVJUFITlr+i3MjoRtAyvI YvmXJeiyyqEfJOnmucDmkPfU7wRfqTEAt+iYtPWn9RKU7XaOsVsyf5NdodFetLkmKs33 j8xUtRZKXmrXBSu1z35zFRU+DNBDKA1z30fxMk7/T5JEqNoH1RIgqPAET7Z7luLq/HW9 cVBIPPTHlAU1eD5Sbmm9uopkT8M+poVL+yMZ0iYNU3R7uEdmf2ywyATqFk/OGpn7kHZI 2H5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=TjH/kvJVXfI4a2nYdU7K2UQyOdvA5k2vd2jexyrg3+E=; b=AyiEISPsGBb+YoE4PcFULmp5GDM0wb7R2J9cjCwCHlqeLOwSHOrrprsrw/gKcdaCph t1DCdXmLKVVFPYlJuxtLQ13t3TvNxODhr9E2NETAUkV/no62t3sbwx+GN43Ft+BYsAHZ 6fUOcX4WIJdlKzQoWVf5PyTo4lSQsAgWtSpRzLw07X/g/aqmbvDP74SkbpGifbrV1fVd EgFYZ7QVR9sgtRA6zDDASDdbnLbL7g4s4+wgk9JW00NlIKH5ZtesASL/+ovBqa9jFJTh m8JBGkaS2IrmKDVwwjsfLT4YpUzdksMVplZ/IDbUoVgH8fhcirD6GyNtwKYsnncGbyra Uiqg== X-Gm-Message-State: AOAM530ri0hxpQzq41d0a5R/JAI1M3qyNwc8mPz1up2/Y72HK14ZLW2/ WghiqQxjU5fW0jhLS4tmXKJMIu+rgts= X-Google-Smtp-Source: ABdhPJxFhmUyA7U+aj37nCHj2fDPDngBXoksApId256vMDWXsVL19BYdDpfO6bC1MrcQ6D3GI3QwKA== X-Received: by 2002:a17:902:b218:b029:11a:bf7b:1a80 with SMTP id t24-20020a170902b218b029011abf7b1a80mr36770670plr.82.1625146207157; Thu, 01 Jul 2021 06:30:07 -0700 (PDT) Received: from [10.1.1.50] ([118.208.69.130]) by smtp.gmail.com with ESMTPSA id z3sm51938pfa.67.2021.07.01.06.30.04 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 01 Jul 2021 06:30:06 -0700 (PDT) References: From: Peter Johansson Message-ID: <44e1cca6-bbb4-0df4-3967-bbefe9f4c081@gmail.com> Date: Thu, 1 Jul 2021 23:30:02 +1000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Kasper, I leave to the maintainers to comment on the suggestion, but in the meantime... On 1/7/21 1:01 pm, Kasper k wrote: > Hello automake devs, > > In script based testsuites (https://www.gnu.org/software/automake/manual/html_node/Scripts_002dbased-Testsuites.html#Scripts_002dbased-Testsuites), when we run `make check` it prints one of the following string for each test: PASS , FAIL , XFAIL or SKIP . > > However, in some cases (long running test, flaky test, other inconclusive ones for more involved reasons), it is essential to know which test is currently in flight. Especially in CI systems, where flakiness every now and then, due to external factors, is almost unavoidable. > > It would be very helpful if a new option AM_TESTS_NAME=1 is provided, which would change the stdout output from: > > > PASS (or FAIL/XFAIL/SKIP) $name > > to something like: > > RUNNING $name > > PASS (or FAIL/XFAIL/SKIP) $name Please note that that output comes from the test-driver script. If you're not happy with the default test-driver, you can declare to use your own my-test-driver (see https://www.gnu.org/software/automake/manual/automake.html#Declaring-Custom-Test-Drivers), and for example this could be a modified version of 'test-driver' script provided by Automake. Adding a line outputting 'Running $name' is trivial if you know any shell, or otherwise, I'm sure people here can help. > > this way we can easily find out the name of test (or multiple of them; in case of parallel execution) which is (are) currently running. I usually find out which tests are running by looking at the timestamps of log and trace files with something like 'ls -lrt *.log *.trs'. Cheers, Peter From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it Resent-From: Kasper k Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Thu, 01 Jul 2021 21:00:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: Peter Johansson , "49309@debbugs.gnu.org" <49309@debbugs.gnu.org> Received: via spool by 49309-submit@debbugs.gnu.org id=B49309.162517318121578 (code B ref 49309); Thu, 01 Jul 2021 21:00:02 +0000 Received: (at 49309) by debbugs.gnu.org; 1 Jul 2021 20:59:41 +0000 Received: from localhost ([127.0.0.1]:33762 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lz3me-0005bx-CS for submit@debbugs.gnu.org; Thu, 01 Jul 2021 16:59:41 -0400 Received: from mail-mw2nam12olkn2068.outbound.protection.outlook.com ([40.92.23.68]:11808 helo=NAM12-MW2-obe.outbound.protection.outlook.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lz1u8-0002jV-QN for 49309@debbugs.gnu.org; Thu, 01 Jul 2021 14:59:18 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Sh2y62rYmsvdwIwBQC+oKbVr+0h9H3Jn1AbD97zOfJS8SkNBEYZnr0In25s6T9YLMqgBZbkSSEzY6IHoD38XJjJKQWC9cUrCjMecxoj9LeOPWtFvAF7LSBM99CToAL4fLjr/4hPdiC4X/kzdge0X9/5zL15dKCpCo2ug7bCpiK1SL7kpcsJ8xK/IbuFHMOmCY6Zo1OCrWkZLeoEAOY3LXQLVF8vaZP7FzugozUa6KO5kyuF83thVp1X7f/1VswqKvRSdlTJT6kEuOitarg9Z5LDaXwBD7XnSJmU2TzBjVKfKfFFEIiXylFnfUs3aoWwgMNz87om75txOAdQbOf7RsQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=HMTM4uBlFn91YulnDX/zqgRLPWy7YF5lsbW+NKERFt4=; b=g58vAGw7mdRZwiGu+j7RVZbhPvTfT21V29SXw0C4IyPnoURIVjwsN99Tx4r1poZt24kAOLBjdqkg8hwNRMd6/F7e0a8DOdWN8plgyPsaJT9porDNucenIzERhXa66c+mgmwPDsUULJmVQm9JizsMykFMOef06qRZOVloqGt3hM7qpn/+WgPyOuWyD2lbcFbAfenyz7coyadnUpPOT8tZtb7CQUvVt33i+TPAryoOtt7bD1R/rcgx0tONY4JNsSJPNzy39DlUqMqOPDbWgID4y/jtgqaCPeOF4HG4XXKXI9mXUFxKWZxN6AzQ4aZrpKXF4D9nTbqwoeymG4ITAijwrA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=HMTM4uBlFn91YulnDX/zqgRLPWy7YF5lsbW+NKERFt4=; b=tbME8W6DvJIybxhKhyG0N6cJD/ICr/+0ScW7voVvOZmI8hW2zdWRxD83OeSxp4P0MstIdwe3x20C5L4oQ0VDbfIPu5lkNmKIpvtYPq81vlL/BE7ajwNvRYsHMUzK20M6hn9j2E1qZOrlpNgzM8GRp1nJCUj3j0YzoWY65SezpIddl+Z/lwuKDCFTCnUCa5ZTx0JhNur6tVobiuzy6djPjne6AoJpSWdEpTbsOjgVJiUA11/JC/Me5ge1ycYXuHGbfun8NigeRrrt/hg1aqQzLrn9MrEdiPxTjfijQ7kU3hA/t6oTqL5tos6lagZhhbjGarusAzhXOJgZFnhBquFbEQ== Received: from MW2NAM12FT006.eop-nam12.prod.protection.outlook.com (2a01:111:e400:fc65::51) by MW2NAM12HT047.eop-nam12.prod.protection.outlook.com (2a01:111:e400:fc65::276) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.8; Thu, 1 Jul 2021 18:59:10 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com (2a01:111:e400:fc65::43) by MW2NAM12FT006.mail.protection.outlook.com (2a01:111:e400:fc65::73) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4308.8 via Frontend Transport; Thu, 1 Jul 2021 18:59:10 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff]) by SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff%3]) with mapi id 15.20.4287.023; Thu, 1 Jul 2021 18:59:10 +0000 From: Kasper k Thread-Topic: bug#49309: Feature Request: Automake script based tests to print the test name before running it Thread-Index: AQHXbiIZMuA/BLVLtE+fylkODTwfqKsuHh8AgABXppk= Date: Thu, 1 Jul 2021 18:59:10 +0000 Message-ID: References: , <44e1cca6-bbb4-0df4-3967-bbefe9f4c081@gmail.com> In-Reply-To: <44e1cca6-bbb4-0df4-3967-bbefe9f4c081@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:B1BE599A724E3FE2363567BC85A9CB485F21B610B9D2990C80C4913EB87E3982; UpperCasedChecksum:65A3E1888077A37E4B6331E2C3441EE04D2A07F1D24E39DBA694CE7065C64024; SizeAsReceived:7072; Count:44 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [qzDrM/a+m1p1u8MnE/7IsmfOpCpImY+a] x-ms-publictraffictype: Email x-incomingheadercount: 44 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: e408aa11-bb7f-43c5-2083-08d93cc24f5c x-ms-traffictypediagnostic: MW2NAM12HT047: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: +CI3ukqzVZfJAf09+BvpPnMjHzBjzvBY7FvuU3HvoDILEd82fyyfxLWVQJmA9QaeOOFFKh+ujqaMlfOcRk61Lrpi5GpAU9W+fyPdjuCgT9PaQ+tDpsJ7L1eoDj6oXVCqIhXyyzjlu1e7B9y82dUlpUL/uEQUu/tc5ybSay5NsNc/ecqy2avUhj7nTiA4Lr4bOUCZSKzjTN8lq3Fr0WW9pTs/n0GvJlmclxTC/KBuDVLYXiqNPRD6BQDHsd4+lWzxVXi9X7kItgUxxOLqytPs5GJa/spEhK9fJem56n70BVM2GeTxXCUFKiQk/7KOgvJ+Q1BlNNH8qxQqejPEoVCctu3ZgL0ZwRJQPnnmTa9E3zDkpmsqt/YW8dO6qRySK8PkyOBaypEIkzkyvYSCsliXt6STLhoEDOvnnkSmEtbKMHdBeEyyGcgBmXtEgc1iO3ZGMmin2fUyg6TOfLVSFZapiNoVpXA9tXC4s+YgBZDvNf13/HAPcmHFARnc3bZVPusr2GKrea/rUODyiISAY1QwCA== x-ms-exchange-antispam-messagedata: +sKAsWR0JCU+lSBP7gk7eVS9ujTYaB7kkRNtv25RBNZysky/ArB/6CRTtIZR9q1qoMtUSQ1oU6egxnQtMG95cg38NQtGTHhPpjTeCXuoIILhfXt6m8T0SZg9fiJe/jFS9CCF0kg2r1tpKFJFVdUzlg== x-ms-exchange-transport-forked: True Content-Type: multipart/alternative; boundary="_000_SN2PR0801MB21585146DD4749CC08B2A0B3A7009SN2PR0801MB2158_" MIME-Version: 1.0 X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-AuthSource: MW2NAM12FT006.eop-nam12.prod.protection.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: e408aa11-bb7f-43c5-2083-08d93cc24f5c X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Jul 2021 18:59:10.1385 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW2NAM12HT047 X-Spam-Score: -0.0 (/) X-Mailman-Approved-At: Thu, 01 Jul 2021 16:59:38 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --_000_SN2PR0801MB21585146DD4749CC08B2A0B3A7009SN2PR0801MB2158_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hi Peter, Thanks for your reply. As to the workarounds, they are just that and I had coined my own for "my m= achine" =99. The standard solution for "display test name before starting i= t" (controlled by a new AC option) would be much more palatable for consume= r to add to their Makefile.am and check into their source tree. Then if so= me intermittent bad situation happens in unattended/disposable CI environme= nt, as an example, then we won't be needing to opt into any kind of workaro= und, it'd be just there right in the "regular" make-check logs; without int= roducing crazy amount of verbosity (which set -x, VERBOSE=3D1 etc. renders)= . /K ________________________________ From: Peter Johansson Sent: Thursday, July 1, 2021 1:30 PM To: Kasper k ; 49309@debbugs.gnu.org <49309@debbug= s.gnu.org> Subject: Re: bug#49309: Feature Request: Automake script based tests to pri= nt the test name before running it Hi Kasper, I leave to the maintainers to comment on the suggestion, but in the meantime... On 1/7/21 1:01 pm, Kasper k wrote: > Hello automake devs, > > In script based testsuites (https://www.gnu.org/software/automake/manual/= html_node/Scripts_002dbased-Testsuites.html#Scripts_002dbased-Testsuites), = when we run `make check` it prints one of the following string for each tes= t: PASS , FAIL , XFAIL or SKIP . > > However, in some cases (long running test, flaky test, other inconclusive= ones for more involved reasons), it is essential to know which test is cur= rently in flight. Especially in CI systems, where flakiness every now and t= hen, due to external factors, is almost unavoidable. > > It would be very helpful if a new option AM_TESTS_NAME=3D1 is provided, w= hich would change the stdout output from: > > > PASS (or FAIL/XFAIL/SKIP) $name > > to something like: > > RUNNING $name > > PASS (or FAIL/XFAIL/SKIP) $name Please note that that output comes from the test-driver script. If you're not happy with the default test-driver, you can declare to use your own my-test-driver (see https://www.gnu.org/software/automake/manual/automake.html#Declaring-Custom= -Test-Drivers), and for example this could be a modified version of 'test-driver' script provided by Automake. Adding a line outputting 'Running $name' is trivial if you know any shell, or otherwise, I'm sure people here can help. > > this way we can easily find out the name of test (or multiple of them; in= case of parallel execution) which is (are) currently running. I usually find out which tests are running by looking at the timestamps of log and trace files with something like 'ls -lrt *.log *.trs'. Cheers, Peter --_000_SN2PR0801MB21585146DD4749CC08B2A0B3A7009SN2PR0801MB2158_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable
Hi Peter,

Thanks for your reply.

As to the workarounds, they are just that and I had coined my own for "= ;my machine" =99. The standard solution for &= quot;display test name before starting it" (controlled by a new AC opt= ion) would be much more palatable for consumer to add to their Makefile.am = and check into their source tree.  Then if some intermittent bad situation happens in unattended/disposable CI environment= , as an example, then we won't be needing to opt into any kind of workaroun= d, it'd be just there right in the "regular" make-check logs; wit= hout introducing crazy amount of verbosity (which set -x, VERBOSE=3D1 etc. renders).

/K
From: Peter Johansson <t= rojkan@gmail.com>
Sent: Thursday, July 1, 2021 1:30 PM
To: Kasper k <kasperkantz@outlook.com>; 49309@debbugs.gnu.org = <49309@debbugs.gnu.org>
Subject: Re: bug#49309: Feature Request: Automake script based tests= to print the test name before running it
 
Hi Kasper,

I leave to the maintainers to comment on the suggestion, but in the
meantime...

On 1/7/21 1:01 pm, Kasper k wrote:
> Hello automake devs,
>
> In script based testsuites (https://www.gnu.org/software/automake/manual/html_node/Scripts= _002dbased-Testsuites.html#Scripts_002dbased-Testsuites), when we run `make check` it prints one of the following string for each te= st: PASS <testname>, FAIL <testname>, XFAIL <testname> or= SKIP <testname>.
>
> However, in some cases (long running test, flaky test, other inconclus= ive ones for more involved reasons), it is essential to know which test is = currently in flight. Especially in CI systems, where flakiness every now an= d then, due to external factors, is almost unavoidable.
>
> It would be very helpful if a new option AM_TESTS_NAME=3D1 is provided= , which would change the stdout output from:
>
>      <blank stdout and wait for test execu= tion to complete>
>       PASS (or FAIL/XFAIL/SKIP) $name >
> to something like:
>
>      RUNNING $name
>      <blank stdout and wait for test execu= tion to complete>
>       PASS (or FAIL/XFAIL/SKIP) $name
Please note that that output comes from the test-driver script. If
you're not happy with the default test-driver, you can declare to use
your own my-test-driver (see
https://www.gnu.org/software/automake/manual/auto= make.html#Declaring-Custom-Test-Drivers),
and for example this could be a modified version of 'test-driver' script provided by Automake. Adding a line outputting 'Running $name' is
trivial if you know any shell, or otherwise, I'm sure people here can help.=

>
> this way we can easily find out the name of test (or multiple of them;= in case of parallel execution) which is (are) currently running.

I usually find out which tests are running by looking at the timestamps of log and trace files with something like 'ls -lrt *.log *.trs'.

Cheers,

Peter

--_000_SN2PR0801MB21585146DD4749CC08B2A0B3A7009SN2PR0801MB2158_-- From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it Resent-From: Hans-Bernhard =?UTF-8?Q?Br=C3=B6ker?= Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Fri, 02 Jul 2021 17:03:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: Kasper k , Peter Johansson , "49309@debbugs.gnu.org" <49309@debbugs.gnu.org> Received: via spool by 49309-submit@debbugs.gnu.org id=B49309.162524536615975 (code B ref 49309); Fri, 02 Jul 2021 17:03:01 +0000 Received: (at 49309) by debbugs.gnu.org; 2 Jul 2021 17:02:46 +0000 Received: from localhost ([127.0.0.1]:37083 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lzMYw-00049b-6D for submit@debbugs.gnu.org; Fri, 02 Jul 2021 13:02:46 -0400 Received: from mailout06.t-online.de ([194.25.134.19]:53842) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lzMYt-00049Q-EV for 49309@debbugs.gnu.org; Fri, 02 Jul 2021 13:02:44 -0400 Received: from fwd27.aul.t-online.de (fwd27.aul.t-online.de [172.20.26.132]) by mailout06.t-online.de (Postfix) with SMTP id 217C98E655; Fri, 2 Jul 2021 19:02:41 +0200 (CEST) Received: from [192.168.178.26] (r9O-UOZlwh+ZjfdGQ1DTrU9s3bHr--G9YfpMivy7ZiB4f1fGfEGM5mbaliy3FUUwV-@[79.228.83.144]) by fwd27.t-online.de with (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384 encrypted) esmtp id 1lzMYq-1IJefA0; Fri, 2 Jul 2021 19:02:40 +0200 References: <44e1cca6-bbb4-0df4-3967-bbefe9f4c081@gmail.com> From: Hans-Bernhard =?UTF-8?Q?Br=C3=B6ker?= Message-ID: <8384a414-bc05-9b95-8170-0b523d86d140@t-online.de> Date: Fri, 2 Jul 2021 19:02:38 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-ID: r9O-UOZlwh+ZjfdGQ1DTrU9s3bHr--G9YfpMivy7ZiB4f1fGfEGM5mbaliy3FUUwV- X-TOI-EXPURGATEID: 150726::1625245360-000107BB-99461447/0/0 CLEAN NORMAL X-TOI-MSGID: ed999d7a-984d-44cd-9bff-e4983294aee1 X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Am 01.07.2021 um 20:59 schrieb Kasper k: > Then if some intermittent bad situation happens in > unattended/disposable CI environment, as an example, then we won't be > needing to opt into any kind of workaround, it'd be just there right in > the "regular" make-check logs; without introducing crazy amount of > verbosity (which set -x, VERBOSE=1 etc. renders). IMHO that whole idea loses a most, if not all of its appeal when tests are run in parallel (which CI builds, always pressed for time, will rather likely want to do). As soon as there is more than one line of output, you're back to where you were without this change, or worse. * -Otarget or -Orecurse will undo the desired effect, because make will keep the entire output to itself until the test is done. That's the back to square one part. * -Oline or -Onone modes will print outputs from different tests intermixed, making it virtually impossible to know which result output belongs to which testcase. That's considerably worse than single-line outputs. From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it Resent-From: Kasper k Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Fri, 02 Jul 2021 21:06:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: Hans-Bernhard =?UTF-8?Q?Br=C3=B6ker?= , Peter Johansson , "49309@debbugs.gnu.org" <49309@debbugs.gnu.org> Received: via spool by 49309-submit@debbugs.gnu.org id=B49309.16252599506825 (code B ref 49309); Fri, 02 Jul 2021 21:06:01 +0000 Received: (at 49309) by debbugs.gnu.org; 2 Jul 2021 21:05:50 +0000 Received: from localhost ([127.0.0.1]:37215 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lzQM9-0001m0-Qf for submit@debbugs.gnu.org; Fri, 02 Jul 2021 17:05:50 -0400 Received: from mail-bn8nam08olkn2079.outbound.protection.outlook.com ([40.92.47.79]:65312 helo=NAM04-BN8-obe.outbound.protection.outlook.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lzQM6-0001lj-Ih for 49309@debbugs.gnu.org; Fri, 02 Jul 2021 17:05:48 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QLxCUs23GHTkLUewLS/l9rabKCZcJw4ifYuYaoHFcTxo6xbE6hBfCTpG4QpXJey0Axt77rra2gYlRbNe2e/xmIvboLX9aVlMGtvm+rhOZmLIAlH6MCoC0YELCZEE7VdW7BkSkVP8xCZ90M78C31fD9J2gDIRak0EnwoR0o2fUBLYgqaC4Oq2kR7fMpzcnEbNYgVmxwVFi2wpxVfLi7HrnYFOYyWplkOoMIokZNNt1WGldDEbePJBpJCfSHXrlzxRgorZQt30Hq3BHqvhXPO0VVAvaLT0luVoKN9xQf5ku0KdaSnq2joXI8pg+nmqjhmYCvjYWTnHKm2ZjurriEX5Vw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=HhtjBOUGut5Zqj5QGn9pzcJjMU/e0i77pK2K7/W4/0Y=; b=E1MqE4KfgoXpu9WFR2UiCCxVKyR+AF4lWThWJC+ucTYspAxuzzOMhfZx2AqpUh6oJlChHXzzb6SqKwJTJC8dV31Esf1v4nuvDbxoWi7wGPynNrLGJ21K01zqi/zzqIQnuU1WdzV71HVA5jhCoCW99AapvD5nVYurwUbNGPcULqCz4uMJ4NJcwm3F4rCfYYQAKWnmuZmAQ4Q2xw61t3bMiIMB95ZaBoRWA6lL48oegE57iGDdt1rRr6ZOeb1m+39JLaEMBL4eCt+osIl2F+7sB/aYjh30QL5Ey71TjeBRDXCqXKJfghu4xqbJuEaUnNCkzxPciIPY4Y6VN7QZMpZaoQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=HhtjBOUGut5Zqj5QGn9pzcJjMU/e0i77pK2K7/W4/0Y=; b=QGlHdeou11iPb6fI9sD/lCun38bG06MKgavjT50VIYcvha1+2rAISt5ikptRn5uOHQXdk4ShEuPm1w4oOW7fn/Dk7IMFuP8LeB300RubUcCMCQvYI7+EUuuT9AkAwLAHiO2sDMLifJwirDeRSa6Q/lU7Y1xT/Sqiumu5qZThMWXQIhGT87e/gFcXiapuZ4vbuPdWjx9cRtmcjrD+tcC5EPqY0NQ0wuvBA1U+QAdT+qiidIhryirEPaYcq1Xezh9g83AIKB+KwX7K+d1sLMG24vd3Jfly7r7jfWpbHl88ChSDrOsHgFKKsdIC9X4RA/XVL7mRPOC0sDFPK/8VzmAigw== Received: from DM6NAM04FT014.eop-NAM04.prod.protection.outlook.com (2a01:111:e400:7ea3::4d) by DM6NAM04HT124.eop-NAM04.prod.protection.outlook.com (2a01:111:e400:7ea3::339) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22; Fri, 2 Jul 2021 21:05:39 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com (2a01:111:e400:7ea3::44) by DM6NAM04FT014.mail.protection.outlook.com (2a01:111:e400:7ea3::288) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22 via Frontend Transport; Fri, 2 Jul 2021 21:05:39 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff]) by SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff%3]) with mapi id 15.20.4287.027; Fri, 2 Jul 2021 21:05:39 +0000 From: Kasper k Thread-Topic: bug#49309: Feature Request: Automake script based tests to print the test name before running it Thread-Index: AQHXbiIZMuA/BLVLtE+fylkODTwfqKsuHh8AgABXppmAAXYWAIAAOneW Date: Fri, 2 Jul 2021 21:05:39 +0000 Message-ID: References: <44e1cca6-bbb4-0df4-3967-bbefe9f4c081@gmail.com> , <8384a414-bc05-9b95-8170-0b523d86d140@t-online.de> In-Reply-To: <8384a414-bc05-9b95-8170-0b523d86d140@t-online.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:532F3FB89F7C47EBB224034B61FC74DB49E3A3FE924E21C000AE987E86D9DD43; UpperCasedChecksum:8ED5E182BF8D9394415F3A6298EF5550F74FDE4933BC045D97401D8894887200; SizeAsReceived:7339; Count:44 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [Q1MvdOtfGT3XoNCWGDbWaSuAyWkkx7SX] x-ms-publictraffictype: Email x-incomingheadercount: 44 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: c2556191-c174-4394-4997-08d93d9d2596 x-ms-traffictypediagnostic: DM6NAM04HT124: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: hA3kzOrO+PKcbRBzmCJCe/KsIADp5QSCHF3w3JHTqkkgOvpoi/hVao91qlhounjBg2MY4af3t07lGpbohhd09t8/TbBaMWVMhJWEF9unszapsN4DlJ773lqdSZq6H2PK6UgEjo4F0mr/neaP93M1CYs6F6+ycZhMIbKLxd1JerFKZ4Kwppjpmk8GvcR7hMku59wK7VWN0yZfoCa18o8MPwxcDqUqJQcVlYkExQ9Q15RkYtpshiUWltXILR6sEGjcta4Bq5v7nJ4Q4K2QZi74LmzggGStCCH982puk2XI88ywCRvQJAVTZNV+BStFz0nI/2n0Uju089PidZL0N6TmUgGvhQJXoKfuDU6t3LIdy3/Ft1taMo7W8a60CGO04ATqqTFb5SoMdClySSwdZwbBJlNw4UMIbi+l5AiwgQ7nnt0GwKqm8gPwRhgggioVqj4l x-ms-exchange-antispam-messagedata: 1HzDYCZuhck8mCb9DPsbW8Sqj9r4NLMTAM9qw4fpZCN02z45rjFL+RO/N/sgPOgcyLTiAS+ELmxJbHVTMulHGhUQgIMbmlf+wYcGvYOoLQb4kSbXvnLMQ6f9sjnZ2GJIhLMtNzfvI3W+jjOVsz6lsw== x-ms-exchange-transport-forked: True Content-Type: multipart/alternative; boundary="_000_SN2PR0801MB21582F5B893FFFC247BDBA2AA71F9SN2PR0801MB2158_" MIME-Version: 1.0 X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-AuthSource: DM6NAM04FT014.eop-NAM04.prod.protection.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: c2556191-c174-4394-4997-08d93d9d2596 X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Jul 2021 21:05:39.7602 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6NAM04HT124 X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --_000_SN2PR0801MB21582F5B893FFFC247BDBA2AA71F9SN2PR0801MB2158_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi Hans, Thanks for taking interest. But I am not sure how would it break the parall= elism of tests or anything in the test infra. The ask here is to optionally= print an additional extra line before running the test regardless of order= or medium in which they will eventually get rendered. AM script check supports these options: * AM_TESTS_FD_REDIRECT * AM_TESTS_ENVIRONMENT * AM_TESTSUITE_SUMMARY_HEADER they solve similar problems which are more useful in one case, but not the = other one. With the proposed AM_TESTS_SHOW_NAME, you can have parallelism: # with AM_TESTS_SHOW_NAME=3D1 # RUN Foo RUN Bar PASS Foo RUN Baz FAILED Baz PASS Bar now as to your point for my specific example where it could be useful, I ag= ree it will not solve that particular problem (of revealing the hanging tes= ts) perfectly in all modes and neither I am looking for the requested optio= n to do so (and neither do the other three supported options are meant to s= olve everything...) /K ________________________________ From: Hans-Bernhard Br=F6ker Sent: Friday, July 2, 2021 5:02 PM To: Kasper k ; Peter Johansson = ; 49309@debbugs.gnu.org <49309@debbugs.gnu.org> Subject: Re: bug#49309: Feature Request: Automake script based tests to pri= nt the test name before running it Am 01.07.2021 um 20:59 schrieb Kasper k: > Then if some intermittent bad situation happens in > unattended/disposable CI environment, as an example, then we won't be > needing to opt into any kind of workaround, it'd be just there right in > the "regular" make-check logs; without introducing crazy amount of > verbosity (which set -x, VERBOSE=3D1 etc. renders). IMHO that whole idea loses a most, if not all of its appeal when tests are run in parallel (which CI builds, always pressed for time, will rather likely want to do). As soon as there is more than one line of output, you're back to where you were without this change, or worse. * -Otarget or -Orecurse will undo the desired effect, because make will keep the entire output to itself until the test is done. That's the back to square one part. * -Oline or -Onone modes will print outputs from different tests intermixed, making it virtually impossible to know which result output belongs to which testcase. That's considerably worse than single-line outputs. --_000_SN2PR0801MB21582F5B893FFFC247BDBA2AA71F9SN2PR0801MB2158_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Hi Hans,

Thanks for taking interest. But I am not sure how would it break the parall= elism of tests or anything in the test infra. The ask here is to optionally print an a= dditional extra line before running the test regardless of order or medium = in which they will eventually get rendered.

AM script check supports these options:
  • AM_TESTS_FD_REDIRECT
  • AM_TESTS_ENVIRONMENT
  • AM_TESTSUITE_SUMMARY_HEADER
they solve similar problems which are more useful in one case, b= ut not the other one. With the proposed AM_TESTS_SHOW_NAME, you can have parallelism:

    # with AM_TESTS_SHOW_NAME=3D1
    #
    RUN Foo
    RUN Bar
    PASS Foo
    RUN Baz
    FAILED Baz
    PASS Bar

now as to your point for my specific example where it could be useful, I ag= ree it will not solve that particular problem (of revealing the hanging tes= ts) perfectly in all modes and neither I am looking for the requested optio= n to do so (and neither do the other three supported options are meant to solve everything...)

/K
From: Hans-Bernhard Br=F6= ker <HBBroeker@t-online.de>
Sent: Friday, July 2, 2021 5:02 PM
To: Kasper k <kasperkantz@outlook.com>; Peter Johansson <tr= ojkan@gmail.com>; 49309@debbugs.gnu.org <49309@debbugs.gnu.org> Subject: Re: bug#49309: Feature Request: Automake script based tests= to print the test name before running it
 
Am 01.07.2021 um 20:59 schrieb Kasper k:

> Then if some intermittent bad situation happens in
> unattended/disposable CI environment, as an example, then we won't be =
> needing to opt into any kind of workaround, it'd be just there right i= n
> the "regular" make-check logs; without introducing crazy amo= unt of
> verbosity (which set -x, VERBOSE=3D1 etc. renders).

IMHO that whole idea loses a most, if not all of its appeal when tests
are run in parallel (which CI builds, always pressed for time, will
rather likely want to do).

As soon as there is more than one line of output, you're back to where
you were without this change, or worse.

* -Otarget or -Orecurse will undo the desired effect, because make will keep the entire output to itself until the test is done.  That's the <= br> back to square one part.

* -Oline or -Onone modes will print outputs from different tests
intermixed, making it virtually impossible to know which result output
belongs to which testcase.  That's considerably worse than single-line=
outputs.
--_000_SN2PR0801MB21582F5B893FFFC247BDBA2AA71F9SN2PR0801MB2158_-- From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it References: Resent-From: Karl Berry Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Sat, 03 Jul 2021 22:59:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: kasperkantz@outlook.com Cc: HBBroeker@t-online.de, trojkan@gmail.com, 49309@debbugs.gnu.org Received: via spool by 49309-submit@debbugs.gnu.org id=B49309.16253531393721 (code B ref 49309); Sat, 03 Jul 2021 22:59:01 +0000 Received: (at 49309) by debbugs.gnu.org; 3 Jul 2021 22:58:59 +0000 Received: from localhost ([127.0.0.1]:40054 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lzobB-0000xv-Gj for submit@debbugs.gnu.org; Sat, 03 Jul 2021 18:58:59 -0400 Received: from freefriends.org ([96.88.95.60]:33594) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lzob5-0000xj-Bu for 49309@debbugs.gnu.org; Sat, 03 Jul 2021 18:58:56 -0400 X-Envelope-From: karl@freefriends.org Received: from freefriends.org (freefriends.org [96.88.95.60]) by freefriends.org (8.14.7/8.14.7) with ESMTP id 163Mwnwx016131 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 3 Jul 2021 16:58:50 -0600 Received: (from apache@localhost) by freefriends.org (8.14.7/8.14.7/Submit) id 163Mwl1k016130; Sat, 3 Jul 2021 16:58:47 -0600 Date: Sat, 3 Jul 2021 16:58:47 -0600 Message-Id: <202107032258.163Mwl1k016130@freefriends.org> From: Karl Berry In-Reply-To: X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * AM_TESTS_FD_REDIRECT * AM_TESTS_ENVIRONMENT * AM_TESTSUITE_SUMMARY_HEADER (Aside: I see now I should have made that name AM_TESTS_SUMMARY_HEADER. Oh well, too late now.) # with AM_TESTS_SHOW_NAME=1 I guess I have nothing against it, for the reasons you give. Can you (or anyone) provide a patch? --thanks, karl. From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it References: Resent-From: Karl Berry Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Mon, 27 Sep 2021 01:41:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: kasperkantz@outlook.com Cc: 49309@debbugs.gnu.org Received: via spool by 49309-submit@debbugs.gnu.org id=B49309.16327068375199 (code B ref 49309); Mon, 27 Sep 2021 01:41:02 +0000 Received: (at 49309) by debbugs.gnu.org; 27 Sep 2021 01:40:37 +0000 Received: from localhost ([127.0.0.1]:39171 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mUfdF-0001Lm-IF for submit@debbugs.gnu.org; Sun, 26 Sep 2021 21:40:37 -0400 Received: from freefriends.org ([96.88.95.60]:39608) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mUfdD-0001Le-Ku for 49309@debbugs.gnu.org; Sun, 26 Sep 2021 21:40:36 -0400 X-Envelope-From: karl@freefriends.org Received: from freefriends.org (freefriends.org [96.88.95.60]) by freefriends.org (8.14.7/8.14.7) with ESMTP id 18R1eYvM028846 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sun, 26 Sep 2021 19:40:34 -0600 Received: (from apache@localhost) by freefriends.org (8.14.7/8.14.7/Submit) id 18R1eXrK028845; Sun, 26 Sep 2021 19:40:33 -0600 Date: Sun, 26 Sep 2021 19:40:33 -0600 Message-Id: <202109270140.18R1eXrK028845@freefriends.org> From: Karl Berry In-Reply-To: X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Back on this suggestion ... It would be very helpful if a new option AM_TESTS_NAME=1 ... RUNNING $name Looking into it now, I believe this can be done already using AM_TESTS_ENVIRONMENT (or by an individual user with TESTS_ENVIRONMENT). The test name is the shell variable $f at that point. Thus: make AM_TESTS_ENVIRONMENT='echo RUNNING: "$$f";' check seems to give the desired output for me. Although the use of $f here is not documented, in practice it is never going to change. Seems way simpler than adding this to Automake ... --best, karl. From unknown Sun Jun 15 08:55:36 2025 X-Loop: help-debbugs@gnu.org Subject: bug#49309: Feature Request: Automake script based tests to print the test name before running it References: Resent-From: Karl Berry Original-Sender: "Debbugs-submit" Resent-CC: bug-automake@gnu.org Resent-Date: Wed, 29 Sep 2021 01:29:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49309 X-GNU-PR-Package: automake X-GNU-PR-Keywords: To: 49309@debbugs.gnu.org Received: via spool by 49309-submit@debbugs.gnu.org id=B49309.163287889825770 (code B ref 49309); Wed, 29 Sep 2021 01:29:02 +0000 Received: (at 49309) by debbugs.gnu.org; 29 Sep 2021 01:28:18 +0000 Received: from localhost ([127.0.0.1]:47354 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mVOOP-0006hZ-Vi for submit@debbugs.gnu.org; Tue, 28 Sep 2021 21:28:18 -0400 Received: from freefriends.org ([96.88.95.60]:55208) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mVOON-0006hN-4S; Tue, 28 Sep 2021 21:28:16 -0400 X-Envelope-From: karl@freefriends.org Received: from freefriends.org (freefriends.org [96.88.95.60]) by freefriends.org (8.14.7/8.14.7) with ESMTP id 18T1SDTC026795 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 28 Sep 2021 19:28:14 -0600 Received: (from apache@localhost) by freefriends.org (8.14.7/8.14.7/Submit) id 18T1SDLr026794; Tue, 28 Sep 2021 19:28:13 -0600 Date: Tue, 28 Sep 2021 19:28:13 -0600 Message-Id: <202109290128.18T1SDLr026794@freefriends.org> From: Karl Berry In-Reply-To: X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) make AM_TESTS_ENVIRONMENT='echo RUNNING: "$$f";' check I added this to the manual as another example of using [AM_]TESTS_ENVIRONMENT. Closing the bug ... --thanks, karl. From unknown Sun Jun 15 08:55:36 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: Kasper k Subject: bug#49309: closed (Re: bug#49309: Feature Request: Automake script based tests to print the test name before running it) Message-ID: References: <202109290128.18T1SDLr026794@freefriends.org> X-Gnu-PR-Message: they-closed 49309 X-Gnu-PR-Package: automake Reply-To: 49309@debbugs.gnu.org Date: Wed, 29 Sep 2021 01:29:03 +0000 Content-Type: multipart/mixed; boundary="----------=_1632878943-25865-1" This is a multi-part message in MIME format... ------------=_1632878943-25865-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #49309: Feature Request: Automake script based tests to print the test name= before running it which was filed against the automake package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 49309@debbugs.gnu.org. --=20 49309: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D49309 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1632878943-25865-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 49309-done) by debbugs.gnu.org; 29 Sep 2021 01:28:18 +0000 Received: from localhost ([127.0.0.1]:47356 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mVOOQ-0006hb-46 for submit@debbugs.gnu.org; Tue, 28 Sep 2021 21:28:18 -0400 Received: from freefriends.org ([96.88.95.60]:55208) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mVOON-0006hN-4S; Tue, 28 Sep 2021 21:28:16 -0400 X-Envelope-From: karl@freefriends.org Received: from freefriends.org (freefriends.org [96.88.95.60]) by freefriends.org (8.14.7/8.14.7) with ESMTP id 18T1SDTC026795 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 28 Sep 2021 19:28:14 -0600 Received: (from apache@localhost) by freefriends.org (8.14.7/8.14.7/Submit) id 18T1SDLr026794; Tue, 28 Sep 2021 19:28:13 -0600 Date: Tue, 28 Sep 2021 19:28:13 -0600 Message-Id: <202109290128.18T1SDLr026794@freefriends.org> From: Karl Berry To: 49309@debbugs.gnu.org Subject: Re: bug#49309: Feature Request: Automake script based tests to print the test name before running it In-Reply-To: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 49309-done X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) make AM_TESTS_ENVIRONMENT='echo RUNNING: "$$f";' check I added this to the manual as another example of using [AM_]TESTS_ENVIRONMENT. Closing the bug ... --thanks, karl. ------------=_1632878943-25865-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 1 Jul 2021 07:22:47 +0000 Received: from localhost ([127.0.0.1]:59430 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lyr26-00006d-OM for submit@debbugs.gnu.org; Thu, 01 Jul 2021 03:22:46 -0400 Received: from lists.gnu.org ([209.51.188.17]:39248) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lyn2H-0001v0-Sg for submit@debbugs.gnu.org; Wed, 30 Jun 2021 23:06:42 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34688) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lyn2H-0002dM-Nd for bug-automake@gnu.org; Wed, 30 Jun 2021 23:06:41 -0400 Received: from mail-dm6nam11olkn20804.outbound.protection.outlook.com ([2a01:111:f400:7eaa::804]:52192 helo=NAM11-DM6-obe.outbound.protection.outlook.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lyn2E-00059x-Fu for bug-automake@gnu.org; Wed, 30 Jun 2021 23:06:41 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aQnaspgrH8/aJehtZo3ON5exw329Th65V53s9nqyZM9LNKIsGAudrgxkMr46WW2GIp8Xx8ouoAvmjHahbuSU6Us72k+CzK+zJhjCdklD/iJXZwQx/3JNVCx9m+SvQFxD3l9YDb4BuBV1H0h8QCnFdCAKrsbe9P7+2yi8t3aEQ17B5xIgDfTg6ns9g14RZpuo6AbWj4gHqadUkmNIGM/hEDy4nfE5CW5lGq9IqPL78jWb8R2v5VAGB4W3+ob9UAkJ0EXiAUYXiFmrtesAOy1ceKW2/HSvZw9Nf9HrZQuY6wHrtSkNposHI3sXYbrd1cTcRsoPEO0oci9fJy7SIeJwsA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KleL/lbXa1+zXR/C8M8VirjZzw7vkhPay5+6PSBULtM=; b=hXt1J1EN3O25IPIcvbura4ZgeNxOznmyJ1tcBcmi7vk8U+MBZk7pixAZbAEgc20onFapXEwF6IyhbwoFbnk3SYnuKnGwG8mW78Na4MP2+q33nQooGiPrNOXwvmwaHLhmg6hFuwNL/ys+27ronz7SwaIFeWMatbh7mihMIQPCFVKp0YPg8vTyVQT2FmvqHPKTtl824GZ342bnTYJ6Kx04NAepBxyaAIk6Xy4c3jpbyvTHOT5yDLo5M8zmmTCDd6ixm30mrdR2ALeE3ihXrvveIBFJjOjFWREJL8kQOh7dwFtdKI6rPCfHkvep07j1YkwYKbNG7Va/jFXxDjcWzk8mJQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KleL/lbXa1+zXR/C8M8VirjZzw7vkhPay5+6PSBULtM=; b=MvCiIUr9c/p7VH/Arh1XL3Z+eLQ7XalkX7yvDif3Vq7qZbF7GNOZaWB21HpchQ0jt2SHNaeCEVmkuoV7Uht9Rsm+mkUQnDJdVincjtpCUzDpltl3rVVDcGftCw6aHyPLFLFSC2QMXB1YuET5vmYQJJZ+jTt5c7oLqGWVJzIvkEqfgbv9w5ePm489RXyZmV2INfRvpRyFkmsikZK83UDolV+pt+B4LAOCDYkHpAFeibxG8nC1hp/892vc+MPY4KFmg6x0NudOa8yI83197Uq6r9KsPun38SSjb2DCav+NhNd5qzi6TzhZhMKQWxdDMGHbmgtazkzmppoFEKa2PWwtWQ== Received: from BN8NAM11FT033.eop-nam11.prod.protection.outlook.com (2a01:111:e400:fc4b::40) by BN8NAM11HT178.eop-nam11.prod.protection.outlook.com (2a01:111:e400:fc4b::483) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22; Thu, 1 Jul 2021 03:01:30 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com (2a01:111:e400:fc4b::41) by BN8NAM11FT033.mail.protection.outlook.com (2a01:111:e400:fc4b::405) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22 via Frontend Transport; Thu, 1 Jul 2021 03:01:30 +0000 Received: from SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff]) by SN2PR0801MB2158.namprd08.prod.outlook.com ([fe80::11a4:929b:2c35:e7ff%3]) with mapi id 15.20.4287.023; Thu, 1 Jul 2021 03:01:30 +0000 From: Kasper k To: "bug-automake@gnu.org" Subject: Feature Request: Automake script based tests to print the test name before running it Thread-Topic: Feature Request: Automake script based tests to print the test name before running it Thread-Index: AQHXbiIZMuA/BLVLtE+fylkODTwfqA== Date: Thu, 1 Jul 2021 03:01:30 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:446E24CAFF6FEA3806DA9E3E1C4F4A44ECE1D577430AF818E939827228E6BF83; UpperCasedChecksum:A31CFE82003DA4330AFE97228D3813AC4D34DFE27B7EC06DC15BB790945AFCB5; SizeAsReceived:6800; Count:42 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [2vdUgyRcgS8rXcNj3GHjywPZVHIXEAP7] x-ms-publictraffictype: Email x-incomingheadercount: 42 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: 86ed05eb-fe00-4e6a-d12a-08d93c3c868c x-ms-traffictypediagnostic: BN8NAM11HT178: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 4dIFmIX7bN1FabwTzaEw3+rVT9C5Gy0dhAYLeqSYC3G/P1MCDfuVmqokJg49OzGu3YXpoID9kCDxmIbUSiTZq17RVCcb4TIKu+9g92S6mKyeSFcftPp0eoxPeCVhtfBSCoZXlNs2TI24NvXHEFGM3Bec0Er/KQVKRBzt5S/yBX17AxZbV0Sz8BeZ6P5bX/h6tR9nHTRkzyADVJpSCbmTZ9sT4N0ZFHiUNbQQDwzDaYja2TBKlkZmsD2FJT2GmjIMYuMr9Jd5QH8gFZxYDpP3npKTvLQ3AVcOadI/3TNscgmCwnNuEuKwLkvONCC1naExpbRbNksJhx71bc4dv4nEmCECqt4mNOHdpkNnTr5BMp5RfFeWofn4J2+lxaiiYp2L6TAxIva8wMKnIkZhNOxdvAQ/xIC5zgh4LQjHiL2MFcO/vkXAf0DNIb8i8gg3gpIlA1qVhiICl953EdCZgDUflOIlzVOwQWSDpvQ85GLQ8GToM4dtcE+J18E7uTlPvjSRXv+mZQMnAW+08XToagaP3w== x-ms-exchange-antispam-messagedata: eIWh9tWjJb+ZuSi2RHLqGIE08shk+y4o1hovbp2Rs3shfHJfx3cmqv3p+G3tlyxIvZWEKQczI/FAXi82N3bzH1gEmach8EN2M/ghlR6PA7qyrsuo9dEeckfmxEdXPXeE/n4V49HMcT5sOo62tVujcA== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT033.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 86ed05eb-fe00-4e6a-d12a-08d93c3c868c X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Jul 2021 03:01:30.0716 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8NAM11HT178 Received-SPF: pass client-ip=2a01:111:f400:7eaa::804; envelope-from=kasperkantz@outlook.com; helo=NAM11-DM6-obe.outbound.protection.outlook.com X-Spam_score_int: 6 X-Spam_score: 0.6 X-Spam_bar: / X-Spam_report: (0.6 / 5.0 requ) BAYES_50=0.8, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: submit X-Mailman-Approved-At: Thu, 01 Jul 2021 03:22:45 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) Hello automake devs,=0A= =0A= In script based testsuites (https://www.gnu.org/software/automake/manual/ht= ml_node/Scripts_002dbased-Testsuites.html#Scripts_002dbased-Testsuites), wh= en we run `make check` it prints one of the following string for each test:= PASS , FAIL , XFAIL or SKIP .=0A= =0A= However, in some cases (long running test, flaky test, other inconclusive o= nes for more involved reasons), it is essential to know which test is curre= ntly in flight. Especially in CI systems, where flakiness every now and the= n, due to external factors, is almost unavoidable.=0A= =0A= It would be very helpful if a new option AM_TESTS_NAME=3D1 is provided, whi= ch would change the stdout output from:=0A= =0A= =0A= PASS (or FAIL/XFAIL/SKIP) $name=0A= =0A= to something like:=0A= =0A= RUNNING $name=0A= =0A= PASS (or FAIL/XFAIL/SKIP) $name=0A= =0A= this way we can easily find out the name of test (or multiple of them; in c= ase of parallel execution) which is (are) currently running.=0A= =0A= Thanks,=0A= /K= ------------=_1632878943-25865-1--