From unknown Sun Sep 14 10:41:28 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#72371 <72371@debbugs.gnu.org> To: bug#72371 <72371@debbugs.gnu.org> Subject: Status: srfi-64: test marked for skip and as expected failure has wrong result-kind in on-test-begin-function Reply-To: bug#72371 <72371@debbugs.gnu.org> Date: Sun, 14 Sep 2025 17:41:28 +0000 retitle 72371 srfi-64: test marked for skip and as expected failure has wro= ng result-kind in on-test-begin-function reassign 72371 guile submitter 72371 Tomas Volf <~@wolfsden.cz> severity 72371 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Tue Jul 30 15:52:28 2024 Received: (at submit) by debbugs.gnu.org; 30 Jul 2024 19:52:28 +0000 Received: from localhost ([127.0.0.1]:48466 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sYstX-0006Y6-JD for submit@debbugs.gnu.org; Tue, 30 Jul 2024 15:52:28 -0400 Received: from lists.gnu.org ([209.51.188.17]:44602) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <~@wolfsden.cz>) id 1sYstM-0006Wo-RE for submit@debbugs.gnu.org; Tue, 30 Jul 2024 15:52:17 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <~@wolfsden.cz>) id 1sYst8-0004sn-14 for bug-guile@gnu.org; Tue, 30 Jul 2024 15:52:02 -0400 Received: from wolfsden.cz ([37.205.8.62]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <~@wolfsden.cz>) id 1sYst6-0006rQ-GW for bug-guile@gnu.org; Tue, 30 Jul 2024 15:52:01 -0400 Received: by wolfsden.cz (Postfix, from userid 104) id 5774E29388B; Tue, 30 Jul 2024 19:51:55 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=wolfsden.cz; s=mail; t=1722369115; bh=QMZVGbal6mRaFphpJZRvU8Dp1MTNigl1eX0GY/RL1rc=; h=Date:From:To:Subject; b=bROvtJaQLj1eaHrrlKPhBwwVMSYZaz8jflja+WsLMzwQN4tb7rgx/eCi3wAmAPsWH wEY5+uLCYihLCMQ/zacofz3t5P0HL7qN4Ifms5o+eUTiprs3+LIPtSVOGHJrOohKkq 2BKz+QIRSgc5UU3M8LDEfFiqqDBtj95b3GVoCDhYCZKGlYrelCzoUpiEXF/XnaSYJ9 3Fxg4Yn3RFKx3CcOYTw8cIEDdRUs8PtbSI8gk48iO/vM5H6mvYbkuJfAN1GsBDRJNF VdP8m0/P3FB6ryMokW8Bt2g9GSm2M7ze+OEbavHkLrub2iXMuxV9vTHYgovQwJRXQ8 W5Yd9lsSNFVI8j8P6FM19d4S+opR0Qb3JrkVnE5HfJ6u3xjOcfn3kfajzjQ+NYLr9Q sAHjSJSqSk/o0Q8JqtzwhgE0kUMOioCQ0bvxNz12p4Q7OhKL7T65ltSIc3XBtDLaZ7 ssY2ger4EY0P/YiV3zVVZzSfen6oW5H5lDsJ3ohmC2JPoXPSVvxx7Evb87ORjI6M4y 4IWGJvntBTDmuTDA/3Q0MQLGQjXL+LDHwomD+qbcxg+NB48Q/NYwfgakGh2nRAjJW/ Q+6Sn7hlYZ9sv2jwnWwt2I6S27B2vDF6WQ75kgEs/N9FhSHt/y3aIBs/gEB8jLJZ+f XiWhsuaUzwRa/6iOavnmz/R0= X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on wolfsden X-Spam-Level: X-Spam-Status: No, score=-1.2 required=5.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.6 Received: from localhost (unknown [128.0.188.242]) by wolfsden.cz (Postfix) with ESMTPSA id 2B996293984 for ; Tue, 30 Jul 2024 19:51:55 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=wolfsden.cz; s=mail; t=1722369115; bh=QMZVGbal6mRaFphpJZRvU8Dp1MTNigl1eX0GY/RL1rc=; h=Date:From:To:Subject; b=bROvtJaQLj1eaHrrlKPhBwwVMSYZaz8jflja+WsLMzwQN4tb7rgx/eCi3wAmAPsWH wEY5+uLCYihLCMQ/zacofz3t5P0HL7qN4Ifms5o+eUTiprs3+LIPtSVOGHJrOohKkq 2BKz+QIRSgc5UU3M8LDEfFiqqDBtj95b3GVoCDhYCZKGlYrelCzoUpiEXF/XnaSYJ9 3Fxg4Yn3RFKx3CcOYTw8cIEDdRUs8PtbSI8gk48iO/vM5H6mvYbkuJfAN1GsBDRJNF VdP8m0/P3FB6ryMokW8Bt2g9GSm2M7ze+OEbavHkLrub2iXMuxV9vTHYgovQwJRXQ8 W5Yd9lsSNFVI8j8P6FM19d4S+opR0Qb3JrkVnE5HfJ6u3xjOcfn3kfajzjQ+NYLr9Q sAHjSJSqSk/o0Q8JqtzwhgE0kUMOioCQ0bvxNz12p4Q7OhKL7T65ltSIc3XBtDLaZ7 ssY2ger4EY0P/YiV3zVVZzSfen6oW5H5lDsJ3ohmC2JPoXPSVvxx7Evb87ORjI6M4y 4IWGJvntBTDmuTDA/3Q0MQLGQjXL+LDHwomD+qbcxg+NB48Q/NYwfgakGh2nRAjJW/ Q+6Sn7hlYZ9sv2jwnWwt2I6S27B2vDF6WQ75kgEs/N9FhSHt/y3aIBs/gEB8jLJZ+f XiWhsuaUzwRa/6iOavnmz/R0= Date: Tue, 30 Jul 2024 21:51:54 +0200 From: Tomas Volf <~@wolfsden.cz> To: bug-guile@gnu.org Subject: srfi-64: test marked for skip and as expected failure has wrong result-kind in on-test-begin-function Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=37.205.8.62; envelope-from=~@wolfsden.cz; helo=wolfsden.cz X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.3 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) Hello, I think I found a bug in (srfi srfi-64) module shipped with GNU Guile. The specification says the following regarding the test-result-kind: > If we've started on a new test, but don't have a result yet, then the result > kind is 'xfail if the test is expected to fail, 'skip if the test is supposed > to be skipped, or #f otherwise. Thus I believe that following should print `xfail': (use-modules (srfi srfi-64)) (test-begin "x") (test-runner-on-test-begin! (test-runner-current) (λ (runner) (pk (test-result-kind)))) (test-skip 1) (test-expect-fail 1) (test-assert #t) (test-end) However it does not: ;;; (skip) Have a nice day Tomas Volf From debbugs-submit-bounces@debbugs.gnu.org Tue Oct 01 17:46:59 2024 Received: (at 72371) by debbugs.gnu.org; 1 Oct 2024 21:46:59 +0000 Received: from localhost ([127.0.0.1]:53878 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1svkhv-0004TM-4c for submit@debbugs.gnu.org; Tue, 01 Oct 2024 17:46:59 -0400 Received: from mail-ed1-f49.google.com ([209.85.208.49]:40007) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1svkht-0004TC-H0 for 72371@debbugs.gnu.org; Tue, 01 Oct 2024 17:46:58 -0400 Received: by mail-ed1-f49.google.com with SMTP id 4fb4d7f45d1cf-5c88367684bso798368a12.0 for <72371@debbugs.gnu.org>; Tue, 01 Oct 2024 14:46:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1727819152; x=1728423952; darn=debbugs.gnu.org; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id:from :to:cc:subject:date:message-id:reply-to; bh=Wc/J4mfkdC3m5lGDsLnP0fbX+DWA18MgbGPHzEQl1Lc=; b=RiIDBOdwYut6XoU+/HpdJW3l8BteGqe+ACqqBOMeL7tlmNGs6p5rVx4ZsrRwW8VnQe KbQ1mLd/m16YmooP89QT20wRQVQVYIUR6gL/h7nH1aErBLsF15D6bno3kOcuOC6v9NCf LfokzBYrexiw9sf6I2yLGdAzTlAfasHDqwDZVG0qbZRpnCqx0p1q2iAb1zuvkQL2D/xE +va9M8y1BROoXtta2hR5bAyUngpMDWhYF9BaiwrVFuL/RUZFDAMo1fxecXXNvxhLZfhF 3acl65bhjbD+RlnNjXAISIR1EiVLeYEee50I58SqsWwD1OFbP5yMip+0Xxhq1WKC7gvl GYfQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1727819152; x=1728423952; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Wc/J4mfkdC3m5lGDsLnP0fbX+DWA18MgbGPHzEQl1Lc=; b=YLSryfqrroqT8PL4DTO0A+phMp6/SfzepPQyqO2GY9yzPr2XATylexn+z6xhd5NsNO wh3WeXVMo1ZFiJ6OtWgPCTsWlJCbKUpbx8tWArf1iU9d8aShvo5aENa27Xy1fnb5sU+w 3xABWk5dG/XJ5Xc2/a1IW4Rpp1peBz/oPlD+TmeErsGKV9CimtMjUDNhDm0+mSGSmRkQ d8qQFfLVHGXHdG1qxtGFzcxq7wZk2xCRC3kHwg3RrrDP3GfIDKRV8KmCuXs5bpHVX0Dn LcdNvx+ttJJPVt0qLvEm/gVX7QESgc73G2DsDW5fXRamA5fVogOpWbdlMwJB8QgrMzk7 JQmg== X-Forwarded-Encrypted: i=1; AJvYcCUt28Qu4KgJSEw/9zpGhpD7zwItzC2mccoBSUU58AdVcaBuuzpZf48D4q9jBeqD/1pXW0G3kA==@debbugs.gnu.org X-Gm-Message-State: AOJu0YyShaYEtZAsVvis5NOoD82QNYbV+XX2pbwyH2LSGyrSJgfIAZ0b +M15h2z3diMBLInaL9W06m03MFyNJMHqLY28zKx1G12vyepik2vWUJuWJIgb X-Google-Smtp-Source: AGHT+IG4GQmfCLop5UiFTcTshv63IGSLR1MTC4t8cS7bOH16oejkB5XkU0Ddb7fCzV9/zYhushtPug== X-Received: by 2002:a05:6402:35c6:b0:5c2:6850:7b2 with SMTP id 4fb4d7f45d1cf-5c8b1b7a6cdmr216153a12.6.1727819151671; Tue, 01 Oct 2024 14:45:51 -0700 (PDT) Received: from ?IPV6:2003:106:8f04:c300:95ac:529d:6db3:196b? (p200301068f04c30095ac529d6db3196b.dip0.t-ipconnect.de. [2003:106:8f04:c300:95ac:529d:6db3:196b]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-5c88248b628sm6665103a12.66.2024.10.01.14.45.50 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 01 Oct 2024 14:45:50 -0700 (PDT) Message-ID: <47bec123-76f8-4117-93ba-aed16b8c659c@gmail.com> Date: Tue, 1 Oct 2024 23:45:49 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: bug#72371: srfi-64: test marked for skip and as expected failure has wrong result-kind in on-test-begin-function To: Tomas Volf <~@wolfsden.cz>, 72371@debbugs.gnu.org References: Content-Language: en-US From: Taylan Kammer In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72371 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) On 30.07.2024 21:51, Tomas Volf wrote: > Hello, > > I think I found a bug in (srfi srfi-64) module shipped with GNU Guile. > > The specification says the following regarding the test-result-kind: > >> If we've started on a new test, but don't have a result yet, then the result >> kind is 'xfail if the test is expected to fail, 'skip if the test is supposed >> to be skipped, or #f otherwise. > Thus I believe that following should print `xfail': > > (use-modules (srfi srfi-64)) > (test-begin "x") > > (test-runner-on-test-begin! (test-runner-current) > (λ (runner) > (pk (test-result-kind)))) > > (test-skip 1) > (test-expect-fail 1) > (test-assert #t) > > (test-end) > > However it does not: > > ;;; (skip) > > Have a nice day > Tomas Volf > I think this is a case where the spec didn't actually consider what should happen if skip and expect-fail are combined. Otherwise, I would expect to see a more explicit description of what should happen in such cases. In other words, I think the English description of what's supposed to happen, that you've quoted, is *not* intended to be read like procedural pseudo-code: "If expected to fail, return 'xfail; if supposed to be skipped, return 'skip." The reference implementation does it the exact other way around, in a rather straightforward manner (two consecutive clasuses of a cond expression), so I don't think it's a bug. Intuitively, I also think it makes the most sense to treat skipping as a higher priority. While an xfail test is still executed, a skipped test is not executed at all, which is a more significant change in the test suite's behavior and should be honored IMO. If I've marked a test to be skipped, it could be because executing it currently leads to a crash or an infinite loop, so it would be important to skip it even if it's marked as xfail. So, I think the observed behavior is probably best, and intended. Opinions welcome. - Taylan From debbugs-submit-bounces@debbugs.gnu.org Mon Oct 21 16:29:35 2024 Received: (at control) by debbugs.gnu.org; 21 Oct 2024 20:29:35 +0000 Received: from localhost ([127.0.0.1]:53570 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1t2z1x-0004ZC-2w for submit@debbugs.gnu.org; Mon, 21 Oct 2024 16:29:35 -0400 Received: from wolfsden.cz ([37.205.8.62]:38894) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <~@wolfsden.cz>) id 1t2z1k-0004Xf-Nk for control@debbugs.gnu.org; Mon, 21 Oct 2024 16:29:21 -0400 Received: by wolfsden.cz (Postfix, from userid 104) id 35207331999; Mon, 21 Oct 2024 20:28:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=wolfsden.cz; s=mail; t=1729542533; bh=zLl3/rXkP0OXkkGrXp5BxbM7yemKWXHtaM47XSLB1PA=; h=Date:To:From:Subject; b=T7bChdNOM6Q9BmH7CZtkpFvMu6Cd4hzrh0BCQGi8vcnPKxQVytM077PJSghuQogdn NKu0AqfM3OJ5kuX9pkjaeCIRFER9wTiAqvxWI0iDxdSIhHD69l0FUoVL2OPCG8viNU XGT7jsAMlxistZeOIlbp1U/SwApu21u1L+JCbzJv7EeQwK6qSpHBRbi8pr9KKMD4aT jQY6w0WSpeFp0t+AayXbWPa0XnymuRgxFz5itRdP/avDfTb43CuHkpmbWKcC80Uf/x EyR/2UOC0jH6LGdzzhjyllwdtuTMt2uLUPmXgdEu7VNaWuKbEqlR+qfnZTxaIYR7l0 THLTh8i4JmdOR5yzJROqZhRqqtFNFMOsHWJdsUs5qeOmgOesZK1/LUn9/wAP5HGAeW hIAc8C90bKq7skJsVwyKPyVgGjiMF77FDOCIfbDypGkg0BoPVyYXhtApFzCJQ4dV5z 1IjWEhnMBhsIIxU8UcktftySZbGoo0CBatuT8UuV5N3q6kgeCQu/utFz6KHAQwzm7L GL4UV9iQlW7qEjGpHtgxHV8oBXSSUMqcIo8T7uldHe5TcEp0NQ9TiFPyRk3kExosvD KA7Ms6LyBGXz3UJmdgQpHOScgMm8wFgHsI3q4HO8UaGmIEPs3PzMjKoB2hkPCNeKfN YA4Br7LhZ3Nj/1os/FEfGa7Y= X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on wolfsden X-Spam-Level: X-Spam-Status: No, score=-3.1 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 Received: from localhost (unknown [193.32.127.157]) by wolfsden.cz (Postfix) with ESMTPSA id C85BF330BE1 for ; Mon, 21 Oct 2024 20:28:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=wolfsden.cz; s=mail; t=1729542533; bh=zLl3/rXkP0OXkkGrXp5BxbM7yemKWXHtaM47XSLB1PA=; h=Date:To:From:Subject; b=T7bChdNOM6Q9BmH7CZtkpFvMu6Cd4hzrh0BCQGi8vcnPKxQVytM077PJSghuQogdn NKu0AqfM3OJ5kuX9pkjaeCIRFER9wTiAqvxWI0iDxdSIhHD69l0FUoVL2OPCG8viNU XGT7jsAMlxistZeOIlbp1U/SwApu21u1L+JCbzJv7EeQwK6qSpHBRbi8pr9KKMD4aT jQY6w0WSpeFp0t+AayXbWPa0XnymuRgxFz5itRdP/avDfTb43CuHkpmbWKcC80Uf/x EyR/2UOC0jH6LGdzzhjyllwdtuTMt2uLUPmXgdEu7VNaWuKbEqlR+qfnZTxaIYR7l0 THLTh8i4JmdOR5yzJROqZhRqqtFNFMOsHWJdsUs5qeOmgOesZK1/LUn9/wAP5HGAeW hIAc8C90bKq7skJsVwyKPyVgGjiMF77FDOCIfbDypGkg0BoPVyYXhtApFzCJQ4dV5z 1IjWEhnMBhsIIxU8UcktftySZbGoo0CBatuT8UuV5N3q6kgeCQu/utFz6KHAQwzm7L GL4UV9iQlW7qEjGpHtgxHV8oBXSSUMqcIo8T7uldHe5TcEp0NQ9TiFPyRk3kExosvD KA7Ms6LyBGXz3UJmdgQpHOScgMm8wFgHsI3q4HO8UaGmIEPs3PzMjKoB2hkPCNeKfN YA4Br7LhZ3Nj/1os/FEfGa7Y= Date: Mon, 21 Oct 2024 22:28:51 +0200 Message-ID: <6841073ef8e20b6c2fe6fd2dc03b4043@wolfsden.cz> To: control@debbugs.gnu.org From: Tomas Volf <~@wolfsden.cz> Subject: control message for bug #72371 X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) close 72371 quit From unknown Sun Sep 14 10:41:28 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Tue, 19 Nov 2024 12:24:18 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator