From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 18 16:18:50 2017 Received: (at submit) by debbugs.gnu.org; 18 Sep 2017 20:18:50 +0000 Received: from localhost ([127.0.0.1]:46888 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du2VG-0003tF-Dw for submit@debbugs.gnu.org; Mon, 18 Sep 2017 16:18:50 -0400 Received: from eggs.gnu.org ([208.118.235.92]:58430) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du2VF-0003t3-D6 for submit@debbugs.gnu.org; Mon, 18 Sep 2017 16:18:49 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1du2V8-0002Bw-Ud for submit@debbugs.gnu.org; Mon, 18 Sep 2017 16:18:44 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,FREEMAIL_FROM, HTML_MESSAGE,T_DKIM_INVALID autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:39013) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1du2V8-0002Bq-Qr for submit@debbugs.gnu.org; Mon, 18 Sep 2017 16:18:42 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:49395) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1du2V7-0006WS-6K for bug-coreutils@gnu.org; Mon, 18 Sep 2017 16:18:42 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1du2V5-0002Ao-OC for bug-coreutils@gnu.org; Mon, 18 Sep 2017 16:18:41 -0400 Received: from mail-qt0-x235.google.com ([2607:f8b0:400d:c0d::235]:46391) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1du2V5-0002A9-J3 for bug-coreutils@gnu.org; Mon, 18 Sep 2017 16:18:39 -0400 Received: by mail-qt0-x235.google.com with SMTP id s18so1811986qta.3 for ; Mon, 18 Sep 2017 13:18:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=VxB5yir73EVDDTGd/KIERh+UdSlYqWkqio9JrlEYpGY=; b=gkHB01TRCG/5rPIE+lTGYoNyJMk5vs/9h5d0CBGCdS3DTvxY1Vy3mXTJ5q3K2PdBZ5 L4IlI2ONN3kEZebKAESVO54cSftfBEr0jZ9UGCoGZcp06eVNjArp7ra1kx47DPOh35YJ e12eRj4PZco3BsD1xQX1bG72EWN2/c15COr3Yb5Inzml4J+iec0BMgLP2WAgp3PC9ck3 GhkuI9nAMBlccYWd8mPotIlsWzpjkcLDYMO8D3x+U/Pzirc5VYJ5NWq3q1G3DNVh5Kf0 oXBhagXBW5xFmSyKDTN05lE0izmKfLYn8n/iJCDSTrGxcnZ2mQ+Z8G7T22AVuvp2mkc2 Y8OA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=VxB5yir73EVDDTGd/KIERh+UdSlYqWkqio9JrlEYpGY=; b=TQBwW97fhSeR1UOTmSoBE4KG9d/1LoAqvgeH+1dMVMJBEdr7oZF49JSz2uevT3e1m5 BpsPCIF02HQ40Jml+5D3/mxWcrTP0Emc+IfPcBpyhEuhbcbEoCuL4u8LlkmkiB9r9t9O 2GWl4HK94fSzgYQ/+LYuGhtHXMKzgHAPypFm4aUQSNiV5XWAyCZgkCa52Pl7iuDaR+ZR CZeqLMT9/p2bdwMnJZBjc3kB03FqTo2MImY4rIOmkm7fu+XiI8md3zaaUY8AGJYOxyj8 NB28w4kUcxdVrLomtyBkaxGVvJptolPOmdlT5v4mDyEawHLoc7NilExJkNL/gBvZbG/F xUyA== X-Gm-Message-State: AHPjjUgBu9utzjugb7v5YzaRtjpOI0nFumYRmVxGYNAfcVO7lhUJ/Zqv 46KXYRu/iS0GEO5xNG4DK+g9Gefij1XyYXX5f9B4MA== X-Google-Smtp-Source: AOwi7QA5J7ZRmJGxdDQUrTzY4HlWF9VFQR39UnepPjyVU6tbrVFWk7VPjDGHHW5FijOHa3lp3fRCn0VCcvEXcZaEMvc= X-Received: by 10.237.62.176 with SMTP id n45mr49203679qtf.302.1505765917604; Mon, 18 Sep 2017 13:18:37 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.209.16 with HTTP; Mon, 18 Sep 2017 13:18:37 -0700 (PDT) From: Jack Howarth Date: Mon, 18 Sep 2017 16:18:37 -0400 Message-ID: Subject: coreutils 8.28 test suite hangs on APFS filesystem To: bug-coreutils@gnu.org Content-Type: multipart/alternative; boundary="001a1142e0c0a23fce05597c720d" X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -4.0 (----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -4.0 (----) --001a1142e0c0a23fce05597c720d Content-Type: text/plain; charset="UTF-8" The coreutils 8.28 release, when built on macOS 10.13 under the new APFS filesystem, produces a hang during the test suite run. The hang appears to occur in the execution of coreutils-8.28/tests/split/filter.sh at.. + yes + head -n200K + split -b1G '--filter=head -c1 >/dev/null' + for mode in ''\'''\''' ''\''r/'\''' + FILE = - according to the filter.log generated from executing the section of split/filter.sh containing... yes | head -n200K | split -b1G --filter='head -c1 >/dev/null' || fail=1 # Ensure that "endless" input is ignored when all filters finish for mode in '' 'r/'; do FILE = '-' if test "$mode" = ''; then FILE = 'zero.in' truncate -s10T "$FILE" || continue fi for N in 1 2; do rm -f x??.n || framework_failure_ timeout 10 sh -c \ "yes | split --filter='head -c1 >\$FILE.n' -n $mode$N $FILE" || fail=1 # Also ensure we get appropriate output from each filter seq 1 $N | tr '0-9' 1 > stat.exp stat -c%s x??.n > stat.out || framework_failure_ compare stat.exp stat.out || fail=1 done done I haven't opened a radar report yet as the Apple engineers can't look directly at the source code for coreutils due to the GPLv3 licensing and the test suite seems to be tangled up with the makefiles making it impossible to extract a stand-alone test case reproducer to attach to a radar bug report. Jack ps Again, the hang seems to occur at the tail end of the log after it emits... + FILE = - Any suggestions on how reduce this to a simpler test case? I would note that the new APFS filesystem produces a failure in the python test suite... https://bugs.python.org/issue31380 which is due to APFS not allowing files to be created with filenames that contain unassigned codepoints in the Unicode 9.0 standard, whereas HFS+ does. So perhaps the coreutils hang might be a similar issue? --001a1142e0c0a23fce05597c720d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
The coreutils 8.28 release, when built on macOS 10.13 unde= r the new APFS filesystem, produces a hang during the test suite run. The h= ang appears to occur in the execution of coreutils-8.28/tests/split/filter.= sh at..

+ yes
+ head -n200K
+ split -b1G '--filter=3Dhead = -c1 >/dev/null'
+ for mode in ''\'''\'= 9;' ''\''r/'\'''
+ FILE =3D -
according to the filter.log generated from executing the section of
spl= it/filter.sh containing...

yes | head -n200K | split -b1G --filter= =3D'head -c1 >/dev/null' || fail=3D1

# Ensure that "= endless" input is ignored when all filters finish
for mode in '= ' 'r/'; do
=C2=A0 FILE =3D '-'
=C2=A0 if test &qu= ot;$mode" =3D ''; then
=C2=A0 =C2=A0 FILE =3D 'zero.in'
=C2=A0 =C2=A0 truncate -s10T "= $FILE" || continue
=C2=A0 fi
=C2=A0 for N in 1 2; do
=C2=A0 = =C2=A0 rm -f x??.n || framework_failure_
=C2=A0 =C2=A0 timeout 10 sh -c = \
=C2=A0 =C2=A0 =C2=A0 "yes | split --filter=3D'head -c1 >\$= FILE.n' -n $mode$N $FILE" || fail=3D1
=C2=A0 =C2=A0 # Also ensu= re we get appropriate output from each filter
=C2=A0 =C2=A0 seq 1 $N | t= r '0-9' 1 > stat.exp
=C2=A0 =C2=A0 stat -c%s x??.n > stat.= out || framework_failure_
=C2=A0 =C2=A0 compare stat.exp stat.out || fai= l=3D1
=C2=A0 done
done

I haven't opened a radar report yet= as the Apple engineers can't look directly at the source code for core= utils due to the GPLv3 licensing and the test suite seems to be tangled up = with the makefiles making it impossible to extract a stand-alone test case = reproducer to attach to a radar bug report.
=C2=A0 =C2=A0 =C2=A0 Jackps Again, the hang seems to occur at the tail end of the log after it emit= s...

+ FILE =3D -

Any suggestions on how reduce this to a sim= pler test case? I would note that the new APFS filesystem produces a failur= e in the python test suite...

https://bugs.python.org/issue31380

which is due to APFS= not allowing files to be created with filenames that contain unassigned co= depoints in the Unicode 9.0 standard, whereas HFS+ does. So perhaps the cor= eutils hang might be a similar issue?
--001a1142e0c0a23fce05597c720d-- From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 18 17:09:01 2017 Received: (at 28506) by debbugs.gnu.org; 18 Sep 2017 21:09:01 +0000 Received: from localhost ([127.0.0.1]:46920 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du3Ho-00054T-UY for submit@debbugs.gnu.org; Mon, 18 Sep 2017 17:09:01 -0400 Received: from mail-qt0-f170.google.com ([209.85.216.170]:48535) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du3Hn-00054H-8K for 28506@debbugs.gnu.org; Mon, 18 Sep 2017 17:08:59 -0400 Received: by mail-qt0-f170.google.com with SMTP id q8so1937934qtb.5 for <28506@debbugs.gnu.org>; Mon, 18 Sep 2017 14:08:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-transfer-encoding; bh=Oko36B4S0I2GBpjiNQt50jxkzQ6eojHHIdq/SZ3VSls=; b=Yv4Pbj69jadCPYk6yVqWBlV7JXWXkCHBqGd8YTHkQF3dvz+3VdIwstUJwl2HWWYu5V bMoV6AyNjW54Jrl+RurNrQzXeD2gG1BgAZOeCL+SwvEItOdR8jYCVfqhpDkHww/SCX8s 4XzgHN/erLtlYdEtkmxhTz1Dw28K7CN/LR7oLMRtBfkp10HnGzjbekiJ4aAat5pCqrmX 0ed4W4LipsCrDuhg7l/SKMKe3zcDGcnRg4PczkGXiijiCsTZBOxemTOlC4kP1vwASSEP al9vIGv20OByDN1Ea1qDpL4ONmALZ8qXU0yafeEKp/vKVICliWqSQERWIAXDCteB5dWf 6Zfw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc:content-transfer-encoding; bh=Oko36B4S0I2GBpjiNQt50jxkzQ6eojHHIdq/SZ3VSls=; b=hgRYsiX1YF9B25ESHWmFmdwOkHdqyz0s+me1ufNheTl+VkM+afzHJRARGa3BWg3Owe mmPjx4KrV6cOxRtf9bpTXkmDtllsYjm2cmDgNQrDQtFSYJt7vxWlKxmZm1ZfvJ83V/7I 85+LJkVGhi6JPzQ+O4CiVQ2F12YSPHYr5IQDCJOWf1EAdfM8WWQaozfkt+pZeQyC8RG/ 9TfPspTLzzUvWhkgjI0sE/15sCAIfUC/e61WQ6lLTUqYDsOlAJcduQasEBm22LfEEOSD NIprQjFgF2xkT/tbGd604JK9mMp93xzG6yVxA1kUYHjKzN8EAnZz38KGtEthEuN71X+V ryTA== X-Gm-Message-State: AHPjjUg4Yqj0a8YYmpLRVIEIYw59bNiJKjDEgwj9Twd4mewtYcfacPg4 6LvJYqEooFsVl/nN0iOiyisX/X98NPEaSJNVIl0= X-Google-Smtp-Source: AOwi7QAY+axDXkeMt0dmHVU7BlybSFXb1Dwk+91stWm8iL6u4H+tyHnsEZTYcKLacAjIwh8M+nrZdLsMMKte46Ybp3o= X-Received: by 10.200.23.140 with SMTP id o12mr37294818qtj.269.1505768933364; Mon, 18 Sep 2017 14:08:53 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.168.143 with HTTP; Mon, 18 Sep 2017 14:08:32 -0700 (PDT) In-Reply-To: References: From: Jim Meyering Date: Mon, 18 Sep 2017 14:08:32 -0700 X-Google-Sender-Auth: T-zkkivL9s1I2mnHvwtPGLc0U5M Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jack Howarth Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On Mon, Sep 18, 2017 at 1:18 PM, Jack Howarth wrote: > The coreutils 8.28 release, when built on macOS 10.13 under the new APFS > filesystem, produces a hang during the test suite run. The hang appears t= o > occur in the execution of coreutils-8.28/tests/split/filter.sh at.. > > + yes > + head -n200K > + split -b1G '--filter=3Dhead -c1 >/dev/null' > + for mode in ''\'''\''' ''\''r/'\''' > + FILE =3D - > > according to the filter.log generated from executing the section of > split/filter.sh containing... > > yes | head -n200K | split -b1G --filter=3D'head -c1 >/dev/null' || fail= =3D1 > > # Ensure that "endless" input is ignored when all filters finish > for mode in '' 'r/'; do > FILE =3D '-' > if test "$mode" =3D ''; then > FILE =3D 'zero.in' > truncate -s10T "$FILE" || continue > fi > for N in 1 2; do > rm -f x??.n || framework_failure_ > timeout 10 sh -c \ > "yes | split --filter=3D'head -c1 >\$FILE.n' -n $mode$N $FILE" || f= ail=3D1 > # Also ensure we get appropriate output from each filter > seq 1 $N | tr '0-9' 1 > stat.exp > stat -c%s x??.n > stat.out || framework_failure_ > compare stat.exp stat.out || fail=3D1 > done > done > > I haven't opened a radar report yet as the Apple engineers can't look > directly at the source code for coreutils due to the GPLv3 licensing and > the test suite seems to be tangled up with the makefiles making it > impossible to extract a stand-alone test case reproducer to attach to a > radar bug report. > Jack > ps Again, the hang seems to occur at the tail end of the log after it > emits... > > + FILE =3D - > > Any suggestions on how reduce this to a simpler test case? I would note > that the new APFS filesystem produces a failure in the python test suite.= .. > > https://bugs.python.org/issue31380 > > which is due to APFS not allowing files to be created with filenames that > contain unassigned codepoints in the Unicode 9.0 standard, whereas HFS+ > does. So perhaps the coreutils hang might be a similar issue? Thank you for the testing and for the report. Is there any chance your failing test was via a python2 framework? I'm asking (on P=C3=A1draig's behalf) because there is a known problem whereby SIGPIPE is mishandled in that case, and that might explain this failure, since the data-generation phase relies on SIGPIPE killing this test's "yes" command. From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 18 19:26:28 2017 Received: (at 28506) by debbugs.gnu.org; 18 Sep 2017 23:26:29 +0000 Received: from localhost ([127.0.0.1]:46974 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du5Qq-0008Ea-HJ for submit@debbugs.gnu.org; Mon, 18 Sep 2017 19:26:28 -0400 Received: from mail-qk0-f182.google.com ([209.85.220.182]:44855) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du5Qp-0008EN-6q for 28506@debbugs.gnu.org; Mon, 18 Sep 2017 19:26:27 -0400 Received: by mail-qk0-f182.google.com with SMTP id b23so2112843qkg.1 for <28506@debbugs.gnu.org>; Mon, 18 Sep 2017 16:26:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=xSRH3xXqswbEFlO9IgoHmHsD7lGIVJen5c2h1s2S+rY=; b=jHIiDJ8VfJvZCiejZi2TGEb8u+LksB8rz1mbwpAyiLAQymEO3b8y8dWBXBPEQNEDru a2JHTuBxp1ThAHcx7l5VXZNxGBE/cCwKZZ9QIUmyVv2XiLPsCbWwIiwgZV18/mGM/bbF unD3k9KfBfSt8P2LwpObWg92Crbox03Vzw60pz2ZyICfRYAIU4+UcDzM5rUxIYzSYBeE EUCcJrO/oSVAiQm7rzbPipCuxhxRwXbiSLdhJdKOcRZEtL46N2PQr6edhhf1hErYxLZG i4wkIWWmyf2gE0HYk4I0Me4sBesvkEjaQiVb25wTZ89r4U06uaTB6fJYTPeqVYhS/ung Iv2w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=xSRH3xXqswbEFlO9IgoHmHsD7lGIVJen5c2h1s2S+rY=; b=reANtsCPui+wmESfVPndM/JLc7TIPqjkD1EDn/eZY4N2ASJsSPs3BBeYShzGbe8r83 Op6qDyZYOsMs2MgAvaLLYwTfoT+dUoV9iCQevLjjjm7TfMxeTuIE0HZKShWGN7MYxFTG JpHWLIw+6Q2DUlrtgALJaXhyOffGJ0qsiK/j3m9kxfY6nbbz5S0gRcfxSChQ9gJuzOuX QjRU84ussIO2a+cTF0RRf6QIcZgR2mU+IV3XJVlcD2+kdzygWvmcT7djEEreGbSWcQlR T8UmnIZXZWZWdH8kt8m4qA4DV3lAzC2PH5tWNZvMTv9z8YORpH65t38as8TCVcG38b6u dKfw== X-Gm-Message-State: AHPjjUhtvdktNSgfCu/1MKSMrSI8FxPqjhY4m/i3YUTke5Y7H2gHCy9d JHm7chtmeNNLpyczpAbkEFOh3PlpEydFKbIn4ig= X-Google-Smtp-Source: AOwi7QDavMFhb91ZOIpav0Xzijb1vDlLce9drwNS79aC0JJC7ngJi1CWyrLx9tfzLbw8WrXb84aobjYrLOcaKeIRRrw= X-Received: by 10.55.16.207 with SMTP id 76mr21008445qkq.120.1505777181301; Mon, 18 Sep 2017 16:26:21 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.209.16 with HTTP; Mon, 18 Sep 2017 16:26:20 -0700 (PDT) In-Reply-To: References: From: Jack Howarth Date: Mon, 18 Sep 2017 19:26:20 -0400 Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jim Meyering Content-Type: multipart/alternative; boundary="001a113fe9e800a5c005597f1249" X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.5 (/) --001a113fe9e800a5c005597f1249 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering wrote: > On Mon, Sep 18, 2017 at 1:18 PM, Jack Howarth > wrote: > > The coreutils 8.28 release, when built on macOS 10.13 under the new APF= S > > filesystem, produces a hang during the test suite run. The hang appears > to > > occur in the execution of coreutils-8.28/tests/split/filter.sh at.. > > > > + yes > > + head -n200K > > + split -b1G '--filter=3Dhead -c1 >/dev/null' > > + for mode in ''\'''\''' ''\''r/'\''' > > + FILE =3D - > > > > according to the filter.log generated from executing the section of > > split/filter.sh containing... > > > > yes | head -n200K | split -b1G --filter=3D'head -c1 >/dev/null' || fail= =3D1 > > > > # Ensure that "endless" input is ignored when all filters finish > > for mode in '' 'r/'; do > > FILE =3D '-' > > if test "$mode" =3D ''; then > > FILE =3D 'zero.in' > > truncate -s10T "$FILE" || continue > > fi > > for N in 1 2; do > > rm -f x??.n || framework_failure_ > > timeout 10 sh -c \ > > "yes | split --filter=3D'head -c1 >\$FILE.n' -n $mode$N $FILE" || > fail=3D1 > > # Also ensure we get appropriate output from each filter > > seq 1 $N | tr '0-9' 1 > stat.exp > > stat -c%s x??.n > stat.out || framework_failure_ > > compare stat.exp stat.out || fail=3D1 > > done > > done > > > > I haven't opened a radar report yet as the Apple engineers can't look > > directly at the source code for coreutils due to the GPLv3 licensing an= d > > the test suite seems to be tangled up with the makefiles making it > > impossible to extract a stand-alone test case reproducer to attach to a > > radar bug report. > > Jack > > ps Again, the hang seems to occur at the tail end of the log after it > > emits... > > > > + FILE =3D - > > > > Any suggestions on how reduce this to a simpler test case? I would note > > that the new APFS filesystem produces a failure in the python test > suite... > > > > https://bugs.python.org/issue31380 > > > > which is due to APFS not allowing files to be created with filenames th= at > > contain unassigned codepoints in the Unicode 9.0 standard, whereas HFS+ > > does. So perhaps the coreutils hang might be a similar issue? > > Thank you for the testing and for the report. > > Is there any chance your failing test was via a python2 framework? I'm > asking (on P=C3=A1draig's behalf) because there is a known problem whereb= y > SIGPIPE is mishandled in that case, and that might explain this > failure, since the data-generation phase relies on SIGPIPE killing > this test's "yes" command. > I doubt it as the hang doesn't happen under 10.13 when run on a JHFS formatted volume. Jack --001a113fe9e800a5c005597f1249 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering <jim@meyering.net>= wrote:
On Mon, Sep 18, 2017 at 1:= 18 PM, Jack Howarth
<howarth.mailing.list= s@gmail.com> wrote:
> The coreutils 8.28 release, when built on macOS 10.13 under the new AP= FS
> filesystem, produces a hang during the test suite run. The hang appear= s to
> occur in the execution of coreutils-8.28/tests/split/filter.sh at= ..
>
> + yes
> + head -n200K
> + split -b1G '--filter=3Dhead -c1 >/dev/null'
> + for mode in ''\'''\''' ''\&#= 39;'r/'\'''
> + FILE =3D -
>
> according to the filter.log generated from executing the section of > split/filter.sh containing...
>
> yes | head -n200K | split -b1G --filter=3D'head -c1 >/dev/null&= #39; || fail=3D1
>
> # Ensure that "endless" input is ignored when all filters fi= nish
> for mode in '' 'r/'; do
>=C2=A0 =C2=A0FILE =3D '-'
>=C2=A0 =C2=A0if test "$mode" =3D ''; then
>=C2=A0 =C2=A0 =C2=A0FILE =3D 'zero.in'
>=C2=A0 =C2=A0 =C2=A0truncate -s10T "$FILE" || continue
>=C2=A0 =C2=A0fi
>=C2=A0 =C2=A0for N in 1 2; do
>=C2=A0 =C2=A0 =C2=A0rm -f x??.n || framework_failure_
>=C2=A0 =C2=A0 =C2=A0timeout 10 sh -c \
>=C2=A0 =C2=A0 =C2=A0 =C2=A0"yes | split --filter=3D'head -c1 &= gt;\$FILE.n' -n $mode$N $FILE" || fail=3D1
>=C2=A0 =C2=A0 =C2=A0# Also ensure we get appropriate output from each f= ilter
>=C2=A0 =C2=A0 =C2=A0seq 1 $N | tr '0-9' 1 > stat.exp
>=C2=A0 =C2=A0 =C2=A0stat -c%s x??.n > stat.out || framework_failure_=
>=C2=A0 =C2=A0 =C2=A0compare stat.exp stat.out || fail=3D1
>=C2=A0 =C2=A0done
> done
>
> I haven't opened a radar report yet as the Apple engineers can'= ;t look
> directly at the source code for coreutils due to the GPLv3 licensing a= nd
> the test suite seems to be tangled up with the makefiles making it
> impossible to extract a stand-alone test case reproducer to attach to = a
> radar bug report.
>=C2=A0 =C2=A0 =C2=A0 =C2=A0Jack
> ps Again, the hang seems to occur at the tail end of the log after it<= br> > emits...
>
> + FILE =3D -
>
> Any suggestions on how reduce this to a simpler test case? I would not= e
> that the new APFS filesystem produces a failure in the python test sui= te...
>
> https://bugs.python.org/issue31380
>
> which is due to APFS not allowing files to be created with filenames t= hat
> contain unassigned codepoints in the Unicode 9.0 standard, whereas HFS= +
> does. So perhaps the coreutils hang might be a similar issue?

Thank you for the testing and for the report.

Is there any chance your failing test was via a python2 framework? I'm<= br> asking (on P=C3=A1draig's behalf) because there is a known problem wher= eby
SIGPIPE is mishandled in that case, and that might explain this
failure, since the data-generation phase relies on SIGPIPE killing
this test's "yes" command.

I doubt it as the hang doesn't happen under 10.13 when run on a JHFS = formatted volume.
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 Jack=C2=A0

--001a113fe9e800a5c005597f1249-- From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 18 19:41:19 2017 Received: (at 28506) by debbugs.gnu.org; 18 Sep 2017 23:41:19 +0000 Received: from localhost ([127.0.0.1]:46979 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du5fD-00008B-1x for submit@debbugs.gnu.org; Mon, 18 Sep 2017 19:41:19 -0400 Received: from mail-qt0-f170.google.com ([209.85.216.170]:46728) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du5fB-00007y-30 for 28506@debbugs.gnu.org; Mon, 18 Sep 2017 19:41:17 -0400 Received: by mail-qt0-f170.google.com with SMTP id s18so2220384qta.3 for <28506@debbugs.gnu.org>; Mon, 18 Sep 2017 16:41:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-transfer-encoding; bh=cC/3jm1wIrpIsgZCuwP2SFTDVTeFAmUCV+wnV6B066E=; b=i0SA8bO2lC/CoLzrD3FNULeEMGB/zwAtJd8xyclUS/U+fNf9Avl72bKjMSGAY8pMQ/ fgDccZiQ1nZSihLAM1i1llj6I46p/Lqvnd3hQt8E9qhRIhVJIeo4VU3V6ybIJr0SdXbP 9/pAmnt07xTNOtPFhM8PT3THSERBXEEV62mXzyu5jaYQPiL4DFxhp6B50zo/JSEX0Hct 0cGe1legDsQ9bhmlP3rg0aWXWCfzKBX0SmI/6HTDVfT0u0eHarbm2aZXneVvBpTiWwPt wwIdeeF7PM2FL/8Cfmze6YAr7Ftn+t89E7NLq6Qu3G8rJLzkzu+a2/txX002/NuZMwIR CM0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc:content-transfer-encoding; bh=cC/3jm1wIrpIsgZCuwP2SFTDVTeFAmUCV+wnV6B066E=; b=T9+I6oyUt75CrfYgtkL7pnJg+gnAtWlHdLgKgLpGC0s6lQPy1xQx9A51n9Rptklvge uW50yQzuyXWZEYyFv2GB0RJ2diyGqwb+9Py6v8uxpzqwN2KlblL5Al1YpJgcBDkiOy1f LEY8nP1FCsaQLR7nsFZy/BBhDPDX4kuH7mWLL8J6OjV6YPscXV1a5RcOHmhFQc7P3KVu A4i81waKf/Z0ByDaPRxyuUwXGCT8yDE+3NXQCykvo2TYsfeokhyuhvWj3k4a4CMABOWy UJ5BP3HegD927GhSmlb45FLQwQXAC9Ar2BgpvTE8Dv5TXrTWyx+gO245egKvVZK2H+66 FFFw== X-Gm-Message-State: AHPjjUiQb7IRu1UEsKxLFMWeYO2BFWw3sVCRqRHRa5gU0eFHX6NNu1Qs 6NODytss3qjXcOhw5Fe4HOSw81hNGegf05CycmU= X-Google-Smtp-Source: AOwi7QAZ0v9M/o1ijm8NDWfKxdLFn7miMDIsyB2wXjIMryRMrQyDybZvdY1LdmVAhOWg5NeSU0dmFqNDKDzHzDO+5aU= X-Received: by 10.237.63.248 with SMTP id w53mr28620144qth.290.1505778071570; Mon, 18 Sep 2017 16:41:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.168.143 with HTTP; Mon, 18 Sep 2017 16:40:50 -0700 (PDT) In-Reply-To: References: From: Jim Meyering Date: Mon, 18 Sep 2017 16:40:50 -0700 X-Google-Sender-Auth: d4Ey-RCVAAmKccfdPcb5Pkx6sDE Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jack Howarth Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth wrote: > On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering wrote: ... >> Is there any chance your failing test was via a python2 framework? I'm >> asking (on P=C3=A1draig's behalf) because there is a known problem where= by >> SIGPIPE is mishandled in that case, and that might explain this >> failure, since the data-generation phase relies on SIGPIPE killing >> this test's "yes" command. > > I doubt it as the hang doesn't happen under 10.13 when run on a JHFS > formatted volume. How did you run the tests? From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 18 21:07:40 2017 Received: (at 28506) by debbugs.gnu.org; 19 Sep 2017 01:07:40 +0000 Received: from localhost ([127.0.0.1]:47053 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du70m-00048W-9Z for submit@debbugs.gnu.org; Mon, 18 Sep 2017 21:07:40 -0400 Received: from mail-qt0-f173.google.com ([209.85.216.173]:43700) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1du70k-00048J-Cl for 28506@debbugs.gnu.org; Mon, 18 Sep 2017 21:07:38 -0400 Received: by mail-qt0-f173.google.com with SMTP id i50so2348725qtf.0 for <28506@debbugs.gnu.org>; Mon, 18 Sep 2017 18:07:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=+J9fPDpJQtTIxnkKuj4rTuPGj9h+BL0Hsx/O2UxwAxg=; b=YeVyBiXb5gGpU1AMnK0NIRFEVn8v71DeSq5qvreAbRXZdZZoYrjrJGXJsUkxZlx4nw Jmd0KJbT+6GSpDtOKomFRgmsGqg6uVGnVxOwpmnebm5OJHK/TP2vebdbzpiGsWYxiYii Mz1Xe9qpPH8lnia0NVQU2DTJg6xDT7N46i78n0qsqsXuj2GTohPbPGflUSDfSsxl8e3E 1d18ndcoWOTDvQUJVGfjvCKJZW1KlWUPcIn6/rhzMEHKnHdY3voc7juSnoMqO6Z48SwL SHPlKJV+qVKiJpEo/tN6otWB5IZt/v1Ag5LSNDnKnaljL8itAXDckp2w7/3eRI17q4vh xGAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=+J9fPDpJQtTIxnkKuj4rTuPGj9h+BL0Hsx/O2UxwAxg=; b=nzKb4K/ciyAfAB+XMxYds6Ed4/VOXg6ffEhwdPLoaAGAlIcKDJmp6CCGuIw4pKiUvV gK7XOJKpTgl3UwL3jlty8Pgm0w7KX18Y5Mkwl0Ca3F+2z0MdbYy1gdZy77jIhGfuUDop Lblze3Coo0TJybPia3oXTGzDiVZY9ob3k3/2+5bbNQ86I+/WCM26IrE5yynKm51eIrvz I+CqBjU7/WK6TwSX1TvgXqtdbRAcOsFffQyGbxTNyAP7d61uSFVj0zoWJ3OsDrYLg1Od Fj3GL6cBNCWOZvvBwmirIaGUh/ANI653BeN4NsLEz50G+1VE+pO5Zq9py0F0fo56tMwZ Toig== X-Gm-Message-State: AHPjjUg2H15EdNjlUKHt27sJHxEfCvd+66x1MpSil36ppbB6QJkPvBFb pS+fkKmI+6zMLGAf6MNkwix7IJv1hnzHlvhA8/44Ew== X-Google-Smtp-Source: AOwi7QDlV7nC2mNIfEVeZwAOcEZbdqUGgucpdLLDPc1H6nbVH/qF4+hDEM4ZPmAUFQSeFC40y/BTKqU1h54g7XIs+dM= X-Received: by 10.200.41.148 with SMTP id 20mr30471595qts.69.1505783252790; Mon, 18 Sep 2017 18:07:32 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.209.16 with HTTP; Mon, 18 Sep 2017 18:07:32 -0700 (PDT) In-Reply-To: References: From: Jack Howarth Date: Mon, 18 Sep 2017 21:07:32 -0400 Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jim Meyering Content-Type: multipart/alternative; boundary="001a114069aee4338d0559807b38" X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.5 (/) --001a114069aee4338d0559807b38 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering wrote: > On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth > wrote: > > On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering wrote: > ... > >> Is there any chance your failing test was via a python2 framework? I'm > >> asking (on P=C3=A1draig's behalf) because there is a known problem whe= reby > >> SIGPIPE is mishandled in that case, and that might explain this > >> failure, since the data-generation phase relies on SIGPIPE killing > >> this test's "yes" command. > > > > I doubt it as the hang doesn't happen under 10.13 when run on a JHFS > > formatted volume. > > How did you run the tests? > Actually, I forgot to mention that the coreutils test suite hang only occurred on the APFS volumes when the coreutils built against the gettext and libiconv from fink. A build outside of fink which didn't build against those packages didn't show the hang in the coreutils test suite. The fink gettext and libiconv packages that I am using are those from... https://sourceforge.net/p/fink/package-submissions/4955/ and https://sourceforge.net/p/fink/package-submissions/5004/ which are both patched for the format string strictness in High Sierra. I found that using --disable-nls in configuring coreutils was insufficient to suppress the test suite hang which I assume is due to the presence of... #define HAVE_LIBINTL_H 1 in the generated ./lib/config.h despite the presence of... /* #undef HAVE_DCGETTEXT */ /* #undef HAVE_GETTEXT */ when --disable-nls is used so it still could be a Unicode related change in APFS, no? Jack --001a114069aee4338d0559807b38 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering <jim@meyering.net>= wrote:
On Mon, Sep 18, 2= 017 at 4:26 PM, Jack Howarth
<howarth.mailing.list= s@gmail.com> wrote:
> On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering <jim@meyering.net> wrote:
...
>> Is there any chance your failing test was v= ia a python2 framework? I'm
>> asking (on P=C3=A1draig's behalf) because there is a known pro= blem whereby
>> SIGPIPE is mishandled in that case, and that might explain this >> failure, since the data-generation phase relies on SIGPIPE killing=
>> this test's "yes" command.
>
> I doubt it as the hang doesn't happen under 10.13 when run on a JH= FS
> formatted volume.

How did you run the tests?

Actually, I forgot = to mention that the coreutils test suite hang only occurred on the APFS vol= umes when the coreutils built against the gettext and libiconv from fink. A= build outside of fink which didn't build against those packages didn&#= 39;t show the hang in the coreutils test suite. The fink gettext and libico= nv packages that I am using are those from...

https://sourceforge.net/p/fink/package-su= bmissions/4955/

and

https://sourceforge.net/p/fink/package-submissions/5004/
=

which are both patched for the f= ormat string strictness in=C2=A0High Sierra. I found that using --disable-n= ls in configuring coreutils was insufficient to suppress the test suite han= g which I assume is due to the presence of...

#define HAVE_LI= BINTL_H 1

in the generated ./lib/config.h

despite the presenc= e of...

/* #undef HAVE_DCGETTEXT */
/* #undef HAVE_GETTEXT */
when --disable-nls is used so it still could be a=C2=A0Unicode related change in APFS, = no?
=C2=A0 = =C2=A0 =C2=A0 Jack
--001a114069aee4338d0559807b38-- From debbugs-submit-bounces@debbugs.gnu.org Thu Sep 21 01:20:23 2017 Received: (at 28506) by debbugs.gnu.org; 21 Sep 2017 05:20:23 +0000 Received: from localhost ([127.0.0.1]:50781 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dutuI-0003P2-3x for submit@debbugs.gnu.org; Thu, 21 Sep 2017 01:20:23 -0400 Received: from mail.magicbluesmoke.com ([82.195.144.49]:39262) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dutuF-0003Ot-34 for 28506@debbugs.gnu.org; Thu, 21 Sep 2017 01:20:12 -0400 Received: from localhost.localdomain (c-73-158-116-184.hsd1.ca.comcast.net [73.158.116.184]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.magicbluesmoke.com (Postfix) with ESMTPSA id 5E25F9500; Thu, 21 Sep 2017 06:20:09 +0100 (IST) Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jack Howarth References: From: =?UTF-8?Q?P=c3=a1draig_Brady?= Message-ID: Date: Wed, 20 Sep 2017 22:20:06 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/mixed; boundary="------------95C7ABE1C2233F1E64573BA8" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) This is a multi-part message in MIME format. --------------95C7ABE1C2233F1E64573BA8 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit On 18/09/17 18:07, Jack Howarth wrote: > On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering wrote: > >> On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth >> wrote: >>> On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering wrote: >> ... >>>> Is there any chance your failing test was via a python2 framework? I'm >>>> asking (on Pádraig's behalf) because there is a known problem whereby >>>> SIGPIPE is mishandled in that case, and that might explain this >>>> failure, since the data-generation phase relies on SIGPIPE killing >>>> this test's "yes" command. >>> >>> I doubt it as the hang doesn't happen under 10.13 when run on a JHFS >>> formatted volume. >> >> How did you run the tests? >> > > Actually, I forgot to mention that the coreutils test suite hang only > occurred on the APFS volumes when the coreutils built against the gettext > and libiconv from fink. A build outside of fink which didn't build against > those packages didn't show the hang in the coreutils test suite. The fink > gettext and libiconv packages that I am using are those from... > > https://sourceforge.net/p/fink/package-submissions/4955/ > > and > > https://sourceforge.net/p/fink/package-submissions/5004/ > > which are both patched for the format string strictness in High Sierra. I > found that using --disable-nls in configuring coreutils was insufficient to > suppress the test suite hang which I assume is due to the presence of... > > #define HAVE_LIBINTL_H 1 > > in the generated ./lib/config.h > > despite the presence of... > > /* #undef HAVE_DCGETTEXT */ > /* #undef HAVE_GETTEXT */ > > when --disable-nls is used so it still could be a Unicode related change in > APFS, no? > Jack The libintl bit reminded me of https://lists.gnu.org/archive/html/bug-gnulib/2014-10/msg00014.html I.E. on OSX enabling those libs creates implicit threads I think. Perhaps that's messing with SIGPIPE handling and only the implicit thread gets it, thus not killing the main yes(1) thread. However the yes(1) is also protected with a timeout(1) call. Perhaps timeout(1) is a silent noop. We should support OSX through DYLD_INSERT_LIBRARIES, but perhaps there is something preventing that on your system? But then would the timeout tests fail. Could you check the timeout tests with: make SUBDIRS=. TESTS=tests/misc/filter.sh check In any case we should protect calls to timeout(1) to ensure it's supported. The attached does that at least. cheers, Pádraig. --------------95C7ABE1C2233F1E64573BA8 Content-Type: text/x-patch; name="require_timeout.patch" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="require_timeout.patch" =46rom c003741b9e39d354d94a786dc86e5b97b01e4680 Mon Sep 17 00:00:00 2001 From: =3D?UTF-8?q?P=3DC3=3DA1draig=3D20Brady?=3D Date: Wed, 20 Sep 2017 22:15:04 -0700 Subject: [PATCH] tests: ensure the timeout command works if used * init.cfg (require_timeout_): A new function. * tests/*: Add require_timeout_ if timeout(1) is called. * tests/split/filter.sh: Likewise. Also remove a duplicate clause, and simply and use of timeout(1) by removing a subshell. --- init.cfg | 8 +++++++- tests/cp/fiemap-extents.sh | 1 + tests/cp/fiemap-perf.sh | 2 ++ tests/cp/parent-perm-race.sh | 2 ++ tests/cp/sparse-to-pipe.sh | 1 + tests/dd/no-allocate.sh | 2 ++ tests/dd/skip-seek-past-dev.sh | 1 + tests/dd/stats.sh | 1 + tests/df/no-mtab-status.sh | 1 + tests/df/skip-rootfs.sh | 4 +++- tests/df/total-verify.sh | 3 ++- tests/du/move-dir-while-traversing.sh | 2 +- tests/ls/infloop.sh | 2 ++ tests/ls/readdir-mountpoint-inode.sh | 2 ++ tests/misc/head-write-error.sh | 2 ++ tests/misc/seq-epipe.sh | 2 ++ tests/misc/seq-io-errors.sh | 2 ++ tests/misc/shred-remove.sh | 1 + tests/misc/shuf.sh | 1 + tests/misc/sleep.sh | 1 + tests/misc/sort-NaN-infloop.sh | 1 + tests/misc/sort-compress-hang.sh | 1 + tests/misc/sort-exit-early.sh | 1 + tests/misc/sync.sh | 2 ++ tests/misc/tee.sh | 2 ++ tests/misc/truncate-fifo.sh | 1 + tests/misc/uniq-perf.sh | 1 + tests/rm/ext3-perf.sh | 1 + tests/rm/r-root.sh | 2 ++ tests/split/filter.sh | 13 ++++--------- tests/tail-2/follow-name.sh | 2 ++ tests/tail-2/follow-stdin.sh | 2 ++ tests/tail-2/inotify-dir-recreate.sh | 2 ++ tests/tail-2/inotify-only-regular.sh | 2 ++ tests/tail-2/inotify-race.sh | 1 + tests/tail-2/inotify-race2.sh | 1 + tests/tail-2/inotify-rotate-resources.sh | 2 ++ tests/tail-2/inotify-rotate.sh | 2 ++ tests/tail-2/pid.sh | 1 + tests/tail-2/pipe-f.sh | 2 ++ tests/tail-2/pipe-f2.sh | 2 +- tests/tail-2/retry.sh | 2 ++ tests/tail-2/symlink.sh | 2 ++ tests/tail-2/wait.sh | 2 ++ 44 files changed, 77 insertions(+), 14 deletions(-) diff --git a/init.cfg b/init.cfg index 71582e8..4896c9a 100644 --- a/init.cfg +++ b/init.cfg @@ -314,7 +314,13 @@ require_built_() esac done =20 - test $skip_ =3D yes && skip_ "required program(s) not built" + test $skip_ =3D yes && skip_ 'required program(s) not built' + return 0 +} + +require_timeout_() { + require_built_ 'timeout' && timeout 0.001 sleep 10 + test $? =3D 124 || skip_ 'timeout support required' } =20 require_file_system_bytes_free_() diff --git a/tests/cp/fiemap-extents.sh b/tests/cp/fiemap-extents.sh index 5f235ed..c822bcd 100755 --- a/tests/cp/fiemap-extents.sh +++ b/tests/cp/fiemap-extents.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ cp =20 +require_timeout_ require_sparse_support_ =20 touch fiemap_chk || framework_failure_ diff --git a/tests/cp/fiemap-perf.sh b/tests/cp/fiemap-perf.sh index e122537..74bee5c 100755 --- a/tests/cp/fiemap-perf.sh +++ b/tests/cp/fiemap-perf.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ cp =20 +require_timeout_ + # Require a fiemap-enabled FS. touch fiemap_chk fiemap_capable_ fiemap_chk || diff --git a/tests/cp/parent-perm-race.sh b/tests/cp/parent-perm-race.sh index 68fb721..3bdd721 100755 --- a/tests/cp/parent-perm-race.sh +++ b/tests/cp/parent-perm-race.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ cp =20 +require_timeout_ + # cp -p gives ENOTSUP on NFS on Linux 2.6.9 at least require_local_dir_ =20 diff --git a/tests/cp/sparse-to-pipe.sh b/tests/cp/sparse-to-pipe.sh index 3f13b37..288f366 100755 --- a/tests/cp/sparse-to-pipe.sh +++ b/tests/cp/sparse-to-pipe.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ cp =20 +require_timeout_ require_sparse_support_ =20 # Terminate any background cp process diff --git a/tests/dd/no-allocate.sh b/tests/dd/no-allocate.sh index 43d6ecd..06ec6d6 100755 --- a/tests/dd/no-allocate.sh +++ b/tests/dd/no-allocate.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ dd =20 +require_timeout_ + # Determine basic amount of memory needed. echo . > f || framework_failure_ vm=3D$(get_min_ulimit_v_ timeout 10 dd if=3Df of=3Df2 status=3Dnone) \ diff --git a/tests/dd/skip-seek-past-dev.sh b/tests/dd/skip-seek-past-dev= =2Esh index f3cfb53..ebd1fae 100755 --- a/tests/dd/skip-seek-past-dev.sh +++ b/tests/dd/skip-seek-past-dev.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ dd =20 +require_timeout_ # need write access to local device # (even though we don't actually write anything) require_root_ diff --git a/tests/dd/stats.sh b/tests/dd/stats.sh index 3e6fc14..d2bb4ac 100755 --- a/tests/dd/stats.sh +++ b/tests/dd/stats.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ dd require_trap_signame_ +require_timeout_ =20 kill -l | grep 'INFO' && SIGINFO=3D'INFO' || SIGINFO=3D'USR1' =20 diff --git a/tests/df/no-mtab-status.sh b/tests/df/no-mtab-status.sh index 319d58b..b6d53a2 100755 --- a/tests/df/no-mtab-status.sh +++ b/tests/df/no-mtab-status.sh @@ -20,6 +20,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ df require_gcc_shared_ +require_timeout_ =20 # Protect against inaccessible remote mounts etc. timeout 10 df || skip_ "df fails" diff --git a/tests/df/skip-rootfs.sh b/tests/df/skip-rootfs.sh index 425cbc8..82a9d2a 100755 --- a/tests/df/skip-rootfs.sh +++ b/tests/df/skip-rootfs.sh @@ -19,8 +19,10 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ df =20 +require_timeout_ + # Protect against inaccessible remote mounts etc. -timeout 10 df || skip_ "df fails" +timeout 10 df || skip_ 'df fails' =20 # Verify that rootfs is in mtab (and shown when the -a option is specifi= ed). # Note this is the case when /proc/self/mountinfo is parsed diff --git a/tests/df/total-verify.sh b/tests/df/total-verify.sh index 5256e71..43a694a 100755 --- a/tests/df/total-verify.sh +++ b/tests/df/total-verify.sh @@ -19,9 +19,10 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ df require_perl_ +require_timeout_ =20 # Protect against inaccessible remote mounts etc. -timeout 10 df || skip_ "df fails" +timeout 10 df || skip_ 'df fails' =20 cat <<\EOF > check-df || framework_failure_ my ($total, $used, $avail) =3D (0, 0, 0); diff --git a/tests/du/move-dir-while-traversing.sh b/tests/du/move-dir-wh= ile-traversing.sh index 70fa22e..f03f77c 100755 --- a/tests/du/move-dir-while-traversing.sh +++ b/tests/du/move-dir-while-traversing.sh @@ -19,7 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ du require_trap_signame_ - +require_timeout_ # We use a python-inotify script, so... python -m pyinotify -h > /dev/null \ || skip_ 'python inotify package not installed' diff --git a/tests/ls/infloop.sh b/tests/ls/infloop.sh index 643f177..3fe7e7d 100755 --- a/tests/ls/infloop.sh +++ b/tests/ls/infloop.sh @@ -20,6 +20,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ ls =20 +require_timeout_ + mkdir loop || framework_failure_ ln -s ../loop loop/sub || framework_failure_ =20 diff --git a/tests/ls/readdir-mountpoint-inode.sh b/tests/ls/readdir-moun= tpoint-inode.sh index b4ca9e4..08bdeed 100755 --- a/tests/ls/readdir-mountpoint-inode.sh +++ b/tests/ls/readdir-mountpoint-inode.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ ls =20 +require_timeout_ + # We use --local here so as to not activate # potentially very many remote mounts. df --local --out=3Dtarget | sed -n '/^\/./p' > mount_points diff --git a/tests/misc/head-write-error.sh b/tests/misc/head-write-error= =2Esh index cba591a..7af2520 100755 --- a/tests/misc/head-write-error.sh +++ b/tests/misc/head-write-error.sh @@ -20,6 +20,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ head =20 +require_timeout_ + if ! test -w /dev/full || ! test -c /dev/full; then skip_ '/dev/full is required' fi diff --git a/tests/misc/seq-epipe.sh b/tests/misc/seq-epipe.sh index 43ff2c7..890cc1f 100755 --- a/tests/misc/seq-epipe.sh +++ b/tests/misc/seq-epipe.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ seq =20 +require_timeout_ + (trap '' PIPE && yes | :) 2>&1 | grep -qF 'Broken pipe' || skip_ 'trapping SIGPIPE is not supported' =20 diff --git a/tests/misc/seq-io-errors.sh b/tests/misc/seq-io-errors.sh index fd6924e..410aaca 100755 --- a/tests/misc/seq-io-errors.sh +++ b/tests/misc/seq-io-errors.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ seq =20 +require_timeout_ + if ! test -w /dev/full || ! test -c /dev/full; then skip_ '/dev/full is required' fi diff --git a/tests/misc/shred-remove.sh b/tests/misc/shred-remove.sh index 8720eaf..da9fc47 100755 --- a/tests/misc/shred-remove.sh +++ b/tests/misc/shred-remove.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ shred skip_if_root_ +require_timeout_ =20 # The length of the basename is what matters. # In this case, shred-4.0l would try to rename the file 256^10 times diff --git a/tests/misc/shuf.sh b/tests/misc/shuf.sh index 66364d4..bef0575 100755 --- a/tests/misc/shuf.sh +++ b/tests/misc/shuf.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ shuf getlimits_ +require_timeout_ =20 seq 100 > in || framework_failure_ =20 diff --git a/tests/misc/sleep.sh b/tests/misc/sleep.sh index 0397b7b..e8f57d7 100755 --- a/tests/misc/sleep.sh +++ b/tests/misc/sleep.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ sleep getlimits_ +require_timeout_ =20 # invalid timeouts returns_ 1 timeout 10 sleep invalid || fail=3D1 diff --git a/tests/misc/sort-NaN-infloop.sh b/tests/misc/sort-NaN-infloop= =2Esh index e7e49a2..5e00dcb 100755 --- a/tests/misc/sort-NaN-infloop.sh +++ b/tests/misc/sort-NaN-infloop.sh @@ -18,6 +18,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ sort +require_timeout_ =20 echo nan > F || framework_failure_ printf 'nan\nnan\n' > exp || framework_failure_ diff --git a/tests/misc/sort-compress-hang.sh b/tests/misc/sort-compress-= hang.sh index e76409f..076788b 100755 --- a/tests/misc/sort-compress-hang.sh +++ b/tests/misc/sort-compress-hang.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ sort very_expensive_ +require_timeout_ =20 cat <compress || framework_failure_ #!$SHELL diff --git a/tests/misc/sort-exit-early.sh b/tests/misc/sort-exit-early.s= h index 2ce7c5b..8708ddb 100755 --- a/tests/misc/sort-exit-early.sh +++ b/tests/misc/sort-exit-early.sh @@ -19,6 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ sort skip_if_root_ +require_timeout_ =20 SORT_FAILURE=3D2 =20 diff --git a/tests/misc/sync.sh b/tests/misc/sync.sh index bf1b4f1..4b4deab 100755 --- a/tests/misc/sync.sh +++ b/tests/misc/sync.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ sync =20 +require_timeout_ + touch file =20 # fdatasync+syncfs is nonsensical diff --git a/tests/misc/tee.sh b/tests/misc/tee.sh index 5998c5a..eb39e6b 100755 --- a/tests/misc/tee.sh +++ b/tests/misc/tee.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tee =20 +require_timeout_ + echo line >sample || framework_failure_ =20 # POSIX says: "Processing of at least 13 file operands shall be supporte= d." diff --git a/tests/misc/truncate-fifo.sh b/tests/misc/truncate-fifo.sh index e84fa54..2fa6beb 100755 --- a/tests/misc/truncate-fifo.sh +++ b/tests/misc/truncate-fifo.sh @@ -18,6 +18,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ truncate +require_timeout_ =20 mkfifo_or_skip_ fifo =20 diff --git a/tests/misc/uniq-perf.sh b/tests/misc/uniq-perf.sh index 70ef28c..936f318 100755 --- a/tests/misc/uniq-perf.sh +++ b/tests/misc/uniq-perf.sh @@ -18,6 +18,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ uniq +require_timeout_ =20 seq 100 > in || fail=3D1 timeout 10 uniq -f 10000000000 in || fail=3D1 diff --git a/tests/rm/ext3-perf.sh b/tests/rm/ext3-perf.sh index 0fe8efe..b2abecd 100755 --- a/tests/rm/ext3-perf.sh +++ b/tests/rm/ext3-perf.sh @@ -18,6 +18,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ rm +require_timeout_ =20 very_expensive_ =20 diff --git a/tests/rm/r-root.sh b/tests/rm/r-root.sh index edc3542..7800809 100755 --- a/tests/rm/r-root.sh +++ b/tests/rm/r-root.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ rm =20 +require_timeout_ + # POSIX mandates rm(1) to skip '/' arguments. This test verifies this m= andated # behavior as well as the --preserve-root and --no-preserve-root options= =2E # Especially the latter case is a live fire exercise as rm(1) is suppose= d to diff --git a/tests/split/filter.sh b/tests/split/filter.sh index 96602bd..e8dcdc6 100755 --- a/tests/split/filter.sh +++ b/tests/split/filter.sh @@ -18,8 +18,9 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ split +require_timeout_ require_sparse_support_ # for 'truncate --size=3D$LARGE' -xz --version || skip_ "xz (better than gzip/bzip2) required" +xz --version || skip_ 'xz (better than gzip/bzip2) required' =20 for total_n_lines in 5 3000 20000; do seq $total_n_lines > in || framework_failure_ @@ -60,8 +61,8 @@ for mode in '' 'r/'; do fi for N in 1 2; do rm -f x??.n || framework_failure_ - timeout 10 sh -c \ - "yes | split --filter=3D'head -c1 >\$FILE.n' -n $mode$N $FILE" || = fail=3D1 + yes | timeout 10 split --filter=3D'head -c1 >$FILE.n' -n $mode$N $FI= LE \ + || fail=3D1 # Also ensure we get appropriate output from each filter seq 1 $N | tr '0-9' 1 > stat.exp stat -c%s x??.n > stat.out || framework_failure_ @@ -75,10 +76,4 @@ for buf in 1000 1000000; do "yes | split --filter=3D'head -c1 >/dev/null' -b $buf" || fail=3D1 done =20 -# Ensure that "endless" input _is_ processed for unbounded number of fil= ters -for buf in 1000 1000000; do - returns_ 124 timeout .5 sh -c \ - "yes | split --filter=3D'head -c1 >/dev/null' -b $buf" || fail=3D1 -done - Exit $fail diff --git a/tests/tail-2/follow-name.sh b/tests/tail-2/follow-name.sh index 01f0ff2..3b51be9 100755 --- a/tests/tail-2/follow-name.sh +++ b/tests/tail-2/follow-name.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + cat <<\EOF > exp || framework_failure_ tail: cannot open 'no-such' for reading: No such file or directory tail: no files remaining diff --git a/tests/tail-2/follow-stdin.sh b/tests/tail-2/follow-stdin.sh index 7df8350..a865d83 100755 --- a/tests/tail-2/follow-stdin.sh +++ b/tests/tail-2/follow-stdin.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + ################# # tail -f - would fail with the initial inotify implementation =20 diff --git a/tests/tail-2/inotify-dir-recreate.sh b/tests/tail-2/inotify-= dir-recreate.sh index 3c33153..6ee242f 100755 --- a/tests/tail-2/inotify-dir-recreate.sh +++ b/tests/tail-2/inotify-dir-recreate.sh @@ -21,6 +21,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + grep '^#define HAVE_INOTIFY 1' "$CONFIG_HEADER" >/dev/null && is_local_d= ir_ . \ || skip_ 'inotify is not supported' =20 diff --git a/tests/tail-2/inotify-only-regular.sh b/tests/tail-2/inotify-= only-regular.sh index f48e36f..0363473 100755 --- a/tests/tail-2/inotify-only-regular.sh +++ b/tests/tail-2/inotify-only-regular.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + grep '^#define HAVE_INOTIFY 1' "$CONFIG_HEADER" >/dev/null \ || skip_ 'inotify support required' =20 diff --git a/tests/tail-2/inotify-race.sh b/tests/tail-2/inotify-race.sh index 433a173..ad55f82 100755 --- a/tests/tail-2/inotify-race.sh +++ b/tests/tail-2/inotify-race.sh @@ -22,6 +22,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail sleep +require_timeout_ =20 # Terminate any background gdb/tail process cleanup_() { diff --git a/tests/tail-2/inotify-race2.sh b/tests/tail-2/inotify-race2.s= h index ffbf29f..e0fd716 100755 --- a/tests/tail-2/inotify-race2.sh +++ b/tests/tail-2/inotify-race2.sh @@ -21,6 +21,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail sleep +require_timeout_ =20 # Terminate any background gdb/tail process cleanup_() { diff --git a/tests/tail-2/inotify-rotate-resources.sh b/tests/tail-2/inot= ify-rotate-resources.sh index 82d6713..a7b12fc 100755 --- a/tests/tail-2/inotify-rotate-resources.sh +++ b/tests/tail-2/inotify-rotate-resources.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + # Inotify not used on remote file systems require_local_dir_ =20 diff --git a/tests/tail-2/inotify-rotate.sh b/tests/tail-2/inotify-rotate= =2Esh index 4b4cff2..0fd58a4 100755 --- a/tests/tail-2/inotify-rotate.sh +++ b/tests/tail-2/inotify-rotate.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + grep '^#define HAVE_INOTIFY 1' "$CONFIG_HEADER" >/dev/null \ || expensive_ =20 diff --git a/tests/tail-2/pid.sh b/tests/tail-2/pid.sh index 7121d68..20856e2 100755 --- a/tests/tail-2/pid.sh +++ b/tests/tail-2/pid.sh @@ -18,6 +18,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail +require_timeout_ getlimits_ =20 touch empty here || framework_failure_ diff --git a/tests/tail-2/pipe-f.sh b/tests/tail-2/pipe-f.sh index 759881c..134e4bf 100755 --- a/tests/tail-2/pipe-f.sh +++ b/tests/tail-2/pipe-f.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + # Speedup the non inotify case fastpoll=3D'-s.1 --max-unchanged-stats=3D1' =20 diff --git a/tests/tail-2/pipe-f2.sh b/tests/tail-2/pipe-f2.sh index c7e429e..903ac1d 100755 --- a/tests/tail-2/pipe-f2.sh +++ b/tests/tail-2/pipe-f2.sh @@ -18,7 +18,7 @@ =20 . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail - +require_timeout_ mkfifo_or_skip_ fifo =20 echo 1 > fifo & diff --git a/tests/tail-2/retry.sh b/tests/tail-2/retry.sh index abe0d67..79e8bda 100755 --- a/tests/tail-2/retry.sh +++ b/tests/tail-2/retry.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + # Function to count number of lines from tail # while ignoring transient errors due to resource limits countlines_ () diff --git a/tests/tail-2/symlink.sh b/tests/tail-2/symlink.sh index 1bbd577..fa34979 100755 --- a/tests/tail-2/symlink.sh +++ b/tests/tail-2/symlink.sh @@ -19,6 +19,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + # Function to count number of lines from tail # while ignoring transient errors due to resource limits countlines_ () diff --git a/tests/tail-2/wait.sh b/tests/tail-2/wait.sh index c79fc66..b79de6f 100755 --- a/tests/tail-2/wait.sh +++ b/tests/tail-2/wait.sh @@ -20,6 +20,8 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ tail =20 +require_timeout_ + grep '^#define HAVE_INOTIFY 1' "$CONFIG_HEADER" >/dev/null \ && HAVE_INOTIFY=3D1 =20 --=20 2.9.3 --------------95C7ABE1C2233F1E64573BA8-- From debbugs-submit-bounces@debbugs.gnu.org Thu Sep 21 02:02:37 2017 Received: (at 28506) by debbugs.gnu.org; 21 Sep 2017 06:02:37 +0000 Received: from localhost ([127.0.0.1]:50810 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1duuZI-0006LS-QV for submit@debbugs.gnu.org; Thu, 21 Sep 2017 02:02:37 -0400 Received: from mail-qt0-f175.google.com ([209.85.216.175]:51589) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1duuZG-0006LE-LG for 28506@debbugs.gnu.org; Thu, 21 Sep 2017 02:02:35 -0400 Received: by mail-qt0-f175.google.com with SMTP id q4so4954505qtq.8 for <28506@debbugs.gnu.org>; Wed, 20 Sep 2017 23:02:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-transfer-encoding; bh=rpwYkvRFvupOL1yLb2GozJdNENVHZYlu8WtGdrw8x94=; b=c8yLUsAC7qdUj6tDnN9lgSXZU0g3FwP+G+ueQqYXEhbuJNdgcatCTm55UNg+TgWPFc opBm5VfjioZ+MoAwXki+L9MzEr26nmnsA14bd5zu/jP855FLzdMyS+uPfT6ZCFeOp581 Q2xOnV5RQkMMmZH9Iu91sJg8soPtI0UeDAtLXxAuORmytvPE12sq0l6wjYIORjFGh+F1 GDjXvGvLNCKMlkXWSOhFsa57f4AbAIDBG5sD+TozBwOjrl2EpGrWjBivBDOfCIQqBE7C UalltGPrVLx+NjHhWEZCYQomqKPbAtGYq7Npq/LRtiRtczwuLnEbVW/FpJYbYARkW2p2 H42w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc:content-transfer-encoding; bh=rpwYkvRFvupOL1yLb2GozJdNENVHZYlu8WtGdrw8x94=; b=imaYceefUKb5+ZGnMueqvgig54E7+lBgulSPovM7s03xSI1Pwaf2211+mn+4JcZgKG kaNz6HlDAOPa4O9coknMWToXXmP1/gkbgcLc+Clhufjrudam53XSAyeODU/m4agUOdUC Y7dNPU53dBszxKX9jV3jJwMQcrk9XR8ymSfIfL2l0+V4GCa2QXVyka8shrLQ9srh6ZMz 7C9lSRqIBv9bShgUtjWc3xXZxKLzQbwpz0MY/AMWMFLMCHIv9v74ZT6K3nYNE7dhNhOs tlBuGnS63hT9KOT58oqBwppecm8EetTqVOjzTCg5PSd0Is0DgTiAdKbB7ODkzuS+x+kz 7P4g== X-Gm-Message-State: AHPjjUhrjyalazV4EkZKV3P4MQJvdbKjsDXBoQMOoviSWIgXpYp4/V7t eqCC5drf2JuZ1ONZvZxKOmy/8SPg/dlJdkiZ1t4= X-Google-Smtp-Source: AOwi7QBNECARBMg5mEv71eudBuhULrgICrF483gTi8In/oNSfMJMURlfMw7Dzk4HVl6/YVoOTE0lhRJdGJJt5DXs6L8= X-Received: by 10.237.39.135 with SMTP id a7mr1738550qtd.84.1505973749106; Wed, 20 Sep 2017 23:02:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.168.143 with HTTP; Wed, 20 Sep 2017 23:02:07 -0700 (PDT) In-Reply-To: References: From: Jim Meyering Date: Wed, 20 Sep 2017 23:02:07 -0700 X-Google-Sender-Auth: VA0FEmD4hVstHCSuwBslHM1mRWY Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: =?UTF-8?Q?P=C3=A1draig_Brady?= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org, Jack Howarth X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On Wed, Sep 20, 2017 at 10:20 PM, P=C3=A1draig Brady wro= te: > On 18/09/17 18:07, Jack Howarth wrote: >> On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering wrote: >> >>> On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth >>> wrote: >>>> On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering wrote= : >>> ... >>>>> Is there any chance your failing test was via a python2 framework? I'= m >>>>> asking (on P=C3=A1draig's behalf) because there is a known problem wh= ereby >>>>> SIGPIPE is mishandled in that case, and that might explain this >>>>> failure, since the data-generation phase relies on SIGPIPE killing >>>>> this test's "yes" command. >>>> >>>> I doubt it as the hang doesn't happen under 10.13 when run on a JHFS >>>> formatted volume. >>> >>> How did you run the tests? >>> >> >> Actually, I forgot to mention that the coreutils test suite hang only >> occurred on the APFS volumes when the coreutils built against the gettex= t >> and libiconv from fink. A build outside of fink which didn't build again= st >> those packages didn't show the hang in the coreutils test suite. The fin= k >> gettext and libiconv packages that I am using are those from... >> >> https://sourceforge.net/p/fink/package-submissions/4955/ >> >> and >> >> https://sourceforge.net/p/fink/package-submissions/5004/ >> >> which are both patched for the format string strictness in High Sierra. = I >> found that using --disable-nls in configuring coreutils was insufficient= to >> suppress the test suite hang which I assume is due to the presence of... >> >> #define HAVE_LIBINTL_H 1 >> >> in the generated ./lib/config.h >> >> despite the presence of... >> >> /* #undef HAVE_DCGETTEXT */ >> /* #undef HAVE_GETTEXT */ >> >> when --disable-nls is used so it still could be a Unicode related change= in >> APFS, no? >> Jack > > The libintl bit reminded me of https://lists.gnu.org/archive/html/bug-gnu= lib/2014-10/msg00014.html > I.E. on OSX enabling those libs creates implicit threads I think. > Perhaps that's messing with SIGPIPE handling and only the implicit > thread gets it, thus not killing the main yes(1) thread. > However the yes(1) is also protected with a timeout(1) call. > Perhaps timeout(1) is a silent noop. We should support OSX through DYLD_I= NSERT_LIBRARIES, > but perhaps there is something preventing that on your system? > But then would the timeout tests fail. Could you check the timeout tests = with: > > make SUBDIRS=3D. TESTS=3Dtests/misc/filter.sh check > > In any case we should protect calls to timeout(1) to ensure it's supporte= d. > The attached does that at least. Good idea. Do you think there should be a syntax-check rule to ensure that any timeout-using test first calls require_timeout_? This makes me wonder if we should make timeout a function that does that job (the first time only), and then exec's the real timeout command. From debbugs-submit-bounces@debbugs.gnu.org Thu Sep 21 20:23:19 2017 Received: (at 28506) by debbugs.gnu.org; 22 Sep 2017 00:23:19 +0000 Received: from localhost ([127.0.0.1]:52001 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvBkU-0002KO-Qr for submit@debbugs.gnu.org; Thu, 21 Sep 2017 20:23:19 -0400 Received: from mail-qt0-f179.google.com ([209.85.216.179]:48482) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvBkT-0002KC-GN for 28506@debbugs.gnu.org; Thu, 21 Sep 2017 20:23:18 -0400 Received: by mail-qt0-f179.google.com with SMTP id q8so7620668qtb.5 for <28506@debbugs.gnu.org>; Thu, 21 Sep 2017 17:23:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=3iLsnhzAMYKmA0wT/0YN0D18wF9c0Fg8jzYFWa/hOPY=; b=UnqUQI3EMYsEBO2oG1OituL2G3uIBeYXKcpN6T1SmGWRTUS8mbcG8cnPJwixQwxYfz DlARls6lOOc031qy26OVhXyuCXmjfwzDQ5sP/JyA/x7s1LbKiGprHUI5oLGqF4Q12olZ rR/vykvrkq3h5zgGq2jqk0dvEsorVuHFKIEFviH/9W9IOM8h2A3aUvFiAKzY9VWNYj7A 2MlbpfPdRNf6z4uDvQKxwpO8WGiUQlThzeM1eKtSJLMVz6NT3Ccxnej9szTIdzI5oPji 822ZpS2WfV+yuvyRQzue/RAN3Saka7mpjPmw1M0UKzXbP5N6KYZaTTVSiBWTot2zpWFd B3ZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=3iLsnhzAMYKmA0wT/0YN0D18wF9c0Fg8jzYFWa/hOPY=; b=MxoJtdKJcLNQgWSKYV/VB6dQFYU8t8beDNOcCiiXST+QLb/jpTbYEvouWqgFsMnx6E HwGPFj1UhsYPWCMCZHLzTCfY3PAorhyko7a3k+hBzMXlmgPOtQNYRLXTUN97nBQ4jCva O/FWptw76iCGRoL5RDPO8noKTNbsSQeseBj9YzjTXgq+f12V8m3hPXg6yaoVk1sSB4jc htC4z0aSE833J4OI9aP6BqbH9AYvNS/YAaRhzNMm6J8Qdd/mF2QzpabRXpKKvHLl0pvf RXoRQLTQlr+c9tWv+vx9NIWeclvt4J01MdCTXYxRvgcBGIt5ulfG+6OxR4Gk3Fl4fEGw f/zw== X-Gm-Message-State: AHPjjUhcKlA+iGpYlsVlIcsRharzQJVGdFO0FFVB+Z4ay+rrUkUnfazo njRVlTpY0yTZtvGhKIifHS2Wxand0O9uHFAcCH8Wzw== X-Google-Smtp-Source: AOwi7QAJuvhtOSrQ+sTIKIz4RrjDpW27rTJnt/pvwUZ6dpn7mSnjDm+YVuy//ZROwohudKQIVICH7HdHZQqSDp4+PK8= X-Received: by 10.200.40.117 with SMTP id 50mr6179282qtr.167.1506039791918; Thu, 21 Sep 2017 17:23:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.209.16 with HTTP; Thu, 21 Sep 2017 17:23:11 -0700 (PDT) In-Reply-To: References: From: Jack Howarth Date: Thu, 21 Sep 2017 20:23:11 -0400 Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: =?UTF-8?Q?P=C3=A1draig_Brady?= Content-Type: multipart/alternative; boundary="001a113c6008d0a21b0559bc368a" X-Spam-Score: -0.2 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.2 (/) --001a113c6008d0a21b0559bc368a Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, Sep 21, 2017 at 1:20 AM, P=C3=A1draig Brady wrot= e: > On 18/09/17 18:07, Jack Howarth wrote: > > On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering wrote: > > > >> On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth > >> wrote: > >>> On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering > wrote: > >> ... > >>>> Is there any chance your failing test was via a python2 framework? I= 'm > >>>> asking (on P=C3=A1draig's behalf) because there is a known problem w= hereby > >>>> SIGPIPE is mishandled in that case, and that might explain this > >>>> failure, since the data-generation phase relies on SIGPIPE killing > >>>> this test's "yes" command. > >>> > >>> I doubt it as the hang doesn't happen under 10.13 when run on a JHFS > >>> formatted volume. > >> > >> How did you run the tests? > >> > > > > Actually, I forgot to mention that the coreutils test suite hang only > > occurred on the APFS volumes when the coreutils built against the gette= xt > > and libiconv from fink. A build outside of fink which didn't build > against > > those packages didn't show the hang in the coreutils test suite. The fi= nk > > gettext and libiconv packages that I am using are those from... > > > > https://sourceforge.net/p/fink/package-submissions/4955/ > > > > and > > > > https://sourceforge.net/p/fink/package-submissions/5004/ > > > > which are both patched for the format string strictness in High Sierra.= I > > found that using --disable-nls in configuring coreutils was insufficien= t > to > > suppress the test suite hang which I assume is due to the presence of..= . > > > > #define HAVE_LIBINTL_H 1 > > > > in the generated ./lib/config.h > > > > despite the presence of... > > > > /* #undef HAVE_DCGETTEXT */ > > /* #undef HAVE_GETTEXT */ > > > > when --disable-nls is used so it still could be a Unicode related chang= e > in > > APFS, no? > > Jack > > The libintl bit reminded me of https://lists.gnu.org/archive/ > html/bug-gnulib/2014-10/msg00014.html > I.E. on OSX enabling those libs creates implicit threads I think. > Perhaps that's messing with SIGPIPE handling and only the implicit > thread gets it, thus not killing the main yes(1) thread. > However the yes(1) is also protected with a timeout(1) call. > Perhaps timeout(1) is a silent noop. We should support OSX through > DYLD_INSERT_LIBRARIES, > but perhaps there is something preventing that on your system? > But then would the timeout tests fail. Could you check the timeout tests > with: > > make SUBDIRS=3D. TESTS=3Dtests/misc/filter.sh check > > In any case we should protect calls to timeout(1) to ensure it's supporte= d. > The attached does that at least. > > cheers, > P=C3=A1draig. > P=C3=A1draig, The hang on APFS volumes doesn't seem to be related to CoreFoundation threading. If I repeat the steps that I used to track down a similar issue in make 4.0/4.1 by rebuilding libiconv with --disable-nls and coreutils with the same --disable-nls so that neither are linked against CoreFoundation, the test suite hang still occurs. Also, for the stock build, adding your proposed timeout changes doesn't eliminate the hang in the test suite either. Jack --001a113c6008d0a21b0559bc368a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Thu, Sep 21, 2017 at 1:20 AM, P=C3=A1draig Brady &= lt;P@draigbrady.com> wrote:
On 18/09/17 18:07, Jack Howarth wrote:
> On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering <jim@meyering.net> wrote:
>
>> On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth
>> <howarth.mai= ling.lists@gmail.com> wrote:
>>> On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering <jim@meyering.net> wrote:
>> ...
>>>> Is there any chance your failing test was via a python2 fr= amework? I'm
>>>> asking (on P=C3=A1draig's behalf) because there is a k= nown problem whereby
>>>> SIGPIPE is mishandled in that case, and that might explain= this
>>>> failure, since the data-generation phase relies on SIGPIPE= killing
>>>> this test's "yes" command.
>>>
>>> I doubt it as the hang doesn't happen under 10.13 when run= on a JHFS
>>> formatted volume.
>>
>> How did you run the tests?
>>
>
> Actually, I forgot to mention that the coreutils test suite hang only<= br> > occurred on the APFS volumes when the coreutils built against the gett= ext
> and libiconv from fink. A build outside of fink which didn't build= against
> those packages didn't show the hang in the coreutils test suite. T= he fink
> gettext and libiconv packages that I am using are those from...
>
> https://sourceforge.net/p/fink/pac= kage-submissions/4955/
>
> and
>
> https://sourceforge.net/p/fink/pac= kage-submissions/5004/
>
> which are both patched for the format string strictness in High Sierra= . I
> found that using --disable-nls in configuring coreutils was insufficie= nt to
> suppress the test suite hang which I assume is due to the presence of.= ..
>
> #define HAVE_LIBINTL_H 1
>
> in the generated ./lib/config.h
>
> despite the presence of...
>
> /* #undef HAVE_DCGETTEXT */
> /* #undef HAVE_GETTEXT */
>
> when --disable-nls is used so it still could be a Unicode related chan= ge in
> APFS, no?
>=C2=A0 =C2=A0 =C2=A0 =C2=A0Jack

The libintl bit reminded me of https://lists.gnu.org/archive/html/bug-gnulib/2014-10/msg00014.html
I.E. on OSX enabling those libs creates implicit threads I think.
Perhaps that's messing with SIGPIPE handling and only the implicit
thread gets it, thus not killing the main yes(1) thread.
However the yes(1) is also protected with a timeout(1) call.
Perhaps timeout(1) is a silent noop. We should support OSX through DYLD_INS= ERT_LIBRARIES,
but perhaps there is something preventing that on your system?
But then would the timeout tests fail. Could you check the timeout tests wi= th:

=C2=A0 make SUBDIRS=3D. TESTS=3Dtests/misc/filter.sh check

In any case we should protect calls to timeout(1) to ensure it's suppor= ted.
The attached does that at least.

cheers,
P=C3=A1draig.

P=C3=A1draig,
=
=C2=A0 =C2=A0 =C2=A0The hang on APFS volumes doe= sn't seem to be related to CoreFoundation threading. If I repeat the st= eps that I used to track down a similar issue in make 4.0/4.1 by rebuilding= libiconv with --disable-nls and coreutils with the same --disable-nls so t= hat neither are linked against CoreFoundation, the test suite hang still oc= curs. Also, for the stock build, adding your proposed timeout changes doesn= 't eliminate the hang in the test suite either.
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Jack
--001a113c6008d0a21b0559bc368a-- From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 22 23:04:08 2017 Received: (at 28506) by debbugs.gnu.org; 23 Sep 2017 03:04:08 +0000 Received: from localhost ([127.0.0.1]:53373 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvajf-0008CA-O5 for submit@debbugs.gnu.org; Fri, 22 Sep 2017 23:04:08 -0400 Received: from mail.magicbluesmoke.com ([82.195.144.49]:46332) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvaje-0008C1-3P for 28506@debbugs.gnu.org; Fri, 22 Sep 2017 23:04:06 -0400 Received: from localhost.localdomain (c-73-158-116-184.hsd1.ca.comcast.net [73.158.116.184]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.magicbluesmoke.com (Postfix) with ESMTPSA id 83A529C38; Sat, 23 Sep 2017 04:04:04 +0100 (IST) Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jim Meyering References: From: =?UTF-8?Q?P=c3=a1draig_Brady?= Message-ID: Date: Fri, 22 Sep 2017 20:04:02 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On 20/09/17 23:02, Jim Meyering wrote: > On Wed, Sep 20, 2017 at 10:20 PM, Pádraig Brady wrote: >> On 18/09/17 18:07, Jack Howarth wrote: >>> On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering wrote: >>> >>>> On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth >>>> wrote: >>>>> On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering wrote: >>>> ... >>>>>> Is there any chance your failing test was via a python2 framework? I'm >>>>>> asking (on Pádraig's behalf) because there is a known problem whereby >>>>>> SIGPIPE is mishandled in that case, and that might explain this >>>>>> failure, since the data-generation phase relies on SIGPIPE killing >>>>>> this test's "yes" command. >>>>> >>>>> I doubt it as the hang doesn't happen under 10.13 when run on a JHFS >>>>> formatted volume. >>>> >>>> How did you run the tests? >>>> >>> >>> Actually, I forgot to mention that the coreutils test suite hang only >>> occurred on the APFS volumes when the coreutils built against the gettext >>> and libiconv from fink. A build outside of fink which didn't build against >>> those packages didn't show the hang in the coreutils test suite. The fink >>> gettext and libiconv packages that I am using are those from... >>> >>> https://sourceforge.net/p/fink/package-submissions/4955/ >>> >>> and >>> >>> https://sourceforge.net/p/fink/package-submissions/5004/ >>> >>> which are both patched for the format string strictness in High Sierra. I >>> found that using --disable-nls in configuring coreutils was insufficient to >>> suppress the test suite hang which I assume is due to the presence of... >>> >>> #define HAVE_LIBINTL_H 1 >>> >>> in the generated ./lib/config.h >>> >>> despite the presence of... >>> >>> /* #undef HAVE_DCGETTEXT */ >>> /* #undef HAVE_GETTEXT */ >>> >>> when --disable-nls is used so it still could be a Unicode related change in >>> APFS, no? >>> Jack >> >> The libintl bit reminded me of https://lists.gnu.org/archive/html/bug-gnulib/2014-10/msg00014.html >> I.E. on OSX enabling those libs creates implicit threads I think. >> Perhaps that's messing with SIGPIPE handling and only the implicit >> thread gets it, thus not killing the main yes(1) thread. >> However the yes(1) is also protected with a timeout(1) call. >> Perhaps timeout(1) is a silent noop. We should support OSX through DYLD_INSERT_LIBRARIES, >> but perhaps there is something preventing that on your system? >> But then would the timeout tests fail. Could you check the timeout tests with: >> >> make SUBDIRS=. TESTS=tests/misc/filter.sh check >> >> In any case we should protect calls to timeout(1) to ensure it's supported. >> The attached does that at least. > > Good idea. > Do you think there should be a syntax-check rule to ensure that any > timeout-using test first calls require_timeout_? This makes me wonder > if we should make timeout a function that does that job (the first > time only), and then exec's the real timeout command. Yes that would be better. Also functions for sleep, printf etc. would be useful in avoiding the need for explicit env and giving greater test coverage. I'll work on that From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 22 23:07:15 2017 Received: (at 28506) by debbugs.gnu.org; 23 Sep 2017 03:07:15 +0000 Received: from localhost ([127.0.0.1]:53377 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvamh-0008GP-BN for submit@debbugs.gnu.org; Fri, 22 Sep 2017 23:07:15 -0400 Received: from mail.magicbluesmoke.com ([82.195.144.49]:46338) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvamf-0008GI-HE for 28506@debbugs.gnu.org; Fri, 22 Sep 2017 23:07:13 -0400 Received: from localhost.localdomain (c-73-158-116-184.hsd1.ca.comcast.net [73.158.116.184]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.magicbluesmoke.com (Postfix) with ESMTPSA id 791019C6C; Sat, 23 Sep 2017 04:07:12 +0100 (IST) Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jack Howarth References: From: =?UTF-8?Q?P=c3=a1draig_Brady?= Message-ID: Date: Fri, 22 Sep 2017 20:07:10 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On 21/09/17 17:23, Jack Howarth wrote: > On Thu, Sep 21, 2017 at 1:20 AM, Pádraig Brady wrote: > >> On 18/09/17 18:07, Jack Howarth wrote: >>> On Mon, Sep 18, 2017 at 7:40 PM, Jim Meyering wrote: >>> >>>> On Mon, Sep 18, 2017 at 4:26 PM, Jack Howarth >>>> wrote: >>>>> On Mon, Sep 18, 2017 at 5:08 PM, Jim Meyering >> wrote: >>>> ... >>>>>> Is there any chance your failing test was via a python2 framework? I'm >>>>>> asking (on Pádraig's behalf) because there is a known problem whereby >>>>>> SIGPIPE is mishandled in that case, and that might explain this >>>>>> failure, since the data-generation phase relies on SIGPIPE killing >>>>>> this test's "yes" command. >>>>> >>>>> I doubt it as the hang doesn't happen under 10.13 when run on a JHFS >>>>> formatted volume. >>>> >>>> How did you run the tests? >>>> >>> >>> Actually, I forgot to mention that the coreutils test suite hang only >>> occurred on the APFS volumes when the coreutils built against the gettext >>> and libiconv from fink. A build outside of fink which didn't build >> against >>> those packages didn't show the hang in the coreutils test suite. The fink >>> gettext and libiconv packages that I am using are those from... >>> >>> https://sourceforge.net/p/fink/package-submissions/4955/ >>> >>> and >>> >>> https://sourceforge.net/p/fink/package-submissions/5004/ >>> >>> which are both patched for the format string strictness in High Sierra. I >>> found that using --disable-nls in configuring coreutils was insufficient >> to >>> suppress the test suite hang which I assume is due to the presence of... >>> >>> #define HAVE_LIBINTL_H 1 >>> >>> in the generated ./lib/config.h >>> >>> despite the presence of... >>> >>> /* #undef HAVE_DCGETTEXT */ >>> /* #undef HAVE_GETTEXT */ >>> >>> when --disable-nls is used so it still could be a Unicode related change >> in >>> APFS, no? >>> Jack >> >> The libintl bit reminded me of https://lists.gnu.org/archive/ >> html/bug-gnulib/2014-10/msg00014.html >> I.E. on OSX enabling those libs creates implicit threads I think. >> Perhaps that's messing with SIGPIPE handling and only the implicit >> thread gets it, thus not killing the main yes(1) thread. >> However the yes(1) is also protected with a timeout(1) call. >> Perhaps timeout(1) is a silent noop. We should support OSX through >> DYLD_INSERT_LIBRARIES, >> but perhaps there is something preventing that on your system? >> But then would the timeout tests fail. Could you check the timeout tests >> with: >> >> make SUBDIRS=. TESTS=tests/misc/filter.sh check >> >> In any case we should protect calls to timeout(1) to ensure it's supported. >> The attached does that at least. >> >> cheers, >> Pádraig. >> > > Pádraig, > The hang on APFS volumes doesn't seem to be related to CoreFoundation > threading. If I repeat the steps that I used to track down a similar issue > in make 4.0/4.1 by rebuilding libiconv with --disable-nls and coreutils > with the same --disable-nls so that neither are linked against > CoreFoundation, the test suite hang still occurs. Also, for the stock > build, adding your proposed timeout changes doesn't eliminate the hang in > the test suite either. Is is a wait or a cpu spin? Could you use the equivalent of strace on your platform to see what's happening? thanks, Pádraig From debbugs-submit-bounces@debbugs.gnu.org Sat Sep 23 22:47:43 2017 Received: (at 28506) by debbugs.gnu.org; 24 Sep 2017 02:47:43 +0000 Received: from localhost ([127.0.0.1]:55041 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvwxE-0007V2-5j for submit@debbugs.gnu.org; Sat, 23 Sep 2017 22:47:43 -0400 Received: from mail.magicbluesmoke.com ([82.195.144.49]:41368) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dvwxC-0007Us-7K for 28506@debbugs.gnu.org; Sat, 23 Sep 2017 22:47:35 -0400 Received: from localhost.localdomain (c-73-158-116-184.hsd1.ca.comcast.net [73.158.116.184]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.magicbluesmoke.com (Postfix) with ESMTPSA id 3619699A0; Sun, 24 Sep 2017 03:47:32 +0100 (IST) Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jack Howarth References: From: =?UTF-8?Q?P=c3=a1draig_Brady?= Message-ID: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> Date: Sat, 23 Sep 2017 19:47:28 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/mixed; boundary="------------2C74A6AFA5139C105AA4E2B0" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) This is a multi-part message in MIME format. --------------2C74A6AFA5139C105AA4E2B0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit On 22/09/17 20:07, Pádraig Brady wrote: > Is is a wait or a cpu spin? > Could you use the equivalent of strace on your platform to see what's happening? Offlist Jack sent a profile showing /usr/bin/FILE was waiting on input. That was the result of a silly typo in the script, which the attached should fix. I don't know what that command does, nor why it's specifically a problem on APFS, but hopefully this fixes things. cheers, Pádraig. --------------2C74A6AFA5139C105AA4E2B0 Content-Type: text/x-patch; name="filter-test-hang-macos.patch" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="filter-test-hang-macos.patch" =46rom 66840271037f55738f688fa2c650fe383fbed592 Mon Sep 17 00:00:00 2001 From: =3D?UTF-8?q?P=3DC3=3DA1draig=3D20Brady?=3D Date: Sat, 23 Sep 2017 19:37:13 -0700 Subject: [PATCH] tests: fix test hang on macOS 10.13 * tests/split/filter.sh: Due to an invalid 'FILE =3D zero.in' construct trying to initialize a FILE variable, it would instead try to run the FILE command which is present on macOS 10.13, and was seen to hang with APFS file systems at least. We also remove a redundant duplicate test clause introduced during a rebase, and simplify the piped timeout command, to avoid requiring a subshell and associated quoting. * THANKS.in: Add the reporter Jack Howarth. Fixes https://bugs.gnu.org/28506 --- THANKS.in | 1 + tests/split/filter.sh | 18 +++++++----------- 2 files changed, 8 insertions(+), 11 deletions(-) diff --git a/THANKS.in b/THANKS.in index 70c0021..b5e11f0 100644 --- a/THANKS.in +++ b/THANKS.in @@ -264,6 +264,7 @@ Ilya N. Golubev gin@mo.msk.ru Ingo Saitz ingo@debian.org Ivan Labath labath3@st.fmph.uniba.sk Ivo Timmermans ivo@debian.org +Jack Howarth howarth.mailing.lists@gmail.com Jacky Fong jacky.fong@utoronto.ca James Antill jmanti%essex.ac.uk@seralph21.essex.a= c.uk James Hunt jamesodhunt@hotmail.com diff --git a/tests/split/filter.sh b/tests/split/filter.sh index 96602bd..25b90e5 100755 --- a/tests/split/filter.sh +++ b/tests/split/filter.sh @@ -19,7 +19,7 @@ . "${srcdir=3D.}/tests/init.sh"; path_prepend_ ./src print_ver_ split require_sparse_support_ # for 'truncate --size=3D$LARGE' -xz --version || skip_ "xz (better than gzip/bzip2) required" +xz --version || skip_ 'xz required' =20 for total_n_lines in 5 3000 20000; do seq $total_n_lines > in || framework_failure_ @@ -53,15 +53,17 @@ yes | head -n200K | split -b1G --filter=3D'head -c1 >= /dev/null' || fail=3D1 =20 # Ensure that "endless" input is ignored when all filters finish for mode in '' 'r/'; do - FILE =3D '-' + in_file=3D'-' + in_cmd=3D'yes' if test "$mode" =3D ''; then - FILE =3D 'zero.in' + in_file=3D'zero.in' + in_cmd=3D'true' truncate -s10T "$FILE" || continue fi for N in 1 2; do rm -f x??.n || framework_failure_ - timeout 10 sh -c \ - "yes | split --filter=3D'head -c1 >\$FILE.n' -n $mode$N $FILE" || = fail=3D1 + $in_cmd | + timeout 10 split --filter=3D'head -c1 >$FILE.n' -n $mode$N $in_file= || fail=3D1 # Also ensure we get appropriate output from each filter seq 1 $N | tr '0-9' 1 > stat.exp stat -c%s x??.n > stat.out || framework_failure_ @@ -75,10 +77,4 @@ for buf in 1000 1000000; do "yes | split --filter=3D'head -c1 >/dev/null' -b $buf" || fail=3D1 done =20 -# Ensure that "endless" input _is_ processed for unbounded number of fil= ters -for buf in 1000 1000000; do - returns_ 124 timeout .5 sh -c \ - "yes | split --filter=3D'head -c1 >/dev/null' -b $buf" || fail=3D1 -done - Exit $fail --=20 2.9.3 --------------2C74A6AFA5139C105AA4E2B0-- From debbugs-submit-bounces@debbugs.gnu.org Sun Sep 24 02:14:20 2017 Received: (at 28506) by debbugs.gnu.org; 24 Sep 2017 06:14:20 +0000 Received: from localhost ([127.0.0.1]:55103 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dw0BH-00048Z-St for submit@debbugs.gnu.org; Sun, 24 Sep 2017 02:14:20 -0400 Received: from mail-out.m-online.net ([212.18.0.10]:54386) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dw0BF-00048P-Ob for 28506@debbugs.gnu.org; Sun, 24 Sep 2017 02:14:18 -0400 Received: from frontend01.mail.m-online.net (unknown [192.168.8.182]) by mail-out.m-online.net (Postfix) with ESMTP id 3y0H3r4G6Pz1qrf4; Sun, 24 Sep 2017 08:14:16 +0200 (CEST) Received: from localhost (dynscan1.mnet-online.de [192.168.6.70]) by mail.m-online.net (Postfix) with ESMTP id 3y0H3r2fPHz1qqkG; Sun, 24 Sep 2017 08:14:16 +0200 (CEST) X-Virus-Scanned: amavisd-new at mnet-online.de Received: from mail.mnet-online.de ([192.168.8.182]) by localhost (dynscan1.mail.m-online.net [192.168.6.70]) (amavisd-new, port 10024) with ESMTP id AKy2bli4sRgQ; Sun, 24 Sep 2017 08:14:15 +0200 (CEST) X-Auth-Info: oHNoq2sXZ2yX2rQ7+2M0audp19kBoe/riteCfeUmpNYE/J/IyX/nCYxjjo11wFpN Received: from igel.home (ppp-88-217-10-94.dynamic.mnet-online.de [88.217.10.94]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.mnet-online.de (Postfix) with ESMTPSA; Sun, 24 Sep 2017 08:14:15 +0200 (CEST) Received: by igel.home (Postfix, from userid 1000) id 081C82C3960; Sun, 24 Sep 2017 08:14:12 +0200 (CEST) From: Andreas Schwab To: =?utf-8?Q?P=C3=A1draig?= Brady Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem References: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> X-Yow: Are we live or on tape? Date: Sun, 24 Sep 2017 08:14:11 +0200 In-Reply-To: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> (=?utf-8?Q?=22P=C3=A1draig?= Brady"'s message of "Sat, 23 Sep 2017 19:47:28 -0700") Message-ID: <87vak8mxn0.fsf@linux-m68k.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org, Jack Howarth X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) On Sep 23 2017, Pádraig Brady wrote: > Offlist Jack sent a profile showing /usr/bin/FILE was waiting on input. > That was the result of a silly typo in the script, which the attached > should fix. I don't know what that command does, That's file(1) trying to analyze '-'. > nor why it's specifically a problem on APFS, Presumably APFS is case insensitive. Andreas. -- Andreas Schwab, schwab@linux-m68k.org GPG Key fingerprint = 58CA 54C7 6D53 942B 1756 01D3 44D5 214B 8276 4ED5 "And now for something completely different." From debbugs-submit-bounces@debbugs.gnu.org Sun Sep 24 13:16:21 2017 Received: (at 28506) by debbugs.gnu.org; 24 Sep 2017 17:16:21 +0000 Received: from localhost ([127.0.0.1]:56341 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwAVx-0006fe-GM for submit@debbugs.gnu.org; Sun, 24 Sep 2017 13:16:21 -0400 Received: from mail-qk0-f170.google.com ([209.85.220.170]:57214) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwAVv-0006fQ-Dw for 28506@debbugs.gnu.org; Sun, 24 Sep 2017 13:16:20 -0400 Received: by mail-qk0-f170.google.com with SMTP id g128so4791602qke.13 for <28506@debbugs.gnu.org>; Sun, 24 Sep 2017 10:16:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=Aj2tmN4xG17quQZ84gQztQjz2WBd1e++BzGUPp6n0AE=; b=mR2JrbIgIYsCpPEiiiKoBvkhXILstECzoWMX14y2AOCEcJl7iwD8MgjQDCcdDOnsgz 3INnNwmBlr5gZKkJf9Y9K19hhrKP7Mf4X1q0gajMT8CA4gFBIwvi5Z0OLhxYxXUj/igh D1qoIp0EQevJV9zbBpMc4w5mjtuCy0tJsJZ3TrPXxPf90F4OAr+r3D1ViQMzHpHi6gn+ VjTffBc8ElcGpvP/1ACZrvBBZIhh2OzqL9DRo6X/d0mNUUQoJiN77oRXw69Z+FLJ9k01 IMXf0UypUxr9JG31XYwPqbFJt7hJkOY82tf7x/QN+8CDr9BI+n6xlCQaw5+zamV1cxWl Jfbw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=Aj2tmN4xG17quQZ84gQztQjz2WBd1e++BzGUPp6n0AE=; b=t6mDfZ87d/DuF/1GZTzRiLoKBTw2HNTh9KIZwNU3zUlpxde9FC9VFb7X/LS0vEO76V u8sfVJvr7Of3Iwr0KWQI4E5k6DoSpLQ8+Fn23z+n4OT6bHesgW2d6fqPnsfygsdpoiTf fvBnvujdKKhwkC9nBOWEX1ET5I/PGUA8Ty643BycLvTbOrQczadJ0Az8T3fZxuHWZnRy Fne/5LKPSqIqiYJZAHDOzV+oc7Im7OKOV88qCf7MqPLWN1fgz+qHSwdNf/SpFWGOQ/RU EsugNIWEBaFItdYweFJxwc5cS42EE9PGNro8Wo1Fk0Q7B7Iw1rpkTKgRyIRh//JXXzmc Lz8Q== X-Gm-Message-State: AHPjjUjQYVsDnXMqe4Vyni/4UvbdlzAnEoFRmhwveTsagdxC2gGc3vGP ylqhhBMbfrMdhhQSBoOmSakfTO5YM0gIpSwatmZcrw== X-Google-Smtp-Source: AOwi7QD1i+Ker3NpLgb4UUYK4r2Wbo/CbeBldhVBZzYZLzjyv1PVIY3mXBiuXEtJRTRor5Aiq4BwTaSQ8PjBHvV1ly4= X-Received: by 10.55.16.207 with SMTP id 76mr6772817qkq.120.1506273374089; Sun, 24 Sep 2017 10:16:14 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.209.16 with HTTP; Sun, 24 Sep 2017 10:16:13 -0700 (PDT) In-Reply-To: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> References: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> From: Jack Howarth Date: Sun, 24 Sep 2017 13:16:13 -0400 Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: =?UTF-8?Q?P=C3=A1draig_Brady?= Content-Type: multipart/alternative; boundary="001a113fe9e865b5520559f299d2" X-Spam-Score: 0.5 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.5 (/) --001a113fe9e865b5520559f299d2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, Sep 23, 2017 at 10:47 PM, P=C3=A1draig Brady wro= te: > On 22/09/17 20:07, P=C3=A1draig Brady wrote: > > Is is a wait or a cpu spin? > > Could you use the equivalent of strace on your platform to see what's > happening? > > Offlist Jack sent a profile showing /usr/bin/FILE was waiting on input. > That was the result of a silly typo in the script, which the attached > should fix. I don't know what that command does, nor why it's specifical= ly > a problem on APFS, but hopefully this fixes things. > > cheers, > P=C3=A1draig. > > P=C3=A1draig. Thanks. I can confirm that eliminates testsuite hang seen on 10.13 with APFS volumes. FYI, the stock APFS is still case-insensitive on darwin17. Jack ps The only failure seen in the test suite is... FAIL: tests/touch/trailing-slash.sh --001a113fe9e865b5520559f299d2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sat, Sep 23, 2017 at 10:47 PM, P=C3=A1draig Brady = <P@draigbrady.com<= /a>> wrote:
On 22/09/1= 7 20:07, P=C3=A1draig Brady wrote:
> Is is a wait or a cpu spin?
> Could you use the equivalent of strace on your platform to see what= 9;s happening?

Offlist Jack sent a profile showing /usr/bin/FILE was waiting on inp= ut.
That was the result of a silly typo in the script, which the attached
should fix.=C2=A0 I don't know what that command does, nor why it's= specifically
a problem on APFS, but hopefully this fixes things.

cheers,
P=C3=A1draig.

=C2=A0
P=C3=A1draig.
=C2=A0 =C2=A0 Thanks. I can confirm that eliminates testsu= ite hang seen on 10.13 with APFS volumes. FYI, the stock APFS is still case= -insensitive on darwin17.
=C2=A0 =C2=A0 =C2= =A0 =C2=A0 Jack
ps The only failure seen in= the test suite is...

FAIL: tests= /touch/trailing-slash.sh


--001a113fe9e865b5520559f299d2-- From debbugs-submit-bounces@debbugs.gnu.org Sun Sep 24 13:34:12 2017 Received: (at 28506) by debbugs.gnu.org; 24 Sep 2017 17:34:12 +0000 Received: from localhost ([127.0.0.1]:56382 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwAnE-00078g-5r for submit@debbugs.gnu.org; Sun, 24 Sep 2017 13:34:12 -0400 Received: from mail-qk0-f179.google.com ([209.85.220.179]:52643) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwAnB-00078T-Oh for 28506@debbugs.gnu.org; Sun, 24 Sep 2017 13:34:10 -0400 Received: by mail-qk0-f179.google.com with SMTP id o77so4814597qke.9 for <28506@debbugs.gnu.org>; Sun, 24 Sep 2017 10:34:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=NXU45aWDJcyQrzmM41wJYL1J5ver1tWcowB/Sp6I0u0=; b=R65hg9D6G1eg2NWSsF9QMLPdtr+ghk0BfF0/qK5SL7KdKqgxsAysEhjwD27igAOamU koJ+weHy7uh6mP16Zl/XEXVSDLoMa1fNICfrwphDdpXxZmoEmxsd8Pu75jcajQBOoy0q ZHwEOB6NTQVh5wqKvwb8BJ3GHkhP0zMU757PN+oZeGstE8RvCncSJn+7fjBeVD1KHXbT pjjmWLjVmTLYA3yJKvzemo9SvSogw1EMyGpS6LvAXm2CJKM4MVK1tQYyNasDRdrH+o9s bELCkCja3WxE4PFsVLZK6ojSag0L1FNMrWNL5d2Y3vOwXRiYv5kCp5N9NaisDlx1PQZ0 7axg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=NXU45aWDJcyQrzmM41wJYL1J5ver1tWcowB/Sp6I0u0=; b=fuYhA2m1agfDByuBlceZO8swCLEoHuZerPD+HwnGIFlOKIwM3th5DjnvVK7SIDLTs5 j+B2E4hHDr2qfL05byjIjo7pADijyO4uQLAr7Ay6pKBePtXXnSa2NQeKT1OY4JEl9OND BcAz0PeApyiKQcbV9WpGrbi++lJm99PyJzlvfmvypHJz6+IcMN+sXaqYtN/VJ6w/hR3b HqXYsTnqIvB6zfcZl/S8IvafSnrYvd9E/K9WDyTP+CsaOS+gWdyhDu0oNIWsIJF5Nd/Y y8Tk2tyoT7eiv99aSY7VII21ijo3+knJ5grbRTsWEXPpxPpjfgfAAFEXpfTlTL873D6B 1gDA== X-Gm-Message-State: AHPjjUjJNN/upiJoPbiCwDmv5XCr5HoZtODPEXgj5/QsPYL/MSUwb5yX pC/smeWMlDDImmlnp+KmD2DRmiTxob/3IWeFfAo= X-Google-Smtp-Source: AOwi7QAYyqUlVKrgKApcCN7hhtH0K81oyVoHICJXceBEEOe5pUCgBFjsyBkF7fVO6GdFTtkpQX9YCrviHeWmu/AbrtA= X-Received: by 10.55.190.5 with SMTP id o5mr7546025qkf.241.1506274444374; Sun, 24 Sep 2017 10:34:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.209.16 with HTTP; Sun, 24 Sep 2017 10:34:02 -0700 (PDT) In-Reply-To: References: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> From: Jack Howarth Date: Sun, 24 Sep 2017 13:34:02 -0400 Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: =?UTF-8?Q?P=C3=A1draig_Brady?= Content-Type: multipart/mixed; boundary="94eb2c043046313fd60559f2d97e" X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 28506 Cc: 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) --94eb2c043046313fd60559f2d97e Content-Type: multipart/alternative; boundary="94eb2c043046313fd30559f2d97c" --94eb2c043046313fd30559f2d97c Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Sep 24, 2017 at 1:16 PM, Jack Howarth < howarth.mailing.lists@gmail.com> wrote: > > > On Sat, Sep 23, 2017 at 10:47 PM, P=C3=A1draig Brady w= rote: > >> On 22/09/17 20:07, P=C3=A1draig Brady wrote: >> > Is is a wait or a cpu spin? >> > Could you use the equivalent of strace on your platform to see what's >> happening? >> >> Offlist Jack sent a profile showing /usr/bin/FILE was waiting on input. >> That was the result of a silly typo in the script, which the attached >> should fix. I don't know what that command does, nor why it's >> specifically >> a problem on APFS, but hopefully this fixes things. >> >> cheers, >> P=C3=A1draig. >> >> > P=C3=A1draig. > Thanks. I can confirm that eliminates testsuite hang seen on 10.13 > with APFS volumes. FYI, the stock APFS is still case-insensitive on > darwin17. > Jack > ps The only failure seen in the test suite is... > > FAIL: tests/touch/trailing-slash.sh > > > P=C3=A1draig, Attached are the tests/touch/trailing-slash.log and tests/touch/trailing-slash.trs files generated from a build on an APFS volume running 10.13 in case you can identify why that test is failing. Jack --94eb2c043046313fd30559f2d97c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sun, Sep 24, 2017 at 1:16 PM, Jack Howarth <howarth.m= ailing.lists@gmail.com> wrote:


On Sat, Sep 23, 2017 at 10:47 PM, P=C3=A1draig Bra= dy <P@draigbrady.com> wrote:
On 22/09/17 20:07, P=C3=A1draig Brad= y wrote:
> Is is a wait or a cpu spin?
> Could you use the equivalent of strace on your platform to see what= 9;s happening?

Offlist Jack sent a profile showing /usr/bin/FILE was waiting on inp= ut.
That was the result of a silly typo in the script, which the attached
should fix.=C2=A0 I don't know what that command does, nor why it's= specifically
a problem on APFS, but hopefully this fixes things.

cheers,
P=C3=A1draig.

=C2=A0
P=C3=A1draig.
=
=C2=A0 =C2=A0 Thanks. I can confirm that elimina= tes testsuite hang seen on 10.13 with APFS volumes. FYI, the stock APFS is = still case-insensitive on darwin17.
=C2=A0 =C2=A0 =C2=A0 =C2=A0 J= ack
ps The only failure seen = in the test suite is...

FAIL: tes= ts/touch/trailing-slash.sh



P=C3=A1draig,
=C2=A0 =C2=A0 Attached are th= e tests/touch/trailing-slash.log and tests/touch/trailing-slash.trs files g= enerated from a build on an APFS volume running 10.13 in case you can ident= ify why that test is failing.
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Jack --94eb2c043046313fd30559f2d97c-- --94eb2c043046313fd60559f2d97e Content-Type: application/octet-stream; name="trailing-slash.log" Content-Disposition: attachment; filename="trailing-slash.log" Content-Transfer-Encoding: base64 X-Attachment-Id: f_j7z0uhjt0 KysgaW5pdGlhbF9jd2RfPS9zdy9zcmMvZmluay5idWlsZC9jb3JldXRpbHMtOC4yOC0xL2NvcmV1 dGlscy04LjI4CisrKyB0ZXN0ZGlyX3ByZWZpeF8KKysrIHByaW50ZiBndAorKyBwZnhfPWd0Cisr KyBta3RlbXBkXyAvc3cvc3JjL2ZpbmsuYnVpbGQvY29yZXV0aWxzLTguMjgtMS9jb3JldXRpbHMt OC4yOCBndC10cmFpbGluZy1zbGFzaC5zaC5YWFhYCisrKyBjYXNlICQjIGluCisrKyBkZXN0ZGly Xz0vc3cvc3JjL2ZpbmsuYnVpbGQvY29yZXV0aWxzLTguMjgtMS9jb3JldXRpbHMtOC4yOAorKysg dGVtcGxhdGVfPWd0LXRyYWlsaW5nLXNsYXNoLnNoLlhYWFgKKysrIE1BWF9UUklFU189NAorKysg Y2FzZSAkZGVzdGRpcl8gaW4KKysrIGRlc3RkaXJfc2xhc2hfPS9zdy9zcmMvZmluay5idWlsZC9j b3JldXRpbHMtOC4yOC0xL2NvcmV1dGlscy04LjI4LworKysgY2FzZSAkdGVtcGxhdGVfIGluCisr KysgdW5zZXQgVE1QRElSCisrKyBkPS9zdy9zcmMvZmluay5idWlsZC9jb3JldXRpbHMtOC4yOC0x L2NvcmV1dGlscy04LjI4L2d0LXRyYWlsaW5nLXNsYXNoLnNoLnJ0REsKKysrIGNhc2UgJGQgaW4K KysrIDoKKysrIHRlc3QgLWQgL3N3L3NyYy9maW5rLmJ1aWxkL2NvcmV1dGlscy04LjI4LTEvY29y ZXV0aWxzLTguMjgvZ3QtdHJhaWxpbmctc2xhc2guc2gucnRESworKysrIGxzIC1kZ28gL3N3L3Ny Yy9maW5rLmJ1aWxkL2NvcmV1dGlscy04LjI4LTEvY29yZXV0aWxzLTguMjgvZ3QtdHJhaWxpbmct c2xhc2guc2gucnRESworKysgcGVybXM9J2Ryd3gtLS0tLS0gMiA2NCBTZXAgMjQgMTM6MjggL3N3 L3NyYy9maW5rLmJ1aWxkL2NvcmV1dGlscy04LjI4LTEvY29yZXV0aWxzLTguMjgvZ3QtdHJhaWxp bmctc2xhc2guc2gucnRESycKKysrIGNhc2UgJHBlcm1zIGluCisrKyA6CisrKyBlY2hvIC9zdy9z cmMvZmluay5idWlsZC9jb3JldXRpbHMtOC4yOC0xL2NvcmV1dGlscy04LjI4L2d0LXRyYWlsaW5n LXNsYXNoLnNoLnJ0REsKKysrIHJldHVybgorKyB0ZXN0X2Rpcl89L3N3L3NyYy9maW5rLmJ1aWxk L2NvcmV1dGlscy04LjI4LTEvY29yZXV0aWxzLTguMjgvZ3QtdHJhaWxpbmctc2xhc2guc2gucnRE SworKyBjZCAvc3cvc3JjL2ZpbmsuYnVpbGQvY29yZXV0aWxzLTguMjgtMS9jb3JldXRpbHMtOC4y OC9ndC10cmFpbGluZy1zbGFzaC5zaC5ydERLCisrIGdsX2luaXRfc2hfbmxfPScKJworKyBJRlM9 JyAJCicKKysgZm9yIHNpZ18gaW4gMSAyIDMgMTMgMTUKKysrIGV4cHIgMSArIDEyOAorKyBldmFs ICd0cmFwICdcJydFeGl0IDEyOSdcJycgMScKKysrIHRyYXAgJ0V4aXQgMTI5JyAxCisrIGZvciBz aWdfIGluIDEgMiAzIDEzIDE1CisrKyBleHByIDIgKyAxMjgKKysgZXZhbCAndHJhcCAnXCcnRXhp dCAxMzAnXCcnIDInCisrKyB0cmFwICdFeGl0IDEzMCcgMgorKyBmb3Igc2lnXyBpbiAxIDIgMyAx MyAxNQorKysgZXhwciAzICsgMTI4CisrIGV2YWwgJ3RyYXAgJ1wnJ0V4aXQgMTMxJ1wnJyAzJwor KysgdHJhcCAnRXhpdCAxMzEnIDMKKysgZm9yIHNpZ18gaW4gMSAyIDMgMTMgMTUKKysrIGV4cHIg MTMgKyAxMjgKKysgZXZhbCAndHJhcCAnXCcnRXhpdCAxNDEnXCcnIDEzJworKysgdHJhcCAnRXhp dCAxNDEnIDEzCisrIGZvciBzaWdfIGluIDEgMiAzIDEzIDE1CisrKyBleHByIDE1ICsgMTI4Cisr IGV2YWwgJ3RyYXAgJ1wnJ0V4aXQgMTQzJ1wnJyAxNScKKysrIHRyYXAgJ0V4aXQgMTQzJyAxNQor KyB0cmFwIHJlbW92ZV90bXBfIDAKKyBwYXRoX3ByZXBlbmRfIC4vc3JjCisgdGVzdCAxICchPScg MAorIHBhdGhfZGlyXz0uL3NyYworIGNhc2UgJHBhdGhfZGlyXyBpbgorIGFic19wYXRoX2Rpcl89 L3N3L3NyYy9maW5rLmJ1aWxkL2NvcmV1dGlscy04LjI4LTEvY29yZXV0aWxzLTguMjgvLi9zcmMK KyBjYXNlICRhYnNfcGF0aF9kaXJfIGluCisgUEFUSD0vc3cvc3JjL2ZpbmsuYnVpbGQvY29yZXV0 aWxzLTguMjgtMS9jb3JldXRpbHMtOC4yOC8uL3NyYzovc3cvc3JjL2ZpbmsuYnVpbGQvY29yZXV0 aWxzLTguMjgtMS9jb3JldXRpbHMtOC4yOC9zcmM6L3N3L3Zhci9saWIvZmluay9wYXRoLXByZWZp eC1saWJjeHg6L3N3L3Zhci9saWIvZmluay9wYXRoLXByZWZpeC1jbGFuZzovc3cvbGliL3Blcmw1 L0V4dFV0aWxzOi9zdy9iaW46L3N3L3NiaW46L2JpbjovdXNyL2Jpbjovc2JpbjovdXNyL3NiaW46 L29wdC9YMTEvYmluCisgY3JlYXRlX2V4ZV9zaGltc18gL3N3L3NyYy9maW5rLmJ1aWxkL2NvcmV1 dGlscy04LjI4LTEvY29yZXV0aWxzLTguMjgvLi9zcmMKKyBjYXNlICRFWEVFWFQgaW4KKyByZXR1 cm4gMAorIHNoaWZ0CisgdGVzdCAwICchPScgMAorIGV4cG9ydCBQQVRICisgcHJpbnRfdmVyXyB0 b3VjaAorIHJlcXVpcmVfYnVpbHRfIHRvdWNoCisgc2tpcF89bm8KKyBmb3IgaSBpbiAnIiRAIicK KyBjYXNlICIgJGJ1aWx0X3Byb2dyYW1zICIgaW4KKyB0ZXN0IG5vID0geWVzCisgdGVzdCB5ZXMg PSB5ZXMKKyBsb2NhbCBpCisgZm9yIGkgaW4gJyQqJworIGVudiB0b3VjaCAtLXZlcnNpb24KdG91 Y2ggKEdOVSBjb3JldXRpbHMpIDguMjgKQ29weXJpZ2h0IChDKSAyMDE3IEZyZWUgU29mdHdhcmUg Rm91bmRhdGlvbiwgSW5jLgpMaWNlbnNlIEdQTHYzKzogR05VIEdQTCB2ZXJzaW9uIDMgb3IgbGF0 ZXIgPGh0dHA6Ly9nbnUub3JnL2xpY2Vuc2VzL2dwbC5odG1sPi4KVGhpcyBpcyBmcmVlIHNvZnR3 YXJlOiB5b3UgYXJlIGZyZWUgdG8gY2hhbmdlIGFuZCByZWRpc3RyaWJ1dGUgaXQuClRoZXJlIGlz IE5PIFdBUlJBTlRZLCB0byB0aGUgZXh0ZW50IHBlcm1pdHRlZCBieSBsYXcuCgpXcml0dGVuIGJ5 IFBhdWwgUnViaW4sIEFybm9sZCBSb2JiaW5zLCBKaW0gS2luZ2RvbiwKRGF2aWQgTWFjS2Vuemll LCBhbmQgUmFuZHkgU21pdGguCisgbG4gLXMgbm93aGVyZSBkYW5nbGluZworIGxuIC1zIGxvb3Ag bG9vcAorIHRvdWNoIGZpbGUKKyBsbiAtcyBmaWxlIGxpbmsxCisgbWtkaXIgZGlyCisgbG4gLXMg ZGlyIGxpbmsyCisgcmV0dXJuc18gMSB0b3VjaCBuby1maWxlLwp0b3VjaDogc2V0dGluZyB0aW1l cyBvZiAnbm8tZmlsZS8nOiBObyBzdWNoIGZpbGUgb3IgZGlyZWN0b3J5CisgcmV0dXJuc18gMSB0 b3VjaCBmaWxlLwp0b3VjaDogc2V0dGluZyB0aW1lcyBvZiAnZmlsZS8nOiBOb3QgYSBkaXJlY3Rv cnkKKyByZXR1cm5zXyAxIHRvdWNoIGRhbmdsaW5nLwp0b3VjaDogc2V0dGluZyB0aW1lcyBvZiAn ZGFuZ2xpbmcvJzogTm8gc3VjaCBmaWxlIG9yIGRpcmVjdG9yeQorIHJldHVybnNfIDEgdG91Y2gg bG9vcC8KdG91Y2g6IHNldHRpbmcgdGltZXMgb2YgJ2xvb3AvJzogVG9vIG1hbnkgbGV2ZWxzIG9m IHN5bWJvbGljIGxpbmtzCisgcmV0dXJuc18gMSB0b3VjaCBsaW5rMS8KKyBmYWlsPTEKKyB0b3Vj aCBkaXIvCisgdG91Y2ggLWMgbm8tZmlsZS8KKyByZXR1cm5zXyAxIHRvdWNoIC1jIGZpbGUvCnRv dWNoOiBzZXR0aW5nIHRpbWVzIG9mICdmaWxlLyc6IE5vdCBhIGRpcmVjdG9yeQorIHRvdWNoIC1j IGRhbmdsaW5nLworIHJldHVybnNfIDEgdG91Y2ggLWMgbG9vcC8KdG91Y2g6IHNldHRpbmcgdGlt ZXMgb2YgJ2xvb3AvJzogVG9vIG1hbnkgbGV2ZWxzIG9mIHN5bWJvbGljIGxpbmtzCisgcmV0dXJu c18gMSB0b3VjaCAtYyBsaW5rMS8KKyBmYWlsPTEKKyB0b3VjaCAtYyBkaXIvCisgcmV0dXJuc18g MSB0ZXN0IC1mIG5vLWZpbGUKKyByZXR1cm5zXyAxIHRlc3QgLWYgbm93aGVyZQorIHRvdWNoIC1k IDIwMDktMTAtMTAgLWggbGluazIvCisgdG91Y2ggLWggLXIgbGluazIvIGZpbGUKKyBjYXNlICQo c3RhdCAtLWZvcm1hdD0leSBkaXIpIGluCisrIHN0YXQgLS1mb3JtYXQ9JXkgZGlyCisgY2FzZSAk KHN0YXQgLS1mb3JtYXQ9JXkgbGluazIpIGluCisrIHN0YXQgLS1mb3JtYXQ9JXkgbGluazIKKyBj YXNlICQoc3RhdCAtLWZvcm1hdD0leSBmaWxlKSBpbgorKyBzdGF0IC0tZm9ybWF0PSV5IGZpbGUK KyBFeGl0IDEKKyBzZXQgK2UKKyBleGl0IDEKKyBleGl0IDEKKyByZW1vdmVfdG1wXworIF9fc3Q9 MQorIGNsZWFudXBfCisgOgorIHRlc3QgJycgPSB5ZXMKKyBjZCAvc3cvc3JjL2ZpbmsuYnVpbGQv Y29yZXV0aWxzLTguMjgtMS9jb3JldXRpbHMtOC4yOAorIGNobW9kIC1SIHUrcnd4IC9zdy9zcmMv Zmluay5idWlsZC9jb3JldXRpbHMtOC4yOC0xL2NvcmV1dGlscy04LjI4L2d0LXRyYWlsaW5nLXNs YXNoLnNoLnJ0REsKKyBybSAtcmYgL3N3L3NyYy9maW5rLmJ1aWxkL2NvcmV1dGlscy04LjI4LTEv Y29yZXV0aWxzLTguMjgvZ3QtdHJhaWxpbmctc2xhc2guc2gucnRESworIGV4aXQgMQpGQUlMIHRl c3RzL3RvdWNoL3RyYWlsaW5nLXNsYXNoLnNoIChleGl0IHN0YXR1czogMSkK --94eb2c043046313fd60559f2d97e Content-Type: application/octet-stream; name="trailing-slash.trs" Content-Disposition: attachment; filename="trailing-slash.trs" Content-Transfer-Encoding: base64 X-Attachment-Id: f_j7z0w10z1 OnRlc3QtcmVzdWx0OiBGQUlMCjpnbG9iYWwtdGVzdC1yZXN1bHQ6IEZBSUwKOnJlY2hlY2s6IHll cwo6Y29weS1pbi1nbG9iYWwtbG9nOiB5ZXMK --94eb2c043046313fd60559f2d97e-- From debbugs-submit-bounces@debbugs.gnu.org Mon Sep 25 13:15:05 2017 Received: (at 28506) by debbugs.gnu.org; 25 Sep 2017 17:15:05 +0000 Received: from localhost ([127.0.0.1]:58814 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwWyH-0007VS-9h for submit@debbugs.gnu.org; Mon, 25 Sep 2017 13:15:05 -0400 Received: from mail-qk0-f170.google.com ([209.85.220.170]:56125) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dwWyG-0007Ua-9c for 28506@debbugs.gnu.org; Mon, 25 Sep 2017 13:15:04 -0400 Received: by mail-qk0-f170.google.com with SMTP id q8so7326399qkl.12 for <28506@debbugs.gnu.org>; Mon, 25 Sep 2017 10:15:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=3Qj+ekO/O7crV4rYDPr9odKzVwQm946BjpnMzQR5Mhc=; b=r6ykMbEOXBLlilBDXs9BfJQD7Os/D84n4ZnIa//uZopcimT5aTJpvnfnrY1xKHDlwK lv6hzhfwzh/Qz9aOoRQcrcKW45F0SOiS9EbChe/LLltRyTvYbkn5JKNBqz+AthXWYv6e XdH1p8eNP2wkAuQrCJZBnJyTCq5TkPioXdNUH4ajdb7bZtpL4Ibti8T4zhiTyQpxGPeA RGZ+LemBctAm4HFiz4jM2iewz7Whie8XREn9e37Lpcd+58QgPOFQUeyw1SqJO6xgL7ig 4DWe4TdI/ZZgm7ME35ZX8bfX3S4vtECHpM2A7kxCP3nJj52nNqfBTRlLDYS7ClPPDCP3 XRaw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=3Qj+ekO/O7crV4rYDPr9odKzVwQm946BjpnMzQR5Mhc=; b=cpP+2obLV2Gtu7+v5QqCBC+2mTQ24dsKII5uub7G5sQRl2JBDcOQpytOZCVZhFCaxm PDqrFlTFo9b3YphyqOkKJBNzYfBD/A9VjC4m511hNg34bxagYLc/Fg3MAXdibRyn3yXr s2k6VFjKljAWDX6pYGoI2dMLytqRRhdrCTJhY3Ap4YiY4jn+xXhxOReBBwBHEARsSUI0 vVoZ4wolS7Etq69ooXtllx3PMfCAyYFW6DeAJjUpBu9aatriJOTutrLmlFqYi9dwcudW fl5BCebFEgf6MlxuhIyEglCyO5hhob9+p55M2xXrgr/O8j7YDmcnM1WeDnIPncrBNzay eHtw== X-Gm-Message-State: AHPjjUglwz2Xy7KXap3Z+1D/MXgOPZG/7K5gMp1frIiGfpGJdr+w6/Yj kc7czBs9imntOQtfpAlbqJs/cntnlPqePYvQ+qA= X-Google-Smtp-Source: AOwi7QAIv8/NUuXSOM19+XJC69eCZDwjGTSZWYoyDDLS7vBu19DI5SaXzeAP4pX3bZviG0vrcK1Gq9KKKOl2+OegKAU= X-Received: by 10.55.68.77 with SMTP id r74mr10884971qka.125.1506359698736; Mon, 25 Sep 2017 10:14:58 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.168.143 with HTTP; Mon, 25 Sep 2017 10:14:37 -0700 (PDT) In-Reply-To: References: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> From: Jim Meyering Date: Mon, 25 Sep 2017 10:14:37 -0700 X-Google-Sender-Auth: gvv6eQWTF7T0LlrlLWmu13_6zoQ Message-ID: Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: Jack Howarth Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.7 (/) X-Debbugs-Envelope-To: 28506 Cc: =?UTF-8?Q?P=C3=A1draig_Brady?= , 28506@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) On Sun, Sep 24, 2017 at 10:34 AM, Jack Howarth wrote: > On Sun, Sep 24, 2017 at 1:16 PM, Jack Howarth < ... > Attached are the tests/touch/trailing-slash.log and > tests/touch/trailing-slash.trs files generated from a build on an APFS > volume running 10.13 in case you can identify why that test is failing. That test is failing because your system allows "touch symlink-to-file-specified-with-trailing-slash/" to succeed, e.g., here is how it's supposed to work, but on your system touch (mistakenly) succeeds: $ : > k && ln -s k j && touch j/ touch: setting times of 'j/': Not a directory When a non-directory name is specified with a trailing slash, many interfaces are required by POSIX to fail with ENOTDIR. It looks like one of those on your system goes ahead and performs the requested operation as if that slash were not present. We can probably teach gnulib to detect and work around this flaw. From debbugs-submit-bounces@debbugs.gnu.org Mon Oct 29 21:16:49 2018 Received: (at 28506) by debbugs.gnu.org; 30 Oct 2018 01:16:49 +0000 Received: from localhost ([127.0.0.1]:52392 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gHIeG-0001Hr-MG for submit@debbugs.gnu.org; Mon, 29 Oct 2018 21:16:48 -0400 Received: from mail-pf1-f194.google.com ([209.85.210.194]:41936) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gHIeD-0001Bq-EE; Mon, 29 Oct 2018 21:16:46 -0400 Received: by mail-pf1-f194.google.com with SMTP id e22-v6so1888352pfn.8; Mon, 29 Oct 2018 18:16:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=pqJ+g2ULFxr2BEbJGlDc8YvPkVqj0yk3GlTwWaQs/XA=; b=TmKYbXrClC15Sde3NU3VQhKDx6Uny6m72nRWBGvqkWowY5wNin+5iB28x90kppdow6 bn7V9ZTVD35n1YTaZa4k3lze3rkJJgmh8tt+USavU0Bcv3LOlE2INysw9UqhO/6erLFV 1lmQnVMAUH9k8c9plKhpQWGbgPKhiZ7BadRJK6DQ2r7+mnUudj2syaPnOVj8H4pKVQ1I fDul55CJn0dht+6GdI7IsEBKkpzMcMMVRZxbxGZvlQ57GMFyYHU8XSi6ar+3vZfouUQ0 sGTJYlEeba8hNDfNfMTBYuGeUAsEk7lU4Y2GDf3TR45Dr13KOCeANZD5nLJ+GZqfPjXI RutA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=pqJ+g2ULFxr2BEbJGlDc8YvPkVqj0yk3GlTwWaQs/XA=; b=ErMNY4q6YAiaDLAfWrXx3ydMAqRWCwT/mBn5zcMwTkkIl7M+lFvxtewUfV+tqjEmLF o1tTpjqFhIr1HEoBBpwpubltLzl2iBsuG3Muqp/Tw4D0nHHX/HGw0oZMJdbDonybi3WR R1/k931IZBlr5RcVoc9cxyGnXEgWys/8PBmy6KQjnbqXiJ8WyvqYmK53dEA10RZCBIIp s8nejoZoznc4vvnQI6T8HJVBPgSo61N57VgLBqGCMj2khyvVX/B7WuLmCA1LwlEdLUH3 MKHDGghbj0vL/NP4+9RGVxliBsm2qX++57/lRxA294OSbirnLmpBQ9b+VFZ7loyvpiwE 8Crw== X-Gm-Message-State: AGRZ1gKPXwh4XIXjW2B6wWUW0co2w6WtNLuMbfevXfkvM/EXR9JeUdvz cI1wD+8u6ZMePg8Xh50NLUx4mAbuctI= X-Google-Smtp-Source: AJdET5cAV8cPG1suMiHlZLsM5Leyp1We7vTMuL8O7f1CI/9Urq1l/U1BhcwgFG64ISNNaGCPhhOlTw== X-Received: by 2002:a65:430b:: with SMTP id j11-v6mr2683845pgq.269.1540862198725; Mon, 29 Oct 2018 18:16:38 -0700 (PDT) Received: from tomato.housegordon.com (moose.housegordon.com. [184.68.105.38]) by smtp.googlemail.com with ESMTPSA id h87-v6sm30812453pfj.78.2018.10.29.18.16.36 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 29 Oct 2018 18:16:37 -0700 (PDT) Subject: Re: bug#28506: coreutils 8.28 test suite hangs on APFS filesystem To: 28506@debbugs.gnu.org References: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> From: Assaf Gordon Message-ID: <93d07107-8e8e-098a-ed0f-0bcbf3ff15f5@gmail.com> Date: Mon, 29 Oct 2018 19:16:35 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: <0d6cc8b3-975a-9443-86ae-cf858f7054c6@draigBrady.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 28506 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) tags 28506 fixed close 28506 stop (triaging old bugs) On 2017-09-23 8:47 p.m., Pádraig Brady wrote: > On 22/09/17 20:07, Pádraig Brady wrote: >> Is is a wait or a cpu spin? >> Could you use the equivalent of strace on your platform to see what's happening? > > Offlist Jack sent a profile showing /usr/bin/FILE was waiting on input. > That was the result of a silly typo in the script, which the attached > should fix. I don't know what that command does, nor why it's specifically > a problem on APFS, but hopefully this fixes things. Pushed here: https://git.savannah.gnu.org/cgit/coreutils.git/commit/?id=63d2f05f5283c88f6c60ebe6de7a26ce6b9e4ee8 so closing as "fixed". -assaf From unknown Sat Aug 16 22:47:01 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Tue, 27 Nov 2018 12:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator