From debbugs-submit-bounces@debbugs.gnu.org Wed May 01 11:46:53 2013 Received: (at submit) by debbugs.gnu.org; 1 May 2013 15:46:53 +0000 Received: from localhost ([127.0.0.1]:54070 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UXZF4-0007X7-DF for submit@debbugs.gnu.org; Wed, 01 May 2013 11:46:52 -0400 Received: from eggs.gnu.org ([208.118.235.92]:58888) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UXXd8-0002hs-Do for submit@debbugs.gnu.org; Wed, 01 May 2013 10:03:39 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UXXcc-00046w-5p for submit@debbugs.gnu.org; Wed, 01 May 2013 10:03:05 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,FREEMAIL_FROM, RCVD_IN_DNSWL_NONE,RECEIVED_FROM_WINDOWS_HOST,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([208.118.235.17]:51174) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UXXcc-00046r-30 for submit@debbugs.gnu.org; Wed, 01 May 2013 10:03:02 -0400 Received: from eggs.gnu.org ([208.118.235.92]:41995) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UXXcY-0002FM-Nm for bug-coreutils@gnu.org; Wed, 01 May 2013 10:03:02 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UXXcR-00044v-VI for bug-coreutils@gnu.org; Wed, 01 May 2013 10:02:58 -0400 Received: from blu0-omc3-s19.blu0.hotmail.com ([65.55.116.94]:19050) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UXXcR-00044l-Sb for bug-coreutils@gnu.org; Wed, 01 May 2013 10:02:51 -0400 Received: from BLU171-W61 ([65.55.116.74]) by blu0-omc3-s19.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Wed, 1 May 2013 07:02:51 -0700 X-EIP: [JjTcugK7Nhv/xPhQO5mWFj+DD4UO/NN4] X-Originating-Email: [kevinmwills@hotmail.com] Message-ID: From: Kevin Wills To: "bug-coreutils@gnu.org" Subject: I am getting random hangs executing coreutils 8.21 sort. Date: Wed, 1 May 2013 09:02:50 -0500 Importance: Normal Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginalArrivalTime: 01 May 2013 14:02:51.0021 (UTC) FILETIME=[916B6BD0:01CE4674] X-detected-operating-system: by eggs.gnu.org: Windows XP X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 208.118.235.17 X-Spam-Score: -3.5 (---) X-Debbugs-Envelope-To: submit X-Mailman-Approved-At: Wed, 01 May 2013 11:46:49 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.2 (------) I am getting random hangs executing coreutils 8.21 sort. It occurs every so often but I can't reproduce on demand. =20 OS: RHEL 5.8 Linux 2.6.18-308.4.1.el5 #1 SMP Wed Mar 28 01:54:56 EDT 2012 x= 86_64 x86_64 x86_64 GNU/Linux =20 CMDLINE: INSTALL/coreutils-8.21/bin/sort --parallel=3D4 -k3=2C3 -k4=2C4n -t= =2C -S 768M -T /tmp =20 -rw------- 1 x x 410M Apr 30 17:31 /tmp/TEST.20100129.1367347586.5d6b2b011b= b90cc1/sortrg8yHh INFO THREADS 2 Thread 0x43386940 (LWP 28946) 0x0000003675c0d594 in __lll_lock_wait () f= rom /lib64/libpthread.so.0 * 1 Thread 0x2af45f251e20 (LWP 28724) 0x0000003675c07ba5 in pthread_join ()= from /lib64/libpthread.so.0 =20 Each of the hangs is at this same place. =20 (gdb) info threads 2 Thread 0x43386940 (LWP 28946) 0x0000003675c0d594 in __lll_lock_wait ()= from /lib64/libpthread.so.0 * 1 Thread 0x2af45f251e20 (LWP 28724) 0x0000003675c07ba5 in pthread_join (= ) from /lib64/libpthread.so.0 THREAD #1 (gdb) bt 20 #0 0x0000003675c07ba5 in pthread_join () from /lib64/libpthread.so.0 #1 0x0000000000406d92 in sortlines (lines=3D0x2af4898c1b50=2C nthreads=3D1= =2C total_lines=3D3913269=2C node=3D0x1dbf37b0=2C queue=3D0x7fffb16a4b80=2C= tfp=3D0x1dbf32a0=2C temp_output=3D0x1dbf323d "/tmp/TEST.20100129.1367347586.5d6b2b011bb90cc= 1/sortrg8yHh") at src/sort.c:3587 #2 0x0000000000406d83 in sortlines (lines=3D0x2af48b69ccf0=2C nthreads=3D2= =2C total_lines=3D3913269=2C node=3D0x1dbf35b0=2C queue=3D0x7fffb16a4b80=2C= tfp=3D0x1dbf32a0=2C temp_output=3D0x1dbf323d "/tmp/TEST.20100129.1367347586.5d6b2b011bb90cc= 1/sortrg8yHh") at src/sort.c:3585 #3 0x0000000000407191 in sort (files=3D0x6185b8=2C nfiles=3D0=2C output_fi= le=3D0x0=2C nthreads=3D4) at src/sort.c:3917 #4 0x00000000004093a6 in main (argc=3D10=2C argv=3D0x7fffb16a5238) at src/= sort.c:4702 THREAD #2 (gdb) thread 2 [Switching to thread 2 (Thread 0x43386940 (LWP 28946))]#0 0x0000003675c0d5= 94 in __lll_lock_wait () from /lib64/libpthread.so.0 (gdb) bt 20 #0 0x0000003675c0d594 in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x0000003675c08e8a in _L_lock_1034 () from /lib64/libpthread.so.0 #2 0x0000003675c08d4c in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x0000000000406a39 in lock_node (lines=3D=2C nthre= ads=3D=2C total_lines=3D3913269=2C node=3D0x1dbf3830= =2C queue=3D0x7fffb16a4b80=2C tfp=3D0x1dbf32a0=2C temp_output=3D0x1dbf323d "/tmp/TEST.20100129.136734= 7586.5d6b2b011bb90cc1/sortrg8yHh") at src/sort.c:3280 #4 queue_check_insert_parent (lines=3D=2C nthreads=3D= =2C total_lines=3D3913269=2C node=3D0x1dbf3830=2C queu= e=3D0x7fffb16a4b80=2C tfp=3D0x1dbf32a0=2C temp_output=3D0x1dbf323d "/tmp/TEST.20100129.1367347586.5d6b2b011bb90cc= 1/sortrg8yHh") at src/sort.c:3458 #5 merge_loop (lines=3D=2C nthreads=3D=2C total_lines=3D3913269=2C node=3D0x1dbf3830=2C queue=3D0x7fffb16a4= b80=2C tfp=3D0x1dbf32a0=2C temp_output=3D0x1dbf323d "/tmp/TEST.20100129.1367347586.5d6b2b011bb90cc= 1/sortrg8yHh") at src/sort.c:3493 #6 sortlines (lines=3D=2C nthreads=3D=2C total_lines=3D3913269=2C node=3D0x1dbf3830=2C queue=3D0x7fffb16a4b= 80=2C tfp=3D0x1dbf32a0=2C temp_output=3D0x1dbf323d "/tmp/TEST.20100129.1367347586.5d6b2b011bb90cc= 1/sortrg8yHh") at src/sort.c:3608 #7 0x0000000000406dc8 in sortlines_thread (data=3D) a= t src/sort.c:3538 #8 0x0000003675c0677d in start_thread () from /lib64/libpthread.so.0 #9 0x0000003674cd325d in clone () from /lib64/libc.so.6 = From debbugs-submit-bounces@debbugs.gnu.org Wed May 01 16:22:21 2013 Received: (at 14327) by debbugs.gnu.org; 1 May 2013 20:22:21 +0000 Received: from localhost ([127.0.0.1]:54200 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UXdXh-0000sg-1u for submit@debbugs.gnu.org; Wed, 01 May 2013 16:22:21 -0400 Received: from smtp.cs.ucla.edu ([131.179.128.62]:57024) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UXdXe-0000sW-B7 for 14327@debbugs.gnu.org; Wed, 01 May 2013 16:22:20 -0400 Received: from localhost (localhost.localdomain [127.0.0.1]) by smtp.cs.ucla.edu (Postfix) with ESMTP id CBED4A60007; Wed, 1 May 2013 13:21:46 -0700 (PDT) X-Virus-Scanned: amavisd-new at smtp.cs.ucla.edu Received: from smtp.cs.ucla.edu ([127.0.0.1]) by localhost (smtp.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XXcy8skOY21R; Wed, 1 May 2013 13:21:46 -0700 (PDT) Received: from penguin.cs.ucla.edu (Penguin.CS.UCLA.EDU [131.179.64.200]) by smtp.cs.ucla.edu (Postfix) with ESMTPSA id 6567C39E8100; Wed, 1 May 2013 13:21:46 -0700 (PDT) Message-ID: <5181795A.7070705@cs.ucla.edu> Date: Wed, 01 May 2013 13:21:46 -0700 From: Paul Eggert User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130311 Thunderbird/17.0.4 MIME-Version: 1.0 To: Kevin Wills Subject: Re: bug#14327: I am getting random hangs executing coreutils 8.21 sort. References: In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Score: -4.1 (----) X-Debbugs-Envelope-To: 14327 Cc: 14327@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -6.8 (------) Can you build coreutils without optimization (make CFLAGS='-g3') and get a backtrace from that version? That might be easier to diagnose. From debbugs-submit-bounces@debbugs.gnu.org Fri May 03 04:09:50 2013 Received: (at 14327) by debbugs.gnu.org; 3 May 2013 08:09:50 +0000 Received: from localhost ([127.0.0.1]:56378 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYB3u-0003WK-8K for submit@debbugs.gnu.org; Fri, 03 May 2013 04:09:50 -0400 Received: from mail-vb0-f51.google.com ([209.85.212.51]:48560) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYB3s-0003W4-Or for 14327@debbugs.gnu.org; Fri, 03 May 2013 04:09:49 -0400 Received: by mail-vb0-f51.google.com with SMTP id x16so1173945vbf.10 for <14327@debbugs.gnu.org>; Fri, 03 May 2013 01:09:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=Ph5SFF9vw64An16Z087p79nj67TIuW1jnGVyIW3SBBU=; b=PahB4cQmcprNg7qB3csMZ14DWVtA8TexWcXlMGzT93Jmogxjab3jPPkTS4ylOdRJLE yJ3E1XAjbPfvuEPhC1wE9QQMAxvtJnINgSSYl8gjX/anUBf2Jt+WpNPUWvfhLLQmWYri q9/BcbgTj/W+OVeCvETH8VKvVs9GDBLe4KZSgW9fF/0X+JzxEhgCNKRZjwSRvKawl1F4 FTxDpNoMPBySJP7lmyQiHNpPDTMykA3Q3W/DUGUiaKugqZQAOdqGRQR5l3TwsytV8v4i EwQfsRdGeuirIZ305cEpMbPEe1ZdX97HWR84rxDFeUbm9q8doNjPI0HAaWj2u7tS61y2 GmvQ== MIME-Version: 1.0 X-Received: by 10.52.231.231 with SMTP id tj7mr2834401vdc.111.1367568549367; Fri, 03 May 2013 01:09:09 -0700 (PDT) Received: by 10.220.112.147 with HTTP; Fri, 3 May 2013 01:09:09 -0700 (PDT) In-Reply-To: <5181795A.7070705@cs.ucla.edu> References: <5181795A.7070705@cs.ucla.edu> Date: Fri, 3 May 2013 01:09:09 -0700 Message-ID: Subject: Re: bug#14327: I am getting random hangs executing coreutils 8.21 sort. From: Chen Guo To: Paul Eggert Content-Type: multipart/alternative; boundary=089e0118467297833804dbcbddba X-Spam-Score: 0.4 (/) X-Debbugs-Envelope-To: 14327 Cc: 14327@debbugs.gnu.org, Kevin Wills X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.3 (--) --089e0118467297833804dbcbddba Content-Type: text/plain; charset=ISO-8859-1 Hi Kevin,if it's not too much trouble a core dump would also be nice to have, particularly given how difficult this seems to be to reproduce. On Wed, May 1, 2013 at 1:21 PM, Paul Eggert wrote: > Can you build coreutils without optimization > (make CFLAGS='-g3') and get a backtrace from > that version? That might be easier to diagnose. > > > > --089e0118467297833804dbcbddba Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Kevin,if it's not too much trouble a core dump= would also be nice to have, particularly given how difficult this seems to= be to reproduce.


On Wed, May 1, 2013 at 1:21 PM, Paul Eggert <eggert@cs.ucla.edu>= wrote:
Can you build coreutils without optimization
(make CFLAGS=3D'-g3') and get a backtrace from
that version? =A0That might be easier to diagnose.




--089e0118467297833804dbcbddba-- From debbugs-submit-bounces@debbugs.gnu.org Fri May 03 04:30:06 2013 Received: (at 14327) by debbugs.gnu.org; 3 May 2013 08:30:06 +0000 Received: from localhost ([127.0.0.1]:56396 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYBNW-0004xn-6g for submit@debbugs.gnu.org; Fri, 03 May 2013 04:30:06 -0400 Received: from mail-ve0-f174.google.com ([209.85.128.174]:50910) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYBNU-0004x8-42 for 14327@debbugs.gnu.org; Fri, 03 May 2013 04:30:04 -0400 Received: by mail-ve0-f174.google.com with SMTP id pb11so1292316veb.33 for <14327@debbugs.gnu.org>; Fri, 03 May 2013 01:29:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=2dbsk/xK3mMaK8wVuOcPGmDQHB5DjdYNqAFpsps2yrA=; b=Ekfh+aTt1F5V4gK7dClmidd5WTIjarHndn+VWlD9x0knwzUulRPDXiaK8Qcdi+2I4w LzfBgOyk9AgMzyUgBGNFt6680KOlo0tSpJiwXyAiMhTeu3XwBE2JG/9tLI9ol6r/d1oB 5XbhnOBgWeBLDzVfe2MJFBet4tgXRp/3AtBFxjJBnr1C9RFthC0W1dKIoAtlzo+rdQyX dYStDeItdj8ralyXiL8pXbL4xwOTD7gwUSe5v/9bHOoqbWwH5rV40vpsCYQ6lA7f8o0m KVxLPmwxhH+MiIWPzo5LKP9hCDZ3wljGQhP57dJMl18Js0csva++KkeSAczrjARE4WrY 4eHQ== MIME-Version: 1.0 X-Received: by 10.52.29.19 with SMTP id f19mr2830897vdh.100.1367569764658; Fri, 03 May 2013 01:29:24 -0700 (PDT) Received: by 10.220.112.147 with HTTP; Fri, 3 May 2013 01:29:24 -0700 (PDT) In-Reply-To: References: <5181795A.7070705@cs.ucla.edu> Date: Fri, 3 May 2013 01:29:24 -0700 Message-ID: Subject: Re: bug#14327: I am getting random hangs executing coreutils 8.21 sort. From: Chen Guo To: Paul Eggert Content-Type: multipart/alternative; boundary=20cf307abe8707626204dbcc260c X-Spam-Score: 0.4 (/) X-Debbugs-Envelope-To: 14327 Cc: 14327@debbugs.gnu.org, Kevin Wills X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.3 (--) --20cf307abe8707626204dbcc260c Content-Type: text/plain; charset=ISO-8859-1 On second though let's hold off on the core dump, I realize with how many lines you're sorting the dump must be excessively large. Let's hope we can nail it with a proper stack trace first. On Fri, May 3, 2013 at 1:09 AM, Chen Guo wrote: > Hi Kevin,if it's not too much trouble a core dump would also be nice to > have, particularly given how difficult this seems to be to reproduce. > > > On Wed, May 1, 2013 at 1:21 PM, Paul Eggert wrote: > >> Can you build coreutils without optimization >> (make CFLAGS='-g3') and get a backtrace from >> that version? That might be easier to diagnose. >> >> >> >> > --20cf307abe8707626204dbcc260c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
On second though let's hold off on the core dump, I re= alize with how many lines you're sorting the dump must be excessively l= arge. Let's hope we can nail it with a proper stack trace first.


On Fri, May 3= , 2013 at 1:09 AM, Chen Guo <chen.guo.0625@gmail.com> = wrote:
Hi Kevin,if it's n= ot too much trouble a core dump would also be nice to have, particularly gi= ven how difficult this seems to be to reproduce.


On Wed, May 1, 2013 at 1:21 PM, Paul Eggert <eggert@cs.ucla.edu>= wrote:
Can you build coreutils without optimization
(make CFLAGS=3D'-g3') and get a backtrace from
that version? =A0That might be easier to diagnose.





--20cf307abe8707626204dbcc260c-- From debbugs-submit-bounces@debbugs.gnu.org Fri May 03 13:06:00 2013 Received: (at 14327) by debbugs.gnu.org; 3 May 2013 17:06:00 +0000 Received: from localhost ([127.0.0.1]:57271 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYJQl-0003o7-Q6 for submit@debbugs.gnu.org; Fri, 03 May 2013 13:06:00 -0400 Received: from joseki.proulx.com ([216.17.153.58]:32870) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYJQj-0003nz-8h for 14327@debbugs.gnu.org; Fri, 03 May 2013 13:05:58 -0400 Received: from hysteria.proulx.com (hysteria.proulx.com [192.168.230.119]) by joseki.proulx.com (Postfix) with ESMTP id 4A207211D5; Fri, 3 May 2013 11:05:15 -0600 (MDT) Received: by hysteria.proulx.com (Postfix, from userid 1000) id 30BF42DC40; Fri, 3 May 2013 11:05:15 -0600 (MDT) Date: Fri, 3 May 2013 11:05:15 -0600 From: Bob Proulx To: Chen Guo Subject: Re: bug#14327: I am getting random hangs executing coreutils 8.21 sort. Message-ID: <20130503170515.GC29697@hysteria.proulx.com> References: <5181795A.7070705@cs.ucla.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Spam-Score: -1.8 (-) X-Debbugs-Envelope-To: 14327 Cc: 14327@debbugs.gnu.org, Kevin Wills X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -4.5 (----) Chen Guo wrote: > Chen Guo wrote: > > Hi Kevin,if it's not too much trouble a core dump would also be nice to > > have, particularly given how difficult this seems to be to reproduce. > > On second though let's hold off on the core dump, I realize with how many > lines you're sorting the dump must be excessively large. Let's hope we can > nail it with a proper stack trace first. If you do try to share core file please do not send it to the mailing list. Any core file would be too huge to push to everyone and only a few would find it useful. Raw core dumps tend to be problematic unless matched with their exact matching source. Let's not push large binary files to everyone. Instead post it to a paste bin site such as wikisend or other and then just send the link to the mailing list. No login needed. http://wikisend.com/ Bob From debbugs-submit-bounces@debbugs.gnu.org Sun May 05 02:08:55 2013 Received: (at 14327) by debbugs.gnu.org; 5 May 2013 06:08:55 +0000 Received: from localhost ([127.0.0.1]:58415 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYs7z-0007SL-4e for submit@debbugs.gnu.org; Sun, 05 May 2013 02:08:55 -0400 Received: from mail-ob0-f172.google.com ([209.85.214.172]:47359) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1UYs7x-0007SC-5E for 14327@debbugs.gnu.org; Sun, 05 May 2013 02:08:54 -0400 Received: by mail-ob0-f172.google.com with SMTP id xk17so2379296obc.17 for <14327@debbugs.gnu.org>; Sat, 04 May 2013 23:08:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=PME3GnVEtEF/649S1dW2+rSF3N4MJ7SLy7FfdIJtY4Q=; b=dTUKbqE9YAXmpyQWr1DldSyjcV5InfqoWBXTr5yTKH146VcMRpsR9kJJPzwV6VwMg6 +n9CHjqr8kI0R2o7bJaejTsbyUUjRaiaiNp3KHwPkmvj0FGctj4VJ9yFGFXpHv1V5AsQ 2wPZkM4zJ/aoI1SjFjKKrSPxz2iGuX/J4YVnIlcFUZ0V74yHhgqjd2lRt098xwsk/ZlF ArV1J65jcAZU02CxcNd9kp2USIQJpg/mh3nNA+wy22sxCnQ5eNsXalw0ggYLqytBR/Ui Vj4xCTY3WBJY2MSeaDeHkN9hLsULGm0gwV+gCz7PzD9co7YAR4muSANd8o7EdUX+mTnP yEjQ== MIME-Version: 1.0 X-Received: by 10.60.60.73 with SMTP id f9mr735228oer.43.1367734082674; Sat, 04 May 2013 23:08:02 -0700 (PDT) Received: by 10.76.105.74 with HTTP; Sat, 4 May 2013 23:08:02 -0700 (PDT) In-Reply-To: References: Date: Sat, 4 May 2013 23:08:02 -0700 Message-ID: Subject: Re: bug#14327: I am getting random hangs executing coreutils 8.21 sort. From: Chen Guo To: Kevin Wills Content-Type: text/plain; charset=ISO-8859-1 X-Spam-Score: -0.4 (/) X-Debbugs-Envelope-To: 14327 Cc: 14327@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.3 (--) Hi Kevin, On Wed, May 1, 2013 at 7:02 AM, Kevin Wills wrote: > THREAD #1 > > (gdb) bt 20 > #0 0x0000003675c07ba5 in pthread_join () from /lib64/libpthread.so.0 > #1 0x0000000000406d92 in sortlines (lines=0x2af4898c1b50, nthreads=1, total_lines=3913269, node=0x1dbf37b0, queue=0x7fffb16a4b80, tfp=0x1dbf32a0, > temp_output=0x1dbf323d "/tmp/TEST.20100129.1367347586.5d6b2b011bb90cc1/sortrg8yHh") at src/sort.c:3587 > #2 0x0000000000406d83 in sortlines (lines=0x2af48b69ccf0, nthreads=2, total_lines=3913269, node=0x1dbf35b0, queue=0x7fffb16a4b80, tfp=0x1dbf32a0, > temp_output=0x1dbf323d "/tmp/TEST.20100129.1367347586.5d6b2b011bb90cc1/sortrg8yHh") at src/sort.c:3585 > #3 0x0000000000407191 in sort (files=0x6185b8, nfiles=0, output_file=0x0, nthreads=4) at src/sort.c:3917 > #4 0x00000000004093a6 in main (argc=10, argv=0x7fffb16a5238) at src/sort.c:4702 > Took a quick look, noticed the above call stack is suspicious. The last call to sortlines before the pthread_join() is invoked with nthreads = 1, while in code sortlines would only call pthread_join() if nthreads > 1. I confirmed this in the disassembly as well to rule out the unlikely possibility this was the result of some compiler optimization (I used -O2). Did you compile this yourself or was it distributed with your system? From debbugs-submit-bounces@debbugs.gnu.org Thu Oct 18 20:30:17 2018 Received: (at 14327) by debbugs.gnu.org; 19 Oct 2018 00:30:17 +0000 Received: from localhost ([127.0.0.1]:57736 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gDIgC-00088A-Te for submit@debbugs.gnu.org; Thu, 18 Oct 2018 20:30:17 -0400 Received: from mail-pl1-f182.google.com ([209.85.214.182]:35559) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gDIgA-000810-R8; Thu, 18 Oct 2018 20:30:15 -0400 Received: by mail-pl1-f182.google.com with SMTP id f8-v6so15078183plb.2; Thu, 18 Oct 2018 17:30:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:cc:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=khTnRg7Q4gg2LeOvLaTZbbwu2nJA5FIjmnykPmLTZFQ=; b=OqvySJw4Hn5PEEksfsh8vUUf4pnJYH+BS1xD3d+Wx6OXK1PWEVVZ01Jvkhxtx8rVTA bdlto4Wl0dew+nJ57J8cJd1daR49oLdFNOHm12mdPAGtpT677qNBkEvbyry2IywTDxHg +uyJUBa9FAlN4v3vAbSc7QfjZLQIsylhIvHUFipGcJ44s/VTo9Wtw92UHjEr7xoEpjcr 5S46Lc4pH0xk33NYu8su4+gGeba1fcbeJx21NgyZAP5uFPxft14qXgYx0TtG+LExL78p 8mUyoj7cR90uZV1pLQlvsU918ywE5Dav0tweQHW9EheLDvF49Y9PYeqF5Eof7Yyzf/Jt 6umw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=khTnRg7Q4gg2LeOvLaTZbbwu2nJA5FIjmnykPmLTZFQ=; b=prrp/iDIZ+kgcPdAfgKUnkHYOItKhmCNjG9UI3OKyb6MOv7cgqV24zJT6H34aNy99m OLVjPkKBraHjWo+onpwYJCQHAP5sXaxeq3WkdZgk0PKaI8AsCcgaELZc4xkJf0CO3CA3 8Yq0BZ2w1WW0wkreibgwjwnE64OtGTvzqWLWKUbOEO37TgrC65fcQ2v8bj6M0hcb9uZX /qBTrUbLVDJF43gSHA7Ceb+8qljhoJbGtMR8GU8Mhedpn9oL7o6xSFTV01j5lBJ46G40 QO3AOKLWsIX12EKaaay59syogaY4+1jVLJdzWkDq0up9BJQ+R3rNiiq5GJ1g+4AWbKhL FDJQ== X-Gm-Message-State: ABuFfoh1r8LKQa9vsq0a9S/30ic0Tyw3FB3Mq7NOVZS3WYt7FjxMZ4mX ytddV985ClIaCCftXVBZIW9cPShAZT4= X-Google-Smtp-Source: ACcGV60cFOC+HDIcFjAxw+k5XEkCYGP2koD6fsLl8oWWziu8l0t69zZppAIsbHDSYSA+SqNGOjxtWg== X-Received: by 2002:a17:902:a618:: with SMTP id u24-v6mr31670696plq.77.1539909008427; Thu, 18 Oct 2018 17:30:08 -0700 (PDT) Received: from tomato.housegordon.com (moose.housegordon.com. [184.68.105.38]) by smtp.googlemail.com with ESMTPSA id n63-v6sm26927046pfn.9.2018.10.18.17.30.06 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 18 Oct 2018 17:30:07 -0700 (PDT) Subject: Re: bug#14327: I am getting random hangs executing coreutils 8.21 sort. References: From: Assaf Gordon Message-ID: <39122abc-e927-abbe-2c8f-2f03c196e8b5@gmail.com> Date: Thu, 18 Oct 2018 18:30:05 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Score: 1.2 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: tags 14327 moreinfo retitle 14327 sort: random hangs executing coreutils 8.21 close 14327 stop (triaging old bugs) Hello, [...] Content analysis details: (1.2 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (assafgordon[at]gmail.com) -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/, no trust [209.85.214.182 listed in list.dnswl.org] -0.0 SPF_PASS SPF: sender matches SPF record 1.2 MISSING_HEADERS Missing To: header X-Debbugs-Envelope-To: 14327 Cc: 14327@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.2 (/) tags 14327 moreinfo retitle 14327 sort: random hangs executing coreutils 8.21 close 14327 stop (triaging old bugs) Hello, On 05/05/13 12:08 AM, Chen Guo wrote: [...] > I confirmed this in the disassembly as well to rule out the unlikely > possibility this was the result of some compiler optimization (I used -O2). > > Did you compile this yourself or was it distributed with your system? With no further follow-ups in 5 years, and some multithreaded-related bug fixes in sort version 8.23, I'm closing this bug. If there are new sort-related bugs, please write to bugs-coreutils@gnu.org . regards, - assaf From unknown Sun Jun 15 08:20:31 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 16 Nov 2018 12:24:05 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator