From unknown Sun Jun 22 07:59:09 2025 X-Loop: help-debbugs@gnu.org Subject: bug#39850: "du" command can not count some files Resent-From: Hyunho Cho Original-Sender: "Debbugs-submit" Resent-CC: bug-coreutils@gnu.org Resent-Date: Sun, 01 Mar 2020 08:06:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 39850 X-GNU-PR-Package: coreutils X-GNU-PR-Keywords: To: 39850@debbugs.gnu.org X-Debbugs-Original-To: Received: via spool by submit@debbugs.gnu.org id=B.158304995623927 (code B ref -1); Sun, 01 Mar 2020 08:06:02 +0000 Received: (at submit) by debbugs.gnu.org; 1 Mar 2020 08:05:56 +0000 Received: from localhost ([127.0.0.1]:35741 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j8Jbk-0006Do-KK for submit@debbugs.gnu.org; Sun, 01 Mar 2020 03:05:56 -0500 Received: from lists.gnu.org ([209.51.188.17]:51301) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j8Ina-0004is-Dh for submit@debbugs.gnu.org; Sun, 01 Mar 2020 02:14:04 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:38403) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1j8InX-0000XD-Q6 for bug-coreutils@gnu.org; Sun, 01 Mar 2020 02:14:01 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-0.4 required=5.0 tests=BAYES_40, FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,FROM_EXCESS_BASE64, FROM_MISSP_FREEMAIL,RCVD_IN_DNSWL_LOW,SPOOFED_FREEMAIL,URIBL_BLOCKED autolearn=disabled version=3.3.2 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1j8InS-0005e7-Kv for bug-coreutils@gnu.org; Sun, 01 Mar 2020 02:13:56 -0500 Received: from cvsmtppost001.nm.naver.com ([125.209.224.201]:35314) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1j8InR-0005Yk-G7 for bug-coreutils@gnu.org; Sun, 01 Mar 2020 02:13:54 -0500 X-Naver-CIP: 211.192.208.211 Received: from cvsendbo19.nm ([10.112.234.162]) by cvsmtppost001.nm.naver.com with ESMTP id QUFS5KZPQNKqSpSGjfvqdA for ; Sun, 01 Mar 2020 07:13:46 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=naver.com; s=s20171208; t=1583046826; bh=+o//A+kdnzd2BsE8mwWd8K/ea+zVZBBYpjFeuHWpEcw=; h=Message-ID:Date:From:To:Subject; b=OZncNxrfdycW9Viu/kE5tqHlD+Jpi85b3YtmuixGQOSyxPqrMf5xXI9WUw56f6I2X PGN0K01GfzsUPcT8wTbzeFp10xDl4iT2ZpVLs6g0qR6UQthTiqtVyLQxXD5oG3VKGP tkcPR/qpLowuFf8gnfvRiuupihhdYEzcbDVIypZhiP227mBBFqHa4mdI1vy1Z+9Fbj mjKq9QhdN0DANWkkyY8yXLzCTXXWEkZYmFhIRzLAlnT5Nzs9t/5d8Y18Z6qDcoELGM RCmJwa5i80QM7wwlm3av6kEuoC9m91PWZJBK74/8q4Fuqp3ytOUj68V9+T7O9eAc35 iJIaBSkQgyj3g== X-Session-ID: NebqKAgZKAUTFAblBqumWBkNaAvr7qMqFAtdFqtmFqE9 MIME-Version: 1.0 Message-ID: <80a198e6b83cc049571d9275028ed5f@cweb011.nm.nfra.io> Date: Sun, 01 Mar 2020 16:13:46 +0900 From: Hyunho Cho Importance: normal X-Originating-IP: 211.192.208.211 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [fuzzy] X-Received-From: 125.209.224.201 X-Spam-Score: 0.5 (/) X-Mailman-Approved-At: Sun, 01 Mar 2020 03:05:51 -0500 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.5 (/) JCBsc2JfcmVsZWFzZSAtYQpObyBMU0IgbW9kdWxlcyBhcmUgYXZhaWxhYmxlLgpEaXN0cmlidXRv ciBJRDogVWJ1bnR1CkRlc2NyaXB0aW9uOiAgICBVYnVudHUgMTkuMTAKUmVsZWFzZTogICAgICAg IDE5LjEwCkNvZGVuYW1lOiAgICAgICBlb2FuCgokIHVuYW1lIC1hCkxpbnV4IEVsaXRlQm9vayA1 LjMuMC00MC1nZW5lcmljICMzMi1VYnVudHUgU01QIEZyaSBKYW4gMzEgMjA6MjQ6MzQgVVRDIDIw MjAgeDg2XzY0IHg4Nl82NCB4ODZfNjQgR05VL0xpbnV4CgokIGR1IC0tdmVyc2lvbgpkdSAoR05V IGNvcmV1dGlscykgOC4zMAoKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09CgoKJCBmaW5kIC91 c3IvYmluIC10eXBlIGYgfCB3YyAtbAoyMjM0CgokIGZpbmQgL3Vzci9iaW4gLXR5cGUgZiAtcHJp bnQwIHwgZHUgLWIgLS1maWxlczAtZnJvbT0tIHwgd2MgLWwKMjIyMgoKJCBkdSAtYiAkKCBmaW5k IC91c3IvYmluIC10eXBlIGYgKSB8IHdjIC1sCjIyMjIKCgoKJCBmaW5kIC91c3IvYmluIC10eXBl IGYgLWV4ZWMgc3RhdCAtYyAlcyB7fSArIHwgYXdrICd7c3VtKz0kMX0gRU5EeyBwcmludCBzdW19 JwoxMjk2MDExNTcwCgokIGZpbmQgL3Vzci9iaW4gLXR5cGUgZiAtcHJpbnQwIHwgZHUgLWIgLS1m aWxlczAtZnJvbT0tIHwgYXdrICd7c3VtKz0kMX0gRU5EeyBwcmludCBzdW19JwoxMjgyMzUwMzg4 CgoKCiQgZGlmZiA8KCBmaW5kIC91c3IvYmluIC10eXBlIGYgfCBzb3J0ICkgPCggZmluZCAvdXNy L2JpbiAtdHlwZSBmIC1wcmludDAgfCBkdSAtLWZpbGVzMC1mcm9tPS0gIHwgY3V0IC1mIDIgIHwg c29ydCApCjEyMzFkMTIzMAo8IC91c3IvYmluL3Blcmw1LjI4LjEKMTIzM2QxMjMxCjwgL3Vzci9i aW4vcGVybGJ1ZwoxMjYyZDEyNTkKPCAvdXNyL2Jpbi9waWd6CjEyNzJkMTI2OAo8IC91c3IvYmlu L3BrZy1jb25maWcKMTUxNywxNTE4ZDE1MTIKPCAvdXNyL2Jpbi9weXRob24zLjZtCjwgL3Vzci9i aW4vcHl0aG9uMy43CjE2MTlkMTYxMgo8IC91c3IvYmluL3JiCjE2OTdkMTY4OQo8IC91c3IvYmlu L3J6CjE3MjdkMTcxOAo8IC91c3IvYmluL3NiCjE4OTNkMTg4Mwo8IC91c3IvYmluL3N6CjE5MzJk MTkyMQo8IC91c3IvYmluL3RpcHRvcAoxOTkwZDE5NzgKPCAvdXNyL2Jpbi91bnppcAoKCgoK From unknown Sun Jun 22 07:59:09 2025 X-Loop: help-debbugs@gnu.org Subject: bug#39850: "du" command can not count some files Resent-From: Paul Eggert Original-Sender: "Debbugs-submit" Resent-CC: bug-coreutils@gnu.org Resent-Date: Sun, 01 Mar 2020 08:32:03 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 39850 X-GNU-PR-Package: coreutils X-GNU-PR-Keywords: To: Hyunho Cho Cc: 39850@debbugs.gnu.org Received: via spool by 39850-submit@debbugs.gnu.org id=B39850.158305148826944 (code B ref 39850); Sun, 01 Mar 2020 08:32:03 +0000 Received: (at 39850) by debbugs.gnu.org; 1 Mar 2020 08:31:28 +0000 Received: from localhost ([127.0.0.1]:35757 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j8K0W-00070W-6J for submit@debbugs.gnu.org; Sun, 01 Mar 2020 03:31:28 -0500 Received: from zimbra.cs.ucla.edu ([131.179.128.68]:37548) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j8K0U-00070C-5X for 39850@debbugs.gnu.org; Sun, 01 Mar 2020 03:31:26 -0500 Received: from localhost (localhost [127.0.0.1]) by zimbra.cs.ucla.edu (Postfix) with ESMTP id EE12A160087; Sun, 1 Mar 2020 00:31:19 -0800 (PST) Received: from zimbra.cs.ucla.edu ([127.0.0.1]) by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id y5S_O3CWw8jc; Sun, 1 Mar 2020 00:31:19 -0800 (PST) Received: from localhost (localhost [127.0.0.1]) by zimbra.cs.ucla.edu (Postfix) with ESMTP id 5626316008C; Sun, 1 Mar 2020 00:31:19 -0800 (PST) X-Virus-Scanned: amavisd-new at zimbra.cs.ucla.edu Received: from zimbra.cs.ucla.edu ([127.0.0.1]) by localhost (zimbra.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 2nBw1VyQ2Tvq; Sun, 1 Mar 2020 00:31:19 -0800 (PST) Received: from [192.168.1.9] (cpe-23-242-74-103.socal.res.rr.com [23.242.74.103]) by zimbra.cs.ucla.edu (Postfix) with ESMTPSA id 2E5BD160087; Sun, 1 Mar 2020 00:31:19 -0800 (PST) References: <80a198e6b83cc049571d9275028ed5f@cweb011.nm.nfra.io> From: Paul Eggert Organization: UCLA Computer Science Department Message-ID: <2dc8ae4f-5899-03e1-d0c1-6100cb8bff79@cs.ucla.edu> Date: Sun, 1 Mar 2020 00:31:18 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.4.1 MIME-Version: 1.0 In-Reply-To: <80a198e6b83cc049571d9275028ed5f@cweb011.nm.nfra.io> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) I don't see a bug there, as the files you say "du" is not counting have counts of zero. From unknown Sun Jun 22 07:59:09 2025 X-Loop: help-debbugs@gnu.org Subject: bug#39850: "du" command can not count some files Resent-From: Bob Proulx Original-Sender: "Debbugs-submit" Resent-CC: bug-coreutils@gnu.org Resent-Date: Tue, 03 Mar 2020 06:02:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 39850 X-GNU-PR-Package: coreutils X-GNU-PR-Keywords: To: Hyunho Cho Cc: 39850@debbugs.gnu.org Received: via spool by 39850-submit@debbugs.gnu.org id=B39850.1583215277900 (code B ref 39850); Tue, 03 Mar 2020 06:02:02 +0000 Received: (at 39850) by debbugs.gnu.org; 3 Mar 2020 06:01:17 +0000 Received: from localhost ([127.0.0.1]:38625 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j90cH-0000ES-Cg for submit@debbugs.gnu.org; Tue, 03 Mar 2020 01:01:17 -0500 Received: from havoc.proulx.com ([96.88.95.61]:60160) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j90cE-0000EE-Vl for 39850@debbugs.gnu.org; Tue, 03 Mar 2020 01:01:16 -0500 Received: from joseki.proulx.com (localhost [127.0.0.1]) by havoc.proulx.com (Postfix) with ESMTP id D93696D4; Mon, 2 Mar 2020 23:01:08 -0700 (MST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=proulx.com; s=dkim2048; t=1583215268; bh=YwxvAULFJCC/iGBMBNnsYs0MG9xp+IbHYvxLUvruw9c=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=IHErnm1GB8FayLUlNpo34ig5JSpkmTO0tEVbuXGBm//8pCqcop5Fo9kk2eO3DeX/y orCUMqJMuioy12Yu4esQoppP5n273UhjsbhUQ0IW+/5FTZAgf7FQP+Y+anqnyuteMx oZsaWbHgMl2hMRD5XHIG8z9of+Kbpx6zEcOq4XW18JPY0DI9QwQQmgu0XwrfC7EDVS tZNgfe1p/oKAWghuQvrEbflvjVZJ8ZK3kRfBUXfkNTlFkE2IJvDyGbEqhaH/ECAaCp vkeDNorFP4AlXT0FItM4LGNnWawj/D1W0qspGAQ4xFobl0hhVM/2AoSY7BhHsYwOYd ty5tveW8wrhoA== Received: from hysteria.proulx.com (hysteria.proulx.com [192.168.230.119]) by joseki.proulx.com (Postfix) with ESMTP id A69642114D; Mon, 2 Mar 2020 23:01:08 -0700 (MST) Received: by hysteria.proulx.com (Postfix, from userid 1000) id 926DB2DC87; Mon, 2 Mar 2020 23:01:08 -0700 (MST) Date: Mon, 2 Mar 2020 23:01:08 -0700 From: Bob Proulx Message-ID: <20200302225314650172088@bob.proulx.com> References: <80a198e6b83cc049571d9275028ed5f@cweb011.nm.nfra.io> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <80a198e6b83cc049571d9275028ed5f@cweb011.nm.nfra.io> X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hyunho Cho wrote: > $ find /usr/bin -type f | wc -l > 2234 > > $ find /usr/bin -type f -print0 | du -b --files0-from=- | wc -l > 2222 Hard links. Files that are hard linked are only counted once by du since du is summing up the disk usage and hard linked files only use disk on the first usage. Add the du -l option if you want to count hard linked files multiple times. find /usr/bin -type f -print0 | du -l -b --files0-from=- | wc -l That will generate an incorrect total disk usage amount however as it will report hard linked disk space for each hard link. But it all depends upon what you are trying to count. > $ du -b $( find /usr/bin -type f ) | wc -l > 2222 du -l -b $( find /usr/bin -type f ) | wc -l > $ find /usr/bin -type f -exec stat -c %s {} + | awk '{sum+=$1} END{ print sum}' > 1296011570 > > $ find /usr/bin -type f -print0 | du -b --files0-from=- | awk '{sum+=$1} END{ print sum}' > 1282350388 find /usr/bin -type f -print0 | du -l -b --files0-from=- | awk '{sum+=$1} END{ print sum}' > $ diff <( find /usr/bin -type f | sort ) <( find /usr/bin -type f -print0 | du --files0-from=- | cut -f 2 | sort ) diff <( find /usr/bin -type f | sort ) <( find /usr/bin -type f -print0 | du -l --files0-from=- | cut -f 2 | sort ) I am surprised you didn't try du on each file in addition to stat -c %s on each file when you were summing them up. :-) find /usr/bin -type f -exec du -b {} \; | awk '{sum+=$1} END{ print sum}' Bob