From unknown Thu Jun 19 14:11:17 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#21916 <21916@debbugs.gnu.org> To: bug#21916 <21916@debbugs.gnu.org> Subject: Status: sort -u drops unique lines with some locales Reply-To: bug#21916 <21916@debbugs.gnu.org> Date: Thu, 19 Jun 2025 21:11:17 +0000 retitle 21916 sort -u drops unique lines with some locales reassign 21916 coreutils submitter 21916 Christoph Anton Mitterer severity 21916 normal tag 21916 notabug thanks From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 00:38:27 2015 Received: (at submit) by debbugs.gnu.org; 14 Nov 2015 05:38:27 +0000 Received: from localhost ([127.0.0.1]:37625 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxTXe-00025b-SX for submit@debbugs.gnu.org; Sat, 14 Nov 2015 00:38:27 -0500 Received: from eggs.gnu.org ([208.118.235.92]:56120) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxTXc-00025T-2z for submit@debbugs.gnu.org; Sat, 14 Nov 2015 00:38:24 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ZxTXZ-0006uq-VB for submit@debbugs.gnu.org; Sat, 14 Nov 2015 00:38:23 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: ** X-Spam-Status: No, score=2.8 required=5.0 tests=AC_HTML_NONSENSE_TAGS, BAYES_50, WEIRD_QUOTING autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:43575) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZxTXZ-0006um-S7 for submit@debbugs.gnu.org; Sat, 14 Nov 2015 00:38:21 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:37892) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZxTXY-0006ZU-CC for bug-coreutils@gnu.org; Sat, 14 Nov 2015 00:38:21 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ZxTXU-0006sM-2R for bug-coreutils@gnu.org; Sat, 14 Nov 2015 00:38:20 -0500 Received: from mailgw-01.dd24.net ([193.46.215.41]:34748) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZxTXT-0006sD-Ok for bug-coreutils@gnu.org; Sat, 14 Nov 2015 00:38:15 -0500 Received: from mailpolicy-01.live.igb.homer.key-systems.net (mailpolicy-01.live.igb.homer.key-systems.net [192.168.1.26]) by mailgw-01.dd24.net (Postfix) with ESMTP id 97CB45FB8A for ; Sat, 14 Nov 2015 05:38:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at mailpolicy-01.live.igb.homer.key-systems.net Received: from mailgw-01.dd24.net ([192.168.1.35]) by mailpolicy-01.live.igb.homer.key-systems.net (mailpolicy-01.live.igb.homer.key-systems.net [192.168.1.25]) (amavisd-new, port 10235) with ESMTP id 9f6BbQ3keoF4 for ; Sat, 14 Nov 2015 05:38:12 +0000 (UTC) Received: from heisenberg.scientia.net (p5B10016F.dip0.t-ipconnect.de [91.16.1.111]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mailgw-01.dd24.net (Postfix) with ESMTPSA for ; Sat, 14 Nov 2015 05:38:12 +0000 (UTC) Message-ID: <1447479491.18813.0.camel@scientia.net> Subject: sort -u drops unique lines with some locales From: Christoph Anton Mitterer To: bug-coreutils@gnu.org Date: Sat, 14 Nov 2015 06:38:11 +0100 Content-Type: multipart/signed; micalg="sha-512"; protocol="application/x-pkcs7-signature"; boundary="=-8E3HhHqNuw4YKLiuQJZ2" X-Mailer: Evolution 3.18.1-1 Mime-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -3.0 (---) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.0 (---) --=-8E3HhHqNuw4YKLiuQJZ2 Content-Type: multipart/mixed; boundary="=-5omvU5Z5LlhuAjMn5Elp" --=-5omvU5Z5LlhuAjMn5Elp Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hey. (GNU coreutils 8.23) Attached is a file, that, when sort -u'ed in my locale, looses lines which are however unique. I've also attached the locale, since it's a custom made one, but the same seem to happen with "standard" locales as well, see e.g. https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=3D695489 Cheers, Chris. PS: Please keep me CCed, as I'm writing off list. --=-5omvU5Z5LlhuAjMn5Elp Content-Disposition: attachment; filename="test-file" Content-Type: text/plain; name="test-file"; charset="UTF-8" Content-Transfer-Encoding: base64 Li9kb2N1bWVudHMsIGltYWdlcywgc291bmRzLCBtb3ZpZXMvLkhTQS9fX3RvZG8vb2xkL1dlaeGz rkpQRUcKLi9kb2N1bWVudHMsIGltYWdlcywgc291bmRzLCBtb3ZpZXMvLkhTQS9fX3RvZG8vb2xk L1dlaeGyrkpQRUcKLi9kb2N1bWVudHMsIGltYWdlcywgc291bmRzLCBtb3ZpZXMvLkhTQS9fX3Rv ZG8vb2xkL1dlaeGuilBFRwouL3NvZnR3YXJlL2ltYWdlcy81LjI1L1RBTkRPTi9FaW5yaWNodHVu Z3Nwcm9ncmFtbWUg4oWgLjXCvC1pbmNoLURTLURELWZsb3BweS1kaXNrLWltYWdlCi4vc29mdHdh cmUvaW1hZ2VzLzUuMjUvVEFORE9OL0VpbnJpY2h0dW5nc3Byb2dyYW1tZSDihaEuNcK8LWluY2gt RFMtREQtZmxvcHB5LWRpc2staW1hZ2UKLi9zb2Z0d2FyZS9pbWFnZXMvNS4yNS9UQU5ET04vRWlu cmljaHR1bmdzcHJvZ3JhbW1lIOKFoC41wrwtaW5jaC1EUy1ERC1mbG9wcHktZGlzay1pbWFnZS5k ZC1sb2cKLi9zb2Z0d2FyZS9pbWFnZXMvNS4yNS9UQU5ET04vRWlucmljaHR1bmdzcHJvZ3JhbW1l IOKFoS41wrwtaW5jaC1EUy1ERC1mbG9wcHktZGlzay1pbWFnZS5nZGRyZXNjdWUtbG9nCi4vc29m dHdhcmUvaW1hZ2VzLzUuMjUvVEFORE9OL0VpbnJpY2h0dW5nc3Byb2dyYW1tZSDihaEuNcK8LWlu Y2gtRFMtREQtZmxvcHB5LWRpc2staW1hZ2Uua2Vybi5sb2cK --=-5omvU5Z5LlhuAjMn5Elp Content-Disposition: attachment; filename="test-file.unique-sorted" Content-Type: text/plain; name="test-file.unique-sorted"; charset="UTF-8" Content-Transfer-Encoding: base64 Li9kb2N1bWVudHMsIGltYWdlcywgc291bmRzLCBtb3ZpZXMvLkhTQS9fX3RvZG8vb2xkL1dlaeGz rkpQRUcKLi9kb2N1bWVudHMsIGltYWdlcywgc291bmRzLCBtb3ZpZXMvLkhTQS9fX3RvZG8vb2xk L1dlaeGuilBFRwouL3NvZnR3YXJlL2ltYWdlcy81LjI1L1RBTkRPTi9FaW5yaWNodHVuZ3Nwcm9n cmFtbWUg4oWgLjXCvC1pbmNoLURTLURELWZsb3BweS1kaXNrLWltYWdlCi4vc29mdHdhcmUvaW1h Z2VzLzUuMjUvVEFORE9OL0VpbnJpY2h0dW5nc3Byb2dyYW1tZSDihaAuNcK8LWluY2gtRFMtREQt ZmxvcHB5LWRpc2staW1hZ2UuZGQtbG9nCi4vc29mdHdhcmUvaW1hZ2VzLzUuMjUvVEFORE9OL0Vp bnJpY2h0dW5nc3Byb2dyYW1tZSDihaEuNcK8LWluY2gtRFMtREQtZmxvcHB5LWRpc2staW1hZ2Uu Z2RkcmVzY3VlLWxvZwouL3NvZnR3YXJlL2ltYWdlcy81LjI1L1RBTkRPTi9FaW5yaWNodHVuZ3Nw cm9ncmFtbWUg4oWhLjXCvC1pbmNoLURTLURELWZsb3BweS1kaXNrLWltYWdlLmtlcm4ubG9nCg== --=-5omvU5Z5LlhuAjMn5Elp Content-Disposition: attachment; filename="en_DE" Content-Type: text/plain; name="en_DE"; charset="UTF-8" Content-Transfer-Encoding: base64 ZXNjYXBlX2NoYXIgLwpjb21tZW50X2NoYXIgJQoKCkxDX0lERU5USUZJQ0FUSU9OCnRpdGxlCQkJ InNjaWVudGlhLm5ldCBkZWZhdWx0IGxvY2FsZSIKc291cmNlCQkJInNjaWVudGlhLm5ldCIKY29u dGFjdAkJCSJDaHJpc3RvcGggQW50b24gTWl0dGVyZXIiCmVtYWlsCQkJImNhbGVzdHlvQHNjaWVu dGlhLm5ldCIKbGFuZ3VhZ2UJCSJlbmciCnRlcnJpdG9yeQkJIkRFIgpyZXZpc2lvbgkJIjIuMCIK ZGF0ZQkJCSIyMDA4LTAyLTEwIgpjYXRlZ29yeQkJImVuX0RFOjIwMDAiO0xDX0lERU5USUZJQ0FU SU9OCmNhdGVnb3J5CQkiZW5fREU6MjAwMCI7TENfQ1RZUEUKY2F0ZWdvcnkJCSJlbl9ERToyMDAw IjtMQ19DT0xMQVRFCmNhdGVnb3J5CQkiZW5fREU6MjAwMCI7TENfVElNRQpjYXRlZ29yeQkJImVu X0RFOjIwMDAiO0xDX05VTUVSSUMKY2F0ZWdvcnkJCSJlbl9ERToyMDAwIjtMQ19NT05FVEFSWQpj YXRlZ29yeQkJImVuX0RFOjIwMDAiO0xDX01FU1NBR0VTCmNhdGVnb3J5CQkiZW5fREU6MjAwMCI7 TENfUEFQRVIKY2F0ZWdvcnkJCSJlbl9ERToyMDAwIjtMQ19OQU1FCmNhdGVnb3J5CQkiZW5fREU6 MjAwMCI7TENfQUREUkVTUwpjYXRlZ29yeQkJImVuX0RFOjIwMDAiO0xDX1RFTEVQSE9ORQpFTkQg TENfSURFTlRJRklDQVRJT04KCkxDX0NUWVBFCmNvcHkJCQkiaTE4biIKRU5EIExDX0NUWVBFCgpM Q19DT0xMQVRFCiVjb3B5CQkJImkxOG4iCmNvcHkJCQkiaXNvMTQ2NTFfdDEiCkVORCBMQ19DT0xM QVRFCgpMQ19NT05FVEFSWQppbnRfY3Vycl9zeW1ib2wJCSI8VTAwNDU+PFUwMDU1PjxVMDA1Mj48 VTAwMjA+IgpjdXJyZW5jeV9zeW1ib2wJCSI8VTIwQUM+Igptb25fZGVjaW1hbF9wb2ludAkiPFUw MDJDPiIKbW9uX3Rob3VzYW5kc19zZXAJIjxVMDAyRT4iCm1vbl9ncm91cGluZwkJMzszCnBvc2l0 aXZlX3NpZ24JCSIiCm5lZ2F0aXZlX3NpZ24JCSI8VTAwMkQ+IgppbnRfZnJhY19kaWdpdHMJCTIK ZnJhY19kaWdpdHMJCTIKcF9jc19wcmVjZWRlcwkJMQpwX3NlcF9ieV9zcGFjZQkJMQpuX2NzX3By ZWNlZGVzCQkxCm5fc2VwX2J5X3NwYWNlCQkxCnBfc2lnbl9wb3NuCQkxCm5fc2lnbl9wb3NuCQkx CkVORCBMQ19NT05FVEFSWQoKTENfTlVNRVJJQwpjb3B5CQkJImkxOG4iCkVORCBMQ19OVU1FUklD CgpMQ19USU1FCmFiZGF5CQkJIjxVMDA1Mz48VTAwNzU+PFUwMDZFPiI7IjxVMDA0RD48VTAwNkY+ PFUwMDZFPiI7IjxVMDA1ND48VTAwNzU+PFUwMDY1PiI7IjxVMDA1Nz48VTAwNjU+PFUwMDY0PiI7 IjxVMDA1ND48VTAwNjg+PFUwMDc1PiI7IjxVMDA0Nj48VTAwNzI+PFUwMDY5PiI7IjxVMDA1Mz48 VTAwNjE+PFUwMDc0PiIKZGF5CQkJIjxVMDA1Mz48VTAwNzU+PFUwMDZFPjxVMDA2ND48VTAwNjE+ PFUwMDc5PiI7IjxVMDA0RD48VTAwNkY+PFUwMDZFPjxVMDA2ND48VTAwNjE+PFUwMDc5PiI7IjxV MDA1ND48VTAwNzU+PFUwMDY1PjxVMDA3Mz48VTAwNjQ+PFUwMDYxPjxVMDA3OT4iOyI8VTAwNTc+ PFUwMDY1PjxVMDA2ND48VTAwNkU+PFUwMDY1PjxVMDA3Mz48VTAwNjQ+PFUwMDYxPjxVMDA3OT4i OyI8VTAwNTQ+PFUwMDY4PjxVMDA3NT48VTAwNzI+PFUwMDczPjxVMDA2ND48VTAwNjE+PFUwMDc5 PiI7IjxVMDA0Nj48VTAwNzI+PFUwMDY5PjxVMDA2ND48VTAwNjE+PFUwMDc5PiI7IjxVMDA1Mz48 VTAwNjE+PFUwMDc0PjxVMDA3NT48VTAwNzI+PFUwMDY0PjxVMDA2MT48VTAwNzk+Igp3ZWVrCQkJ NzsxOTk3MTIwMTs0CmFibW9uCQkJIjxVMDA0QT48VTAwNjE+PFUwMDZFPiI7IjxVMDA0Nj48VTAw NjU+PFUwMDYyPiI7IjxVMDA0RD48VTAwNjE+PFUwMDcyPiI7IjxVMDA0MT48VTAwNzA+PFUwMDcy PiI7IjxVMDA0RD48VTAwNjE+PFUwMDc5PiI7IjxVMDA0QT48VTAwNzU+PFUwMDZFPiI7IjxVMDA0 QT48VTAwNzU+PFUwMDZDPiI7IjxVMDA0MT48VTAwNzU+PFUwMDY3PiI7IjxVMDA1Mz48VTAwNjU+ PFUwMDcwPiI7IjxVMDA0Rj48VTAwNjM+PFUwMDc0PiI7IjxVMDA0RT48VTAwNkY+PFUwMDc2PiI7 IjxVMDA0ND48VTAwNjU+PFUwMDYzPiIKbW9uCQkJIjxVMDA0QT48VTAwNjE+PFUwMDZFPjxVMDA3 NT48VTAwNjE+PFUwMDcyPjxVMDA3OT4iOyI8VTAwNDY+PFUwMDY1PjxVMDA2Mj48VTAwNzI+PFUw MDc1PjxVMDA2MT48VTAwNzI+PFUwMDc5PiI7IjxVMDA0RD48VTAwNjE+PFUwMDcyPjxVMDA2Mz48 VTAwNjg+IjsiPFUwMDQxPjxVMDA3MD48VTAwNzI+PFUwMDY5PjxVMDA2Qz4iOyI8VTAwNEQ+PFUw MDYxPjxVMDA3OT4iOyI8VTAwNEE+PFUwMDc1PjxVMDA2RT48VTAwNjU+IjsiPFUwMDRBPjxVMDA3 NT48VTAwNkM+PFUwMDc5PiI7IjxVMDA0MT48VTAwNzU+PFUwMDY3PjxVMDA3NT48VTAwNzM+PFUw MDc0PiI7IjxVMDA1Mz48VTAwNjU+PFUwMDcwPjxVMDA3ND48VTAwNjU+PFUwMDZEPjxVMDA2Mj48 VTAwNjU+PFUwMDcyPiI7IjxVMDA0Rj48VTAwNjM+PFUwMDc0PjxVMDA2Rj48VTAwNjI+PFUwMDY1 PjxVMDA3Mj4iOyI8VTAwNEU+PFUwMDZGPjxVMDA3Nj48VTAwNjU+PFUwMDZEPjxVMDA2Mj48VTAw NjU+PFUwMDcyPiI7IjxVMDA0ND48VTAwNjU+PFUwMDYzPjxVMDA2NT48VTAwNkQ+PFUwMDYyPjxV MDA2NT48VTAwNzI+IgphbV9wbQkJCSIiOyIiCmRfdF9mbXQJCQkiPFUwMDI1PjxVMDA0Nj48VTAw MjA+PFUwMDI1PjxVMDA1ND4iCmRfZm10CQkJIjxVMDAyNT48VTAwNDY+Igp0X2ZtdAkJCSI8VTAw MjU+PFUwMDU0PiIKdF9mbXRfYW1wbQkJIiIKZGF0ZV9mbXQJCSI8VTAwMjU+PFUwMDYxPjxVMDAy MD48VTAwMjU+PFUwMDYyPjxVMDAyMD48VTAwMjU+PFUwMDY1PjxVMDAyMD48VTAwMjU+PFUwMDQ4 PjxVMDAzQT48VTAwMjU+PFUwMDREPjxVMDAzQT48VTAwMjU+PFUwMDUzPjxVMDAyMD48VTAwMjU+ PFUwMDVBPjxVMDAyMD48VTAwMjU+PFUwMDU5PiIKRU5EIExDX1RJTUUKCkxDX01FU1NBR0VTCnll c2V4cHIJCQkiPFUwMDc5PjxVMDA3Qz48VTAwNTk+PFUwMDdDPjxVMDA3OT48VTAwNjU+PFUwMDcz PjxVMDA3Qz48VTAwNTk+PFUwMDQ1PjxVMDA1Mz48VTAwN0M+PFUwMDU5PjxVMDA2NT48VTAwNzM+ Igpub2V4cHIJCQkiPFUwMDZFPjxVMDA3Qz48VTAwNEU+PFUwMDdDPjxVMDA2RT48VTAwNkY+PFUw MDdDPjxVMDA0RT48VTAwNEY+PFUwMDdDPjxVMDA0RT48VTAwNkY+IgpFTkQgTENfTUVTU0FHRVMK CkxDX1BBUEVSCmNvcHkJCQkiaTE4biIKRU5EIExDX1BBUEVSCgpMQ19OQU1FCm5hbWVfZm10CQki PFUwMDI1PjxVMDA3Mz48VTAwMjU+PFUwMDc0PjxVMDAyNT48VTAwNjc+PFUwMDI1PjxVMDA3ND48 VTAwMjU+PFUwMDZEPjxVMDAyNT48VTAwNzQ+PFUwMDI1PjxVMDA2Nj4iCm5hbWVfbWlzcwkJIjxV MDA0RD48VTAwNjk+PFUwMDczPjxVMDA3Mz48VTAwMkU+IgpuYW1lX21yCQkJIjxVMDA0RD48VTAw NzI+PFUwMDJFPiIKbmFtZV9tcnMJCSI8VTAwNEQ+PFUwMDcyPjxVMDA3Mz48VTAwMkU+IgpuYW1l X21zCQkJIjxVMDA0RD48VTAwNzM+PFUwMDJFPiIKRU5EIExDX05BTUUKCkxDX0FERFJFU1MKcG9z dGFsX2ZtdAkJIjxVMDAyNT48VTAwNjY+PFUwMDI1PjxVMDA0RT48VTAwMjU+PFUwMDYxPjxVMDAy NT48VTAwNEU+PFUwMDI1PjxVMDA2ND48VTAwMjU+PFUwMDRFPjxVMDAyNT48VTAwNjI+PFUwMDI1 PjxVMDA0RT48VTAwMjU+PFUwMDczPjxVMDAyMD48VTAwMjU+PFUwMDY4PjxVMDAyMD48VTAwMjU+ PFUwMDY1PjxVMDAyMD48VTAwMjU+PFUwMDcyPjxVMDAyNT48VTAwNEU+PFUwMDI1PjxVMDA3QT48 VTAwMjU+PFUwMDc0PjxVMDAyNT48VTAwNTQ+PFUwMDI1PjxVMDA0RT48VTAwMjU+PFUwMDUzPjxV MDAyNT48VTAwNEU+PFUwMDI1PjxVMDA2Mz48VTAwMjU+PFUwMDRFPiIKY291bnRyeV9uYW1lCQki PFUwMDQ2PjxVMDA2NT48VTAwNjQ+PFUwMDY1PjxVMDA3Mj48VTAwNjE+PFUwMDZDPjxVMDAyMD48 VTAwNTI+PFUwMDY1PjxVMDA3MD48VTAwNzU+PFUwMDYyPjxVMDA2Qz48VTAwNjk+PFUwMDYzPjxV MDAyMD48VTAwNkY+PFUwMDY2PjxVMDAyMD48VTAwNDc+PFUwMDY1PjxVMDA3Mj48VTAwNkQ+PFUw MDYxPjxVMDA2RT48VTAwNzk+Igpjb3VudHJ5X3Bvc3QJCSI8VTAwNDQ+PFUwMDQ1PiIKY291bnRy eV9hYjIJCSI8VTAwNDQ+PFUwMDQ1PiIKY291bnRyeV9hYjMJCSI8VTAwNDQ+PFUwMDQ1PjxVMDA1 NT4iCmNvdW50cnlfbnVtCQkyNzYKY291bnRyeV9jYXIJCSI8VTAwNDQ+Igpjb3VudHJ5X2lzYm4J CTMKbGFuZ19uYW1lCQkiPFUwMDQ3PjxVMDA2NT48VTAwNzI+PFUwMDZEPjxVMDA2MT48VTAwNkU+ IgpsYW5nX2FiCQkJIjxVMDA2ND48VTAwNjU+IgpsYW5nX3Rlcm0JCSI8VTAwNjQ+PFUwMDY1PjxV MDA3NT4iCmxhbmdfbGliCQkiPFUwMDY3PjxVMDA2NT48VTAwNzI+IgpFTkQgTENfQUREUkVTUwoK TENfVEVMRVBIT05FCnRlbF9pbnRfZm10CQkiPFUwMDJCPjxVMDAyNT48VTAwNjM+PFUwMDIwPjxV MDAyQj48VTAwNjE+PFUwMDIwPjxVMDAyQj48VTAwNkM+Igp0ZWxfZG9tX2ZtdAkJIjxVMDAyNT48 VTAwNDE+PFUwMDIwPjxVMDAyNT48VTAwNkM+IgppbnRfc2VsZWN0CQkiPFUwMDMwPjxVMDAzMD4i CmludF9wcmVmaXgJCSI8VTAwMzQ+PFUwMDM5PiIKRU5EIExDX1RFTEVQSE9ORQoKTENfTUVBU1VS RU1FTlQKY29weQkJCSJpMThuIgpFTkQgTENfTUVBU1VSRU1FTlQK --=-5omvU5Z5LlhuAjMn5Elp-- --=-8E3HhHqNuw4YKLiuQJZ2 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCCEZIw ggW/MIIDp6ADAgECAgMCOakwDQYJKoZIhvcNAQENBQAwVDEUMBIGA1UEChMLQ0FjZXJ0IEluYy4x HjAcBgNVBAsTFWh0dHA6Ly93d3cuQ0FjZXJ0Lm9yZzEcMBoGA1UEAxMTQ0FjZXJ0IENsYXNzIDMg Um9vdDAeFw0xNDA2MTIxNjM2MThaFw0xNjA2MTExNjM2MThaMHwxITAfBgNVBAMTGENocmlzdG9w aCBBbnRvbiBNaXR0ZXJlcjEkMCIGCSqGSIb3DQEJARYVY2FsZXN0eW9Ac2NpZW50aWEubmV0MTEw LwYJKoZIhvcNAQkBFiJtYWlsQGNocmlzdG9waC5hbnRvbi5taXR0ZXJlci5uYW1lMIIBIjANBgkq hkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA4phP/j9vT9dZT+k3ffHxvRWMOuzBnu5O3Fl4y2+WL7pL rfLiEhWzGXhHvjSqpt4vCNSdqy43453nnu8+hMb+uEtqSIL1AHU5eLhuDNVN9S4bt9E7nA2WKYBU LCUi/xCD/GL7ToyJNwhrhzcCZ7pXSc3xVqFoC4f6weU9ExhoEZQNRpTM0BFCOi4fRxvKFNnUYgjK hqy0Ta5H0Xx86mAp0Q4dxoD7mhI5iTF6TRkUheELxF24JCuAf04M89Cwft6DRH1FpJ3yvgW2B5U5 aFSL4ZnF4N/wyCB7Dkm1rQ7RCAvw5btkf0VdPnU7ccDCx8HEc2nxK/lbCjrznvh3sa1CCwIDAQAB o4IBcDCCAWwwDAYDVR0TAQH/BAIwADBWBglghkgBhvhCAQ0ESRZHVG8gZ2V0IHlvdXIgb3duIGNl cnRpZmljYXRlIGZvciBGUkVFIGhlYWQgb3ZlciB0byBodHRwOi8vd3d3LkNBY2VydC5vcmcwDgYD VR0PAQH/BAQDAgOoMEAGA1UdJQQ5MDcGCCsGAQUFBwMEBggrBgEFBQcDAgYKKwYBBAGCNwoDBAYK KwYBBAGCNwoDAwYJYIZIAYb4QgQBMDIGCCsGAQUFBwEBBCYwJDAiBggrBgEFBQcwAYYWaHR0cDov L29jc3AuY2FjZXJ0Lm9yZzA4BgNVHR8EMTAvMC2gK6AphidodHRwOi8vY3JsLmNhY2VydC5vcmcv Y2xhc3MzLXJldm9rZS5jcmwwRAYDVR0RBD0wO4EVY2FsZXN0eW9Ac2NpZW50aWEubmV0gSJtYWls QGNocmlzdG9waC5hbnRvbi5taXR0ZXJlci5uYW1lMA0GCSqGSIb3DQEBDQUAA4ICAQBefctiLgGl e5baspuozyA4k7Up7SVhGHbif6pQfoFc/9Thx9GXnYpX+U64PMyWBfWwHZIy52Vg0RVkvPi1t6mi GyBfoSpC6ooR0bKWtUIogw/ymqKWlTLVR8kbLqRmRk4juMtCXG2K3yMygX/rjkuUSuFj2Bjpkmzg CtMojbUMYbszePmhQ7DJ62YEdtKpcjN94QAsI5GWlIAbs3KJazAcaNCRJeXCLcUMchyKHJA+NXH5 az/ekBxBMBzJP2An20PP88UI4JW18z31KiG9UVGa2uO4l4aWgVe2GnhNEdCD/o48msJEWKAt5vl2 yMqr7ihmNPocU2+/FW0xPe/vftdOTD9pgXdSGf4prdD+23q2YvpalOCzr2p8yCJZNVBPMxAP4mL0 3OEktXza4wohqAmceXKfGUNwRGBaPvtIGnPrpLhCQ+2YJDg8g1UEsk23bKyZlJWeKJyVqOBsDJmj aBsN/qKhQFnav+zQdqGhMeaSisF/53mD3gyVYg2JRl18apgGbg32kyLmomqa0JbhnY3Dc3FVtZfe +P+s2Cyep3pVKvFer2llRoGm8TwraG5Yhyx8Oq/1qETpstjbURJOVBLDCV4AjOEUj0ZnE/tEo/DK yexgGaViNvjp+IZdFdJhYmsVjw4Q3vG7O0pfsLiYEyQjeDgjNEWDfa5/MufPywIfxzCCBb8wggOn oAMCAQICAwI5qTANBgkqhkiG9w0BAQ0FADBUMRQwEgYDVQQKEwtDQWNlcnQgSW5jLjEeMBwGA1UE CxMVaHR0cDovL3d3dy5DQWNlcnQub3JnMRwwGgYDVQQDExNDQWNlcnQgQ2xhc3MgMyBSb290MB4X DTE0MDYxMjE2MzYxOFoXDTE2MDYxMTE2MzYxOFowfDEhMB8GA1UEAxMYQ2hyaXN0b3BoIEFudG9u IE1pdHRlcmVyMSQwIgYJKoZIhvcNAQkBFhVjYWxlc3R5b0BzY2llbnRpYS5uZXQxMTAvBgkqhkiG 9w0BCQEWIm1haWxAY2hyaXN0b3BoLmFudG9uLm1pdHRlcmVyLm5hbWUwggEiMA0GCSqGSIb3DQEB AQUAA4IBDwAwggEKAoIBAQDimE/+P29P11lP6Td98fG9FYw67MGe7k7cWXjLb5Yvukut8uISFbMZ eEe+NKqm3i8I1J2rLjfjneee7z6Exv64S2pIgvUAdTl4uG4M1U31Lhu30TucDZYpgFQsJSL/EIP8 YvtOjIk3CGuHNwJnuldJzfFWoWgLh/rB5T0TGGgRlA1GlMzQEUI6Lh9HG8oU2dRiCMqGrLRNrkfR fHzqYCnRDh3GgPuaEjmJMXpNGRSF4QvEXbgkK4B/Tgzz0LB+3oNEfUWknfK+BbYHlTloVIvhmcXg 3/DIIHsOSbWtDtEIC/Dlu2R/RV0+dTtxwMLHwcRzafEr+VsKOvOe+HexrUILAgMBAAGjggFwMIIB bDAMBgNVHRMBAf8EAjAAMFYGCWCGSAGG+EIBDQRJFkdUbyBnZXQgeW91ciBvd24gY2VydGlmaWNh dGUgZm9yIEZSRUUgaGVhZCBvdmVyIHRvIGh0dHA6Ly93d3cuQ0FjZXJ0Lm9yZzAOBgNVHQ8BAf8E BAMCA6gwQAYDVR0lBDkwNwYIKwYBBQUHAwQGCCsGAQUFBwMCBgorBgEEAYI3CgMEBgorBgEEAYI3 CgMDBglghkgBhvhCBAEwMgYIKwYBBQUHAQEEJjAkMCIGCCsGAQUFBzABhhZodHRwOi8vb2NzcC5j YWNlcnQub3JnMDgGA1UdHwQxMC8wLaAroCmGJ2h0dHA6Ly9jcmwuY2FjZXJ0Lm9yZy9jbGFzczMt cmV2b2tlLmNybDBEBgNVHREEPTA7gRVjYWxlc3R5b0BzY2llbnRpYS5uZXSBIm1haWxAY2hyaXN0 b3BoLmFudG9uLm1pdHRlcmVyLm5hbWUwDQYJKoZIhvcNAQENBQADggIBAF59y2IuAaV7ltqym6jP IDiTtSntJWEYduJ/qlB+gVz/1OHH0Zedilf5Trg8zJYF9bAdkjLnZWDRFWS8+LW3qaIbIF+hKkLq ihHRspa1QiiDD/KaopaVMtVHyRsupGZGTiO4y0JcbYrfIzKBf+uOS5RK4WPYGOmSbOAK0yiNtQxh uzN4+aFDsMnrZgR20qlyM33hACwjkZaUgBuzcolrMBxo0JEl5cItxQxyHIockD41cflrP96QHEEw HMk/YCfbQ8/zxQjglbXzPfUqIb1RUZra47iXhpaBV7YaeE0R0IP+jjyawkRYoC3m+XbIyqvuKGY0 +hxTb78VbTE97+9+105MP2mBd1IZ/imt0P7berZi+lqU4LOvanzIIlk1UE8zEA/iYvTc4SS1fNrj CiGoCZx5cp8ZQ3BEYFo++0gac+ukuEJD7ZgkODyDVQSyTbdsrJmUlZ4onJWo4GwMmaNoGw3+oqFA Wdq/7NB2oaEx5pKKwX/neYPeDJViDYlGXXxqmAZuDfaTIuaiaprQluGdjcNzcVW1l974/6zYLJ6n elUq8V6vaWVGgabxPCtobliHLHw6r/WoROmy2NtREk5UEsMJXgCM4RSPRmcT+0Sj8MrJ7GAZpWI2 +On4hl0V0mFiaxWPDhDe8bs7Sl+wuJgTJCN4OCM0RYN9rn8y58/LAh/HMIIGCDCCA/CgAwIBAgIB ATANBgkqhkiG9w0BAQQFADB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVodHRwOi8vd3d3 LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3JpdHkxITAfBgkqhkiG 9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZzAeFw0wNTEwMTQwNzM2NTVaFw0zMzAzMjgwNzM2NTVa MFQxFDASBgNVBAoTC0NBY2VydCBJbmMuMR4wHAYDVQQLExVodHRwOi8vd3d3LkNBY2VydC5vcmcx HDAaBgNVBAMTE0NBY2VydCBDbGFzcyAzIFJvb3QwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQCrSTURSHzSJn5TlM9Dqd0o10Iqi/OHeBlYfA+e2ol94fvrcpANdKGWZKufoCSZc9riVXbH F3v1BKxGuMO+f2SNEGwk82GcwPKQ+lHm9WkBY8MPVuJKQs/iRIwlKKjFeQl9RrmK8+nzNCkIReQc n8uUBByBqBSzmGXEQ+xOgo0J0b2qW42S0OzekMV/CsLj6+YxWl50PpczWejDAz1gM7/30W9HxM3u YoNSbi4ImqTZFRiRpoWSR7CuSOtttyHshRpocjWr//AQXcD0lKdq1TuSfkyQBX6TwSyLpI5idBVx bgtxA+qvFTia1NIFcm+M+SvrWnIl+TlG43IbPgTDZCciECqKT1inA62+tC4T7V2qSNfVfdQqe1z6 RgRQ5MwOQluM7dvyz/yWk+DbETZUYjQ4jwxgmzuXVjit89Jbi6Bb6k6WuHzX1aCGcEDTkSm3ojyt 9Yy7zxqSiuQ0e8DYbF/pCsLDpyCaWt8sXVJcukfVm+8kKHA4IC/VfynAskEDaJLM4JzMl0tF7zoQ CqtwOpiVcK01seqFK6QcgCExqa5geoAmSAC4AcCTY1UikTxW56/bOiXzjzFU6iaLgVn5odFTEcV7 nQP2dBHgbbEsPyyGkZlxmqZ3izRg0RS0LKydr4wQ05/EavhvE/xzWfdmQnQeiuP43NJvmJzLR5iV QAX76QIDAQABo4G/MIG8MA8GA1UdEwEB/wQFMAMBAf8wXQYIKwYBBQUHAQEEUTBPMCMGCCsGAQUF BzABhhdodHRwOi8vb2NzcC5DQWNlcnQub3JnLzAoBggrBgEFBQcwAoYcaHR0cDovL3d3dy5DQWNl cnQub3JnL2NhLmNydDBKBgNVHSAEQzBBMD8GCCsGAQQBgZBKMDMwMQYIKwYBBQUHAgEWJWh0dHA6 Ly93d3cuQ0FjZXJ0Lm9yZy9pbmRleC5waHA/aWQ9MTAwDQYJKoZIhvcNAQEEBQADggIBAH8IiKHa GlBJ2on7oQhy84r3HsQ6tHlbIDCxRd7CXdNlafHCXVRUPIVfuXtCkcKZ/RtRm6tGpaEQU55tiKxz biwzpvD0nuB1wT6IRanhZkP+VlrRekF490DaSjrxC1uluxYG5sLnk7mFTZdPsR44Q4Dvmw2M77in YACHV30eRBzLI++bPJmdr7UpHEV5FpZNJ23xHGzDwlVks7wU4vOkHx4y/CcVBc/dLq4+gmF78CEQ GPZE6lM5+dzQmiDgxrvgu1pPxJnIB721vaLbLmINQjRBvP+LivVRIqqIMADisNS8vmW61QNXeZvo 3MhN+FDtkaVSKKKs+zZYPumUK5FQhxvWXtaMzPcPEAxSTtAWYeXlCmy/F8dyRlecmPVsYGN6b165 Ti/Iubm7aoW8mA3t+T6XhDSUrgCvoeXnkm5OvfPi2RSLXNLrAWygF6UtEOucekq9ve7O/e0iQKtw OIj1CodqwqsFYMlIBdpTwd5Ed2qz8zw87YC8pjhKKSRf/lk7myV6VmMAZLldpGJ9VzZPrYPvH5JT oI53V93lYRE9IwCQTDz6o2CTBKOvNfYOao9PSmCnhQVsRqGP9Md246FZV/dxssRuFFxtbUFm3xuT sdQAw+7Lzzw9IYCpX2Nl/N3gX6T0K/CFcUHUZyX7GrGXrtaZghNB0m6lG5kngOcLqagAMYIC7TCC AukCAQEwWzBUMRQwEgYDVQQKEwtDQWNlcnQgSW5jLjEeMBwGA1UECxMVaHR0cDovL3d3dy5DQWNl cnQub3JnMRwwGgYDVQQDExNDQWNlcnQgQ2xhc3MgMyBSb290AgMCOakwDQYJYIZIAWUDBAIDBQCg ggFjMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE1MTExNDA1Mzgx MVowTwYJKoZIhvcNAQkEMUIEQMgBWDOwNh+4eWU7CStAcByXVwZO+do1TDZmF0s+NKrgeQs9ifq1 v6/mtU+0mSY7Z56HoaXj04MQG5Oy47eHSigwagYJKwYBBAGCNxAEMV0wWzBUMRQwEgYDVQQKEwtD QWNlcnQgSW5jLjEeMBwGA1UECxMVaHR0cDovL3d3dy5DQWNlcnQub3JnMRwwGgYDVQQDExNDQWNl cnQgQ2xhc3MgMyBSb290AgMCOakwbAYLKoZIhvcNAQkQAgsxXaBbMFQxFDASBgNVBAoTC0NBY2Vy dCBJbmMuMR4wHAYDVQQLExVodHRwOi8vd3d3LkNBY2VydC5vcmcxHDAaBgNVBAMTE0NBY2VydCBD bGFzcyAzIFJvb3QCAwI5qTANBgkqhkiG9w0BAQEFAASCAQDHzbmBCXx06QSzSyY9+Q3c2bsCCVY9 QU0d/SLLHf1tLBdBUmBO545sp86+YpIf/yvN0Zje82OLai7XNUDHwElickvn8aE5usfi+UOU0UZC +9LLJp4ua73AGLzlP3aqdQhjMYEFcj8+AkAP+qTJLTS8y3SmCtpkqC8m2nmuuLSXjNkOkX3OJ3bY wnunVPXhtJlrzU9YhB2LrYUf3NDuMum+iYldRw9xlPAsqJs6nsBmN6ykVOvq7/8RbT3LCXUvRQyd 6GvdPEFxi78F6lg7fl3QrTyXH3vPJo34b43Xr2IK3XxnYKfjyocyT9mH3CJ1DS5jWiGdD1h1qOiK XM6udIVYAAAAAAAA --=-8E3HhHqNuw4YKLiuQJZ2-- From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 06:06:27 2015 Received: (at 21916) by debbugs.gnu.org; 14 Nov 2015 11:06:27 +0000 Received: from localhost ([127.0.0.1]:37679 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxYf5-0001Z1-2n for submit@debbugs.gnu.org; Sat, 14 Nov 2015 06:06:27 -0500 Received: from mail1.vodafone.ie ([213.233.128.43]:20111) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxYf2-0001Ys-AE for 21916@debbugs.gnu.org; Sat, 14 Nov 2015 06:06:25 -0500 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AkALAIQUR1ZtT9EC/2dsb2JhbABdKAOCPlJTb8A8I4VjCgKBN0wBAQEBAQGBC4Q1AQEEEhEECwFWCQINCwICBRYLAgIJAwIBAgFFBgEMCAEBHogQAQiSKJMKiiuFbYpJAQEBBwEBAQEbBIEBhFiFeYQ0g0GBRAWWSIUdiWWEQIMZjx+DcmOEBD40AYQAgUoBAQE Received: from unknown (HELO localhost.localdomain) ([109.79.209.2]) by mail1.vodafone.ie with ESMTP; 14 Nov 2015 11:06:22 +0000 Subject: Re: bug#21916: sort -u drops unique lines with some locales To: Christoph Anton Mitterer , 21916@debbugs.gnu.org References: <1447479491.18813.0.camel@scientia.net> From: =?UTF-8?Q?P=c3=a1draig_Brady?= X-Enigmail-Draft-Status: N1110 Message-ID: <564715AE.6050205@draigBrady.com> Date: Sat, 14 Nov 2015 11:06:22 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: <1447479491.18813.0.camel@scientia.net> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 21916 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) tag 21916 notabug close 21916 stop On 14/11/15 05:38, Christoph Anton Mitterer wrote: > Hey. > > (GNU coreutils 8.23) > > Attached is a file, that, when sort -u'ed in my locale, looses lines > which are however unique. > > I've also attached the locale, since it's a custom made one, but the > same seem to happen with "standard" locales as well, see e.g. > https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=695489 > > Cheers, > Chris. > > PS: Please keep me CCed, as I'm writing off list. Unfortunately the roman numeral code points compare equal: $ printf '%s\n' Ⅱ Ⅰ | ltrace -e strcoll sort sort->strcoll("\342\205\241", "\342\205\240") = 0 Ⅱ Ⅰ If you compare at the byte level you'll get appropriate grouping: $ printf '%s\n' Ⅱ Ⅰ | LC_ALL=C sort Ⅰ Ⅱ The same goes for other similar representations, like full width forms of latin numbers: $ printf '%s\n' ２ １ | ltrace -e strcoll sort sort->strcoll("\357\274\222", "\357\274\221") = 0 ２ １ That's a bit surprising, though maybe since only a limited number of these representations are provided, it was not thought appropriate to provide collation orders for them. There are details on the unicode representation at: https://en.wikipedia.org/wiki/Numerals_in_Unicode#Roman_numerals_in_Unicode Where it says "[f]or most purposes, it is preferable to compose the Roman numerals from sequences of the appropriate Latin letters" For example you could mix ISO 8859-1 and ISO 8859-5 to get appropriate sorting: $ printf '%s\n' I II III IV V VI VII VIII ІХ Х ХI ХII ХIII ХIV ХV ХVI ХVII ХVIII ХІХ | sort I II III IV V VI VII VIII ІХ Х ХI ХII ХIII ХIV ХV ХVI ХVII ХVIII ХІХ If there were only portions of the line that was appropriate to treat in the C locale (not for your grouping case really, but generally for sorting for example), then you'd need to consider transformations like enclosed, fullwidth, halfwidth -> ASCII which might be done with a separate utility, and for number specific transformations like the above, handled within the numfmt utility? One thing we might do immediately, is maybe with the sort --debug option, to provide some indication when strcoll() and memcmp() differ in direction. cheers, Pádraig. From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 16:20:04 2015 Received: (at 21916) by debbugs.gnu.org; 14 Nov 2015 21:20:04 +0000 Received: from localhost ([127.0.0.1]:38291 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxiEs-0004sv-D2 for submit@debbugs.gnu.org; Sat, 14 Nov 2015 16:20:03 -0500 Received: from mailgw-01.dd24.net ([193.46.215.41]:34929) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxiEp-0004sR-JZ for 21916@debbugs.gnu.org; Sat, 14 Nov 2015 16:20:00 -0500 Received: from mailpolicy-01.live.igb.homer.key-systems.net (mailpolicy-01.live.igb.homer.key-systems.net [192.168.1.26]) by mailgw-01.dd24.net (Postfix) with ESMTP id BEC935FBCE; Sat, 14 Nov 2015 21:19:58 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at mailpolicy-01.live.igb.homer.key-systems.net Received: from mailgw-01.dd24.net ([192.168.1.35]) by mailpolicy-01.live.igb.homer.key-systems.net (mailpolicy-01.live.igb.homer.key-systems.net [192.168.1.25]) (amavisd-new, port 10235) with ESMTP id SXTDAPdmMUys; Sat, 14 Nov 2015 21:19:56 +0000 (UTC) Received: from heisenberg.scientia.net (p5B10016F.dip0.t-ipconnect.de [91.16.1.111]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mailgw-01.dd24.net (Postfix) with ESMTPSA; Sat, 14 Nov 2015 21:19:56 +0000 (UTC) Message-ID: <1447535995.20381.11.camel@scientia.net> Subject: Re: bug#21916: sort -u drops unique lines with some locales From: Christoph Anton Mitterer To: =?ISO-8859-1?Q?P=E1draig?= Brady , 21916@debbugs.gnu.org Date: Sat, 14 Nov 2015 22:19:55 +0100 In-Reply-To: <564715AE.6050205@draigBrady.com> References: <1447479491.18813.0.camel@scientia.net> <564715AE.6050205@draigBrady.com> Content-Type: multipart/signed; micalg="sha-512"; protocol="application/x-pkcs7-signature"; boundary="=-naZUiz/yZvOgW18fexp9" X-Mailer: Evolution 3.18.1-1 Mime-Version: 1.0 X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 21916 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) --=-naZUiz/yZvOgW18fexp9 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hey=C2=A0P=C3=A1draig On Sat, 2015-11-14 at 11:06 +0000, P=C3=A1draig Brady wrote: > Unfortunately the roman numeral code points compare equal: >=20 > =C2=A0 $ printf '%s\n' =E2=85=A1 =E2=85=A0 | ltrace -e strcoll sort > =C2=A0 sort->strcoll("\342\205\241", "\342\205\240") =3D 0 > =C2=A0 =E2=85=A1 > =C2=A0 =E2=85=A0 >=20 > If you compare at the byte level you'll get appropriate grouping: >=20 > =C2=A0 $ printf '%s\n' =E2=85=A1 =E2=85=A0 | LC_ALL=3DC sort > =C2=A0 =E2=85=A0 > =C2=A0 =E2=85=A1 >=20 > The same goes for other similar representations, > like full width forms of latin numbers: >=20 > =C2=A0 $ printf '%s\n' =EF=BC=92 =EF=BC=91 | ltrace -e strcoll sort > =C2=A0 sort->strcoll("\357\274\222", "\357\274\221") =3D 0 > =C2=A0 =EF=BC=92 > =C2=A0 =EF=BC=91 So the bug's basically in the locales? > That's a bit surprising, though maybe since only a limited > number of these representations are provided, it was > not thought appropriate to provide collation orders for them. Really strange... > One thing we might do immediately, is maybe with the sort --debug > option, > to provide some indication when strcoll() and memcmp() differ in > direction. Well I think the main problem here is that -u does then actually not what most people would expect from it. AFAIU, it removes any lines that *collation would consider as duplicate* ... and not any lines which *actually are duplicates*. God knows how many scripts and other stuff this already breaks... and I wonder whether any other tools may be badly affected by that collation stuff, too... Imagine you do a cp -a ... or diff -qr and these would leave out any of such files they consider duplicate :-( That could really result in data loss. Actually that's how I stumbled over it... I made some lists with find, of files which are then to be binary compared on a source and copy filesystem... over the find result I once used just sort and once sort -u and was quite shocked then. If I had taken the sort -u sorted list, then I might have lost some files to copy / compare. The semantics of -u are IMHO even more problematic, as it (AFAIU) won't happen with LANG=3DC. But normally people wouldn't expect that different locales lead to completely different behaviour, especially with respect to collation - they would only expect that things are ordered differently. Does it seems possible that sort -u spills out a warning on stderr, when such case occurs where -u drops lines, which are considered identical in terms of collation but which aren't really identical? Cheers, Chris. btw: Is that bugtracker somewhere accessible? Cause I'd like to update the Debian bug to having been forwarded to this one here. --=-naZUiz/yZvOgW18fexp9 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCCEZIw ggW/MIIDp6ADAgECAgMCOakwDQYJKoZIhvcNAQENBQAwVDEUMBIGA1UEChMLQ0FjZXJ0IEluYy4x HjAcBgNVBAsTFWh0dHA6Ly93d3cuQ0FjZXJ0Lm9yZzEcMBoGA1UEAxMTQ0FjZXJ0IENsYXNzIDMg Um9vdDAeFw0xNDA2MTIxNjM2MThaFw0xNjA2MTExNjM2MThaMHwxITAfBgNVBAMTGENocmlzdG9w aCBBbnRvbiBNaXR0ZXJlcjEkMCIGCSqGSIb3DQEJARYVY2FsZXN0eW9Ac2NpZW50aWEubmV0MTEw LwYJKoZIhvcNAQkBFiJtYWlsQGNocmlzdG9waC5hbnRvbi5taXR0ZXJlci5uYW1lMIIBIjANBgkq hkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA4phP/j9vT9dZT+k3ffHxvRWMOuzBnu5O3Fl4y2+WL7pL rfLiEhWzGXhHvjSqpt4vCNSdqy43453nnu8+hMb+uEtqSIL1AHU5eLhuDNVN9S4bt9E7nA2WKYBU LCUi/xCD/GL7ToyJNwhrhzcCZ7pXSc3xVqFoC4f6weU9ExhoEZQNRpTM0BFCOi4fRxvKFNnUYgjK hqy0Ta5H0Xx86mAp0Q4dxoD7mhI5iTF6TRkUheELxF24JCuAf04M89Cwft6DRH1FpJ3yvgW2B5U5 aFSL4ZnF4N/wyCB7Dkm1rQ7RCAvw5btkf0VdPnU7ccDCx8HEc2nxK/lbCjrznvh3sa1CCwIDAQAB o4IBcDCCAWwwDAYDVR0TAQH/BAIwADBWBglghkgBhvhCAQ0ESRZHVG8gZ2V0IHlvdXIgb3duIGNl cnRpZmljYXRlIGZvciBGUkVFIGhlYWQgb3ZlciB0byBodHRwOi8vd3d3LkNBY2VydC5vcmcwDgYD VR0PAQH/BAQDAgOoMEAGA1UdJQQ5MDcGCCsGAQUFBwMEBggrBgEFBQcDAgYKKwYBBAGCNwoDBAYK KwYBBAGCNwoDAwYJYIZIAYb4QgQBMDIGCCsGAQUFBwEBBCYwJDAiBggrBgEFBQcwAYYWaHR0cDov L29jc3AuY2FjZXJ0Lm9yZzA4BgNVHR8EMTAvMC2gK6AphidodHRwOi8vY3JsLmNhY2VydC5vcmcv Y2xhc3MzLXJldm9rZS5jcmwwRAYDVR0RBD0wO4EVY2FsZXN0eW9Ac2NpZW50aWEubmV0gSJtYWls QGNocmlzdG9waC5hbnRvbi5taXR0ZXJlci5uYW1lMA0GCSqGSIb3DQEBDQUAA4ICAQBefctiLgGl e5baspuozyA4k7Up7SVhGHbif6pQfoFc/9Thx9GXnYpX+U64PMyWBfWwHZIy52Vg0RVkvPi1t6mi GyBfoSpC6ooR0bKWtUIogw/ymqKWlTLVR8kbLqRmRk4juMtCXG2K3yMygX/rjkuUSuFj2Bjpkmzg CtMojbUMYbszePmhQ7DJ62YEdtKpcjN94QAsI5GWlIAbs3KJazAcaNCRJeXCLcUMchyKHJA+NXH5 az/ekBxBMBzJP2An20PP88UI4JW18z31KiG9UVGa2uO4l4aWgVe2GnhNEdCD/o48msJEWKAt5vl2 yMqr7ihmNPocU2+/FW0xPe/vftdOTD9pgXdSGf4prdD+23q2YvpalOCzr2p8yCJZNVBPMxAP4mL0 3OEktXza4wohqAmceXKfGUNwRGBaPvtIGnPrpLhCQ+2YJDg8g1UEsk23bKyZlJWeKJyVqOBsDJmj aBsN/qKhQFnav+zQdqGhMeaSisF/53mD3gyVYg2JRl18apgGbg32kyLmomqa0JbhnY3Dc3FVtZfe +P+s2Cyep3pVKvFer2llRoGm8TwraG5Yhyx8Oq/1qETpstjbURJOVBLDCV4AjOEUj0ZnE/tEo/DK yexgGaViNvjp+IZdFdJhYmsVjw4Q3vG7O0pfsLiYEyQjeDgjNEWDfa5/MufPywIfxzCCBb8wggOn oAMCAQICAwI5qTANBgkqhkiG9w0BAQ0FADBUMRQwEgYDVQQKEwtDQWNlcnQgSW5jLjEeMBwGA1UE CxMVaHR0cDovL3d3dy5DQWNlcnQub3JnMRwwGgYDVQQDExNDQWNlcnQgQ2xhc3MgMyBSb290MB4X DTE0MDYxMjE2MzYxOFoXDTE2MDYxMTE2MzYxOFowfDEhMB8GA1UEAxMYQ2hyaXN0b3BoIEFudG9u IE1pdHRlcmVyMSQwIgYJKoZIhvcNAQkBFhVjYWxlc3R5b0BzY2llbnRpYS5uZXQxMTAvBgkqhkiG 9w0BCQEWIm1haWxAY2hyaXN0b3BoLmFudG9uLm1pdHRlcmVyLm5hbWUwggEiMA0GCSqGSIb3DQEB AQUAA4IBDwAwggEKAoIBAQDimE/+P29P11lP6Td98fG9FYw67MGe7k7cWXjLb5Yvukut8uISFbMZ eEe+NKqm3i8I1J2rLjfjneee7z6Exv64S2pIgvUAdTl4uG4M1U31Lhu30TucDZYpgFQsJSL/EIP8 YvtOjIk3CGuHNwJnuldJzfFWoWgLh/rB5T0TGGgRlA1GlMzQEUI6Lh9HG8oU2dRiCMqGrLRNrkfR fHzqYCnRDh3GgPuaEjmJMXpNGRSF4QvEXbgkK4B/Tgzz0LB+3oNEfUWknfK+BbYHlTloVIvhmcXg 3/DIIHsOSbWtDtEIC/Dlu2R/RV0+dTtxwMLHwcRzafEr+VsKOvOe+HexrUILAgMBAAGjggFwMIIB bDAMBgNVHRMBAf8EAjAAMFYGCWCGSAGG+EIBDQRJFkdUbyBnZXQgeW91ciBvd24gY2VydGlmaWNh dGUgZm9yIEZSRUUgaGVhZCBvdmVyIHRvIGh0dHA6Ly93d3cuQ0FjZXJ0Lm9yZzAOBgNVHQ8BAf8E BAMCA6gwQAYDVR0lBDkwNwYIKwYBBQUHAwQGCCsGAQUFBwMCBgorBgEEAYI3CgMEBgorBgEEAYI3 CgMDBglghkgBhvhCBAEwMgYIKwYBBQUHAQEEJjAkMCIGCCsGAQUFBzABhhZodHRwOi8vb2NzcC5j YWNlcnQub3JnMDgGA1UdHwQxMC8wLaAroCmGJ2h0dHA6Ly9jcmwuY2FjZXJ0Lm9yZy9jbGFzczMt cmV2b2tlLmNybDBEBgNVHREEPTA7gRVjYWxlc3R5b0BzY2llbnRpYS5uZXSBIm1haWxAY2hyaXN0 b3BoLmFudG9uLm1pdHRlcmVyLm5hbWUwDQYJKoZIhvcNAQENBQADggIBAF59y2IuAaV7ltqym6jP IDiTtSntJWEYduJ/qlB+gVz/1OHH0Zedilf5Trg8zJYF9bAdkjLnZWDRFWS8+LW3qaIbIF+hKkLq ihHRspa1QiiDD/KaopaVMtVHyRsupGZGTiO4y0JcbYrfIzKBf+uOS5RK4WPYGOmSbOAK0yiNtQxh uzN4+aFDsMnrZgR20qlyM33hACwjkZaUgBuzcolrMBxo0JEl5cItxQxyHIockD41cflrP96QHEEw HMk/YCfbQ8/zxQjglbXzPfUqIb1RUZra47iXhpaBV7YaeE0R0IP+jjyawkRYoC3m+XbIyqvuKGY0 +hxTb78VbTE97+9+105MP2mBd1IZ/imt0P7berZi+lqU4LOvanzIIlk1UE8zEA/iYvTc4SS1fNrj CiGoCZx5cp8ZQ3BEYFo++0gac+ukuEJD7ZgkODyDVQSyTbdsrJmUlZ4onJWo4GwMmaNoGw3+oqFA Wdq/7NB2oaEx5pKKwX/neYPeDJViDYlGXXxqmAZuDfaTIuaiaprQluGdjcNzcVW1l974/6zYLJ6n elUq8V6vaWVGgabxPCtobliHLHw6r/WoROmy2NtREk5UEsMJXgCM4RSPRmcT+0Sj8MrJ7GAZpWI2 +On4hl0V0mFiaxWPDhDe8bs7Sl+wuJgTJCN4OCM0RYN9rn8y58/LAh/HMIIGCDCCA/CgAwIBAgIB ATANBgkqhkiG9w0BAQQFADB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVodHRwOi8vd3d3 LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3JpdHkxITAfBgkqhkiG 9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZzAeFw0wNTEwMTQwNzM2NTVaFw0zMzAzMjgwNzM2NTVa MFQxFDASBgNVBAoTC0NBY2VydCBJbmMuMR4wHAYDVQQLExVodHRwOi8vd3d3LkNBY2VydC5vcmcx HDAaBgNVBAMTE0NBY2VydCBDbGFzcyAzIFJvb3QwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQCrSTURSHzSJn5TlM9Dqd0o10Iqi/OHeBlYfA+e2ol94fvrcpANdKGWZKufoCSZc9riVXbH F3v1BKxGuMO+f2SNEGwk82GcwPKQ+lHm9WkBY8MPVuJKQs/iRIwlKKjFeQl9RrmK8+nzNCkIReQc n8uUBByBqBSzmGXEQ+xOgo0J0b2qW42S0OzekMV/CsLj6+YxWl50PpczWejDAz1gM7/30W9HxM3u YoNSbi4ImqTZFRiRpoWSR7CuSOtttyHshRpocjWr//AQXcD0lKdq1TuSfkyQBX6TwSyLpI5idBVx bgtxA+qvFTia1NIFcm+M+SvrWnIl+TlG43IbPgTDZCciECqKT1inA62+tC4T7V2qSNfVfdQqe1z6 RgRQ5MwOQluM7dvyz/yWk+DbETZUYjQ4jwxgmzuXVjit89Jbi6Bb6k6WuHzX1aCGcEDTkSm3ojyt 9Yy7zxqSiuQ0e8DYbF/pCsLDpyCaWt8sXVJcukfVm+8kKHA4IC/VfynAskEDaJLM4JzMl0tF7zoQ CqtwOpiVcK01seqFK6QcgCExqa5geoAmSAC4AcCTY1UikTxW56/bOiXzjzFU6iaLgVn5odFTEcV7 nQP2dBHgbbEsPyyGkZlxmqZ3izRg0RS0LKydr4wQ05/EavhvE/xzWfdmQnQeiuP43NJvmJzLR5iV QAX76QIDAQABo4G/MIG8MA8GA1UdEwEB/wQFMAMBAf8wXQYIKwYBBQUHAQEEUTBPMCMGCCsGAQUF BzABhhdodHRwOi8vb2NzcC5DQWNlcnQub3JnLzAoBggrBgEFBQcwAoYcaHR0cDovL3d3dy5DQWNl cnQub3JnL2NhLmNydDBKBgNVHSAEQzBBMD8GCCsGAQQBgZBKMDMwMQYIKwYBBQUHAgEWJWh0dHA6 Ly93d3cuQ0FjZXJ0Lm9yZy9pbmRleC5waHA/aWQ9MTAwDQYJKoZIhvcNAQEEBQADggIBAH8IiKHa GlBJ2on7oQhy84r3HsQ6tHlbIDCxRd7CXdNlafHCXVRUPIVfuXtCkcKZ/RtRm6tGpaEQU55tiKxz biwzpvD0nuB1wT6IRanhZkP+VlrRekF490DaSjrxC1uluxYG5sLnk7mFTZdPsR44Q4Dvmw2M77in YACHV30eRBzLI++bPJmdr7UpHEV5FpZNJ23xHGzDwlVks7wU4vOkHx4y/CcVBc/dLq4+gmF78CEQ GPZE6lM5+dzQmiDgxrvgu1pPxJnIB721vaLbLmINQjRBvP+LivVRIqqIMADisNS8vmW61QNXeZvo 3MhN+FDtkaVSKKKs+zZYPumUK5FQhxvWXtaMzPcPEAxSTtAWYeXlCmy/F8dyRlecmPVsYGN6b165 Ti/Iubm7aoW8mA3t+T6XhDSUrgCvoeXnkm5OvfPi2RSLXNLrAWygF6UtEOucekq9ve7O/e0iQKtw OIj1CodqwqsFYMlIBdpTwd5Ed2qz8zw87YC8pjhKKSRf/lk7myV6VmMAZLldpGJ9VzZPrYPvH5JT oI53V93lYRE9IwCQTDz6o2CTBKOvNfYOao9PSmCnhQVsRqGP9Md246FZV/dxssRuFFxtbUFm3xuT sdQAw+7Lzzw9IYCpX2Nl/N3gX6T0K/CFcUHUZyX7GrGXrtaZghNB0m6lG5kngOcLqagAMYIC7TCC AukCAQEwWzBUMRQwEgYDVQQKEwtDQWNlcnQgSW5jLjEeMBwGA1UECxMVaHR0cDovL3d3dy5DQWNl cnQub3JnMRwwGgYDVQQDExNDQWNlcnQgQ2xhc3MgMyBSb290AgMCOakwDQYJYIZIAWUDBAIDBQCg ggFjMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE1MTExNDIxMTk1 NVowTwYJKoZIhvcNAQkEMUIEQO7Oi/I2GMPy2Bp07yjlKOOcIajHXCYUUrdfGeGtVIlLg/+fF0LL z2mBY2MQq4IZ0liln1hBNrvQwU33/C7KaewwagYJKwYBBAGCNxAEMV0wWzBUMRQwEgYDVQQKEwtD QWNlcnQgSW5jLjEeMBwGA1UECxMVaHR0cDovL3d3dy5DQWNlcnQub3JnMRwwGgYDVQQDExNDQWNl cnQgQ2xhc3MgMyBSb290AgMCOakwbAYLKoZIhvcNAQkQAgsxXaBbMFQxFDASBgNVBAoTC0NBY2Vy dCBJbmMuMR4wHAYDVQQLExVodHRwOi8vd3d3LkNBY2VydC5vcmcxHDAaBgNVBAMTE0NBY2VydCBD bGFzcyAzIFJvb3QCAwI5qTANBgkqhkiG9w0BAQEFAASCAQBR4ihNT3u0uXVcudyI4ZSwhZ4KinLX 1WXFNfBmZxlq8aeJEyrbApbbURctLltYx3rdAbScCEnMLo6zSnxkcsHxD6cbWtdxHhJdq0Z1KmnZ P/MeIg660Z6gALa3hSB/tL6RKdIxTmnjB1B5cViTlfVlZR/s40ECUCEalxbCKvQnYbd/XqpsSORY e0fwPyRcazy99ThcWQ3LqiRwCUqcgEtmnZdEeEzsB4xp6T4uo/u+2nO2+f4PVHqZHiHi599YcMl3 koWSfhuaw5L3CAfIvxnCilKqbXVX7H3gQ8P61T04IS0t0QbyhGA1g0hjX4MUkVNlMSnc/gKAkkrN vJEOmCfsAAAAAAAA --=-naZUiz/yZvOgW18fexp9-- From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 16:23:17 2015 Received: (at 21916) by debbugs.gnu.org; 14 Nov 2015 21:23:17 +0000 Received: from localhost ([127.0.0.1]:38295 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxiI1-0004xf-2g for submit@debbugs.gnu.org; Sat, 14 Nov 2015 16:23:17 -0500 Received: from mailgw-02.dd24.net ([193.46.215.43]:59860) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZxiHz-0004xX-8g for 21916@debbugs.gnu.org; Sat, 14 Nov 2015 16:23:15 -0500 Received: from mailpolicy-01.live.igb.homer.key-systems.net (mailpolicy-02.live.igb.homer.key-systems.net [192.168.1.27]) by mailgw-02.dd24.net (Postfix) with ESMTP id A8D635FC30; Sat, 14 Nov 2015 21:23:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at mailpolicy-02.live.igb.homer.key-systems.net Received: from mailgw-02.dd24.net ([192.168.1.36]) by mailpolicy-01.live.igb.homer.key-systems.net (mailpolicy-02.live.igb.homer.key-systems.net [192.168.1.25]) (amavisd-new, port 10236) with ESMTP id yFOjf87yl99Q; Sat, 14 Nov 2015 21:23:12 +0000 (UTC) Received: from heisenberg.scientia.net (p5B10016F.dip0.t-ipconnect.de [91.16.1.111]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mailgw-02.dd24.net (Postfix) with ESMTPSA; Sat, 14 Nov 2015 21:23:12 +0000 (UTC) Message-ID: <1447536191.20381.14.camel@scientia.net> Subject: Re: bug#21916: sort -u drops unique lines with some locales From: Christoph Anton Mitterer To: =?ISO-8859-1?Q?P=E1draig?= Brady , 21916@debbugs.gnu.org Date: Sat, 14 Nov 2015 22:23:11 +0100 In-Reply-To: <564715AE.6050205@draigBrady.com> References: <1447479491.18813.0.camel@scientia.net> <564715AE.6050205@draigBrady.com> Content-Type: multipart/signed; micalg="sha-512"; protocol="application/x-pkcs7-signature"; boundary="=-NNU5CY9/nwHwCrYtLCaP" X-Mailer: Evolution 3.18.1-1 Mime-Version: 1.0 X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 21916 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) --=-NNU5CY9/nwHwCrYtLCaP Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Oh one further solution: - document more properly in the manpage and --help, what -u really is, and especially that it may not behave as expected, with other locales/collations. Perhaps even giving an example, so that people understand the seriousness of that. - add companion option, maybe -U, which sorts out *only* those lines which are really binary identical between the two \n . Cheers, Chris. --=-NNU5CY9/nwHwCrYtLCaP Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCCEZIw ggW/MIIDp6ADAgECAgMCOakwDQYJKoZIhvcNAQENBQAwVDEUMBIGA1UEChMLQ0FjZXJ0IEluYy4x HjAcBgNVBAsTFWh0dHA6Ly93d3cuQ0FjZXJ0Lm9yZzEcMBoGA1UEAxMTQ0FjZXJ0IENsYXNzIDMg Um9vdDAeFw0xNDA2MTIxNjM2MThaFw0xNjA2MTExNjM2MThaMHwxITAfBgNVBAMTGENocmlzdG9w aCBBbnRvbiBNaXR0ZXJlcjEkMCIGCSqGSIb3DQEJARYVY2FsZXN0eW9Ac2NpZW50aWEubmV0MTEw LwYJKoZIhvcNAQkBFiJtYWlsQGNocmlzdG9waC5hbnRvbi5taXR0ZXJlci5uYW1lMIIBIjANBgkq hkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA4phP/j9vT9dZT+k3ffHxvRWMOuzBnu5O3Fl4y2+WL7pL rfLiEhWzGXhHvjSqpt4vCNSdqy43453nnu8+hMb+uEtqSIL1AHU5eLhuDNVN9S4bt9E7nA2WKYBU LCUi/xCD/GL7ToyJNwhrhzcCZ7pXSc3xVqFoC4f6weU9ExhoEZQNRpTM0BFCOi4fRxvKFNnUYgjK hqy0Ta5H0Xx86mAp0Q4dxoD7mhI5iTF6TRkUheELxF24JCuAf04M89Cwft6DRH1FpJ3yvgW2B5U5 aFSL4ZnF4N/wyCB7Dkm1rQ7RCAvw5btkf0VdPnU7ccDCx8HEc2nxK/lbCjrznvh3sa1CCwIDAQAB o4IBcDCCAWwwDAYDVR0TAQH/BAIwADBWBglghkgBhvhCAQ0ESRZHVG8gZ2V0IHlvdXIgb3duIGNl cnRpZmljYXRlIGZvciBGUkVFIGhlYWQgb3ZlciB0byBodHRwOi8vd3d3LkNBY2VydC5vcmcwDgYD VR0PAQH/BAQDAgOoMEAGA1UdJQQ5MDcGCCsGAQUFBwMEBggrBgEFBQcDAgYKKwYBBAGCNwoDBAYK KwYBBAGCNwoDAwYJYIZIAYb4QgQBMDIGCCsGAQUFBwEBBCYwJDAiBggrBgEFBQcwAYYWaHR0cDov L29jc3AuY2FjZXJ0Lm9yZzA4BgNVHR8EMTAvMC2gK6AphidodHRwOi8vY3JsLmNhY2VydC5vcmcv Y2xhc3MzLXJldm9rZS5jcmwwRAYDVR0RBD0wO4EVY2FsZXN0eW9Ac2NpZW50aWEubmV0gSJtYWls QGNocmlzdG9waC5hbnRvbi5taXR0ZXJlci5uYW1lMA0GCSqGSIb3DQEBDQUAA4ICAQBefctiLgGl e5baspuozyA4k7Up7SVhGHbif6pQfoFc/9Thx9GXnYpX+U64PMyWBfWwHZIy52Vg0RVkvPi1t6mi GyBfoSpC6ooR0bKWtUIogw/ymqKWlTLVR8kbLqRmRk4juMtCXG2K3yMygX/rjkuUSuFj2Bjpkmzg CtMojbUMYbszePmhQ7DJ62YEdtKpcjN94QAsI5GWlIAbs3KJazAcaNCRJeXCLcUMchyKHJA+NXH5 az/ekBxBMBzJP2An20PP88UI4JW18z31KiG9UVGa2uO4l4aWgVe2GnhNEdCD/o48msJEWKAt5vl2 yMqr7ihmNPocU2+/FW0xPe/vftdOTD9pgXdSGf4prdD+23q2YvpalOCzr2p8yCJZNVBPMxAP4mL0 3OEktXza4wohqAmceXKfGUNwRGBaPvtIGnPrpLhCQ+2YJDg8g1UEsk23bKyZlJWeKJyVqOBsDJmj aBsN/qKhQFnav+zQdqGhMeaSisF/53mD3gyVYg2JRl18apgGbg32kyLmomqa0JbhnY3Dc3FVtZfe +P+s2Cyep3pVKvFer2llRoGm8TwraG5Yhyx8Oq/1qETpstjbURJOVBLDCV4AjOEUj0ZnE/tEo/DK yexgGaViNvjp+IZdFdJhYmsVjw4Q3vG7O0pfsLiYEyQjeDgjNEWDfa5/MufPywIfxzCCBb8wggOn oAMCAQICAwI5qTANBgkqhkiG9w0BAQ0FADBUMRQwEgYDVQQKEwtDQWNlcnQgSW5jLjEeMBwGA1UE CxMVaHR0cDovL3d3dy5DQWNlcnQub3JnMRwwGgYDVQQDExNDQWNlcnQgQ2xhc3MgMyBSb290MB4X DTE0MDYxMjE2MzYxOFoXDTE2MDYxMTE2MzYxOFowfDEhMB8GA1UEAxMYQ2hyaXN0b3BoIEFudG9u IE1pdHRlcmVyMSQwIgYJKoZIhvcNAQkBFhVjYWxlc3R5b0BzY2llbnRpYS5uZXQxMTAvBgkqhkiG 9w0BCQEWIm1haWxAY2hyaXN0b3BoLmFudG9uLm1pdHRlcmVyLm5hbWUwggEiMA0GCSqGSIb3DQEB AQUAA4IBDwAwggEKAoIBAQDimE/+P29P11lP6Td98fG9FYw67MGe7k7cWXjLb5Yvukut8uISFbMZ eEe+NKqm3i8I1J2rLjfjneee7z6Exv64S2pIgvUAdTl4uG4M1U31Lhu30TucDZYpgFQsJSL/EIP8 YvtOjIk3CGuHNwJnuldJzfFWoWgLh/rB5T0TGGgRlA1GlMzQEUI6Lh9HG8oU2dRiCMqGrLRNrkfR fHzqYCnRDh3GgPuaEjmJMXpNGRSF4QvEXbgkK4B/Tgzz0LB+3oNEfUWknfK+BbYHlTloVIvhmcXg 3/DIIHsOSbWtDtEIC/Dlu2R/RV0+dTtxwMLHwcRzafEr+VsKOvOe+HexrUILAgMBAAGjggFwMIIB bDAMBgNVHRMBAf8EAjAAMFYGCWCGSAGG+EIBDQRJFkdUbyBnZXQgeW91ciBvd24gY2VydGlmaWNh dGUgZm9yIEZSRUUgaGVhZCBvdmVyIHRvIGh0dHA6Ly93d3cuQ0FjZXJ0Lm9yZzAOBgNVHQ8BAf8E BAMCA6gwQAYDVR0lBDkwNwYIKwYBBQUHAwQGCCsGAQUFBwMCBgorBgEEAYI3CgMEBgorBgEEAYI3 CgMDBglghkgBhvhCBAEwMgYIKwYBBQUHAQEEJjAkMCIGCCsGAQUFBzABhhZodHRwOi8vb2NzcC5j YWNlcnQub3JnMDgGA1UdHwQxMC8wLaAroCmGJ2h0dHA6Ly9jcmwuY2FjZXJ0Lm9yZy9jbGFzczMt cmV2b2tlLmNybDBEBgNVHREEPTA7gRVjYWxlc3R5b0BzY2llbnRpYS5uZXSBIm1haWxAY2hyaXN0 b3BoLmFudG9uLm1pdHRlcmVyLm5hbWUwDQYJKoZIhvcNAQENBQADggIBAF59y2IuAaV7ltqym6jP IDiTtSntJWEYduJ/qlB+gVz/1OHH0Zedilf5Trg8zJYF9bAdkjLnZWDRFWS8+LW3qaIbIF+hKkLq ihHRspa1QiiDD/KaopaVMtVHyRsupGZGTiO4y0JcbYrfIzKBf+uOS5RK4WPYGOmSbOAK0yiNtQxh uzN4+aFDsMnrZgR20qlyM33hACwjkZaUgBuzcolrMBxo0JEl5cItxQxyHIockD41cflrP96QHEEw HMk/YCfbQ8/zxQjglbXzPfUqIb1RUZra47iXhpaBV7YaeE0R0IP+jjyawkRYoC3m+XbIyqvuKGY0 +hxTb78VbTE97+9+105MP2mBd1IZ/imt0P7berZi+lqU4LOvanzIIlk1UE8zEA/iYvTc4SS1fNrj CiGoCZx5cp8ZQ3BEYFo++0gac+ukuEJD7ZgkODyDVQSyTbdsrJmUlZ4onJWo4GwMmaNoGw3+oqFA Wdq/7NB2oaEx5pKKwX/neYPeDJViDYlGXXxqmAZuDfaTIuaiaprQluGdjcNzcVW1l974/6zYLJ6n elUq8V6vaWVGgabxPCtobliHLHw6r/WoROmy2NtREk5UEsMJXgCM4RSPRmcT+0Sj8MrJ7GAZpWI2 +On4hl0V0mFiaxWPDhDe8bs7Sl+wuJgTJCN4OCM0RYN9rn8y58/LAh/HMIIGCDCCA/CgAwIBAgIB ATANBgkqhkiG9w0BAQQFADB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVodHRwOi8vd3d3 LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3JpdHkxITAfBgkqhkiG 9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZzAeFw0wNTEwMTQwNzM2NTVaFw0zMzAzMjgwNzM2NTVa MFQxFDASBgNVBAoTC0NBY2VydCBJbmMuMR4wHAYDVQQLExVodHRwOi8vd3d3LkNBY2VydC5vcmcx HDAaBgNVBAMTE0NBY2VydCBDbGFzcyAzIFJvb3QwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQCrSTURSHzSJn5TlM9Dqd0o10Iqi/OHeBlYfA+e2ol94fvrcpANdKGWZKufoCSZc9riVXbH F3v1BKxGuMO+f2SNEGwk82GcwPKQ+lHm9WkBY8MPVuJKQs/iRIwlKKjFeQl9RrmK8+nzNCkIReQc n8uUBByBqBSzmGXEQ+xOgo0J0b2qW42S0OzekMV/CsLj6+YxWl50PpczWejDAz1gM7/30W9HxM3u YoNSbi4ImqTZFRiRpoWSR7CuSOtttyHshRpocjWr//AQXcD0lKdq1TuSfkyQBX6TwSyLpI5idBVx bgtxA+qvFTia1NIFcm+M+SvrWnIl+TlG43IbPgTDZCciECqKT1inA62+tC4T7V2qSNfVfdQqe1z6 RgRQ5MwOQluM7dvyz/yWk+DbETZUYjQ4jwxgmzuXVjit89Jbi6Bb6k6WuHzX1aCGcEDTkSm3ojyt 9Yy7zxqSiuQ0e8DYbF/pCsLDpyCaWt8sXVJcukfVm+8kKHA4IC/VfynAskEDaJLM4JzMl0tF7zoQ CqtwOpiVcK01seqFK6QcgCExqa5geoAmSAC4AcCTY1UikTxW56/bOiXzjzFU6iaLgVn5odFTEcV7 nQP2dBHgbbEsPyyGkZlxmqZ3izRg0RS0LKydr4wQ05/EavhvE/xzWfdmQnQeiuP43NJvmJzLR5iV QAX76QIDAQABo4G/MIG8MA8GA1UdEwEB/wQFMAMBAf8wXQYIKwYBBQUHAQEEUTBPMCMGCCsGAQUF BzABhhdodHRwOi8vb2NzcC5DQWNlcnQub3JnLzAoBggrBgEFBQcwAoYcaHR0cDovL3d3dy5DQWNl cnQub3JnL2NhLmNydDBKBgNVHSAEQzBBMD8GCCsGAQQBgZBKMDMwMQYIKwYBBQUHAgEWJWh0dHA6 Ly93d3cuQ0FjZXJ0Lm9yZy9pbmRleC5waHA/aWQ9MTAwDQYJKoZIhvcNAQEEBQADggIBAH8IiKHa GlBJ2on7oQhy84r3HsQ6tHlbIDCxRd7CXdNlafHCXVRUPIVfuXtCkcKZ/RtRm6tGpaEQU55tiKxz biwzpvD0nuB1wT6IRanhZkP+VlrRekF490DaSjrxC1uluxYG5sLnk7mFTZdPsR44Q4Dvmw2M77in YACHV30eRBzLI++bPJmdr7UpHEV5FpZNJ23xHGzDwlVks7wU4vOkHx4y/CcVBc/dLq4+gmF78CEQ GPZE6lM5+dzQmiDgxrvgu1pPxJnIB721vaLbLmINQjRBvP+LivVRIqqIMADisNS8vmW61QNXeZvo 3MhN+FDtkaVSKKKs+zZYPumUK5FQhxvWXtaMzPcPEAxSTtAWYeXlCmy/F8dyRlecmPVsYGN6b165 Ti/Iubm7aoW8mA3t+T6XhDSUrgCvoeXnkm5OvfPi2RSLXNLrAWygF6UtEOucekq9ve7O/e0iQKtw OIj1CodqwqsFYMlIBdpTwd5Ed2qz8zw87YC8pjhKKSRf/lk7myV6VmMAZLldpGJ9VzZPrYPvH5JT oI53V93lYRE9IwCQTDz6o2CTBKOvNfYOao9PSmCnhQVsRqGP9Md246FZV/dxssRuFFxtbUFm3xuT sdQAw+7Lzzw9IYCpX2Nl/N3gX6T0K/CFcUHUZyX7GrGXrtaZghNB0m6lG5kngOcLqagAMYIC7TCC AukCAQEwWzBUMRQwEgYDVQQKEwtDQWNlcnQgSW5jLjEeMBwGA1UECxMVaHR0cDovL3d3dy5DQWNl cnQub3JnMRwwGgYDVQQDExNDQWNlcnQgQ2xhc3MgMyBSb290AgMCOakwDQYJYIZIAWUDBAIDBQCg ggFjMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE1MTExNDIxMjMx MVowTwYJKoZIhvcNAQkEMUIEQKM6iqxx/OLrhPTH/AAzwYDTssTg9j10YONroLCWSzPOeB0lQpan HevE+rpmolrKtw/+PON3vS056gEHAeb7viEwagYJKwYBBAGCNxAEMV0wWzBUMRQwEgYDVQQKEwtD QWNlcnQgSW5jLjEeMBwGA1UECxMVaHR0cDovL3d3dy5DQWNlcnQub3JnMRwwGgYDVQQDExNDQWNl cnQgQ2xhc3MgMyBSb290AgMCOakwbAYLKoZIhvcNAQkQAgsxXaBbMFQxFDASBgNVBAoTC0NBY2Vy dCBJbmMuMR4wHAYDVQQLExVodHRwOi8vd3d3LkNBY2VydC5vcmcxHDAaBgNVBAMTE0NBY2VydCBD bGFzcyAzIFJvb3QCAwI5qTANBgkqhkiG9w0BAQEFAASCAQCwobEbx1wL37TYWX1lSTVeaXlHJvxe SyqkWwlK5qt4vEA+f93J7dNKjNKWlTLFaHwQoWIs9EDpzrnp6R/JhufXNXbgjsBudwocelwjAK43 kjFwpviMGs5mnel3IA186zN0v//+LVZnui5p/JcOwA5+xro+XDfPpZ0WGtpA8q1xJRv5hXj01UFE RWt8C2gGNUebXRe3ya9+Z2r81zjasZccpPPB3CB1b6aMPd0Txq+fp5rEsXtyZhQ0n2vpsPH1JIke nEtWmq9u501KY64O02TT/tdSy3EizbSgHvObNyl+fysKqG8xS7ILkUh51VuDtfvcMpnHAIyZFXAU 7cKrSgF5AAAAAAAA --=-NNU5CY9/nwHwCrYtLCaP-- From debbugs-submit-bounces@debbugs.gnu.org Sun Nov 15 19:11:40 2015 Received: (at 21916) by debbugs.gnu.org; 16 Nov 2015 00:11:40 +0000 Received: from localhost ([127.0.0.1]:39299 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zy7OW-00082T-4D for submit@debbugs.gnu.org; Sun, 15 Nov 2015 19:11:40 -0500 Received: from joseki.proulx.com ([216.17.153.58]:55400) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zy7OU-00082F-Cu for 21916@debbugs.gnu.org; Sun, 15 Nov 2015 19:11:38 -0500 Received: from hysteria.proulx.com (hysteria.proulx.com [192.168.230.119]) by joseki.proulx.com (Postfix) with ESMTP id 5C18E21232; Sun, 15 Nov 2015 17:11:37 -0700 (MST) Received: by hysteria.proulx.com (Postfix, from userid 1000) id 28F0E2DC52; Sun, 15 Nov 2015 17:11:37 -0700 (MST) Date: Sun, 15 Nov 2015 17:11:37 -0700 From: Bob Proulx To: Christoph Anton Mitterer , 21916@debbugs.gnu.org Subject: Re: bug#21916: sort -u drops unique lines with some locales Message-ID: <20151115170622234520817@bob.proulx.com> References: <1447479491.18813.0.camel@scientia.net> <564715AE.6050205@draigBrady.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <564715AE.6050205@draigBrady.com> User-Agent: Mutt/1.5.24 (2015-08-30) X-Spam-Score: -1.3 (-) X-Debbugs-Envelope-To: 21916 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.3 (-) Pádraig Brady wrote: > Christoph Anton Mitterer wrote: > > Attached is a file, that, when sort -u'ed in my locale, looses lines > > which are however unique. > > > > I've also attached the locale, since it's a custom made one, but the > > same seem to happen with "standard" locales as well, see e.g. > > https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=695489 > > > > PS: Please keep me CCed, as I'm writing off list. > > If you compare at the byte level you'll get appropriate grouping: > > $ printf '%s\n' Ⅱ Ⅰ | LC_ALL=C sort > Ⅰ > Ⅱ It is also possible to set only LC_COLLATE=C and not set everything to C. > The same goes for other similar representations, > like full width forms of latin numbers: > > $ printf '%s\n' ２ １ | ltrace -e strcoll sort > sort->strcoll("\357\274\222", "\357\274\221") = 0 > ２ > １ > > That's a bit surprising, though maybe since only a limited > number of these representations are provided, it was > not thought appropriate to provide collation orders for them. Hmm... Seems questionable to me. > There are details on the unicode representation at: > https://en.wikipedia.org/wiki/Numerals_in_Unicode#Roman_numerals_in_Unicode > Where it says "[f]or most purposes, it is preferable to compose the Roman numerals > from sequences of the appropriate Latin letters" > > For example you could mix ISO 8859-1 and ISO 8859-5 to get appropriate sorting: One can transliterate them using 'iconv'. printf '%s\n' Ⅱ Ⅰ ２ １ | iconv -f UTF-8 -t ASCII//TRANSLIT | sort 1 2 I II Bob From debbugs-submit-bounces@debbugs.gnu.org Wed Oct 24 17:19:21 2018 Received: (at control) by debbugs.gnu.org; 24 Oct 2018 21:19:21 +0000 Received: from localhost ([127.0.0.1]:40729 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gFQYj-0006Wv-Cf for submit@debbugs.gnu.org; Wed, 24 Oct 2018 17:19:21 -0400 Received: from mail-pf1-f181.google.com ([209.85.210.181]:36144) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gFQYh-0006Wf-Dg for control@debbugs.gnu.org; Wed, 24 Oct 2018 17:19:19 -0400 Received: by mail-pf1-f181.google.com with SMTP id l81-v6so3065742pfg.3 for ; Wed, 24 Oct 2018 14:19:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:message-id:date:user-agent:mime-version:content-language :content-transfer-encoding; bh=Uu4wenYYHUIS1VJCloso0Ld7KS3tQNvEg+jrwpXgUeU=; b=Zw5JlW/j0SB3EHsseY11/2yPegzjl4Sxw7vScPl11Qa/4+c8+73F5qZ+JKZRP6XYWJ hx/i37EcC7hdME6//LBqzfpJpkg7ZYMGQ4QZhHw7mDQvMHBGZ0o2UekWL1Q7MYqv3TB/ Pwz4YUvAT9RCsGyYcQQaJexZAVn62kJuNvvlMpzVemg8lcnLNPJ3yVDsUqn+mhRi/urD 7qvMyTL37X8/QEEQO3eghpDxDNAKC4/R/W4ZTFQTRiayRnetje4+HFeYn2cWnTXWuPdz 9RVJaTdaHg+3H8N5gMBt9842jIDsCKff3E8MtnlVIbtNv2T5a+7QE3JzHDnKJa9lgwp+ AEZw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=Uu4wenYYHUIS1VJCloso0Ld7KS3tQNvEg+jrwpXgUeU=; b=M9czx9rKxqliIIvcaSeypa14kG/7jv75NVGcSF5VF53uzbB26FbskN4yc+xsSsn4c3 b6ZB2WSBROkcefwVmxJYxmQP77TSLJTZFt8yxeCumNPX1QZ1s+RpG3pYCrc2bzM/w4DN Oo9BYg+vhk/qflo10i1wOfcpqTIkLsoSVL97sidNbsXJ/fOZVjYLZp6XrMv/5Xd7waQ0 /fmm3Z1RFTKf7CEDrvlVr2EPg/ZeEKbrLmdPHdMiPkB/LYhw3qHZyJryFXS5h60TnrqN 16TzybssnjuHLelqyqRhI5pbxVOXBW+the7JRUbmJkeW6nU0h7CNr+1BcAiJ5By4RR2P 14YA== X-Gm-Message-State: AGRZ1gIosQcPzrl1LXeqoq2bHiDookDlsfihDUppaKmLueFaPlQPXJTQ rzFoPEIr9n1Qw+ywLxY/gHBRIU50u8I= X-Google-Smtp-Source: AJdET5f+PEBcNR/cv8Wz0iuxuMsPwbp0w88sLBuBQ3GkOJaogrh94AZ/WiSQEH9/qJIxBCdCzA3npg== X-Received: by 2002:a62:7f8c:: with SMTP id a134-v6mr4120799pfd.257.1540415953155; Wed, 24 Oct 2018 14:19:13 -0700 (PDT) Received: from tomato.housegordon.com (moose.housegordon.com. [184.68.105.38]) by smtp.googlemail.com with ESMTPSA id p26-v6sm3468779pfe.7.2018.10.24.14.19.11 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 24 Oct 2018 14:19:11 -0700 (PDT) To: control@debbugs.gnu.org From: Assaf Gordon Message-ID: <2a0c8fb6-9c8a-bf17-7ce0-fec6c75de3fa@gmail.com> Date: Wed, 24 Oct 2018 15:19:10 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Score: 2.0 (++) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: tags 21916 notabug close 21916 [...] Content analysis details: (2.0 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/, no trust [209.85.210.181 listed in list.dnswl.org] 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (assafgordon[at]gmail.com) -0.0 SPF_PASS SPF: sender matches SPF record 1.8 MISSING_SUBJECT Missing Subject: header 0.2 NO_SUBJECT Extra score for no subject X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) tags 21916 notabug close 21916 From unknown Thu Jun 19 14:11:17 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Thu, 22 Nov 2018 12:24:05 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator