Subject: bug#16168: closed (Re: bug#16168: uniq mis-handles UTF8 (8bit) characters)

From: [email-masked] (GNU bug Tracking System)
Date: Mon, 16 Dec 2013 17:34:02 +0000

Your bug report

#16168: uniq mis-handles UTF8 (8bit) characters

which was filed against the coreutils package, has been closed.

The explanation is attached below, along with your original report.
If you require more details, please reply to [email-masked].

-- 
16168: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=16168
GNU Bug Tracking System
Contact [email-masked] with problems

Subject: Re: bug#16168: uniq mis-handles UTF8 (8bit) characters
From: Pádraig Brady <[email-masked]>
To: Shlomo Urbach <[email-masked]>
Cc: [email-masked]
Date: Mon, 16 Dec 2013 17:33:23 +0000
List-Id: <debbugs-submit.debbugs.gnu.org>

tag 16168 notabug
close 16168
stop

On 12/16/2013 01:50 PM, Shlomo Urbach wrote:
> Lines with CJK letters are deemed equal by length only, since the
> characters seem to be ignored.
> I understand this is due to locale.
> But, it would be nice if a simple flag would do a locale-free comparison
> (i.e. equal = all bytes are equal).

If you want to compare byte by byte:

LC_ALL=C uniq ....

thanks,
Pǽdraig.

Subject: uniq mis-handles UTF8 (8bit) characters
From: Shlomo Urbach <[email-masked]>
To: [email-masked]
Date: Mon, 16 Dec 2013 15:50:15 +0200
List-Id: <debbugs-submit.debbugs.gnu.org>

Lines with CJK letters are deemed equal by length only, since the
characters seem to be ignored.
I understand this is due to locale.
But, it would be nice if a simple flag would do a locale-free comparison
(i.e. equal = all bytes are equal).