GNU bug report logs - #12285
uniq on a UTF8 file with roman numerals

Previous Next

Full log

Message #11 received at 12285 <at> debbugs.gnu.org (full text, mbox):

From: Pádraig Brady <P <at> draigBrady.com>
To: "P. Michaud" <pierrecmichaud <at> aol.com>
Cc: 12285 <at> debbugs.gnu.org
Subject: Re: bug#12285: uniq on a UTF8 file with roman numerals
Date: Sun, 26 Aug 2012 21:53:51 +0100

On 08/26/2012 06:49 PM, P. Michaud wrote:
> Hello,
> 
> I used the command
> 
> "uniq -dc myfile.txt'
> 
> here are some lines of the output
> 
>       2 ☼ turvy
>       2 ☼ with gay abandon
>       2 ☼ with reckless abandon
>      10 ☼ yyⅰ
>       9 ☼ yyⅹⅲ
>       2 ☼ yyⅺ
>      12 ☼ zzⅰ
> 
> 
> The three first lines above are correct and correspond to real duplicates lines in the file, but the numbers on the 4 last one are erroneous, each of them correspond to a single line in the file.
> 
> Yours faithfully.
> 
> Pierre Michaud

What system are you on
What version of uniq
What is the input exactly

I suspect your locale is equating roman numerals (though that is surprising),
but I can't reproduce with the following on coreutils-8.10-2.fc15.x86_64 at least.

  locale -a | while read locale; do
    LC_ALL=$locale uniq -dc t.in
  done | grep -v " *2"

cheers,
Pádraig.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.