Subject: bug#25455: uniq considers all the full-width punctuation and Japanese kana as the same under zh_CN.UTF-8 locale

From: Mike Frysinger <[email-masked]>
Date: Fri, 20 Jan 2017 22:08:33 -0500

On 16 Jan 2017 04:01, Icenowy Zheng wrote:
> When dealing lines with only a Chinese full-width punctuation or Japanese kana
> and locale is zh_CN.UTF-8, uniq command will consider all the lines are the
> same, and wrongly removed different punctuations.

this is a problem with glibc, not coreutils.  you can follow the upstream bug:
https://sourceware.org/bugzilla/show_bug.cgi?id=13063
-mike