From unknown Sun Jun 15 08:34:11 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#66664 <66664@debbugs.gnu.org> To: bug#66664 <66664@debbugs.gnu.org> Subject: Status: On modified lines containing =?UTF-8?Q?=F0=9F=8C=90=EF=B8=8E?= and Unicode VS15 in text mode emacs does not show the real content of the lines Reply-To: bug#66664 <66664@debbugs.gnu.org> Date: Sun, 15 Jun 2025 15:34:11 +0000 retitle 66664 On modified lines containing =F0=9F=8C=90=EF=B8=8E and Unicod= e VS15 in text mode emacs does not show the real content of the lines reassign 66664 emacs submitter 66664 =D0=94=D0=B8=D0=BB=D1=8F=D0=BD =D0=9F=D0=B0=D0=BB=D0=B0=D1= =83=D0=B7=D0=BE=D0=B2 severity 66664 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 21 08:09:50 2023 Received: (at submit) by debbugs.gnu.org; 21 Oct 2023 12:09:50 +0000 Received: from localhost ([127.0.0.1]:42471 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quAna-0000zg-DS for submit@debbugs.gnu.org; Sat, 21 Oct 2023 08:09:50 -0400 Received: from lists.gnu.org ([2001:470:142::17]:60526) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quAnS-0000zL-Bn for submit@debbugs.gnu.org; Sat, 21 Oct 2023 08:09:44 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1quAms-00048W-8c for bug-gnu-emacs@gnu.org; Sat, 21 Oct 2023 08:09:02 -0400 Received: from mail.aegee.org ([144.76.142.78]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1quAmq-0001NV-7K for bug-gnu-emacs@gnu.org; Sat, 21 Oct 2023 08:09:01 -0400 Authentication-Results: mail.aegee.org/39LC7r2k1826419; auth=pass (LOGIN) smtp.auth=didopalauzov@aegee.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=aegee.org; s=k4096; t=1697890075; i=dkim+MSA-ssl@aegee.org; bh=Z5Gs1Yk5GSwZBYmJjcyEcIz9/rhwIi62ZxdN3SIPrQM=; h=Subject:From:To:Date; b=KUdaJTBKat/0S+s9wj3u/RURJ//Y7huI81nSnQc9RUGvBSidAkWp8j/Gv0dsjpL3z irbk7N2pU20HUAlOTRg/KBEUyWzRGxG87bzdct8WsK7TGgSLbTgv0UwR8Anztguky8 slc37bab2ytWYuHqwbByLvjBg6TQ2s75+aGLk/WAzPvF3DJYPCMycclMncviHdTxjl B8wc39wthAFrZrbj3ArpUkU708sAYgpqP3g49SLXQMOvd6mguqK3k0INd7ZJD3BaNV VpGZFR1mQZIPJvOBbACP07kjzEMQNVsdlp3fwkM5n4S2kSuWtBeb59eYJAwprd6Wkm ht2NW3Qo2ejOZdqSFDNnc7PpI+7BPxRjw0Y/M8RU8Y+8P7phT61dDaoBiBzZX3JWAz Xr5Il7pB2B2mGSHzM0djqOwvPETC/nGKkieUrnRhJq0v9Y6I9zgXj8j0Ai1grayD07 qOtJ+2g7wdEHr6z30AtgjPRXRlIH7RJvgy4WlIHOjyWupVMiBI1ba1adhqkYv7ZB11 Y7yqqbPYj1cGJKK0/rva9m0Xv2ETzDxL8if8vht8J+YJEj/gfZRfhkZ05BU86JjlOG A/P4qGiMaU+R+giIk0UzSkaz22gBpML0cmnvGadlc4C8tb0AjBZ3yMcNlS7zjxA8pp 9C+cu5FDaR3pH1mQEa3AUNCI= Authentication-Results: mail.aegee.org/39LC7r2k1826419; dkim=none Received: from [10.57.6.126] ([192.19.207.250]) (authenticated bits=0) by mail.aegee.org (8.17.2/8.17.2) with ESMTPSA id 39LC7r2k1826419 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sat, 21 Oct 2023 12:07:53 GMT Message-ID: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> Subject: On modified lines containing =?UTF-8?Q?=F0=9F=8C=90=EF=B8=8E?= and Unicode VS15 in text mode emacs does not show the real content of the lines From: =?UTF-8?Q?=D0=94=D0=B8=D0=BB=D1=8F=D0=BD_?= =?UTF-8?Q?=D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0=BE=D0=B2?= To: bug-gnu-emacs@gnu.org Date: Sat, 21 Oct 2023 14:07:52 +0200 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.51.1 MIME-Version: 1.0 Received-SPF: none client-ip=144.76.142.78; envelope-from=dilyan.palauzov@aegee.org; helo=mail.aegee.org X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001, SPF_NONE=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hello, I have a text unix file u.txt where I insert this line: t.add('=F0=9F=8C=90=EF=B8=8E ' + 'abcd') That is a globe U+1F310 followed by Unicode Variation Selector 15 to remove= the colour of the globe. $ hexdump -C u.txt 00000000 74 2e 61 64 64 28 27 f0 9f 8c 90 ef b8 8e 20 27 |t.add('.......= '| 00000010 20 2b 20 27 61 62 63 64 27 29 0a | + 'abcd').| 0000001b I open the file in text mode, emacs-fedora-28.3 -nw, and press the right ar= row repeatedly to go over c. Then I press x. emacs shows that c is delete= d and on its place appears x. I press Ctrl+L to refresh. Now c appears bef= ore x. I close emacs, repeat the above steps and get consistent results. I try th= is on a different system with self-compiled emacs 29.1, same results. The problem report is that when that character sequence is contained in a t= ext file, modifying more complex lines gets practically impossible with ema= cs, as the latter stops showing the actual text. I have to refresh, close,= open emacs several times in order to get modifications correctly on the li= nes, containing the above sequence. I literally cannot see what I am chan= ging on such lines, as what is displayed is different to what is actually m= odified. Kind regards Dilyan From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 21 08:45:00 2023 Received: (at 66664) by debbugs.gnu.org; 21 Oct 2023 12:45:00 +0000 Received: from localhost ([127.0.0.1]:42510 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quBLb-0007HE-UU for submit@debbugs.gnu.org; Sat, 21 Oct 2023 08:44:59 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:39066) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quBLW-0007Gv-57 for 66664@debbugs.gnu.org; Sat, 21 Oct 2023 08:44:54 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1quBKx-0003vH-10; Sat, 21 Oct 2023 08:44:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-version:References:Subject:In-Reply-To:To:From: Date; bh=+sxM2AHTyIRqGu/j6CO/fCAq759o/ZCycYXqQjDutXU=; b=VQrt2q6wNDqLFDH3Eipm yt3MB4QkeWJ9TrVaEX8AQFR+oC3cI77qJjNQtGwhbXiGbuIrq7UMisIiKAQO2o3+zTSfmW3Ez3ZSF 9auCIvk6Ho2OarYw8oiaXutt9rtE4Chjz7v9kPf2o5fJe2IsTnNj7dsf6PpYx91SvDJHTxEp01JEv YgWYrKlMjE6XasYGwLsyzZd1M/MWXzfwWFbDuCtgqB9IxiyI/gkswebQiKsOQyBFPF+ofICD8tooy PiNNebDlX45RcMu01riH4z1BebA/oAhnQqI+zi1/sKsLU5OzsqkXBVK7Ml1YrcvCerm52i7JK4Eeo BkWB74bEPWWBeg==; Date: Sat, 21 Oct 2023 15:44:11 +0300 Message-Id: <83pm18qh5w.fsf@gnu.org> From: Eli Zaretskii To: =?utf-8?B?0JTQuNC70Y/QvSDQn9Cw0LvQsNGD0LfQvtCy?= In-Reply-To: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> (dilyan.palauzov@aegee.org) Subject: Re: bug#66664: On modified lines containing =?utf-8?B?8J+MkO+4jg==?= and Unicode VS15 in text mode emacs does not show the real content of the lines References: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 66664 Cc: 66664@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Дилян Палаузов > > Date: Sat, 21 Oct 2023 14:07:52 +0200 > > Hello, > > I have a text unix file u.txt where I insert this line: > > > t.add('🌐︎ ' + 'abcd') > > That is a globe U+1F310 followed by Unicode Variation Selector 15 to remove the colour of the globe. > > $ hexdump -C u.txt > 00000000 74 2e 61 64 64 28 27 f0 9f 8c 90 ef b8 8e 20 27 |t.add('....... '| > 00000010 20 2b 20 27 61 62 63 64 27 29 0a | + 'abcd').| > 0000001b > > I open the file in text mode, emacs-fedora-28.3 -nw, and press the right arrow repeatedly to go over c. Then I press x. emacs shows that c is deleted and on its place appears x. I press Ctrl+L to refresh. Now c appears before x. > > I close emacs, repeat the above steps and get consistent results. I try this on a different system with self-compiled emacs 29.1, same results. What is the terminal emulator you are using, and on what OS? Basically, what the above means is that the text terminal you are using doesn't support the sequence of U+1F310 followed by VS-15 as Emacs expects it. On such a terminal you need to disable auto-composition-mode to be able to edit such text. From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 21 09:12:37 2023 Received: (at 66664) by debbugs.gnu.org; 21 Oct 2023 13:12:37 +0000 Received: from localhost ([127.0.0.1]:42544 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quBmO-0008D2-Io for submit@debbugs.gnu.org; Sat, 21 Oct 2023 09:12:36 -0400 Received: from mail.aegee.org ([144.76.142.78]:36218) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quBmM-0008Cq-0H for 66664@debbugs.gnu.org; Sat, 21 Oct 2023 09:12:35 -0400 Authentication-Results: mail.aegee.org/39LDC47P1888627; auth=pass (LOGIN) smtp.auth=didopalauzov@aegee.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=aegee.org; s=k4096; t=1697893924; i=dkim+MSA-ssl@aegee.org; bh=kKiWUy/hKJZbcBOKKzvIM1VheatQykjl7VxhyKB0eGI=; h=Subject:From:To:Cc:Date:In-Reply-To:References; b=Nsrv16KVHypm6Z+wO3t982ei24OPHtbnrqqPJsAqVTscyi/Qy1gFEP4SJnFCY/Sms ubTg+GMthTJkElTlAhKDD0+TWaC7qzJj9cr2RK+0g95/xeTJSmDUJsDPUavvOOnvyx +A2fi5XaBNlG/gOeNmx9VdVgGZM83hF5oKA2bOQaLJRQ3npkggLMk2Qdm1p838tL6H 5C5zSphEEp7Uh8uD/Y31hhAYOcGw1SCtuOdvRJG58aRXkhP0ICuR/z7dtWKbqM9/j1 7f4xIPyuG1frhsIHaxuiIXL+epuN5vkMaVzqrWYRCndTOTXrbq1nKWolxJeWsrPRJT 7TAcR+aT5bgadio561qdBlacW/+z+DPT8A3zitwPUPa+yfOc+iIXRy5yOhxQE2/ja/ rooiH4FxpxuBer7WUnItxDQ8Wvm1ie9UOWVQzIesL32NR8tFFdthZv0bKvzyTbyznZ nmSQuX8sgymi+DINzYIewGgtif22wNxZpTx2GNGVYQqJwoX8FBWdmLgfD7hm2wNGS1 tGgI7KKyxX+48e2uVMYARGQp3l6rvz2IXw8RsPIRqVPunPcaGZaoA/7QzfE3PlvmwE kPEB7nTB3bFeFF2qytPZxBjV3o35YZWKV0jw1o/LrdpJFIhwdtdBtLvF3Gy1Xa3KdC 1Rl/Sx3jCd01DmNhGnTqblWs= Authentication-Results: mail.aegee.org/39LDC47P1888627; dkim=none Received: from [10.57.6.126] ([192.19.207.250]) (authenticated bits=0) by mail.aegee.org (8.17.2/8.17.2) with ESMTPSA id 39LDC47P1888627 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 21 Oct 2023 13:12:04 GMT Message-ID: <7e1f9e947a191eca18429cd20e5e71a4dcd34f2f.camel@aegee.org> Subject: Re: bug#66664: On modified lines containing =?UTF-8?Q?=F0=9F=8C=90=EF=B8=8E?= and Unicode VS15 in text mode emacs does not show the real content of the lines From: =?UTF-8?Q?=D0=94=D0=B8=D0=BB=D1=8F=D0=BD_?= =?UTF-8?Q?=D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0=BE=D0=B2?= To: Eli Zaretskii Date: Sat, 21 Oct 2023 15:12:03 +0200 In-Reply-To: <83pm18qh5w.fsf@gnu.org> References: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> <83pm18qh5w.fsf@gnu.org> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.51.1 MIME-Version: 1.0 X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 66664 Cc: 66664@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hello Eli, thanks for your answer. I am using Gnome Terminal 3.48.1 on Fedora 38, but = with MATE Terminal 1.26.1 the same happens. I tried to follow your advice.= I start emacs -nw u.txt , then M-x auto-composition-mode. =20 Emacs changes the displayed text from t.add('=F0=9F=8C=90=EF=B8=8E ' + 'abcd') to=20 t.add('=F0=9F=8C=90 ' + 'abcd') and prints =E2=80=9CAuto-Composition mode disabled in current buffer=E2=80= =9D. After the change the globe is coloured in the terminal and there is a= n underscore after the globe. I again press several times the right arrow = to go over the letter c and then press x. Emacs again deletes (actually hid= es) the letter c and shows on its place the letter x. So in this example turning off auto-composition-mode does not help. I expect that the letter c stays visible. What terminals and OSes do you recommend, which work good with enabled auto= -composition-mode? Kind regards =D0=94=D0=B8=D0=BB=D1=8F=D0=BD -----Original Message----- From: Eli Zaretskii To: =D0=94=D0=B8=D0=BB=D1=8F=D0=BD =D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0= =BE=D0=B2 Cc: 66664@debbugs.gnu.org Subject: Re: bug#66664: On modified lines containing =F0=9F=8C=90=EF=B8=8E = and Unicode VS15 in text mode emacs does not show the real content of the l= ines Date: 10/21/2023 02:44:11 PM > From: =D0=94=D0=B8=D0=BB=D1=8F=D0=BD =D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7= =D0=BE=D0=B2 > =C2=A0 > Date: Sat, 21 Oct 2023 14:07:52 +0200 >=20 > Hello, >=20 > I have a text unix file u.txt where I insert this line: >=20 >=20 > t.add('=F0=9F=8C=90=EF=B8=8E ' + 'abcd') >=20 > That is a globe U+1F310 followed by Unicode Variation Selector 15 to remo= ve the colour of the globe. >=20 > $ hexdump -C=C2=A0 u.txt > 00000000=C2=A0 74 2e 61 64 64 28 27 f0=C2=A0 9f 8c 90 ef b8 8e 20 27=C2= =A0 |t.add('....... '| > 00000010=C2=A0 20 2b 20 27 61 62 63 64=C2=A0 27 29 0a=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 | + 'abcd').| > 0000001b >=20 > I open the file in text mode, emacs-fedora-28.3 -nw, and press the right = arrow repeatedly to go over c.=C2=A0 Then I press x.=C2=A0 emacs shows that= c is deleted and on its place appears x. I press Ctrl+L to refresh.=C2=A0 = Now c appears before x. >=20 > I close emacs, repeat the above steps and get consistent results.=C2=A0 I= try this on a different system with self-compiled emacs 29.1, same results= . What is the terminal emulator you are using, and on what OS? Basically, what the above means is that the text terminal you are using doesn't support the sequence of U+1F310 followed by VS-15 as Emacs expects it.=C2=A0 On such a terminal you need to disable auto-composition-mode to be able to edit such text. From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 21 09:37:16 2023 Received: (at 66664) by debbugs.gnu.org; 21 Oct 2023 13:37:16 +0000 Received: from localhost ([127.0.0.1]:42583 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quCAG-0000Yj-FF for submit@debbugs.gnu.org; Sat, 21 Oct 2023 09:37:16 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:60964) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quCAE-0000YV-DS for 66664@debbugs.gnu.org; Sat, 21 Oct 2023 09:37:15 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1quC9f-000537-Hi; Sat, 21 Oct 2023 09:36:39 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-version:References:Subject:In-Reply-To:To:From: Date; bh=6MH6vvZxgmfVcwknSlPkbdmVOARQeuNvGlDe/Jg9vg4=; b=Jbcg9QI1TqQA5smYraeT CuUrtwMS0zun+TfMy3u8i513zFXPVYUflJ4mJvDdu6hAdCrXr6Bnt2WfGiy3GTXzal8fUYpW6FohP wb/IX55CwZ+yIuk8Wmq4P5fVBu+3jK7Cm++Q+qeJq0L/KXDh2Ye6G1JtBNNpOe/uPd+aS+HlLW/s0 8yu0pzh5V469oV8mpATolyZm9zB9aKg2CNrEYLPJkM0JE3sl84bWUGuMIOzAnziRPyimm4PPCMRFz UUGWNx24rnRiPwMYKZJs/5RFNcaeCltJNhW8qXneCQgz0vTlxN2uZ+F7ST3AIlWrzxQApUJ/M5a6l OcHeUnYi1wxsNQ==; Date: Sat, 21 Oct 2023 16:36:38 +0300 Message-Id: <83jzrgqeqh.fsf@gnu.org> From: Eli Zaretskii To: =?utf-8?B?0JTQuNC70Y/QvSDQn9Cw0LvQsNGD0LfQvtCy?= In-Reply-To: <7e1f9e947a191eca18429cd20e5e71a4dcd34f2f.camel@aegee.org> (dilyan.palauzov@aegee.org) Subject: Re: bug#66664: On modified lines containing =?utf-8?B?8J+MkO+4jg==?= and Unicode VS15 in text mode emacs does not show the real content of the lines References: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> <83pm18qh5w.fsf@gnu.org> <7e1f9e947a191eca18429cd20e5e71a4dcd34f2f.camel@aegee.org> MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 66664 Cc: 66664@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Дилян Палаузов > > Cc: 66664@debbugs.gnu.org > Date: Sat, 21 Oct 2023 15:12:03 +0200 > > thanks for your answer. I am using Gnome Terminal 3.48.1 on Fedora 38, but with MATE Terminal 1.26.1 the same happens. I tried to follow your advice. I start emacs -nw u.txt , then M-x auto-composition-mode. > > Emacs changes the displayed text from > > t.add('🌐︎ ' + 'abcd') > > to > > t.add('🌐 ' + 'abcd') > > and prints “Auto-Composition mode disabled in current buffer”. After the change the globe is coloured in the terminal and there is an underscore after the globe. I again press several times the right arrow to go over the letter c and then press x. Emacs again deletes (actually hides) the letter c and shows on its place the letter x. Then I cannot reproduce this, nether with nor without auto-composition-mode. What happens if you use xterm instead? Also, does this happen in "emacs -Q -nw"? And what is your locale-environment and language-environment? From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 21 09:54:08 2023 Received: (at 66664) by debbugs.gnu.org; 21 Oct 2023 13:54:08 +0000 Received: from localhost ([127.0.0.1]:42615 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quCQZ-0001Fb-Qp for submit@debbugs.gnu.org; Sat, 21 Oct 2023 09:54:08 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:56382) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quCQW-0001F3-6c for 66664@debbugs.gnu.org; Sat, 21 Oct 2023 09:54:06 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1quCPx-000254-IF; Sat, 21 Oct 2023 09:53:29 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-version:References:Subject:In-Reply-To:To:From: Date; bh=whXT78NbAMdTqKSZ6JaZEbN+GYmpGdRq50pY7LOx6lc=; b=j088ys/XQT2OuykJfM2C ci4MBUzds5d9cc8FLmCi06TEMh1KN7cYx3cTcM1l93ezhyT2ZpE1b/CXApL76+zWSch98hPS6arWf lG0knC+1vF5tqDfPjkpA+0CWZemaeLQvn6P49QvUiTC1sak2jKFC0sxdCsFg1t7HoYqHJhklAl9Y6 zF0+9rurJq6LA8Ju7QKCZKzNHp/XSk9kZtdgeQVGfk2lfCfck7YkpEtPNJkbo47o0q3u8YXaVhoz0 CSHZ3x3hNR58uhuvUBMWJsyzQS+eT+yEL99FpJeOLUXyYGr+/BLTmb8BJZBXGPVgq8Pa/5hvP3EKF lTSTsevTMktBEQ==; Date: Sat, 21 Oct 2023 16:53:25 +0300 Message-Id: <83il70qdyi.fsf@gnu.org> From: Eli Zaretskii To: dilyan.palauzov@aegee.org In-Reply-To: <83jzrgqeqh.fsf@gnu.org> (message from Eli Zaretskii on Sat, 21 Oct 2023 16:36:38 +0300) Subject: Re: bug#66664: On modified lines containing =?utf-8?B?8J+MkO+4jg==?= and Unicode VS15 in text mode emacs does not show the real content of the lines References: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> <83pm18qh5w.fsf@gnu.org> <7e1f9e947a191eca18429cd20e5e71a4dcd34f2f.camel@aegee.org> <83jzrgqeqh.fsf@gnu.org> MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 66664 Cc: 66664@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > Cc: 66664@debbugs.gnu.org > Date: Sat, 21 Oct 2023 16:36:38 +0300 > From: Eli Zaretskii > > > and prints “Auto-Composition mode disabled in current buffer”. After the change the globe is coloured in the terminal and there is an underscore after the globe. I again press several times the right arrow to go over the letter c and then press x. Emacs again deletes (actually hides) the letter c and shows on its place the letter x. > > Then I cannot reproduce this, nether with nor without > auto-composition-mode. Scratch that, I was mis-reading your description. I can reproduce, and I know the reason: Emacs considers the U+1F310 character to take 2 columns on display, whereas your terminal thinks it takes only one column. That's why you see these problems. From debbugs-submit-bounces@debbugs.gnu.org Sat Oct 21 11:40:37 2023 Received: (at 66664) by debbugs.gnu.org; 21 Oct 2023 15:40:37 +0000 Received: from localhost ([127.0.0.1]:44917 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quE5c-000285-Oq for submit@debbugs.gnu.org; Sat, 21 Oct 2023 11:40:37 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:42386) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quE5Y-00027l-8R for 66664@debbugs.gnu.org; Sat, 21 Oct 2023 11:40:35 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1quE4z-0005JW-81; Sat, 21 Oct 2023 11:39:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-version:References:Subject:In-Reply-To:To:From: Date; bh=ok2xe7vukohM2/Y9yZHKn3/PK4qD/dTnXmTKJQfDk6g=; b=i1lX48AVOTHeZ8+aql9F QTNVbf+4iRjF5TFDkcgfeOPGh8xpOFxyy6j3kb/PUcRVMYQx2ZVbUUeJcLYXViRDjHl/x3xWIlYWA MlvUxPTxGYt0OLA35DnFPdUDVzxNOajTNoNe/lcBxuoQ9RiHCksKTKZ2iSxkaBK9VxAQ6YvT8UVx/ t0jddtx5PgnQIVkf3gzNkCop/FeqI7TmL9/XOjKzt2IhbmRl1/zReVB7XQXxvMPBwU7YUBw92mIVR HZsE5XM7zu8kB439P1OfY4yn6+bebLjmj24rn0l9RuAkXdPDXl9yMx7W4FBLMjLYhXGuLg8aLkXBD 9RDYuV3c1v3naA==; Date: Sat, 21 Oct 2023 18:39:53 +0300 Message-Id: <83fs24q912.fsf@gnu.org> From: Eli Zaretskii To: =?utf-8?B?0JTQuNC70Y/QvSDQn9Cw0LvQsNGD0LfQvtCy?= In-Reply-To: (dilyan.palauzov@aegee.org) Subject: Re: bug#66664: On modified lines containing =?utf-8?B?8J+MkO+4jg==?= and Unicode VS15 in text mode emacs does not show the real content of the lines References: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> <83pm18qh5w.fsf@gnu.org> <7e1f9e947a191eca18429cd20e5e71a4dcd34f2f.camel@aegee.org> <83jzrgqeqh.fsf@gnu.org> <83il70qdyi.fsf@gnu.org> MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 66664 Cc: 66664@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) [Please use Reply All, to keep the bug tracker on the CC list.] > From: Дилян Палаузов > > Date: Sat, 21 Oct 2023 17:25:11 +0200 > > when I load the file the globe appears below “it” from “file edIT options” menu. So at least visually I see two columns. > > Now that you can reproduce the problem, what shall I do? Try M-: (set-char-table-range char-width-table '(#x1f310 . #x1f310) 1) RET But in general, I don't think this problem has a solution, except to use GUI frames. Text-mode terminals don't give a damn, to put it mildly, about Emacs expectations and needs, when display of such advanced character sequences is concerned. They invent their own implementations and de-facto standards, completely disregarding the fact that Emacs was there and did that many years before them. When approached, they basically tell us "our way or the highway". "Their way" isn't going to happen in Emacs, for several good reasons, so here we are. Why are you using a text-mode terminal to edit files with these characters? Why not use a GUI session instead? From debbugs-submit-bounces@debbugs.gnu.org Sun Nov 05 06:56:35 2023 Received: (at 66664) by debbugs.gnu.org; 5 Nov 2023 11:56:36 +0000 Received: from localhost ([127.0.0.1]:36242 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qzbk3-0003rJ-Hf for submit@debbugs.gnu.org; Sun, 05 Nov 2023 06:56:35 -0500 Received: from mail.aegee.org ([144.76.142.78]:42010) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qzbk0-0003r8-Mv for 66664@debbugs.gnu.org; Sun, 05 Nov 2023 06:56:34 -0500 Authentication-Results: mail.aegee.org/3A5BtrLX2151925; auth=pass (LOGIN) smtp.auth=didopalauzov@aegee.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=aegee.org; s=k4096; t=1699185353; i=dkim+MSA-ssl@aegee.org; bh=VO1IdOFrv0E3YU5HIwG79cYryBbEHKLNZaEYQyH0uOo=; h=Subject:From:To:Cc:Date:In-Reply-To:References; b=kmfwM6FH/EkWxK2FZdxawUuQfref8qCgxC2Y+ZfuPAjxOVlus2TIhonBzab1igYkP 4kZ084D6Z0YYHyK2/qHCbrvYYnniJ1rBrqTi/ovbDXHcCy7xzJWfOlxR1bPp9ViQG1 dDV+/is4KHe909vTkhL1lJWvN5DJNajR3IZgl8UnXbCWF+1rPpUdxa0XE9SGt2RMTq pZwesVZtLbBVKDSD+g54NKFizKOLxcfhoAOM+eO11C1FKs0BFPIPDcnUj5n0ltL7JW HGegcd2VI9qbMCTDeyymMd+6yKD93UdW86PQoj102+eMc85hsiJZAPHT8eRQ6XZEKL xZC0gnpzbzwPs/wILViDxQ3uVJvUVI3TlymFY/En2NWIn/Z4We/F2RU394Y7cHLj/Q TEkIuih2PAsXy2Ob2b03+llkPKMEhDV6ENaqxexNsk57q5bBlJg26Q75CYw6f45TM6 F0wN9ylY6J+u9f7Fkaa0BWdQkQk0ew0PLWGvOmmrjgMwl3QmvTFxm22hbYLt+dNMmu hKcBob16oqVZmM87otrtdguzLnG19GDBq/yPQMq2dOjt8bt+IB3elLYAgrys8b68NF yWIXlqNVzwNgrnrP6xTYIM9KhQqYx0UgHjkV/Mf1DLjAbXdYSZH2AqxGcAje3E/zS5 efke+l6K8cHSXXtIZHSWn8hc= Authentication-Results: mail.aegee.org/3A5BtrLX2151925; dkim=none Received: from [10.57.6.126] ([192.19.207.250]) (authenticated bits=0) by mail.aegee.org (8.17.2/8.17.2) with ESMTPSA id 3A5BtrLX2151925 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 5 Nov 2023 11:55:53 GMT Message-ID: <8872328a7ec3b230013dcd74fb214cfbbf87d209.camel@aegee.org> Subject: Re: bug#66664: On modified lines containing =?UTF-8?Q?=F0=9F=8C=90=EF=B8=8E?= and Unicode VS15 in text mode emacs does not show the real content of the lines From: =?UTF-8?Q?=D0=94=D0=B8=D0=BB=D1=8F=D0=BD_?= =?UTF-8?Q?=D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0=BE=D0=B2?= To: Eli Zaretskii Date: Sun, 05 Nov 2023 12:55:53 +0100 In-Reply-To: <83fs24q912.fsf@gnu.org> References: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> <83pm18qh5w.fsf@gnu.org> <7e1f9e947a191eca18429cd20e5e71a4dcd34f2f.camel@aegee.org> <83jzrgqeqh.fsf@gnu.org> <83il70qdyi.fsf@gnu.org> <83fs24q912.fsf@gnu.org> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.51.1 MIME-Version: 1.0 X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 66664 Cc: 66664@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hello Eli, thanks for your answer. I start emacs -nw then M-: shows Eval: I enter= =20 (set-char-table-range char-width-table '(#x1f310 . #x1f310) 1) RET then the mini-buffer shows 1 (#o1, #x1, ?\C-a) I open then the problematic file, go to the problematic line, then to its e= nd (Ctrl+E). Emacs should show the cursor after the last letter on the lin= e, but it does show the cursor over the last letter of the line. > Why are you using a text-mode terminal to edit files with these character= s? Why not use a GUI session instead? I used connect over SSH to some systems, then start emacs and finally chang= e the files there. I see I can first start Emacs-GUI and then =E2=80=9Cfi= nd a file=E2=80=9D starting with /ssh:, which open locally ssh-remote files= . So this is a valid work around. Greetings =D0=94=D0=B8=D0=BB=D1=8F=D0=BD -----Original Message----- From: Eli Zaretskii To: =D0=94=D0=B8=D0=BB=D1=8F=D0=BD =D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0= =BE=D0=B2 Cc: 66664@debbugs.gnu.org Subject: Re: bug#66664: On modified lines containing =F0=9F=8C=90=EF=B8=8E = and Unicode VS15 in text mode emacs does not show the real content of the l= ines Date: 10/21/2023 05:39:53 PM [Please use Reply All, to keep the bug tracker on the CC list.] > From: =D0=94=D0=B8=D0=BB=D1=8F=D0=BD =D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7= =D0=BE=D0=B2 > > Date: Sat, 21 Oct 2023 17:25:11 +0200 >=20 > when I load the file the globe appears below =E2=80=9Cit=E2=80=9D from = =E2=80=9Cfile edIT options=E2=80=9D menu.=C2=A0 So at least visually I see = two columns. >=20 > Now that you can reproduce the problem, what shall I do? Try =C2=A0 M-: (set-char-table-range char-width-table '(#x1f310 . #x1f310) 1) R= ET But in general, I don't think this problem has a solution, except to use GUI frames.=C2=A0 Text-mode terminals don't give a damn, to put it mildly, about Emacs expectations and needs, when display of such advanced character sequences is concerned.=C2=A0 They invent their own implementations and de-facto standards, completely disregarding the fact that Emacs was there and did that many years before them.=C2=A0 When approached, they basically tell us "our way or the highway".=C2=A0 "Their way" isn't going to happen in Emacs, for several good reasons, so here we are. Why are you using a text-mode terminal to edit files with these characters?=C2=A0 Why not use a GUI session instead?