GNU bug report logs - #1033
Indic language rendering problem

Previous Next

Package: emacs;

Reported by: "Parag N(पराग़)" <paragn <at> fedoraproject.org>

Date: Fri, 26 Sep 2008 10:00:02 UTC

Severity: normal

Done: Chong Yidong <cyd <at> stupidchicken.com>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 1033 in the body.
You can then email your comments to 1033 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to "Parag N(पराग़)" <paragn <at> fedoraproject.org>:
New bug report received and forwarded. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #5 received at submit <at> emacsbugs.donarmstrong.com (full text, mbox):

From: "Parag N(पराग़)" <paragn <at> fedoraproject.org>
To: emacs-pretest-bug <at> gnu.org
Subject: Indic language rendering problem
Date: Fri, 26 Sep 2008 15:24:18 +0530
[Message part 1 (text/plain, inline)]
Hi,
      When I tried to view unicode text with emacs23.0.60 snapshot of date
20080801, I see rendering is broken. Combinations of characters are
appearing broken. I have comparsion done on Fedora 10 Beta system with gedit
application. Following is snapshot image link of both applications when
tried to view same file.
 http://paragn.fedorapeople.org/emacs-23.0.60vsgedit-2.23.92.rendering.png
       I tried to set Devanagari but no effects on loaded text file to
correct broken combinations. Also, output of Hello text from
Options->MULE->Multi-lingual Text is broken for Indian languages.
       This is first time I am reporting bug for emacs. If needed please ask
for more input. Sorry If I have not followed any guidelines for reporting
bug ro emacs bugs list.

In GNU Emacs 23.0.60.1 (i386-redhat-linux-gnu, GTK+ Version 2.14.0)
of 2008-09-18 on localhost
Windowing system distributor `The X.Org Foundation', version 11.0.10500000
configured using `configure  '--build=i386-redhat-linux-gnu'
'--host=i386-redhat-linux-gnu' '--target=i386-redhat-linux-gnu'
'--program-prefix=' '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin'
'--sbindir=/usr/sbin' '--sysconfdir=/etc' '--datadir=/usr/share'
'--includedir=/usr/include' '--libdir=/usr/lib' '--libexecdir=/usr/libexec'
'--localstatedir=/var' '--sharedstatedir=/usr/com' '--mandir=/usr/share/man'
'--infodir=/usr/share/info' 'build_alias=i386-redhat-linux-gnu'
'host_alias=i386-redhat-linux-gnu' 'target_alias=i386-redhat-linux-gnu'
'CFLAGS=-DMAIL_USE_LOCKF -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m32 -march=i386
-mtune=generic -fasynchronous-unwind-tables''

Important settings:
 value of $LC_ALL: nil
 value of $LC_COLLATE: nil
 value of $LC_CTYPE: nil
 value of $LC_MESSAGES: nil
 value of $LC_MONETARY: nil
 value of $LC_NUMERIC: nil
 value of $LC_TIME: nil
 value of $LANG: en_US.UTF-8
 value of $XMODIFIERS: nil
 locale-coding-system: utf-8-unix
 default-enable-multibyte-characters: t

Major mode: Text

Minor modes in effect:
 tooltip-mode: t
 tool-bar-mode: t
 mouse-wheel-mode: t
 menu-bar-mode: t
 file-name-shadow-mode: t
 global-font-lock-mode: t
 font-lock-mode: t
 blink-cursor-mode: t
 global-auto-composition-mode: t
 auto-composition-mode: t
 auto-encryption-mode: t
 auto-compression-mode: t
 line-number-mode: t
 transient-mark-mode: t

Recent input:
<help-echo> <help-echo> <help-echo> <down-mouse-5>
<mouse-5> <down-mouse-5> <mouse-5> <double-down-mouse-5>
<double-mouse-5> <triple-down-mouse-5> <triple-mouse-5>
<triple-down-mouse-5> <triple-mouse-5> <triple-down-mouse-5>
<triple-mouse-5> <down-mouse-5> <mouse-5> <double-down-mouse-5>
<double-mouse-5> <triple-down-mouse-5> <triple-mouse-5>
<triple-down-mouse-5> <triple-mouse-5> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <menu-bar>
<help-menu> <send-emacs-bug-report>

Recent messages:
Loading /usr/share/emacs/site-lisp/site-start.d/focus-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/git-init.el (source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/igrep-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/php-mode-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/po-mode-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/rpm-spec-mode-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/rpmdev-init.el
(source)...done
For information about GNU Emacs and the GNU system, type C-h C-a.

Regards,
Parag.
[Message part 2 (text/html, inline)]

Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to Chong Yidong <cyd <at> stupidchicken.com>:
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #10 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: Chong Yidong <cyd <at> stupidchicken.com>
To: paragn <at> fedoraproject.org
Cc: 1033 <at> debbugs.gnu.org
Subject: Indic language rendering problem
Date: Tue, 30 Sep 2008 13:12:25 -0400
>       When I tried to view unicode text with emacs23.0.60 snapshot of
> date 20080801, I see rendering is broken. Combinations of characters
> are appearing broken.

The HELLO file Works for me with a new CVS build.  Does the problem
still occur with latest Emacs CVS?




Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to "Parag N(पराग़)" <paragn <at> fedoraproject.org>:
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #15 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: "Parag N(पराग़)" <paragn <at> fedoraproject.org>
To: "Chong Yidong" <cyd <at> stupidchicken.com>
Cc: 1033 <at> debbugs.gnu.org
Subject: Re: Indic language rendering problem
Date: Wed, 1 Oct 2008 09:54:51 +0530
[Message part 1 (text/plain, inline)]
Hi,

On Tue, Sep 30, 2008 at 10:42 PM, Chong Yidong <cyd <at> stupidchicken.com>wrote:

> >       When I tried to view unicode text with emacs23.0.60 snapshot of
> > date 20080801, I see rendering is broken. Combinations of characters
> > are appearing broken.
>
> The HELLO file Works for me with a new CVS build.  Does the problem
> still occur with latest Emacs CVS?
>

  Yes. I can see problem is still present in CVS build. I got following
details of emacs now
In GNU Emacs 23.0.60.1 (i686-pc-linux-gnu, GTK+ Version 2.14.3)
 of 2008-10-01 on dhcp1-48.pnq.redhat.com
Windowing system distributor `The X.Org Foundation', version 11.0.10500000
configured using `configure  '--prefix=/usr''

How can I help you to fix this issue. If you need some input from me please
ask for same.
Thanks & Regards,
Parag.
[Message part 2 (text/html, inline)]

Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to Chong Yidong <cyd <at> stupidchicken.com>:
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #20 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: Chong Yidong <cyd <at> stupidchicken.com>
To: ""Parag N(पराग़)"" <paragn <at> fedoraproject.org>
Cc: 1033 <at> debbugs.gnu.org
Subject: Re: Indic language rendering problem
Date: Thu, 02 Oct 2008 18:32:00 -0400
[Message part 1 (text/plain, inline)]
""Parag N(पराग़)"" <paragn <at> fedoraproject.org> writes:

>   Yes. I can see problem is still present in CVS build. I got
> following details of emacs now In GNU Emacs 23.0.60.1
> (i686-pc-linux-gnu, GTK+ Version 2.14.3) of 2008-10-01 on
> dhcp1-48.pnq.redhat.com Windowing system distributor `The X.Org
> Foundation', version 11.0.10500000 configured using `configure
> '--prefix=/usr''
>
> How can I help you to fix this issue. If you need some input from me
> please ask for same.

I don't read Devanagari, so I can't tell if the script is rendered
incorrectly (gedit doesn't seem to render the HELLO file at all).
Here's a screenshot of the HELLO file that I see.  Leaving aside the
blank boxes (the font I'm using apparently doesn't contain all the
glyphs), is the file shown correctly?

[hello.png (image/png, attachment)]

Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to "Parag N(पराग़)" <paragn <at> fedoraproject.org>:
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #25 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: "Parag N(पराग़)" <paragn <at> fedoraproject.org>
To: "Chong Yidong" <cyd <at> stupidchicken.com>
Cc: 1033 <at> debbugs.gnu.org
Subject: Re: Indic language rendering problem
Date: Fri, 3 Oct 2008 14:53:17 +0530
[Message part 1 (text/plain, inline)]
Hi,
On Fri, Oct 3, 2008 at 4:02 AM, Chong Yidong <cyd <at> stupidchicken.com> wrote:

> ""Parag N(पराग़)"" <paragn <at> fedoraproject.org> writes:
>
> >   Yes. I can see problem is still present in CVS build. I got
> > following details of emacs now In GNU Emacs 23.0.60.1
> > (i686-pc-linux-gnu, GTK+ Version 2.14.3) of 2008-10-01 on
> > dhcp1-48.pnq.redhat.com Windowing system distributor `The X.Org
> > Foundation', version 11.0.10500000 configured using `configure
> > '--prefix=/usr''
> >
> > How can I help you to fix this issue. If you need some input from me
> > please ask for same.
>
> I don't read Devanagari, so I can't tell if the script is rendered
> incorrectly (gedit doesn't seem to render the HELLO file at all).
> Here's a screenshot of the HELLO file that I see.  Leaving aside the
> blank boxes (the font I'm using apparently doesn't contain all the
> glyphs), is the file shown correctly?
>

   Please have a look at image I posted in my initial mail. Its available
at
http://paragn.fedorapeople.org/emacs-23.0.60vsgedit-2.23.92.rendering.png
  From that you can see required rendering for Indic text should be from
left side(gedit application rendering output) whereas emacs is showing wrong
rendering for same text.

Thanks & Regards,
Parag.
[Message part 2 (text/html, inline)]

Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to "Parag N(पराग़)" <panemade <at> gmail.com>:
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #30 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: "Parag N(पराग़)" <panemade <at> gmail.com>
To: "Chong Yidong" <cyd <at> stupidchicken.com>
Cc: 1033 <at> debbugs.gnu.org
Subject: Re: Indic language rendering problem
Date: Fri, 3 Oct 2008 15:08:35 +0530
[Message part 1 (text/plain, inline)]
Hi again,

On Fri, Oct 3, 2008 at 2:53 PM, Parag N(पराग़) <paragn <at> fedoraproject.org>wrote:

> Hi,
> On Fri, Oct 3, 2008 at 4:02 AM, Chong Yidong <cyd <at> stupidchicken.com>wrote:
>
>> ""Parag N(पराग़)"" <paragn <at> fedoraproject.org> writes:
>>
>> >   Yes. I can see problem is still present in CVS build. I got
>> > following details of emacs now In GNU Emacs 23.0.60.1
>> > (i686-pc-linux-gnu, GTK+ Version 2.14.3) of 2008-10-01 on
>> > dhcp1-48.pnq.redhat.com Windowing system distributor `The X.Org
>> > Foundation', version 11.0.10500000 configured using `configure
>> > '--prefix=/usr''
>> >
>> > How can I help you to fix this issue. If you need some input from me
>> > please ask for same.
>>
>> I don't read Devanagari, so I can't tell if the script is rendered
>> incorrectly (gedit doesn't seem to render the HELLO file at all).
>> Here's a screenshot of the HELLO file that I see.  Leaving aside the
>> blank boxes (the font I'm using apparently doesn't contain all the
>> glyphs), is the file shown correctly?
>
>
         Sorry, I missed to answer above question. Yes image you gave is
showing wrong rendering. I have created one more screenshot of comparison
between Gedit and Emacs applications rendering for Hello text. Its available
at  http://paragn.fedorapeople.org/GeditvsEmacs_hellotext.png


>    Please have a look at image I posted in my initial mail. Its available
> at
> http://paragn.fedorapeople.org/emacs-23.0.60vsgedit-2.23.92.rendering.png
>   From that you can see required rendering for Indic text should be from
> left side(gedit application rendering output) whereas emacs is showing wrong
> rendering for same text.
>
> Thanks & Regards,
> Parag.
>
>
[Message part 2 (text/html, inline)]

Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to wahjava <at> gmail.com (Ashish Shukla आशीष शुक्ल):
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #35 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: wahjava <at> gmail.com (Ashish Shukla आशीष शुक्ल)
To: 1033 <at> debbugs.gnu.org
Cc: paragn <at> fedoraproject.org
Subject: Re: Indic language rendering problem
Date: Wed, 19 Nov 2008 23:04:47 +0530
[Message part 1 (text/plain, inline)]
Hi Parag,

I reported similar bug (# 320) in May, 2008 where it is concluded that Emacs
is not selecting the proper font for Indic script, for which I've applied the
following temporary workaround for Devanagari script rendering to force the
use of "Lohit Hindi" font.

,---- M-x my-setup-devanagari-rendering
| (defun my-setup-devanagari-rendering()
|   "Setup devanagari rendering"
|   (interactive)
|   (set-fontset-font "fontset-default"
| 					(cons (decode-char 'ucs ?\x0900)
| 						  (decode-char 'ucs ?\x097f))
| 					"Lohit Hindi-12"))
`----

But that problem also went away in June or July, 2008, IIRC. So, that
workaround is not needed anymore. Following is the link to the screenshot of
the HELLO file rendered in "GNU Emacs 23.0.60.1 (x86_64-pc-linux-gnu, X
toolkit, Xaw3d scroll bars) of 2008-11-16 on chateau":

http://flickr.com/photos/wahjava/3043187881/

What I think, the problem at your end will be is lack of m17n support in
Emacs. Following is the './configure' command line of my Emacs build:

,----
| ./configure '--prefix=/usr' '--host=x86_64-pc-linux-gnu'
| '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--datadir=/usr/share'
| '--sysconfdir=/etc' '--localstatedir=/var/lib' '--program-suffix=-emacs-23'
| '--infodir=/usr/share/info/emacs-23' '--with-sound' '--with-x'
| '--with-toolkit-scroll-bars' '--with-gif' '--with-jpeg' '--with-png'
| '--with-rsvg' '--with-tiff' '--with-xpm' '--with-freetype' '--with-xft'
| '--with-libotf' '--with-m17n-flt' '--with-x-toolkit=athena' '--without-hesiod'
| '--without-kerberos' '--without-kerberos5' '--with-gpm' '--with-dbus'
| '--libdir=/usr/lib64' '--build=x86_64-pc-linux-gnu'
| 'build_alias=x86_64-pc-linux-gnu' 'host_alias=x86_64-pc-linux-gnu' 'CFLAGS=-O2
| -pipe -mtune=nocona -march=nocona -ggdb' 'LDFLAGS=-Wl,--hash-style,both' 
`----

To figure out which font is used to render a particular character, move cursor
to the character and do "C-u C-x =" as pointed to me by Kenichi Handa.

HTH
-- 
Ashish Shukla
[Message part 2 (application/pgp-signature, inline)]

Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to "Parag N(पराग़)" <paragn <at> fedoraproject.org>:
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #40 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: "Parag N(पराग़)" <paragn <at> fedoraproject.org>
To: "Ashish Shukla आशीष शुक्ल" <wahjava <at> gmail.com>
Cc: 1033 <at> debbugs.gnu.org
Subject: Re: Indic language rendering problem
Date: Mon, 24 Nov 2008 12:06:56 +0530
[Message part 1 (text/plain, inline)]
Hi Ashish,
On Wed, Nov 19, 2008 at 11:04 PM, Ashish Shukla आशीष शुक्ल <
wahjava <at> gmail.com> wrote:

> Hi Parag,
>
> I reported similar bug (# 320) in May, 2008 where it is concluded that
> Emacs
> is not selecting the proper font for Indic script, for which I've applied
> the
> following temporary workaround for Devanagari script rendering to force the
> use of "Lohit Hindi" font.
>
> ,---- M-x my-setup-devanagari-rendering
> | (defun my-setup-devanagari-rendering()
> |   "Setup devanagari rendering"
> |   (interactive)
> |   (set-fontset-font "fontset-default"
> |                                       (cons (decode-char 'ucs ?\x0900)
> |                                                 (decode-char 'ucs
> ?\x097f))
> |                                       "Lohit Hindi-12"))
> `----
>
> But that problem also went away in June or July, 2008, IIRC. So, that
> workaround is not needed anymore. Following is the link to the screenshot
> of
> the HELLO file rendered in "GNU Emacs 23.0.60.1 (x86_64-pc-linux-gnu, X
> toolkit, Xaw3d scroll bars) of 2008-11-16 on chateau":
>
> http://flickr.com/photos/wahjava/3043187881/
>
> What I think, the problem at your end will be is lack of m17n support in
> Emacs. Following is the './configure' command line of my Emacs build:
>
> ,----
> | ./configure '--prefix=/usr' '--host=x86_64-pc-linux-gnu'
> | '--mandir=/usr/share/man' '--infodir=/usr/share/info'
> '--datadir=/usr/share'
> | '--sysconfdir=/etc' '--localstatedir=/var/lib'
> '--program-suffix=-emacs-23'
> | '--infodir=/usr/share/info/emacs-23' '--with-sound' '--with-x'
> | '--with-toolkit-scroll-bars' '--with-gif' '--with-jpeg' '--with-png'
> | '--with-rsvg' '--with-tiff' '--with-xpm' '--with-freetype' '--with-xft'
> | '--with-libotf' '--with-m17n-flt' '--with-x-toolkit=athena'
> '--without-hesiod'
> | '--without-kerberos' '--without-kerberos5' '--with-gpm' '--with-dbus'
> | '--libdir=/usr/lib64' '--build=x86_64-pc-linux-gnu'
> | 'build_alias=x86_64-pc-linux-gnu' 'host_alias=x86_64-pc-linux-gnu'
> 'CFLAGS=-O2
> | -pipe -mtune=nocona -march=nocona -ggdb' 'LDFLAGS=-Wl,--hash-style,both'
> `----
>
> To figure out which font is used to render a particular character, move
> cursor
> to the character and do "C-u C-x =" as pointed to me by Kenichi Handa.
>

         Thanks very much. I now got correct rendering for Indic languages
in emacs.

Regards,
Parag.
[Message part 2 (text/html, inline)]

Information forwarded to bug-submit-list <at> lists.donarmstrong.com, Emacs Bugs <bug-gnu-emacs <at> gnu.org>:
bug#1033; Package emacs. Full text and rfc822 format available.

Acknowledgement sent to wahjava <at> gmail.com (Ashish Shukla आशीष शुक्ल):
Extra info received and forwarded to list. Copy sent to Emacs Bugs <bug-gnu-emacs <at> gnu.org>. Full text and rfc822 format available.

Message #45 received at 1033 <at> emacsbugs.donarmstrong.com (full text, mbox):

From: wahjava <at> gmail.com (Ashish Shukla आशीष शुक्ल)
To: ""Parag N(पराग़)"" <paragn <at> fedoraproject.org>
Cc: 1033 <at> debbugs.gnu.org
Subject: Re: Indic language rendering problem
Date: Mon, 24 Nov 2008 13:44:17 +0530
[Message part 1 (text/plain, inline)]
"Parag N(पराग़)" writes:

[snip]

>          Thanks very much. I now got correct rendering for Indic languages in emacs.

Cool :)
-- 
Ashish Shukla
[Message part 2 (application/pgp-signature, inline)]

bug closed, send any further explanations to "Parag N(पराग़)" <paragn <at> fedoraproject.org> Request was from Chong Yidong <cyd <at> stupidchicken.com> to control <at> emacsbugs.donarmstrong.com. (Wed, 26 Nov 2008 22:15:04 GMT) Full text and rfc822 format available.

bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> emacsbugs.donarmstrong.com. (Thu, 25 Dec 2008 15:24:04 GMT) Full text and rfc822 format available.

This bug report was last modified 16 years and 241 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.