GNU bug report logs - #8751
24.0.50; CCL is broken

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 8751 in the body.
You can then email your comments to 8751 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Kazuhiro Ito <kzhr <at> d1.dion.ne.jp>
To: bug-gnu-emacs <at> gnu.org
Subject: 24.0.50; CCL is broken
Date: Sat, 28 May 2011 21:49:35 +0900

Below code raises error "Error in CCL program at 4th code" on trunk.

(progn
  (define-ccl-program ccl-test
    '(1 (loop
	 (read r0)
	 (write-repeat r0))))
  (ccl-execute-on-string 'ccl-test (make-vector 9 0) "_"))

-- 
Kazuhiro Ito

Message #8 received at 8751 <at> debbugs.gnu.org (full text, mbox):

From: Kazuhiro Ito <kzhr <at> d1.dion.ne.jp>
To: 8751 <at> debbugs.gnu.org
Subject: Re: bug#8751: 24.0.50; CCL is broken
Date: Mon, 30 May 2011 22:09:30 +0900

The problem may be that ccl-compiler produce negative integer as CCL
code (at latest, since Emacs21).

(ccl-compile
 '(1 (loop
      (read r0)
      (write-repeat r0))))

-> [1 4 14 -506 22]
           ~~~~

But the document of ccl.c says "CCL code is a sequence of 28-bit
non-negative integers", and current ccl.c does not accept such
negative value.  I don't know which whould be changed, ccl-compiler or
document and current ccl.c.

Kazuhiro Ito wrote:
>
> Below code raises error "Error in CCL program at 4th code" on trunk.
> 
> (progn
>   (define-ccl-program ccl-test
>     '(1 (loop
> 	 (read r0)
> 	 (write-repeat r0))))
>   (ccl-execute-on-string 'ccl-test (make-vector 9 0) "_"))

-- 
Kazuhiro Ito

Message #11 received at 8751 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Paul Eggert <eggert <at> cs.ucla.edu>
Cc: Kazuhiro Ito <kzhr <at> d1.dion.ne.jp>, 8751 <at> debbugs.gnu.org
Subject: Re: bug#8751: 24.0.50; CCL is broken
Date: Mon, 30 May 2011 13:01:51 -0300

Paul, can you take a look at this?  It seems this was introduced very
recently, probably by

	* ccl.c (ccl_driver): Redo slightly to avoid the need for 'unsigned'.

	ccl: add integer overflow checks
	* ccl.c (CCL_CODE_MAX, GET_CCL_RANGE, GET_CCL_CODE, GET_CCL_INT):
	(IN_INT_RANGE): New macros.
	(ccl_driver): Use them to check for integer overflow when
	decoding a CCL program.  Many of the new checks are whether XINT (x)
	fits in int; it doesn't always, on 64-bit hosts.  The new version
	doesn't catch all possible integer overflows, but it's an
	improvement.  (Bug#8719)


-- Stefan


>>>>> "Kazuhiro" == Kazuhiro Ito <kzhr <at> d1.dion.ne.jp> writes:

> Below code raises error "Error in CCL program at 4th code" on trunk.
> (progn
>   (define-ccl-program ccl-test
>     '(1 (loop
> 	 (read r0)
> 	 (write-repeat r0))))
>   (ccl-execute-on-string 'ccl-test (make-vector 9 0) "_"))

> -- 
> Kazuhiro Ito

Message #14 received at 8751 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Kazuhiro Ito <kzhr <at> d1.dion.ne.jp>
Cc: 8751 <at> debbugs.gnu.org
Subject: Re: bug#8751: 24.0.50; CCL is broken
Date: Mon, 30 May 2011 13:04:09 -0300

> The problem may be that ccl-compiler produce negative integer as CCL
> code (at latest, since Emacs21).

The negative number is normal (it's due to the relative instruction
address for the backward jump at the end of the loop).  The problem must
be in the ccl.c code.


        Stefan

Message #17 received at 8751 <at> debbugs.gnu.org (full text, mbox):

From: Kazuhiro Ito <kzhr <at> d1.dion.ne.jp>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Paul Eggert <eggert <at> cs.ucla.edu>, 8751 <at> debbugs.gnu.org
Subject: Re: bug#8751: 24.0.50; CCL is broken
Date: Tue, 31 May 2011 08:26:24 +0900

> > The problem may be that ccl-compiler produce negative integer as CCL
> > code (at latest, since Emacs21).
> 
> The negative number is normal (it's due to the relative instruction
> address for the backward jump at the end of the loop).  The problem must
> be in the ccl.c code.

If that is right (and I think so, too), the comment of ccl.c should be
fixed.

> /* CCL code is a sequence of 28-bit non-negative integers (i.e. the
                                      ~~~~~~~~~~~~
>    MSB is always 0), each contains CCL command and/or arguments in the
>    following format:
>
> 	|----------------- integer (28-bit) ------------------|
> 	|------- 17-bit ------|- 3-bit --|- 3-bit --|- 5-bit -|
> 	|--constant argument--|-register-|-register-|-command-|
> 	   ccccccccccccccccc      RRR        rrr       XXXXX
>   or
> 	|------- relative address -------|-register-|-command-|
> 	       cccccccccccccccccccc          rrr       XXXXX
>   or
> 	|------------- constant or other args ----------------|
>                      cccccccccccccccccccccccccccc
>
>    where, `cc...c' is a non-negative integer indicating constant value
                          ~~~~~~~~~~~~
>    (the left most `c' is always 0) or an absolute jump address, `RRR'
>    and `rrr' are CCL register number, `XXXXX' is one of the following
>    CCL commands.  */


Here is a quick fix for actual code, but I don't check whether there
is other problems.

=== modified file 'src/ccl.c'
--- src/ccl.c	2011-05-27 21:24:11 +0000
+++ src/ccl.c	2011-05-30 22:19:52 +0000
@@ -100,6 +100,7 @@
    CCL commands.  */
 
 #define CCL_CODE_MAX ((1 << (28 - 1)) - 1)
+#define CCL_CODE_MIN (- CCL_CODE_MAX - 1)
 
 /* CCL commands
 
@@ -756,7 +757,7 @@
   while (0)
 
 #define GET_CCL_CODE(code, ccl_prog, ic)			\
-  GET_CCL_RANGE (code, ccl_prog, ic, 0, CCL_CODE_MAX)
+  GET_CCL_RANGE (code, ccl_prog, ic, CCL_CODE_MIN, CCL_CODE_MAX)
 
 #define GET_CCL_INT(var, ccl_prog, ic)				\
   GET_CCL_RANGE (var, ccl_prog, ic, INT_MIN, INT_MAX)


-- 
Kazuhiro Ito

Message #22 received at 8751-done <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: Kazuhiro Ito <kzhr <at> d1.dion.ne.jp>
Cc: 8719 <at> debbugs.gnu.org, Stefan Monnier <monnier <at> iro.umontreal.ca>,
	8751-done <at> debbugs.gnu.org
Subject: Re: bug#8751: 24.0.50; CCL is broken
Date: Mon, 30 May 2011 19:16:40 -0700

> Here is a quick fix for actual code, but I don't check whether there
> is other problems.

Thanks, I came up with something similar independently, and installed
a fix into the trunk (bzr 104441).  This fix adjusted the comment as
best I could.

Bug#8719 and Bug#8751 are related so I'll CC: this to bug 8719 to give
Kenichi Handa a heads-up.

Message #25 received at 8751 <at> debbugs.gnu.org (full text, mbox):

From: Kenichi Handa <handa <at> m17n.org>
To: Kazuhiro Ito <kzhr <at> d1.dion.ne.jp>
Cc: eggert <at> cs.ucla.edu, monnier <at> iro.umontreal.ca, 8751 <at> debbugs.gnu.org
Subject: Re: bug#8751: 24.0.50; CCL is broken
Date: Tue, 31 May 2011 14:12:54 +0900

Sorry for the late response on this matter.

In article <20110530232630.273942C803A <at> msa105.auone-net.jp>, Kazuhiro Ito <kzhr <at> d1.dion.ne.jp> writes:

> > > The problem may be that ccl-compiler produce negative integer as CCL
> > > code (at latest, since Emacs21).
> > 
> > The negative number is normal (it's due to the relative instruction
> > address for the backward jump at the end of the loop).  The problem must
> > be in the ccl.c code.

> If that is right (and I think so, too), the comment of ccl.c should be
> fixed.

> > /* CCL code is a sequence of 28-bit non-negative integers (i.e. the

Yes, this comment is wrong.  It seems that I have forgotten
to update it when I changed CCL to accept negative integer.

> Here is a quick fix for actual code, but I don't check whether there
> is other problems.

> === modified file 'src/ccl.c'
> --- src/ccl.c	2011-05-27 21:24:11 +0000
> +++ src/ccl.c	2011-05-30 22:19:52 +0000
> @@ -100,6 +100,7 @@
>     CCL commands.  */
 
>  #define CCL_CODE_MAX ((1 << (28 - 1)) - 1)
> +#define CCL_CODE_MIN (- CCL_CODE_MAX - 1)
 
>  /* CCL commands
 
> @@ -756,7 +757,7 @@
>    while (0)
 
>  #define GET_CCL_CODE(code, ccl_prog, ic)			\
> -  GET_CCL_RANGE (code, ccl_prog, ic, 0, CCL_CODE_MAX)
> +  GET_CCL_RANGE (code, ccl_prog, ic, CCL_CODE_MIN, CCL_CODE_MAX)
 
>  #define GET_CCL_INT(var, ccl_prog, ic)				\
>    GET_CCL_RANGE (var, ccl_prog, ic, INT_MIN, INT_MAX)

Sorry but I still don't have a time to check the recent
change.  If the above patch fixes the code to match with the
following revised comment, it is the right patch.

/* CCL code is a sequence of 28-bit integers, each contains CCL
   command and/or arguments in the following format:

	|----------------- integer (28-bit) ------------------|
	|------- 17-bit ------|- 3-bit --|- 3-bit --|- 5-bit -|
	|--constant argument--|-register-|-register-|-command-|
	   ccccccccccccccccc      RRR        rrr       XXXXX
  or
	|------- relative address -------|-register-|-command-|
	       cccccccccccccccccccc          rrr       XXXXX
  or
	|------------- constant or other args ----------------|
                     cccccccccccccccccccccccccccc

   where, `cc...c' is a 17-bit, 20-bit, or 28-bit integer indicating a
   constant value or a relative/absolute jump address, `RRR' and `rrr'
   are CCL register number, `XXXXX' is one of the following CCL
   command codes.  */

---
Kenichi Handa
handa <at> m17n.org

Message #28 received at 8751 <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: Kenichi Handa <handa <at> m17n.org>
Cc: 8751 <at> debbugs.gnu.org
Subject: Re: bug#8751: 24.0.50; CCL is broken
Date: Mon, 30 May 2011 22:39:47 -0700

On 05/30/11 22:12, Kenichi Handa wrote:
> If the above patch fixes the code to match with the
> following revised comment, it is the right patch.

Thanks, I put that comment in, as bzr 104445.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.