Subject: Re: bug#16733: messed up unicode chars in package description

From: Juanma Barranquero <[email-masked]>
Date: Wed, 19 Mar 2014 17:08:47 +0100

On Wed, Mar 19, 2014 at 4:53 PM, Glenn Morris <[email-masked]> wrote:

> If it works, sounds fine.

Yes, it does.

> (I wonder why doesn't Emacs simply DTRT though.)

Apparently, url-retrieve-synchronously returns a unibyte buffer.

(multibyte-string-p (with-current-buffer
                        (url-retrieve-synchronously "http://es.gnu.org")
                      (buffer-string)))

=> nil

and yet the homepage of GNU España contains non-ASCII chars and its
metadata says it is encoded in utf-8:

C:\> lwp-request -m HEAD http://es.gnu.org
200 OK
[...]
Content-Language: es
Content-Type: text/html; charset=UTF-8
[...]