From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Tassilo Horn Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 15:22:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: 19393@debbugs.gnu.org X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.141874330514088 (code B ref -1); Tue, 16 Dec 2014 15:22:02 +0000 Received: (at submit) by debbugs.gnu.org; 16 Dec 2014 15:21:45 +0000 Received: from localhost ([127.0.0.1]:47989 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0twU-0003f8-94 for submit@debbugs.gnu.org; Tue, 16 Dec 2014 10:21:44 -0500 Received: from eggs.gnu.org ([208.118.235.92]:44130) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0twQ-0003ey-C3 for submit@debbugs.gnu.org; Tue, 16 Dec 2014 10:21:40 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Y0twI-0001vR-GA for submit@debbugs.gnu.org; Tue, 16 Dec 2014 10:21:38 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:35284) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Y0twI-0001vN-Cu for submit@debbugs.gnu.org; Tue, 16 Dec 2014 10:21:30 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:45801) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Y0tw9-0003lG-Al for bug-gnu-emacs@gnu.org; Tue, 16 Dec 2014 10:21:30 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Y0tw3-0001sC-Bn for bug-gnu-emacs@gnu.org; Tue, 16 Dec 2014 10:21:21 -0500 Received: from deliver.uni-koblenz.de ([141.26.64.15]:53047) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Y0tw2-0001rj-Tt for bug-gnu-emacs@gnu.org; Tue, 16 Dec 2014 10:21:15 -0500 Received: from localhost (localhost [127.0.0.1]) by deliver.uni-koblenz.de (Postfix) with ESMTP id 9B7671A856D for ; Tue, 16 Dec 2014 16:21:13 +0100 (CET) X-Virus-Scanned: amavisd-new at uni-koblenz.de Received: from deliver.uni-koblenz.de ([127.0.0.1]) by localhost (deliver.uni-koblenz.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LggJ-8B1iLWs for ; Tue, 16 Dec 2014 16:21:11 +0100 (CET) X-CHKRCPT: Envelopesender noch tsdh@gnu.org Received: from thinkpad-t440p.tsdh.org (dhcp208.uni-koblenz.de [141.26.71.208]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by deliver.uni-koblenz.de (Postfix) with ESMTPSA id 806F61A856A for ; Tue, 16 Dec 2014 16:21:11 +0100 (CET) From: Tassilo Horn Date: Tue, 16 Dec 2014 16:21:10 +0100 Message-ID: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) I've dowloaded the following file ftp://ftp.fu-berlin.de/pub/misc/movies/database/movies.list.gz which contains all movies known to the international movie database (IMDb.com). When I open that file using "emacs -Q movies.list.gz" (or unzip it first) and then do M-x describe-coding-system I can see that it is "t -- raw-text-unix". As a result of this, the last movie in that file is displayed as "\374\347 (2012) 2012". However, according to the `file' command, the file is plain ISO-8859. And I can easily convert it to UTF-8 using % iconv -f ISO-8859-15 -t UTF-8 < movies.list > movies.list.utf8 without any encoding errors being reported. Emacs can guess the encoding of the resulting UTF-8 encoded file movies.list.utf8, i.e., the coding system when opening the file is "U -- utf-8-unix". Emacs shows the last movie as "=C3=BC=C3=A7 (2012) 2012" whic= h is correct. I also tried % iconv -f ISO-8859-15 -t ISO-8859-15 < movies.list > movies.list.iso-8859 but for the result file movies.list.iso-8859 the same issue as for the original file applies, i.e., Emacs uses the encoding "t -- raw-text-unix" and displays garbage for all non-ASCII characters. I also can't force Emacs to use ISO-8859 for that or the original file. `C-x RET f iso-8859-15 RET' results in a query that certain characters cannot be encoded using latin-9, e.g., \374 and \347, and I'm expected to choose another encoding. So `file' and `iconv' say the file is valid latin-9 but Emacs seems to disagree. Who is correct? I tend towards file/iconv but I might be wrong. And shouldn't it be possible to force Emacs to a certain coding system? I mean, even if a file's content has a broken encoding, e.g., coding X in part A, coding Y in part B, I might want to switch to X in order to be able to read part A at all. (Ok, in that case I should get a big fat warning that saving the buffer will corrupt the file even more. Or maybe the buffer should become read-only...) The issue can be reproduced also with the other IMDb files containing non-ASCII chars, e.g., actors.list.gz, actresses.list.gz, etc. They are all available in the FTP directory above. In GNU Emacs 25.0.50.10 (x86_64-unknown-linux-gnu, GTK+ Version 3.14.5) of 2014-12-16 on thinkpad-t440p Repository revision: 15426191a1353ac208d8ebe4a5920228e0df41a4 Windowing system distributor `The X.Org Foundation', version 11.0.11602901 System Description: Arch Linux Configured features: XPM JPEG TIFF GIF PNG RSVG IMAGEMAGICK SOUND GPM DBUS GCONF GSETTINGS NOTIFY ACL GNUTLS LIBXML2 FREETYPE M17N_FLT LIBOTF XFT ZLIB Important settings: value of $LC_MONETARY: de_DE.utf8 value of $LC_NUMERIC: de_DE.utf8 value of $LC_TIME: de_DE.utf8 value of $LANG: en_US.utf8 locale-coding-system: utf-8-unix Major mode: Group Minor modes in effect: TeX-PDF-mode: t TeX-source-correlate-mode: t diff-auto-refine-mode: t gnus-topic-mode: t hl-line-mode: t global-company-mode: t global-aggressive-indent-mode: t gnus-undo-mode: t global-edit-server-edit-mode: t recentf-mode: t shell-dirtrack-mode: t helm-match-plugin-mode: t helm-occur-match-plugin-mode: t global-subword-mode: t subword-mode: t savehist-mode: t show-paren-mode: t icomplete-mode: t minibuffer-depth-indicate-mode: t electric-pair-mode: t tooltip-mode: t global-eldoc-mode: t electric-indent-mode: t mouse-wheel-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t blink-cursor-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t buffer-read-only: t column-number-mode: t line-number-mode: t Recent messages: Buffer dictionary was nil Ispell process killed Local Ispell dictionary set to en Buffer dictionary is now en Starting new Ispell process /usr/bin/aspell with en dictionary... Checking region... Spell Checking...100% [diss] Spell Checking completed. Quit Auto-saving... Load-path shadows: ~/Repos/el/auctex/lpath hides ~/Repos/el/gnus/lisp/lpath ~/Repos/el/gnus/lisp/md4 hides /home/horn/Repos/el/emacs/lisp/md4 ~/Repos/el/gnus/lisp/color hides /home/horn/Repos/el/emacs/lisp/color ~/Repos/el/gnus/lisp/format-spec hides /home/horn/Repos/el/emacs/lisp/forma= t-spec ~/Repos/el/gnus/lisp/password-cache hides /home/horn/Repos/el/emacs/lisp/pa= ssword-cache ~/Repos/el/gnus/lisp/hex-util hides /home/horn/Repos/el/emacs/lisp/hex-util ~/Repos/el/gnus/lisp/dns-mode hides /home/horn/Repos/el/emacs/lisp/textmode= s/dns-mode /home/horn/.emacs.d/elpa/org-20141215/ob-plantuml hides /home/horn/Repos/el= /emacs/lisp/org/ob-plantuml /home/horn/.emacs.d/elpa/org-20141215/org-archive hides /home/horn/Repos/el= /emacs/lisp/org/org-archive /home/horn/.emacs.d/elpa/org-20141215/org-w3m hides /home/horn/Repos/el/ema= cs/lisp/org/org-w3m /home/horn/.emacs.d/elpa/org-20141215/ox-org hides /home/horn/Repos/el/emac= s/lisp/org/ox-org /home/horn/.emacs.d/elpa/org-20141215/ob hides /home/horn/Repos/el/emacs/li= sp/org/ob /home/horn/.emacs.d/elpa/org-20141215/org-faces hides /home/horn/Repos/el/e= macs/lisp/org/org-faces /home/horn/.emacs.d/elpa/org-20141215/ob-awk hides /home/horn/Repos/el/emac= s/lisp/org/ob-awk /home/horn/.emacs.d/elpa/org-20141215/org-habit hides /home/horn/Repos/el/e= macs/lisp/org/org-habit /home/horn/.emacs.d/elpa/org-20141215/ob-sass hides /home/horn/Repos/el/ema= cs/lisp/org/ob-sass /home/horn/.emacs.d/elpa/org-20141215/org-ctags hides /home/horn/Repos/el/e= macs/lisp/org/org-ctags /home/horn/.emacs.d/elpa/org-20141215/ob-screen hides /home/horn/Repos/el/e= macs/lisp/org/ob-screen /home/horn/.emacs.d/elpa/org-20141215/ox-md hides /home/horn/Repos/el/emacs= /lisp/org/ox-md /home/horn/.emacs.d/elpa/org-20141215/ox-beamer hides /home/horn/Repos/el/e= macs/lisp/org/ox-beamer /home/horn/.emacs.d/elpa/org-20141215/org-loaddefs hides /home/horn/Repos/e= l/emacs/lisp/org/org-loaddefs /home/horn/.emacs.d/elpa/org-20141215/ob-perl hides /home/horn/Repos/el/ema= cs/lisp/org/ob-perl /home/horn/.emacs.d/elpa/org-20141215/org-rmail hides /home/horn/Repos/el/e= macs/lisp/org/org-rmail /home/horn/.emacs.d/elpa/org-20141215/org-id hides /home/horn/Repos/el/emac= s/lisp/org/org-id /home/horn/.emacs.d/elpa/org-20141215/ox-publish hides /home/horn/Repos/el/= emacs/lisp/org/ox-publish /home/horn/.emacs.d/elpa/org-20141215/ob-maxima hides /home/horn/Repos/el/e= macs/lisp/org/ob-maxima /home/horn/.emacs.d/elpa/org-20141215/org-install hides /home/horn/Repos/el= /emacs/lisp/org/org-install /home/horn/.emacs.d/elpa/org-20141215/org-feed hides /home/horn/Repos/el/em= acs/lisp/org/org-feed /home/horn/.emacs.d/elpa/org-20141215/ob-R hides /home/horn/Repos/el/emacs/= lisp/org/ob-R /home/horn/.emacs.d/elpa/org-20141215/ox-latex hides /home/horn/Repos/el/em= acs/lisp/org/ox-latex /home/horn/.emacs.d/elpa/org-20141215/org-timer hides /home/horn/Repos/el/e= macs/lisp/org/org-timer /home/horn/.emacs.d/elpa/org-20141215/ob-core hides /home/horn/Repos/el/ema= cs/lisp/org/ob-core /home/horn/.emacs.d/elpa/org-20141215/org-datetree hides /home/horn/Repos/e= l/emacs/lisp/org/org-datetree /home/horn/.emacs.d/elpa/org-20141215/ob-sql hides /home/horn/Repos/el/emac= s/lisp/org/ob-sql /home/horn/.emacs.d/elpa/org-20141215/ob-js hides /home/horn/Repos/el/emacs= /lisp/org/ob-js /home/horn/.emacs.d/elpa/org-20141215/ob-tangle hides /home/horn/Repos/el/e= macs/lisp/org/ob-tangle /home/horn/.emacs.d/elpa/org-20141215/org-capture hides /home/horn/Repos/el= /emacs/lisp/org/org-capture /home/horn/.emacs.d/elpa/org-20141215/ob-haskell hides /home/horn/Repos/el/= emacs/lisp/org/ob-haskell /home/horn/.emacs.d/elpa/org-20141215/ob-dot hides /home/horn/Repos/el/emac= s/lisp/org/ob-dot /home/horn/.emacs.d/elpa/org-20141215/ob-exp hides /home/horn/Repos/el/emac= s/lisp/org/ob-exp /home/horn/.emacs.d/elpa/org-20141215/org-info hides /home/horn/Repos/el/em= acs/lisp/org/org-info /home/horn/.emacs.d/elpa/org-20141215/ob-octave hides /home/horn/Repos/el/e= macs/lisp/org/ob-octave /home/horn/.emacs.d/elpa/org-20141215/org-mobile hides /home/horn/Repos/el/= emacs/lisp/org/org-mobile /home/horn/.emacs.d/elpa/org-20141215/org-indent hides /home/horn/Repos/el/= emacs/lisp/org/org-indent /home/horn/.emacs.d/elpa/org-20141215/org-attach hides /home/horn/Repos/el/= emacs/lisp/org/org-attach /home/horn/.emacs.d/elpa/org-20141215/ob-java hides /home/horn/Repos/el/ema= cs/lisp/org/ob-java /home/horn/.emacs.d/elpa/org-20141215/org-mhe hides /home/horn/Repos/el/ema= cs/lisp/org/org-mhe /home/horn/.emacs.d/elpa/org-20141215/ob-scheme hides /home/horn/Repos/el/e= macs/lisp/org/ob-scheme /home/horn/.emacs.d/elpa/org-20141215/ob-lob hides /home/horn/Repos/el/emac= s/lisp/org/ob-lob /home/horn/.emacs.d/elpa/org-20141215/ob-calc hides /home/horn/Repos/el/ema= cs/lisp/org/ob-calc /home/horn/.emacs.d/elpa/org-20141215/org-agenda hides /home/horn/Repos/el/= emacs/lisp/org/org-agenda /home/horn/.emacs.d/elpa/org-20141215/org-version hides /home/horn/Repos/el= /emacs/lisp/org/org-version /home/horn/.emacs.d/elpa/org-20141215/org-clock hides /home/horn/Repos/el/e= macs/lisp/org/org-clock /home/horn/.emacs.d/elpa/org-20141215/org-macro hides /home/horn/Repos/el/e= macs/lisp/org/org-macro /home/horn/.emacs.d/elpa/org-20141215/ob-fortran hides /home/horn/Repos/el/= emacs/lisp/org/ob-fortran /home/horn/.emacs.d/elpa/org-20141215/ob-picolisp hides /home/horn/Repos/el= /emacs/lisp/org/ob-picolisp /home/horn/.emacs.d/elpa/org-20141215/ob-mscgen hides /home/horn/Repos/el/e= macs/lisp/org/ob-mscgen /home/horn/.emacs.d/elpa/org-20141215/ox-texinfo hides /home/horn/Repos/el/= emacs/lisp/org/ox-texinfo /home/horn/.emacs.d/elpa/org-20141215/org-table hides /home/horn/Repos/el/e= macs/lisp/org/org-table /home/horn/.emacs.d/elpa/org-20141215/ob-matlab hides /home/horn/Repos/el/e= macs/lisp/org/ob-matlab /home/horn/.emacs.d/elpa/org-20141215/ox-html hides /home/horn/Repos/el/ema= cs/lisp/org/ox-html /home/horn/.emacs.d/elpa/org-20141215/ox-icalendar hides /home/horn/Repos/e= l/emacs/lisp/org/ox-icalendar /home/horn/.emacs.d/elpa/org-20141215/org-bbdb hides /home/horn/Repos/el/em= acs/lisp/org/org-bbdb /home/horn/.emacs.d/elpa/org-20141215/ob-asymptote hides /home/horn/Repos/e= l/emacs/lisp/org/ob-asymptote /home/horn/.emacs.d/elpa/org-20141215/org-eshell hides /home/horn/Repos/el/= emacs/lisp/org/org-eshell /home/horn/.emacs.d/elpa/org-20141215/ob-comint hides /home/horn/Repos/el/e= macs/lisp/org/ob-comint /home/horn/.emacs.d/elpa/org-20141215/org hides /home/horn/Repos/el/emacs/l= isp/org/org /home/horn/.emacs.d/elpa/org-20141215/org-irc hides /home/horn/Repos/el/ema= cs/lisp/org/org-irc /home/horn/.emacs.d/elpa/org-20141215/ob-table hides /home/horn/Repos/el/em= acs/lisp/org/ob-table /home/horn/.emacs.d/elpa/org-20141215/ob-scala hides /home/horn/Repos/el/em= acs/lisp/org/ob-scala /home/horn/.emacs.d/elpa/org-20141215/ob-io hides /home/horn/Repos/el/emacs= /lisp/org/ob-io /home/horn/.emacs.d/elpa/org-20141215/ox-ascii hides /home/horn/Repos/el/em= acs/lisp/org/ox-ascii /home/horn/.emacs.d/elpa/org-20141215/ob-lisp hides /home/horn/Repos/el/ema= cs/lisp/org/ob-lisp /home/horn/.emacs.d/elpa/org-20141215/org-macs hides /home/horn/Repos/el/em= acs/lisp/org/org-macs /home/horn/.emacs.d/elpa/org-20141215/ob-sqlite hides /home/horn/Repos/el/e= macs/lisp/org/ob-sqlite /home/horn/.emacs.d/elpa/org-20141215/ob-latex hides /home/horn/Repos/el/em= acs/lisp/org/ob-latex /home/horn/.emacs.d/elpa/org-20141215/ob-css hides /home/horn/Repos/el/emac= s/lisp/org/ob-css /home/horn/.emacs.d/elpa/org-20141215/org-protocol hides /home/horn/Repos/e= l/emacs/lisp/org/org-protocol /home/horn/.emacs.d/elpa/org-20141215/ob-keys hides /home/horn/Repos/el/ema= cs/lisp/org/ob-keys /home/horn/.emacs.d/elpa/org-20141215/org-mouse hides /home/horn/Repos/el/e= macs/lisp/org/org-mouse /home/horn/.emacs.d/elpa/org-20141215/ob-ruby hides /home/horn/Repos/el/ema= cs/lisp/org/ob-ruby /home/horn/.emacs.d/elpa/org-20141215/org-element hides /home/horn/Repos/el= /emacs/lisp/org/org-element /home/horn/.emacs.d/elpa/org-20141215/org-bibtex hides /home/horn/Repos/el/= emacs/lisp/org/org-bibtex /home/horn/.emacs.d/elpa/org-20141215/ob-C hides /home/horn/Repos/el/emacs/= lisp/org/ob-C /home/horn/.emacs.d/elpa/org-20141215/org-src hides /home/horn/Repos/el/ema= cs/lisp/org/org-src /home/horn/.emacs.d/elpa/org-20141215/ob-makefile hides /home/horn/Repos/el= /emacs/lisp/org/ob-makefile /home/horn/.emacs.d/elpa/org-20141215/org-colview hides /home/horn/Repos/el= /emacs/lisp/org/org-colview /home/horn/.emacs.d/elpa/org-20141215/ob-ledger hides /home/horn/Repos/el/e= macs/lisp/org/ob-ledger /home/horn/.emacs.d/elpa/org-20141215/org-crypt hides /home/horn/Repos/el/e= macs/lisp/org/org-crypt /home/horn/.emacs.d/elpa/org-20141215/ob-shen hides /home/horn/Repos/el/ema= cs/lisp/org/ob-shen /home/horn/.emacs.d/elpa/org-20141215/ob-gnuplot hides /home/horn/Repos/el/= emacs/lisp/org/ob-gnuplot /home/horn/.emacs.d/elpa/org-20141215/org-inlinetask hides /home/horn/Repos= /el/emacs/lisp/org/org-inlinetask /home/horn/.emacs.d/elpa/org-20141215/org-gnus hides /home/horn/Repos/el/em= acs/lisp/org/org-gnus /home/horn/.emacs.d/elpa/org-20141215/ob-sh hides /home/horn/Repos/el/emacs= /lisp/org/ob-sh /home/horn/.emacs.d/elpa/org-20141215/org-pcomplete hides /home/horn/Repos/= el/emacs/lisp/org/org-pcomplete /home/horn/.emacs.d/elpa/org-20141215/org-docview hides /home/horn/Repos/el= /emacs/lisp/org/org-docview /home/horn/.emacs.d/elpa/org-20141215/ox-man hides /home/horn/Repos/el/emac= s/lisp/org/ox-man /home/horn/.emacs.d/elpa/org-20141215/org-plot hides /home/horn/Repos/el/em= acs/lisp/org/org-plot /home/horn/.emacs.d/elpa/org-20141215/ox hides /home/horn/Repos/el/emacs/li= sp/org/ox /home/horn/.emacs.d/elpa/org-20141215/ob-python hides /home/horn/Repos/el/e= macs/lisp/org/ob-python /home/horn/.emacs.d/elpa/org-20141215/ob-eval hides /home/horn/Repos/el/ema= cs/lisp/org/ob-eval /home/horn/.emacs.d/elpa/org-20141215/ob-clojure hides /home/horn/Repos/el/= emacs/lisp/org/ob-clojure /home/horn/.emacs.d/elpa/org-20141215/ob-ocaml hides /home/horn/Repos/el/em= acs/lisp/org/ob-ocaml /home/horn/.emacs.d/elpa/org-20141215/ox-odt hides /home/horn/Repos/el/emac= s/lisp/org/ox-odt /home/horn/.emacs.d/elpa/org-20141215/org-compat hides /home/horn/Repos/el/= emacs/lisp/org/org-compat /home/horn/.emacs.d/elpa/org-20141215/org-list hides /home/horn/Repos/el/em= acs/lisp/org/org-list /home/horn/.emacs.d/elpa/org-20141215/ob-emacs-lisp hides /home/horn/Repos/= el/emacs/lisp/org/ob-emacs-lisp /home/horn/.emacs.d/elpa/org-20141215/org-entities hides /home/horn/Repos/e= l/emacs/lisp/org/org-entities /home/horn/.emacs.d/elpa/org-20141215/ob-ref hides /home/horn/Repos/el/emac= s/lisp/org/ob-ref /home/horn/.emacs.d/elpa/org-20141215/ob-ditaa hides /home/horn/Repos/el/em= acs/lisp/org/ob-ditaa /home/horn/.emacs.d/elpa/org-20141215/ob-lilypond hides /home/horn/Repos/el= /emacs/lisp/org/ob-lilypond /home/horn/.emacs.d/elpa/org-20141215/ob-org hides /home/horn/Repos/el/emac= s/lisp/org/ob-org /home/horn/.emacs.d/elpa/org-20141215/org-footnote hides /home/horn/Repos/e= l/emacs/lisp/org/org-footnote ~/Repos/el/gnus/lisp/dig hides /home/horn/Repos/el/emacs/lisp/net/dig ~/Repos/el/gnus/lisp/hmac-md5 hides /home/horn/Repos/el/emacs/lisp/net/hmac= -md5 ~/Repos/el/gnus/lisp/ntlm hides /home/horn/Repos/el/emacs/lisp/net/ntlm ~/Repos/el/gnus/lisp/hmac-def hides /home/horn/Repos/el/emacs/lisp/net/hmac= -def ~/Repos/el/gnus/lisp/sasl-ntlm hides /home/horn/Repos/el/emacs/lisp/net/sas= l-ntlm ~/Repos/el/gnus/lisp/sasl-cram hides /home/horn/Repos/el/emacs/lisp/net/sas= l-cram ~/Repos/el/gnus/lisp/dns hides /home/horn/Repos/el/emacs/lisp/net/dns ~/Repos/el/gnus/lisp/sasl hides /home/horn/Repos/el/emacs/lisp/net/sasl ~/Repos/el/gnus/lisp/tls hides /home/horn/Repos/el/emacs/lisp/net/tls ~/Repos/el/gnus/lisp/netrc hides /home/horn/Repos/el/emacs/lisp/net/netrc ~/Repos/el/gnus/lisp/sasl-digest hides /home/horn/Repos/el/emacs/lisp/net/s= asl-digest ~/Repos/el/gnus/lisp/uudecode hides /home/horn/Repos/el/emacs/lisp/mail/uud= ecode ~/Repos/el/gnus/lisp/binhex hides /home/horn/Repos/el/emacs/lisp/mail/binhex ~/Repos/el/gnus/lisp/hashcash hides /home/horn/Repos/el/emacs/lisp/mail/has= hcash ~/Repos/el/gnus/lisp/canlock hides /home/horn/Repos/el/emacs/lisp/gnus/canl= ock ~/Repos/el/gnus/lisp/nneething hides /home/horn/Repos/el/emacs/lisp/gnus/nn= eething ~/Repos/el/gnus/lisp/mm-encode hides /home/horn/Repos/el/emacs/lisp/gnus/mm= -encode ~/Repos/el/gnus/lisp/mm-util hides /home/horn/Repos/el/emacs/lisp/gnus/mm-u= til ~/Repos/el/gnus/lisp/rfc2047 hides /home/horn/Repos/el/emacs/lisp/gnus/rfc2= 047 ~/Repos/el/gnus/lisp/nnml hides /home/horn/Repos/el/emacs/lisp/gnus/nnml ~/Repos/el/gnus/lisp/gnus-cus hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-cus ~/Repos/el/gnus/lisp/gnus-range hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-range ~/Repos/el/gnus/lisp/gnus-int hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-int ~/Repos/el/gnus/lisp/gnus-cloud hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-cloud ~/Repos/el/gnus/lisp/spam-stat hides /home/horn/Repos/el/emacs/lisp/gnus/sp= am-stat ~/Repos/el/gnus/lisp/nnmh hides /home/horn/Repos/el/emacs/lisp/gnus/nnmh ~/Repos/el/gnus/lisp/gnus-mlspl hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-mlspl ~/Repos/el/gnus/lisp/deuglify hides /home/horn/Repos/el/emacs/lisp/gnus/deu= glify ~/Repos/el/gnus/lisp/gnus-gravatar hides /home/horn/Repos/el/emacs/lisp/gnu= s/gnus-gravatar ~/Repos/el/gnus/lisp/nngateway hides /home/horn/Repos/el/emacs/lisp/gnus/nn= gateway ~/Repos/el/gnus/lisp/ietf-drums hides /home/horn/Repos/el/emacs/lisp/gnus/i= etf-drums ~/Repos/el/gnus/lisp/mail-parse hides /home/horn/Repos/el/emacs/lisp/gnus/m= ail-parse ~/Repos/el/gnus/lisp/gnus-salt hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-salt ~/Repos/el/gnus/lisp/nnimap hides /home/horn/Repos/el/emacs/lisp/gnus/nnimap ~/Repos/el/gnus/lisp/gnus-draft hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-draft ~/Repos/el/gnus/lisp/mail-source hides /home/horn/Repos/el/emacs/lisp/gnus/= mail-source ~/Repos/el/gnus/lisp/messcompat hides /home/horn/Repos/el/emacs/lisp/gnus/m= esscompat ~/Repos/el/gnus/lisp/pop3 hides /home/horn/Repos/el/emacs/lisp/gnus/pop3 ~/Repos/el/gnus/lisp/nnmaildir hides /home/horn/Repos/el/emacs/lisp/gnus/nn= maildir ~/Repos/el/gnus/lisp/nnheader hides /home/horn/Repos/el/emacs/lisp/gnus/nnh= eader ~/Repos/el/gnus/lisp/gnus-cite hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-cite ~/Repos/el/gnus/lisp/rfc2104 hides /home/horn/Repos/el/emacs/lisp/gnus/rfc2= 104 ~/Repos/el/gnus/lisp/nndiary hides /home/horn/Repos/el/emacs/lisp/gnus/nndi= ary ~/Repos/el/gnus/lisp/gnus-diary hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-diary ~/Repos/el/gnus/lisp/nnfolder hides /home/horn/Repos/el/emacs/lisp/gnus/nnf= older ~/Repos/el/gnus/lisp/gnus-art hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-art ~/Repos/el/gnus/lisp/gnus-demon hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-demon ~/Repos/el/gnus/lisp/mml-sec hides /home/horn/Repos/el/emacs/lisp/gnus/mml-= sec ~/Repos/el/gnus/lisp/nnir hides /home/horn/Repos/el/emacs/lisp/gnus/nnir ~/Repos/el/gnus/lisp/mm-partial hides /home/horn/Repos/el/emacs/lisp/gnus/m= m-partial ~/Repos/el/gnus/lisp/gnus-registry hides /home/horn/Repos/el/emacs/lisp/gnu= s/gnus-registry ~/Repos/el/gnus/lisp/gnus-icalendar hides /home/horn/Repos/el/emacs/lisp/gn= us/gnus-icalendar ~/Repos/el/gnus/lisp/compface hides /home/horn/Repos/el/emacs/lisp/gnus/com= pface ~/Repos/el/gnus/lisp/gnus-fun hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-fun ~/Repos/el/gnus/lisp/gnus-start hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-start ~/Repos/el/gnus/lisp/smiley hides /home/horn/Repos/el/emacs/lisp/gnus/smiley ~/Repos/el/gnus/lisp/gnus-picon hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-picon ~/Repos/el/gnus/lisp/spam-report hides /home/horn/Repos/el/emacs/lisp/gnus/= spam-report ~/Repos/el/gnus/lisp/nntp hides /home/horn/Repos/el/emacs/lisp/gnus/nntp ~/Repos/el/gnus/lisp/nnnil hides /home/horn/Repos/el/emacs/lisp/gnus/nnnil ~/Repos/el/gnus/lisp/nndir hides /home/horn/Repos/el/emacs/lisp/gnus/nndir ~/Repos/el/gnus/lisp/gnus-srvr hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-srvr ~/Repos/el/gnus/lisp/smime hides /home/horn/Repos/el/emacs/lisp/gnus/smime ~/Repos/el/gnus/lisp/nnvirtual hides /home/horn/Repos/el/emacs/lisp/gnus/nn= virtual ~/Repos/el/gnus/lisp/gnus-notifications hides /home/horn/Repos/el/emacs/lis= p/gnus/gnus-notifications ~/Repos/el/gnus/lisp/nnspool hides /home/horn/Repos/el/emacs/lisp/gnus/nnsp= ool ~/Repos/el/gnus/lisp/gnus-group hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-group ~/Repos/el/gnus/lisp/gnus-bcklg hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-bcklg ~/Repos/el/gnus/lisp/gnus-util hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-util ~/Repos/el/gnus/lisp/gnus-sieve hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-sieve ~/Repos/el/gnus/lisp/nndraft hides /home/horn/Repos/el/emacs/lisp/gnus/nndr= aft ~/Repos/el/gnus/lisp/nnagent hides /home/horn/Repos/el/emacs/lisp/gnus/nnag= ent ~/Repos/el/gnus/lisp/gnus-spec hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-spec ~/Repos/el/gnus/lisp/gnus-bookmark hides /home/horn/Repos/el/emacs/lisp/gnu= s/gnus-bookmark ~/Repos/el/gnus/lisp/mml1991 hides /home/horn/Repos/el/emacs/lisp/gnus/mml1= 991 ~/Repos/el/gnus/lisp/rfc2231 hides /home/horn/Repos/el/emacs/lisp/gnus/rfc2= 231 ~/Repos/el/gnus/lisp/yenc hides /home/horn/Repos/el/emacs/lisp/gnus/yenc ~/Repos/el/gnus/lisp/gnus-undo hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-undo ~/Repos/el/gnus/lisp/ecomplete hides /home/horn/Repos/el/emacs/lisp/gnus/ec= omplete ~/Repos/el/gnus/lisp/legacy-gnus-agent hides /home/horn/Repos/el/emacs/lisp= /gnus/legacy-gnus-agent ~/Repos/el/gnus/lisp/utf7 hides /home/horn/Repos/el/emacs/lisp/gnus/utf7 ~/Repos/el/gnus/lisp/rtree hides /home/horn/Repos/el/emacs/lisp/gnus/rtree ~/Repos/el/gnus/lisp/gnus-uu hides /home/horn/Repos/el/emacs/lisp/gnus/gnus= -uu ~/Repos/el/gnus/lisp/gnus-ml hides /home/horn/Repos/el/emacs/lisp/gnus/gnus= -ml ~/Repos/el/gnus/lisp/sieve hides /home/horn/Repos/el/emacs/lisp/gnus/sieve ~/Repos/el/gnus/lisp/gnus hides /home/horn/Repos/el/emacs/lisp/gnus/gnus ~/Repos/el/gnus/lisp/mml hides /home/horn/Repos/el/emacs/lisp/gnus/mml ~/Repos/el/gnus/lisp/message hides /home/horn/Repos/el/emacs/lisp/gnus/mess= age ~/Repos/el/gnus/lisp/mml-smime hides /home/horn/Repos/el/emacs/lisp/gnus/mm= l-smime ~/Repos/el/gnus/lisp/gnus-eform hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-eform ~/Repos/el/gnus/lisp/gnus-agent hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-agent ~/Repos/el/gnus/lisp/gnus-logic hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-logic ~/Repos/el/gnus/lisp/mm-extern hides /home/horn/Repos/el/emacs/lisp/gnus/mm= -extern ~/Repos/el/gnus/lisp/nndoc hides /home/horn/Repos/el/emacs/lisp/gnus/nndoc ~/Repos/el/gnus/lisp/sieve-manage hides /home/horn/Repos/el/emacs/lisp/gnus= /sieve-manage ~/Repos/el/gnus/lisp/mm-decode hides /home/horn/Repos/el/emacs/lisp/gnus/mm= -decode ~/Repos/el/gnus/lisp/starttls hides /home/horn/Repos/el/emacs/lisp/gnus/sta= rttls ~/Repos/el/gnus/lisp/gnus-dired hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-dired ~/Repos/el/gnus/lisp/nnbabyl hides /home/horn/Repos/el/emacs/lisp/gnus/nnba= byl ~/Repos/el/gnus/lisp/nnmbox hides /home/horn/Repos/el/emacs/lisp/gnus/nnmbox ~/Repos/el/gnus/lisp/gnus-win hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-win ~/Repos/el/gnus/lisp/gnus-async hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-async ~/Repos/el/gnus/lisp/mm-url hides /home/horn/Repos/el/emacs/lisp/gnus/mm-url ~/Repos/el/gnus/lisp/gnus-html hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-html ~/Repos/el/gnus/lisp/gssapi hides /home/horn/Repos/el/emacs/lisp/gnus/gssapi ~/Repos/el/gnus/lisp/mml2015 hides /home/horn/Repos/el/emacs/lisp/gnus/mml2= 015 ~/Repos/el/gnus/lisp/nnrss hides /home/horn/Repos/el/emacs/lisp/gnus/nnrss ~/Repos/el/gnus/lisp/gnus-mh hides /home/horn/Repos/el/emacs/lisp/gnus/gnus= -mh ~/Repos/el/gnus/lisp/gnus-sum hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-sum ~/Repos/el/gnus/lisp/nnweb hides /home/horn/Repos/el/emacs/lisp/gnus/nnweb ~/Repos/el/gnus/lisp/mail-prsvr hides /home/horn/Repos/el/emacs/lisp/gnus/m= ail-prsvr ~/Repos/el/gnus/lisp/nnmairix hides /home/horn/Repos/el/emacs/lisp/gnus/nnm= airix ~/Repos/el/gnus/lisp/plstore hides /home/horn/Repos/el/emacs/lisp/gnus/plst= ore ~/Repos/el/gnus/lisp/rfc2045 hides /home/horn/Repos/el/emacs/lisp/gnus/rfc2= 045 ~/Repos/el/gnus/lisp/gnus-msg hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-msg ~/Repos/el/gnus/lisp/spam-wash hides /home/horn/Repos/el/emacs/lisp/gnus/sp= am-wash ~/Repos/el/gnus/lisp/gnus-score hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-score ~/Repos/el/gnus/lisp/mm-uu hides /home/horn/Repos/el/emacs/lisp/gnus/mm-uu ~/Repos/el/gnus/lisp/spam hides /home/horn/Repos/el/emacs/lisp/gnus/spam ~/Repos/el/gnus/lisp/mm-view hides /home/horn/Repos/el/emacs/lisp/gnus/mm-v= iew ~/Repos/el/gnus/lisp/sieve-mode hides /home/horn/Repos/el/emacs/lisp/gnus/s= ieve-mode ~/Repos/el/gnus/lisp/html2text hides /home/horn/Repos/el/emacs/lisp/gnus/ht= ml2text ~/Repos/el/gnus/lisp/gnus-ems hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-ems ~/Repos/el/gnus/lisp/registry hides /home/horn/Repos/el/emacs/lisp/gnus/reg= istry ~/Repos/el/gnus/lisp/auth-source hides /home/horn/Repos/el/emacs/lisp/gnus/= auth-source ~/Repos/el/gnus/lisp/gravatar hides /home/horn/Repos/el/emacs/lisp/gnus/gra= vatar ~/Repos/el/gnus/lisp/flow-fill hides /home/horn/Repos/el/emacs/lisp/gnus/fl= ow-fill ~/Repos/el/gnus/lisp/gmm-utils hides /home/horn/Repos/el/emacs/lisp/gnus/gm= m-utils ~/Repos/el/gnus/lisp/mailcap hides /home/horn/Repos/el/emacs/lisp/gnus/mail= cap ~/Repos/el/gnus/lisp/gnus-delay hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-delay ~/Repos/el/gnus/lisp/mm-bodies hides /home/horn/Repos/el/emacs/lisp/gnus/mm= -bodies ~/Repos/el/gnus/lisp/mm-archive hides /home/horn/Repos/el/emacs/lisp/gnus/m= m-archive ~/Repos/el/gnus/lisp/rfc1843 hides /home/horn/Repos/el/emacs/lisp/gnus/rfc1= 843 ~/Repos/el/gnus/lisp/gnus-kill hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-kill ~/Repos/el/gnus/lisp/qp hides /home/horn/Repos/el/emacs/lisp/gnus/qp ~/Repos/el/gnus/lisp/score-mode hides /home/horn/Repos/el/emacs/lisp/gnus/s= core-mode ~/Repos/el/gnus/lisp/gnus-topic hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-topic ~/Repos/el/gnus/lisp/gnus-cache hides /home/horn/Repos/el/emacs/lisp/gnus/g= nus-cache ~/Repos/el/gnus/lisp/nnmail hides /home/horn/Repos/el/emacs/lisp/gnus/nnmail ~/Repos/el/gnus/lisp/gnus-vm hides /home/horn/Repos/el/emacs/lisp/gnus/gnus= -vm ~/Repos/el/gnus/lisp/gnus-sync hides /home/horn/Repos/el/emacs/lisp/gnus/gn= us-sync ~/Repos/el/gnus/lisp/nnoo hides /home/horn/Repos/el/emacs/lisp/gnus/nnoo ~/Repos/el/gnus/lisp/nnregistry hides /home/horn/Repos/el/emacs/lisp/gnus/n= nregistry ~/Repos/el/gnus/lisp/gnus-dup hides /home/horn/Repos/el/emacs/lisp/gnus/gnu= s-dup ~/Repos/el/gnus/lisp/parse-time hides /home/horn/Repos/el/emacs/lisp/calend= ar/parse-time ~/Repos/el/gnus/lisp/time-date hides /home/horn/Repos/el/emacs/lisp/calenda= r/time-date Features: (shadow emacsbug tramp-cache gnus-dired autorevert filenotify cider-macroexpansion reftex-sel reftex-ref reftex-parse reftex-toc texmathp preview prv-emacs auto-dictionary flyspell ispell tex-buf reftex-dcr reftex-auc reftex reftex-vars font-latex latex tex-style tex dbus crm tex-mode latexenc filecache shr-color color shr dom subr-x pcase hippie-exp bs mailalias smtpmail sendmail nxml-uchnm rng-xsd xsd-regexp rng-cmpct rng-nxml rng-valid rng-loc rng-uri rng-parse nxml-parse rng-match rng-dt rng-util rng-pttrn nxml-ns nxml-mode nxml-outln nxml-rap nxml-util nxml-glyph nxml-enc xmltok misearch multi-isearch xterm url-http url-gw url-auth sort smiley gnus-cite qp mm-archive gnus-async gnus-bcklg gnus-ml mule-diag vc-git diff-mode jka-compr hl-line nndraft nnmh rot13 utf-7 gnutls network-stream nsm starttls nnml nnnil gnus-agent gnus-srvr gnus-score score-mode nnvirtual gnus-cache gnus-demon nntp spam spam-stat gnus-uu yenc gnus-msg gnus-gravatar mail-extr gravatar gnus-topic nnir gnus-registry registry eieio-base th-private company-files company-oddmuse company-keywords company-etags company-gtags company-dabbrev-code company-dabbrev company-capf company-cmake company-ropemacs company-xcode company-clang company-semantic company-eclim company-template company-css company-nxml company-bbdb highlight-parentheses company stratego-mode greql-mode tg-mode generic preview-latex tex-site auto-loads cider tramp-sh cider-mode cider-repl cider-eldoc cider-interaction apropos arc-mode archive-mode cider-doc org-table cider-test cider-stacktrace cider-client nrepl-client queue cider-util ewoc etags clojure-mode imenu paredit aggressive-indent names edebug epa-file epa epg rdictcc ox-reveal ox-latex ox-icalendar ox-html ox-ascii ox-publish ox org-element google-contacts-message google-contacts derived url-cache google-oauth google-contacts-gnus gnus-art mm-uu mml2015 mm-view mml-smime smime dig gnus-sum gnus-group gnus-undo gnus-start gnus-cloud nnimap nnmail mail-source tls utf7 netrc nnoo parse-time gnus-spec gnus-int gnus-range gnus-win gnus gnus-ems gnus-compat nnheader em-term term ehelp esh-opt esh-ext esh-util highlight-symbol boxquote rect ecomplete message rfc822 mml mml-sec mm-decode mm-bodies mm-encode mail-parse rfc2231 rfc2047 rfc2045 ietf-drums mailabbrev mail-utils gmm-utils mailheader edit-server server yasnippet help-mode disp-table browse-kill-ring recentf tree-widget wid-edit helm-projectile helm-files image-dired tramp tramp-compat tramp-loaddefs trampver shell dired-x dired-aux ffap helm-tags helm-bookmark helm-adaptive helm-info helm-net browse-url xml url url-proxy url-privacy url-expand url-methods url-history url-cookie url-domsuf url-util url-parse auth-source gnus-util mm-util mail-prsvr password-cache url-vars mailcap bookmark pp helm-help helm-org org org-macro org-footnote org-pcomplete pcomplete org-list org-faces org-entities noutline outline org-version ob-emacs-lisp ob ob-tangle ob-ref ob-lob ob-table ob-exp org-src ob-keys ob-comint ob-core ob-eval org-compat org-macs org-loaddefs format-spec cal-menu calendar cal-loaddefs helm-external helm-buffers helm-match-plugin helm-grep helm-regexp helm-plugin helm-elscreen helm-utils dired helm-locate helm helm-source eieio byte-opt bytecomp byte-compile cl-extra cconv eieio-core helm-config async-bytecomp async helm-aliases projectile ibuf-ext ibuffer pkg-info find-func lisp-mnt epl grep compile comint ansi-color ring f s ucs-normalize thingatpt easy-mmode cl-macs iedit help-macro iedit-lib cl gv cap-words superword subword saveplace savehist paren icomplete mb-depth smart-mode-line-respectful-theme smart-mode-line-light-theme rich-minority smart-mode-line mule-util dash rx edmacro kmacro cl-loaddefs cl-lib elec-pair gnus-load tsdh-light-theme memory-usage-autoloads advice help-fns info easymenu package epg-config time-date tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel x-win x-dnd tool-bar dnd fontset image regexp-opt fringe tabulated-list newcomment elisp-mode lisp-mode prog-mode register page menu-bar rfn-eshadow timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core frame cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese case-table epa-hook jka-cmpr-hook help simple abbrev minibuffer nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote make-network-process dbusbind gfilenotify dynamic-setting system-font-setting font-render-setting move-toolbar gtk x-toolkit x multi-tty emacs) Memory information: ((conses 16 905837 165784) (symbols 48 63620 24) (miscs 40 1776 13622) (strings 32 211846 31876) (string-bytes 1 6973133) (vectors 16 88496) (vector-slots 8 2137319 192540) (floats 8 791 758) (intervals 56 7040 9061) (buffers 976 59) (heap 1024 133392 9009)) From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 16:06:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Tassilo Horn Cc: 19393@debbugs.gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141874595218394 (code B ref 19393); Tue, 16 Dec 2014 16:06:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 16:05:52 +0000 Received: from localhost ([127.0.0.1]:48022 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0udD-0004mc-VZ for submit@debbugs.gnu.org; Tue, 16 Dec 2014 11:05:52 -0500 Received: from mtaout26.012.net.il ([80.179.55.182]:52486) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0udB-0004mT-NZ for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 11:05:50 -0500 Received: from conversion-daemon.mtaout26.012.net.il by mtaout26.012.net.il (HyperSendmail v2007.08) id <0NGO00200N8EN100@mtaout26.012.net.il> for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 18:04:55 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by mtaout26.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NGO0032VNC75X00@mtaout26.012.net.il>; Tue, 16 Dec 2014 18:04:55 +0200 (IST) Date: Tue, 16 Dec 2014 18:05:38 +0200 From: Eli Zaretskii In-reply-to: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> X-012-Sender: halo1@inter.net.il Message-id: <83oar3wpf1.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Tassilo Horn > Date: Tue, 16 Dec 2014 16:21:10 +0100 > > ftp://ftp.fu-berlin.de/pub/misc/movies/database/movies.list.gz > > which contains all movies known to the international movie database > (IMDb.com). When I open that file using "emacs -Q movies.list.gz" (or > unzip it first) and then do M-x describe-coding-system I can see that it > is "t -- raw-text-unix". As a result of this, the last movie in that > file is displayed as "\374\347 (2012) 2012". > > However, according to the `file' command, the file is plain ISO-8859. Looks like some kind of bug, although with such a large file, it's not easy to be sure. > I also can't force Emacs to use ISO-8859 for that or the original file. > `C-x RET f iso-8859-15 RET' results in a query that certain characters > cannot be encoded using latin-9, e.g., \374 and \347, and I'm expected > to choose another encoding. That's not how you force Emacs to use a specific encoding when visiting a file. You should do this instead: C-x RET c iso-8859-15 RET C-x C-f movies.list RET IOW, revisit the file, forcing Emacs to decode it as ISO-8859-15. (The same works with the original compressed file.) From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 16:21:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: tsdh@gnu.org Cc: 19393@debbugs.gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141874684019745 (code B ref 19393); Tue, 16 Dec 2014 16:21:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 16:20:40 +0000 Received: from localhost ([127.0.0.1]:48031 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0urY-00058O-7U for submit@debbugs.gnu.org; Tue, 16 Dec 2014 11:20:40 -0500 Received: from mtaout20.012.net.il ([80.179.55.166]:64067) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0urU-00058E-NC for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 11:20:37 -0500 Received: from conversion-daemon.a-mtaout20.012.net.il by a-mtaout20.012.net.il (HyperSendmail v2007.08) id <0NGO00400NZ8P400@a-mtaout20.012.net.il> for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 18:20:35 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout20.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NGO004NFO2AJ250@a-mtaout20.012.net.il>; Tue, 16 Dec 2014 18:20:35 +0200 (IST) Date: Tue, 16 Dec 2014 18:20:25 +0200 From: Eli Zaretskii In-reply-to: <83oar3wpf1.fsf@gnu.org> X-012-Sender: halo1@inter.net.il Message-id: <83mw6nwoqe.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <83oar3wpf1.fsf@gnu.org> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > Date: Tue, 16 Dec 2014 18:05:38 +0200 > From: Eli Zaretskii > Cc: 19393@debbugs.gnu.org > > > From: Tassilo Horn > > Date: Tue, 16 Dec 2014 16:21:10 +0100 > > > > ftp://ftp.fu-berlin.de/pub/misc/movies/database/movies.list.gz > > > > which contains all movies known to the international movie database > > (IMDb.com). When I open that file using "emacs -Q movies.list.gz" (or > > unzip it first) and then do M-x describe-coding-system I can see that it > > is "t -- raw-text-unix". As a result of this, the last movie in that > > file is displayed as "\374\347 (2012) 2012". > > > > However, according to the `file' command, the file is plain ISO-8859. > > Looks like some kind of bug, although with such a large file, it's not > easy to be sure. Actually, I don't think this is a bug. There are ISO-8859-15 characters in that file that are not part of ISO-8859-1, so Emacs will not detect that encoding unless either (a) your locale dictates that encoding, or (b) you change the preferences to prefer ISO-8859-15. This is so with any 8-bit encoding -- EMacs cannot easily distinguish between them, and needs some guidance. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: martin rudalics Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 16:41:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Tassilo Horn , 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141874801021592 (code B ref 19393); Tue, 16 Dec 2014 16:41:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 16:40:10 +0000 Received: from localhost ([127.0.0.1]:48035 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0vAQ-0005cC-1o for submit@debbugs.gnu.org; Tue, 16 Dec 2014 11:40:10 -0500 Received: from mout.gmx.net ([212.227.17.21]:60499) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0vAN-0005c3-9w for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 11:40:08 -0500 Received: from [62.46.211.219] ([62.46.211.219]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0M4TgW-1XiJzR12Fw-00yevv; Tue, 16 Dec 2014 17:40:01 +0100 Message-ID: <5490605D.9070507@gmx.at> Date: Tue, 16 Dec 2014 17:39:57 +0100 From: martin rudalics MIME-Version: 1.0 References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K0:FQOdGOzg8oFoPIAtGi1PRRgSMJ0YIqFJoM6l1goMza3PW3arjcU 9GMlmEvODQY6bZsq9tpK/K7lerH380+lVF+znxFEdtT8tPAsTenBdocB42QGF6CaFQSqnts mGmgLFn41NPVMnho555+oPIeSzDCFb0WUJLY9V0toU8AsJ5Vil5xp69jYaSRe53WbDL8ALr SiOQZrh6y+bXew7Z0IyOg== X-UI-Out-Filterresults: notjunk:1; X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) > I've dowloaded the following file > > ftp://ftp.fu-berlin.de/pub/misc/movies/database/movies.list.gz > > which contains all movies known to the international movie database > (IMDb.com). When I open that file using "emacs -Q movies.list.gz" (or > unzip it first) and then do M-x describe-coding-system I can see that it > is "t -- raw-text-unix". As a result of this, the last movie in that > file is displayed as "\374\347 (2012) 2012". I usually delegate such problems to unicad.el. martin From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Andreas Schwab Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 16:57:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Tassilo Horn Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141874896523056 (code B ref 19393); Tue, 16 Dec 2014 16:57:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 16:56:05 +0000 Received: from localhost ([127.0.0.1]:48043 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0vPo-0005zo-SP for submit@debbugs.gnu.org; Tue, 16 Dec 2014 11:56:05 -0500 Received: from cantor2.suse.de ([195.135.220.15]:57241 helo=mx2.suse.de) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0vPm-0005zV-Hg for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 11:56:03 -0500 Received: from relay2.suse.de (charybdis-ext.suse.de [195.135.220.254]) by mx2.suse.de (Postfix) with ESMTP id AAD6BAB09; Tue, 16 Dec 2014 16:56:01 +0000 (UTC) From: Andreas Schwab References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> X-Yow: NEWARK has been REZONED!! DES MOINES has been REZONED!! Date: Tue, 16 Dec 2014 17:56:01 +0100 In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> (Tassilo Horn's message of "Tue, 16 Dec 2014 16:21:10 +0100") Message-ID: User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -5.0 (-----) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Tassilo Horn writes: > However, according to the `file' command, the file is plain ISO-8859. You can't take that seriously, since file doesn't check every character in the file. Andreas. -- Andreas Schwab, SUSE Labs, schwab@suse.de GPG Key fingerprint = 0196 BAD8 1CE9 1970 F4BE 1748 E4D4 88E3 0EEA B9D7 "And now for something completely different." From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 18:51:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Tassilo Horn Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14187558611456 (code B ref 19393); Tue, 16 Dec 2014 18:51:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 18:51:01 +0000 Received: from localhost ([127.0.0.1]:48100 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xD2-0000NP-Mf for submit@debbugs.gnu.org; Tue, 16 Dec 2014 13:51:00 -0500 Received: from b2bfep12.mx.upcmail.net ([62.179.121.57]:46256) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xCz-0000NG-Qg for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 13:50:59 -0500 Received: from edge11.upcmail.net ([192.168.13.81]) by b2bfep12.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20141216185056.PVDN14748.b2bfep12-int.chello.at@edge11.upcmail.net> for <19393@debbugs.gnu.org>; Tue, 16 Dec 2014 19:50:56 +0100 Received: from iznogoud.viz ([91.119.95.193]) by edge11.upcmail.net with edge id UJqv1p00N4AKj630BJqvbW; Tue, 16 Dec 2014 19:50:55 +0100 X-SourceIP: 91.119.95.193 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Y0xCx-000AlQ-0E; Tue, 16 Dec 2014 19:50:55 +0100 From: Wolfgang Jenkner Date: Tue, 16 Dec 2014 19:49:52 +0100 References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Message-ID: <85oar3xwc1.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Tue, Dec 16 2014, Tassilo Horn wrote: > I've dowloaded the following file > > ftp://ftp.fu-berlin.de/pub/misc/movies/database/movies.list.gz > [...] > I also can't force Emacs to use ISO-8859 for that or the original file. > `C-x RET f iso-8859-15 RET' results in a query that certain characters > cannot be encoded using latin-9, e.g., \374 and \347, and I'm expected > to choose another encoding. > > So `file' and `iconv' say the file is valid latin-9 but Emacs seems to > disagree. Who is correct? I tend towards file/iconv but I might be > wrong. > > And shouldn't it be possible to force Emacs to a certain coding system? Perhaps revert-buffer-with-coding-system will do what you want (i.e., C-x r l a t i n - 1 y e s should show letters with diacritical marks properly, but it took about 20 minutes on my old dual-core k8 system). In any case, some bisecting shows that the first problem is the line Jedna =C5=BEena =E2=80=93 jedan vek (2011) 2011 It seems to be encoded in Windows-1250 [1] instead. The IMDb website [2] has also problems with this title (at least in Firefox, the problematic letters seem to be missing somehow). [1] https://en.wikipedia.org/wiki/Windows-1250 [2] http://www.imdb.com/title/tt2087826/keywords Wolfgang From debbugs-submit-bounces@debbugs.gnu.org Tue Dec 16 14:09:04 2014 Received: (at control) by debbugs.gnu.org; 16 Dec 2014 19:09:04 +0000 Received: from localhost ([127.0.0.1]:48117 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xUV-0000sG-Fu for submit@debbugs.gnu.org; Tue, 16 Dec 2014 14:09:03 -0500 Received: from fencepost.gnu.org ([208.118.235.10]:38926) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xUU-0000ri-4Z for control@debbugs.gnu.org; Tue, 16 Dec 2014 14:09:02 -0500 Received: from rgm by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1Y0xUT-00005O-TP for control@debbugs.gnu.org; Tue, 16 Dec 2014 14:09:01 -0500 Date: Tue, 16 Dec 2014 14:09:01 -0500 Message-Id: Subject: control message for bug 19393 To: X-Mailer: mail (GNU Mailutils 2.1) From: Glenn Morris X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) tag 19393 notabug From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Tassilo Horn Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 19:11:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14187570543539 (code B ref 19393); Tue, 16 Dec 2014 19:11:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 19:10:54 +0000 Received: from localhost ([127.0.0.1]:48121 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xWI-0000v1-49 for submit@debbugs.gnu.org; Tue, 16 Dec 2014 14:10:54 -0500 Received: from out3-smtp.messagingengine.com ([66.111.4.27]:38458) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xWF-0000ur-15 for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 14:10:51 -0500 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 8E64F20832 for <19393@debbugs.gnu.org>; Tue, 16 Dec 2014 14:10:50 -0500 (EST) Received: from frontend1 ([10.202.2.160]) by compute5.internal (MEProxy); Tue, 16 Dec 2014 14:10:50 -0500 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=x-sasl-enc:from:to:cc:subject:references :date:in-reply-to:message-id:mime-version:content-type; s= smtpout; bh=ZLLHH0Stw2/3yrBpRb692QnPJrs=; b=PlZlE+1PqxV5e21BV/Mu CPk9e8/+CDe4E5yV7AQ7LmpvsAosAOGXp7zRNPRZUfvbjCDywB1Kn/c1OQN69zyI j2CUl2fpiGvMsHHAmXahPJI9n0RV9KnaUxgZKHnQwdmt2jjbpxY3OU9fuTXeP2R0 dA+yzeUvLe8XhFLZx7xLYgY= X-Sasl-enc: oHKvIxgO80NmC9/VtsiJSpKMTOXqUFWlzV6ArU8AL7Hl 1418757049 Received: from thinkpad-t440p.tsdh.org (unknown [2.163.175.46]) by mail.messagingengine.com (Postfix) with ESMTPA id 6547FC0027D; Tue, 16 Dec 2014 14:10:49 -0500 (EST) From: Tassilo Horn References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <83oar3wpf1.fsf@gnu.org> Date: Tue, 16 Dec 2014 20:10:43 +0100 In-Reply-To: <83oar3wpf1.fsf@gnu.org> (Eli Zaretskii's message of "Tue, 16 Dec 2014 18:05:38 +0200") Message-ID: <87k31rs958.fsf@thinkpad-t440p.tsdh.org> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.3 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.3 (/) Eli Zaretskii writes: >> I also can't force Emacs to use ISO-8859 for that or the original file. >> `C-x RET f iso-8859-15 RET' results in a query that certain characters >> cannot be encoded using latin-9, e.g., \374 and \347, and I'm expected >> to choose another encoding. > > That's not how you force Emacs to use a specific encoding when > visiting a file. You should do this instead: > > C-x RET c iso-8859-15 RET C-x C-f movies.list RET > > IOW, revisit the file, forcing Emacs to decode it as ISO-8859-15. > (The same works with the original compressed file.) Ah, indeed, that works. Bye, Tassilo From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Tassilo Horn Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 19:23:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14187577409775 (code B ref 19393); Tue, 16 Dec 2014 19:23:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 19:22:20 +0000 Received: from localhost ([127.0.0.1]:48125 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xhM-0002Xb-8k for submit@debbugs.gnu.org; Tue, 16 Dec 2014 14:22:20 -0500 Received: from out3-smtp.messagingengine.com ([66.111.4.27]:58845) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xhJ-0002XS-32 for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 14:22:17 -0500 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id E959720A05 for <19393@debbugs.gnu.org>; Tue, 16 Dec 2014 14:22:16 -0500 (EST) Received: from frontend1 ([10.202.2.160]) by compute4.internal (MEProxy); Tue, 16 Dec 2014 14:22:16 -0500 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=x-sasl-enc:from:to:cc:subject:in-reply-to :references:date:message-id:mime-version:content-type; s= smtpout; bh=EjofO4pR0f1ZaCsYalHruMArMgM=; b=nlCKdLtKtJqu6GnDgQ0d hcPTcKYB749l521x/FUXcUhcOzPMDxwk3d6ZFiH8mZphaIMnDP51Vg2hUm0y+EWL Ecjmp+9m36id2tXtZPNapU4B8LPINR71akqPRsmkbtIHUHCZV9bOnASLKSAmqM5H ZOuu+/Dg4thsAkZG7qdNuEI= X-Sasl-enc: C6fFdrJ4w5Pc4k0B0x2wQ0koyl8J+1aNVbAyXnM/pf1U 1418757736 Received: from thinkpad-t440p.tsdh.org (unknown [2.163.175.46]) by mail.messagingengine.com (Postfix) with ESMTPA id 1A1B8C00285; Tue, 16 Dec 2014 14:22:15 -0500 (EST) From: Tassilo Horn In-Reply-To: <83mw6nwoqe.fsf@gnu.org> (Eli Zaretskii's message of "Tue, 16 Dec 2014 18:20:25 +0200") References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <83oar3wpf1.fsf@gnu.org> <83mw6nwoqe.fsf@gnu.org> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (gnu/linux) Date: Tue, 16 Dec 2014 20:22:11 +0100 Message-ID: <87bnn3s8m4.fsf@thinkpad-t440p.tsdh.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.3 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.3 (/) Eli Zaretskii writes: >> > However, according to the `file' command, the file is plain ISO-8859. >> >> Looks like some kind of bug, although with such a large file, it's not >> easy to be sure. > > Actually, I don't think this is a bug. There are ISO-8859-15 > characters in that file that are not part of ISO-8859-1, so Emacs will > not detect that encoding unless either (a) your locale dictates that > encoding, It doesn't. > or (b) you change the preferences to prefer ISO-8859-15. Is there a way to prefer ISO-8859-15 over ISO-8859-1? The manual I can only find the command `prefer-coding-system' which doesn't seem to do what I want. I wan't to reorder the "priority list for automatic detection" so that ISO-8859-15 is before ISO-8859-1 but still UTF-8 is the very first entry (as it's dictated by my locale). > This is so with any 8-bit encoding -- EMacs cannot easily distinguish > between them, and needs some guidance. Ok, I see. And as Wolfgang said, some chars in the file are encoded wrongly using Windows-1250. That probably adds to the problem. Thanks for the explanation! Bye, Tassilo From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Tassilo Horn Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 19:27:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: martin rudalics Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141875800310281 (code B ref 19393); Tue, 16 Dec 2014 19:27:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 19:26:43 +0000 Received: from localhost ([127.0.0.1]:48142 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xla-0002fk-9s for submit@debbugs.gnu.org; Tue, 16 Dec 2014 14:26:42 -0500 Received: from out3-smtp.messagingengine.com ([66.111.4.27]:45858) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xlY-0002fb-BD for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 14:26:41 -0500 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 4154720A38 for <19393@debbugs.gnu.org>; Tue, 16 Dec 2014 14:26:40 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute5.internal (MEProxy); Tue, 16 Dec 2014 14:26:40 -0500 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=x-sasl-enc:from:to:cc:subject:references :date:in-reply-to:message-id:mime-version:content-type; s= smtpout; bh=WqakiUa+N575LzSGFr7bnpf9t/M=; b=QgMJ3HIA6CyAhpxm4Mxr PqfRgLPZZqbWJtTkymA0UG5sZu+x3nY5VmP63h1mHtTWO3pKYfuL7SWZ7+Tne1Qk w/UceJxJfJSfNzaa+M2P7rDoXqiv7XoF5QShnhDA0n3RZv74YiNl9WmHLLeGZJxU Hn2jN2ougRbyCfvEosA0gR4= X-Sasl-enc: 06M7ot0KGQpyOXTf/uD7LsMpAtuANvWfpokrJohJ03Zj 1418757999 Received: from thinkpad-t440p.tsdh.org (unknown [2.163.175.46]) by mail.messagingengine.com (Postfix) with ESMTPA id EC08168013F; Tue, 16 Dec 2014 14:26:38 -0500 (EST) From: Tassilo Horn References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <5490605D.9070507@gmx.at> Date: Tue, 16 Dec 2014 20:26:33 +0100 In-Reply-To: <5490605D.9070507@gmx.at> (martin rudalics's message of "Tue, 16 Dec 2014 17:39:57 +0100") Message-ID: <877fxrs8eu.fsf@thinkpad-t440p.tsdh.org> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.3 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.3 (/) martin rudalics writes: >> I've dowloaded the following file >> >> ftp://ftp.fu-berlin.de/pub/misc/movies/database/movies.list.gz >> >> which contains all movies known to the international movie database >> (IMDb.com). When I open that file using "emacs -Q movies.list.gz" (or >> unzip it first) and then do M-x describe-coding-system I can see that it >> is "t -- raw-text-unix". As a result of this, the last movie in that >> file is displayed as "\374\347 (2012) 2012". > > I usually delegate such problems to unicad.el. Indeed, when using and enabling that, the file is read as latin-9. Thanks, Tassilo From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Tassilo Horn Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Dec 2014 19:37:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141875860116659 (code B ref 19393); Tue, 16 Dec 2014 19:37:02 +0000 Received: (at 19393) by debbugs.gnu.org; 16 Dec 2014 19:36:41 +0000 Received: from localhost ([127.0.0.1]:48148 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xvE-0004Kc-Lj for submit@debbugs.gnu.org; Tue, 16 Dec 2014 14:36:40 -0500 Received: from out3-smtp.messagingengine.com ([66.111.4.27]:52459) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y0xvD-0004KV-3m for 19393@debbugs.gnu.org; Tue, 16 Dec 2014 14:36:39 -0500 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id EEEF62031D for <19393@debbugs.gnu.org>; Tue, 16 Dec 2014 14:36:38 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Tue, 16 Dec 2014 14:36:38 -0500 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=x-sasl-enc:from:to:cc:subject:in-reply-to :references:date:message-id:mime-version:content-type :content-transfer-encoding; s=smtpout; bh=EvaekZ1GcjPZiSTEd1OLDG eVJPw=; b=X1lMZkQQdaHRXKloIfzIscdPjYuhg1rxvUoWgmTDDVlwcpB6sQIB8A /YQYgWleB8iQipzn4eiG0wsSJ5tEAVmWeG2tNfHOHQxgJjh8bOM24wGnZrGcC1nZ gkMzHZb0DTm+3NtnTAhWOgJIuhBULw+ivPMLVfS6PJHRLIMQ1qVrI= X-Sasl-enc: zHzMNog1FOT42utd1XqP2WSjRvh2j0wK45GYdvf4cmUk 1418758598 Received: from thinkpad-t440p.tsdh.org (unknown [2.163.175.46]) by mail.messagingengine.com (Postfix) with ESMTPA id AD2FD680092; Tue, 16 Dec 2014 14:36:37 -0500 (EST) From: Tassilo Horn In-Reply-To: <85oar3xwc1.fsf@iznogoud.viz> (Wolfgang Jenkner's message of "Tue, 16 Dec 2014 19:49:52 +0100") References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (gnu/linux) Date: Tue, 16 Dec 2014 20:36:33 +0100 Message-ID: <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.3 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.3 (/) Wolfgang Jenkner writes: >> And shouldn't it be possible to force Emacs to a certain coding system? > > Perhaps revert-buffer-with-coding-system will do what you want (i.e., > > C-x r l a t i n - 1 y e s Yes, that's the right command and not `C-x RET f' as I've thought. > should show letters with diacritical marks properly, It does. > but it took about 20 minutes on my old dual-core k8 system). Here it took about 2 seconds and it's not that I own the first practical quantum computer. > In any case, some bisecting shows that the first problem is the line > > Jedna =C5=BEena =E2=80=93 jedan vek (2011) 2011 > > It seems to be encoded in Windows-1250 [1] instead. Indeed. How did you search for it? I guess you didn't just scroll the file with open eye. Bye, Tassilo From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Dec 2014 14:23:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Tassilo Horn Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141882615621727 (code B ref 19393); Wed, 17 Dec 2014 14:23:01 +0000 Received: (at 19393) by debbugs.gnu.org; 17 Dec 2014 14:22:36 +0000 Received: from localhost ([127.0.0.1]:48582 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1FUq-0005eM-2L for submit@debbugs.gnu.org; Wed, 17 Dec 2014 09:22:36 -0500 Received: from b2bfep16.mx.upcmail.net ([62.179.121.61]:39023) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1FUn-0005eA-Lc for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 09:22:35 -0500 Received: from edge12.upcmail.net ([192.168.13.82]) by b2bfep16.mx.upcmail.net (InterMail vM.8.01.05.05 201-2260-151-110-20120111) with ESMTP id <20141217142221.NKCZ10322.b2bfep16-int.chello.at@edge12.upcmail.net> for <19393@debbugs.gnu.org>; Wed, 17 Dec 2014 15:22:21 +0100 Received: from iznogoud.viz ([85.127.8.35]) by edge12.upcmail.net with edge id UeNL1p01E0lM6Wl0CeNLhq; Wed, 17 Dec 2014 15:22:21 +0100 X-SourceIP: 85.127.8.35 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Y1FUZ-0000IC-Vj; Wed, 17 Dec 2014 15:22:20 +0100 From: Wolfgang Jenkner References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> Date: Wed, 17 Dec 2014 15:22:19 +0100 In-Reply-To: <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> (Tassilo Horn's message of "Tue, 16 Dec 2014 20:36:33 +0100") Message-ID: <85mw6m4aqs.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Tue, Dec 16 2014, Tassilo Horn wrote: >> but it took about 20 minutes on my old dual-core k8 system). > > Here it took about 2 seconds and it's not that I own the first practical > quantum computer. Thanks, that's strange... Wolfgang From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Dec 2014 15:13:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Tassilo Horn Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141882916332088 (code B ref 19393); Wed, 17 Dec 2014 15:13:01 +0000 Received: (at 19393) by debbugs.gnu.org; 17 Dec 2014 15:12:43 +0000 Received: from localhost ([127.0.0.1]:48974 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1GHK-0008LU-PV for submit@debbugs.gnu.org; Wed, 17 Dec 2014 10:12:43 -0500 Received: from b2bfep14.mx.upcmail.net ([62.179.121.59]:41784) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1GHH-0008LK-Nm for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 10:12:41 -0500 Received: from edge12.upcmail.net ([192.168.13.82]) by b2bfep14.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20141217151237.FIMM11972.b2bfep14-int.chello.at@edge12.upcmail.net> for <19393@debbugs.gnu.org>; Wed, 17 Dec 2014 16:12:37 +0100 Received: from iznogoud.viz ([85.127.8.35]) by edge12.upcmail.net with edge id UfCc1p00n0lM6Wl0CfCc7e; Wed, 17 Dec 2014 16:12:37 +0100 X-SourceIP: 85.127.8.35 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Y1GHE-0000Mx-C9; Wed, 17 Dec 2014 16:12:36 +0100 From: Wolfgang Jenkner References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> Date: Wed, 17 Dec 2014 16:12:36 +0100 In-Reply-To: <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> (Tassilo Horn's message of "Tue, 16 Dec 2014 20:36:33 +0100") Message-ID: <85ioha48ez.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Tue, Dec 16 2014, Tassilo Horn wrote: >> In any case, some bisecting shows that the first problem is the line >> >> Jedna =C5=BEena =E2=80=93 jedan vek (2011) 2011 >> >> It seems to be encoded in Windows-1250 [1] instead. > > Indeed. How did you search for it? I guess you didn't just scroll the > file with open eye. Bisecting (to base 10 ;-) $ cp movies.list /tmp/bad && cd /tmp Then repeat the following 5 or 6 times. $ split -n10 bad $ emacs -Q x* $ cp x... bad $ rm x* Just look for the indication of the buffer coding system in the mode line to find the first bad file at each step. Wolfgang From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Tassilo Horn Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Dec 2014 15:47:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14188312023460 (code B ref 19393); Wed, 17 Dec 2014 15:47:02 +0000 Received: (at 19393) by debbugs.gnu.org; 17 Dec 2014 15:46:42 +0000 Received: from localhost ([127.0.0.1]:49028 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1GoD-0000tk-Ua for submit@debbugs.gnu.org; Wed, 17 Dec 2014 10:46:42 -0500 Received: from deliver.uni-koblenz.de ([141.26.64.15]:45044) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1GoC-0000tb-11 for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 10:46:40 -0500 Received: from localhost (localhost [127.0.0.1]) by deliver.uni-koblenz.de (Postfix) with ESMTP id E43B51A8253; Wed, 17 Dec 2014 16:46:38 +0100 (CET) X-Virus-Scanned: amavisd-new at uni-koblenz.de Received: from deliver.uni-koblenz.de ([127.0.0.1]) by localhost (deliver.uni-koblenz.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id udBXWzimZelA; Wed, 17 Dec 2014 16:46:38 +0100 (CET) X-CHKRCPT: Envelopesender noch tsdh@gnu.org Received: from thinkpad-t440p.tsdh.org (dhcp177.uni-koblenz.de [141.26.71.177]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by deliver.uni-koblenz.de (Postfix) with ESMTPSA id 931B61A822C; Wed, 17 Dec 2014 16:46:38 +0100 (CET) From: Tassilo Horn References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85ioha48ez.fsf@iznogoud.viz> Date: Wed, 17 Dec 2014 16:46:37 +0100 In-Reply-To: <85ioha48ez.fsf@iznogoud.viz> (Wolfgang Jenkner's message of "Wed, 17 Dec 2014 16:12:36 +0100") Message-ID: <871tnyqnxe.fsf@thinkpad-t440p.tsdh.org> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -1.3 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.3 (-) Wolfgang Jenkner writes: >> Indeed. How did you search for it? I guess you didn't just scroll the >> file with open eye. > > Bisecting (to base 10 ;-) > > $ cp movies.list /tmp/bad && cd /tmp > > Then repeat the following 5 or 6 times. > > $ split -n10 bad > $ emacs -Q x* > $ cp x... bad > $ rm x* > > Just look for the indication of the buffer coding system in the mode > line to find the first bad file at each step. Ah, I see. I hoped for some emacs command that lets me search for characters displayed "in red", e.g., characters displayed as ^J or \374. Bye, Tassilo From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Dec 2014 15:51:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org, tsdh@gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14188314353865 (code B ref 19393); Wed, 17 Dec 2014 15:51:01 +0000 Received: (at 19393) by debbugs.gnu.org; 17 Dec 2014 15:50:35 +0000 Received: from localhost ([127.0.0.1]:49036 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1Grz-00010F-01 for submit@debbugs.gnu.org; Wed, 17 Dec 2014 10:50:35 -0500 Received: from mtaout22.012.net.il ([80.179.55.172]:57305) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1Grw-000107-Ow for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 10:50:33 -0500 Received: from conversion-daemon.a-mtaout22.012.net.il by a-mtaout22.012.net.il (HyperSendmail v2007.08) id <0NGQ00E00H9KT700@a-mtaout22.012.net.il> for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 17:50:31 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout22.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NGQ00EYSHC7HC60@a-mtaout22.012.net.il>; Wed, 17 Dec 2014 17:50:31 +0200 (IST) Date: Wed, 17 Dec 2014 17:50:24 +0200 From: Eli Zaretskii In-reply-to: <85mw6m4aqs.fsf@iznogoud.viz> X-012-Sender: halo1@inter.net.il Message-id: <83zjamuvgf.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Wolfgang Jenkner > Date: Wed, 17 Dec 2014 15:22:19 +0100 > Cc: 19393@debbugs.gnu.org > > On Tue, Dec 16 2014, Tassilo Horn wrote: > > >> but it took about 20 minutes on my old dual-core k8 system). > > > > Here it took about 2 seconds and it's not that I own the first practical > > quantum computer. > > Thanks, that's strange... What is the system where you observed the 20-minute delay? And what version of Emacs was that? From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Dec 2014 16:03:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Eli Zaretskii Cc: 19393@debbugs.gnu.org, tsdh@gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14188321345105 (code B ref 19393); Wed, 17 Dec 2014 16:03:02 +0000 Received: (at 19393) by debbugs.gnu.org; 17 Dec 2014 16:02:14 +0000 Received: from localhost ([127.0.0.1]:49042 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1H3G-0001KG-EY for submit@debbugs.gnu.org; Wed, 17 Dec 2014 11:02:14 -0500 Received: from b2bfep11.mx.upcmail.net ([62.179.121.56]:44812) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1H3C-0001K3-Nn for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 11:02:12 -0500 Received: from edge11.upcmail.net ([192.168.13.81]) by b2bfep11.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20141217160208.BVKD22355.b2bfep11-int.chello.at@edge11.upcmail.net> for <19393@debbugs.gnu.org>; Wed, 17 Dec 2014 17:02:08 +0100 Received: from iznogoud.viz ([85.127.8.35]) by edge11.upcmail.net with edge id Ug271p0180lM6Wl0Bg27MM; Wed, 17 Dec 2014 17:02:08 +0100 X-SourceIP: 85.127.8.35 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Y1H39-0000Oo-El; Wed, 17 Dec 2014 17:02:07 +0100 From: Wolfgang Jenkner References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> Date: Wed, 17 Dec 2014 17:02:07 +0100 In-Reply-To: <83zjamuvgf.fsf@gnu.org> (Eli Zaretskii's message of "Wed, 17 Dec 2014 17:50:24 +0200") Message-ID: <85egry464g.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Wed, Dec 17 2014, Eli Zaretskii wrote: > What is the system where you observed the 20-minute delay? And what > version of Emacs was that? FreeBSD 10 on amd64, but the emacs versions I have are more than a month old, so I'll bootstrap from a current git checkout and try again. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 17 Dec 2014 17:05:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org, tsdh@gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141883584816911 (code B ref 19393); Wed, 17 Dec 2014 17:05:02 +0000 Received: (at 19393) by debbugs.gnu.org; 17 Dec 2014 17:04:08 +0000 Received: from localhost ([127.0.0.1]:49123 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1I1A-0004Oh-FR for submit@debbugs.gnu.org; Wed, 17 Dec 2014 12:04:08 -0500 Received: from mtaout21.012.net.il ([80.179.55.169]:57204) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1I18-0004OV-5x for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 12:04:07 -0500 Received: from conversion-daemon.a-mtaout21.012.net.il by a-mtaout21.012.net.il (HyperSendmail v2007.08) id <0NGQ00600KM44W00@a-mtaout21.012.net.il> for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 19:04:04 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout21.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NGQ0058ZKQRXHB0@a-mtaout21.012.net.il>; Wed, 17 Dec 2014 19:04:04 +0200 (IST) Date: Wed, 17 Dec 2014 19:03:56 +0200 From: Eli Zaretskii In-reply-to: <85egry464g.fsf@iznogoud.viz> X-012-Sender: halo1@inter.net.il Message-id: <83y4q6us1v.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Wolfgang Jenkner > Cc: 19393@debbugs.gnu.org, tsdh@gnu.org > Date: Wed, 17 Dec 2014 17:02:07 +0100 > > On Wed, Dec 17 2014, Eli Zaretskii wrote: > > > What is the system where you observed the 20-minute delay? And what > > version of Emacs was that? > > FreeBSD 10 on amd64 That's what I thought. AFAIK, FreeBSD systems use mmap(2) explicitly for buffer memory allocation, and that could be slow when we need to repeatedly reallocate buffer text and memmove the text between old and new. > but the emacs versions I have are more than a month old, so I'll > bootstrap from a current git checkout and try again. If I'm right, this won't change the result. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 18 Dec 2014 01:56:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141886772519281 (code B ref 19393); Thu, 18 Dec 2014 01:56:02 +0000 Received: (at 19393) by debbugs.gnu.org; 18 Dec 2014 01:55:25 +0000 Received: from localhost ([127.0.0.1]:49387 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1QJH-00050t-Ki for submit@debbugs.gnu.org; Wed, 17 Dec 2014 20:55:24 -0500 Received: from b2bfep13.mx.upcmail.net ([62.179.121.58]:56141) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1QJC-00050X-Rs for 19393@debbugs.gnu.org; Wed, 17 Dec 2014 20:55:21 -0500 Received: from edge11.upcmail.net ([192.168.13.81]) by b2bfep13.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20141218015515.LDQF20529.b2bfep13-int.chello.at@edge11.upcmail.net> for <19393@debbugs.gnu.org>; Thu, 18 Dec 2014 02:55:15 +0100 Received: from iznogoud.viz ([85.127.8.35]) by edge11.upcmail.net with edge id UpvF1p00X0lM6Wl0BpvFXp; Thu, 18 Dec 2014 02:55:15 +0100 X-SourceIP: 85.127.8.35 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Y1QJ8-0009VO-SI; Thu, 18 Dec 2014 02:55:14 +0100 From: Wolfgang Jenkner Date: Thu, 18 Dec 2014 02:47:41 +0100 References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> Message-ID: <85bnn1pvr1.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Wed, Dec 17 2014, Eli Zaretskii wrote: >> On Wed, Dec 17 2014, Eli Zaretskii wrote: >> >> > What is the system where you observed the 20-minute delay? And what >> > version of Emacs was that? >> >> FreeBSD 10 on amd64 > > That's what I thought. AFAIK, FreeBSD systems use mmap(2) explicitly > for buffer memory allocation, and that could be slow when we need to > repeatedly reallocate buffer text and memmove the text between old and > new. > >> but the emacs versions I have are more than a month old, so I'll >> bootstrap from a current git checkout and try again. > > If I'm right, this won't change the result. You are right, of course (it took around 15 minutes system+user time). So, I tried --8<---------------cut here---------------start------------->8--- diff --git a/configure.ac b/configure.ac index 010abc8..de1c5e8 100644 --- a/configure.ac +++ b/configure.ac @@ -2127,7 +2127,7 @@ fi use_mmap_for_buffers=no case "$opsys" in - cygwin|mingw32|freebsd|irix6-5) use_mmap_for_buffers=yes ;; + cygwin|mingw32|irix6-5) use_mmap_for_buffers=yes ;; esac AC_FUNC_MMAP --8<---------------cut here---------------end--------------->8--- However, this still took around 10 minutes (I tested with emacs -Q in both cases, of course). I give samples of the recurring sequence of syscalls (as reported by truss) in both cases below. Here's the current default for FreeBSD. Should Emacs use the GNU version of malloc? yes Should Emacs use a relocating allocator for buffers? no Should Emacs use mmap(2) for buffer allocation? yes --8<---------------cut here---------------start------------->8--- sigprocmask(SIG_BLOCK,SIGINT|SIGALRM,0x0) = 0 (0x0) clock_gettime(0,{1418846146.702726599 }) = 0 (0x0) ktimer_settime(0x3,0x1,0x7ffffffece50,0x0,0x0,0x0) = 0 (0x0) sigprocmask(SIG_SETMASK,0x0,SIGINT|SIGALRM) = 0 (0x0) nanosleep({0.000001000 }) = 0 (0x0) mmap(0x0,28815360,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x8108ec000,28798976) = 0 (0x0) read(9,"\t????\n"Esperan\M-ga" (2002) {("...,65536) = 65536 (0x10000) mmap(0x0,28831744,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34608795648 (0x80ed85000) munmap(0x80d20a000,28815360) = 0 (0x0) mmap(0x0,28848128,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34637627392 (0x810904000) munmap(0x80ed85000,28831744) = 0 (0x0) mmap(0x0,28864512,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810904000,28848128) = 0 (0x0) mmap(0x0,28880896,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34608844800 (0x80ed91000) munmap(0x80d20a000,28864512) = 0 (0x0) read(9," SportsCentury" (1999) {Seabiscu"...,65536) = 65536 (0x10000) mmap(0x0,28897280,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34637725696 (0x81091c000) munmap(0x80ed91000,28880896) = 0 (0x0) mmap(0x0,28913664,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x81091c000,28897280) = 0 (0x0) mmap(0x0,28930048,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34608893952 (0x80ed9d000) munmap(0x80d20a000,28913664) = 0 (0x0) mmap(0x0,28946432,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34637824000 (0x810934000) munmap(0x80ed9d000,28930048) = 0 (0x0) read(9,"a es mi historia" (2001) {La vid"...,65536) = 65536 (0x10000) mmap(0x0,28962816,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810934000,28946432) = 0 (0x0) mmap(0x0,28979200,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34608943104 (0x80eda9000) munmap(0x80d20a000,28962816) = 0 (0x0) mmap(0x0,28999680,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34637922304 (0x81094c000) munmap(0x80eda9000,28979200) = 0 (0x0) mmap(0x0,29016064,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x81094c000,28999680) = 0 (0x0) read(9,"\t1999\n"Esti showder" (1999) {("...,65536) = 65536 (0x10000) mmap(0x0,29032448,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34608996352 (0x80edb6000) munmap(0x80d20a000,29016064) = 0 (0x0) mmap(0x0,29048832,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638028800 (0x810966000) munmap(0x80edb6000,29032448) = 0 (0x0) mmap(0x0,29065216,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810966000,29048832) = 0 (0x0) mmap(0x0,29081600,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609045504 (0x80edc2000) munmap(0x80d20a000,29065216) = 0 (0x0) read(9,"en Cuba}\t\t1978\n"Estudio 1" (1"...,65536) = 65536 (0x10000) mmap(0x0,29097984,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638127104 (0x81097e000) munmap(0x80edc2000,29081600) = 0 (0x0) mmap(0x0,29114368,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x81097e000,29097984) = 0 (0x0) mmap(0x0,29130752,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609094656 (0x80edce000) munmap(0x80d20a000,29114368) = 0 (0x0) mmap(0x0,29147136,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638225408 (0x810996000) munmap(0x80edce000,29130752) = 0 (0x0) read(9,"07\n"Eterna Magia" (2007) {(2007"...,65536) = 65536 (0x10000) mmap(0x0,29163520,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810996000,29147136) = 0 (0x0) mmap(0x0,29179904,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609143808 (0x80edda000) munmap(0x80d20a000,29163520) = 0 (0x0) mmap(0x0,29196288,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638323712 (0x8109ae000) munmap(0x80edda000,29179904) = 0 (0x0) mmap(0x0,29212672,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x8109ae000,29196288) = 0 (0x0) read(9,")}\t1991\n"Eva y Ad\M-an, agenci"...,65536) = 65536 (0x10000) mmap(0x0,29229056,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609192960 (0x80ede6000) munmap(0x80d20a000,29212672) = 0 (0x0) mmap(0x0,29245440,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638422016 (0x8109c6000) munmap(0x80ede6000,29229056) = 0 (0x0) mmap(0x0,29261824,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x8109c6000,29245440) = 0 (0x0) mmap(0x0,29278208,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609242112 (0x80edf2000) munmap(0x80d20a000,29261824) = 0 (0x0) read(9,"A. (#9.4)}\t2004\n"Everybody Lov"...,65536) = 65536 (0x10000) mmap(0x0,29294592,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638520320 (0x8109de000) munmap(0x80edf2000,29278208) = 0 (0x0) mmap(0x0,29310976,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x8109de000,29294592) = 0 (0x0) mmap(0x0,29327360,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609291264 (0x80edfe000) munmap(0x80d20a000,29310976) = 0 (0x0) mmap(0x0,29343744,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638618624 (0x8109f6000) munmap(0x80edfe000,29327360) = 0 (0x0) read(9,"\t\t1988\n"Everyman" (1977) {Who"...,65536) = 65536 (0x10000) mmap(0x0,29360128,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x8109f6000,29343744) = 0 (0x0) mmap(0x0,29376512,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609340416 (0x80ee0a000) munmap(0x80d20a000,29360128) = 0 (0x0) mmap(0x0,29392896,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638716928 (0x810a0e000) munmap(0x80ee0a000,29376512) = 0 (0x0) mmap(0x0,29409280,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810a0e000,29392896) = 0 (0x0) read(9,"xclusive" (1997) {(#1.1)}\t\t\t"...,65536) = 65536 (0x10000) mmap(0x0,29425664,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609389568 (0x80ee16000) munmap(0x80d20a000,29409280) = 0 (0x0) mmap(0x0,29442048,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638815232 (0x810a26000) munmap(0x80ee16000,29425664) = 0 (0x0) mmap(0x0,29458432,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810a26000,29442048) = 0 (0x0) mmap(0x0,29474816,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609438720 (0x80ee22000) munmap(0x80d20a000,29458432) = 0 (0x0) read(9,"\n"Explorers: Adventures of the "...,65536) = 65536 (0x10000) mmap(0x0,29491200,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34638913536 (0x810a3e000) munmap(0x80ee22000,29474816) = 0 (0x0) mmap(0x0,29507584,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810a3e000,29491200) = 0 (0x0) mmap(0x0,29523968,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609487872 (0x80ee2e000) munmap(0x80d20a000,29507584) = 0 (0x0) mmap(0x0,29540352,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34639011840 (0x810a56000) munmap(0x80ee2e000,29523968) = 0 (0x0) read(9,"xtra" (1994) {(2011-05-03)}\t\t"...,65536) = 65536 (0x10000) mmap(0x0,29556736,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34579980288 (0x80d20a000) munmap(0x810a56000,29540352) = 0 (0x0) mmap(0x0,29573120,PROT_READ|PROT_WRITE,MAP_PRIVATE|MAP_ANON,-1,0x0) = 34609537024 (0x80ee3a000) SIGNAL 14 (SIGALRM) sigprocmask(SIG_SETMASK,SIGINT|SIGQUIT|SIGALRM|SIGCHLD|SIGIO|SIGPROF|SIGWINCH,0x0) = 0 (0x0) sigreturn(0x7ffffffec630,0x7ffffffec630,0x301,0x0,0xfffffffffffffbc0,0x0) = 34609537064 (0x80ee3a028) munmap(0x80d20a000,29556736) = 0 (0x0) recvmsg(0x6,0x7ffffffecb80,0x0,0x1000,0x1c30000,0x0) ERR#35 'Resource temporarily unavailable' --8<---------------cut here---------------end--------------->8--- And here's the version with the patch above applied. Should Emacs use the GNU version of malloc? yes Should Emacs use a relocating allocator for buffers? yes Should Emacs use mmap(2) for buffer allocation? no --8<---------------cut here---------------start------------->8--- sigprocmask(SIG_BLOCK,SIGINT|SIGALRM,0x0) = 0 (0x0) clock_gettime(0,{1418846834.087766996 }) = 0 (0x0) ktimer_settime(0x3,0x1,0x7ffffffece90,0x0,0x0,0xd10fe8) = 0 (0x0) sigprocmask(SIG_SETMASK,0x0,SIGINT|SIGALRM) = 0 (0x0) nanosleep({0.000001000 }) = 0 (0x0) read(5,"n the Family" (1971) {Archie See"...,65536) = 65536 (0x10000) break(0xeb9a000) = 0 (0x0) read(5,"en" (1970) {(#1.5899)}\t\t\t1992"...,65536) = 65536 (0x10000) break(0xebaa000) = 0 (0x0) read(5,"\t\t2008\n"All My Children" (197"...,65536) = 65536 (0x10000) break(0xebba000) = 0 (0x0) read(5,"(1998) {False Convictions (#8.15"...,65536) = 65536 (0x10000) break(0xebca000) = 0 (0x0) read(5,"la lei\M-p" (2008) {Fimmti \M-~"...,65536) = 65536 (0x10000) break(0xebda000) = 0 (0x0) read(5,"014\n"Allt f\M-vr Sverige" (2011"...,65536) = 65536 (0x10000) SIGNAL 14 (SIGALRM) sigreturn(0x7ffffffeca70,0x10003,0x7ffffffeca70,0x7ffffffed478,0x41e8,0xd10fe8) = 25710504 (0x1884fa8) recvmsg(0x4,0x7ffffffecbc0,0x0,0x1000,0x41e8,0xd10fe8) ERR#35 'Resource temporarily unavailable' --8<---------------cut here---------------end--------------->8--- From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 18 Dec 2014 16:23:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141891974312738 (code B ref 19393); Thu, 18 Dec 2014 16:23:02 +0000 Received: (at 19393) by debbugs.gnu.org; 18 Dec 2014 16:22:23 +0000 Received: from localhost ([127.0.0.1]:50312 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1dqI-0003JN-MM for submit@debbugs.gnu.org; Thu, 18 Dec 2014 11:22:23 -0500 Received: from mtaout27.012.net.il ([80.179.55.183]:46501) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1dqG-0003JC-4v for 19393@debbugs.gnu.org; Thu, 18 Dec 2014 11:22:21 -0500 Received: from conversion-daemon.mtaout27.012.net.il by mtaout27.012.net.il (HyperSendmail v2007.08) id <0NGS00800D38LA00@mtaout27.012.net.il> for 19393@debbugs.gnu.org; Thu, 18 Dec 2014 18:18:20 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by mtaout27.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NGS005AHDAKNZ40@mtaout27.012.net.il>; Thu, 18 Dec 2014 18:18:20 +0200 (IST) Date: Thu, 18 Dec 2014 18:22:14 +0200 From: Eli Zaretskii In-reply-to: <85bnn1pvr1.fsf@iznogoud.viz> X-012-Sender: halo1@inter.net.il Message-id: <83388dudvt.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Wolfgang Jenkner > Cc: 19393@debbugs.gnu.org > Date: Thu, 18 Dec 2014 02:47:41 +0100 > > > That's what I thought. AFAIK, FreeBSD systems use mmap(2) explicitly > > for buffer memory allocation, and that could be slow when we need to > > repeatedly reallocate buffer text and memmove the text between old and > > new. > > > >> but the emacs versions I have are more than a month old, so I'll > >> bootstrap from a current git checkout and try again. > > > > If I'm right, this won't change the result. > > You are right, of course (it took around 15 minutes system+user time). > > So, I tried > > --8<---------------cut here---------------start------------->8--- > diff --git a/configure.ac b/configure.ac > index 010abc8..de1c5e8 100644 > --- a/configure.ac > +++ b/configure.ac > @@ -2127,7 +2127,7 @@ fi > > use_mmap_for_buffers=no > case "$opsys" in > - cygwin|mingw32|freebsd|irix6-5) use_mmap_for_buffers=yes ;; > + cygwin|mingw32|irix6-5) use_mmap_for_buffers=yes ;; > esac > > AC_FUNC_MMAP > --8<---------------cut here---------------end--------------->8--- > > However, this still took around 10 minutes (I tested with emacs -Q in > both cases, of course). That's expected: when you disable mmap, Emacs uses ralloc.c, which still has this problem. Btw, is this with the compressed file or after decompressing it? My guess is the former. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 18 Dec 2014 16:37:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141892058514296 (code B ref 19393); Thu, 18 Dec 2014 16:37:01 +0000 Received: (at 19393) by debbugs.gnu.org; 18 Dec 2014 16:36:25 +0000 Received: from localhost ([127.0.0.1]:50376 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1e3t-0003iW-Dh for submit@debbugs.gnu.org; Thu, 18 Dec 2014 11:36:25 -0500 Received: from b2bfep14.mx.upcmail.net ([62.179.121.59]:57387) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1e3q-0003iL-Kg for 19393@debbugs.gnu.org; Thu, 18 Dec 2014 11:36:24 -0500 Received: from edge11.upcmail.net ([192.168.13.81]) by b2bfep14.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20141218163620.XSVQ11972.b2bfep14-int.chello.at@edge11.upcmail.net> for <19393@debbugs.gnu.org>; Thu, 18 Dec 2014 17:36:20 +0100 Received: from iznogoud.viz ([85.127.8.35]) by edge11.upcmail.net with edge id V4cK1p0050lM6Wl0B4cK0B; Thu, 18 Dec 2014 17:36:20 +0100 X-SourceIP: 85.127.8.35 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Y1e3n-0001pb-2o; Thu, 18 Dec 2014 17:36:19 +0100 From: Wolfgang Jenkner References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> Date: Thu, 18 Dec 2014 17:36:19 +0100 In-Reply-To: <83388dudvt.fsf@gnu.org> (Eli Zaretskii's message of "Thu, 18 Dec 2014 18:22:14 +0200") Message-ID: <85vbl8nce4.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Thu, Dec 18 2014, Eli Zaretskii wrote: >> - cygwin|mingw32|freebsd|irix6-5) use_mmap_for_buffers=yes ;; >> + cygwin|mingw32|irix6-5) use_mmap_for_buffers=yes ;; [...] >> However, this still took around 10 minutes (I tested with emacs -Q in >> both cases, of course). > > That's expected: when you disable mmap, Emacs uses ralloc.c, which > still has this problem. Shouldn't other systems for which the native malloc is not used have a similar problem then? > Btw, is this with the compressed file or after decompressing it? My > guess is the former. No, with the uncompressed file. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 18 Dec 2014 17:35:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: notabug To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141892405720159 (code B ref 19393); Thu, 18 Dec 2014 17:35:02 +0000 Received: (at 19393) by debbugs.gnu.org; 18 Dec 2014 17:34:17 +0000 Received: from localhost ([127.0.0.1]:50439 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1ext-0005F4-4u for submit@debbugs.gnu.org; Thu, 18 Dec 2014 12:34:17 -0500 Received: from mtaout25.012.net.il ([80.179.55.181]:57451) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y1exr-0005Es-Fd for 19393@debbugs.gnu.org; Thu, 18 Dec 2014 12:34:16 -0500 Received: from conversion-daemon.mtaout25.012.net.il by mtaout25.012.net.il (HyperSendmail v2007.08) id <0NGS00800GF5LN00@mtaout25.012.net.il> for 19393@debbugs.gnu.org; Thu, 18 Dec 2014 19:30:01 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by mtaout25.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NGS003HOGM0CK60@mtaout25.012.net.il>; Thu, 18 Dec 2014 19:30:01 +0200 (IST) Date: Thu, 18 Dec 2014 19:34:09 +0200 From: Eli Zaretskii In-reply-to: <85vbl8nce4.fsf@iznogoud.viz> X-012-Sender: halo1@inter.net.il Message-id: <83tx0suajy.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Wolfgang Jenkner > Cc: 19393@debbugs.gnu.org > Date: Thu, 18 Dec 2014 17:36:19 +0100 > > On Thu, Dec 18 2014, Eli Zaretskii wrote: > > >> - cygwin|mingw32|freebsd|irix6-5) use_mmap_for_buffers=yes ;; > >> + cygwin|mingw32|irix6-5) use_mmap_for_buffers=yes ;; > [...] > >> However, this still took around 10 minutes (I tested with emacs -Q in > >> both cases, of course). > > > > That's expected: when you disable mmap, Emacs uses ralloc.c, which > > still has this problem. > > Shouldn't other systems for which the native malloc is not used have > a similar problem then? There are almost none of them. But yes, those which do should have a similar problem. > > Btw, is this with the compressed file or after decompressing it? My > > guess is the former. > > No, with the uncompressed file. Then it's probably some inefficiency in insert-file-contents, when it is called to revert a buffer. If you have time, please take a look what happens there, I suspect we reallocate the buffer in very small chunks, instead of doing it with larger increments. (With compressed files, it's hard to do, because the size of the uncompressed file is not known in advance.) Thanks. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 20 Dec 2014 03:23:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141904572223695 (code B ref 19393); Sat, 20 Dec 2014 03:23:02 +0000 Received: (at 19393) by debbugs.gnu.org; 20 Dec 2014 03:22:02 +0000 Received: from localhost ([127.0.0.1]:52066 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y2AcD-0006A7-UA for submit@debbugs.gnu.org; Fri, 19 Dec 2014 22:22:02 -0500 Received: from b2bfep15.mx.upcmail.net ([62.179.121.60]:45864) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y2AcA-00069e-26 for 19393@debbugs.gnu.org; Fri, 19 Dec 2014 22:21:59 -0500 Received: from edge12.upcmail.net ([192.168.13.82]) by b2bfep15.mx.upcmail.net (InterMail vM.8.01.05.05 201-2260-151-110-20120111) with ESMTP id <20141220032155.FZLJ21184.b2bfep15-int.chello.at@edge12.upcmail.net> for <19393@debbugs.gnu.org>; Sat, 20 Dec 2014 04:21:55 +0100 Received: from iznogoud.viz ([85.127.11.157]) by edge12.upcmail.net with edge id VfMv1p00H3PJ2L50CfMvEN; Sat, 20 Dec 2014 04:21:55 +0100 X-SourceIP: 85.127.11.157 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1Y2Ac6-00011b-Ue; Sat, 20 Dec 2014 04:21:54 +0100 From: Wolfgang Jenkner References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> Date: Sat, 20 Dec 2014 04:21:54 +0100 In-Reply-To: <83tx0suajy.fsf@gnu.org> (Eli Zaretskii's message of "Thu, 18 Dec 2014 19:34:09 +0200") Message-ID: <85vbl7qa3x.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Thu, Dec 18 2014, Eli Zaretskii wrote: > Then it's probably some inefficiency in insert-file-contents, when it > is called to revert a buffer. If you have time, please take a look > what happens there, I suspect we reallocate the buffer in very small > chunks, instead of doing it with larger increments. (With compressed > files, it's hard to do, because the size of the uncompressed file is > not known in advance.) I have been looking into this with dtrace and what is sure is that a large amount of data (increasing up to the order of magnitude of the buffer size) is memcpy'd again and again as a result of mmap_realloc being called by enlarge_buffer_text. Apparently, the latter is called for buffer gap handling which is triggered by decode_coding_c_string (or rather decode_coding_object) in insert-file-contents. So it seems that the effect on memory of this innocent-looking loop there is enormously magnified. But I have to look at the source more closely (not that I expect to get any idea how to fix this, though). From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 20 Dec 2014 07:28:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.141906046614801 (code B ref 19393); Sat, 20 Dec 2014 07:28:02 +0000 Received: (at 19393) by debbugs.gnu.org; 20 Dec 2014 07:27:46 +0000 Received: from localhost ([127.0.0.1]:52099 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y2ES1-0003qe-7N for submit@debbugs.gnu.org; Sat, 20 Dec 2014 02:27:45 -0500 Received: from mtaout20.012.net.il ([80.179.55.166]:48364) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Y2ERx-0003qT-81 for 19393@debbugs.gnu.org; Sat, 20 Dec 2014 02:27:42 -0500 Received: from conversion-daemon.a-mtaout20.012.net.il by a-mtaout20.012.net.il (HyperSendmail v2007.08) id <0NGV00E00DXBXL00@a-mtaout20.012.net.il> for 19393@debbugs.gnu.org; Sat, 20 Dec 2014 09:27:39 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout20.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NGV00ELYE23P0A0@a-mtaout20.012.net.il>; Sat, 20 Dec 2014 09:27:39 +0200 (IST) Date: Sat, 20 Dec 2014 09:27:39 +0200 From: Eli Zaretskii In-reply-to: <85vbl7qa3x.fsf@iznogoud.viz> X-012-Sender: halo1@inter.net.il Message-id: <83ioh6srv8.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Wolfgang Jenkner > Cc: 19393@debbugs.gnu.org > Date: Sat, 20 Dec 2014 04:21:54 +0100 > > I have been looking into this with dtrace and what is sure is that > a large amount of data (increasing up to the order of magnitude of the > buffer size) is memcpy'd again and again as a result of mmap_realloc > being called by enlarge_buffer_text. Apparently, the latter is called > for buffer gap handling which is triggered by decode_coding_c_string (or > rather decode_coding_object) in insert-file-contents. So it seems that > the effect on memory of this innocent-looking loop there is enormously > magnified. Yes, that'd be my guess for the reason. > But I have to look at the source more closely (not that I expect to get > any idea how to fix this, though). Since we know the size of the file, we could perhaps compute the new buffer size up front (taking some conservative approximations, if needed), and mmap_realloc it only once. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 13 Jan 2015 14:09:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14211581003863 (code B ref 19393); Tue, 13 Jan 2015 14:09:02 +0000 Received: (at 19393) by debbugs.gnu.org; 13 Jan 2015 14:08:20 +0000 Received: from localhost ([127.0.0.1]:55129 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB28p-00010E-W1 for submit@debbugs.gnu.org; Tue, 13 Jan 2015 09:08:20 -0500 Received: from b2bfep14.mx.upcmail.net ([62.179.121.59]:48407) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB28m-0000zw-Fk for 19393@debbugs.gnu.org; Tue, 13 Jan 2015 09:08:18 -0500 Received: from edge11.upcmail.net ([192.168.13.81]) by b2bfep14.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20150113140809.EOEZ11972.b2bfep14-int.chello.at@edge11.upcmail.net> for <19393@debbugs.gnu.org>; Tue, 13 Jan 2015 15:08:09 +0100 Received: from iznogoud.viz ([85.127.90.213]) by edge11.upcmail.net with edge id fS871p01G4cBfQ50BS88xl; Tue, 13 Jan 2015 15:08:09 +0100 X-SourceIP: 85.127.90.213 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1YB28d-0000Im-HR; Tue, 13 Jan 2015 15:08:07 +0100 From: Wolfgang Jenkner Date: Tue, 13 Jan 2015 15:06:01 +0100 References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> Message-ID: <85h9vuai48.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) --=-=-= Content-Type: text/plain Here's a simple change in src/buffer.c that reduces the time to six seconds or so, but only for newer versions of FreeBSD. It takes advantage of the MAP_EXCL flag for mmap(2), which has been recently added[1] and is also available in 10-STABLE and 10.1-RELEASE. In percentage of user CPU time, the hotuser script[2] from the dtrace toolkit shows a change from [...] emacs-25.0.50.1`decode_coding 537 0.1% emacs-25.0.50.1`produce_chars 2109 0.4% emacs-25.0.50.1`decode_coding_charset 2544 0.5% libc.so.7`memcpy 516884 98.9% to [...] libc.so.7`memcpy 220 4.1% bootstrap-emacs`decode_coding 488 9.0% bootstrap-emacs`produce_chars 2100 38.8% bootstrap-emacs`decode_coding_charset 2501 46.2% (the second column counts sample points, of which there are 1001 per second for each CPU core) The numbers are for the system compiler (clang 3.4.1) with default optimizations, though they are even a bit better for gcc 4.9. However, if the file in question is compressed revert-buffer-with-coding-system still takes 4 minutes (the user time being dominated to 98% by memmove). [1] https://svnweb.freebsd.org/base?view=revision&revision=267630 [2] https://svnweb.freebsd.org/base/stable/10/cddl/contrib/dtracetoolkit/hotuser?revision=256281&view=co --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0001-Actually-use-mmap_enlarge-for-FreeBSD-10.1-or-newer.patch Content-Description: Use MAP_EXCL mmap flag. >From b0233ff2274e554339da3c4606ff7fb5fc961e82 Mon Sep 17 00:00:00 2001 From: Wolfgang Jenkner Date: Tue, 23 Dec 2014 01:50:10 +0100 Subject: [PATCH] Actually use mmap_enlarge for FreeBSD 10.1 or newer. * src/buffer.c (MAP_EXCL): Make sure it is always defined. (MMAP_ALLOCATED_P, mmap_enlarge): Use it. This alleviates a performance problem due to excessive use of memcpy(3). (Bug#19393) --- src/ChangeLog | 8 ++++++++ src/buffer.c | 15 ++++++++++++--- 2 files changed, 20 insertions(+), 3 deletions(-) diff --git a/src/ChangeLog b/src/ChangeLog index 252dfd3..b526e28 100644 --- a/src/ChangeLog +++ b/src/ChangeLog @@ -1,3 +1,11 @@ +2014-12-24 Wolfgang Jenkner + + Actually use mmap_enlarge for FreeBSD 10.1 or newer. + * buffer.c (MAP_EXCL): Make sure it is always defined. + (MMAP_ALLOCATED_P, mmap_enlarge): Use it. + This alleviates a performance problem due to excessive use of + memcpy(3). (Bug#19393) + 2015-01-12 Paul Eggert Port to 32-bit MingGW --with-wide-int diff --git a/src/buffer.c b/src/buffer.c index d0ffe67d9..8a97f3d 100644 --- a/src/buffer.c +++ b/src/buffer.c @@ -4683,10 +4683,19 @@ static bool mmap_initialized_p; Default is to conservatively assume the address range is occupied by something else. This can be overridden by system configuration - files if system-specific means to determine this exists. */ + files if system-specific means to determine this exists. + + However, if MAP_EXCL is defined assume that it is an mmap flag + which, combined with MAP_FIXED, has FreeBSD semantics, viz., the + mapping request will fail if a mapping already exists within the + range (the flag was first present in release 10.1). */ + +#ifndef MAP_EXCL +#define MAP_EXCL 0 +#endif #ifndef MMAP_ALLOCATED_P -#define MMAP_ALLOCATED_P(start, end) 1 +#define MMAP_ALLOCATED_P(start, end) (!MAP_EXCL) #endif /* Perform necessary initializations for the use of mmap. */ @@ -4770,7 +4779,7 @@ mmap_enlarge (struct mmap_region *r, int npages) void *p; p = mmap (region_end, nbytes, PROT_READ | PROT_WRITE, - MAP_ANON | MAP_PRIVATE | MAP_FIXED, mmap_fd, 0); + MAP_ANON | MAP_EXCL | MAP_PRIVATE | MAP_FIXED, mmap_fd, 0); if (p == MAP_FAILED) ; /* fprintf (stderr, "mmap: %s\n", emacs_strerror (errno)); */ else if (p != region_end) -- 2.2.1 --=-=-=-- From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 13 Jan 2015 16:26:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.142116632817147 (code B ref 19393); Tue, 13 Jan 2015 16:26:01 +0000 Received: (at 19393) by debbugs.gnu.org; 13 Jan 2015 16:25:28 +0000 Received: from localhost ([127.0.0.1]:55609 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB4HY-0004SV-Hv for submit@debbugs.gnu.org; Tue, 13 Jan 2015 11:25:28 -0500 Received: from mtaout22.012.net.il ([80.179.55.172]:44601) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB4HV-0004SE-4u for 19393@debbugs.gnu.org; Tue, 13 Jan 2015 11:25:26 -0500 Received: from conversion-daemon.a-mtaout22.012.net.il by a-mtaout22.012.net.il (HyperSendmail v2007.08) id <0NI400400ITHHP00@a-mtaout22.012.net.il> for 19393@debbugs.gnu.org; Tue, 13 Jan 2015 18:24:57 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout22.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NI4004QEIXKDK30@a-mtaout22.012.net.il>; Tue, 13 Jan 2015 18:24:56 +0200 (IST) Date: Tue, 13 Jan 2015 18:25:05 +0200 From: Eli Zaretskii In-reply-to: <85h9vuai48.fsf@iznogoud.viz> X-012-Sender: halo1@inter.net.il Message-id: <83ioga4pi6.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Wolfgang Jenkner > Cc: 19393@debbugs.gnu.org > Date: Tue, 13 Jan 2015 15:06:01 +0100 > > However, if the file in question is compressed > revert-buffer-with-coding-system still takes 4 minutes (the user time > being dominated to 98% by memmove). Is the problem with compressed files due to the fact that the size is unknown in advance? If so, perhaps enlarging by more than was requested (e.g., twice as large) will alleviate the problem? Thanks. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 13 Jan 2015 17:14:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.142116919621888 (code B ref 19393); Tue, 13 Jan 2015 17:14:01 +0000 Received: (at 19393) by debbugs.gnu.org; 13 Jan 2015 17:13:16 +0000 Received: from localhost ([127.0.0.1]:55674 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB51n-0005gy-Jn for submit@debbugs.gnu.org; Tue, 13 Jan 2015 12:13:16 -0500 Received: from b2bfep16.mx.upcmail.net ([62.179.121.61]:34278) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB51k-0005gi-AZ for 19393@debbugs.gnu.org; Tue, 13 Jan 2015 12:13:14 -0500 Received: from edge12.upcmail.net ([192.168.13.82]) by b2bfep16.mx.upcmail.net (InterMail vM.8.01.05.05 201-2260-151-110-20120111) with ESMTP id <20150113171255.HET6241.b2bfep16-int.chello.at@edge12.upcmail.net> for <19393@debbugs.gnu.org>; Tue, 13 Jan 2015 18:12:55 +0100 Received: from iznogoud.viz ([85.127.90.213]) by edge12.upcmail.net with edge id fVCu1p0084cBfQ50CVCuxC; Tue, 13 Jan 2015 18:12:54 +0100 X-SourceIP: 85.127.90.213 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1YB51S-0004tX-3p; Tue, 13 Jan 2015 18:12:54 +0100 From: Wolfgang Jenkner References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> <83ioga4pi6.fsf@gnu.org> Date: Tue, 13 Jan 2015 18:12:54 +0100 Message-ID: <85k30q7gfd.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Tue, Jan 13 2015, Eli Zaretskii wrote: >> From: Wolfgang Jenkner >> Cc: 19393@debbugs.gnu.org >> Date: Tue, 13 Jan 2015 15:06:01 +0100 >> >> However, if the file in question is compressed >> revert-buffer-with-coding-system still takes 4 minutes (the user time >> being dominated to 98% by memmove). > > Is the problem with compressed files due to the fact that the size is > unknown in advance? I only know that loading the compressed file from disk with the same coding system conversion as above takes just a few seconds, i.e., doing something like C-x RET c l a t i n - 1 C-x C-f m o v i e s . l i s t . g z is fast (enough). > If so, perhaps enlarging by more than was > requested (e.g., twice as large) will alleviate the problem? IIUC, this is your previous suggestion about improving insert-file-contents itself? From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 13 Jan 2015 17:32:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Wolfgang Jenkner Cc: 19393@debbugs.gnu.org Reply-To: Eli Zaretskii Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.142117030923720 (code B ref 19393); Tue, 13 Jan 2015 17:32:01 +0000 Received: (at 19393) by debbugs.gnu.org; 13 Jan 2015 17:31:49 +0000 Received: from localhost ([127.0.0.1]:55698 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB5Jl-0006AV-1K for submit@debbugs.gnu.org; Tue, 13 Jan 2015 12:31:49 -0500 Received: from mtaout20.012.net.il ([80.179.55.166]:37898) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YB5Ji-0006AE-LC for 19393@debbugs.gnu.org; Tue, 13 Jan 2015 12:31:47 -0500 Received: from conversion-daemon.a-mtaout20.012.net.il by a-mtaout20.012.net.il (HyperSendmail v2007.08) id <0NI400D00LYAPE00@a-mtaout20.012.net.il> for 19393@debbugs.gnu.org; Tue, 13 Jan 2015 19:31:39 +0200 (IST) Received: from HOME-C4E4A596F7 ([87.69.4.28]) by a-mtaout20.012.net.il (HyperSendmail v2007.08) with ESMTPA id <0NI400D6JM0RIR50@a-mtaout20.012.net.il>; Tue, 13 Jan 2015 19:31:39 +0200 (IST) Date: Tue, 13 Jan 2015 19:31:48 +0200 From: Eli Zaretskii In-reply-to: <85k30q7gfd.fsf@iznogoud.viz> X-012-Sender: halo1@inter.net.il Message-id: <83h9vu4mez.fsf@gnu.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> <83ioga4pi6.fsf@gnu.org> <85k30q7gfd.fsf@iznogoud.viz> X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) > From: Wolfgang Jenkner > Cc: 19393@debbugs.gnu.org > Date: Tue, 13 Jan 2015 18:12:54 +0100 > > > Is the problem with compressed files due to the fact that the size is > > unknown in advance? > > I only know that loading the compressed file from disk with the same > coding system conversion as above takes just a few seconds, i.e., doing > something like > > C-x RET c l a t i n - 1 C-x C-f m o v i e s . l i s t . g z > > is fast (enough). Then it's probably not what I had in mind. > > If so, perhaps enlarging by more than was > > requested (e.g., twice as large) will alleviate the problem? > > IIUC, this is your previous suggestion about improving > insert-file-contents itself? According to what you see, it sounds like determining the encoding is what takes the time here, for some reason triggering massive memmove's. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 14 Jan 2015 19:44:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.142126462322931 (code B ref 19393); Wed, 14 Jan 2015 19:44:02 +0000 Received: (at 19393) by debbugs.gnu.org; 14 Jan 2015 19:43:43 +0000 Received: from localhost ([127.0.0.1]:57126 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBTqw-0005xm-Nc for submit@debbugs.gnu.org; Wed, 14 Jan 2015 14:43:43 -0500 Received: from b2bfep16.mx.upcmail.net ([62.179.121.61]:39831) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBTqs-0005xR-IY for 19393@debbugs.gnu.org; Wed, 14 Jan 2015 14:43:40 -0500 Received: from edge12.upcmail.net ([192.168.13.82]) by b2bfep16.mx.upcmail.net (InterMail vM.8.01.05.05 201-2260-151-110-20120111) with ESMTP id <20150114194320.EGQX19129.b2bfep16-int.chello.at@edge12.upcmail.net> for <19393@debbugs.gnu.org>; Wed, 14 Jan 2015 20:43:20 +0100 Received: from iznogoud.viz ([91.119.235.210]) by edge12.upcmail.net with edge id fvjK1p00f4Z2dTv0CvjLgF; Wed, 14 Jan 2015 20:43:20 +0100 X-SourceIP: 91.119.235.210 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1YBTqZ-0000hq-MF; Wed, 14 Jan 2015 20:43:19 +0100 From: Wolfgang Jenkner Date: Wed, 14 Jan 2015 20:41:21 +0100 References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> Message-ID: <85oaq1gnc8.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Tue, Jan 13 2015, Wolfgang Jenkner wrote: > Here's a simple change in src/buffer.c that reduces the time to six > seconds or so, but only for newer versions of FreeBSD. > > It takes advantage of the MAP_EXCL flag for mmap(2), which has been > recently added[1] and is also available in 10-STABLE and 10.1-RELEASE. There remains the problem, though, that emacs on FreeBSD also uses gmalloc and hence, IIUC, sbrk() for memory allocation, and at this point I'm too ignorant about almost everything involved here to be confident that mmap()ed pages can't overlap with the process (BSS) data segment when MAP_EXCL | MAP_FIXED is among the flags. Without the MAP_EXCL mmap flag they definitely can overlap, as the following test program shows when it is _statically_ linked. Here's the output when I run it: r0 = 0x800663000 Cannot allocate memory r2 = 0x800662000 -- >8 -- #include #include #include #include #include int main () { int n; void *r0, *r1, *r2; n = getpagesize(); r0 = mmap(NULL, n, PROT_READ | PROT_WRITE, MAP_ANON, -1, 0); if (r0 == MAP_FAILED || brk(r0) != 0 || sbrk(0) != r0) return (1); fprintf(stderr, "r0 = %p\n", r0); errno = 0; r1 = mmap(r0 - n, n, PROT_READ | PROT_WRITE, MAP_ANON | MAP_EXCL | MAP_FIXED, -1, 0); if (r1 == MAP_FAILED) perror(NULL); else fprintf(stderr, "r1 = %p\n", r1); errno = 0; r2 = mmap(r0 - n, n, PROT_READ | PROT_WRITE, MAP_ANON | MAP_FIXED, -1, 0); if (r2 == MAP_FAILED) perror(NULL); else fprintf(stderr, "r2 = %p\n", r2); return (0); } From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files In-Reply-To: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 15 Jan 2015 13:40:03 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Eli Zaretskii Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.142132918021651 (code B ref 19393); Thu, 15 Jan 2015 13:40:03 +0000 Received: (at 19393) by debbugs.gnu.org; 15 Jan 2015 13:39:40 +0000 Received: from localhost ([127.0.0.1]:57426 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBkeB-0005d9-Ut for submit@debbugs.gnu.org; Thu, 15 Jan 2015 08:39:40 -0500 Received: from b2bfep11.mx.upcmail.net ([62.179.121.56]:60600) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBke7-0005cs-Mq for 19393@debbugs.gnu.org; Thu, 15 Jan 2015 08:39:37 -0500 Received: from edge11.upcmail.net ([192.168.13.81]) by b2bfep11.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20150115133928.UPEY22355.b2bfep11-int.chello.at@edge11.upcmail.net> for <19393@debbugs.gnu.org>; Thu, 15 Jan 2015 14:39:28 +0100 Received: from iznogoud.viz ([91.119.120.37]) by edge11.upcmail.net with edge id gDfT1p00H0oWRX70BDfToM; Thu, 15 Jan 2015 14:39:28 +0100 X-SourceIP: 91.119.120.37 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1YBkdy-0000LM-Sg; Thu, 15 Jan 2015 14:39:26 +0100 From: Wolfgang Jenkner Date: Thu, 15 Jan 2015 14:38:10 +0100 References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> <85oaq1gnc8.fsf@iznogoud.viz> Message-ID: <85bnm088oh.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Wed, Jan 14 2015, Wolfgang Jenkner wrote: > There remains the problem, though, that emacs on FreeBSD also uses > gmalloc and hence, IIUC, sbrk() for memory allocation, and at this point > I'm too ignorant about almost everything involved here to be confident > that mmap()ed pages can't overlap with the process (BSS) data segment > when MAP_EXCL | MAP_FIXED is among the flags. > > Without the MAP_EXCL mmap flag they definitely can overlap, as the > following test program shows when it is _statically_ linked. > > Here's the output when I run it: > > r0 = 0x800663000 > Cannot allocate memory > r2 = 0x800662000 However, I somehow forgot that, quite contrary to my test program, src/buffer.c would use MAP_FIXED only when trying to add some other pages on top of an existing region, the beginning of which was mmap'd without MAP_FIXED. Hence the new region could only reach into the data segment if the old one was already there. That is, the patch doesn't change the current situation in this regard. So I think that the patch would be OK, after all. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Stefan Monnier Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 15 Jan 2015 16:09:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Wolfgang Jenkner Cc: Eli Zaretskii , 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.14213380848218 (code B ref 19393); Thu, 15 Jan 2015 16:09:02 +0000 Received: (at 19393) by debbugs.gnu.org; 15 Jan 2015 16:08:04 +0000 Received: from localhost ([127.0.0.1]:57899 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBmxo-00028T-3g for submit@debbugs.gnu.org; Thu, 15 Jan 2015 11:08:04 -0500 Received: from pruche.dit.umontreal.ca ([132.204.246.22]:57595) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBmxm-00028L-RF for 19393@debbugs.gnu.org; Thu, 15 Jan 2015 11:08:03 -0500 Received: from pastel.home (lechon.iro.umontreal.ca [132.204.27.242]) by pruche.dit.umontreal.ca (8.14.1/8.14.1) with ESMTP id t0FG80hq018683; Thu, 15 Jan 2015 11:08:01 -0500 Received: by pastel.home (Postfix, from userid 20848) id B2461A32; Thu, 15 Jan 2015 11:08:00 -0500 (EST) From: Stefan Monnier Message-ID: References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> <85oaq1gnc8.fsf@iznogoud.viz> <85bnm088oh.fsf@iznogoud.viz> Date: Thu, 15 Jan 2015 11:08:00 -0500 In-Reply-To: <85bnm088oh.fsf@iznogoud.viz> (Wolfgang Jenkner's message of "Thu, 15 Jan 2015 14:38:10 +0100") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-NAI-Spam-Flag: NO X-NAI-Spam-Threshold: 5 X-NAI-Spam-Score: 0 X-NAI-Spam-Rules: 1 Rules triggered RV5187=0 X-NAI-Spam-Version: 2.3.0.9393 : core <5187> : inlines <1773> : streams <1373859> : uri <1842497> X-Spam-Score: -1.3 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.3 (-) > However, I somehow forgot that, quite contrary to my test program, > src/buffer.c would use MAP_FIXED only when trying to add some other > pages on top of an existing region, the beginning of which was mmap'd > without MAP_FIXED. Hence the new region could only reach into the data > segment if the old one was already there. That is, the patch doesn't > change the current situation in this regard. > So I think that the patch would be OK, after all. Thanks Wolfgang for looking into this. I'm really unfamiliar with that code, so I can't help much, but hopefully someone else will be able to take care of your patch, Stefan From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 15 Jan 2015 17:01:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Stefan Monnier Cc: 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.142134121713737 (code B ref 19393); Thu, 15 Jan 2015 17:01:02 +0000 Received: (at 19393) by debbugs.gnu.org; 15 Jan 2015 17:00:17 +0000 Received: from localhost ([127.0.0.1]:57941 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBnmJ-0003Z1-Qt for submit@debbugs.gnu.org; Thu, 15 Jan 2015 12:00:16 -0500 Received: from b2bfep13.mx.upcmail.net ([62.179.121.58]:41708) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1YBnmG-0003Rc-Ja for 19393@debbugs.gnu.org; Thu, 15 Jan 2015 12:00:14 -0500 Received: from edge11.upcmail.net ([192.168.13.81]) by b2bfep13.mx.upcmail.net (InterMail vM.8.01.05.11 201-2260-151-128-20120928) with ESMTP id <20150115170005.RKMG20529.b2bfep13-int.chello.at@edge11.upcmail.net> for <19393@debbugs.gnu.org>; Thu, 15 Jan 2015 18:00:05 +0100 Received: from iznogoud.viz ([91.119.120.37]) by edge11.upcmail.net with edge id gH041p00g0oWRX70BH04DJ; Thu, 15 Jan 2015 18:00:04 +0100 X-SourceIP: 91.119.120.37 Received: from wolfgang by iznogoud.viz with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1YBnm8-0003hs-65; Thu, 15 Jan 2015 18:00:04 +0100 From: Wolfgang Jenkner References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> <85oaq1gnc8.fsf@iznogoud.viz> <85bnm088oh.fsf@iznogoud.viz> Date: Thu, 15 Jan 2015 18:00:04 +0100 In-Reply-To: (Stefan Monnier's message of "Thu, 15 Jan 2015 11:08:00 -0500") Message-ID: <854mrs7ze3.fsf@iznogoud.viz> User-Agent: Gnus/5.130012 (Ma Gnus v0.12) Emacs/25.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.0 (/) On Thu, Jan 15 2015, Stefan Monnier wrote: > but hopefully someone else will be able to > take care of your patch, You gave me a commit bit (but I haven't been very active since then)... From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Lars Ingebrigtsen Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Mon, 07 Sep 2020 21:31:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Wolfgang Jenkner Cc: Eli Zaretskii , 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.15995142419716 (code B ref 19393); Mon, 07 Sep 2020 21:31:02 +0000 Received: (at 19393) by debbugs.gnu.org; 7 Sep 2020 21:30:41 +0000 Received: from localhost ([127.0.0.1]:51186 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kFOim-0002We-Sb for submit@debbugs.gnu.org; Mon, 07 Sep 2020 17:30:41 -0400 Received: from quimby.gnus.org ([95.216.78.240]:33738) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kFOil-0002WP-Cn for 19393@debbugs.gnu.org; Mon, 07 Sep 2020 17:30:39 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date: References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=/ip6sOHRPZ4KaHXeBbQscdJWv+mT7SR7cPQoaKEjlQY=; b=mAKuoDXqeAcEJOjxKF5CA0fa2U KDyor9GEzMBinXj1o162NMLf4wQ3h9qJIFBiQKGt2SudiONCWRv3zsVK2GaAvDIS5RItp+ZBNT1a4 xp320iyjzXRs6JsIWpI81kl/hE4FdvOFjMgJpkhhEVScpH5COKxX5M6pm7iaxIb8muAE=; Received: from cm-84.212.202.86.getinternet.no ([84.212.202.86] helo=xo) by quimby with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kFOiS-00043M-5W; Mon, 07 Sep 2020 23:30:32 +0200 From: Lars Ingebrigtsen References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> X-Now-Playing: Various's _For Discos Only (1)_: "The Players Association - Turn the Music Up! (12" Disco)" Date: Mon, 07 Sep 2020 23:30:18 +0200 In-Reply-To: <85h9vuai48.fsf@iznogoud.viz> (Wolfgang Jenkner's message of "Tue, 13 Jan 2015 15:06:01 +0100") Message-ID: <871rjd8ec5.fsf@gnus.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: Wolfgang Jenkner writes: > * src/buffer.c (MAP_EXCL): Make sure it is always defined. > (MMAP_ALLOCATED_P, mmap_enlarge): Use it. > This alleviates a performance problem due to excessive use of > memcpy(3). (Bug#19393) Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Wolfgang Jenkner writes: > * src/buffer.c (MAP_EXCL): Make sure it is always defined. > (MMAP_ALLOCATED_P, mmap_enlarge): Use it. > This alleviates a performance problem due to excessive use of > memcpy(3). (Bug#19393) [...] > - MAP_ANON | MAP_PRIVATE | MAP_FIXED, mmap_fd, 0); > + MAP_ANON | MAP_EXCL | MAP_PRIVATE | MAP_FIXED, mmap_fd, 0); This patch apparently made loading huge files on FreeBSD a lot faster, but as far as I can tell, it was never applied. This was five years ago, though -- Wolfgang, is this still a problem on FreeBSD? -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Wolfgang Jenkner Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 10 Sep 2020 00:44:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Lars Ingebrigtsen Cc: Eli Zaretskii , 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.15996986155538 (code B ref 19393); Thu, 10 Sep 2020 00:44:02 +0000 Received: (at 19393) by debbugs.gnu.org; 10 Sep 2020 00:43:35 +0000 Received: from localhost ([127.0.0.1]:35478 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGAgZ-0001RF-2z for submit@debbugs.gnu.org; Wed, 09 Sep 2020 20:43:35 -0400 Received: from vie01a-dmta-at50-1.mx.upcmail.net ([62.179.121.136]:58735) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGAgX-0001R6-2W for 19393@debbugs.gnu.org; Wed, 09 Sep 2020 20:43:33 -0400 Received: from [172.31.216.42] (helo=vie01a-pemc-psmtp-at51) by vie01a-dmta-at50.mx.upcmail.net with esmtp (Exim 4.92) (envelope-from ) id 1kGAgV-0007wx-5M for 19393@debbugs.gnu.org; Thu, 10 Sep 2020 02:43:31 +0200 Received: from iznogoud.viz ([91.119.123.120]) by vie01a-pemc-psmtp-at51 with SMTP @ mailcloud.upcmail.net id S0jW2300e2by8A30B0jW9p; Thu, 10 Sep 2020 02:43:31 +0200 X-SourceIP: 91.119.123.120 X-CNFS-Analysis: v=2.2 cv=SdWHTrZu c=1 sm=2 tr=0 cx=a_idp_f a=7qjav+mrA59nEYCotopILw==:117 a=7qjav+mrA59nEYCotopILw==:17 a=reM5J-MqmosA:10 a=OocQHUDgAAAA:8 a=LCtk0XInNejxP-8jG-IA:9 a=xUZTl98r3Qw_uB5NK3jt:22 Received: from wolfgang (uid 1002) (envelope-from wjenkner@inode.at) id 106c by iznogoud.viz (DragonFly Mail Agent v0.11+); Thu, 10 Sep 2020 02:43:30 +0200 Date: Thu, 10 Sep 2020 02:43:30 +0200 From: Wolfgang Jenkner Message-ID: <20200910004330.zmoXL%wjenkner@inode.at> In-Reply-To: <871rjd8ec5.fsf@gnus.org> References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> <871rjd8ec5.fsf@gnus.org> User-Agent: s-nail v14.9.13 X-Spam-Score: -0.7 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Lars Ingebrigtsen wrote: > This was five years ago, though -- Wolfgang, is this still a problem on > FreeBSD? No, AFAICT. For the last four years or so, FreeBSD (like other non-glibc based systems) has been able to use its native libc malloc instead of the bundled gmalloc (first via HYBRID_MALLOC and now thanks to pdumper). The test case described above in this bug report now takes only a few seconds (both with or without compression). My patch above should be consigned to oblivion. From unknown Sun Sep 07 16:50:14 2025 X-Loop: help-debbugs@gnu.org Subject: bug#19393: 25.0.50; Emacs cannot determine coding system of ISO-8859 encoded files Resent-From: Lars Ingebrigtsen Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 10 Sep 2020 13:18:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19393 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Wolfgang Jenkner Cc: Eli Zaretskii , 19393@debbugs.gnu.org Received: via spool by 19393-submit@debbugs.gnu.org id=B19393.159974387625439 (code B ref 19393); Thu, 10 Sep 2020 13:18:01 +0000 Received: (at 19393) by debbugs.gnu.org; 10 Sep 2020 13:17:56 +0000 Received: from localhost ([127.0.0.1]:37650 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGMSa-0006cF-7l for submit@debbugs.gnu.org; Thu, 10 Sep 2020 09:17:56 -0400 Received: from quimby.gnus.org ([95.216.78.240]:38424) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGMSY-0006bs-L7 for 19393@debbugs.gnu.org; Thu, 10 Sep 2020 09:17:55 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date: References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=MI/BP2rougP2JW1L+xCrj8psHccv1AA69RgD5oN9FfY=; b=Iku66QLXIZMsZlmi64aTGtDL8+ PmBvs864hVqkhQLzXMesAr9lqPTArRH5MtWv6SkXPLze9ktRwAWeYSU3OjuqrOlPEkfVpobfIK+Jp 2UaaBFGNhumXLjtt5sI0G/X+SWoYWSnE3Ys3aSt0zwp86C9Wk0z6IzHS+8hu7zMfztFA=; Received: from cm-84.212.202.86.getinternet.no ([84.212.202.86] helo=xo) by quimby with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kGMSQ-0006lM-1U; Thu, 10 Sep 2020 15:17:48 +0200 From: Lars Ingebrigtsen References: <87sigfpqmx.fsf@thinkpad-t440p.tsdh.org> <85oar3xwc1.fsf@iznogoud.viz> <871tnzs7y6.fsf@thinkpad-t440p.tsdh.org> <85mw6m4aqs.fsf@iznogoud.viz> <83zjamuvgf.fsf@gnu.org> <85egry464g.fsf@iznogoud.viz> <83y4q6us1v.fsf@gnu.org> <85bnn1pvr1.fsf@iznogoud.viz> <83388dudvt.fsf@gnu.org> <85vbl8nce4.fsf@iznogoud.viz> <83tx0suajy.fsf@gnu.org> <85vbl7qa3x.fsf@iznogoud.viz> <83ioh6srv8.fsf@gnu.org> <85h9vuai48.fsf@iznogoud.viz> <871rjd8ec5.fsf@gnus.org> <20200910004330.zmoXL%wjenkner@inode.at> Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAABGdBTUEAALGPC/xhBQAAACBj SFJNAAB6JgAAgIQAAPoAAACA6AAAdTAAAOpgAAA6mAAAF3CculE8AAAAD1BMVEX75gwxKgWMeg6/ ow3///96YCDpAAAAAWJLR0QEj2jZUQAAAAd0SU1FB+QJCgwgHzI6oRIAAAGmSURBVDjLbZOLtaww CEUxNBBCA/k0QLT/3i6fRH2+cc0YZU/gHMgAABSAQwAqYAVIjDMLoMYtasAZNA0IB8AMR3Ug9qzX CABswPLobgewQHfgoaO+QfP3LlHvP4BFfgPA/gV9pU7yqcEWsrcKKSTI9qHWhoPQ1m7n+t49FdBj EItvmgCn/YqXVSASB2mcHmiFfD1LCMTOmgxmhlPWhuwPqdRpzWVoO1NuDrJLLQz0gBzApOaxgcBo 5d6BDzAdFGCK3usLTBOcSHz2b3AEMNMTrn9AjVTWEPymQraeFUD5FEfvvd7qDcTl2o5qLcsLlMZu EM1EIhr5ds5NwgeUwyiV3gNc+6Q1O15M5JPYbQ/h+q0twDoUKuzsffiEqFuOqJS0DvVObK7IlgUu NA9aRZBWjSX6CJDydMAbsIpif2hqQ+0soNYWaLN4kySAhx3Mxt7WGkCNlQ3yGkRdh7T9BNM+L3Cn 8n/Mr+JqulWOKWy547p0/npldt23QVtGtpDrrGm3xJZiBUs5uw15N7Fr+m6Fus7BZ3PSeCaEoqUE 9IsXgr680Otu1x/5dTOCZ3HoagAAACV0RVh0ZGF0ZTpjcmVhdGUAMjAyMC0wOS0xMFQxMjozMjoz MSswMDowMB3F3joAAAAldEVYdGRhdGU6bW9kaWZ5ADIwMjAtMDktMTBUMTI6MzI6MzErMDA6MDBs mGaGAAAAAElFTkSuQmCC X-Now-Playing: Various's _Disco Rallado_: "DJ Rupture - Options" Date: Thu, 10 Sep 2020 15:17:44 +0200 In-Reply-To: <20200910004330.zmoXL%wjenkner@inode.at> (Wolfgang Jenkner's message of "Thu, 10 Sep 2020 02:43:30 +0200") Message-ID: <87a6xx7ouf.fsf@gnus.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: Wolfgang Jenkner writes: > Lars Ingebrigtsen wrote: > >> This was five years ago, though -- Wolfgang, is this still a problem on >> FreeBSD? > > No, AFAICT. > > For the last four years or so, FreeBSD (like ot [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Wolfgang Jenkner writes: > Lars Ingebrigtsen wrote: > >> This was five years ago, though -- Wolfgang, is this still a problem on >> FreeBSD? > > No, AFAICT. > > For the last four years or so, FreeBSD (like other non-glibc based > systems) has been able to use its native libc malloc instead of the > bundled gmalloc (first via HYBRID_MALLOC and now thanks to pdumper). > > The test case described above in this bug report now takes only a few > seconds (both with or without compression). > > My patch above should be consigned to oblivion. OK. :-) Closing this bug report. -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no From debbugs-submit-bounces@debbugs.gnu.org Thu Sep 10 09:18:07 2020 Received: (at control) by debbugs.gnu.org; 10 Sep 2020 13:18:07 +0000 Received: from localhost ([127.0.0.1]:37654 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGMSl-0006d6-Gf for submit@debbugs.gnu.org; Thu, 10 Sep 2020 09:18:07 -0400 Received: from quimby.gnus.org ([95.216.78.240]:38440) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kGMSj-0006cQ-2B for control@debbugs.gnu.org; Thu, 10 Sep 2020 09:18:06 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Subject:From:To:Message-Id:Date:Sender:Reply-To:Cc: MIME-Version:Content-Type:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=lNmQCa4fhqxNYcbVsp5+/aeuFeb6ogxImcGbJ0JWAY0=; b=do29OPRC67IiMGY8z3TWLeDpMT sJbX7kT6vX95I2uqB5UKSFT1HODYV4Cvi9BzIkp49ewLMzOuhO/vzqwUN7IqMo37n+/AJ1xT81Suv 7+++1n30Nyqv5+3UXR6EnyS7DUiNBr+Qn6P6MB2HKpMCHgbfvTxNL2pZEPS4aOqNnUEs=; Received: from cm-84.212.202.86.getinternet.no ([84.212.202.86] helo=xo) by quimby with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kGMSb-0006la-AA for control@debbugs.gnu.org; Thu, 10 Sep 2020 15:17:59 +0200 Date: Thu, 10 Sep 2020 15:17:55 +0200 Message-Id: <878sdh7ou4.fsf@gnus.org> To: control@debbugs.gnu.org From: Lars Ingebrigtsen Subject: control message for bug #19393 X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: close 19393 quit Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) close 19393 quit