From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 06 10:23:22 2020 Received: (at submit) by debbugs.gnu.org; 6 Nov 2020 15:23:22 +0000 Received: from localhost ([127.0.0.1]:56910 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb3aD-0000WP-NE for submit@debbugs.gnu.org; Fri, 06 Nov 2020 10:23:22 -0500 Received: from lists.gnu.org ([209.51.188.17]:39626) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb3Os-0000Ce-E1 for submit@debbugs.gnu.org; Fri, 06 Nov 2020 10:11:39 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:33068) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kb3Os-0003xj-9O for bug-gnu-emacs@gnu.org; Fri, 06 Nov 2020 10:11:38 -0500 Received: from mout01.posteo.de ([185.67.36.65]:51583) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kb3Op-0003Rp-1L for bug-gnu-emacs@gnu.org; Fri, 06 Nov 2020 10:11:37 -0500 Received: from submission (posteo.de [89.146.220.130]) by mout01.posteo.de (Postfix) with ESMTPS id 5D95D16005F for ; Fri, 6 Nov 2020 16:11:30 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1604675490; bh=uKxha6ergkyOxh02KVBLEYALm+sVDXLem8JdQrsDY9E=; h=From:To:Subject:Autocrypt:Date:OpenPGP:From; b=mozHuDeXZ+uh3Z8Wg9DzhtGOUyPVEpnH7gSDh/1auzgYt0RnBl+yJu14Yve48uh2X gJsfZHjWWXG5QxW8k4dUEfMxwN1LymbihgoSP8UqR7mwzeUZ4za7faxmkyUhID4SkP H3FDNlMxsQid8x2/Z4Co8kfq4sq0gQBwn17Cjw7gpM3YD7SmXb6IgIbc/td1a/VIs/ NCPglzV+szoyzCGrXElRHG4PJ7qrxfqn0/3UUhIjhpk9OHMeqcf7g4ljjjhlFg+2a2 N/WYDnhOSw9ef478oxmxgWGJp2q/f/Sz9zjeDvNnvr833NFphm74CwuO1wEQC4HeLC h4IDZIcphEPzw== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4CSP412WkFz9ry4 for ; Fri, 6 Nov 2020 16:11:29 +0100 (CET) User-agent: mu4e 1.5.6; emacs 27.1 From: Thierry Volpiatto To: bug-gnu-emacs@gnu.org Subject: 27.1; C-@ chars corrupt elisp buffer Autocrypt: addr=thievol@posteo.net; prefer-encrypt=mutual; keydata= mQGNBF8ylcIBDADG+hy+zR6L4/vbdDDZuSaMmSrU3A5QZJpeBCvxTr7MpzzruZbhLPW1K3R6N2MA edi8Y+C8o27FVRIjpdbaKMGu9je7JV/TbUQYo3SOwCK1vM4LUn4V6ZLzSYkuiEt4eyMoiDdyvN0p kcK6P9x9DCetcEVszXzQg+yzCVrQ2hXWDXWT4M18EC3wtO7RHPouMqGiwBFhBAYErCqFWFxQHkfb tG/4yGyJ58rglb65O3qijjMWvYwcWZun9/7qm8Z4/4mHopmo2zgU+OrptnLSZfkZGz3Y7Uf452xQ GVq0Fv75NPvQru7y+DYVhuVXXyAmGxt+vf4rIiixMBbhKEPjcxEPAa2LTzex2IsTZR+QVG9uDnqC WcgaOEQ58fzXNvNhtwwF/Rgio2XWAJVdmFWS59/k9W58CIUSNKBMZh2XeGdEmtHvDtCxW3z6FJha 36RzOM3fMNNiAGdFZJA84gcdloJR+sHCDTTPT3784fjr+V8An7sI581NGFzkRQqPvEQCZbUAEQEA AbQSdGhpZXZvbEBwb3N0ZW8ubmV0iQHUBBMBCgA+FiEEI9twfRN7r3nig/xwDsVtFB0W75MFAl8y lcICGwMFCQPCZwAFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQDsVtFB0W75MB3QwAlTsVzFmr +S/tMKwwwOibjhNPi/OZiUC2AYfaqfVAiIHDT3RbzDe03sAJoomJkJnYVjGzQZwibCMO2+ITkMPV 2wvrd4CbgS1KCVbrltwcuK/nxPCBaHytOCZUIInnhJo5PE/h03K0rWhUFLDocpnWwI7mPq33oR9N u2XMNtUQeWhhZHj8dvpMazWIR/c4iPnQiIobETISNlKIVo7DZSl67btoBrZygVYobgHpAYLBpHtH pXUcfM+Jrl8ytLouZ2XYeqzezr1qUDXhPk6mXtEVLJsK4FSS4wT5hPpRozuIwj6sE8OGJIp5uUhm SYm9mjRNJBEgmGUNxMQ/wbcA3NEWxBeIZbRvxMgHG47GJ0TJM4xLpGC8BHUZvuIw05gAtgoA3BGh 5GXbLWy4fi8ozJA/kCkP43d3zh4wTOfQterVTf90bbw6NiNcmXdKH7E/yO1or06bleza39PJsshX 8EETESzVIifk2yDnc0/CQ+FrLY9IwOOszkMouFXmiwN1xMkjuQGNBF8ylcIBDADnIDHEkmk4lUwT lOhwb2yjUfmGPnpH3MCCHkjM9H/P1gTHxFWtwFVPcNMCwXWvKSBTF2dZXKERD0yzG06zT53ZMN7E IIeuY6m4R8IcMvpohciisWxbFoB4ZY117tVSeqjo946itgbpdeESKl9a8dpn7ytZMyYxPdojlQAq xeAJ8444raESh1oTKXb64hlk4l2pSRlrLgjpJBo8asAfZndaxIUKhw68tV8sqeZh9P6cGtHbUELK VJqefNV7V7jF5wf3xvRG6Ces3kSKXalLfs+vrVaoOjQeWrc0AtwFWHmt9JLfKrqF+Q2Q7jUidboW mazQM56ESJFPpPHmWq8k6DHspsFHOforLouTHJL1556IPne7IV2BGfWc0+xLxalZ8F5F+vnPF/Ok rC1CD5iCKTjXKa2iZbcYdYQAiL6P8Ac8CgN6EkhpbxRtzrEgChuNGevdi/G/GHG4Zqrh6YFwIa/N Hq2aVaFq5C1yNTMJd1FRjRzs5JPPlJKpYDnNx+MSp7UAEQEAAYkBvAQYAQoAJhYhBCPbcH0Te695 4oP8cA7FbRQdFu+TBQJfMpXCAhsMBQkDwmcAAAoJEA7FbRQdFu+TXsEL/3nCs8oDLBSTPXylenWK CYLdfZSg8jmwgRKihktU1ZLf8kL/LtEhxdKc9nYQO0gTYdPQ+HEdFbm+gFZ4AxuCtd5zM+MP5Sej pfr93QbLwYCiqsudKa+T7wosBBNFnh8ZQkbnsF6iPIeESCJM0Vhjh1lQ+z1qVkdf/yazwmXspOUh 3kx8dzJQ1F3t6Dj/zHpdNE11bT6wFwTPBFvFeH0yCwDpvVcLbH0xf/0V/RhwkQ4jjae0Cqn8domz RpGODjXkAzoRqpRL9/DvIKTQ/uJQqzu6qvi04foFCmtWTSahJiLtbgHSDNj1HHOivtgeTgtVdAEk ZAqAXJfmaM8KkEi8Rqcbz3AzkjNWjQNkel0xjB3wkewds1iGcvo2/etWOXcvFiLUpy7YnLMZ4J6d jNpwSwDzxvJVy0OvB9SgVF0hX5DdbKTRBSZpGYQgoVdPelGnqs6uq8fa1Ker587E6O6haTIX779d pd5UIX75/XbtumwE0L+IvMpekoM9zH8pCowu4g== Date: Fri, 06 Nov 2020 16:11:28 +0100 Message-ID: <878sbeikpr.fsf@posteo.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable OpenPGP: url=https://posteo.de/keys/thievol@posteo.net.asc; preference=encrypt Received-SPF: pass client-ip=185.67.36.65; envelope-from=thievol@posteo.net; helo=mout01.posteo.de X-detected-operating-system: by eggs.gnu.org: First seen = 2020/11/06 10:11:30 X-ACL-Warn: Detected OS = Linux 3.11 and newer [fuzzy] X-Spam_score_int: -43 X-Spam_score: -4.4 X-Spam_bar: ---- X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.3 (-) X-Debbugs-Envelope-To: submit X-Mailman-Approved-At: Fri, 06 Nov 2020 10:23:20 -0500 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) 1) emacs -Q 2) M-x find-file test.el 3) insert this in test.el buffer: ;; =C3=A0=C3=A0=C3=A0=C3=A0=C3=A0 (foo "^@") 4) save buffer 5) M-x revert-buffer You should see now the line ;; =C3=A0=C3=A0=C3=A0=C3=A0=C3=A0 corrupted: NOTE: in 3) Write "^@" with C-q C-@. In GNU Emacs 27.1 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.22.30, cair= o version 1.15.10) of 2020-08-31 built on IPadS340 Windowing system distributor 'The X.Org Foundation', version 11.0.12008000 System Description: Linux Mint 19.3 Recent messages: Sending... Sending via mail... Decrypting /home/thierry/.authinfo.gpg...done Sending email=20=20 Sending email done Saving file /home/thierry/Maildir/Posteo/Sent/cur/1604674326.396ddaa78615bf= be.ipads340:2,S... Wrote /home/thierry/Maildir/Posteo/Sent/cur/1604674326.396ddaa78615bfbe.ipa= ds340:2,S Sending...done [mu4e] Message sent Do you want to exit emacs-w3m? (y or n) y Configured using: 'configure CFLAGS=3D-O3 --without-dbus --without-gconf --without-gsettings --with-mailutils --with-cairo' Configured features: XPM JPEG TIFF GIF PNG RSVG CAIRO SOUND GPM GLIB NOTIFY INOTIFY ACL LIBSELINUX GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS LIBSYSTEMD PDUMPER LCMS2 GMP Important settings: value of $LANG: fr_FR.UTF-8 locale-coding-system: utf-8-unix Major mode: Ilisp Minor modes in effect: global-magit-file-mode: t magit-auto-revert-mode: t global-git-commit-mode: t global-undo-tree-mode: t undo-tree-mode: t global-ligature-mode: t ligature-mode: t psession-mode: t psession-autosave-mode: t psession-savehist-mode: t global-git-gutter-mode: t eldoc-in-minibuffer-mode: t display-time-mode: t winner-mode: t show-paren-mode: t helm-epa-mode: t helm-descbinds-mode: t override-global-mode: t helm-adaptive-mode: t helm-mode: t helm-ff-cache-mode: t shell-dirtrack-mode: t async-bytecomp-package-mode: t dired-async-mode: t minibuffer-depth-indicate-mode: t straight-use-package-mode: t straight-package-neutering-mode: t tooltip-mode: t global-eldoc-mode: t eldoc-mode: t mouse-wheel-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t column-number-mode: t line-number-mode: t auto-fill-function: do-auto-fill transient-mark-mode: t Load-path shadows: None found. Features: (shadow emacsbug w3m-filter w3m-cookie w3m-tabmenu w3m-session w3m-search helm-w3m w3m-bookmark gnutls epa-file network-stream nsm mailalias helm-ring helm-dabbrev autocrypt-message epa-mail helm-firefox magit-extras face-remap magit-bookmark magit-submodule magit-obsolete magit-blame magit-stash magit-reflog magit-bisect magit-push magit-pull magit-fetch magit-clone magit-remote magit-commit magit-sequence magit-notes magit-worktree magit-tag magit-merge magit-branch magit-reset magit-files magit-refs magit-status magit magit-repos magit-apply magit-wip magit-log which-func magit-diff smerge-mode magit-core magit-autorevert autorevert filenotify magit-margin magit-transient magit-process magit-mode git-commit transient magit-git magit-section magit-utils crm log-edit add-log with-editor qp view sort gnus-cite smiley w3m-form w3m-symbol w3m timezone w3m-hist w3m-fb bookmark-w3m w3m-ems w3m-favicon w3m-image tab-line w3m-proc w3m-util mm-archive mail-extr autocrypt-gnus autocrypt-mu4e autocrypt rx addressbook-bookmark mu4e-config org-mu4e gnus-art mm-uu mml2015 mm-view mml-smime smime dig gnus-sum gnus-group gnus-undo gnus-start gnus-cloud nnimap nnmail mail-source utf7 netrc nnoo gnus-spec gnus-int gnus-range gnus-win gnus nnheader mu4e-patch mu4e-contrib eshell esh-cmd esh-ext esh-opt esh-proc esh-io esh-arg esh-module esh-groups esh-util mu4e mu4e-org mu4e-main mu4e-view mu4e-headers mu4e-compose mu4e-context mu4e-draft mu4e-actions ido rfc2368 smtpmail sendmail mu4e-mark mu4e-proc mu4e-utils doc-view image-mode exif mu4e-lists mu4e-message shr svg dom flow-fill hl-line mu4e-vars message rmc puny rfc822 mml mml-sec gnus-util rmail rmail-loaddefs mm-decode mm-bodies mm-encode mail-parse rfc2231 rfc2047 rfc2045 mm-util ietf-drums mail-prsvr mailabbrev mail-utils gmm-utils mailheader mu4e-meta helm-x-files helm-for-files helm-bookmark bookmark text-property-search pp helm-command flymake-proc flymake warnings conf-mode sh-script smie executable jka-compr bug-reference naquadah-theme solar cal-dst holidays hol-loaddefs tv-utils undo-tree diff undo-tree-autoloads ligature ligature-autoloads boxquote rect rainbow-mode-autoloads psession wgrep-helm wgrep grep compile wgrep-helm-autoloads wgrep-autoloads log-view pcvs-util pcmpl-git pcmpl-git-autoloads bash-completion-autoloads powerline powerline-separators color powerline-themes powerline-autoloads toc-org-autoloads cl-indent pcase ffap markdown-toc-autoloads markdown-mode-autoloads autocrypt-autoloads config-w3m w3m-autoloads git-gutter git-gutter-autoloads mule-util appt diary-lib diary-loaddefs anaconda-mode xref project pythonic f dash s anaconda-mode-autoloads pythonic-autoloads f-autoloads s-autoloads eldoc-eval emamux-autoloads magit-autoloads git-commit-autoloads with-editor-autoloads transient-autoloads dash-autoloads pcomplete-extension pcmpl-unix pcmpl-gnu iterator iedit-autoloads ledger-mode-autoloads wdired dired-extension org-config ob-gnuplot org-crypt net-utils time winner w3m-wget wget thingatpt wget-sysdep autotest-mode autoconf-mode paren woman man ediff ediff-merg ediff-mult ediff-wind ediff-diff ediff-help ediff-init ediff-util init-helm helm-fd epa derived epg epg-config helm-misc helm-apt helm-imenu imenu helm-elisp-package package url-handlers helm-find helm-org org ob ob-tangle ob-ref ob-lob ob-table ob-exp org-macro org-footnote org-src ob-comint org-pcomplete org-list org-faces org-entities noutline outline org-version ob-emacs-lisp ob-core ob-eval org-table ol org-keys org-compat org-macs org-loaddefs cal-menu calendar cal-loaddefs helm-external helm-net browse-url xml url url-proxy url-privacy url-expand url-methods url-history url-cookie url-domsuf url-util url-parse url-vars mailcap helm-descbinds cus-edit wid-edit helm-ls-git vc-git diff-mode vc vc-dispatcher helm-ipython helm-elisp helm-eval edebug backtrace find-func helm-info python tramp-sh use-package-bind-key bind-key helm-adaptive diminish helm-mode helm-files tramp tramp-loaddefs trampver tramp-integration files-x tramp-compat shell pcomplete comint ansi-color ring parse-time iso8601 time-date ls-lisp auth-source password-cache json map helm-buffers helm-occur helm-tags helm-locate helm-grep helm-regexp format-spec helm-utils helm-help helm-types use-package-diminish helm-extensions-autoloads helm-config helm-autoloads helm easy-mmode async-bytecomp helm-global-bindings helm-easymenu helm-source eieio-compat eieio eieio-core eieio-loaddefs helm-multi-match helm-lib dired-async advice dired-aux dired dired-loaddefs async emms-autoloads cl-seq use-package-core popup-autoloads finder-inf diminish-autoloads mb-depth server edmacro kmacro avoid cus-start cus-load use-package-autoloads bind-key-autoloads straight-autoloads info cl-extra help-mode easymenu seq byte-opt straight subr-x cl-macs gv bytecomp byte-compile cconv cl-loaddefs cl-lib tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote threads inotify lcms2 dynamic-setting font-render-setting cairo move-toolbar gtk x-toolkit x multi-tty make-network-process emacs) Memory information: ((conses 16 599805 404657) (symbols 48 41981 3) (strings 32 167881 57520) (string-bytes 1 6426344) (vectors 16 82748) (vector-slots 8 1666976 230836) (floats 8 1795 3081) (intervals 56 6849 3252) (buffers 1000 130)) --=20 Thierry From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 06 10:33:09 2020 Received: (at 44486) by debbugs.gnu.org; 6 Nov 2020 15:33:09 +0000 Received: from localhost ([127.0.0.1]:57029 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb3jh-0000q8-KR for submit@debbugs.gnu.org; Fri, 06 Nov 2020 10:33:09 -0500 Received: from mail-out.m-online.net ([212.18.0.10]:52037) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb3jf-0000py-Gm for 44486@debbugs.gnu.org; Fri, 06 Nov 2020 10:33:08 -0500 Received: from frontend01.mail.m-online.net (unknown [192.168.8.182]) by mail-out.m-online.net (Postfix) with ESMTP id 4CSPXy0PQZz1rsMt; Fri, 6 Nov 2020 16:33:05 +0100 (CET) Received: from localhost (dynscan1.mnet-online.de [192.168.6.70]) by mail.m-online.net (Postfix) with ESMTP id 4CSPXx51g1z1qqkD; Fri, 6 Nov 2020 16:33:05 +0100 (CET) X-Virus-Scanned: amavisd-new at mnet-online.de Received: from mail.mnet-online.de ([192.168.8.182]) by localhost (dynscan1.mail.m-online.net [192.168.6.70]) (amavisd-new, port 10024) with ESMTP id cMztQoA03xuY; Fri, 6 Nov 2020 16:33:05 +0100 (CET) X-Auth-Info: DZjAK6FamWYkQfO19+5ApWz22S8gBrPZ3GCtiq2sMl2TfS0nyaoA1gH0hze85quJ Received: from igel.home (ppp-46-244-183-75.dynamic.mnet-online.de [46.244.183.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.mnet-online.de (Postfix) with ESMTPSA; Fri, 6 Nov 2020 16:33:05 +0100 (CET) Received: by igel.home (Postfix, from userid 1000) id 753652C3600; Fri, 6 Nov 2020 16:33:04 +0100 (CET) From: Andreas Schwab To: Thierry Volpiatto Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> X-Yow: Catsup and Mustard all over the place! It's the Human Hamburger! Date: Fri, 06 Nov 2020 16:33:04 +0100 In-Reply-To: <878sbeikpr.fsf@posteo.net> (Thierry Volpiatto's message of "Fri, 06 Nov 2020 16:11:28 +0100") Message-ID: <87zh3u8pqn.fsf@igel.home> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.4 (/) X-Debbugs-Envelope-To: 44486 Cc: 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.4 (-) The null byte causes the file to be detected as binary. You can use C-x C-m c to override the detection. Andreas. -- Andreas Schwab, schwab@linux-m68k.org GPG Key fingerprint = 7578 EB47 D4E5 4D69 2510 2552 DF73 E780 A9DA AEC1 "And now for something completely different." From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 06 10:40:58 2020 Received: (at 44486) by debbugs.gnu.org; 6 Nov 2020 15:40:58 +0000 Received: from localhost ([127.0.0.1]:57037 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb3rG-00010t-Dw for submit@debbugs.gnu.org; Fri, 06 Nov 2020 10:40:58 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41226) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb3rE-00010e-R3 for 44486@debbugs.gnu.org; Fri, 06 Nov 2020 10:40:57 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:39426) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kb3r9-0005to-97; Fri, 06 Nov 2020 10:40:51 -0500 Received: from [176.228.60.248] (port=3451 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kb3r8-0001FN-OE; Fri, 06 Nov 2020 10:40:51 -0500 Date: Fri, 06 Nov 2020 17:40:50 +0200 Message-Id: <83blga8pdp.fsf@gnu.org> From: Eli Zaretskii To: Andreas Schwab In-Reply-To: <87zh3u8pqn.fsf@igel.home> (message from Andreas Schwab on Fri, 06 Nov 2020 16:33:04 +0100) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Andreas Schwab > Date: Fri, 06 Nov 2020 16:33:04 +0100 > Cc: 44486@debbugs.gnu.org > > The null byte causes the file to be detected as binary. You can use C-x > C-m c to override the detection. Right. Or set inhibit-nul-byte-detection to a non-nil value before reverting From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 06 11:18:03 2020 Received: (at 44486) by debbugs.gnu.org; 6 Nov 2020 16:18:03 +0000 Received: from localhost ([127.0.0.1]:57109 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb4R9-0001y9-Dp for submit@debbugs.gnu.org; Fri, 06 Nov 2020 11:18:03 -0500 Received: from eggs.gnu.org ([209.51.188.92]:49388) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb4R7-0001xg-Du for 44486@debbugs.gnu.org; Fri, 06 Nov 2020 11:18:01 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:40320) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kb4R0-0001qG-Ri; Fri, 06 Nov 2020 11:17:54 -0500 Received: from [176.228.60.248] (port=1772 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kb4R0-0000R3-4E; Fri, 06 Nov 2020 11:17:54 -0500 Date: Fri, 06 Nov 2020 18:17:53 +0200 Message-Id: <838sbe8nny.fsf@gnu.org> From: Eli Zaretskii To: schwab@linux-m68k.org In-Reply-To: <83blga8pdp.fsf@gnu.org> (message from Eli Zaretskii on Fri, 06 Nov 2020 17:40:50 +0200) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > Date: Fri, 06 Nov 2020 17:40:50 +0200 > From: Eli Zaretskii > Cc: thievol@posteo.net, 44486@debbugs.gnu.org > > Or set inhibit-nul-byte-detection to a non-nil value before > reverting Actually, this doesn't seem to work, but it looks like a bug... Btw, reverting while forcing a particular encoding can be invoked with "C-x C-m r". From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 06 14:18:45 2020 Received: (at 44486) by debbugs.gnu.org; 6 Nov 2020 19:18:45 +0000 Received: from localhost ([127.0.0.1]:57343 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb7G1-0006NY-Jg for submit@debbugs.gnu.org; Fri, 06 Nov 2020 14:18:45 -0500 Received: from mout01.posteo.de ([185.67.36.65]:40446) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb7Fy-0006ND-9j for 44486@debbugs.gnu.org; Fri, 06 Nov 2020 14:18:44 -0500 Received: from submission (posteo.de [89.146.220.130]) by mout01.posteo.de (Postfix) with ESMTPS id 11C92160066 for <44486@debbugs.gnu.org>; Fri, 6 Nov 2020 20:18:35 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1604690316; bh=4IJcVm2+OMUe3hZ1IHYhVq83l3RpAKCHGGynSGHYFOE=; h=From:To:Cc:Subject:Autocrypt:Date:OpenPGP:From; b=X9SU36nUUYHIQYXVLpwltmmfXp9rXwfBqDXxKaIUmwMeVtdAQ4pZDobdUTfXlAPEx MLo98xfFN0ZhVMtDN3s32vQAps3wVKLH3hYjNqIPcyouIv6DbWfW4gB2Mq3IiC2CZo RDR3ZlhkcHU3oVRoixDxW6sk5de+lOckoslQMtV3LGWBjN2F27x4GFSO8LopkVqe6i LsBen6CJINx0IAFTJceoKtd7mwd8/cznGokon10dhx86qE44giV9JkUNQbcJzV7b4z XdyAGEgCeEUpnh5b6Av3juWBE5e8CWUWHLktRCehDXuWtsTPQh8YEGlDvkzoMSoOI9 tgm7GOSyxDehQ== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4CSVY70zCwz9rxV; Fri, 6 Nov 2020 20:18:34 +0100 (CET) References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> User-agent: mu4e 1.5.6; emacs 27.1 From: Thierry Volpiatto To: Andreas Schwab Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer Message-ID: <877dqy75j4.fsf@posteo.net> In-reply-to: <87zh3u8pqn.fsf@igel.home> Autocrypt: addr=thievol@posteo.net; prefer-encrypt=mutual; keydata= mQGNBF8ylcIBDADG+hy+zR6L4/vbdDDZuSaMmSrU3A5QZJpeBCvxTr7MpzzruZbhLPW1K3R6N2MA edi8Y+C8o27FVRIjpdbaKMGu9je7JV/TbUQYo3SOwCK1vM4LUn4V6ZLzSYkuiEt4eyMoiDdyvN0p kcK6P9x9DCetcEVszXzQg+yzCVrQ2hXWDXWT4M18EC3wtO7RHPouMqGiwBFhBAYErCqFWFxQHkfb tG/4yGyJ58rglb65O3qijjMWvYwcWZun9/7qm8Z4/4mHopmo2zgU+OrptnLSZfkZGz3Y7Uf452xQ GVq0Fv75NPvQru7y+DYVhuVXXyAmGxt+vf4rIiixMBbhKEPjcxEPAa2LTzex2IsTZR+QVG9uDnqC WcgaOEQ58fzXNvNhtwwF/Rgio2XWAJVdmFWS59/k9W58CIUSNKBMZh2XeGdEmtHvDtCxW3z6FJha 36RzOM3fMNNiAGdFZJA84gcdloJR+sHCDTTPT3784fjr+V8An7sI581NGFzkRQqPvEQCZbUAEQEA AbQSdGhpZXZvbEBwb3N0ZW8ubmV0iQHUBBMBCgA+FiEEI9twfRN7r3nig/xwDsVtFB0W75MFAl8y lcICGwMFCQPCZwAFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQDsVtFB0W75MB3QwAlTsVzFmr +S/tMKwwwOibjhNPi/OZiUC2AYfaqfVAiIHDT3RbzDe03sAJoomJkJnYVjGzQZwibCMO2+ITkMPV 2wvrd4CbgS1KCVbrltwcuK/nxPCBaHytOCZUIInnhJo5PE/h03K0rWhUFLDocpnWwI7mPq33oR9N u2XMNtUQeWhhZHj8dvpMazWIR/c4iPnQiIobETISNlKIVo7DZSl67btoBrZygVYobgHpAYLBpHtH pXUcfM+Jrl8ytLouZ2XYeqzezr1qUDXhPk6mXtEVLJsK4FSS4wT5hPpRozuIwj6sE8OGJIp5uUhm SYm9mjRNJBEgmGUNxMQ/wbcA3NEWxBeIZbRvxMgHG47GJ0TJM4xLpGC8BHUZvuIw05gAtgoA3BGh 5GXbLWy4fi8ozJA/kCkP43d3zh4wTOfQterVTf90bbw6NiNcmXdKH7E/yO1or06bleza39PJsshX 8EETESzVIifk2yDnc0/CQ+FrLY9IwOOszkMouFXmiwN1xMkjuQGNBF8ylcIBDADnIDHEkmk4lUwT lOhwb2yjUfmGPnpH3MCCHkjM9H/P1gTHxFWtwFVPcNMCwXWvKSBTF2dZXKERD0yzG06zT53ZMN7E IIeuY6m4R8IcMvpohciisWxbFoB4ZY117tVSeqjo946itgbpdeESKl9a8dpn7ytZMyYxPdojlQAq xeAJ8444raESh1oTKXb64hlk4l2pSRlrLgjpJBo8asAfZndaxIUKhw68tV8sqeZh9P6cGtHbUELK VJqefNV7V7jF5wf3xvRG6Ces3kSKXalLfs+vrVaoOjQeWrc0AtwFWHmt9JLfKrqF+Q2Q7jUidboW mazQM56ESJFPpPHmWq8k6DHspsFHOforLouTHJL1556IPne7IV2BGfWc0+xLxalZ8F5F+vnPF/Ok rC1CD5iCKTjXKa2iZbcYdYQAiL6P8Ac8CgN6EkhpbxRtzrEgChuNGevdi/G/GHG4Zqrh6YFwIa/N Hq2aVaFq5C1yNTMJd1FRjRzs5JPPlJKpYDnNx+MSp7UAEQEAAYkBvAQYAQoAJhYhBCPbcH0Te695 4oP8cA7FbRQdFu+TBQJfMpXCAhsMBQkDwmcAAAoJEA7FbRQdFu+TXsEL/3nCs8oDLBSTPXylenWK CYLdfZSg8jmwgRKihktU1ZLf8kL/LtEhxdKc9nYQO0gTYdPQ+HEdFbm+gFZ4AxuCtd5zM+MP5Sej pfr93QbLwYCiqsudKa+T7wosBBNFnh8ZQkbnsF6iPIeESCJM0Vhjh1lQ+z1qVkdf/yazwmXspOUh 3kx8dzJQ1F3t6Dj/zHpdNE11bT6wFwTPBFvFeH0yCwDpvVcLbH0xf/0V/RhwkQ4jjae0Cqn8domz RpGODjXkAzoRqpRL9/DvIKTQ/uJQqzu6qvi04foFCmtWTSahJiLtbgHSDNj1HHOivtgeTgtVdAEk ZAqAXJfmaM8KkEi8Rqcbz3AzkjNWjQNkel0xjB3wkewds1iGcvo2/etWOXcvFiLUpy7YnLMZ4J6d jNpwSwDzxvJVy0OvB9SgVF0hX5DdbKTRBSZpGYQgoVdPelGnqs6uq8fa1Ker587E6O6haTIX779d pd5UIX75/XbtumwE0L+IvMpekoM9zH8pCowu4g== Date: Fri, 06 Nov 2020 20:18:33 +0100 MIME-Version: 1.0 Content-Type: text/plain OpenPGP: url=https://posteo.de/keys/thievol@posteo.net.asc; preference=encrypt X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Andreas Schwab writes: > The null byte causes the file to be detected as binary. You can use C-x > C-m c to override the detection. Thanks for explanation, I work around this by using "\0" in my code instead of "^@". -- Thierry From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 06 15:07:22 2020 Received: (at 44486) by debbugs.gnu.org; 6 Nov 2020 20:07:22 +0000 Received: from localhost ([127.0.0.1]:57404 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb813-0007jj-Mk for submit@debbugs.gnu.org; Fri, 06 Nov 2020 15:07:21 -0500 Received: from eggs.gnu.org ([209.51.188.92]:47084) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kb812-0007jX-3K for 44486@debbugs.gnu.org; Fri, 06 Nov 2020 15:07:20 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:45892) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kb80u-0000vO-Uf; Fri, 06 Nov 2020 15:07:12 -0500 Received: from [176.228.60.248] (port=4040 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kb80t-00047n-RZ; Fri, 06 Nov 2020 15:07:12 -0500 Date: Fri, 06 Nov 2020 22:07:10 +0200 Message-Id: <83361m8d1t.fsf@gnu.org> From: Eli Zaretskii To: Kenichi Handa In-Reply-To: <838sbe8nny.fsf@gnu.org> (message from Eli Zaretskii on Fri, 06 Nov 2020 18:17:53 +0200) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > Date: Fri, 06 Nov 2020 18:17:53 +0200 > From: Eli Zaretskii > Cc: thievol@posteo.net, 44486@debbugs.gnu.org > > > Date: Fri, 06 Nov 2020 17:40:50 +0200 > > From: Eli Zaretskii > > Cc: thievol@posteo.net, 44486@debbugs.gnu.org > > > > Or set inhibit-nul-byte-detection to a non-nil value before > > reverting > > Actually, this doesn't seem to work, but it looks like a bug... We don't specify that prefer-utf-8, which is used by default for *.el files, should heed this variable. Since prefer-utf-8 is a variant of 'undecided', i.e. it performs detection of encoding, I think this is a bug, because 'undecided' does pay attention to inhibit-null-byte-detection. So I propose the change below (for master). Any objections? diff --git a/lisp/international/mule-conf.el b/lisp/international/mule-conf.el index e6e6135..16cd8cf 100644 --- a/lisp/international/mule-conf.el +++ b/lisp/international/mule-conf.el @@ -1251,7 +1251,9 @@ 'prefer-utf-8 :coding-type 'undecided :mnemonic ?- :charset-list '(emacs) - :prefer-utf-8 t) + :prefer-utf-8 t + :inhibit-null-byte-detection 0 + :inhibit-iso-escape-detection 0) (define-coding-system 'raw-text "Raw text, which means text contains random 8-bit codes. From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 09 10:44:13 2020 Received: (at 44486) by debbugs.gnu.org; 9 Nov 2020 15:44:13 +0000 Received: from localhost ([127.0.0.1]:35230 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kc9L2-0003ZA-W3 for submit@debbugs.gnu.org; Mon, 09 Nov 2020 10:44:13 -0500 Received: from quimby.gnus.org ([95.216.78.240]:43250) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kc9L1-0003Yy-KA for 44486@debbugs.gnu.org; Mon, 09 Nov 2020 10:44:12 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date: References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=PqR00lRxh91gqVn+Dcqx6lwSWPLQplvMxtPAuD8EXmU=; b=Y29azrc8BO93bomJu1nesfiCYL jGdTrW6uU3j77VOHD9aq6GQnLwWPn5NE1S7ppQ8qVmhQtgsZQInIn8p/jDAd2MbhqHFnspmvk2el5 BSGHAVkn07unATmtPH5HZMikD9+Yp6q4A2o6pzXbGPz2o5ACOda8y9gIeIRsrWkwGS4U=; Received: from cm-84.212.202.86.getinternet.no ([84.212.202.86] helo=xo) by quimby.gnus.org with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kc9Kr-0007Vo-O7; Mon, 09 Nov 2020 16:44:05 +0100 From: Lars Ingebrigtsen To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> X-Now-Playing: Melanie de Biasio's _No Deal_: "I'm Gonna Leave You" Date: Mon, 09 Nov 2020 16:44:00 +0100 In-Reply-To: <83361m8d1t.fsf@gnu.org> (Eli Zaretskii's message of "Fri, 06 Nov 2020 22:07:10 +0200") Message-ID: <87blg6lem7.fsf@gnus.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: Eli Zaretskii writes: > So I propose the change below (for master). Any objections? [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, Kenichi Handa , schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Eli Zaretskii writes: > So I propose the change below (for master). Any objections? [...] > - :prefer-utf-8 t) > + :prefer-utf-8 t > + :inhibit-null-byte-detection 0 > + :inhibit-iso-escape-detection 0) Makes sense to me, but is there any particular reason to use 0 instead of t here? -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 09 11:14:11 2020 Received: (at 44486) by debbugs.gnu.org; 9 Nov 2020 16:14:11 +0000 Received: from localhost ([127.0.0.1]:35326 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kc9o3-0000C2-ID for submit@debbugs.gnu.org; Mon, 09 Nov 2020 11:14:11 -0500 Received: from eggs.gnu.org ([209.51.188.92]:44486) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kc9o1-0000Bp-UP for 44486@debbugs.gnu.org; Mon, 09 Nov 2020 11:14:10 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:46009) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kc9nv-00055C-3R; Mon, 09 Nov 2020 11:14:03 -0500 Received: from [176.228.60.248] (port=1630 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kc9ns-0000Ma-Qo; Mon, 09 Nov 2020 11:14:01 -0500 Date: Mon, 09 Nov 2020 18:14:07 +0200 Message-Id: <83r1p24ieo.fsf@gnu.org> From: Eli Zaretskii To: Lars Ingebrigtsen In-Reply-To: <87blg6lem7.fsf@gnus.org> (message from Lars Ingebrigtsen on Mon, 09 Nov 2020 16:44:00 +0100) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Lars Ingebrigtsen > Cc: Kenichi Handa , thievol@posteo.net, > schwab@linux-m68k.org, 44486@debbugs.gnu.org > Date: Mon, 09 Nov 2020 16:44:00 +0100 > > > - :prefer-utf-8 t) > > + :prefer-utf-8 t > > + :inhibit-null-byte-detection 0 > > + :inhibit-iso-escape-detection 0) > > Makes sense to me, but is there any particular reason to use 0 instead > of t here? 0 is different: it says to obey the value of inhibit-null-byte-detection resp. inhibit-iso-escape-detection. t means inhibit the detection unconditionally, which is not what we want. (We could use any non-nil, non-t value, of course; I've chosen to use zero for consistency with what we do for 'undecided', see coding.c.) From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 09 11:27:27 2020 Received: (at 44486) by debbugs.gnu.org; 9 Nov 2020 16:27:27 +0000 Received: from localhost ([127.0.0.1]:35381 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcA0t-0002fp-Fn for submit@debbugs.gnu.org; Mon, 09 Nov 2020 11:27:27 -0500 Received: from quimby.gnus.org ([95.216.78.240]:43816) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcA0s-0002fb-BY for 44486@debbugs.gnu.org; Mon, 09 Nov 2020 11:27:26 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date: References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=CPwJGP3oFDdidL401Ppl4c5+tiMlyrpej2z88RRxsq0=; b=mKJFjFlN8c8X/b01+faKs46w4/ CY+XeJxm1vBs2d+vEpZ69YT6LUo9+063n/2/e0l78Ez6ICP4/yeVxyCz+jsya87EZwzbAKCmBzC25 oPA5b3M1uXJo5+C3TgeUrqKxJu64AqmtcWlQAfE2mg5pv5F4YrVbu21wFcWoeLobtcrc=; Received: from cm-84.212.202.86.getinternet.no ([84.212.202.86] helo=xo) by quimby.gnus.org with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kcA0Z-0007uw-IJ; Mon, 09 Nov 2020 17:27:20 +0100 From: Lars Ingebrigtsen To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAABGdBTUEAALGPC/xhBQAAACBj SFJNAAB6JgAAgIQAAPoAAACA6AAAdTAAAOpgAAA6mAAAF3CculE8AAAAElBMVEUHBgYtIxlaRDGj PSampo/////eOq0WAAAAAWJLR0QF+G/pxwAAAAd0SU1FB+QLCRAEA6qaumEAAAHBSURBVDjLfZSJ dcMgDIahEyCcAYLQALHEAgHtP1PF5TSvaeX3fPD512Vk5z4buP/MR4yICMkOAB8BwlzP0kSKyjDu pzQVxwBNFslH/Ql0gzPmD4CFGVUvIC8Fn9QwraTyD9DvFrBU+S9gdoGi+A50CxTzR2AK+QSKKr8p SPPsR6l5AdINEIVJeQenOsA4I5bSkN8UG8gFbppid9WX2QBvYKuwFRm12M3zBUjrVFBX1A2ildFB ZpRcUTZIQKo6g8NRIU/Qn16AMsf2G7BVKbcFvAewGKpkJWP6ylR3jBjxbmmRLR+j1gm+zFWXPGPK nKxhxBvEsCo3YJW0FcO2JDjolasVKHgruoLD/FA42whUrgLHuhFrBwBT2enCaK7qab2h0mOs7gI9 J0jJMsKoOMeGUnkCGHj4ZImHyEtBUB4QO3AQfHB+7xJzFoZC0t05Dg6ODexN18H5sHfs6VJ0U21a AdppgVYdw1nqaaWYQhQDes0tJGoqAOnwcuZLATn4vnUR78dh01kW8ChxTHGlBxg+5NyuxKcxGnhD kVzaY85mChJ8n8PSukPr1VSAF7kPMCexF3Sl238e9rlsW/Rr+O/P8w3znopwZhnFrAAAACV0RVh0 ZGF0ZTpjcmVhdGUAMjAyMC0xMS0wOVQxNjowNDowMyswMDowMGaLV34AAAAldEVYdGRhdGU6bW9k aWZ5ADIwMjAtMTEtMDlUMTY6MDQ6MDMrMDA6MDAX1u/CAAAAAElFTkSuQmCC X-Now-Playing: Irreversible Entanglements's _Irreversible Entanglements_: "Projects" Date: Mon, 09 Nov 2020 17:27:06 +0100 In-Reply-To: <83r1p24ieo.fsf@gnu.org> (Eli Zaretskii's message of "Mon, 09 Nov 2020 18:14:07 +0200") Message-ID: <875z6ejy1x.fsf@gnus.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: Eli Zaretskii writes: > 0 is different: it says to obey the value of > inhibit-null-byte-detection resp. inhibit-iso-escape-detection. t > means inhibit the detection unconditionally, which is not what we > want. > > (We c [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Eli Zaretskii writes: > 0 is different: it says to obey the value of > inhibit-null-byte-detection resp. inhibit-iso-escape-detection. t > means inhibit the detection unconditionally, which is not what we > want. > > (We could use any non-nil, non-t value, of course; I've chosen to use > zero for consistency with what we do for 'undecided', see coding.c.) I see. Perhaps the difference between the various non-nil values should be mentioned in the doc strings of the two variables? They only mention nil/non-nil now, as far as I can see. -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 09 11:57:08 2020 Received: (at 44486) by debbugs.gnu.org; 9 Nov 2020 16:57:09 +0000 Received: from localhost ([127.0.0.1]:35483 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcATc-0007gM-Kv for submit@debbugs.gnu.org; Mon, 09 Nov 2020 11:57:08 -0500 Received: from eggs.gnu.org ([209.51.188.92]:57124) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcATb-0007g8-GV for 44486@debbugs.gnu.org; Mon, 09 Nov 2020 11:57:07 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:47122) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kcATV-0003KA-D1; Mon, 09 Nov 2020 11:57:01 -0500 Received: from [176.228.60.248] (port=4284 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kcATU-0008Jy-Rd; Mon, 09 Nov 2020 11:57:01 -0500 Date: Mon, 09 Nov 2020 18:57:07 +0200 Message-Id: <83imae4gf0.fsf@gnu.org> From: Eli Zaretskii To: Lars Ingebrigtsen In-Reply-To: <875z6ejy1x.fsf@gnus.org> (message from Lars Ingebrigtsen on Mon, 09 Nov 2020 17:27:06 +0100) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <875z6ejy1x.fsf@gnus.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Lars Ingebrigtsen > Cc: handa@gnu.org, thievol@posteo.net, schwab@linux-m68k.org, > 44486@debbugs.gnu.org > Date: Mon, 09 Nov 2020 17:27:06 +0100 > > Eli Zaretskii writes: > > > 0 is different: it says to obey the value of > > inhibit-null-byte-detection resp. inhibit-iso-escape-detection. t > > means inhibit the detection unconditionally, which is not what we > > want. > > > > (We could use any non-nil, non-t value, of course; I've chosen to use > > zero for consistency with what we do for 'undecided', see coding.c.) > > I see. Perhaps the difference between the various non-nil values should > be mentioned in the doc strings of the two variables? They only mention > nil/non-nil now, as far as I can see. The _variables_ are simple booleans; it's the value of the :inhibit-null-byte-detection _property_ of a coding-system that is a tri-state. And that fact is documented in the doc string of define-coding-system. From debbugs-submit-bounces@debbugs.gnu.org Tue Nov 10 09:29:40 2020 Received: (at 44486) by debbugs.gnu.org; 10 Nov 2020 14:29:40 +0000 Received: from localhost ([127.0.0.1]:36879 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcUeS-0003vs-BP for submit@debbugs.gnu.org; Tue, 10 Nov 2020 09:29:40 -0500 Received: from quimby.gnus.org ([95.216.78.240]:53932) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcUeQ-0003ve-7f for 44486@debbugs.gnu.org; Tue, 10 Nov 2020 09:29:38 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date: References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=GxuFzSzPrV1p0hag/pXHSEJWMw0eWDuHwDsTmcgrcYM=; b=YcUWWf3zQ0Kg2PojGt5Mzl+Ly4 mU9pUUkP8RJmlX5rnep+jJpmotsaoAulR/U9z8gnSVyjR5cHxyvUr+mOUhPziCEh9l0lJ5XGHjh8w dbEzi3pL1ILYdutmivmkrXEYhpJ96KNG7Mh+2XLF8kNEfbHSa9Uu0952dTQfRwefPVVA=; Received: from cm-84.212.202.86.getinternet.no ([84.212.202.86] helo=xo) by quimby.gnus.org with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kcUeG-0003BU-W1; Tue, 10 Nov 2020 15:29:31 +0100 From: Lars Ingebrigtsen To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <875z6ejy1x.fsf@gnus.org> <83imae4gf0.fsf@gnu.org> X-Now-Playing: Deathcrush's _The Single Series_: "Lesson #14 for Bethan Peters: Smooth" Date: Tue, 10 Nov 2020 15:29:27 +0100 In-Reply-To: <83imae4gf0.fsf@gnu.org> (Eli Zaretskii's message of "Mon, 09 Nov 2020 18:57:07 +0200") Message-ID: <874klxi8u0.fsf@gnus.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: Eli Zaretskii writes: > The _variables_ are simple booleans; it's the value of the > :inhibit-null-byte-detection _property_ of a coding-system that is a > tri-state. And that fact is documented in the doc string of > defi [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Eli Zaretskii writes: > The _variables_ are simple booleans; it's the value of the > :inhibit-null-byte-detection _property_ of a coding-system that is a > tri-state. And that fact is documented in the doc string of > define-coding-system. Ah; sorry for the noise. -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no From debbugs-submit-bounces@debbugs.gnu.org Tue Nov 10 11:04:51 2020 Received: (at 44486) by debbugs.gnu.org; 10 Nov 2020 16:04:51 +0000 Received: from localhost ([127.0.0.1]:38728 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcW8Z-0006pH-HF for submit@debbugs.gnu.org; Tue, 10 Nov 2020 11:04:51 -0500 Received: from eggs.gnu.org ([209.51.188.92]:60144) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcW8Y-0006p4-5a for 44486@debbugs.gnu.org; Tue, 10 Nov 2020 11:04:50 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:35092) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kcW8R-0004B6-3O; Tue, 10 Nov 2020 11:04:43 -0500 Received: from [176.228.60.248] (port=2374 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kcW8Q-0003No-0j; Tue, 10 Nov 2020 11:04:42 -0500 Date: Tue, 10 Nov 2020 18:04:52 +0200 Message-Id: <83361h2o63.fsf@gnu.org> From: Eli Zaretskii To: Lars Ingebrigtsen In-Reply-To: <874klxi8u0.fsf@gnus.org> (message from Lars Ingebrigtsen on Tue, 10 Nov 2020 15:29:27 +0100) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <875z6ejy1x.fsf@gnus.org> <83imae4gf0.fsf@gnu.org> <874klxi8u0.fsf@gnus.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Lars Ingebrigtsen > Cc: handa@gnu.org, thievol@posteo.net, schwab@linux-m68k.org, > 44486@debbugs.gnu.org > Date: Tue, 10 Nov 2020 15:29:27 +0100 > > Eli Zaretskii writes: > > > The _variables_ are simple booleans; it's the value of the > > :inhibit-null-byte-detection _property_ of a coding-system that is a > > tri-state. And that fact is documented in the doc string of > > define-coding-system. > > Ah; sorry for the noise. No noise heard here ;-) From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 07:43:54 2020 Received: (at 44486-done) by debbugs.gnu.org; 14 Nov 2020 12:43:54 +0000 Received: from localhost ([127.0.0.1]:50004 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kduuI-0003U0-8v for submit@debbugs.gnu.org; Sat, 14 Nov 2020 07:43:54 -0500 Received: from eggs.gnu.org ([209.51.188.92]:50836) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kduuF-0003Tl-EW for 44486-done@debbugs.gnu.org; Sat, 14 Nov 2020 07:43:52 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:53785) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kduu8-0003t3-Qy; Sat, 14 Nov 2020 07:43:44 -0500 Received: from [176.228.60.248] (port=3401 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kduu6-0001kB-Kj; Sat, 14 Nov 2020 07:43:44 -0500 Date: Sat, 14 Nov 2020 14:43:30 +0200 Message-Id: <831rgww1l9.fsf@gnu.org> From: Eli Zaretskii To: handa@gnu.org In-Reply-To: <83361m8d1t.fsf@gnu.org> (message from Eli Zaretskii on Fri, 06 Nov 2020 22:07:10 +0200) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486-done Cc: thievol@posteo.net, schwab@linux-m68k.org, 44486-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > Date: Fri, 06 Nov 2020 22:07:10 +0200 > From: Eli Zaretskii > Cc: thievol@posteo.net, schwab@linux-m68k.org, 44486@debbugs.gnu.org > > We don't specify that prefer-utf-8, which is used by default for *.el > files, should heed this variable. Since prefer-utf-8 is a variant of > 'undecided', i.e. it performs detection of encoding, I think this is a > bug, because 'undecided' does pay attention to > inhibit-null-byte-detection. > > So I propose the change below (for master). Any objections? No objections, so I have now installed this on the master branch, and I'm closing this bug report. From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 09:02:27 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 14:02:27 +0000 Received: from localhost ([127.0.0.1]:50143 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdw8J-0005T3-0b for submit@debbugs.gnu.org; Sat, 14 Nov 2020 09:02:27 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:48354) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdw8H-0005Sr-L5 for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 09:02:26 -0500 Received: from pmg2.iro.umontreal.ca (localhost.localdomain [127.0.0.1]) by pmg2.iro.umontreal.ca (Proxmox) with ESMTP id 60ACA80C41; Sat, 14 Nov 2020 09:02:20 -0500 (EST) Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg2.iro.umontreal.ca (Proxmox) with ESMTP id 0BF9B80479; Sat, 14 Nov 2020 09:02:19 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1605362539; bh=kfO5zCIX+l0WUvlhSCkzEGJukEliwBxIOnAXRKQVSZs=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=PWJtNQCKUH4d7gMMWa7f0iZt2ATNl3vR0iSPLzGVMwMqBCJlXkscpd3LdnlzT5GmB RAS8vhEOI5ck+LYPELA+3f4Guv3pH3+rYuNpfrgRu92Q0T8V9y8ekxcp/3WpmSV70q 3B3buuqvSmU3NLKjjSRYesJYhOBrJqSQPEp3SZCx6XPTx1oJTXBIMTo0W8JNCOct98 UGmlvr54hbZ1SjSGjBc2UUbreOOAROENRA/vNztp4QUkOy229GS+ctcDlFbzZ46+ji raT98NbQPUs25mEWc+12VoT0TAyfs3PxKqzEDp8pTKt5hONAqGtaDjgvpZBJBFUB6H ACJPd0jh+Pacg== Received: from alfajor (unknown [157.52.9.240]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id B9396120403; Sat, 14 Nov 2020 09:02:18 -0500 (EST) From: Stefan Monnier To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer Message-ID: References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> Date: Sat, 14 Nov 2020 09:02:16 -0500 In-Reply-To: <83r1p24ieo.fsf@gnu.org> (Eli Zaretskii's message of "Mon, 09 Nov 2020 18:14:07 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP AWL -0.073 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, Lars Ingebrigtsen , schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) >> > - :prefer-utf-8 t) >> > + :prefer-utf-8 t >> > + :inhibit-null-byte-detection 0 >> > + :inhibit-iso-escape-detection 0) >> >> Makes sense to me, but is there any particular reason to use 0 instead >> of t here? > > 0 is different: it says to obey the value of > inhibit-null-byte-detection resp. inhibit-iso-escape-detection. t > means inhibit the detection unconditionally, which is not what we > want. Actually, for prefer-utf-8 files, I think we never want to automatically fallback to binary. IOW I think Thierry's situation shows a bug in Emacs rather than a pilot error. Stefan From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 10:09:46 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 15:09:46 +0000 Received: from localhost ([127.0.0.1]:51492 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdxBO-000161-5y for submit@debbugs.gnu.org; Sat, 14 Nov 2020 10:09:46 -0500 Received: from eggs.gnu.org ([209.51.188.92]:47720) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdxBM-00015p-KC for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 10:09:41 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:55822) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kdxBG-0004Vo-GJ; Sat, 14 Nov 2020 10:09:34 -0500 Received: from [176.228.60.248] (port=4670 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kdxBE-00047t-QX; Sat, 14 Nov 2020 10:09:33 -0500 Date: Sat, 14 Nov 2020 17:09:20 +0200 Message-Id: <83h7psug9r.fsf@gnu.org> From: Eli Zaretskii To: Stefan Monnier In-Reply-To: (message from Stefan Monnier on Sat, 14 Nov 2020 09:02:16 -0500) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) > From: Stefan Monnier > Cc: Lars Ingebrigtsen , thievol@posteo.net, handa@gnu.org, > schwab@linux-m68k.org, 44486@debbugs.gnu.org > Date: Sat, 14 Nov 2020 09:02:16 -0500 > > > 0 is different: it says to obey the value of > > inhibit-null-byte-detection resp. inhibit-iso-escape-detection. t > > means inhibit the detection unconditionally, which is not what we > > want. > > Actually, for prefer-utf-8 files, I think we never want to automatically > fallback to binary. I think you are assuming prefer-utf-8 is something other than what it is. It is not a variant of UTF-8, it is a variant of 'undecided' (i.e. it starts by detecting the encoding), which prefers UTF-8 if that can decode the text. inhibit-null-byte-detection etc. are relevant to the detection phase, not to the decoding phase. It is wrong IMO to decide to use UTF-8 for a binary byte stream just because it includes valid UTF-8 byte sequences. If the input text is known to be UTF-8, even though it includes null bytes, the user or the application should either bind coding-system-for-read or inhibit-null-byte-detection. > IOW I think Thierry's situation shows a bug in Emacs rather than > a pilot error. I disagree. From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 10:20:07 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 15:20:07 +0000 Received: from localhost ([127.0.0.1]:51566 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdxLT-0001O2-5E for submit@debbugs.gnu.org; Sat, 14 Nov 2020 10:20:07 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:53858) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdxLR-0001NF-Cg for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 10:20:05 -0500 Received: from pmg3.iro.umontreal.ca (localhost [127.0.0.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id 1B25A441007; Sat, 14 Nov 2020 10:20:00 -0500 (EST) Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id C575044068B; Sat, 14 Nov 2020 10:19:58 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1605367198; bh=LshaajWsQKcIP9lA9sxhinZuKvtkI58EdiON0ijv/k8=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=GTBKFBZyuDooiqhfD/b7tWDEQFtog7ZIWB2giHvjBGf1teN9Qh8JGrlbPgdSW/Pir 4EWs4vjwfxBImsAtaRozUKlihrrM6cCkv6Wu1gbaItW+soXLipAtpYHb0ZYk0jlPiM mPWH0SJSymE8eUaFtcodUD1oOv3+/5g6aNGB4RyttgrFPKCOgHzHEr17CYUHi60hr8 onDCuIkJKKp9f0tTY8D61lD/pvCmHBacIexgGg5MkEebRuv8Yofq5F6nM1eseu9umZ TGpvIFPNl4RAzLq17sN4dHU6dQljjtmqkLT3XbIhC4dMZpK2QHK3ogHx9FjlpXWEFU 5kjpAxfInAWcg== Received: from alfajor (unknown [157.52.9.240]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 77FE112016D; Sat, 14 Nov 2020 10:19:58 -0500 (EST) From: Stefan Monnier To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer Message-ID: References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> Date: Sat, 14 Nov 2020 10:19:57 -0500 In-Reply-To: <83h7psug9r.fsf@gnu.org> (Eli Zaretskii's message of "Sat, 14 Nov 2020 17:09:20 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP AWL -0.070 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) >> Actually, for prefer-utf-8 files, I think we never want to automatically >> fallback to binary. > I think you are assuming prefer-utf-8 is something other than what it > is. It is not a variant of UTF-8, it is a variant of 'undecided' > (i.e. it starts by detecting the encoding), which prefers UTF-8 if > that can decode the text. My position is not based on principles but on pragmatic concerns. AFAIK `prefer-utf-8` is only ever used for files which are known to contain text and should almost always contain UTF-8 text. I believe if there's a NUL byte in such a files but it otherwise doesn't contain any invalid UTF-8 byte sequence, it will result in better behavior if we treat it as UFT-8 than as binary. Stefan From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 11:14:16 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 16:14:16 +0000 Received: from localhost ([127.0.0.1]:51715 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdyBo-0004vd-16 for submit@debbugs.gnu.org; Sat, 14 Nov 2020 11:14:16 -0500 Received: from eggs.gnu.org ([209.51.188.92]:39540) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdyBl-0004vQ-Le for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 11:14:10 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:56868) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kdyBf-0003IF-AK; Sat, 14 Nov 2020 11:14:03 -0500 Received: from [176.228.60.248] (port=4626 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kdyBe-0002bx-Kw; Sat, 14 Nov 2020 11:14:03 -0500 Date: Sat, 14 Nov 2020 18:13:49 +0200 Message-Id: <83eekvvruq.fsf@gnu.org> From: Eli Zaretskii To: Stefan Monnier In-Reply-To: (message from Stefan Monnier on Sat, 14 Nov 2020 10:19:57 -0500) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) > From: Stefan Monnier > Cc: larsi@gnus.org, thievol@posteo.net, handa@gnu.org, > schwab@linux-m68k.org, 44486@debbugs.gnu.org > Date: Sat, 14 Nov 2020 10:19:57 -0500 > > >> Actually, for prefer-utf-8 files, I think we never want to automatically > >> fallback to binary. > > I think you are assuming prefer-utf-8 is something other than what it > > is. It is not a variant of UTF-8, it is a variant of 'undecided' > > (i.e. it starts by detecting the encoding), which prefers UTF-8 if > > that can decode the text. > > My position is not based on principles but on pragmatic concerns. > AFAIK `prefer-utf-8` is only ever used for files which are known to > contain text and should almost always contain UTF-8 text. For those, we should use utf-8, not prefer-utf-8. > I believe if there's a NUL byte in such a files but it otherwise doesn't > contain any invalid UTF-8 byte sequence, it will result in better > behavior if we treat it as UFT-8 than as binary. We treat null bytes as the _single_ telltale sign of a binary file. If we disable that in coding-systems that are supposed to _detect_ encoding, we will never be able to detect binary files. From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 12:56:01 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 17:56:01 +0000 Received: from localhost ([127.0.0.1]:51940 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdzmK-0005Py-Pr for submit@debbugs.gnu.org; Sat, 14 Nov 2020 12:56:01 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:42552) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdzmI-0005Pk-U1 for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 12:55:59 -0500 Received: from pmg3.iro.umontreal.ca (localhost [127.0.0.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id 7485A44106D; Sat, 14 Nov 2020 12:55:53 -0500 (EST) Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id 2748244104D; Sat, 14 Nov 2020 12:55:52 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1605376552; bh=bRNquEN6gg4zCNpG7q0pEdZBOFK8UMffDiRpoON2vuI=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=frcSLF7ZVFIpjnjczASzRSlTa5QXPZEY+G7mzu2QlwAW1n5pSblWbzJF0Pw2Bdl/d p+dJZegco10InhYB5tbM4sKMBYpkRm77j3tN5qLdt5xawZBiTwwp8w7+9mVJuwwi25 zN0yp1N6hu8s5QLNPZRvMKcNmetOy6NrfVGeNOhunTEuG9LtqxKOdMfJqJ3cE+eqOe 0/gJ3uSoK+fADVvFHK71SuJVUBzn+e2HHj1R2sq5mFUq5NKPm40Ijyrkk2++lXwCDR Ymf4i3LKijwUbleayL1p+v3KSR0NqeKWhsoeDF/f+LnqVa8611fZbUFx07DxQqM+RO zh3Nv9dpCzftA== Received: from alfajor (unknown [157.52.9.240]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id D7FB71202A8; Sat, 14 Nov 2020 12:55:51 -0500 (EST) From: Stefan Monnier To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer Message-ID: References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> Date: Sat, 14 Nov 2020 12:55:51 -0500 In-Reply-To: <83eekvvruq.fsf@gnu.org> (Eli Zaretskii's message of "Sat, 14 Nov 2020 18:13:49 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP AWL -0.070 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) >> >> Actually, for prefer-utf-8 files, I think we never want to automatically >> >> fallback to binary. >> > I think you are assuming prefer-utf-8 is something other than what it >> > is. It is not a variant of UTF-8, it is a variant of 'undecided' >> > (i.e. it starts by detecting the encoding), which prefers UTF-8 if >> > that can decode the text. >> My position is not based on principles but on pragmatic concerns. >> AFAIK `prefer-utf-8` is only ever used for files which are known to >> contain text and should almost always contain UTF-8 text. > For those, we should use utf-8, not prefer-utf-8. No, `utf-8` should be used when other coding systems should be considered as errors (i.e. not "almost always" but "always"), whereas `prefer-utf-8` is for use when utf-8 is the most likely one and other coding systems should be tried only when there's some evidence that the file actually doesn't use utf-8. `prefer-utf-8` was introduced specifically for `.el` files (and I don't know of any other use of that encoding so far). If `utf-8` is preferable over `prefer-utf-8` for this usage I think the problem is in `prefer-utf-8` since it was introduced specifically for that. >> I believe if there's a NUL byte in such a files but it otherwise doesn't >> contain any invalid UTF-8 byte sequence, it will result in better >> behavior if we treat it as UFT-8 than as binary. > We treat null bytes as the _single_ telltale sign of a binary file. A .el file should *never* be a binary file. > If we disable that in coding-systems that are supposed to _detect_ > encoding, we will never be able to detect binary files. In which scenario would it be beneficial to detect a `.el` file as being binary instead of utf-8? Stefan PS: Especially since NUL bytes can and do occur in ELisp code. From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 13:08:31 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 18:08:31 +0000 Received: from localhost ([127.0.0.1]:51944 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdzyN-0005in-0T for submit@debbugs.gnu.org; Sat, 14 Nov 2020 13:08:31 -0500 Received: from eggs.gnu.org ([209.51.188.92]:33168) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kdzyL-0005iZ-Ch for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 13:08:25 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:58962) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kdzyE-0002Mf-Kw; Sat, 14 Nov 2020 13:08:18 -0500 Received: from [176.228.60.248] (port=3721 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kdzyD-0002jt-Gy; Sat, 14 Nov 2020 13:08:18 -0500 Date: Sat, 14 Nov 2020 20:08:04 +0200 Message-Id: <83y2j3u7zv.fsf@gnu.org> From: Eli Zaretskii To: Stefan Monnier In-Reply-To: (message from Stefan Monnier on Sat, 14 Nov 2020 12:55:51 -0500) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) > From: Stefan Monnier > Cc: larsi@gnus.org, thievol@posteo.net, handa@gnu.org, > schwab@linux-m68k.org, 44486@debbugs.gnu.org > Date: Sat, 14 Nov 2020 12:55:51 -0500 > > >> AFAIK `prefer-utf-8` is only ever used for files which are known to > >> contain text and should almost always contain UTF-8 text. > > For those, we should use utf-8, not prefer-utf-8. > > No, `utf-8` should be used when other coding systems should be > considered as errors (i.e. not "almost always" but "always") Why? > whereas `prefer-utf-8` is for use when utf-8 is the most likely one > and other coding systems should be tried only when there's some > evidence that the file actually doesn't use utf-8. > > `prefer-utf-8` was introduced specifically for `.el` files (and I don't > know of any other use of that encoding so far). Maybe that was the history, but the reality is different. prefer-utf-8 is the same as 'undecided' with coding-systems' priorities tampered to prefer UTF-8. > If `utf-8` is preferable over `prefer-utf-8` for this usage I think > the problem is in `prefer-utf-8` since it was introduced > specifically for that. The implementation doesn't support your POV. > >> I believe if there's a NUL byte in such a files but it otherwise doesn't > >> contain any invalid UTF-8 byte sequence, it will result in better > >> behavior if we treat it as UFT-8 than as binary. > > We treat null bytes as the _single_ telltale sign of a binary file. > > A .el file should *never* be a binary file. We are not talking about .el files, we are talking about _any_ file read using prefer-utf-8. For .el files, we can always bind inhibit-null-byte-detection to t when we load or visit such files. > > If we disable that in coding-systems that are supposed to _detect_ > > encoding, we will never be able to detect binary files. > > In which scenario would it be beneficial to detect a `.el` file as being > binary instead of utf-8? I'm not talking about .el files. The coding-system's applicability is wider than that. From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 13:15:16 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 18:15:16 +0000 Received: from localhost ([127.0.0.1]:51953 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ke04x-0005t8-Ug for submit@debbugs.gnu.org; Sat, 14 Nov 2020 13:15:16 -0500 Received: from eggs.gnu.org ([209.51.188.92]:33986) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ke04w-0005sv-K6 for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 13:15:15 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:59056) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ke04p-0004n6-8v; Sat, 14 Nov 2020 13:15:07 -0500 Received: from [176.228.60.248] (port=4135 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1ke04k-0004vb-AG; Sat, 14 Nov 2020 13:15:06 -0500 Date: Sat, 14 Nov 2020 20:14:50 +0200 Message-Id: <83wnynu7ol.fsf@gnu.org> From: Eli Zaretskii To: monnier@iro.umontreal.ca In-Reply-To: <83y2j3u7zv.fsf@gnu.org> (message from Eli Zaretskii on Sat, 14 Nov 2020 20:08:04 +0200) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> <83y2j3u7zv.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > Date: Sat, 14 Nov 2020 20:08:04 +0200 > From: Eli Zaretskii > Cc: thievol@posteo.net, larsi@gnus.org, schwab@linux-m68k.org, > 44486@debbugs.gnu.org > > For .el files, we can always bind inhibit-null-byte-detection to t > when we load or visit such files. Alternatively, we could introduce a separate coding-system whose :inhibit-null-byte-detection property is t, and use that for *.el files. From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 17:54:10 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 22:54:11 +0000 Received: from localhost ([127.0.0.1]:52258 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ke4Qs-0000EC-LW for submit@debbugs.gnu.org; Sat, 14 Nov 2020 17:54:10 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:35209) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ke4Qr-0000E0-Im for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 17:54:10 -0500 Received: from pmg3.iro.umontreal.ca (localhost [127.0.0.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id F20CD4410A3; Sat, 14 Nov 2020 17:54:03 -0500 (EST) Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id 5F00744106D; Sat, 14 Nov 2020 17:53:58 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1605394438; bh=YT+58dluexxjHTDqFhlqGUOlxTxnVRELeKptoaJLEnQ=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=ONRo6bw3AKFxqgzgpRVrnPcPDysr8eL0WYnVsaLLx+tDHF888S3z1V16PtEC6y+ay 0gNq2QZLrjKnU6TS2w2icyRjwXlzf2CT/zxiusjeeE17HD1CBB8Yqtg4AUGVB7SO6J /kQzHa85UFCUlAELn6AfGN5hN8seEmA8f/RXaCC9mYIqgYRcbCDXyRZlNyMVxrDPnW CuE34TfkqLR3toJIjj1pY0J/q4jjeCZ+l0BiEABY+6Qkr2fgpo8ju/KVbiuOVlvuKy rI2ARZlVHUKeXqPhpkNJYjgsabGTfgYeivqMTSOC2If3Ya/+cSxkH3eNJ6c6cEfg70 dr1h4nJ9u/1Nw== Received: from alfajor (unknown [157.52.9.240]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 04C101202E7; Sat, 14 Nov 2020 17:53:57 -0500 (EST) From: Stefan Monnier To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer Message-ID: References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> <83y2j3u7zv.fsf@gnu.org> Date: Sat, 14 Nov 2020 17:53:57 -0500 In-Reply-To: <83y2j3u7zv.fsf@gnu.org> (Eli Zaretskii's message of "Sat, 14 Nov 2020 20:08:04 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP AWL -0.070 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) >> If `utf-8` is preferable over `prefer-utf-8` for this usage I think >> the problem is in `prefer-utf-8` since it was introduced >> specifically for that. > The implementation doesn't support your POV. Then I think the implementation is in error. >> >> I believe if there's a NUL byte in such a files but it otherwise does= n't >> >> contain any invalid UTF-8 byte sequence, it will result in better >> >> behavior if we treat it as UFT-8 than as binary. >> > We treat null bytes as the _single_ telltale sign of a binary file. >>=20 >> A .el file should *never* be a binary file. > > We are not talking about .el files, we are talking about _any_ file > read using prefer-utf-8. `prefer-utf-8` was not introduced because it seemed like a good idea and then we hoped someone would find it useful. It was introduced to solve a concrete need, which is that of `.el` files. It's quite possible that there are other situations that have the same needs as `.el` files, but from where I stand it looks like "the needs of .el files (and similar cases)" should determine the intended behavior of `prefer-utf-8` rather than its current implementation. > For .el files, we can always bind inhibit-null-byte-detection to t > when we load or visit such files. We could, but I'm having trouble imagining a situation where we'd want to use `prefer-utf-8` and not inhibit "NUL means binary". The "NUL mean binarys" heuristic fundamentally says that `binary` is the first coding system we try and only if this one fails (for lack of NUL bytes) we consider others. But for `prefer-utf-8` we should first consider utf-8 and only if this fails should we consider others (potentially including `binary` if you want, my opinion is not as strong there). > I'm not talking about .el files. The coding-system's applicability is > wider than that. Could be. But it's its "raison d'=EAtre" (and AFAIK currently still the sole application), so it should handle this case as best it can. Stefan From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 14 17:56:47 2020 Received: (at 44486) by debbugs.gnu.org; 14 Nov 2020 22:56:47 +0000 Received: from localhost ([127.0.0.1]:52264 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ke4TP-0000IJ-3p for submit@debbugs.gnu.org; Sat, 14 Nov 2020 17:56:47 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:29518) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ke4TN-0000I5-CM for 44486@debbugs.gnu.org; Sat, 14 Nov 2020 17:56:45 -0500 Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 19450100257; Sat, 14 Nov 2020 17:56:40 -0500 (EST) Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 4EE95100229; Sat, 14 Nov 2020 17:56:38 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1605394598; bh=RYqM3Mmx8yfWvLT7MXqUhazcUUY4Xjj42h29AwDTo9I=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=RJHGxQX/xFpXWYkmbjUqXpm9IPZVRub9JgovPfH8z2xYVGMWS4GzCBs0eKSWs62j5 oKXvGqJ5f5LhVbqxSQRFyH7jTprwyu3cjojG2SOSB/zMFkEEKNpRfn7u3LCspniwP3 CfLSRUgpmx35tqv5efrr8NCowrkVshxpj2LHVZ6IJ+J4WFSPKt8bM3R6U9ll3n1GwQ HhIBCsp57WHd+hBMTqcfpsS2nJZZSyo7ZYs5UixLJMP0iam6JAAkTvOKM1SYzd2HwH tx0/aWCp4tHWxRsK5mknqZ55Q+Ktlrf+MwP7kU7y1Bh3Gc86M/uypkQEGnFLafjUOo D0HUvpW9BRgxA== Received: from alfajor (unknown [157.52.9.240]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 1147E1200F4; Sat, 14 Nov 2020 17:56:38 -0500 (EST) From: Stefan Monnier To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer Message-ID: References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> <83y2j3u7zv.fsf@gnu.org> <83wnynu7ol.fsf@gnu.org> Date: Sat, 14 Nov 2020 17:56:36 -0500 In-Reply-To: <83wnynu7ol.fsf@gnu.org> (Eli Zaretskii's message of "Sat, 14 Nov 2020 20:14:50 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP AWL -0.056 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) >> For .el files, we can always bind inhibit-null-byte-detection to t >> when we load or visit such files. > Alternatively, we could introduce a separate coding-system whose > :inhibit-null-byte-detection property is t, and use that for *.el > files. If you want to go that route, that's fine by me. AFAIK noone else uses `prefer-utf-8`, so it doesn't seem worth the trouble, tho (especially since we don't have any evidence that potential other users would favor the current behavior over the inhibit-null-byte-detection one). Stefan From debbugs-submit-bounces@debbugs.gnu.org Sun Nov 15 10:08:41 2020 Received: (at 44486) by debbugs.gnu.org; 15 Nov 2020 15:08:41 +0000 Received: from localhost ([127.0.0.1]:53949 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1keJdt-0005DO-Ij for submit@debbugs.gnu.org; Sun, 15 Nov 2020 10:08:41 -0500 Received: from eggs.gnu.org ([209.51.188.92]:33406) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1keJdr-0005D9-M2 for 44486@debbugs.gnu.org; Sun, 15 Nov 2020 10:08:36 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:43414) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1keJdk-000477-Vb; Sun, 15 Nov 2020 10:08:28 -0500 Received: from [176.228.60.248] (port=1397 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1keJdk-0006WV-5E; Sun, 15 Nov 2020 10:08:28 -0500 Date: Sun, 15 Nov 2020 17:08:17 +0200 Message-Id: <83mtziu07y.fsf@gnu.org> From: Eli Zaretskii To: Stefan Monnier In-Reply-To: (message from Stefan Monnier on Sat, 14 Nov 2020 17:53:57 -0500) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> <83y2j3u7zv.fsf@gnu.org> MIME-version: 1.0 Content-type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Stefan Monnier > Cc: larsi@gnus.org, thievol@posteo.net, handa@gnu.org, > schwab@linux-m68k.org, 44486@debbugs.gnu.org > Date: Sat, 14 Nov 2020 17:53:57 -0500 > > >> If `utf-8` is preferable over `prefer-utf-8` for this usage I think > >> the problem is in `prefer-utf-8` since it was introduced > >> specifically for that. > > The implementation doesn't support your POV. > > Then I think the implementation is in error. But that ship has sailed 7 years ago. > > We are not talking about .el files, we are talking about _any_ file > > read using prefer-utf-8. > > `prefer-utf-8` was not introduced because it seemed like a good idea and > then we hoped someone would find it useful. It was introduced to solve > a concrete need, which is that of `.el` files. It's quite possible that > there are other situations that have the same needs as `.el` files, but > from where I stand it looks like "the needs of .el files (and similar > cases)" should determine the intended behavior of `prefer-utf-8` rather > than its current implementation. > > > For .el files, we can always bind inhibit-null-byte-detection to t > > when we load or visit such files. > > We could, but I'm having trouble imagining a situation where we'd want > to use `prefer-utf-8` and not inhibit "NUL means binary". > > The "NUL mean binarys" heuristic fundamentally says that `binary` is the > first coding system we try and only if this one fails (for lack of NUL > bytes) we consider others. But for `prefer-utf-8` we should first > consider utf-8 and only if this fails should we consider others > (potentially including `binary` if you want, my opinion is not as strong > there). > > > I'm not talking about .el files. The coding-system's applicability is > > wider than that. > > Could be. But it's its "raison d'être" (and AFAIK currently still the > sole application), so it should handle this case as best it can. We should have been having this discussion 7 years ago. And guess what? we did. In that discussion, you said, in response to a question from Kenichi: > * What to do with null byte detection. Previously, if a > *.el file contains a null byte and > inhibit-null-byte-detection is nil (the default), it's > detected as a binary file. Now utf-8 is forced regardless > of inhibit-null-byte-detection. I like the utf-8 better, but I don't know of any concrete case where it makes a significant difference, so either way is OK. ^^^^^^^^^^^^^^^^ Note that what actually got implemented ignored inhibit-null-byte-detection altogether, and _always_ considered the file binary if any null byte was found. My change, which prompted this present discussion, made prefer-utf-8 heed the variable's value, which is mid-way between what we had for 7 years and what you thought we should have. So, a small step forward ;-) From debbugs-submit-bounces@debbugs.gnu.org Sun Nov 15 10:14:28 2020 Received: (at 44486) by debbugs.gnu.org; 15 Nov 2020 15:14:28 +0000 Received: from localhost ([127.0.0.1]:53958 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1keJjU-0005Lr-CD for submit@debbugs.gnu.org; Sun, 15 Nov 2020 10:14:28 -0500 Received: from eggs.gnu.org ([209.51.188.92]:34454) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1keJjS-0005Ld-DZ for 44486@debbugs.gnu.org; Sun, 15 Nov 2020 10:14:23 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:43469) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1keJjM-00069m-Lo; Sun, 15 Nov 2020 10:14:16 -0500 Received: from [176.228.60.248] (port=1746 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1keJjM-00070n-3R; Sun, 15 Nov 2020 10:14:16 -0500 Date: Sun, 15 Nov 2020 17:14:05 +0200 Message-Id: <83lff2tzya.fsf@gnu.org> From: Eli Zaretskii To: Stefan Monnier In-Reply-To: (message from Stefan Monnier on Sat, 14 Nov 2020 17:56:36 -0500) Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> <83y2j3u7zv.fsf@gnu.org> <83wnynu7ol.fsf@gnu.org> X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > From: Stefan Monnier > Cc: thievol@posteo.net, larsi@gnus.org, schwab@linux-m68k.org, > 44486@debbugs.gnu.org > Date: Sat, 14 Nov 2020 17:56:36 -0500 > > >> For .el files, we can always bind inhibit-null-byte-detection to t > >> when we load or visit such files. > > Alternatively, we could introduce a separate coding-system whose > > :inhibit-null-byte-detection property is t, and use that for *.el > > files. > > If you want to go that route, that's fine by me. I actually think that we don't need to do anything. We've lived for 7 years with a reality that is worse than what is now on master, and no one complained. But if you are very unhappy about this, we _could_ introduce a new coding-system for *.el files. > (especially since we don't have any evidence that potential other > users would favor the current behavior over the > inhibit-null-byte-detection one). The current behavior on master is to heed inhibit-null-byte-detection; the current behavior in Emacs 27 is to ignore it, and always consider a .el file with null bytes as binary. I hope you agree that the behavior on master is slightly better, at least in that it won't surprise users. From debbugs-submit-bounces@debbugs.gnu.org Sun Nov 15 13:31:29 2020 Received: (at 44486) by debbugs.gnu.org; 15 Nov 2020 18:31:29 +0000 Received: from localhost ([127.0.0.1]:54154 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1keMoC-0001pm-Nk for submit@debbugs.gnu.org; Sun, 15 Nov 2020 13:31:28 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:36263) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1keMoA-0001pV-Bv for 44486@debbugs.gnu.org; Sun, 15 Nov 2020 13:31:27 -0500 Received: from pmg3.iro.umontreal.ca (localhost [127.0.0.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id BFC7F4410D3; Sun, 15 Nov 2020 13:31:20 -0500 (EST) Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id E62A74410C3; Sun, 15 Nov 2020 13:31:14 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1605465074; bh=C7LcYmv/XcUN4qst4eNGsaWtH8DFx6hocXbhCGEITLU=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=GocR84MBljCZ+fknxV0sFJ6e5ZfAuWWwF5vsWRE2G2YjPF/bcZLgJ75HUYJO8omKA HJLm8h8otUBjvQGezwbSm9xLq5f9FDgy6LyXa3hhZnhhPEAYWk4tt5O7Xv/r7PdFDD 8E25vGEcWUPqMn5IfSFwHku+UDhgWG1KTxiMa7WUkP/mfyyJOHWQb4ThyjAd/BSsFc cC9pWLWpOB/IQniBDDY42CFGa+VK2V3G0vy2Q0mNVnjYDv0CQ33BFYLSh2j8GRRr6s cpHo791l8JYMteZTBLf60HqxXK03BZxWTSsTxKGamozRETAHqqKPYu0A7AimbiOENJ Sm3DHqQn8PSig== Received: from alfajor (unknown [157.52.9.240]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 946C8120312; Sun, 15 Nov 2020 13:31:14 -0500 (EST) From: Stefan Monnier To: Eli Zaretskii Subject: Re: bug#44486: 27.1; C-@ chars corrupt elisp buffer Message-ID: References: <878sbeikpr.fsf@posteo.net> <87zh3u8pqn.fsf@igel.home> <83blga8pdp.fsf@gnu.org> <838sbe8nny.fsf@gnu.org> <83361m8d1t.fsf@gnu.org> <87blg6lem7.fsf@gnus.org> <83r1p24ieo.fsf@gnu.org> <83h7psug9r.fsf@gnu.org> <83eekvvruq.fsf@gnu.org> <83y2j3u7zv.fsf@gnu.org> <83mtziu07y.fsf@gnu.org> Date: Sun, 15 Nov 2020 13:31:13 -0500 In-Reply-To: <83mtziu07y.fsf@gnu.org> (Eli Zaretskii's message of "Sun, 15 Nov 2020 17:08:17 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP AWL -0.068 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44486 Cc: thievol@posteo.net, handa@gnu.org, larsi@gnus.org, schwab@linux-m68k.org, 44486@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > > * What to do with null byte detection. Previously, if a > > *.el file contains a null byte and > > inhibit-null-byte-detection is nil (the default), it's > > detected as a binary file. Now utf-8 is forced regardless > > of inhibit-null-byte-detection. > > I like the utf-8 better, but I don't know of any concrete case where it > makes a significant difference, so either way is OK. > ^^^^^^^^^^^^^^^^ I'm glad to see that I now know better ;-) > we should have. So, a small step forward ;-) I'll take what I can get ;-) Stefan From unknown Tue Aug 19 02:52:35 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Mon, 14 Dec 2020 12:24:08 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator