GNU bug report logs - #66534
30.0.50; [PATCH] Expand file-name of ~/.emacs before attempt to load it

Previous Next

To reply to this bug, email your comments to 66534 AT debbugs.gnu.org.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Christoph <just.mychris <at> googlemail.com>
To: bug-gnu-emacs <at> gnu.org
Subject: 30.0.50;
 [PATCH] Expand file-name of ~/.emacs before attempt to load it
Date: Fri, 13 Oct 2023 20:41:16 +0200

[Message part 1 (text/plain, inline)]

Hi,

I noticed that during startup, emacs tries to load ~/.emacs (with
different extensions) many times over.  You can see this by using
strace and tracing the openat syscall.  The problem is, that `load'
does not expand the ~/ in the filename passed to it.  So it does not
recognize the file as being absolute and tries to resolve it using
the load-path.

While resolving the path in the openp function in lread.c,
`expand-file-name' is used with the default directory being the
elements of the load-path.  Since for `expand-file-name', ~/.emacs is
an absolute path, it returns the path unchanged, and load tries to
load ~/.emacs many times over.  I am not sure if the behavior of
`load' should also be considered a bug, but since all the other paths
of init files are resolved using `expand-file-name', I guess the same
should be done for the ~/.emacs path as well.

-- Christoph

[0001-Expand-file-name-of-.emacs-before-attempt-to-load-it.patch (text/x-patch, attachment)]

Message #8 received at 66534 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Christoph <just.mychris <at> googlemail.com>
Cc: 66534 <at> debbugs.gnu.org
Subject: Re: bug#66534: 30.0.50;
 [PATCH] Expand file-name of ~/.emacs before attempt to load it
Date: Sat, 14 Oct 2023 09:54:00 +0300

> Date: Fri, 13 Oct 2023 20:41:16 +0200
> From:  Christoph via "Bug reports for GNU Emacs,
>  the Swiss army knife of text editors" <bug-gnu-emacs <at> gnu.org>
> 
> I noticed that during startup, emacs tries to load ~/.emacs (with
> different extensions) many times over.  You can see this by using
> strace and tracing the openat syscall.  The problem is, that `load'
> does not expand the ~/ in the filename passed to it.  So it does not
> recognize the file as being absolute and tries to resolve it using
> the load-path.
> 
> While resolving the path in the openp function in lread.c,
> `expand-file-name' is used with the default directory being the
> elements of the load-path.  Since for `expand-file-name', ~/.emacs is
> an absolute path, it returns the path unchanged, and load tries to
> load ~/.emacs many times over.

I don't understand what you are saying here.  The last sentence is
incorrect, as evidenced by the following:

  (expand-file-name "~/.emacs" "/tmp")
   => "/home/eliz/.emacs"

IOW, "~/.emacs" is indeed treated by Emacs as an absolute file name,
but expand-file-name does NOT return "~/.emacs" unchanged.

So please explain what exactly is the problem you see here, and in
particular what issues that problem causes in your case.

Thanks.

Message #11 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Andreas Schwab <schwab <at> linux-m68k.org>
To: Christoph via "Bug reports for GNU Emacs, the Swiss army knife of text
 editors" <bug-gnu-emacs <at> gnu.org>
Cc: 66534 <at> debbugs.gnu.org, Christoph <just.mychris <at> googlemail.com>
Subject: Re: bug#66534: 30.0.50; [PATCH] Expand file-name of ~/.emacs before
 attempt to load it
Date: Sat, 14 Oct 2023 09:25:50 +0200

On Okt 13 2023, Christoph via "Bug reports for GNU Emacs, the Swiss army knife of text editors" wrote:

> I noticed that during startup, emacs tries to load ~/.emacs (with
> different extensions) many times over.  You can see this by using
> strace and tracing the openat syscall.  The problem is, that `load'
> does not expand the ~/ in the filename passed to it.  So it does not
> recognize the file as being absolute and tries to resolve it using
> the load-path.

That's probably a bug in complete_filename_p.

-- 
Andreas Schwab, schwab <at> linux-m68k.org
GPG Key fingerprint = 7578 EB47 D4E5 4D69 2510  2552 DF73 E780 A9DA AEC1
"And now for something completely different."

Message #17 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Christoph <just.mychris <at> googlemail.com>
To: Andreas Schwab <schwab <at> linux-m68k.org>
Cc: "Christoph via Bug reports for GNU Emacs,
 the Swiss army knife of text editors" <bug-gnu-emacs <at> gnu.org>,
 66534 <at> debbugs.gnu.org
Subject: Re: bug#66534: 30.0.50; [PATCH] Expand file-name of ~/.emacs before
 attempt to load it
Date: Sat, 14 Oct 2023 11:05:42 +0200

On Sat, Oct 14, 2023 at 9:25 AM Andreas Schwab <schwab <at> linux-m68k.org> wrote:
>
> On Okt 13 2023, Christoph via "Bug reports for GNU Emacs, the Swiss army knife of text editors" wrote:
>
> > I noticed that during startup, emacs tries to load ~/.emacs (with
> > different extensions) many times over.  You can see this by using
> > strace and tracing the openat syscall.  The problem is, that `load'
> > does not expand the ~/ in the filename passed to it.  So it does not
> > recognize the file as being absolute and tries to resolve it using
> > the load-path.
>
> That's probably a bug in complete_filename_p.
>

I am not so sure if complete_filename_p should be able to recognize
these kinds of paths, or if `load' should expand the filename before
using it.  I am not familiar with all supported platforms, but it might
be tricky to check if a filename is absolute, without expanding it
beforehand.

For instance, what about filenames that start with a series of "../".
I guess they should be considered to be absolute, if the path goes up
to the root.

On the other hand, the documentation of `load' does not mention
absolute paths at all and states, This function searches the
directories on `load-path'.  So I can't say what the expected behaviour
of load is with paths that aren't expanded, but are absolute.

I am hesitant with changing the C code, because I am not very familiar
with it and just started to get into it, so I thought it might be more
appropriate to change it on the Lisp side, since all the other paths
to init files are fully expanded before passing them to load.

But yes, as I wrote before, I think this behaviour of load could be
considered a bug as well.

-- Christoph

Message #20 received at 66534 <at> debbugs.gnu.org (full text, mbox):

From: Christoph <just.mychris <at> googlemail.com>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: 66534 <at> debbugs.gnu.org
Subject: Re: bug#66534: 30.0.50; [PATCH] Expand file-name of ~/.emacs before
 attempt to load it
Date: Sat, 14 Oct 2023 11:04:14 +0200

On Sat, Oct 14, 2023 at 8:54 AM Eli Zaretskii <eliz <at> gnu.org> wrote:
>
> > Date: Fri, 13 Oct 2023 20:41:16 +0200
> > From:  Christoph via "Bug reports for GNU Emacs,
> >  the Swiss army knife of text editors" <bug-gnu-emacs <at> gnu.org>
> >
> > I noticed that during startup, emacs tries to load ~/.emacs (with
> > different extensions) many times over.  You can see this by using
> > strace and tracing the openat syscall.  The problem is, that `load'
> > does not expand the ~/ in the filename passed to it.  So it does not
> > recognize the file as being absolute and tries to resolve it using
> > the load-path.
> >
> > While resolving the path in the openp function in lread.c,
> > `expand-file-name' is used with the default directory being the
> > elements of the load-path.  Since for `expand-file-name', ~/.emacs is
> > an absolute path, it returns the path unchanged, and load tries to
> > load ~/.emacs many times over.
>
> I don't understand what you are saying here.  The last sentence is
> incorrect, as evidenced by the following:
>
>   (expand-file-name "~/.emacs" "/tmp")
>    => "/home/eliz/.emacs"
>
> IOW, "~/.emacs" is indeed treated by Emacs as an absolute file name,
> but expand-file-name does NOT return "~/.emacs" unchanged.

What I meant is "unchanged" in the regard to the default
directory. You can give any default directory to expand-file-name and
it will always return the first argument in its expanded form, if the
expanded form of the first argument is an absolute path.

>
> So please explain what exactly is the problem you see here, and in
> particular what issues that problem causes in your case.
>
> Thanks.

If you start Emacs without an ~/.emacs file, and with using .emacs.d
and not .config/emacs, I think there is a difference as well, Emacs
will try to load ~/.emacs `(length load-path)' times.  If I start
Emacs with strace -e openat I see the following lines 147 times:

openat(AT_FDCWD, "/home/chris/.emacs", O_RDONLY|O_CLOEXEC) = -1 ENOENT
(No such file or directory)
openat(AT_FDCWD, "/home/chris/.emacs.gz", O_RDONLY|O_CLOEXEC) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD, "/home/chris/.emacs.so", O_RDONLY|O_CLOEXEC) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD, "/home/chris/.emacs.so.gz", O_RDONLY|O_CLOEXEC) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD, "/home/chris/.emacs.elc", O_RDONLY|O_CLOEXEC) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD, "/home/chris/.emacs.elc.gz", O_RDONLY|O_CLOEXEC) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD, "/home/chris/.emacs.el", O_RDONLY|O_CLOEXEC) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD, "/home/chris/.emacs.el.gz", O_RDONLY|O_CLOEXEC) = -1
ENOENT (No such file or directory)

But Emacs should only try to load the file once.  The problem is that
the path to ~/.emacs is not expanded before it is handed to `load' and
load basically does:

(dolist (path load-path)
  (low-level-load (expand-file-name "~/.emacs" path)))

where low-level-load is some magic function which really loads a file.
There is off course more going on, like iterating over the extension
and such, but I want to keep it simple, since I am not familiar with
it at all.

`load' does check if the given path is absolute and
changes its behavior.  If the path is absolute, `load' does not take the
load-path into account, but paths beginning with "~/" are not recognized as
beeing absolute, hence the paths should be expanded before passing them
to `load'.

Because all the other paths to init files (early-init.el and init.el)
are expanded before they are passed to `load', I think "~/.emacs"
should be expanded as well.

There is also the question if `load' itself should be able to handle
paths that begin with "~/" correctly, or if the user is expected to
expand paths before passing them to `load'.

Regards, Christoph

Message #26 received at 66534 <at> debbugs.gnu.org (full text, mbox):

From: Christoph <just.mychris <at> googlemail.com>
To: 66534 <at> debbugs.gnu.org
Subject: Re: bug#66534: 30.0.50; [PATCH] Expand file-name of ~/.emacs before
 attempt to load it
Date: Mon, 23 Oct 2023 17:56:23 +0200

On Sat, Oct 14, 2023 at 8:54 AM Eli Zaretskii <eliz <at> gnu.org> wrote:
> So please explain what exactly is the problem you see here, and in
> particular what issues that problem causes in your case.

Do you think the patch makes sense like that, or should I rather look
into the native side, as suggested by Andreas?

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.