GNU bug report logs - #59882
30.0.50; Compilation of ELPA packages during version upgrade (Org 9.6 ELPA upgrade from older ELPA version)

Previous Next

Package: emacs;

Reported by: Ihor Radchenko <yantar92 <at> posteo.net>

Date: Wed, 7 Dec 2022 11:37:01 UTC

Severity: normal

Found in version 30.0.50

To reply to this bug, email your comments to 59882 AT debbugs.gnu.org.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 07 Dec 2022 11:37:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ihor Radchenko <yantar92 <at> posteo.net>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs <at> gnu.org. (Wed, 07 Dec 2022 11:37:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: bug-gnu-emacs <at> gnu.org
Subject: 30.0.50; Compilation of ELPA packages during version upgrade (Org
 9.6 ELPA upgrade from older ELPA version)
Date: Wed, 07 Dec 2022 11:36:07 +0000
Hi,

I am writing as a follow-up of numerous errors reports on Org 9.6
upgrades.

Users commonly report issues upgrading Org mode via ELPA when an older,
non-built-in, version of Org is already installed and loaded.

The issue is well described in https://irreal.org/blog/?p=10996

People are commonly getting "invalid function `org-assert-version'",
which indicates compilation issue when `org-assert-version' macro is not
correctly recognized as a macro.

Similar errors have been reported in the past Org upgrades when we
introduced/changes some basic macros in Org.

I am not yet sure about the source of the error, but I suspect that it
might be something to do with package.el. May it be that M-x
package-install / package-reinstall does not unload the old package
versions upon installation? Or maybe there are some stale .elc files
lying around? Any other ideas?

P.S. Please, do not be diverted by the purpose of `org-assert-version'
macro. The origin of the error has nothing to do with it and could as
well happen with any other macro. It is just that we put this particular
macro into all the Org libraries now, making the problem obvious.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 03:54:02 GMT) Full text and rfc822 format available.

Message #8 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: David Masterson <dsmasterson <at> gmail.com>
To: "Michel Schinz" <michel <at> schi.nz>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: Multiple versions of Org in load-path problem
Date: Thu, 08 Dec 2022 13:56:03 -0800
Adding this to bug #59882

"Michel Schinz" <michel <at> schi.nz> writes:

> Just for the record, I also ran into problems when installing Org 9.6
> using Emacs' package system on top of an older version that came with
> Emacs. If I tried to install it as usual (M-x list-packages, then
> install the package from there), I had errors during compilation related
> to `org-assert-version`, and then if I restarted Emacs, I would get a
> fatal error in an unrelated package.
>
> I managed to solve that problem by:
> 1. uninstalling Org 9.6 and exiting Emacs,
> 2. starting Emacs with -q,
> 3. installing Org 9.6 from there (using M-x list-packages as usual),
> 4. restarting Emacs.

Interesting!  I tried this (essentially) and it worked for my case.  In
my case, I had a built-in Org-9.3 and I was trying to use list-packages
to install Org-9.6. I checked that using -q still added Org-9.3 to the
load-path, but, since Org wasn't loaded, the install via list-packages
worked.

The question is what's the proper way of doing this without '-q'?

> I'm not sure this is related to your problem, or whether that helps (but
> I hope it does)...

I think it does.

Side note:

In my testing, I found a strange case where, in *scratch*, I get:

(message "%s" org-version)
;; Error undefined
;; Do 'C-h v org-version'
(message "%s" org-version)
9.3

So, 'describe-variable' on org-version causes Org to be loaded?!?  Why
do I have a feeling this is related to this bug?

-- 
David Masterson




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 07:18:02 GMT) Full text and rfc822 format available.

Message #11 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: David Masterson <dsmasterson <at> gmail.com>
Cc: emacs-orgmode <at> gnu.org, michel <at> schi.nz, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 09 Dec 2022 09:17:23 +0200
> Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
> From: David Masterson <dsmasterson <at> gmail.com>
> Date: Thu, 08 Dec 2022 13:56:03 -0800
> 
> In my testing, I found a strange case where, in *scratch*, I get:
> 
> (message "%s" org-version)
> ;; Error undefined
> ;; Do 'C-h v org-version'
> (message "%s" org-version)
> 9.3
> 
> So, 'describe-variable' on org-version causes Org to be loaded?!?

Why is it so surprising?  Is this the first time you see that a Help
command loads something to do its job?




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 07:44:03 GMT) Full text and rfc822 format available.

Message #14 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: David Masterson <dsmasterson <at> gmail.com>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: emacs-orgmode <at> gnu.org, michel <at> schi.nz, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Thu, 08 Dec 2022 23:43:05 -0800
Eli Zaretskii <eliz <at> gnu.org> writes:

>> Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
>> From: David Masterson <dsmasterson <at> gmail.com>
>> Date: Thu, 08 Dec 2022 13:56:03 -0800
>> 
>> In my testing, I found a strange case where, in *scratch*, I get:
>> 
>> (message "%s" org-version)
>> ;; Error undefined
>> ;; Do 'C-h v org-version'
>> (message "%s" org-version)
>> 9.3
>> 
>> So, 'describe-variable' on org-version causes Org to be loaded?!?
>
> Why is it so surprising?  Is this the first time you see that a Help
> command loads something to do its job?

Yes, it is surprising.  How did Emacs know to load Org to find
org-version?  I didn't request it to by this action.  Or did it do a
package-activate-all (or similar) to ensure that everything was loaded?
That would be overkill.  Sometimes the best answer is 'nil'.

-- 
David Masterson




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 11:58:02 GMT) Full text and rfc822 format available.

Message #17 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: David Masterson <dsmasterson <at> gmail.com>
Cc: emacs-orgmode <at> gnu.org, michel <at> schi.nz, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 09 Dec 2022 13:57:40 +0200
> From: David Masterson <dsmasterson <at> gmail.com>
> Cc: michel <at> schi.nz,  emacs-orgmode <at> gnu.org,  59882 <at> debbugs.gnu.org
> Date: Thu, 08 Dec 2022 23:43:05 -0800
> 
> Eli Zaretskii <eliz <at> gnu.org> writes:
> 
> >> So, 'describe-variable' on org-version causes Org to be loaded?!?
> >
> > Why is it so surprising?  Is this the first time you see that a Help
> > command loads something to do its job?
> 
> Yes, it is surprising.  How did Emacs know to load Org to find
> org-version?  I didn't request it to by this action.  Or did it do a
> package-activate-all (or similar) to ensure that everything was loaded?
> That would be overkill.  Sometimes the best answer is 'nil'.

I don't think Emacs does package-activate-all.  But Help commands
frequently load packages to provide the documentation of the symbols
you ask about.  If this is surprising, then I suggest to get used to
it.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 19:41:02 GMT) Full text and rfc822 format available.

Message #20 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: "Cook, Malcolm" <MEC <at> stowers.org>
To: David Masterson <dsmasterson <at> gmail.com>, Eli Zaretskii <eliz <at> gnu.org>
Cc: "emacs-orgmode <at> gnu.org" <emacs-orgmode <at> gnu.org>,
 "michel <at> schi.nz" <michel <at> schi.nz>,
 "59882 <at> debbugs.gnu.org" <59882 <at> debbugs.gnu.org>
Subject: RE: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 9 Dec 2022 19:40:17 +0000
> Eli Zaretskii <eliz <at> gnu.org> writes:
> 
> >> Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
> >> From: David Masterson <dsmasterson <at> gmail.com>
> >> Date: Thu, 08 Dec 2022 13:56:03 -0800
> >>
> >> In my testing, I found a strange case where, in *scratch*, I get:
> >>
> >> (message "%s" org-version)
> >> ;; Error undefined
> >> ;; Do 'C-h v org-version'
> >> (message "%s" org-version)
> >> 9.3
> >>
> >> So, 'describe-variable' on org-version causes Org to be loaded?!?
> >
> > Why is it so surprising?  Is this the first time you see that a Help
> > command loads something to do its job?
> 
> Yes, it is surprising.  How did Emacs know to load Org to find org-version? 

This is provided for via emacs' autoload by prefix mechanism.

See:

https://www.gnu.org/software/emacs/manual/html_node/elisp/Autoload-by-Prefix.html

What you observed will NOT happen if you first run:

	(clrhash  definition-prefixes)

> didn't request it to by this action.  Or did it do a package-activate-all (or
> similar) to ensure that everything was loaded?
> That would be overkill.  Sometimes the best answer is 'nil'.
> 
> --
> David Masterson





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 19:49:01 GMT) Full text and rfc822 format available.

Message #23 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: "Cook, Malcolm" <MEC <at> stowers.org>
To: David Masterson <dsmasterson <at> gmail.com>, Michel Schinz <michel <at> schi.nz>
Cc: "emacs-orgmode <at> gnu.org" <emacs-orgmode <at> gnu.org>,
 "59882 <at> debbugs.gnu.org" <59882 <at> debbugs.gnu.org>
Subject: RE: Multiple versions of Org in load-path problem
Date: Fri, 9 Dec 2022 19:47:59 +0000
> Adding this to bug #59882
> 
> "Michel Schinz" <michel <at> schi.nz> writes:
> 
> > Just for the record, I also ran into problems when installing Org 9.6
> > using Emacs' package system on top of an older version that came with
> > Emacs. If I tried to install it as usual (M-x list-packages, then
> > install the package from there), I had errors during compilation
> > related to `org-assert-version`, and then if I restarted Emacs, I
> > would get a fatal error in an unrelated package.
> >
> > I managed to solve that problem by:
> > 1. uninstalling Org 9.6 and exiting Emacs, 2. starting Emacs with -q,
> > 3. installing Org 9.6 from there (using M-x list-packages as usual),
> > 4. restarting Emacs.
> 
> Interesting!  I tried this (essentially) and it worked for my case.  In my case, I
> had a built-in Org-9.3 and I was trying to use list-packages to install Org-9.6. I
> checked that using -q still added Org-9.3 to the load-path, but, since Org
> wasn't loaded, the install via list-packages worked.
> 
> The question is what's the proper way of doing this without '-q'?
> 
> > I'm not sure this is related to your problem, or whether that helps
> > (but I hope it does)...
> 
> I think it does.
> 
> Side note:
> 
> In my testing, I found a strange case where, in *scratch*, I get:
> 
> (message "%s" org-version)
> ;; Error undefined
> ;; Do 'C-h v org-version'
> (message "%s" org-version)
> 9.3
> 
> So, 'describe-variable' on org-version causes Org to be loaded?!?  [Cook, Malcolm] 

Yes.  See https://www.gnu.org/software/emacs/manual/html_node/elisp/Autoload-by-Prefix.html

But it will NOT be autoloaded if you first:

(clrhash  definition-prefixes)

HTH & YMMV,

Malcolm

> Why do I
> have a feeling this is related to this bug?

Yeah, I'm not sure what you consider the bug to be now.  Remind me?

> 
> --
> David Masterson





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 19:52:01 GMT) Full text and rfc822 format available.

Message #26 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: David Masterson <dsmasterson <at> gmail.com>
To: "Cook, Malcolm" <MEC <at> stowers.org>
Cc: Eli Zaretskii <eliz <at> gnu.org>,
 "emacs-orgmode <at> gnu.org" <emacs-orgmode <at> gnu.org>,
 "michel <at> schi.nz" <michel <at> schi.nz>,
 "59882 <at> debbugs.gnu.org" <59882 <at> debbugs.gnu.org>
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 09 Dec 2022 11:51:29 -0800
"Cook, Malcolm" <MEC <at> stowers.org> writes:

>> Eli Zaretskii <eliz <at> gnu.org> writes:
>> 
>> >> Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
>> >> From: David Masterson <dsmasterson <at> gmail.com>
>> >> Date: Thu, 08 Dec 2022 13:56:03 -0800
>> >>
>> >> In my testing, I found a strange case where, in *scratch*, I get:
>> >>
>> >> (message "%s" org-version)
>> >> ;; Error undefined
>> >> ;; Do 'C-h v org-version'
>> >> (message "%s" org-version)
>> >> 9.3
>> >>
>> >> So, 'describe-variable' on org-version causes Org to be loaded?!?
>> >
>> > Why is it so surprising?  Is this the first time you see that a Help
>> > command loads something to do its job?
>> 
>> Yes, it is surprising.  How did Emacs know to load Org to find org-version? 
>
> This is provided for via emacs' autoload by prefix mechanism.
>
> See:
>
> https://www.gnu.org/software/emacs/manual/html_node/elisp/Autoload-by-Prefix.html
>
> What you observed will NOT happen if you first run:
>
> 	(clrhash  definition-prefixes)

Ah! Thank you.  In many ways, I still think of Emacs from what I learned
about it in the early 80s (yes, pre-Elisp).  I didn't expect this and,
so, didn't investigate the possibility that it's planned (the Info
documentation has gotten huge).  Apologies to Eli.

-- 
David Masterson




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 09 Dec 2022 20:28:01 GMT) Full text and rfc822 format available.

Message #29 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: David Masterson <dsmasterson <at> gmail.com>
Cc: MEC <at> stowers.org, emacs-orgmode <at> gnu.org, michel <at> schi.nz,
 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 09 Dec 2022 22:27:13 +0200
> From: David Masterson <dsmasterson <at> gmail.com>
> Cc: Eli Zaretskii <eliz <at> gnu.org>,  "michel <at> schi.nz" <michel <at> schi.nz>,
>   "emacs-orgmode <at> gnu.org" <emacs-orgmode <at> gnu.org>,  "59882 <at> debbugs.gnu.org"
>  <59882 <at> debbugs.gnu.org>
> Date: Fri, 09 Dec 2022 11:51:29 -0800
> 
> > https://www.gnu.org/software/emacs/manual/html_node/elisp/Autoload-by-Prefix.html
> >
> > What you observed will NOT happen if you first run:
> >
> > 	(clrhash  definition-prefixes)
> 
> Ah! Thank you.  In many ways, I still think of Emacs from what I learned
> about it in the early 80s (yes, pre-Elisp).  I didn't expect this and,
> so, didn't investigate the possibility that it's planned (the Info
> documentation has gotten huge).  Apologies to Eli.

No apologies needed, we all learn something new about Emacs every day.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Sat, 10 Dec 2022 14:03:02 GMT) Full text and rfc822 format available.

Message #32 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: David Masterson <dsmasterson <at> gmail.com>, emacs-orgmode <at> gnu.org,
 michel <at> schi.nz, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Sat, 10 Dec 2022 14:01:58 +0000
Eli Zaretskii <eliz <at> gnu.org> writes:

>> In my testing, I found a strange case where, in *scratch*, I get:
>> 
>> (message "%s" org-version)
>> ;; Error undefined
>> ;; Do 'C-h v org-version'
>> (message "%s" org-version)
>> 9.3
>> 
>> So, 'describe-variable' on org-version causes Org to be loaded?!?
>
> Why is it so surprising?  Is this the first time you see that a Help
> command loads something to do its job?

Please note that David's recipe is _not_ what I described in the bug
report.

I am referring to the problem people run into when using M-x
package-install.

AFAIU, package-install must not depend on the older version of a package
being loaded/not loaded.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 14 Dec 2022 09:52:02 GMT) Full text and rfc822 format available.

Message #35 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: David Masterson <dsmasterson <at> gmail.com>, emacs-orgmode <at> gnu.org,
 michel <at> schi.nz, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 09:51:01 +0000
Eli Zaretskii <eliz <at> gnu.org> writes:

>> So, 'describe-variable' on org-version causes Org to be loaded?!?
>
> Why is it so surprising?  Is this the first time you see that a Help
> command loads something to do its job?

On a related note, is it normal that package like org-mouse.el gets
loaded upon calling C-h f org-mouse- <TAB> completion prompt?
org-mouse.el does not contain a single autoload cookie.

I am asking because org-mouse.el advises some functions and its loading
may cause unexpected consequences. See
https://orgmode.org/list/87r0x6sju1.fsf <at> fastmail.fm

At the same time, we have users complaining about some defcustoms not
being available without loading.
https://orgmode.org/list/25496.19258.682537.503614 <at> gargle.gargle.HOWL

I feel confused about the situation.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 14 Dec 2022 13:01:02 GMT) Full text and rfc822 format available.

Message #38 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Ihor Radchenko <yantar92 <at> posteo.net>,
 Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: dsmasterson <at> gmail.com, emacs-orgmode <at> gnu.org, michel <at> schi.nz,
 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 14:59:50 +0200
> From: Ihor Radchenko <yantar92 <at> posteo.net>
> Cc: David Masterson <dsmasterson <at> gmail.com>, emacs-orgmode <at> gnu.org,
>  michel <at> schi.nz, 59882 <at> debbugs.gnu.org
> Date: Wed, 14 Dec 2022 09:51:01 +0000
> 
> On a related note, is it normal that package like org-mouse.el gets
> loaded upon calling C-h f org-mouse- <TAB> completion prompt?
> org-mouse.el does not contain a single autoload cookie.

I think it's expected, because the doc strings need to be loaded.
Stefan, am I right?

> I am asking because org-mouse.el advises some functions and its loading
> may cause unexpected consequences. See
> https://orgmode.org/list/87r0x6sju1.fsf <at> fastmail.fm

I think org-mouse.el should be fixed not to cause such effects just by
loading it.  It should do that only when it is actually used.

> At the same time, we have users complaining about some defcustoms not
> being available without loading.
> https://orgmode.org/list/25496.19258.682537.503614 <at> gargle.gargle.HOWL

That's too vague: it talks about "whether a variable exists", which is
ambiguous.  That a variable is not boundp until its definition is
loaded is perfectly expected, and I don't think defcustom changes that
in any way (unless you autoload the defcustom, which is considered not
the best style around here).

So I guess some clarification is in order: what exactly was the
problem with that variable being "nonexistent"?




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 14 Dec 2022 13:38:02 GMT) Full text and rfc822 format available.

Message #41 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: dsmasterson <at> gmail.com, 59882 <at> debbugs.gnu.org, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, michel <at> schi.nz
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 13:37:07 +0000
Eli Zaretskii <eliz <at> gnu.org> writes:

>> I am asking because org-mouse.el advises some functions and its loading
>> may cause unexpected consequences. See
>> https://orgmode.org/list/87r0x6sju1.fsf <at> fastmail.fm
>
> I think org-mouse.el should be fixed not to cause such effects just by
> loading it.  It should do that only when it is actually used.

Yes, we plan to do exactly this https://orgmode.org/list/87zgbqqukg.fsf <at> localhost
However, it will be a breaking backward-incompatible change. And we have
similar issues with several important Org components (ol-* and ob-*). In
particular, ob-*.el packages affect Org simply by defining function
symbols with specific name patters (by ob-core.el design).

Achieving no side effects is difficult in practice.

Also, note that side effects are not uncommon in Elisp packages.
Including, built-ins, like rect.el.
dired+ comes to mind among popular third-party packages.

>> At the same time, we have users complaining about some defcustoms not
>> being available without loading.
>> https://orgmode.org/list/25496.19258.682537.503614 <at> gargle.gargle.HOWL
>
> That's too vague: it talks about "whether a variable exists", which is
> ambiguous.  That a variable is not boundp until its definition is
> loaded is perfectly expected, and I don't think defcustom changes that
> in any way (unless you autoload the defcustom, which is considered not
> the best style around here).
>
> So I guess some clarification is in order: what exactly was the
> problem with that variable being "nonexistent"?

Agree. See the quote below:
https://list.orgmode.org/orgmode/25497.41832.663858.836948 <at> gargle.gargle.HOWL/

    Like I said in another message that I sent just before receiving yours
    my conclusion came from the fact that hitting 'C-h v' with the cursor
    on 'org-goto-interface' provided nothing.  It was the first time this
    ever happened to me.  I did try to explicitly enter the variable's
    name by entering 'org-goto<TAB>', which (like 'org-go<TAB>') is not
    enough: it is completed to 'org--goto'.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 14 Dec 2022 14:26:02 GMT) Full text and rfc822 format available.

Message #44 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: dsmasterson <at> gmail.com, Ihor Radchenko <yantar92 <at> posteo.net>,
 emacs-orgmode <at> gnu.org, michel <at> schi.nz, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 09:25:17 -0500
>> On a related note, is it normal that package like org-mouse.el gets
>> loaded upon calling C-h f org-mouse- <TAB> completion prompt?

Yes.  See `help-enable-completion-autoload`.

>> I am asking because org-mouse.el advises some functions and its loading
>> may cause unexpected consequences. See
>> https://orgmode.org/list/87r0x6sju1.fsf <at> fastmail.fm
> I think org-mouse.el should be fixed not to cause such effects just by
> loading it.  It should do that only when it is actually used.

Exactly.  Merely loading a file should not affect Emacs's behavior in
any significant way.


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 14 Dec 2022 14:36:02 GMT) Full text and rfc822 format available.

Message #47 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Ihor Radchenko <yantar92 <at> posteo.net>
Cc: dsmasterson <at> gmail.com, Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 michel <at> schi.nz, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 09:35:32 -0500
> similar issues with several important Org components (ol-* and ob-*). In
> particular, ob-*.el packages affect Org simply by defining function
> symbols with specific name patters (by ob-core.el design).
> Achieving no side effects is difficult in practice.

That's true.  It can be a balancing act.

> Also, note that side effects are not uncommon in Elisp packages.
> Including, built-ins, like rect.el.
> dired+ comes to mind among popular third-party packages.

Most of them are plain bugs, tho (typically fixed by introducing an
autoloaded minor-mode, so the package is activated by enabling the
minor mode rather than by `require`ing the package).

>     Like I said in another message that I sent just before receiving yours
>     my conclusion came from the fact that hitting 'C-h v' with the cursor
>     on 'org-goto-interface' provided nothing.  It was the first time this
>     ever happened to me.  I did try to explicitly enter the variable's
>     name by entering 'org-goto<TAB>', which (like 'org-go<TAB>') is not
>     enough: it is completed to 'org--goto'.

AFAICT this is a missing feature: we obey `help-enable-autoload` in
`describe-function` but we fail to do the same autoloading dance in
`describe-variable`.


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 14 Dec 2022 16:04:01 GMT) Full text and rfc822 format available.

Message #50 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>,
 Ihor Radchenko <yantar92 <at> posteo.net>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 23:02:53 +0700
On 14/12/2022 21:35, Stefan Monnier wrote:
> 
>>      Like I said in another message that I sent just before receiving yours
>>      my conclusion came from the fact that hitting 'C-h v' with the cursor
>>      on 'org-goto-interface' provided nothing.  It was the first time this
>>      ever happened to me.  I did try to explicitly enter the variable's
>>      name by entering 'org-goto<TAB>', which (like 'org-go<TAB>') is not
>>      enough: it is completed to 'org--goto'.
> 
> AFAICT this is a missing feature: we obey `help-enable-autoload` in
> `describe-function` but we fail to do the same autoloading dance in
> `describe-variable`.

I think, the difference is interactive vs. non-interactive calls rather 
than `describe-function' vs. `describe-variable'. What misses this 
feature is `customize-variable'.

Completion failure for "org-to" happened because result of 
`register-definition-prefixes' calls is not considered as options. I am 
aware that it may give false positives, but I still believe they should 
be added.

Though I believe that org mixed version issue happens due to 
transitional dependency of some third party package on org or something 
like (require 'org-protocol) that can not be loaded on demand.





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 14 Dec 2022 21:50:02 GMT) Full text and rfc822 format available.

Message #53 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: "Cook, Malcolm" <MEC <at> stowers.org>
To: Ihor Radchenko <yantar92 <at> posteo.net>, Eli Zaretskii <eliz <at> gnu.org>
Cc: David Masterson <dsmasterson <at> gmail.com>,
 "emacs-orgmode <at> gnu.org" <emacs-orgmode <at> gnu.org>,
 "michel <at> schi.nz" <michel <at> schi.nz>,
 "59882 <at> debbugs.gnu.org" <59882 <at> debbugs.gnu.org>
Subject: RE: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 21:49:24 +0000
>On a related note, is it normal that package like org-mouse.el gets
>loaded upon calling C-h f org-mouse- <TAB> completion prompt?
>org-mouse.el does not contain a single autoload cookie.

There need not be which is apparently by design:

The autoload happens as a consequence of emacs' documented feature to [Autoload by Prefix](https://www.gnu.org/software/emacs/manual/html_node/elisp/Autoload-by-Prefix.html) 

Given that:

(equal (gethash "org-mouse-"  definition-prefixes) '("org-mouse"))






Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Thu, 15 Dec 2022 04:18:02 GMT) Full text and rfc822 format available.

Message #56 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Ihor Radchenko <yantar92 <at> posteo.net>, emacs-orgmode <at> gnu.org,
 Eli Zaretskii <eliz <at> gnu.org>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 14 Dec 2022 23:17:22 -0500
Max Nikulin [2022-12-14 23:02:53] wrote:
> On 14/12/2022 21:35, Stefan Monnier wrote:
>>>      Like I said in another message that I sent just before receiving yours
>>>      my conclusion came from the fact that hitting 'C-h v' with the cursor
>>>      on 'org-goto-interface' provided nothing.  It was the first time this
>>>      ever happened to me.  I did try to explicitly enter the variable's
>>>      name by entering 'org-goto<TAB>', which (like 'org-go<TAB>') is not
>>>      enough: it is completed to 'org--goto'.
>> AFAICT this is a missing feature: we obey `help-enable-autoload` in
>> `describe-function` but we fail to do the same autoloading dance in
>> `describe-variable`.
>
> I think, the difference is interactive vs. non-interactive calls rather than
> `describe-function' vs. `describe-variable'. What misses this feature is
> `customize-variable'.
>
> Completion failure for "org-to" happened because result of
> `register-definition-prefixes' calls is not considered as options. I am
> aware that it may give false positives, but I still believe they should
> be added.

I'm sorry, but I don't understand what you're saying.

> Though I believe that org mixed version issue happens due to transitional
> dependency of some third party package on org or something like (require
> 'org-protocol) that can not be loaded on demand.

Hmm... indeed the "Subject:" talks about mixed versions, yet I was
discussing something not directly related.  Looks like I got off-topic
somewhere along the way without noticing, sorry.


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Thu, 15 Dec 2022 04:57:01 GMT) Full text and rfc822 format available.

Message #59 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Max Nikulin <manikulin <at> gmail.com>, emacs-orgmode <at> gnu.org,
 Eli Zaretskii <eliz <at> gnu.org>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Thu, 15 Dec 2022 04:56:16 +0000
Stefan Monnier <monnier <at> iro.umontreal.ca> writes:

>> Though I believe that org mixed version issue happens due to transitional
>> dependency of some third party package on org or something like (require
>> 'org-protocol) that can not be loaded on demand.
>
> Hmm... indeed the "Subject:" talks about mixed versions, yet I was
> discussing something not directly related.  Looks like I got off-topic
> somewhere along the way without noticing, sorry.

And the off-topic is what has been CCed to Org mailing list :)

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 16 Dec 2022 12:37:02 GMT) Full text and rfc822 format available.

Message #62 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Ihor Radchenko <yantar92 <at> posteo.net>, emacs-orgmode <at> gnu.org,
 Eli Zaretskii <eliz <at> gnu.org>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 16 Dec 2022 19:36:18 +0700
On 15/12/2022 11:17, Stefan Monnier wrote:
> Max Nikulin [2022-12-14 23:02:53] wrote:
>> Completion failure for "org-to" happened because result of
>> `register-definition-prefixes' calls is not considered as options. I am
>> aware that it may give false positives, but I still believe they should
>> be added.
> 
> I'm sorry, but I don't understand what you're saying.

My bad. "org-go" is completed to "org--goto" while "org-goto-" is not 
offered. The latter might be a variant because "org-goto" is registered 
as an autoload prefix. Ihor kindly created https://debbugs.gnu.org/60085 
"`help-enable-autoload' is not fully obeyed", so it is better to discuss 
it there.

>> Though I believe that org mixed version issue happens due to transitional
>> dependency of some third party package on org or something like (require
>> 'org-protocol) that can not be loaded on demand.
> 
> Hmm... indeed the "Subject:" talks about mixed versions, yet I was
> discussing something not directly related.  Looks like I got off-topic
> somewhere along the way without noticing, sorry.

I have impression that there is no recipe how to reproduce this bug yet, 
just reports that people have faced it. So aspects of autoload may be 
considered as a part of brainstorm.

Other ideas when built-in Org version may be loaded too early:
- restoring previous session.
- user configured Org agenda as startup buffer.

Can it happen that already loaded version affects compilation of a new 
version by package-install.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 16 Dec 2022 14:48:02 GMT) Full text and rfc822 format available.

Message #65 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 16 Dec 2022 14:47:42 +0000
Max Nikulin <manikulin <at> gmail.com> writes:

> I have impression that there is no recipe how to reproduce this bug yet, 
> just reports that people have faced it. So aspects of autoload may be 
> considered as a part of brainstorm.
>
> Other ideas when built-in Org version may be loaded too early:
> - restoring previous session.
> - user configured Org agenda as startup buffer.
>
> Can it happen that already loaded version affects compilation of a new 
> version by package-install.

Yes. It is what appears to be happening:

https://irreal.org/blog/?p=10996
https://irreal.org/blog/?p=10999

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Sun, 18 Dec 2022 15:25:02 GMT) Full text and rfc822 format available.

Message #68 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: Ihor Radchenko <yantar92 <at> posteo.net>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Sun, 18 Dec 2022 22:24:24 +0700
On 16/12/2022 21:47, Ihor Radchenko wrote:
>> Can it happen that already loaded version affects compilation of a new
>> version by package-install.
> 
> Yes. It is what appears to be happening:
> 
> https://irreal.org/blog/?p=10996
> https://irreal.org/blog/?p=10999

I would not call it steps to reproduce.

From my point of view, there is a number of issues with updating of 
packages from emacs session.

1. If compilation of a package failed then it is not withdrawn from the 
load path.

2. There is no reliable way to determine if package compilation failed. 
(byte-recompile-directory DIR 0 t) returns human readable string, not 
signalling an error or returning a value convenient to check in the 
code. It is the cause of the previous issue.

3. Emacs package system is not ready for complex multifile packages 
containing macro definitions. It does not push user to update packages 
just after emacs restart in a clean state. As a result, files may be 
compiled with old or missed macro definitions.

4. Because of the item 2 a package has no chance to implement reliable 
internal sanity check that prevents updating to a broken state.

I have tried the following in Emacs-27. For Emacs >= 29 add -L to Org <= 
9.5.

- "emacs -l org" to simulate a regular user session with some opened files.
- Update to Org-9.6 from ELPA.
- Close emacs and start it again "emacs -l org"

Result:
byte-code: Invalid function: org-assert-version

Notice attempt to load Org-9.6 despite warnings and even error during 
update:

> Compiling file /home/emcs/.emacs.d/elpa/org-9.6/ob-C.el at Sun Dec 18 04:30:49 2022
> Entering directory ‘/home/emcs/.emacs.d/elpa/org-9.6/’
> 
> In end of data:
> ob-C.el:509:1:Warning: the function ‘org-assert-version’ is not known to be
>     defined. 
...
> Compiling file /home/emcs/.emacs.d/elpa/org-9.6/ob-matlab.el at Sun Dec 18 04:30:50 2022
> ob-matlab.el:43:1:Error: Symbol’s function definition is void: org-assert-version

So emacs can not handle update of a package with changed macro 
definitions when they reside in another package file.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Sun, 18 Dec 2022 15:41:01 GMT) Full text and rfc822 format available.

Message #71 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Ihor Radchenko <yantar92 <at> posteo.net>, emacs-orgmode <at> gnu.org,
 Eli Zaretskii <eliz <at> gnu.org>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Sun, 18 Dec 2022 10:40:39 -0500
> - "emacs -l org" to simulate a regular user session with some opened files.
> - Update to Org-9.6 from ELPA.
> - Close emacs and start it again "emacs -l org"
>
> Result:
> byte-code: Invalid function: org-assert-version

Hmm... there's code in `package.el` intended to avoid that problem, but
clearly it's failing here.  Could Someone™ investigate why that code
doesn't do its job.

The code in question is in `package--reload-previously-loaded` and
my understanding is that it should cause `org-macs` to be reloaded from
the Org-9.6 version of the code before the new code gets compiled, and
that new version does define the `org-assert-version` version, so those
macro calls should then be compiled correctly.

[ The approach used in `package--reload-previously-loaded` has its
  weaknesses, but AFAIK it *should* be able to avoid the above error.  ]


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Sun, 25 Dec 2022 09:50:02 GMT) Full text and rfc822 format available.

Message #74 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Sun, 25 Dec 2022 09:48:55 +0000
Max Nikulin <manikulin <at> gmail.com> writes:

> I have tried the following in Emacs-27. For Emacs >= 29 add -L to Org <= 
> 9.5.
>
> - "emacs -l org" to simulate a regular user session with some opened files.
> - Update to Org-9.6 from ELPA.
> - Close emacs and start it again "emacs -l org"
>
> Result:
> byte-code: Invalid function: org-assert-version

I tried to follow these steps, but unfortunately I am unable to
reproduce. Everything works fine using Emacs 27 on my side. Strange.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Sun, 25 Dec 2022 11:47:02 GMT) Full text and rfc822 format available.

Message #77 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: Ihor Radchenko <yantar92 <at> posteo.net>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Sun, 25 Dec 2022 18:46:37 +0700
On 18/12/2022 22:40, Stefan Monnier wrote:
> Could Someone™ investigate why that code
> doesn't do its job.
> 
> The code in question is in `package--reload-previously-loaded` and
> my understanding is that it should cause `org-macs` to be reloaded

I do not see obvious flaws in `package--reload-previously-loaded' code. 
My guess is that we get reports from users who have installed released 
versions of emacs.

Notice that my complain concerning failure `byte-recompile-directory', 
hidden from its caller, is still valid.

On 25/12/2022 16:48, Ihor Radchenko wrote:
> Max Nikulin writes:
> 
>> I have tried the following in Emacs-27. For Emacs >= 29 add -L to Org <=
>> 9.5.

Stefan convinced me that I was too optimistic concerning Emacs-29.

>> - "emacs -l org" to simulate a regular user session with some opened files.
>> - Update to Org-9.6 from ELPA.
>> - Close emacs and start it again "emacs -l org"
>>
>> Result:
>> byte-code: Invalid function: org-assert-version
> 
> I tried to follow these steps, but unfortunately I am unable to
> reproduce. Everything works fine using Emacs 27 on my side. Strange.

I tried it once more in a minimal LXC container with Ubuntu-22.04 LTS 
jammy. This time I even removed the elpa-org-9.5.2 system package, so 
built-in version of org is really used. So, emacs-27

- emacs -l org
- M-x list-packages RET
- / n org RET
- move cursor to org, install it
- i x y
- compilation buffers pops up with warning and errors.

Due to "-l org" some libraries like org, org-macs, ob are loaded. Files 
that `require' already loaded libraries generate warnings

Compiling file /home/emcs/.emacs.d/elpa/org-9.6/ob-R.el at Sun Dec 18 
04:30:49 2022

In end of data:
ob-R.el:562:1:Warning: the function ‘org-assert-version’ is not known to be
    defined.

because `org-assert-version' is defined in org-macs.el, but the old 
version without it is already loaded. Call to `org-assert-version' is 
just added to the .elc file.

E.g. org-keys.el produce the same warning. Another case is

Compiling file /home/emcs/.emacs.d/elpa/org-9.6/ob-matlab.el at Sun Dec 
18 04:30:50 2022
ob-matlab.el:43:1:Error: Symbol’s function definition is void: 
org-assert-version

This file contains "(require 'ob-octave)". Attempt of load new version 
of ob-octave fails because during execution of it contents causes an 
error due to the `org-assert-version' call.

In particular, compilation of org.el fails because the new version has 
new "(require 'org-fold)" and the latter also tries to call undefined 
`org-assert-version'.

So at this point we have partially compiled broken install. Some files 
are not compiled, others have call to `org-assert-version' instead of 
its expansion.

Let's try to start emacs again and load org. Since org.el is not 
compiled, "(org-assert-version)" inside it is unable to catch any 
problem due to mixed-version compilation. Now `org-release' returns new 
version. The failure happens during "(require 'org-keys)" that was 
compiled with the warning.

Debugger entered--Lisp error: (invalid-function org-assert-version)
  org-assert-version()
  byte-code("\300\301!\210\302 \210\300\303!\210\300\304!\207" [require 
org-macs org-assert-version cl-lib oc] 2)
  require(org-keys)

So we have an obscure load time error.  I would say that compile *error* 
messages are obscure as well because it is unclear that errors happen in 
`require'. E.g. when compiling org-matlab.el the reported line number is 
for "(require 'ob-maxima)" while compiling of ob.maxima.el finished with 
a warning, not an error and it is really confusing. "ob-octave:34:" in 
addition to "ob-matlab:43:" during compiling of ob-matlab.el would be 
more informative.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Mon, 26 Dec 2022 08:46:02 GMT) Full text and rfc822 format available.

Message #80 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Mon, 26 Dec 2022 08:44:55 +0000
Max Nikulin <manikulin <at> gmail.com> writes:

>> I tried to follow these steps, but unfortunately I am unable to
>> reproduce. Everything works fine using Emacs 27 on my side. Strange.
>
> I tried it once more in a minimal LXC container with Ubuntu-22.04 LTS 
> jammy. This time I even removed the elpa-org-9.5.2 system package, so 
> built-in version of org is really used. So, emacs-27
>
> - emacs -l org
> - M-x list-packages RET
> - / n org RET
> - move cursor to org, install it

On my side, it will give nothing useful: the package list is not updated
and I get:

Package org is built-in.

     Status: Built-In.
    Version: 9.4.4
    Summary: Export Framework for Org Mode

Detailed steps I tried (with package refresh) using with-emacs.sh [1]:

1. ~/Git/with-emacs.sh/with-emacs.sh -e emacs-27 -O -- -l org
2. M-x package-list-packages RET
3. C-s outline-based RET
4. RET
5. C-x o C-s instal RET
6. RET y
7. The warnings buffer appears, but only contains
   Warning (defvaralias): Overwriting value of ‘org-tab-first-hook’ by aliasing to ‘org-cycle-tab-first-hook’

[1] https://github.com/alphapapa/with-emacs.sh

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Mon, 26 Dec 2022 11:03:01 GMT) Full text and rfc822 format available.

Message #83 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Mon, 26 Dec 2022 11:01:59 +0000
Ihor Radchenko <yantar92 <at> posteo.net> writes:

> 1. ~/Git/with-emacs.sh/with-emacs.sh -e emacs-27 -O -- -l org

I was finally able to reproduce using emacs-26.

Maybe your Emacs 27 is older than mine? I have GNU Emacs 27.2

I also tried with Emacs 28. Not able to reproduce.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Mon, 26 Dec 2022 12:27:02 GMT) Full text and rfc822 format available.

Message #86 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: Ihor Radchenko <yantar92 <at> posteo.net>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Mon, 26 Dec 2022 19:25:49 +0700
On 26/12/2022 18:01, Ihor Radchenko wrote:
> Ihor Radchenko writes:
>> 1. ~/Git/with-emacs.sh/with-emacs.sh -e emacs-27 -O -- -l org
> I was finally able to reproduce using emacs-26.
> 
> Maybe your Emacs 27 is older than mine? I have GNU Emacs 27.2

Debian stable and Ubuntu LTS have Emacs-27.1 only, so I am testing 
1:27.1+1-3ubuntu5

Following the with-emacs.sh script I have tried

mkdir /tmp/emcs
emacs --quick --eval '(setq user-emacs-directory "/tmp/emcs/")' --eval 
'(setq user-init-file "/tmp/emcs/init.el")' -l package --eval '(setq 
package-user-dir "/tmp/emcs/elpa/")' --eval '(package-initialize)' 
--eval '(package-refresh-contents)' -l org

I had no problem to select Org-9.6 from the buffer generated by 
`list-packages'. Compilation errors and the error during next startup 
are the same as I reported before.

I found just single commit to lisp/emacs-lisp/package.el between 
emacs-27.1 and emacs-27.2:

1fc9de4b81c 2020-10-30 19:20:24 -0700 Glenn Morris: Improve 
reproducibility of generated -pkg.el files

So I am still surprised that you can not reproduce the issue.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Tue, 27 Dec 2022 09:48:02 GMT) Full text and rfc822 format available.

Message #89 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Tue, 27 Dec 2022 09:47:17 +0000
Max Nikulin <manikulin <at> gmail.com> writes:

> I found just single commit to lisp/emacs-lisp/package.el between 
> emacs-27.1 and emacs-27.2:
>
> 1fc9de4b81c 2020-10-30 19:20:24 -0700 Glenn Morris: Improve 
> reproducibility of generated -pkg.el files
>
> So I am still surprised that you can not reproduce the issue.

Can you then try to test using Emacs 28?
The main question if whether this has been fixed in newer Emacs releases
or it is also something to do with OS environment.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Tue, 27 Dec 2022 09:57:02 GMT) Full text and rfc822 format available.

Message #92 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: Ihor Radchenko <yantar92 <at> posteo.net>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Tue, 27 Dec 2022 16:56:31 +0700
On 27/12/2022 16:47, Ihor Radchenko wrote:
> Can you then try to test using Emacs 28?
> The main question if whether this has been fixed in newer Emacs releases
> or it is also something to do with OS environment.

I see quite the same issue with Emacs-28.2 in Debian testing. Compile 
buffer displays a bit more warnings and usual `org-assert-version' 
warnings and errors are present as well. It might have another level of 
complexity due to .eln files. I am unsure what happens with calls to 
undefined macros.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 03 Feb 2023 11:05:01 GMT) Full text and rfc822 format available.

Message #95 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: Eli Zaretskii <eliz <at> gnu.org>, emacs-orgmode <at> gnu.org,
 Stefan Monnier <monnier <at> iro.umontreal.ca>, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 03 Feb 2023 11:02:21 +0000
Max Nikulin <manikulin <at> gmail.com> writes:

> On 27/12/2022 16:47, Ihor Radchenko wrote:
>> Can you then try to test using Emacs 28?
>> The main question if whether this has been fixed in newer Emacs releases
>> or it is also something to do with OS environment.
>
> I see quite the same issue with Emacs-28.2 in Debian testing. Compile 
> buffer displays a bit more warnings and usual `org-assert-version' 
> warnings and errors are present as well. It might have another level of 
> complexity due to .eln files. I am unsure what happens with calls to 
> undefined macros.

I asked people around to test using Debian, and we do have a
confirmation that Debian + Emacs 27 and Debian + Emacs 28 do trigger the
error.

I also installed Debian 11.6.0 on virtual machine, and I was also able to
trigger the error, following the provided steps, using the Emacs 27
installed via apt-get.

The problem seems to be real and appears to be some combination of
Debian/Ubuntu + Emacs.

Considering the popularity of Debian-based distros, may someone take a
closer look on what may be going on? Since the latest Emacs release also
suffers from the problem, I am afraid that the issue will be present in
the coming Emacs 29 as well (I recall no related fixes in recent Emacs).

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 03 Feb 2023 12:17:02 GMT) Full text and rfc822 format available.

Message #98 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Ihor Radchenko <yantar92 <at> posteo.net>,
 Sean Whitton <spwhitton <at> spwhitton.name>, rlb <at> defaultvalue.org
Cc: manikulin <at> gmail.com, emacs-orgmode <at> gnu.org, monnier <at> iro.umontreal.ca,
 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 03 Feb 2023 14:15:52 +0200
> From: Ihor Radchenko <yantar92 <at> posteo.net>
> Cc: Stefan Monnier <monnier <at> iro.umontreal.ca>, emacs-orgmode <at> gnu.org, Eli
>  Zaretskii <eliz <at> gnu.org>, 59882 <at> debbugs.gnu.org
> Date: Fri, 03 Feb 2023 11:02:21 +0000
> 
> Considering the popularity of Debian-based distros, may someone take a
> closer look on what may be going on? Since the latest Emacs release also
> suffers from the problem, I am afraid that the issue will be present in
> the coming Emacs 29 as well (I recall no related fixes in recent Emacs).

I don't know enough about package.el's peculiarities, sorry.  And my
plate is too full ATM.  So I'm afraid someone else will have to
investigate this.  (I think Debian downstream maintainers are the
natural candidates, so I've taken the liberty of CC'ing them.)




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Tue, 14 Feb 2023 22:55:02 GMT) Full text and rfc822 format available.

Message #101 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Gregor Zattler <telegraph <at> gmx.net>
To: 59882 <at> debbugs.gnu.org, emacs-orgmode <at> gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Tue, 14 Feb 2023 23:53:48 +0100
Hi Tim, org-mode and emacs developers,
* Tim Cross <theophilusx <at> gmail.com> [2023-02-04; 07:01 +11]:
> Ihor Radchenko <yantar92 <at> posteo.net> writes:
>> Max Nikulin <manikulin <at> gmail.com> writes:
>>> On 27/12/2022 16:47, Ihor Radchenko wrote:
>>>> Can you then try to test using Emacs 28?
>>>> The main question if whether this has been fixed in newer Emacs releases
>>>> or it is also something to do with OS environment.
>>> I see quite the same issue with Emacs-28.2 in Debian testing. Compile
>>> buffer displays a bit more warnings and usual `org-assert-version'
>>> warnings and errors are present as well. It might have another level of
>>> complexity due to .eln files. I am unsure what happens with calls to
>>> undefined macros.
>>
>> I asked people around to test using Debian, and we do have a
>> confirmation that Debian + Emacs 27 and Debian + Emacs 28 do trigger the
>> error.
>>
>> I also installed Debian 11.6.0 on virtual machine, and I was also able to
>> trigger the error, following the provided steps, using the Emacs 27
>> installed via apt-get.
>>
>> The problem seems to be real and appears to be some combination of
>> Debian/Ubuntu + Emacs.
>>
>> Considering the popularity of Debian-based distros, may someone take a
>> closer look on what may be going on? Since the latest Emacs release also
>> suffers from the problem, I am afraid that the issue will be present in
>> the coming Emacs 29 as well (I recall no related fixes in recent Emacs).
>
> I don't run Debian or Ubuntu anymore. However, I do recall that debian
> does use a modified Emacs startup which is not part of the standard
> Emacs distribution. They do this to enable the ability to have multiple
> versions of Emacs installed at the same time.

that would be /usr/share/emacs/site-lisp/debian-startup.el


Ciao; Gregor
--
 -... --- .-. . -.. ..--.. ...-.-




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Thu, 16 Feb 2023 12:15:02 GMT) Full text and rfc822 format available.

Message #104 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: 59882 <at> debbugs.gnu.org, emacs-orgmode <at> gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Thu, 16 Feb 2023 19:14:40 +0700
On 15/02/2023 05:53, Gregor Zattler wrote:
> * Tim Cross [2023-02-04; 07:01 +11]:
>>
>> I don't run Debian or Ubuntu anymore. However, I do recall that debian
>> does use a modified Emacs startup which is not part of the standard
>> Emacs distribution. They do this to enable the ability to have multiple
>> versions of Emacs installed at the same time.
> 
> that would be /usr/share/emacs/site-lisp/debian-startup.el

This file should be ignored when Emacs is started with --quick (-Q) 
option, see
https://debbugs.gnu.org/cgi/bugreport.cgi?bug=59882#86

I have not checked patches that may be applied to Emacs core files.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Tue, 21 Feb 2023 05:23:02 GMT) Full text and rfc822 format available.

Message #107 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Richard Stallman <rms <at> gnu.org>
To: Max Nikulin <manikulin <at> gmail.com>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Tue, 21 Feb 2023 00:22:04 -0500
[[[ To any NSA and FBI agents reading my email: please consider    ]]]
[[[ whether defending the US Constitution against all enemies,     ]]]
[[[ foreign or domestic, requires you to follow Snowden's example. ]]]

  > >> I don't run Debian or Ubuntu anymore. However, I do recall that debian
  > >> does use a modified Emacs startup which is not part of the standard
  > >> Emacs distribution. They do this to enable the ability to have multiple
  > >> versions of Emacs installed at the same time.

Would we like to add a feature like that to Emacs?
I don't know how much work it would be, but I think
it would be a desirable change if it is easy.

-- 
Dr Richard Stallman (https://stallman.org)
Chief GNUisance of the GNU Project (https://gnu.org)
Founder, Free Software Foundation (https://fsf.org)
Internet Hall-of-Famer (https://internethalloffame.org)






Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Tue, 21 Feb 2023 12:33:02 GMT) Full text and rfc822 format available.

Message #110 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: rms <at> gnu.org
Cc: manikulin <at> gmail.com, emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Tue, 21 Feb 2023 14:32:39 +0200
> Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
> From: Richard Stallman <rms <at> gnu.org>
> Date: Tue, 21 Feb 2023 00:22:04 -0500
> 
>   > >> I don't run Debian or Ubuntu anymore. However, I do recall that debian
>   > >> does use a modified Emacs startup which is not part of the standard
>   > >> Emacs distribution. They do this to enable the ability to have multiple
>   > >> versions of Emacs installed at the same time.
> 
> Would we like to add a feature like that to Emacs?
> I don't know how much work it would be, but I think
> it would be a desirable change if it is easy.

I'm not sure I understand: feature like what?  If you are talking
about having several Emacs versions installed on the same system, then
I think we already support that: I use that all the time.  That's why
we install various files in version-specific directories.

If you mean something else, please elaborate.  (The bug discussion is
very long, and the above quote is from a tangent, so I'm not sure it's
worth my while reading all the discussion from the beginning trying to
understand what is being alluded to here.)




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Tue, 21 Feb 2023 17:28:02 GMT) Full text and rfc822 format available.

Message #113 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Bhavin Gandhi <bhavin7392 <at> gmail.com>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Tue, 21 Feb 2023 22:56:49 +0530
On Fri, 3 Feb 2023 at 16:35, Ihor Radchenko <yantar92 <at> posteo.net> wrote:
>
> Max Nikulin <manikulin <at> gmail.com> writes:
>
> > On 27/12/2022 16:47, Ihor Radchenko wrote:
> >> Can you then try to test using Emacs 28?
> >> The main question if whether this has been fixed in newer Emacs releases
> >> or it is also something to do with OS environment.
> >
> > I see quite the same issue with Emacs-28.2 in Debian testing. Compile
> > buffer displays a bit more warnings and usual `org-assert-version'
> > warnings and errors are present as well. It might have another level of
> > complexity due to .eln files. I am unsure what happens with calls to
> > undefined macros.
>
> I asked people around to test using Debian, and we do have a
> confirmation that Debian + Emacs 27 and Debian + Emacs 28 do trigger the
> error.
>
> I also installed Debian 11.6.0 on virtual machine, and I was also able to
> trigger the error, following the provided steps, using the Emacs 27
> installed via apt-get.
>
> The problem seems to be real and appears to be some combination of
> Debian/Ubuntu + Emacs.

I'm able to reproduce this on Fedora 37, Emacs 28.2.

In Fedora we have:
- /usr/share/emacs/site-lisp/site-start.el (has code to load .el and .elc
from /usr/share/emacs/site-lisp/site-start.d).
- /usr/share/emacs/site-lisp/default.el (sets smime-CA-directory).

There are other patches but most of them are backports and seem to be
unrelated to package.el:
https://src.fedoraproject.org/rpms/emacs/tree/rawhide

Steps using with-emacs.sh (https://github.com/alphapapa/with-emacs.sh):

1. mkdir /tmp/emacs-59882
2. with-emacs.sh -d /tmp/emacs-59882 -- -l org
3. M-x package-list-packages
4. Install Org 9.6.1 from ELPA
5. When the package is compiled you get this error at the end (it is
there multiple times)
   ox.el:82:1: Error: Symbol’s function definition is void: org-assert-version
6. Close Emacs and start it again with
   with-emacs.sh -d /tmp/emacs-59882 -- -l org
7. I get byte-code: Invalid function: org-assert-version

-- 
Bhavin Gandhi (bhavin192) | https://geeksocket.in




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 22 Feb 2023 10:48:02 GMT) Full text and rfc822 format available.

Message #116 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Bhavin Gandhi <bhavin7392 <at> gmail.com>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 22 Feb 2023 10:48:33 +0000
Bhavin Gandhi <bhavin7392 <at> gmail.com> writes:

> I'm able to reproduce this on Fedora 37, Emacs 28.2.
>
> In Fedora we have:
> - /usr/share/emacs/site-lisp/site-start.el (has code to load .el and .elc
> from /usr/share/emacs/site-lisp/site-start.d).
> - /usr/share/emacs/site-lisp/default.el (sets smime-CA-directory).

May I know what is the contents of
/usr/share/emacs/site-lisp/site-start.d ?

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 22 Feb 2023 17:00:02 GMT) Full text and rfc822 format available.

Message #119 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Bhavin Gandhi <bhavin7392 <at> gmail.com>
To: Ihor Radchenko <yantar92 <at> posteo.net>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Wed, 22 Feb 2023 22:28:45 +0530
On Wed, 22 Feb 2023 at 16:17, Ihor Radchenko <yantar92 <at> posteo.net> wrote:
>
> Bhavin Gandhi <bhavin7392 <at> gmail.com> writes:
>
> > I'm able to reproduce this on Fedora 37, Emacs 28.2.
> >
> > In Fedora we have:
> > - /usr/share/emacs/site-lisp/site-start.el (has code to load .el and .elc
> > from /usr/share/emacs/site-lisp/site-start.d).
> > - /usr/share/emacs/site-lisp/default.el (sets smime-CA-directory).
>
> May I know what is the contents of
> /usr/share/emacs/site-lisp/site-start.d ?

These are init files specific to other packages installed via OS package
manager. But those are not loaded, it seems in the above steps. I tried to
run (featurep 'clang-format) and it returned nil, while this returns t
in my normal Emacs instance.

$ ls -1 /usr/share/emacs/site-lisp/site-start.d/
autoconf-init.el
  https://src.fedoraproject.org/rpms/autoconf/blob/rawhide/f/autoconf-init.el
clang-format.el
clang-include-fixer.el
clang-rename.el
cmake-init.el
  https://src.fedoraproject.org/rpms/cmake/blob/rawhide/f/cmake-init.el
desktop-entry-mode-init.el
  https://src.fedoraproject.org/rpms/desktop-file-utils/blob/rawhide/f/desktop-entry-mode-init.el
gtypist-init.el
  https://src.fedoraproject.org/rpms/gtypist/blob/rawhide/f/gtypist.spec#_43-46
mercurial-site-start.el
  https://src.fedoraproject.org/rpms/mercurial/blob/rawhide/f/mercurial-site-start.el

None of these load org-mode.

--
Bhavin Gandhi (bhavin192) | https://geeksocket.in




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Thu, 23 Feb 2023 09:36:02 GMT) Full text and rfc822 format available.

Message #122 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Ihor Radchenko <yantar92 <at> posteo.net>
To: Bhavin Gandhi <bhavin7392 <at> gmail.com>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Thu, 23 Feb 2023 09:35:52 +0000
Bhavin Gandhi <bhavin7392 <at> gmail.com> writes:

> These are init files specific to other packages installed via OS package
> manager. But those are not loaded, it seems in the above steps. I tried to
> run (featurep 'clang-format) and it returned nil, while this returns t
> in my normal Emacs instance.
> ...
> None of these load org-mode.

They just define auto-loading, but I see not how they would affect Org
loading.

Very confusing...

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Thu, 06 Apr 2023 15:03:01 GMT) Full text and rfc822 format available.

Message #125 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: 59882 <at> debbugs.gnu.org
Cc: emacs-orgmode <at> gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Thu, 6 Apr 2023 22:02:06 +0700
On 03/02/2023 18:02, Ihor Radchenko wrote:
> 
> The problem seems to be real and appears to be some combination of
> Debian/Ubuntu + Emacs.

It is not a Debian packaging issue. I have reproduced the "invalid 
function `org-assert-version'" bug using emacs built from emacs-28.2 git 
tag. It is important to execute "make install" and to launch emacs from 
from that directory.

I have no idea why behavior is different when emacs is launched from the 
build tree.

Environment: Debian-12 bookworm (frozen testing).

There is no problem when emacs is built by just "make" from debian 
sources with all patches applied. I admit that this experiment was not 
really pure since I did not use configure options from the 
debian/control file.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Thu, 06 Apr 2023 16:10:01 GMT) Full text and rfc822 format available.

Message #128 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Thu, 6 Apr 2023 23:09:13 +0700
On 18/12/2022 22:40, Stefan Monnier via Bug reports for GNU Emacs, the 
Swiss army knife of text editors wrote:
>> - "emacs -l org" to simulate a regular user session with some opened files.
>> - Update to Org-9.6 from ELPA.
>> - Close emacs and start it again "emacs -l org"
>>
>> Result:
>> byte-code: Invalid function: org-assert-version
> 
> Hmm... there's code in `package.el` intended to avoid that problem, but
> clearly it's failing here.  Could Someone™ investigate why that code
> doesn't do its job.
> 
> The code in question is in `package--reload-previously-loaded`

Since I managed to reproduce the issue with emacs-28.2 built from source 
tree, I tried current master (30.0.50) as well. I used the following 
trick to shadow org-assert-version:

sed -i -e 's/org-assert-version/org-assert-version-old/g' lisp/org/*.el

I am unable to reproduce the "Invalid function: org-assert-version" 
issue. Org compilation finishes without warnings.

I have noticed that neither `package--reload-previously-loaded` nor code 
loading already compiled package unload the loaddefs file. E.g. I added 
org-stale-function marked as autoload. It is possible to get help for 
this function, but attempts to call this function causes "Autoloading 
file" error. Ideally emacs should completely forget about such functions 
when newer elpa package is installed.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Thu, 06 Apr 2023 21:26:01 GMT) Full text and rfc822 format available.

Message #131 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: emacs-orgmode <at> gnu.org
Cc: 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Thu, 06 Apr 2023 17:25:08 -0400
> I have noticed that neither `package--reload-previously-loaded` nor code
> loading already compiled package unload the loaddefs file. E.g. I added

The state of our unloading support is not good enough to use it blindly,
indeed: it's too easy/common to have packages where `unload` leaves you
with an Emacs that has serious problems (including being unusable).

So, instead we limit ourselves to force-reloading files which tends to
be much more harmless (tho in theory of course it's just as bad).
It also tends to be sufficient.


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Fri, 07 Apr 2023 11:40:01 GMT) Full text and rfc822 format available.

Message #134 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Max Nikulin <manikulin <at> gmail.com>
To: 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Fri, 7 Apr 2023 18:39:01 +0700
On 06/04/2023 22:02, Max Nikulin wrote:
> It is not a Debian packaging issue. I have reproduced the "invalid 
> function `org-assert-version'" bug using emacs built from emacs-28.2 git 
> tag. It is important to execute "make install" and to launch emacs from 
> from that directory.
> 
> I have no idea why behavior is different when emacs is launched from the 
> build tree.

When installed, built-in Org contains .elc and .el.gz files, but not .el 
ones. When uncompressed source .el files are present in 
$prefix/share/emacs-28.2/lisp/org (gunzip --keep *.el.gz) then the Org 
ELPA package compiles without warnings and errors related to 
`org-assert-version' (There is still a single warning though that does 
not lead to later failure during loading).

It seems new .el files are ignored when built-in directory contains no 
.el files. Definitions from the built-in .elc files are used during 
compilation in such case.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#59882; Package emacs. (Wed, 19 Apr 2023 04:22:02 GMT) Full text and rfc822 format available.

Message #137 received at 59882 <at> debbugs.gnu.org (full text, mbox):

From: Tom Gillespie <tgbugs <at> gmail.com>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: emacs-orgmode <at> gnu.org, 59882 <at> debbugs.gnu.org
Subject: Re: bug#59882: Multiple versions of Org in load-path problem
Date: Tue, 18 Apr 2023 21:20:54 -0700
> The state of our unloading support is not good enough to use it blindly

I have managed to use unload-feature to reload a new version of org
after the builtin version has been previously loaded, but the dance you
have to do to avoid nasty errors (and segfaults if using native comp!)
is about 100 lines of arcane footwork, and if any one step is off you
will encounter one of the many hidden landmines.

unload-feature cannot be used blindly, and there are a very large
number of side effects along the path that are not controlled which
makes any process that tries to use unload-feature brittle and hard
to debug.

https://github.com/tgbugs/orgstrap/blob/f35bccde556b0f82515e79ee69f4379469276356/ow.el#L1010-L1064
https://github.com/tgbugs/orgstrap/blob/f35bccde556b0f82515e79ee69f4379469276356/ow.el#L1073-L1177




This bug report was last modified 2 years and 57 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.