GNU bug report logs - #65010
[PATCH 0/8] Misc Python build system improvements

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 65010 in the body.
You can then email your comments to 65010 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Lars-Dominik Braun <lars <at> 6xq.net>
To: guix-patches <at> gnu.org
Subject: [PATCH 0/8] Misc Python build system improvements
Date: Wed, 2 Aug 2023 12:37:57 +0200

[Message part 1 (text/plain, inline)]

Hi,

the attached patches contain various Python build system improvements
including an original TOML parser (which may be used by other build
systems and importers in the future too) and fixes for #62781 and #63044.
I’m also pushing the patches to the pyproject-toml branch. As always,
a world rebuild is required.

Cheers,
Lars

Lars-Dominik Braun (8):
  build-system/pyproject: Use python-sans-pip-wrapper as default-python.
  build-system/python: Ignore symlinks when changing mtime.
  gnu: criu: Change file mtimes to fix build.
  gnu: sssd: Change file mtimes to fix build.
  guix: toml: Add TOML parser.
  build-system/pyproject: Use TOML parser.
  gnu: python-pytest-xdist: Disable failing test.
  guix: pyproject-build-system: Default configure-flags to empty
    dictionary.

 Makefile.am                           |   2 +
 gnu/packages/admin.scm                |   2 +-
 gnu/packages/astronomy.scm            |  81 +++--
 gnu/packages/bioinformatics.scm       |  79 +++--
 gnu/packages/bootloaders.scm          |   3 +
 gnu/packages/build-tools.scm          |  10 +-
 gnu/packages/check.scm                |  14 +-
 gnu/packages/databases.scm            |  12 +-
 gnu/packages/digest.scm               |   2 +-
 gnu/packages/engineering.scm          |   2 +-
 gnu/packages/fontutils.scm            |   9 +-
 gnu/packages/geo.scm                  |  10 +-
 gnu/packages/graph.scm                |   7 +-
 gnu/packages/graphviz.scm             |   4 +-
 gnu/packages/license.scm              |   5 +-
 gnu/packages/machine-learning.scm     |  32 +-
 gnu/packages/maths.scm                |   4 +-
 gnu/packages/monitoring.scm           |   2 +-
 gnu/packages/package-management.scm   |   6 +-
 gnu/packages/potassco.scm             |  10 +-
 gnu/packages/protobuf.scm             |   4 +-
 gnu/packages/python-build.scm         |  33 +-
 gnu/packages/python-check.scm         |  30 +-
 gnu/packages/python-compression.scm   |  20 +-
 gnu/packages/python-crypto.scm        |  15 +-
 gnu/packages/python-science.scm       |  24 +-
 gnu/packages/python-web.scm           |  57 ++-
 gnu/packages/python-xyz.scm           | 260 +++++++++-----
 gnu/packages/qt.scm                   |   3 +-
 gnu/packages/rpc.scm                  |   2 +-
 gnu/packages/serialization.scm        |   4 +-
 gnu/packages/sphinx.scm               |   4 +-
 gnu/packages/sssd.scm                 |   9 +-
 gnu/packages/statistics.scm           |  14 +-
 gnu/packages/terminals.scm            |   5 +-
 gnu/packages/time.scm                 |   3 +-
 gnu/packages/tor.scm                  |   4 +-
 gnu/packages/tree-sitter.scm          |   4 +-
 gnu/packages/video.scm                |   2 +-
 gnu/packages/vim.scm                  |   4 +-
 gnu/packages/virtualization.scm       |  20 +-
 guix/build-system/pyproject.scm       |  12 +-
 guix/build/pyproject-build-system.scm |  56 +--
 guix/build/python-build-system.scm    |   4 +-
 guix/build/toml.scm                   | 478 ++++++++++++++++++++++++++
 tests/toml.scm                        | 442 ++++++++++++++++++++++++
 46 files changed, 1503 insertions(+), 306 deletions(-)
 create mode 100644 guix/build/toml.scm
 create mode 100644 tests/toml.scm


base-commit: 5aceacac65784bd2e1fd12304f965ae6026de49d
-- 
2.41.0

[0001-build-system-pyproject-Use-python-sans-pip-wrapper-a.patch (text/plain, attachment)]

[0002-build-system-python-Ignore-symlinks-when-changing-mt.patch (text/plain, attachment)]

[0003-gnu-criu-Change-file-mtimes-to-fix-build.patch (text/plain, attachment)]

[0004-gnu-sssd-Change-file-mtimes-to-fix-build.patch (text/plain, attachment)]

[0005-guix-toml-Add-TOML-parser.patch (text/plain, attachment)]

[0006-build-system-pyproject-Use-TOML-parser.patch (text/plain, attachment)]

[0007-gnu-python-pytest-xdist-Disable-failing-test.patch (text/plain, attachment)]

[0008-guix-pyproject-build-system-Default-configure-flags-.patch (text/plain, attachment)]

Message #8 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Sharlatan Hellseher <sharlatanus <at> gmail.com>
To: 65010 <at> debbugs.gnu.org
Date: Thu, 7 Sep 2023 22:55:29 +0100

Hi,

Based on a cover letter it provides more patches in series, was everything sent?

-- 
… наш разум - превосходная объяснительная машина которая способна
найти смысл почти в чем угодно, истолковать любой феномен, но
совершенно не в состоянии принять мысль о непредсказуемости.

Message #11 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Marius Bakke <marius <at> gnu.org>
To: Lars-Dominik Braun <lars <at> 6xq.net>, 65010 <at> debbugs.gnu.org
Cc: jgart <at> dismail.de
Subject: Re: [bug#65010] [PATCH 0/8] Misc Python build system improvements
Date: Fri, 22 Sep 2023 12:01:57 +0800

[Message part 1 (text/plain, inline)]

Lars-Dominik Braun <lars <at> 6xq.net> skriver:

> Hi,
>
> the attached patches contain various Python build system improvements
> including an original TOML parser (which may be used by other build
> systems and importers in the future too) and fixes for #62781 and #63044.
> I’m also pushing the patches to the pyproject-toml branch. As always,
> a world rebuild is required.

Hi Lars!

> Lars-Dominik Braun (8):
>   build-system/pyproject: Use python-sans-pip-wrapper as default-python.
>   build-system/python: Ignore symlinks when changing mtime.
>   gnu: criu: Change file mtimes to fix build.
>   gnu: sssd: Change file mtimes to fix build.
>   guix: toml: Add TOML parser.
>   build-system/pyproject: Use TOML parser.
>   gnu: python-pytest-xdist: Disable failing test.
>   guix: pyproject-build-system: Default configure-flags to empty
>     dictionary.

I read through these patches and they LGTM overall.  Some individual
comments follow.

>>From 70baccd8068f35ff8dce0955eaea60f7ea9c240e Mon Sep 17 00:00:00 2001
> Message-ID: <70baccd8068f35ff8dce0955eaea60f7ea9c240e.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Thu, 11 May 2023 08:33:02 +0200
> Subject: [PATCH 1/8] build-system/pyproject: Use python-sans-pip-wrapper as
>  default-python.
>
> Also adds python-setuptools and python-wheel to relevant packages,
> either to native-inputs or to propagated inputs if the pkg_resources
> Python module is loaded at runtime.
>
> * guix/build-system/pyproject.scm (default-python): Default to
> python-sans-pip-wrapper.

This change makes sense.  Using a 'python-toolchain' by default was a
mistake, a quite expensive one by the diff.  Sorry about that, and
thanks for fixing it.

As you noted elsewhere (and for those following along at home): this is
necessary to solve a cycle at the root of the Python package graph.  It
also is more "correct" in that there are no surprising or hidden inputs.

[...thinking while typing...]

About 'wheel': that package *is* actually required by the build system
(as opposed to pypa-build!): I think we should make it available by
default (e.g. with a #:wheel argument), or propagate it from the build
systems.  It makes no sense to add it to _all_ pyproject-build-system
consumers.

WDYT?

[...]

>>From f4697d0da0018e66ae759a9495a82f364cad5ccd Mon Sep 17 00:00:00 2001
> Message-ID: <f4697d0da0018e66ae759a9495a82f364cad5ccd.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Sat, 13 May 2023 15:31:06 +0200
> Subject: [PATCH 2/8] build-system/python: Ignore symlinks when changing mtime.
>
> * guix/build/python-build-system.scm (ensure-no-mtimes-pre-1980): Ignore
> 'symlink.

LGTM.

>>From a0d4c891e6cf3522c6769e82d888d906445363f5 Mon Sep 17 00:00:00 2001
> Message-ID: <a0d4c891e6cf3522c6769e82d888d906445363f5.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Sat, 13 May 2023 15:31:22 +0200
> Subject: [PATCH 3/8] gnu: criu: Change file mtimes to fix build.

This commit title is weird.  The build is already working, but using a
workaround that is no longer needed.

> * gnu/packages/virtualization.scm (criu)[arguments]: Add
> python-build-system to #:modules and #:imported modules, add phase
> 'ensure-no-mtimes-pre-1980.

LGTM.

>>From 824c6ea30573c3a02f33058bd1739be4cd980da2 Mon Sep 17 00:00:00 2001
> Message-ID: <824c6ea30573c3a02f33058bd1739be4cd980da2.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Sat, 13 May 2023 16:20:23 +0200
> Subject: [PATCH 4/8] gnu: sssd: Change file mtimes to fix build.
>
> * gnu/packages/sssd.scm (sssd)[arguments]: Add
> python-build-system to #:modules and #:imported modules, add phase
> 'ensure-no-mtimes-pre-1980.

Ditto.

>>From 72d66e838ce9d3d2182c570ee3088063e372fcdd Mon Sep 17 00:00:00 2001
> Message-ID: <72d66e838ce9d3d2182c570ee3088063e372fcdd.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Sun, 23 Jul 2023 11:20:03 +0200
> Subject: [PATCH 5/8] guix: toml: Add TOML parser.
>
> * guix/build/toml.scm: New file.
> * tests/toml.scm: New file.
> * Makefile.am: Register new files.
> ---
>  Makefile.am         |   2 +
>  guix/build/toml.scm | 478 ++++++++++++++++++++++++++++++++++++++++++++
>  tests/toml.scm      | 442 ++++++++++++++++++++++++++++++++++++++++

Woow, amazing work, and I'm surprised it's less than 500 lines!

I haven't studied it in detail, but on the surface LGTM.

>>From 8e079b48b7c07c07360db8eb6305e8044d86dd87 Mon Sep 17 00:00:00 2001
> Message-ID: <8e079b48b7c07c07360db8eb6305e8044d86dd87.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Sun, 23 Jul 2023 11:22:03 +0200
> Subject: [PATCH 6/8] build-system/pyproject: Use TOML parser.
>
> More reliable than regular expressions.
>
> * guix/build-system/pyproject.scm (%pyproject-build-system-modules): Add (guix build toml).
> (pyproject-build): Add argument #:backend-path.
> * guix/build/pyproject-build-system.scm (build): Add support for
> auto-detected and override backend-path.
> * gnu/packages/python-build.scm (python-tomli)[arguments]: Remove
> 'add-self-to-path, because it is not necessary any more.
> (python-poetry-core): Same.
> (python-hatchling): Same.
> (python-pdm-backend): Same.
> ---
>  gnu/packages/python-build.scm         | 30 ++------------
>  guix/build-system/pyproject.scm       |  3 ++
>  guix/build/pyproject-build-system.scm | 56 +++++++++++++++------------
>  3 files changed, 39 insertions(+), 50 deletions(-)

LGTM...

[...]

> diff --git a/guix/build-system/pyproject.scm b/guix/build-system/pyproject.scm
> index 94b9d79692..585117cbf0 100644
> --- a/guix/build-system/pyproject.scm
> +++ b/guix/build-system/pyproject.scm
> @@ -46,6 +46,7 @@ (define %pyproject-build-system-modules
>    ;; Build-side modules imported by default.
>    `((guix build pyproject-build-system)
>      (guix build json)
> +    (guix build toml)
>      ,@%python-build-system-modules))
>  
>  (define (default-python)
> @@ -93,6 +94,7 @@ (define* (pyproject-build name inputs
>                            #:key source
>                            (tests? #t)
>                            (configure-flags ''())
> +                          (backend-path #f)
>                            (build-backend #f)
>                            (test-backend #f)
>                            (test-flags ''())
> @@ -116,6 +118,7 @@ (define* (pyproject-build name inputs
>                   #:source #+source
>                   #:configure-flags #$configure-flags
>                   #:system #$system
> +                 #:backend-path #$backend-path
>                   #:build-backend #$build-backend
>                   #:test-backend #$test-backend
>                   #:test-flags #$test-flags
> diff --git a/guix/build/pyproject-build-system.scm b/guix/build/pyproject-build-system.scm
> index c69ccc9d64..a1919eacf6 100644
> --- a/guix/build/pyproject-build-system.scm
> +++ b/guix/build/pyproject-build-system.scm
> @@ -21,11 +21,13 @@ (define-module (guix build pyproject-build-system)
>    #:use-module ((guix build python-build-system) #:prefix python:)
>    #:use-module (guix build utils)
>    #:use-module (guix build json)
> +  #:use-module (guix build toml)
>    #:use-module (ice-9 match)
>    #:use-module (ice-9 ftw)
>    #:use-module (ice-9 format)
>    #:use-module (ice-9 rdelim)
>    #:use-module (ice-9 regex)
> +  #:use-module (ice-9 textual-ports)

This import seems unused?

>    #:use-module (srfi srfi-1)
>    #:use-module (srfi srfi-26)
>    #:use-module (srfi srfi-34)
> @@ -60,8 +62,8 @@ (define-module (guix build pyproject-build-system)
>  ;;; wheel and expected to be created by the installing utility.
>  ;;; TODO: Add support for PEP-621 entry points.
>  ;;;
> -;;; Caveats:
> -;;; - There is no support for in-tree build backends.
> +;;; This module also supports in-tree build backends, which can be
> +;;; overridden by #:backend-path.

Perhaps this should also be documented in the manual.

>>From e987a9e28ec0d8d1b8ecdb2486eb12eae270a49d Mon Sep 17 00:00:00 2001
> Message-ID: <e987a9e28ec0d8d1b8ecdb2486eb12eae270a49d.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Tue, 25 Jul 2023 18:26:58 +0200
> Subject: [PATCH 7/8] gnu: python-pytest-xdist: Disable failing test.
>
> * gnu/packages/check.scm (python-pytest-xdist)[arguments]: Skip failing
> test.

OK.

>>From b3726639df72aa3943d8e403e3c2b9a6cde05421 Mon Sep 17 00:00:00 2001
> Message-ID: <b3726639df72aa3943d8e403e3c2b9a6cde05421.1690972374.git.lars <at> 6xq.net>
> In-Reply-To: <cover.1690972374.git.lars <at> 6xq.net>
> References: <cover.1690972374.git.lars <at> 6xq.net>
> From: Lars-Dominik Braun <lars <at> 6xq.net>
> Date: Sun, 30 Jul 2023 13:36:37 +0200
> Subject: [PATCH 8/8] guix: pyproject-build-system: Default configure-flags to
>  empty dictionary.
>
> PEP 517 specifies it should be a dictionary and thus meson-python cannot
> handle an empty list.
>
> Fixes: <https://issues.guix.gnu.org/62781>
> ---
>  gnu/packages/build-tools.scm    | 10 ++--------
>  gnu/packages/python-science.scm |  5 -----
>  guix/build-system/pyproject.scm |  2 +-
>  3 files changed, 3 insertions(+), 14 deletions(-)

The commit message lacks a mention of the changed variables.

[...]

> diff --git a/guix/build-system/pyproject.scm b/guix/build-system/pyproject.scm
> index 585117cbf0..c0e089eac7 100644
> --- a/guix/build-system/pyproject.scm
> +++ b/guix/build-system/pyproject.scm
> @@ -93,7 +93,7 @@ (define* (lower name
>  (define* (pyproject-build name inputs
>                            #:key source
>                            (tests? #t)
> -                          (configure-flags ''())
> +                          (configure-flags ''(@))

I don't understand how the @ makes it a dictionary.  Can you enlighten
me?  Either here, or in a comment?  :-)

LGTM anyway!

Let's get these merged in the 'python-team' branch.  WDYT jgart?

[signature.asc (application/pgp-signature, inline)]

Message #14 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Lars-Dominik Braun <lars <at> 6xq.net>
To: Marius Bakke <marius <at> gnu.org>
Cc: jgart <at> dismail.de, 65010 <at> debbugs.gnu.org
Subject: Re: [bug#65010] [PATCH 0/8] Misc Python build system improvements
Date: Sat, 23 Sep 2023 08:31:47 +0200

Hi Marius,

> About 'wheel': that package *is* actually required by the build system
> (as opposed to pypa-build!): I think we should make it available by
> default (e.g. with a #:wheel argument), or propagate it from the build
> systems.  It makes no sense to add it to _all_ pyproject-build-system
> consumers.

it’s not added to all of them. After submitting this patch I realized
it’s actually a dependency of setuptools (bdist_wheel), which otherwise
cannot create wheels. Other backends afaik have their own method of
building wheels or depend on a wheel-generating library. So it might
make sense to add python-wheel as a propagated input to
python-setuptools. I didn’t have time to try it yet though.

> This commit title is weird.  The build is already working, but using a
> workaround that is no longer needed.

Probably a leftover from all the rebasing.

> > +  #:use-module (ice-9 textual-ports)
> This import seems unused?

Yeah, possibly a leftover from previous experiments.

> Perhaps this should also be documented in the manual.

Indeed. I didn’t know we had separate documentation in the manual.

> > -                          (configure-flags ''())
> > +                          (configure-flags ''(@))
> 
> I don't understand how the @ makes it a dictionary.  Can you enlighten
> me?  Either here, or in a comment?  :-)

It’s an implementation detail of our JSON library. The configure-flags
are directly passed to it.

Lars

Message #17 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: 65010 <at> debbugs.gnu.org
Cc: Lars-Dominik Braun <lars <at> 6xq.net>
Subject: [PATCH 0/8] Misc Python build system improvements
Date: Sat, 10 Feb 2024 13:15:04 +0100

I’m currently in the process of reviving the python-team branch.  I’d
like to pull in a few upgrades to Python science packages, and I think
this patch series should also be part of the branch.

Lars, do you have a final version of this patch series that we could
merge into the python-team branch?  It looks like apart from very minor
issues this is ready.

-- 
Ricardo

Message #20 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Lars-Dominik Braun <lars <at> 6xq.net>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: 65010 <at> debbugs.gnu.org
Subject: Re: [PATCH 0/8] Misc Python build system improvements
Date: Fri, 16 Feb 2024 07:50:01 +0100

Hi,

> Lars, do you have a final version of this patch series that we could
> merge into the python-team branch?  It looks like apart from very minor
> issues this is ready.

I’m rebasing the changes right now, will look through Marius’ comments
and send an updated patch series.

Lars

Message #23 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Lars-Dominik Braun <lars <at> 6xq.net>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: 65010 <at> debbugs.gnu.org, Marius Bakke <marius <at> gnu.org>
Subject: Re: [PATCH 0/8] Misc Python build system improvements
Date: Fri, 16 Feb 2024 13:38:51 +0100

Hi again,

> Lars, do you have a final version of this patch series that we could
> merge into the python-team branch?  It looks like apart from very minor
> issues this is ready.

as you suggested I pushed the updated version to the python-team branch,
deleting my own pyproject-toml branch.

Unfortunately the python-setuptools/python-wheel situation is not
easily resolvable, since – contrary to my initial assumption –
python-setuptools does not depend on python-wheel, but rather the latter
extends the former and is only required when using setuptools, but not
for other build backends like flit or poetry. Therefore I kept my
changes as-is, adding python-setuptools and python-wheel to
native-inputs/propagated-inputs where needed. Not pretty, but that’s
PEP 517 in a nutshell.

Since it’s been a while and more packages have been migrated to use
pyproject-build-system this will probably break a few packages, which
do not have these two packages added yet. We’ll have to wait for
https://ci.guix.gnu.org/eval/1123219 to finish to assess the damage
done. There are two possible failure modes:

1) Build-time failure: Usually the build will complain about setuptools
not being found. That’s an easy fix, just add setuptools and wheel to
the native-inputs.
2) Run-time failure: The deprecated but still heavily used pkg_resources
is missing during runtime, because it’s part of setuptools. This one
is harder to detect, but once all packages have been built we should
`grep` for pkg_resources and figure out which of the consumers don’t
propagate python-setuptools.

Cheers,
Lars

Message #26 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: jgart <jgart <at> dismail.de>
To: 65010 <at> debbugs.gnu.org
Cc: Ricardo Wurmus <rekado <at> elephly.net>,
 Sharlatan Hellseher <sharlatanus <at> gmail.com>, Lars-Dominik Braun <lars <at> 6xq.net>,
 Marius Bakke <marius <at> gnu.org>
Subject: Re: [PATCH 0/8] Misc Python build system improvements
Date: Tue, 14 Jan 2025 12:47:06 -0600

Hi,

I've seen recently that there are a lot of Python packages that fail
because both, python-setuptools and python-wheel is missing from the
native-inputs.

I just wanted to see if someone can bring me up to date on what we are
doing about that. I am not caught up on the latest efforts.

Will pyproject-build-system include the above mentioned dependencies
conditionally somehow or do we need to be including python-setuptools
and python-wheel for each package that needs it?
-- 
all the best,
jgart

Message #29 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Sharlatan Hellseher <sharlatanus <at> gmail.com>
To: 65010 <at> debbugs.gnu.org
Cc: jgart <jgart <at> dismail.de>
Subject: [PATCH 0/8] Misc Python build system improvements
Date: Tue, 14 Jan 2025 20:36:33 +0000

[Message part 1 (text/plain, inline)]

Hi jgart,

It happens because python-build-system does not provide any base Python
build backend by default now, which is bundled in python-build-system,
it's more flexible when we need to update or add a new version of
python-setuptools for example or when the project does not need
setuptools at all and requires some other build backend.

Python ecosystem does not follow any particular standard when it
concerns packaging or package management so we have a collection of any
potential build back end packaged in python-build module.

Build back end is specified in pyproject.toml in modern Python proejcts
which is captured by the pypi import now, but for any packaged packaged
before #65010 was merged the build back end might be missing - that is
the main reason of issue.

The simplest solution - check pyproject.toml, setup.cf, setup.py for any
reference of expected build backend (flit-core, hatcling, pdm-backend,
poetry-core, setuptools) and add it to native-inputs of failing package.

Example:
--8<---------------cut here---------------start------------->8---
[build-system]
requires = ["setuptools",
            "setuptools_scm>=6.2",
            "cython>=3.0.0, <4",
            "numpy>=2.0.0, <3",
            "extension-helpers>=1,<2"]
build-backend = "setuptools.build_meta"
--8<---------------cut here---------------end--------------->8---
<https://raw.githubusercontent.com/astropy/astropy/refs/heads/main/pyproject.toml>

Most of the major packages were fixed on python-team branch which is
next to be merged <https://issues.guix.gnu.org/75246>.

--
Oleg

[signature.asc (application/pgp-signature, inline)]

Message #32 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: "jgart" <jgart <at> dismail.de>
To: "Sharlatan Hellseher" <sharlatanus <at> gmail.com>, 65010 <at> debbugs.gnu.org
Subject: Re: [PATCH 0/8] Misc Python build system improvements
Date: Tue, 14 Jan 2025 23:08:04 +0000

[Message part 1 (text/plain, inline)]

> check pyproject.toml, setup.cf, setup.py for anyreference of expected build backend (flit-core, hatcling, pdm-backend, poetry-core, setuptools) and add it to native-inputs of failing package.

Hi Sharlatan, 

Thanks for the reply and information.

Should we refactor to have a pyproject-build-system/setuptools, pyproject-build-system/poetry-core, pyproject-build-system/flit-core, pyproject-build-system/hatchling, etc abstractions in the future or something else?

all best,

jgart

[Message part 2 (text/html, inline)]

Message #35 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: jgart <jgart <at> dismail.de>
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Lars-Dominik Braun <lars <at> 6xq.net>, 65010 <at> debbugs.gnu.org,
 Marius Bakke <marius <at> gnu.org>
Subject: Re: [PATCH 0/8] Misc Python build system improvements
Date: Wed, 15 Jan 2025 13:21:08 +0100

jgart <jgart <at> dismail.de> writes:

> I've seen recently that there are a lot of Python packages that fail
> because both, python-setuptools and python-wheel is missing from the
> native-inputs.

See our work on the python-team branch.

-- 
Ricardo

Message #38 received at 65010 <at> debbugs.gnu.org (full text, mbox):

From: "jgart" <jgart <at> dismail.de>
To: "Ricardo Wurmus" <rekado <at> elephly.net>
Cc: Sharlatan 
 Hellseher <sharlatanus <at> gmail.com>, Lars-Dominik Braun <lars <at> 6xq.net>,
 65010 <at> debbugs.gnu.org, Marius Bakke <marius <at> gnu.org>
Subject: Re: [PATCH 0/8] Misc Python build system improvements
Date: Wed, 15 Jan 2025 14:51:22 +0000

[Message part 1 (text/plain, inline)]

> 
> See our work on the python-team branch.
> 
Yep, I noticed yesterday after doing some reading on that branch. Thanks!

[Message part 2 (text/html, inline)]

Message #43 received at 65010-done <at> debbugs.gnu.org (full text, mbox):

From: Sharlatan Hellseher <sharlatanus <at> gmail.com>
To: 65010-done <at> debbugs.gnu.org
Subject: [PATCH 0/8] Misc Python build system improvements
Date: Sun, 4 May 2025 20:09:57 +0100

[Message part 1 (text/plain, inline)]

Hi,

This is already in master, closing.


VCS: https://github.incerto.xyz/; https://git.sr.ht/~hellseher/
GPG: 9847 81DE 689C 21C2 6418 0867 76D7 27BF F62C D2B5

… наш разум - превосходная объяснительная машина которая способна найти
смысл почти в чем угодно, истолковать любой феномен, но совершенно не в
состоянии принять мысль о непредсказуемости.

[Message part 2 (text/html, inline)]

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.