GNU bug report logs - #75246
Request for merging "python-team" branch

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 75246 in the body.
You can then email your comments to 75246 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: guix-patches <at> gnu.org
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, Lars-Dominik Braun <lars <at> 6xq.net>,
 jgart <jgart <at> dismail.de>, Marius Bakke <marius <at> gnu.org>,
 Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Request for merging "python-team" branch
Date: Wed, 01 Jan 2025 18:58:58 +0100

The python-team branch is currently tracking the rust-team branch,
because it depends on changes there.  It is shaping up nicely and we
hope to be able to merge it some time soon.

-- 
Ricardo

Message #8 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Lars-Dominik Braun <lars <at> 6xq.net>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: Tanguy Le Carrour <tanguy <at> bioneland.org>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, 75246 <at> debbugs.gnu.org,
 jgart <jgart <at> dismail.de>, Marius Bakke <marius <at> gnu.org>,
 Sharlatan Hellseher <sharlatanus <at> gmail.com>
Subject: Re: Request for merging "python-team" branch
Date: Sun, 5 Jan 2025 11:34:49 +0100

Hi Ricardo,

> The python-team branch is currently tracking the rust-team branch,
> because it depends on changes there.  It is shaping up nicely and we
> hope to be able to merge it some time soon.

I recall you wanted to keep python-team small, but do you mind if I
push https://issues.guix.gnu.org/74993 there (it’s a small, but
world-rebuilding change)?

Thanks,
Lars

Message #11 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Lars-Dominik Braun <lars <at> 6xq.net>
Cc: Tanguy Le Carrour <tanguy <at> bioneland.org>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, 75246 <at> debbugs.gnu.org,
 jgart <jgart <at> dismail.de>, Marius Bakke <marius <at> gnu.org>,
 Sharlatan Hellseher <sharlatanus <at> gmail.com>
Subject: Re: Request for merging "python-team" branch
Date: Sun, 05 Jan 2025 13:22:47 +0100

Hi Lars,

>> The python-team branch is currently tracking the rust-team branch,
>> because it depends on changes there.  It is shaping up nicely and we
>> hope to be able to merge it some time soon.
>
> I recall you wanted to keep python-team small, but do you mind if I
> push https://issues.guix.gnu.org/74993 there (it’s a small, but
> world-rebuilding change)?

Looks fine to me.  Would this fix the build failure we see in
python-fastapi-pagination-minimal, which seems to be due to a parse
error?

I know I said I wanted to merge this branch quickly and keep the changes
restricted to important fixes, but it turned out that many of the
required fixes are wide-ranging anyway.  I had to upgrade a lot of
packages that led to thousands of rebuilds.  At this point I'd still
like to keep *experimental* changes out, but almost all other
improvements are welcome.

Thank you!

-- 
Ricardo

Message #14 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Lars-Dominik Braun <lars <at> 6xq.net>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: Tanguy Le Carrour <tanguy <at> bioneland.org>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, 75246 <at> debbugs.gnu.org,
 jgart <jgart <at> dismail.de>, Marius Bakke <marius <at> gnu.org>,
 Sharlatan Hellseher <sharlatanus <at> gmail.com>
Subject: Re: Request for merging "python-team" branch
Date: Sun, 5 Jan 2025 14:00:49 +0100

Hi,

> Looks fine to me.  Would this fix the build failure we see in
> python-fastapi-pagination-minimal, which seems to be due to a parse
> error?

yes, that looks like the error this patch tries to fix.

Thanks,
Lars

Message #17 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: guix-patches <at> gnu.org
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, Lars-Dominik Braun <lars <at> 6xq.net>,
 jgart <jgart <at> dismail.de>, Marius Bakke <marius <at> gnu.org>,
 Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: Request for merging "python-team" branch
Date: Sun, 05 Jan 2025 14:02:54 +0100

Ricardo Wurmus <rekado <at> elephly.net> writes:

> The python-team branch is currently tracking the rust-team branch,
> because it depends on changes there.  It is shaping up nicely and we
> hope to be able to merge it some time soon.

Looking at the dashboard for any recent evaluation of the python-team
branch, we still see a lot of failures, e.g. here:

    https://ci.guix.gnu.org/eval/1967649/dashboard

Is anyone here interested in helping to get most of the packages
prefixed with "python-" to build successfully?  

-- 
Ricardo

Message #20 received at submit <at> debbugs.gnu.org (full text, mbox):

From: "jgart" <jgart <at> dismail.de>
To: "Ricardo Wurmus" <rekado <at> elephly.net>, guix-patches <at> gnu.org
Cc: Munyoki Kilyungi <me <at> bonfacemunyoki.com>,
 Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Tanguy Le Carrour <tanguy <at> bioneland.org>, Lars-Dominik Braun <lars <at> 6xq.net>,
 Marius Bakke <marius <at> gnu.org>
Subject: Re: Request for merging "python-team" branch
Date: Sun, 05 Jan 2025 20:18:26 +0000

[Message part 1 (text/plain, inline)]

I probably won't have time to work on that in the coming weeks.

Could you cherry-pick out the packages that are introducing failures into a WIP branch and make the scope of this request smaller so that it can be merged?

Someone can then address the failures in the next python-team merge request.

WDYT

all the best,

jgart

[Message part 2 (text/html, inline)]

Message #23 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: guix-devel <at> gnu.org
Cc: sharlatanus <at> gmail.com, me <at> bonfacemunyoki.com, 75246 <at> debbugs.gnu.org,
 lars <at> 6xq.net, jgart <at> dismail.de, marius <at> gnu.org, tanguy <at> bioneland.org
Subject: Last minute python-team fixes: help needed!
Date: Mon, 13 Jan 2025 14:10:11 +0100

Hi,

I've spent the last weeks whipping the python-team branch into shape,
but I'm running out of steam.  There are still a number of failures, and
I'm about to lose motivation to continue fixing the remaining build
failures.

Here are some of the failures that may be of interest:

  ansible
  python-libcst (needs rust)
  python-pandas 1.5
  python-pytorch 2.0.1
  python-django-q
  python-pyodbc-c (3.1.5 fails with: undefined symbol: PyUnicode_GetMax)
  python-agate (whole wireservice module needs upgrades)

I won't be working on these packages.  Instead I'll focus on preparing
the guix-science channel for the merge.  Please view the dashboard for
the latest evaluation of python-team at
https://ci.guix.gnu.org/jobset/python-team to see if you could
contribute fixes for the remaining failures.  Thanks!

The "python-team" branch has just been rebased on top of "master".  It
will soon be merged --- even with the above failures --- to avoid
falling into our old habits of delaying merges and encouraging the
proliferation of increasingly divergent fixes across several branches.
It is next in line after "libgcrypt-gpg-update"
(https://issues.guix.gnu.org/75180).

(If you find yourself in Cc, you are listed as a member of the python
team.  If you consider this to be outdated, please submit a change to
etc/teams.scm.)

-- 
Ricardo

Message #26 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: 宋文武 <iyzsong <at> envs.net>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: sharlatanus <at> gmail.com, me <at> bonfacemunyoki.com, 75246 <at> debbugs.gnu.org,
 lars <at> 6xq.net, jgart <at> dismail.de, marius <at> gnu.org, guix-devel <at> gnu.org,
 tanguy <at> bioneland.org
Subject: Re: Last minute python-team fixes: help needed!
Date: Tue, 14 Jan 2025 10:38:36 +0800

Ricardo Wurmus <rekado <at> elephly.net> writes:

> Hi,
>
> I've spent the last weeks whipping the python-team branch into shape,
> but I'm running out of steam.  There are still a number of failures, and
> I'm about to lose motivation to continue fixing the remaining build
> failures.

Thank you for the work!

> Here are some of the failures that may be of interest:
>
>   ansible
>   python-libcst (needs rust)
>   python-pandas 1.5
>   python-pytorch 2.0.1
>   python-django-q
>   python-pyodbc-c (3.1.5 fails with: undefined symbol: PyUnicode_GetMax)
>   python-agate (whole wireservice module needs upgrades)
>
> I won't be working on these packages.  Instead I'll focus on preparing
> the guix-science channel for the merge.  Please view the dashboard for
> the latest evaluation of python-team at
> https://ci.guix.gnu.org/jobset/python-team to see if you could
> contribute fixes for the remaining failures.  Thanks!

I can contribute some fixes today, it seems many failures are due to
missing python-setuptools and python-wheel in its native-inputs when
using the pyproject-build-system.

Message #29 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Sharlatan Hellseher <sharlatanus <at> gmail.com>
To: 75246 <at> debbugs.gnu.org
Cc: rekado <at> elephly.net
Subject: Request for merging "python-team" branch
Date: Tue, 14 Jan 2025 20:47:40 +0000

[Message part 1 (text/plain, inline)]

Hi Ricardo,

I found 2 duplicated packages with different names in bioinformatics:

this
--8<---------------cut here---------------start------------->8---
(define-public fanc
  (let ((commit "354401e52ba2320e6b1ba0d3b5aab3541d31c9f3")
	(revision "1"))
    (package
      (name "fanc")
      (version (git-version "0" revision commit))
      (source (origin
		(method git-fetch)
		(uri (git-reference
		      (url "https://github.com/vaquerizaslab/fanc.git")
		      (commit commit)))
		(file-name (git-file-name name version))
		(sha256
		 (base32
		  "0vp2cak5snla4j2q23d3ixx016bwzvxfiv4z6yp7anl0xaksd5bl"))))
...
      (home-page "https://github.com/vaquerizaslab/fanc")
      (synopsis "Framework for the analysis of C-like data")
      (description "FAN-C provides a pipeline for analysing Hi-C data starting
at mapped paired-end sequencing reads.")
      (license license:gpl3+))))
--8<---------------cut here---------------end--------------->8---

and this

--8<---------------cut here---------------start------------->8---
(define-public python-fanc
  (package
    (name "python-fanc")
    (version "0.9.25")
    (source (origin
              (method git-fetch)
              (uri (git-reference
                    (url "https://github.com/vaquerizaslab/fanc")
                    ;; There are no tags.  This commit corresponds to
                    ;; version 0.9.25.
                    (commit "e2205346c13ea5349681dff21adeb271d4ea5261")))
              (file-name (git-file-name name version))
              (sha256
               (base32
                "0rxq24p852iiayi0083fyigvc30as695rha71q6xd4s2ij1k9mqi"))))
...
    (home-page "https://github.com/vaquerizaslab/fanc")
    (synopsis "Framework for the analysis of C-data")
    (description
     "FAN-C provides a pipeline for analysing Hi-C data starting at
mapped paired-end sequencing reads.")
    (license license:gpl3+)))
--8<---------------cut here---------------end--------------->8---

Failing and took too much time on tests I've gave up on 20min :-).

--
Oleg

[signature.asc (application/pgp-signature, inline)]

Message #32 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Sharlatan Hellseher <sharlatanus <at> gmail.com>
Cc: 75246 <at> debbugs.gnu.org
Subject: Re: Request for merging "python-team" branch
Date: Thu, 16 Jan 2025 09:44:02 +0100

Sharlatan Hellseher <sharlatanus <at> gmail.com> writes:

> I found 2 duplicated packages with different names in bioinformatics:
> [...]

Thanks for letting me know.  I fixed this yesterday and upgraded
python-fanc.

Unfortunately, ci.guix.gnu.org seems to have stopped following our
progress.

https://qa.guix.gnu.org/branch/python-team doesn't know the merge base,
so I will rebase python-team once more on top of master some time today.

-- 
Ricardo

Message #35 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Sharlatan Hellseher <sharlatanus <at> gmail.com>
Cc: 75246 <at> debbugs.gnu.org
Subject: Re: Request for merging "python-team" branch
Date: Thu, 16 Jan 2025 10:51:19 +0100

Ricardo Wurmus <rekado <at> elephly.net> writes:

> Unfortunately, ci.guix.gnu.org seems to have stopped following our
> progress.

I've fixed this by deleting a stray lock file.

> https://qa.guix.gnu.org/branch/python-team doesn't know the merge base,
> so I will rebase python-team once more on top of master some time today.

I just pushed the rebased branch.

-- 
Ricardo

Message #38 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Sharlatan Hellseher <sharlatanus <at> gmail.com>
To: 75246 <at> debbugs.gnu.org
Cc: Ricardo Wurmus <rekado <at> elephly.net>
Subject: Request for merging "python-team" branch
Date: Thu, 16 Jan 2025 10:18:59 +0000

[Message part 1 (text/plain, inline)]

Hi Ricardo,

Do you have a list of packages which you would like to fix/update before
merge?

I try to fix the build of python-stcal which was affected by numpy
upgrade, have no solution yet.

--
Oleg

[signature.asc (application/pgp-signature, inline)]

Message #41 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Sharlatan Hellseher <sharlatanus <at> gmail.com>
Cc: 75246 <at> debbugs.gnu.org
Subject: Re: Request for merging "python-team" branch
Date: Thu, 16 Jan 2025 22:22:33 +0100

> Do you have a list of packages which you would like to fix/update before
> merge?

I don't have a list, but I have some ongoing work that I'd like to
complete first.  I'm afraid one of the fixes will cause yet another
world rebuild, but it's best to get it over with now than to introduce
more workarounds.

> I try to fix the build of python-stcal which was affected by numpy
> upgrade, have no solution yet.

I have these things still going on before I would be comfortable with a
merge:

- python-pysnptools (almost done, with lots of Rust)
- python-modin (tests don't work yet)
- python-pynetdicom (lots of tests fail)
- python-asyncua (freezes)

In guix-science I'd like to fix python-tensorflow, but that seems to be
a small problem only -- we could relax requirements there, because it
complains about a patch-level mismatch in the numpy version.

(I noticed this time around that quite a few builds have a failing test suite
only when run on my laptop with more than 4 cores.  botocore is one of
them.  A bit strange.)

-- 
Ricardo

Message #44 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Sharlatan Hellseher <sharlatanus <at> gmail.com>
Cc: 75246 <at> debbugs.gnu.org
Subject: Re: Request for merging "python-team" branch
Date: Thu, 16 Jan 2025 22:33:34 +0100

Ricardo Wurmus <rekado <at> elephly.net> writes:

> I have these things still going on before I would be comfortable with a
> merge:
>
> - python-pysnptools (almost done, with lots of Rust)
> - python-modin (tests don't work yet)
> - python-pynetdicom (lots of tests fail)
> - python-asyncua (freezes)

Another important one: python-psycopg-3.1.10 appears to be failing its
test suite now.  I haven't looked into it yet.

-- 
Ricardo

Message #47 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, 75246 <at> debbugs.gnu.org,
 Lars-Dominik Braun <lars <at> 6xq.net>, jgart <jgart <at> dismail.de>,
 Marius Bakke <marius <at> gnu.org>, Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Fri, 17 Jan 2025 14:57:44 -0500

On Wed, Jan 01, 2025 at 06:58:58PM +0100, Ricardo Wurmus wrote:
> The python-team branch is currently tracking the rust-team branch,
> because it depends on changes there.  It is shaping up nicely and we
> hope to be able to merge it some time soon.

I think that we should be bold in merging the branch if there are only
scattered problems.

Already we have had large parts of the Python package graph failing to
build on master (including most of the scientific and numerical
packages), and it was at least partly fixed by cherry-picking from
python-team.

I think it's okay to trade "new with some failures" for "old with some
failures" on the master branch. At least there will be more help to fix
them.

Message #50 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: "jgart" <jgart <at> dismail.de>
To: "Leo Famulari" <leo <at> famulari.name>, "Ricardo Wurmus" <rekado <at> elephly.net>
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, 75246 <at> debbugs.gnu.org,
 Lars-Dominik Braun <lars <at> 6xq.net>, Marius Bakke <marius <at> gnu.org>,
 Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Fri, 17 Jan 2025 20:42:41 +0000

[Message part 1 (text/plain, inline)]

> 
> I think it's okay to trade "new with some failures" for "old with some
> failures" on the master branch. At least there will be more help to fix
> them.
> 
If this the state that we are already in on master then sounds good to me.

In the future, it would be great to have some hooks in place to prevent people from pushing updates to master that break packages or cause too many rebuilds.

In other words, I don't think we should be allowed to push commits to master that break the package graph accidentally.

How can we make such a thing happen? I don't have an answer at the moment :)

all best,

jgart

[Message part 2 (text/html, inline)]

Message #53 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: jgart <jgart <at> dismail.de>
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, 75246 <at> debbugs.gnu.org,
 Lars-Dominik Braun <lars <at> 6xq.net>, Ricardo Wurmus <rekado <at> elephly.net>,
 Marius Bakke <marius <at> gnu.org>, Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Fri, 17 Jan 2025 18:33:47 -0500

On Fri, Jan 17, 2025 at 08:42:41PM +0000, jgart wrote:
> In the future, it would be great to have some hooks in place to prevent people from pushing updates to master that break packages or cause too many rebuilds.
> 
> In other words, I don't think we should be allowed to push commits to master that break the package graph accidentally.
> 
> How can we make such a thing happen? I don't have an answer at the moment :)

That's basically the premise of qa.guix.gnu.org, and continuous
integration in general.

We "just have to" use those resources in a more disciplined way.

Message #56 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: "jgart" <jgart <at> dismail.de>
To: "Leo Famulari" <leo <at> famulari.name>
Cc: Sharlatan
 Hellseher <sharlatanus <at> gmail.com>, Munyoki Kilyungi <me <at> bonfacemunyoki.com>,
 75246 <at> debbugs.gnu.org, Lars-Dominik Braun <lars <at> 6xq.net>,
 Ricardo Wurmus <rekado <at> elephly.net>, Marius
 Bakke <marius <at> gnu.org>, Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Sat, 18 Jan 2025 00:15:02 +0000

[Message part 1 (text/plain, inline)]

One issue with QA that confuses me though is when it says unknown. For example, here:

https://issues.guix.gnu.org/75635

What does "unknown" mean? Abort looking at QA? 

If the correct response, then, now there's no QA for 75635? ;()

[Message part 2 (text/html, inline)]

Message #59 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Christopher Baines <mail <at> cbaines.net>
To: jgart via Guix-patches via <guix-patches <at> gnu.org>
Cc: jgart <jgart <at> dismail.de>, Leo Famulari <leo <at> famulari.name>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Sat, 18 Jan 2025 04:24:22 +0000

[Message part 1 (text/plain, inline)]

jgart via Guix-patches via <guix-patches <at> gnu.org> writes:

> One issue with QA that confuses me though is when it says unknown. For example, here:
>
> https://issues.guix.gnu.org/75635
>
> What does "unknown" mean? Abort looking at QA?
>
> If the correct response, then, now there's no QA for 75635? ;()

The overall status is a summary, there should be more information on the
relevant QA page for that issue. Currently on that page [1] the thing
highlighted in red reads:

  Builds for this patch series not yet submitted as master branch
  substitute availability is low for: aarch64-linux armhf-linux
  i686-linux x86_64-linux

1: https://qa.guix.gnu.org/issue/75635

If you look at the page, QA does actually have some information,
e.g. how many rebuilds there are and some information on lint warnings
to, but it can't give an overall status because it is missing build
information for both the master branch and the state after applying the
patches (the "Unknown" column in the "Package changes" table).

Currently my approach so far has been that QA shouldn't be a blocker,
e.g. if it doesn't give the OK then that's not something you have to
wait for, but given how the bordeaux build farm has been struggling to
keep up recently I'm starting to think that if people don't start
waiting for QA, substitute availability might never catch up so the
bordeaux build farm is always going to be behind and therefore QA will
be unable to actually provide any information.

[signature.asc (application/pgp-signature, inline)]

Message #62 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Leo Famulari <leo <at> famulari.name>
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, 75246 <at> debbugs.gnu.org,
 Lars-Dominik Braun <lars <at> 6xq.net>, jgart <jgart <at> dismail.de>,
 Marius Bakke <marius <at> gnu.org>, Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Sun, 19 Jan 2025 14:07:40 +0100

Leo Famulari <leo <at> famulari.name> writes:

> On Wed, Jan 01, 2025 at 06:58:58PM +0100, Ricardo Wurmus wrote:
>> The python-team branch is currently tracking the rust-team branch,
>> because it depends on changes there.  It is shaping up nicely and we
>> hope to be able to merge it some time soon.
>
> I think that we should be bold in merging the branch if there are only
> scattered problems.

We had not been able to figure out if there really are only scattered
problems.  Just a few days ago we had to do another world rebuild due to
an upgrade of a small package close to the root of the Python test
graph.  But from what I can tell in test builds of real-world
environments we're in good shape.

> Already we have had large parts of the Python package graph failing to
> build on master (including most of the scientific and numerical
> packages), and it was at least partly fixed by cherry-picking from
> python-team.

I'm pretty much done with what I set out to fix.  Now it's up to the
build farms to successfully complete the evaluations.  I'd like to merge
this all on Monday if the build farms cooperate.

...and then I'd like to start a new shortlived python-team branch with
an upgrade from Python 3.10 to 3.11.

-- 
Ricardo

Message #67 received at 75246-done <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, Lars-Dominik Braun <lars <at> 6xq.net>,
 75246-done <at> debbugs.gnu.org, jgart <jgart <at> dismail.de>,
 Marius Bakke <marius <at> gnu.org>, Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Mon, 20 Jan 2025 17:46:18 -0500

On Mon, Jan 20, 2025 at 09:56:39PM +0100, Ricardo Wurmus wrote:
> Commit 69d657f9c4ffa59d708356baacbefafb58f09308 is now the tip of the
> "master" branch.  The "python-team" branch has been merged.

Hooray! Thanks to the whole team for their work.

Message #70 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Sharlatan Hellseher <sharlatanus <at> gmail.com>
To: 75246 <at> debbugs.gnu.org
Cc: rekado <at> elephly.net
Subject: Request for merging "python-team" branch
Date: Mon, 20 Jan 2025 21:19:54 +0000

[Message part 1 (text/plain, inline)]

Hi,

Thank you for merging and leading this refresh quest!

> I see that we have Python 3.12, but let's please target 3.11 first.
> It's a small step up from 3.10, and we already know of packages that
> won't work with 3.12.  Let's keep the next iteration of this branch
> simple, please.

While refreshing (now) packages from astronomy module I've faced wit few
failing to build due to hard requirement of Python3.11+ and NumPy 1.27+
or 2.0+ which don't have yet.

I've got a chance to to refresh NumPy to 1.24 but any farther version
failed to build (see notes on the package).

May we give it one more go with NumPy and friends?

--
Oleg

[signature.asc (application/pgp-signature, inline)]

Message #73 received at 75246-done <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: 75246-done <at> debbugs.gnu.org
Cc: Sharlatan Hellseher <sharlatanus <at> gmail.com>,
 Munyoki Kilyungi <me <at> bonfacemunyoki.com>, Lars-Dominik Braun <lars <at> 6xq.net>,
 Leo Famulari <leo <at> famulari.name>, jgart <jgart <at> dismail.de>,
 Marius Bakke <marius <at> gnu.org>, Tanguy Le Carrour <tanguy <at> bioneland.org>
Subject: Re: [bug#75246] Request for merging "python-team" branch
Date: Mon, 20 Jan 2025 21:56:39 +0100

> build farms to successfully complete the evaluations.  I'd like to merge
> this all on Monday if the build farms cooperate.

https://qa.guix.gnu.org/branch/python-team sadly doesn't show *anything*
other than "Information unavailable", but ci.guix.gnu.org is happy.  The
dashboard looks much greener than what we currently have for "master",
so I'm feeling good about merging this.

Commit 69d657f9c4ffa59d708356baacbefafb58f09308 is now the tip of the
"master" branch.  The "python-team" branch has been merged.

> ...and then I'd like to start a new shortlived python-team branch with
> an upgrade from Python 3.10 to 3.11.

I see that we have Python 3.12, but let's please target 3.11 first.
It's a small step up from 3.10, and we already know of packages that
won't work with 3.12.  Let's keep the next iteration of this branch
simple, please.

Thanks to everyone who contributed to this branch!

-- 
Ricardo

Message #76 received at 75246 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Sharlatan Hellseher <sharlatanus <at> gmail.com>
Cc: 75246 <at> debbugs.gnu.org
Subject: Re: Request for merging "python-team" branch
Date: Tue, 21 Jan 2025 11:32:19 +0100

Sharlatan Hellseher <sharlatanus <at> gmail.com> writes:

>> I see that we have Python 3.12, but let's please target 3.11 first.
>> It's a small step up from 3.10, and we already know of packages that
>> won't work with 3.12.  Let's keep the next iteration of this branch
>> simple, please.
>
> While refreshing (now) packages from astronomy module I've faced wit few
> failing to build due to hard requirement of Python3.11+ and NumPy 1.27+
> or 2.0+ which don't have yet.
>
> I've got a chance to to refresh NumPy to 1.24 but any farther version
> failed to build (see notes on the package).
>
> May we give it one more go with NumPy and friends?

I'd like to avoid the kind of sprawling upgrade chain reactions that
we've encountered in the most recent iteration.  My hope is that we've
already upgraded the most important and deeply rooted packages so that
an upgrade to numpy won't lead to an upgrade storm.

Please keep it at Numpy 1.x, though.  As with Pandas I think it makes
sense to first add an extra package for 2.x so that we can use package
transformations to test the impact before switching the default.

Let's open a new issue for the next iteration.

-- 
Ricardo

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.