From unknown Fri Jun 20 07:26:43 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#65801 <65801@debbugs.gnu.org> To: bug#65801 <65801@debbugs.gnu.org> Subject: Status: [PATCH] gnu: openmpi: Enable PMIx. Reply-To: bug#65801 <65801@debbugs.gnu.org> Date: Fri, 20 Jun 2025 14:26:43 +0000 retitle 65801 [PATCH] gnu: openmpi: Enable PMIx. reassign 65801 guix-patches submitter 65801 Lars Bilke severity 65801 normal tag 65801 patch thanks From debbugs-submit-bounces@debbugs.gnu.org Thu Sep 07 09:14:03 2023 Received: (at submit) by debbugs.gnu.org; 7 Sep 2023 13:14:03 +0000 Received: from localhost ([127.0.0.1]:38859 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qeEpe-0003zV-MJ for submit@debbugs.gnu.org; Thu, 07 Sep 2023 09:14:02 -0400 Received: from lists.gnu.org ([2001:470:142::17]:35880) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qeEpc-0003ym-R6 for submit@debbugs.gnu.org; Thu, 07 Sep 2023 09:14:01 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qeEpV-00008w-Hc for guix-patches@gnu.org; Thu, 07 Sep 2023 09:13:53 -0400 Received: from mailgate4.ufz.de ([141.65.7.211] helo=mailgate.ufz.de) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qeEpS-0003SE-31 for guix-patches@gnu.org; Thu, 07 Sep 2023 09:13:53 -0400 Received: from imap.intranet.ufz.de (dcs1.intranet.ufz.de [141.65.125.135]) by mailgate.ufz.de (Mailgate4-UFZ) with ESMTP id E87A2160020 for ; Thu, 7 Sep 2023 15:13:36 +0200 (CEST) MIME-version: 1.0 Content-type: multipart/mixed; boundary="Boundary_(ID_QX2zUkWXZ1tuuMgZ32TDTw)" Received: from conversion-daemon.imap.intranet.ufz.de by imap.intranet.ufz.de (Oracle Communications Messaging Server 8.0.2.6.20200227 64bit (built Feb 27 2020)) id <0S0M00K009UZAE00@imap.intranet.ufz.de> for guix-patches@gnu.org; Thu, 07 Sep 2023 15:13:36 +0200 (CEST) Received: from smtp1.ufz.de ([141.65.7.216]) by imap.intranet.ufz.de (Oracle Communications Messaging Server 8.0.2.6.20200227 64bit (built Feb 27 2020)) with ESMTPS id <0S0M000FXA2OWVF0@imap.intranet.ufz.de> for guix-patches@gnu.org; Thu, 07 Sep 2023 15:13:36 +0200 (CEST) Received: from [198.19.249.3] (ufz542757.intranet.ufz.de [141.65.235.243]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp1.ufz.de (smtp1-UFZ) with ESMTPSA id C22B0801E7 for ; Thu, 7 Sep 2023 15:13:36 +0200 (CEST) Date: Thu, 07 Sep 2023 15:13:36 +0200 From: Lars Bilke Subject: [PATCH] gnu: openmpi: Enable PMIx. To: guix-patches@gnu.org Message-id: <840372D7-8A24-495D-8975-392DFFFA50C0@ufz.de> X-Mailer: MailMate (1.14r5937) Received-SPF: pass client-ip=141.65.7.211; envelope-from=lars.bilke@ufz.de; helo=mailgate.ufz.de X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --Boundary_(ID_QX2zUkWXZ1tuuMgZ32TDTw) Content-type: text/plain; markup=markdown Content-transfer-encoding: 7BIT Enables support for the Process Management Interface for Exascale which is used e.g. by Slurm for the management communication and coordination of MPI processes. This allows e.g. to run guix-created container on JSC Juwels cluster with native performance. --Boundary_(ID_QX2zUkWXZ1tuuMgZ32TDTw) Content-type: text/plain; name=0001-PATCH-gnu-openmpi-Enable-PMIx.patch Content-transfer-encoding: 7BIT Content-disposition: attachment; filename=0001-PATCH-gnu-openmpi-Enable-PMIx.patch >From 23a11683c37faf8b971628b2ded9560ba5a22965 Mon Sep 17 00:00:00 2001 From: Lars Bilke Date: Thu, 7 Sep 2023 15:06:03 +0200 Subject: [PATCH] [PATCH] gnu: openmpi: Enable PMIx. Enables support for the Process Management Interface for Exascale which is used e.g. by Slurm for the management communication and coordination of MPI processes --- gnu/packages/mpi.scm | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm index 4d2458344f..907cd3af29 100644 --- a/gnu/packages/mpi.scm +++ b/gnu/packages/mpi.scm @@ -247,6 +247,10 @@ (define-public openmpi "--enable-openib-rdmacm" "--enable-openib-rdmacm-ibaddr" + ;; Enable support for the 'Process Management + ;; Interface for Exascale'. + "--with-pmix=internal" + ;; Enable support for SLURM's Process Manager ;; Interface (PMI). ,(string-append "--with-pmi=" -- 2.41.0 --Boundary_(ID_QX2zUkWXZ1tuuMgZ32TDTw)-- From debbugs-submit-bounces@debbugs.gnu.org Thu Sep 14 16:58:21 2023 Received: (at 65801-done) by debbugs.gnu.org; 14 Sep 2023 20:58:21 +0000 Received: from localhost ([127.0.0.1]:41258 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qgtPl-0004fP-Hx for submit@debbugs.gnu.org; Thu, 14 Sep 2023 16:58:21 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:19359) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qgtPg-0004f4-8W for 65801-done@debbugs.gnu.org; Thu, 14 Sep 2023 16:58:16 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:references:date:in-reply-to: message-id:mime-version:content-transfer-encoding; bh=WzWqjKTkzabhxB9SnpxN9ZPV5LznZ+o2a4bEwlzppg4=; b=Kljo1y8zAK5YjWdYPHV+TNI74s4pn2cVMmMTpBuN5n04IbxwW1zPbQCs z1SbTvMkrdReVsF2lAPEOEr35wtr/9xCj6+1fIu1brV7rqRr7WgbpZaVN XXUdox4AtnXlOtnr66jXfMNy5UYEDT2QzVQoVxJkfMN0w2jHsytcIWbgy U=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.02,146,1688421600"; d="scan'208";a="66002071" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 14 Sep 2023 22:58:00 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Lars Bilke Subject: Re: bug#65801: [PATCH] gnu: openmpi: Enable PMIx. References: <840372D7-8A24-495D-8975-392DFFFA50C0@ufz.de> Date: Thu, 14 Sep 2023 22:57:59 +0200 In-Reply-To: <840372D7-8A24-495D-8975-392DFFFA50C0@ufz.de> (Lars Bilke's message of "Thu, 07 Sep 2023 15:13:36 +0200") Message-ID: <87il8c5v6w.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 65801-done Cc: 65801-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi, Lars Bilke skribis: > Enables support for the Process Management Interface for Exascale which i= s used e.g. by Slurm for the management communication and coordination of M= PI processes. > > This allows e.g. to run guix-created container on JSC Juwels cluster with= native performance. Nice. Out of curiosity, does the cluster run Guix natively or are you using =E2=80=98guix pack=E2=80=99? >>>From 23a11683c37faf8b971628b2ded9560ba5a22965 Mon Sep 17 00:00:00 2001 > From: Lars Bilke > Date: Thu, 7 Sep 2023 15:06:03 +0200 > Subject: [PATCH] [PATCH] gnu: openmpi: Enable PMIx. > > Enables support for the Process Management Interface for Exascale which > is used e.g. by Slurm for the management communication and coordination > of MPI processes I added this to the comment in the code, tweaked the commit log, and committed. Thank you! Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 15 02:21:44 2023 Received: (at 65801) by debbugs.gnu.org; 15 Sep 2023 06:21:44 +0000 Received: from localhost ([127.0.0.1]:41860 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qh2D2-00052u-AE for submit@debbugs.gnu.org; Fri, 15 Sep 2023 02:21:44 -0400 Received: from mailgate5.ufz.de ([141.65.7.212]:49788 helo=mailgate.ufz.de) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qh2D0-00052c-GY for 65801@debbugs.gnu.org; Fri, 15 Sep 2023 02:21:43 -0400 Received: from imap.intranet.ufz.de (dcs1.intranet.ufz.de [141.65.125.135]) by mailgate.ufz.de (Mailgate5-UFZ) with ESMTP id C2BFC16028B for <65801@debbugs.gnu.org>; Fri, 15 Sep 2023 08:21:29 +0200 (CEST) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain Received: from conversion-daemon.imap.intranet.ufz.de by imap.intranet.ufz.de (Oracle Communications Messaging Server 8.0.2.6.20200227 64bit (built Feb 27 2020)) id <0S1000E00K0KDS00@imap.intranet.ufz.de> for 65801@debbugs.gnu.org; Fri, 15 Sep 2023 08:21:29 +0200 (CEST) Received: from smtp1.ufz.de ([141.65.7.216]) by imap.intranet.ufz.de (Oracle Communications Messaging Server 8.0.2.6.20200227 64bit (built Feb 27 2020)) with ESMTPS id <0S10008M1KBTB890@imap.intranet.ufz.de> for 65801@debbugs.gnu.org; Fri, 15 Sep 2023 08:21:29 +0200 (CEST) Received: from [100.88.251.128] (unknown [141.65.34.101]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp1.ufz.de (smtp1-UFZ) with ESMTPSA id 9E87280224 for <65801@debbugs.gnu.org>; Fri, 15 Sep 2023 08:21:29 +0200 (CEST) Date: Fri, 15 Sep 2023 08:21:29 +0200 From: Lars Bilke Subject: Re: bug#65801: closed (Re: bug#65801: [PATCH] gnu: openmpi: Enable PMIx.) In-reply-to: To: 65801@debbugs.gnu.org Message-id: <12BF2CA4-FC72-414F-95A9-E29A3A51768C@ufz.de> X-Mailer: MailMate (1.14r5937) References: <87il8c5v6w.fsf@gnu.org> <840372D7-8A24-495D-8975-392DFFFA50C0@ufz.de> X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 65801 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Ludo, thanks for committing! The JSC clusters don't run Guix natively but with the patch I can run 'guix pack' created containers with Apptainer with full interconnect perfomance! Thank you for all your work in this regard! Next up is to test the same container on other HPC platforms (already successfully tested on our in-house cluster EVE). Sincerely, Lars On 14 Sep 2023, at 22:59, GNU bug Tracking System wrote: > Your bug report > > #65801: [PATCH] gnu: openmpi: Enable PMIx. > > which was filed against the guix-patches package, has been closed. > > The explanation is attached below, along with your original report. > If you require more details, please reply to 65801@debbugs.gnu.org. > > -- > 65801: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=65801 > GNU Bug Tracking System > Contact help-debbugs@gnu.org with problems From debbugs-submit-bounces@debbugs.gnu.org Fri Sep 15 05:09:37 2023 Received: (at 65801) by debbugs.gnu.org; 15 Sep 2023 09:09:37 +0000 Received: from localhost ([127.0.0.1]:42041 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qh4pV-0001Lm-BG for submit@debbugs.gnu.org; Fri, 15 Sep 2023 05:09:37 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:44581) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qh4pK-0001L0-2U for 65801@debbugs.gnu.org; Fri, 15 Sep 2023 05:09:29 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:references:date:in-reply-to: message-id:mime-version:content-transfer-encoding; bh=1VPVfxQFeUZQ65mzbMYtcchSwqi8MG0yPZcAio30qQI=; b=lO1JbN7/uhxPMqux3Gipktt0g0gRZRY5lFIIZegeflnGfJCSmjl4YzBx rx6dH2iALaPsVlCL+97AJ4K3ktgluFRwVAhmrcgg/SiuACRjpmRMId8ef lxC1ljRW6fykhktAxmwSWqQDz8Qs8mNLTHl3ZX9azZ/U+5LPVWQ046wlV 4=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.02,148,1688421600"; d="scan'208";a="126157177" Received: from unknown (HELO ribbon) ([193.50.110.120]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 15 Sep 2023 11:09:12 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Lars Bilke Subject: Re: bug#65801: [PATCH] gnu: openmpi: Enable PMIx. References: <87il8c5v6w.fsf@gnu.org> <840372D7-8A24-495D-8975-392DFFFA50C0@ufz.de> <12BF2CA4-FC72-414F-95A9-E29A3A51768C@ufz.de> Date: Fri, 15 Sep 2023 11:09:12 +0200 In-Reply-To: <12BF2CA4-FC72-414F-95A9-E29A3A51768C@ufz.de> (Lars Bilke's message of "Fri, 15 Sep 2023 08:21:29 +0200") Message-ID: <8734zf3irr.fsf_-_@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 65801 Cc: 65801@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Hello, Lars Bilke skribis: > The JSC clusters don't run Guix natively but with the patch I can run > 'guix pack' created containers with Apptainer with full interconnect > perfomance! Thank you for all your work in this regard! Excellent, good to hear! > Next up is to test the same container on other HPC platforms (already > successfully tested on our in-house cluster EVE). Cool, let me know how it goes (we=E2=80=99re also using the same MPI on a r= ange of clusters in France). Also next: getting sysadmins to consider installing Guix? :-) Thanks, Ludo=E2=80=99. From unknown Fri Jun 20 07:26:43 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 13 Oct 2023 11:24:05 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator