From debbugs-submit-bounces@debbugs.gnu.org Thu Jul 11 10:34:17 2024 Received: (at submit) by debbugs.gnu.org; 11 Jul 2024 14:34:17 +0000 Received: from localhost ([127.0.0.1]:52357 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRusD-00013j-GM for submit@debbugs.gnu.org; Thu, 11 Jul 2024 10:34:17 -0400 Received: from lists.gnu.org ([209.51.188.17]:50896) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRusB-00013b-Bi for submit@debbugs.gnu.org; Thu, 11 Jul 2024 10:34:16 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sRusB-0005Yu-Cg for guix-patches@gnu.org; Thu, 11 Jul 2024 10:34:15 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sRus8-0002um-Ug for guix-patches@gnu.org; Thu, 11 Jul 2024 10:34:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=pkwxCIT6on7y37o40ji40u1d2dZYn61CLMLkrLMS0nU=; b=m2cRb62cZ9RBo9P0zYHTrBfgAHFrfe7MEAck7wdrkQyRzykhxfx4Drc9 tG7u/oN1D5K2vUTx35DLA/nACv6pOVBjw0g/txsKYO2WcqyU7yXZmK/iV Sn2zIS3Qx5mYSCCajt+IgMIOrsCNIPdDQXzCHxHBO+rGTCwkL/iKF360G o=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,200,1716242400"; d="scan'208";a="91951774" Received: from lfbn-bay-1-62-70.w83-193.abo.wanadoo.fr (HELO guix-A102.home) ([83.193.153.70]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Jul 2024 16:34:06 +0200 From: Romain GARBAGE To: guix-patches@gnu.org Subject: [PATCH 0/4] Add OpenMPI 5.x Date: Thu, 11 Jul 2024 16:25:08 +0200 Message-ID: <20240711143230.12467-1-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=192.134.164.104; envelope-from=romain.garbage@inria.fr; helo=mail3-relais-sop.national.inria.fr X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.3 (-) X-Debbugs-Envelope-To: submit Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) This patch series aims at bringing the 5.x branch of OpenMPI to Guix. First two patches are dependencies of OpenMPI 5.x. Third patch adds a new package for OpenMPI 5.x, keeping OpenMPI 4.x as the default version in package dependencies. Fourth patch adds PMIx support, which is required for OpenMPI 5.x support in SLURM. These patches have been applied on top of commit 0663668507377a849317b0fff3d72f609c3139c2, all packages depending on slurm and openmpi@5 have been successfully rebuilt. Romain GARBAGE (4): gnu: Add openpmix. gnu: Add prrte. gnu: Add openmpi-5. gnu: slurm: Add PMIx support. gnu/packages/mpi.scm | 52 ++++++++++++++++++++++++++++++ gnu/packages/parallel.scm | 68 +++++++++++++++++++++++++++++++++++++++ 2 files changed, 120 insertions(+) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Thu Jul 11 10:35:55 2024 Received: (at 72062) by debbugs.gnu.org; 11 Jul 2024 14:35:55 +0000 Received: from localhost ([127.0.0.1]:52363 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRutm-00018v-Ti for submit@debbugs.gnu.org; Thu, 11 Jul 2024 10:35:55 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:49022) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRutk-00018c-KA for 72062@debbugs.gnu.org; Thu, 11 Jul 2024 10:35:54 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=crT74xfYN/yker4IvbpOuL6NoQm/P175aP7P34bLYOU=; b=oSJiyCWOE2J264+82qIeouxpDx3J54WIBMp+bQKcVhH+bl0K0kvnQ6Fp I7ExYJHw6ZDlDR65Oa48emAQNeQ8mbEjXPgKAwLjmtgcVh1U5Zsv6z0x8 qyoxPVLZR255UzZnJPqxLkUOMsFLazGZT0uFqcmGFjn8b6YBySi44003C E=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,200,1716242400"; d="scan'208";a="91951976" Received: from lfbn-bay-1-62-70.w83-193.abo.wanadoo.fr (HELO guix-A102.home) ([83.193.153.70]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Jul 2024 16:35:46 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH 1/4] gnu: Add openpmix. Date: Thu, 11 Jul 2024 16:35:22 +0200 Message-ID: <20240711143540.25601-1-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/packages/parallel.scm (openpmix): New variable. Change-Id: Id23bc710c9b61ede0aebf7e2a18863fbe5fb8304 --- gnu/packages/parallel.scm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index a16a0d8689..4a57e85e6c 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -14,6 +14,7 @@ ;;; Copyright © 2021 Stefan Reichör ;;; Copyright © 2024 Zheng Junjie <873216071@qq.com> ;;; Copyright © 2024 David Elsing +;;; Copyright © 2024 Romain Garbage ;;; ;;; This file is part of GNU Guix. ;;; @@ -51,6 +52,7 @@ (define-module (gnu packages parallel) #:use-module (gnu packages documentation) #:use-module (gnu packages flex) #:use-module (gnu packages freeipmi) + #:use-module (gnu packages libevent) #:use-module (gnu packages linux) #:use-module (gnu packages maths) #:use-module (gnu packages mpi) @@ -612,3 +614,33 @@ (define-public psimd "This header-only C++ library provides a portable interface to single-instruction multiple-data (SIMD) intrinsics.") (license license:expat)))) + +(define-public openpmix + (package + (name "openpmix") + (version "4.2.8") + (source (origin + (method url-fetch) + (uri (string-append + "https://github.com/openpmix/openpmix/releases/download/v" + version "/pmix-" version ".tar.bz2")) + (sha256 + (base32 + "1j9xlhqrrmgjdkwakamn78y5gj756adi53hn25zksgr3is3l5d09")))) + (build-system gnu-build-system) + (arguments + (list #:configure-flags #~(list (string-append "--with-hwloc=" + (ungexp (this-package-input "hwloc") "lib"))))) + (inputs (list libevent + `(,hwloc "lib"))) + (native-inputs (list perl + python)) + (synopsis "PMIx library") + (description + "PMIx is an application programming interface standard that provides +libraries and programming models with portable and well-defined access +to commonly needed services in distributed and parallel computing +systems.") + (home-page "https://pmix.org/") + ;; The provided license is kind of BSD-style but specific. + (license (license:fsf-free "https://github.com/openpmix/openpmix?tab=License-1-ov-file#License-1-ov-file")))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Thu Jul 11 10:35:59 2024 Received: (at 72062) by debbugs.gnu.org; 11 Jul 2024 14:35:59 +0000 Received: from localhost ([127.0.0.1]:52366 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRutq-00019K-IN for submit@debbugs.gnu.org; Thu, 11 Jul 2024 10:35:58 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:49022) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRutm-00018c-Ee for 72062@debbugs.gnu.org; Thu, 11 Jul 2024 10:35:55 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=yqsPhFoI4Fl83DImr6eG3PxIPhBaoR6gI55hWdqQksI=; b=OJISyFNR4CHtyxWXrBktG7IOG01daIfwlhXF/xQvsF+Wy/jlOsj2sAtU TThA3Yzb9ZqIF0rG+YTKxpqvzofMB5tAc7wz8h2GsH3V6R11pTAGgKpNa UElUjh++c3V3LNaV2fwBAh3gh+r7dhmrY+y1MowwLqtU4RSIB7VO2z3Ux k=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,200,1716242400"; d="scan'208";a="91951992" Received: from lfbn-bay-1-62-70.w83-193.abo.wanadoo.fr (HELO guix-A102.home) ([83.193.153.70]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Jul 2024 16:35:52 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH 2/4] gnu: Add prrte. Date: Thu, 11 Jul 2024 16:35:23 +0200 Message-ID: <20240711143540.25601-2-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240711143540.25601-1-romain.garbage@inria.fr> References: <20240711143540.25601-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: 1.7 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: * gnu/packages/parallel.scm (prrte): New variable. Change-Id: I4427eec1a5c7d94ed5f9cbceb55f9372834a8971 --- gnu/packages/parallel.scm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) Content analysis details: (1.7 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3) [192.134.164.104 listed in wl.mailspike.net] 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record -0.0 SPF_PASS SPF: sender matches SPF record 1.7 URIBL_BLACK Contains an URL listed in the URIBL blacklist [URIs: github.io] 0.0 RCVD_IN_MSPIKE_WL Mailspike good senders X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.7 (/) * gnu/packages/parallel.scm (prrte): New variable. Change-Id: I4427eec1a5c7d94ed5f9cbceb55f9372834a8971 --- gnu/packages/parallel.scm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index 4a57e85e6c..f173d1b75e 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -644,3 +644,35 @@ (define-public openpmix (home-page "https://pmix.org/") ;; The provided license is kind of BSD-style but specific. (license (license:fsf-free "https://github.com/openpmix/openpmix?tab=License-1-ov-file#License-1-ov-file")))) + +(define-public prrte + (package + (name "prrte") + (version "3.0.6") + (source (origin + (method url-fetch) + (uri (string-append + "https://github.com/openpmix/prrte/releases/download/v" + version "/prrte-" version ".tar.bz2")) + (sha256 + (base32 + "0wiy0vk37v4db1jgxza8bci0cczcvj34dalzsrlz05dk45zb7dl3")))) + (build-system gnu-build-system) + (arguments + (list #:configure-flags #~(list (string-append "--with-hwloc=" + (assoc-ref %build-inputs "hwloc")) + (string-append "--with-pmix=" #$(this-package-input "openpmix"))))) + (inputs (list libevent + `(,hwloc "lib") + openpmix)) + (native-inputs (list perl)) + (synopsis "PMIx Reference RunTime Environment (PRRTE)") + (description + "The PMIx Reference RunTime Environment is a runtime environment +containing the reference implementation and capable of operating +within a host SMS. The reference RTE therefore provides an easy way of +exploring PMIx capabilities and testing PMIx-based applications +outside of a PMIx-enabled environment.") + (home-page "https://openpmix.github.io/") + ;; The provided license is kind of BSD-style but specific. + (license (license:fsf-free "https://github.com/openpmix/prrte?tab=License-1-ov-file#License-1-ov-file")))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Thu Jul 11 10:36:02 2024 Received: (at 72062) by debbugs.gnu.org; 11 Jul 2024 14:36:02 +0000 Received: from localhost ([127.0.0.1]:52370 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRutt-00019r-Vz for submit@debbugs.gnu.org; Thu, 11 Jul 2024 10:36:02 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:49022) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRuto-00018c-MS for 72062@debbugs.gnu.org; Thu, 11 Jul 2024 10:36:00 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=gz3GUCCGboz4dSlYJm5dSxtNWwoXVz4rcj2+M/oSbC4=; b=setHBS4JKU2ahkJhzxk8UB++ZwXJKQtfJ0bnZpA5yZBcVZ5xQHOQZbUP 3l4RBgLYKRNvwQMstowM+7mLz27dlXi1ZtphISdm9DNnmXqmO0RE9AUSw txRvcx+A9mVAXDzgdmP+HjN9l5UETGuIEGCVglqVDJk6/6MpucT1mflr0 U=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,200,1716242400"; d="scan'208";a="91952006" Received: from lfbn-bay-1-62-70.w83-193.abo.wanadoo.fr (HELO guix-A102.home) ([83.193.153.70]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Jul 2024 16:35:56 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH 3/4] gnu: Add openmpi-5. Date: Thu, 11 Jul 2024 16:35:24 +0200 Message-ID: <20240711143540.25601-3-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240711143540.25601-1-romain.garbage@inria.fr> References: <20240711143540.25601-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/packages/mpi.scm (openmpi-5): New variable. Change-Id: I048692b2e928077c9cfa9fb8076ceb356251e1db --- gnu/packages/mpi.scm | 52 ++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 52 insertions(+) diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm index 6270108b16..8cde8ef044 100644 --- a/gnu/packages/mpi.scm +++ b/gnu/packages/mpi.scm @@ -8,6 +8,7 @@ ;;; Copyright © 2018–2022 Tobias Geerinckx-Rice ;;; Copyright © 2018 Paul Garlick ;;; Copyright © 2019, 2021 Ricardo Wurmus +;;; Copyright © 2024 Romain Garbage ;;; ;;; This file is part of GNU Guix. ;;; @@ -49,6 +50,7 @@ (define-module (gnu packages mpi) #:use-module (gnu packages ncurses) #:use-module (gnu packages parallel) #:use-module (gnu packages pkg-config) + #:use-module (gnu packages python) #:use-module (gnu packages valgrind) #:use-module (srfi srfi-1) #:use-module (ice-9 match)) @@ -307,6 +309,56 @@ (define-public openmpi ;; See file://LICENSE (license license:bsd-2))) +(define-public openmpi-5 + (package/inherit openmpi + (version "5.0.3") + (source + (origin + (method url-fetch) + (uri (string-append "https://www.open-mpi.org/software/ompi/v" + (version-major+minor version) + "/downloads/openmpi-" version ".tar.bz2")) + (sha256 + (base32 "02x9xmpggw77mdpikjjx83j6i4v3gkqbncda73lk5axk0vr841cr")))) + + (inputs (modify-inputs (package-inputs openmpi) + ;; As of Open MPI 5.0.X, PMIx is used to communicate + ;; with SLURM, so SLURM'S PMI is no longer needed. + (delete "slurm") + (append ucx) ;for Infiniband support + (append openpmix) ;for PMI support (launching via "srun") + (append prrte))) ;for PMI support (launching via "srun") + (native-inputs (modify-inputs (package-native-inputs openmpi) + (append python))) + + (outputs '("out" "debug")) + (arguments + (substitute-keyword-arguments (package-arguments openmpi) + ((#:configure-flags flags) + #~(append (list "--enable-prte-prefix-by-default" ;replaces --enable-mpirun-prefix-by-default + ;; Enable support for the 'Process Management + ;; Interface for Exascale' (PMIx) used e.g. by + ;; Slurm for the management communication and + ;; coordination of MPI processes. + (string-append "--with-pmix=" #$(this-package-input "openpmix")) + (string-append "--with-prrte=" #$(this-package-input "prrte")) + + ;; Since 5.x, Infiniband support is provided by ucx. + (string-append "--with-ucx=" #$(this-package-input "ucx"))) + (filter (lambda (e) + (and (not (string-contains e "pmi")) ;; Since 5.x, OpenMPI doesn't support PMI/PMI-2 + ;; Deprecated since 5.x. + (not (string-contains e "enable-mpirun-prefix-by-default")) + ;; Infiniband support is deprecated and superseded by ucx + ;; See https://docs.open-mpi.org/en/main/release-notes/networks.html#miscellaneous-network-notes + (not (string-contains e "openib")))) + #$flags))) + + ((#:phases phases) + #~(modify-phases #$phases + (delete 'remove-absolute) + (delete 'scrub-timestamps))))))) + (define-public openmpi-c++ (package/inherit openmpi (name "openmpi-c++") -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Thu Jul 11 10:36:12 2024 Received: (at 72062) by debbugs.gnu.org; 11 Jul 2024 14:36:12 +0000 Received: from localhost ([127.0.0.1]:52373 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRutu-0001A0-GY for submit@debbugs.gnu.org; Thu, 11 Jul 2024 10:36:12 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:49027) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sRuts-00018k-PF for 72062@debbugs.gnu.org; Thu, 11 Jul 2024 10:36:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=+jQ0/oHP/eKvOT/d+bvrYUhMykBXe2PNcrO44HN/0dw=; b=ekc0yDpWny70J9Vh8S/Za9nujyu+y22U+F6xwsvdHeU2yNn1gFzEybpR nNpV/RBSbyUFHtMcaGlXz59rWMsGzsoJzLjVOMpZOPbgVTBm/utxs1LMF nVw45fBE23TXkuOWXNC7UHvwQR0+WvseVJWeY1XiC53LFUWNBo2rQwvz5 s=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,200,1716242400"; d="scan'208";a="91952013" Received: from lfbn-bay-1-62-70.w83-193.abo.wanadoo.fr (HELO guix-A102.home) ([83.193.153.70]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Jul 2024 16:36:00 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH 4/4] gnu: slurm: Add PMIx support. Date: Thu, 11 Jul 2024 16:35:25 +0200 Message-ID: <20240711143540.25601-4-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240711143540.25601-1-romain.garbage@inria.fr> References: <20240711143540.25601-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/packages/parallel.scm (slurm) [inputs]: Add dependency. [arguments]: Update configure flags. Change-Id: I6544be5eb44980191d0788738ab960263c56c0ba --- gnu/packages/parallel.scm | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index f173d1b75e..694968b727 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -229,6 +229,7 @@ (define-public slurm `(,hwloc-2 "lib") json-c linux-pam + openpmix munge numactl readline)) @@ -245,6 +246,9 @@ (define-public slurm (string-append "--with-json=" #$(this-package-input "json-c")) (string-append "--with-munge=" #$(this-package-input "munge")) + ;; Use PMIx bundled with Open MPI (this is required for Open MPI 5.x). + (string-append "--with-pmix=" #$(this-package-input "openpmix")) + ;; 32-bit support is marked as deprecated and needs to be ;; explicitly enabled. #$@(if (target-64bit?) '() '("--enable-deprecated"))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 03:27:34 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 07:27:34 +0000 Received: from localhost ([127.0.0.1]:53116 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSAgo-0002pY-Cu for submit@debbugs.gnu.org; Fri, 12 Jul 2024 03:27:34 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:13846) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSAgl-0002p8-9X for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 03:27:32 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=mime-version:content-transfer-encoding:date:to:cc: subject:from:message-id:references:in-reply-to; bh=6l1IuH3qik1vwozH3OgjrRg64Ksxzt9Hka0EHFoYpsQ=; b=PK/g8lfvWUBvWYYni0k9FM3eaAidmV17Gfi5yH7ghKYjg+evrVQuBer/ Hwfo6ca7M+tWt81TzDjKGpcw1bnjcTaDp5LzUCDjvzKg8mtPygjk2H8v7 CNEZ+tjZHl8fp1HN4J3ne/XnupfdlKuivcZNLN4NFm6EwOBJHXaPENqKN I=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="92002750" Received: from 91-164-88-5.subs.proxad.net (HELO localhost) ([91.164.88.5]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 09:27:24 +0200 Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=UTF-8 Date: Fri, 12 Jul 2024 09:27:22 +0200 To: <72062@debbugs.gnu.org> Subject: Re: [PATCH 0/4] Add OpenMPI 5.x From: "Romain GARBAGE" Message-Id: X-Mailer: aerc 0.15.2 References: <20240711143230.12467-1-romain.garbage@inria.fr> In-Reply-To: <20240711143230.12467-1-romain.garbage@inria.fr> X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) On Thu Jul 11, 2024 at 4:25 PM CEST, Romain GARBAGE wrote: > This patch series aims at bringing the 5.x branch of OpenMPI to Guix. [...] > Third patch adds a new package for OpenMPI 5.x, keeping OpenMPI 4.x as > the default version in package dependencies. > > Fourth patch adds PMIx support, which is required for OpenMPI 5.x > support in SLURM. After thinking about it, the last two patches should be applied in the reverse order so the when OpenMPI5 is present in the tree, SLURM already has the PMIx support needed by OpenMPI5.=20 If the need arises to submit a v2, I'll swap them at this occasion. > These patches have been applied on top of commit > 0663668507377a849317b0fff3d72f609c3139c2, all packages depending on > slurm and openmpi@5 have been successfully rebuilt. To be more precise, I rebuilt the packages that depend directly on slurm and openmpi@5 (for the latter, there should be none for now). Romain From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 04:41:03 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 08:41:03 +0000 Received: from localhost ([127.0.0.1]:53158 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSBpu-0004iW-DL for submit@debbugs.gnu.org; Fri, 12 Jul 2024 04:41:02 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:11310) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSBps-0004hx-IS for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 04:41:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:in-reply-to:references:date: message-id:mime-version:content-transfer-encoding; bh=WgcyIroe3fKKnCMmFitlhPg8EbYiTO4WTQgUp6ZtsAY=; b=NdvnZMVX9yxcKQgIXz/9fmPvTbdB33b2M9fqZXi7wLSopRCDdN18nnKs H+hKxb/jg7fv3wwlimNaED3XWFL/m84OySvmi/RnlRyeG4xWLSwp8siCV FHn1PHGSVI7AQsfTEghe89/S4rI70gbOI+Mc/On6AonIKenHHq+RbwK7t 0=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="92013927" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 10:40:53 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Romain GARBAGE Subject: Re: [PATCH 3/4] gnu: Add openmpi-5. In-Reply-To: <20240711143540.25601-3-romain.garbage@inria.fr> (Romain GARBAGE's message of "Thu, 11 Jul 2024 16:35:24 +0200") References: <20240711143540.25601-1-romain.garbage@inria.fr> <20240711143540.25601-3-romain.garbage@inria.fr> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Quintidi 25 Messidor an 232 de la =?utf-8?Q?R=C3=A9v?= =?utf-8?Q?olution=2C?= jour de la Pintade X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Fri, 12 Jul 2024 10:40:53 +0200 Message-ID: <87r0bzypd6.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062 Cc: 72062@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hello! Romain GARBAGE skribis: > * gnu/packages/mpi.scm (openmpi-5): New variable. > > Change-Id: I048692b2e928077c9cfa9fb8076ceb356251e1db [...] > +(define-public openmpi-5 > + (package/inherit openmpi I think it=E2=80=99s a case where (package (inherit openmpi) =E2=80=A6) is = more appropriate: =E2=80=98package/inherit=E2=80=99 would cause the =E2=80=98rep= lacement=E2=80=99 of =E2=80=98openmpi=E2=80=99 to be inherited, which is probably not a good ide= a since it=E2=80=99s a different version. > + (substitute-keyword-arguments (package-arguments openmpi) > + ((#:configure-flags flags) > + #~(append (list "--enable-prte-prefix-by-default" ;replaces --en= able-mpirun-prefix-by-default > + ;; Enable support for the 'Process Management > + ;; Interface for Exascale' (PMIx) used e.g. by > + ;; Slurm for the management communication and > + ;; coordination of MPI processes. > + (string-append "--with-pmix=3D" #$(this-package-= input "openpmix")) > + (string-append "--with-prrte=3D" #$(this-package= -input "prrte")) > + > + ;; Since 5.x, Infiniband support is provided by = ucx. > + (string-append "--with-ucx=3D" #$(this-package-i= nput "ucx"))) > + (filter (lambda (e) > + (and (not (string-contains e "pmi")) ;; Sinc= e 5.x, OpenMPI doesn't support PMI/PMI-2 > + ;; Deprecated since 5.x. > + (not (string-contains e "enable-mpirun-= prefix-by-default")) > + ;; Infiniband support is deprecated and= superseded by ucx > + ;; See https://docs.open-mpi.org/en/mai= n/release-notes/networks.html#miscellaneous-network-notes > + (not (string-contains e "openib")))) > + #$flags))) How about listing all the configure flags explicitly rather than relative to those of 4.x? I feel like this would be clearer and that there=E2=80=99s little to be gained by factorizing anyway. Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 04:42:56 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 08:42:56 +0000 Received: from localhost ([127.0.0.1]:53162 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSBrk-0004lb-5e for submit@debbugs.gnu.org; Fri, 12 Jul 2024 04:42:56 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:11415) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSBrh-0004lJ-T2 for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 04:42:54 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:in-reply-to:references:date: message-id:mime-version:content-transfer-encoding; bh=zF1ZEfUd8qtM9Rkz6GOT8oucwxwF1zrHtqtddVZLLa8=; b=ISJZthbVRZ5cSVdElzCv3VmEQb/kW+M3QfW+kR4LlMOQ3tdefkL3J6+d +Jfd5TL+EdCAP9xUcgayfxaCEkDavwg/A3kKUnjl/K+qY7Oxxgj9rvRl3 NZL2cozvLIibkUhJsw/bF+FAdV6TDIQQjlkjbawLy9Uy59V4cJl/AHYIl s=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="92014154" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 10:42:48 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Romain GARBAGE Subject: Re: [PATCH 3/4] gnu: Add openmpi-5. In-Reply-To: <20240711143540.25601-3-romain.garbage@inria.fr> (Romain GARBAGE's message of "Thu, 11 Jul 2024 16:35:24 +0200") References: <20240711143540.25601-1-romain.garbage@inria.fr> <20240711143540.25601-3-romain.garbage@inria.fr> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Quintidi 25 Messidor an 232 de la =?utf-8?Q?R=C3=A9v?= =?utf-8?Q?olution=2C?= jour de la Pintade X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Fri, 12 Jul 2024 10:42:47 +0200 Message-ID: <87msmnypa0.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062 Cc: 72062@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Romain GARBAGE skribis: > +(define-public openmpi-5 Also, probably as a separate patch, you could rename =E2=80=98openmpi=E2=80= =99 to =E2=80=98openmpi-4=E2=80=99 and add: (define-public openmpi openmpi-4) That way, we=E2=80=99ll only have to touch that variable when we decide to upgrade wholesale. WDYT? Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 04:44:14 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 08:44:14 +0000 Received: from localhost ([127.0.0.1]:53166 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSBt0-0004o1-IE for submit@debbugs.gnu.org; Fri, 12 Jul 2024 04:44:14 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:11494) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSBsy-0004nn-MI for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 04:44:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:in-reply-to:references:date: message-id:mime-version:content-transfer-encoding; bh=bqqjAYxEjlDWoiDUxLAoBymvmBiF57n5zXpNZManB9A=; b=BooKSqQEHV8fIci9WMBTsRnEvwrSuexsX0I5aWKkfgDtuF4R9VdYAk5X XHaI9RdsH5AxvrBZdy1gso/a0J//Jatl79Hbn6I1u8VLKqmQeHNd0n8wt lQQUfy7XTxJterycvE9xTfCWXrVDzInL9SEcBUh63a/aSdlU4/ogBzLg1 o=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="92014338" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 10:44:07 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Romain GARBAGE Subject: Re: [PATCH 0/4] Add OpenMPI 5.x In-Reply-To: <20240711143230.12467-1-romain.garbage@inria.fr> (Romain GARBAGE's message of "Thu, 11 Jul 2024 16:25:08 +0200") References: <20240711143230.12467-1-romain.garbage@inria.fr> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Quintidi 25 Messidor an 232 de la =?utf-8?Q?R=C3=A9v?= =?utf-8?Q?olution=2C?= jour de la Pintade X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Fri, 12 Jul 2024 10:44:06 +0200 Message-ID: <87ikxbyp7t.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062 Cc: 72062@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Romain GARBAGE skribis: > gnu: Add openpmix. > gnu: Add prrte. > gnu: Add openmpi-5. > gnu: slurm: Add PMIx support. Apart from the minor issues I reported, it LGTM! Let=E2=80=99s see if qa.g= uix can give it a try=E2=80=A6 Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 07:53:11 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 11:53:11 +0000 Received: from localhost ([127.0.0.1]:53386 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpq-0006n0-LT for submit@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:11 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:40873) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpn-0006mT-Me for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=VD2b0fXyYFCpNeM+EyRADubiwcMQPuFsrzenm3UhTA4=; b=ouoUF7XIvMKiEDYaeq899hEFS8ulDPdRSKh2bK2Plp8fzfTvHkJLycu4 RsDT5j51xvyNZMt0guL5bEqv0P/C9M3hq0UPNlX4MpyiCrcBB+9CDe6Bi zXQ+RuQYvthJLkniVdR22gSYFpeWKb6zVa04MGRB2ge3W0C5pUCneLHn8 s=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175229856" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 13:53:00 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v2 0/5] Add OpenMPI 5.x. Date: Fri, 12 Jul 2024 13:47:01 +0200 Message-ID: <20240712115235.20217-1-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Changes from v1->v2: * Swapped patches #3 and #4 so SLURM with PMIx support is present before OpenMPI 5.x. * (openmpi-5)[arguments]: configure flags are not derived from the inherited package but fully listed. * (openmpi-5): Switched from package/inherit to (inherit ...). * Renamed openmpi to openmpi-4. * Set openmpi-4 as default openmpi. Romain GARBAGE (5): gnu: Add openpmix. gnu: Add prrte. gnu: slurm: Add PMIx support. gnu: Add openmpi-5. gnu: openmpi: Set default version to 4.x. gnu/packages/mpi.scm | 63 +++++++++++++++++++++++++++++++++++- gnu/packages/parallel.scm | 68 +++++++++++++++++++++++++++++++++++++++ 2 files changed, 130 insertions(+), 1 deletion(-) base-commit: 0663668507377a849317b0fff3d72f609c3139c2 -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 07:53:14 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 11:53:14 +0000 Received: from localhost ([127.0.0.1]:53391 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpt-0006nb-Gg for submit@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:14 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:40875) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpp-0006mn-Aw for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:10 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=crT74xfYN/yker4IvbpOuL6NoQm/P175aP7P34bLYOU=; b=qI1SCEymcdDMy2i6iSytwAz+h0Ec1JqJeyaF2niy/S5Nb/obd2eCzWXs zrt/v9XkxO/uGviezB4cQwS9QbN6c9JdhZnjMl1U8ULESedop+4vVSCue lhJSynbm6HquWzgcG+uE1Qx/AhDqoLzeeOp8Z/HK67KRFXEnQp3enaOiT 0=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175229865" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 13:53:03 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v2 1/5] gnu: Add openpmix. Date: Fri, 12 Jul 2024 13:47:02 +0200 Message-ID: <20240712115235.20217-2-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712115235.20217-1-romain.garbage@inria.fr> References: <20240712115235.20217-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/parallel.scm (openpmix): New variable. Change-Id: Id23bc710c9b61ede0aebf7e2a18863fbe5fb8304 --- gnu/packages/parallel.scm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index a16a0d8689..4a57e85e6c 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -14,6 +14,7 @@ ;;; Copyright © 2021 Stefan Reichör ;;; Copyright © 2024 Zheng Junjie <873216071@qq.com> ;;; Copyright © 2024 David Elsing +;;; Copyright © 2024 Romain Garbage ;;; ;;; This file is part of GNU Guix. ;;; @@ -51,6 +52,7 @@ (define-module (gnu packages parallel) #:use-module (gnu packages documentation) #:use-module (gnu packages flex) #:use-module (gnu packages freeipmi) + #:use-module (gnu packages libevent) #:use-module (gnu packages linux) #:use-module (gnu packages maths) #:use-module (gnu packages mpi) @@ -612,3 +614,33 @@ (define-public psimd "This header-only C++ library provides a portable interface to single-instruction multiple-data (SIMD) intrinsics.") (license license:expat)))) + +(define-public openpmix + (package + (name "openpmix") + (version "4.2.8") + (source (origin + (method url-fetch) + (uri (string-append + "https://github.com/openpmix/openpmix/releases/download/v" + version "/pmix-" version ".tar.bz2")) + (sha256 + (base32 + "1j9xlhqrrmgjdkwakamn78y5gj756adi53hn25zksgr3is3l5d09")))) + (build-system gnu-build-system) + (arguments + (list #:configure-flags #~(list (string-append "--with-hwloc=" + (ungexp (this-package-input "hwloc") "lib"))))) + (inputs (list libevent + `(,hwloc "lib"))) + (native-inputs (list perl + python)) + (synopsis "PMIx library") + (description + "PMIx is an application programming interface standard that provides +libraries and programming models with portable and well-defined access +to commonly needed services in distributed and parallel computing +systems.") + (home-page "https://pmix.org/") + ;; The provided license is kind of BSD-style but specific. + (license (license:fsf-free "https://github.com/openpmix/openpmix?tab=License-1-ov-file#License-1-ov-file")))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 07:53:14 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 11:53:14 +0000 Received: from localhost ([127.0.0.1]:53393 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpu-0006nd-3t for submit@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:14 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:40873) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpp-0006mT-TU for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=yqsPhFoI4Fl83DImr6eG3PxIPhBaoR6gI55hWdqQksI=; b=qvTCtBUuKXGRfNkJ38Ol4xkmJT9V469gMovdm56cmyitXIb1yJ780BGN ePl6XxIGZKThKnUDdWNu6G5mtk8FW5Jm5YN3FsEPo36rcZvBDJjCyb2qm R9AWJEnDK9gZhet8smaBNJb+CmD89YYKXS30pB3lBmFmobjAK7zY98UTN k=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175229873" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 13:53:05 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v2 2/5] gnu: Add prrte. Date: Fri, 12 Jul 2024 13:47:03 +0200 Message-ID: <20240712115235.20217-3-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712115235.20217-1-romain.garbage@inria.fr> References: <20240712115235.20217-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -0.6 (/) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.6 (-) * gnu/packages/parallel.scm (prrte): New variable. Change-Id: I4427eec1a5c7d94ed5f9cbceb55f9372834a8971 --- gnu/packages/parallel.scm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index 4a57e85e6c..f173d1b75e 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -644,3 +644,35 @@ (define-public openpmix (home-page "https://pmix.org/") ;; The provided license is kind of BSD-style but specific. (license (license:fsf-free "https://github.com/openpmix/openpmix?tab=License-1-ov-file#License-1-ov-file")))) + +(define-public prrte + (package + (name "prrte") + (version "3.0.6") + (source (origin + (method url-fetch) + (uri (string-append + "https://github.com/openpmix/prrte/releases/download/v" + version "/prrte-" version ".tar.bz2")) + (sha256 + (base32 + "0wiy0vk37v4db1jgxza8bci0cczcvj34dalzsrlz05dk45zb7dl3")))) + (build-system gnu-build-system) + (arguments + (list #:configure-flags #~(list (string-append "--with-hwloc=" + (assoc-ref %build-inputs "hwloc")) + (string-append "--with-pmix=" #$(this-package-input "openpmix"))))) + (inputs (list libevent + `(,hwloc "lib") + openpmix)) + (native-inputs (list perl)) + (synopsis "PMIx Reference RunTime Environment (PRRTE)") + (description + "The PMIx Reference RunTime Environment is a runtime environment +containing the reference implementation and capable of operating +within a host SMS. The reference RTE therefore provides an easy way of +exploring PMIx capabilities and testing PMIx-based applications +outside of a PMIx-enabled environment.") + (home-page "https://openpmix.github.io/") + ;; The provided license is kind of BSD-style but specific. + (license (license:fsf-free "https://github.com/openpmix/prrte?tab=License-1-ov-file#License-1-ov-file")))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 07:53:15 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 11:53:15 +0000 Received: from localhost ([127.0.0.1]:53395 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpu-0006nl-Ia for submit@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:15 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:40875) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpr-0006mn-7a for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=+jQ0/oHP/eKvOT/d+bvrYUhMykBXe2PNcrO44HN/0dw=; b=Xo1nuJGqgmFJcwKDILroAi6vwizj1v1WUhAeJOzIOQETbYn+YIThrYJS 2kRd/SV+6AhoubmxWWpS95TNYHvegsKYyHcJ1NuK+gUpKNA/GSZeM3dJo oV57KR/qvczEoEeGX0f5pF+5mc5wfTBHkT/NcPHHfzaLf3c1Fo7BsCezA E=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175229876" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 13:53:07 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v2 3/5] gnu: slurm: Add PMIx support. Date: Fri, 12 Jul 2024 13:47:04 +0200 Message-ID: <20240712115235.20217-4-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712115235.20217-1-romain.garbage@inria.fr> References: <20240712115235.20217-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/parallel.scm (slurm) [inputs]: Add dependency. [arguments]: Update configure flags. Change-Id: I6544be5eb44980191d0788738ab960263c56c0ba --- gnu/packages/parallel.scm | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index f173d1b75e..694968b727 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -229,6 +229,7 @@ (define-public slurm `(,hwloc-2 "lib") json-c linux-pam + openpmix munge numactl readline)) @@ -245,6 +246,9 @@ (define-public slurm (string-append "--with-json=" #$(this-package-input "json-c")) (string-append "--with-munge=" #$(this-package-input "munge")) + ;; Use PMIx bundled with Open MPI (this is required for Open MPI 5.x). + (string-append "--with-pmix=" #$(this-package-input "openpmix")) + ;; 32-bit support is marked as deprecated and needs to be ;; explicitly enabled. #$@(if (target-64bit?) '() '("--enable-deprecated"))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 07:53:15 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 11:53:15 +0000 Received: from localhost ([127.0.0.1]:53397 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpv-0006nt-9r for submit@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:15 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:40884) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEps-0006mq-2Y for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:12 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=e/m783Mvvi3wqxLnwqBuX5w14qe40EHh8t3HALJ2LqE=; b=FzTdVPygMeNoaf4VR3T7CKgNR1F7854HIJfZK3itZ7CA5VxQ0aaowbWa HO+KpT0Tr4O2Hieb4WH37uMVLo2CVwMiHHbgltK0k42gsAKv2B0pebpo8 DKlIl2e5NzFO+LGMfiuBXWGhLHoP+iXhIFTVkOOD/paZJA/N4qMe5mCoO E=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175229891" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 13:53:11 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v2 5/5] gnu: openmpi: Set default version to 4.x. Date: Fri, 12 Jul 2024 13:47:06 +0200 Message-ID: <20240712115235.20217-6-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712115235.20217-1-romain.garbage@inria.fr> References: <20240712115235.20217-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/mpi.scm (openmpi-4): New variable. (openmpi): Redefine variable. Change-Id: I899e6259c9bcc579622c57a1ad1e9665f0e5db7f --- gnu/packages/mpi.scm | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm index 01f07a0f7c..08cfbc3062 100644 --- a/gnu/packages/mpi.scm +++ b/gnu/packages/mpi.scm @@ -185,7 +185,9 @@ (define-public hwloc ;; The latest stable series of hwloc. hwloc-2) -(define-public openmpi +(define-public openmpi openmpi-4) + +(define-public openmpi-4 (package (name "openmpi") (version "4.1.6") -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 07:53:16 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 11:53:16 +0000 Received: from localhost ([127.0.0.1]:53399 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpv-0006o4-NA for submit@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:16 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:40873) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEpr-0006mT-DH for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 07:53:12 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=cbM8mwrO+H9LSBuYWvVfbRlbWYUyW9KXXgE9XUjVVDc=; b=Hx1JgYgFEsD09tNJFipypVes5Ise6dipgLJqlDbEwzaZ0/GZFMradpjU FYTLTzXdzRIBTIFhFtfDUQ7alLzx46H1XHiYjI5q1afFLpi+nazOdyAC9 8tDsCDg1RW7o8Iy5Eg+UnLPaNI+fZl1FvEsydbSagosbrF7g9b0wYx6mR Y=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175229878" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 13:53:09 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v2 4/5] gnu: Add openmpi-5. Date: Fri, 12 Jul 2024 13:47:05 +0200 Message-ID: <20240712115235.20217-5-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712115235.20217-1-romain.garbage@inria.fr> References: <20240712115235.20217-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/mpi.scm (openmpi-5): New variable. Change-Id: I048692b2e928077c9cfa9fb8076ceb356251e1db --- gnu/packages/mpi.scm | 59 ++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 59 insertions(+) diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm index 6270108b16..01f07a0f7c 100644 --- a/gnu/packages/mpi.scm +++ b/gnu/packages/mpi.scm @@ -8,6 +8,7 @@ ;;; Copyright © 2018–2022 Tobias Geerinckx-Rice ;;; Copyright © 2018 Paul Garlick ;;; Copyright © 2019, 2021 Ricardo Wurmus +;;; Copyright © 2024 Romain Garbage ;;; ;;; This file is part of GNU Guix. ;;; @@ -49,6 +50,7 @@ (define-module (gnu packages mpi) #:use-module (gnu packages ncurses) #:use-module (gnu packages parallel) #:use-module (gnu packages pkg-config) + #:use-module (gnu packages python) #:use-module (gnu packages valgrind) #:use-module (srfi srfi-1) #:use-module (ice-9 match)) @@ -307,6 +309,63 @@ (define-public openmpi ;; See file://LICENSE (license license:bsd-2))) +(define-public openmpi-5 + (package + (inherit openmpi) + (version "5.0.3") + (source + (origin + (method url-fetch) + (uri (string-append "https://www.open-mpi.org/software/ompi/v" + (version-major+minor version) + "/downloads/openmpi-" version ".tar.bz2")) + (sha256 + (base32 "02x9xmpggw77mdpikjjx83j6i4v3gkqbncda73lk5axk0vr841cr")))) + + (inputs (modify-inputs (package-inputs openmpi) + ;; As of Open MPI 5.0.X, PMIx is used to communicate + ;; with SLURM, so SLURM'S PMI is no longer needed. + (delete "slurm") + (append ucx) ;for Infiniband support + (append openpmix) ;for PMI support (launching via "srun") + (append prrte))) ;for PMI support (launching via "srun") + (native-inputs (modify-inputs (package-native-inputs openmpi) + (append python))) + + (outputs '("out" "debug")) + (arguments + (substitute-keyword-arguments (package-arguments openmpi) + ((#:configure-flags _) + #~(list "--enable-mpi-ext=affinity" ;cr doesn't work + "--with-sge" + + #$@(if (package? (this-package-input "valgrind")) + #~("--enable-memchecker" + "--with-valgrind") + #~("--without-valgrind")) + + "--with-hwloc=external" + "--with-libevent" + + ;; This replaces --enable-mpirun-prefix-by-default wich is deprecated + ;; since 5.x. + "--enable-prte-prefix-by-default" + + ;; Enable support for the 'Process Management Interface for Exascale' + ;; (PMIx) used e.g. by Slurm for the management communication and + ;; coordination of MPI processes. + (string-append "--with-pmix=" #$(this-package-input "openpmix")) + (string-append "--with-prrte=" #$(this-package-input "prrte")) + + ;; Since 5.x, Infiniband support is provided by ucx. + ;; See https://docs.open-mpi.org/en/main/release-notes/networks.html#miscellaneous-network-notes + (string-append "--with-ucx=" #$(this-package-input "ucx")))) + + ((#:phases phases) + #~(modify-phases #$phases + (delete 'remove-absolute) + (delete 'scrub-timestamps))))))) + (define-public openmpi-c++ (package/inherit openmpi (name "openmpi-c++") -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 08:01:54 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 12:01:54 +0000 Received: from localhost ([127.0.0.1]:53416 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyH-00072V-Qj for submit@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:54 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:1632) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyF-00072D-8r for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:52 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=TeGdLEShhFAHqKeb935isqCW3/vPeZfp59gc98t1BFg=; b=cwIkhzeqhmMsER7vQ367YM86u9XnZ0VussxjCn7yu+omwpOefaVuqab3 d7S9je3r2GYg3Gn7HxHmtkxA6Uc5GTxR9Za8bBPFRI4ff9vgX9+zePFEL 1LuBjiHScIiR7W+r2Pjc7Aime6/94bBtlM7nOeP48kfXi50lYOM4JM53X 4=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175231340" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 14:01:44 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v3 0/5] Add OpenMPI 5.x. Date: Fri, 12 Jul 2024 14:00:00 +0200 Message-ID: <20240712120140.20391-1-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Changes from v2->v3 * Moved the definition of openmpi below openmpi-4 (fixes build breakage). Romain GARBAGE (5): gnu: Add openpmix. gnu: Add prrte. gnu: slurm: Add PMIx support. gnu: Add openmpi-5. gnu: openmpi: Set default version to 4.x. gnu/packages/mpi.scm | 63 +++++++++++++++++++++++++++++++++++- gnu/packages/parallel.scm | 68 +++++++++++++++++++++++++++++++++++++++ 2 files changed, 130 insertions(+), 1 deletion(-) base-commit: 0663668507377a849317b0fff3d72f609c3139c2 -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 08:01:58 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 12:01:58 +0000 Received: from localhost ([127.0.0.1]:53422 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyK-00072p-6L for submit@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:58 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:1634) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyF-00072F-F5 for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=crT74xfYN/yker4IvbpOuL6NoQm/P175aP7P34bLYOU=; b=a1C6yNJ/iUGLomIDSrPFS75WSc2lroX+nLn4R99doKYz+oZnyvSJ5TIi LyQ1KBJ9tuDeoni+Tj/ECA7L+MeXjnNlNN8jlt6+Pxm5St/rhd77BfkY+ J7a2A4O+6a+4pk3193hGf8lNBgnb3Iq7MGBe6Azsh2i0JxPcG/pzBC8OQ w=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175231342" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 14:01:45 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v3 1/5] gnu: Add openpmix. Date: Fri, 12 Jul 2024 14:00:01 +0200 Message-ID: <20240712120140.20391-2-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712120140.20391-1-romain.garbage@inria.fr> References: <20240712120140.20391-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/parallel.scm (openpmix): New variable. Change-Id: Id23bc710c9b61ede0aebf7e2a18863fbe5fb8304 --- gnu/packages/parallel.scm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index a16a0d8689..4a57e85e6c 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -14,6 +14,7 @@ ;;; Copyright © 2021 Stefan Reichör ;;; Copyright © 2024 Zheng Junjie <873216071@qq.com> ;;; Copyright © 2024 David Elsing +;;; Copyright © 2024 Romain Garbage ;;; ;;; This file is part of GNU Guix. ;;; @@ -51,6 +52,7 @@ (define-module (gnu packages parallel) #:use-module (gnu packages documentation) #:use-module (gnu packages flex) #:use-module (gnu packages freeipmi) + #:use-module (gnu packages libevent) #:use-module (gnu packages linux) #:use-module (gnu packages maths) #:use-module (gnu packages mpi) @@ -612,3 +614,33 @@ (define-public psimd "This header-only C++ library provides a portable interface to single-instruction multiple-data (SIMD) intrinsics.") (license license:expat)))) + +(define-public openpmix + (package + (name "openpmix") + (version "4.2.8") + (source (origin + (method url-fetch) + (uri (string-append + "https://github.com/openpmix/openpmix/releases/download/v" + version "/pmix-" version ".tar.bz2")) + (sha256 + (base32 + "1j9xlhqrrmgjdkwakamn78y5gj756adi53hn25zksgr3is3l5d09")))) + (build-system gnu-build-system) + (arguments + (list #:configure-flags #~(list (string-append "--with-hwloc=" + (ungexp (this-package-input "hwloc") "lib"))))) + (inputs (list libevent + `(,hwloc "lib"))) + (native-inputs (list perl + python)) + (synopsis "PMIx library") + (description + "PMIx is an application programming interface standard that provides +libraries and programming models with portable and well-defined access +to commonly needed services in distributed and parallel computing +systems.") + (home-page "https://pmix.org/") + ;; The provided license is kind of BSD-style but specific. + (license (license:fsf-free "https://github.com/openpmix/openpmix?tab=License-1-ov-file#License-1-ov-file")))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 08:01:58 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 12:01:58 +0000 Received: from localhost ([127.0.0.1]:53425 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyM-000739-1o for submit@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:58 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:1634) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyI-00072F-45 for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:54 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=+jQ0/oHP/eKvOT/d+bvrYUhMykBXe2PNcrO44HN/0dw=; b=O29MklsKfx/RF37HEF8R025uxkRp0DMjXpsovzwCtiCwBv1vV3BXAOyf 1eNZ1vg2QwicAI7fzl7djln4bRCgGWi+K6Xx389ir39FTyQLOzkNHTPZJ ktSfLzrvjpp42ZMl2UGRXQoeRYflekgR7c4qc7EfQ3dJZXbMrClaKDuxj k=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175231349" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 14:01:45 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v3 3/5] gnu: slurm: Add PMIx support. Date: Fri, 12 Jul 2024 14:00:03 +0200 Message-ID: <20240712120140.20391-4-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712120140.20391-1-romain.garbage@inria.fr> References: <20240712120140.20391-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/parallel.scm (slurm) [inputs]: Add dependency. [arguments]: Update configure flags. Change-Id: I6544be5eb44980191d0788738ab960263c56c0ba --- gnu/packages/parallel.scm | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index f173d1b75e..694968b727 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -229,6 +229,7 @@ (define-public slurm `(,hwloc-2 "lib") json-c linux-pam + openpmix munge numactl readline)) @@ -245,6 +246,9 @@ (define-public slurm (string-append "--with-json=" #$(this-package-input "json-c")) (string-append "--with-munge=" #$(this-package-input "munge")) + ;; Use PMIx bundled with Open MPI (this is required for Open MPI 5.x). + (string-append "--with-pmix=" #$(this-package-input "openpmix")) + ;; 32-bit support is marked as deprecated and needs to be ;; explicitly enabled. #$@(if (target-64bit?) '() '("--enable-deprecated"))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 08:02:01 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 12:02:01 +0000 Received: from localhost ([127.0.0.1]:53427 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyO-00073S-DV for submit@debbugs.gnu.org; Fri, 12 Jul 2024 08:02:00 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:1634) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyI-00072F-S2 for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=cbM8mwrO+H9LSBuYWvVfbRlbWYUyW9KXXgE9XUjVVDc=; b=Mzr+LHYcGbxDp4RRCBAHC+mUnjJWxbuB08ISeEcjkaZHNNqglevFoWxj /Vk0+EC5q8aIaYPSAQGkL5kO0oZDdMOvDTuHecUkGOq3DjD1GrGpuZfsm MqXaq1wbsqvuljFGEg2AFqwGsyeQkeGwIVc9r26ZfpQ2+zTS3UW3SJBOy I=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175231351" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 14:01:46 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v3 4/5] gnu: Add openmpi-5. Date: Fri, 12 Jul 2024 14:00:04 +0200 Message-ID: <20240712120140.20391-5-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712120140.20391-1-romain.garbage@inria.fr> References: <20240712120140.20391-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/mpi.scm (openmpi-5): New variable. Change-Id: I048692b2e928077c9cfa9fb8076ceb356251e1db --- gnu/packages/mpi.scm | 59 ++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 59 insertions(+) diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm index 6270108b16..01f07a0f7c 100644 --- a/gnu/packages/mpi.scm +++ b/gnu/packages/mpi.scm @@ -8,6 +8,7 @@ ;;; Copyright © 2018–2022 Tobias Geerinckx-Rice ;;; Copyright © 2018 Paul Garlick ;;; Copyright © 2019, 2021 Ricardo Wurmus +;;; Copyright © 2024 Romain Garbage ;;; ;;; This file is part of GNU Guix. ;;; @@ -49,6 +50,7 @@ (define-module (gnu packages mpi) #:use-module (gnu packages ncurses) #:use-module (gnu packages parallel) #:use-module (gnu packages pkg-config) + #:use-module (gnu packages python) #:use-module (gnu packages valgrind) #:use-module (srfi srfi-1) #:use-module (ice-9 match)) @@ -307,6 +309,63 @@ (define-public openmpi ;; See file://LICENSE (license license:bsd-2))) +(define-public openmpi-5 + (package + (inherit openmpi) + (version "5.0.3") + (source + (origin + (method url-fetch) + (uri (string-append "https://www.open-mpi.org/software/ompi/v" + (version-major+minor version) + "/downloads/openmpi-" version ".tar.bz2")) + (sha256 + (base32 "02x9xmpggw77mdpikjjx83j6i4v3gkqbncda73lk5axk0vr841cr")))) + + (inputs (modify-inputs (package-inputs openmpi) + ;; As of Open MPI 5.0.X, PMIx is used to communicate + ;; with SLURM, so SLURM'S PMI is no longer needed. + (delete "slurm") + (append ucx) ;for Infiniband support + (append openpmix) ;for PMI support (launching via "srun") + (append prrte))) ;for PMI support (launching via "srun") + (native-inputs (modify-inputs (package-native-inputs openmpi) + (append python))) + + (outputs '("out" "debug")) + (arguments + (substitute-keyword-arguments (package-arguments openmpi) + ((#:configure-flags _) + #~(list "--enable-mpi-ext=affinity" ;cr doesn't work + "--with-sge" + + #$@(if (package? (this-package-input "valgrind")) + #~("--enable-memchecker" + "--with-valgrind") + #~("--without-valgrind")) + + "--with-hwloc=external" + "--with-libevent" + + ;; This replaces --enable-mpirun-prefix-by-default wich is deprecated + ;; since 5.x. + "--enable-prte-prefix-by-default" + + ;; Enable support for the 'Process Management Interface for Exascale' + ;; (PMIx) used e.g. by Slurm for the management communication and + ;; coordination of MPI processes. + (string-append "--with-pmix=" #$(this-package-input "openpmix")) + (string-append "--with-prrte=" #$(this-package-input "prrte")) + + ;; Since 5.x, Infiniband support is provided by ucx. + ;; See https://docs.open-mpi.org/en/main/release-notes/networks.html#miscellaneous-network-notes + (string-append "--with-ucx=" #$(this-package-input "ucx")))) + + ((#:phases phases) + #~(modify-phases #$phases + (delete 'remove-absolute) + (delete 'scrub-timestamps))))))) + (define-public openmpi-c++ (package/inherit openmpi (name "openmpi-c++") -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 08:02:01 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 12:02:02 +0000 Received: from localhost ([127.0.0.1]:53431 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyP-00073g-FO for submit@debbugs.gnu.org; Fri, 12 Jul 2024 08:02:01 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:1634) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyL-00072F-Cj for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 08:01:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=OHAovuc3trlig4zqoxAXwzwRcZ0fW/r+r8KDR7LqZa8=; b=kl97cPhLyu4RKzSDdT1KCJEIb44HD3lM+z/mewZ5ZJBlZpZUSMxoods5 NwdfgYDbeu1se1XGjk+edFTNrrtHJuat7cD4Txz3hyRg+q0Khym21SD90 mhaKHmVTY29LJdfkof/kHTnD9wTg0mbikJzbcexYIcHc+4ypS+1+5fd0a k=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175231354" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 14:01:46 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v3 5/5] gnu: openmpi: Set default version to 4.x. Date: Fri, 12 Jul 2024 14:00:05 +0200 Message-ID: <20240712120140.20391-6-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712120140.20391-1-romain.garbage@inria.fr> References: <20240712120140.20391-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) * gnu/packages/mpi.scm (openmpi-4): New variable. (openmpi): Redefine variable. Change-Id: If5bb4429c935982ddaa1a5acbd728367ebbfd6fd --- gnu/packages/mpi.scm | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm index 01f07a0f7c..7b639b9033 100644 --- a/gnu/packages/mpi.scm +++ b/gnu/packages/mpi.scm @@ -185,7 +185,7 @@ (define-public hwloc ;; The latest stable series of hwloc. hwloc-2) -(define-public openmpi +(define-public openmpi-4 (package (name "openmpi") (version "4.1.6") @@ -309,6 +309,8 @@ (define-public openmpi ;; See file://LICENSE (license license:bsd-2))) +(define-public openmpi openmpi-4) + (define-public openmpi-5 (package (inherit openmpi) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Fri Jul 12 08:02:08 2024 Received: (at 72062) by debbugs.gnu.org; 12 Jul 2024 12:02:08 +0000 Received: from localhost ([127.0.0.1]:53439 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyW-00074t-0j for submit@debbugs.gnu.org; Fri, 12 Jul 2024 08:02:08 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:1632) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sSEyG-00072D-UG for 72062@debbugs.gnu.org; Fri, 12 Jul 2024 08:02:00 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=yqsPhFoI4Fl83DImr6eG3PxIPhBaoR6gI55hWdqQksI=; b=vY1gHQx5zE/2cOJeiS85N7ElfEfvuWTUetLlOSjhO4xzgfltewFtuGHQ SLwhRsDcpS2ei3Ei4y5Glta2yIxa5d07CORLzydBKvEgNvlL9y7MiQXut mbfqabM+b3FflKCMZ6PUF9+LAj2QNVSuJFmNrQfGNd05E37480mJfWo6s 0=; Authentication-Results: mail2-relais-roc.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=romain.garbage@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.09,202,1716242400"; d="scan'208";a="175231346" Received: from 91-164-88-5.subs.proxad.net (HELO localhost.localdomain) ([91.164.88.5]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Jul 2024 14:01:45 +0200 From: Romain GARBAGE To: 72062@debbugs.gnu.org Subject: [PATCH v3 2/5] gnu: Add prrte. Date: Fri, 12 Jul 2024 14:00:02 +0200 Message-ID: <20240712120140.20391-3-romain.garbage@inria.fr> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240712120140.20391-1-romain.garbage@inria.fr> References: <20240712120140.20391-1-romain.garbage@inria.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: -0.6 (/) X-Debbugs-Envelope-To: 72062 Cc: ludovic.courtes@inria.fr, Romain GARBAGE X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.6 (-) * gnu/packages/parallel.scm (prrte): New variable. Change-Id: I4427eec1a5c7d94ed5f9cbceb55f9372834a8971 --- gnu/packages/parallel.scm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index 4a57e85e6c..f173d1b75e 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -644,3 +644,35 @@ (define-public openpmix (home-page "https://pmix.org/") ;; The provided license is kind of BSD-style but specific. (license (license:fsf-free "https://github.com/openpmix/openpmix?tab=License-1-ov-file#License-1-ov-file")))) + +(define-public prrte + (package + (name "prrte") + (version "3.0.6") + (source (origin + (method url-fetch) + (uri (string-append + "https://github.com/openpmix/prrte/releases/download/v" + version "/prrte-" version ".tar.bz2")) + (sha256 + (base32 + "0wiy0vk37v4db1jgxza8bci0cczcvj34dalzsrlz05dk45zb7dl3")))) + (build-system gnu-build-system) + (arguments + (list #:configure-flags #~(list (string-append "--with-hwloc=" + (assoc-ref %build-inputs "hwloc")) + (string-append "--with-pmix=" #$(this-package-input "openpmix"))))) + (inputs (list libevent + `(,hwloc "lib") + openpmix)) + (native-inputs (list perl)) + (synopsis "PMIx Reference RunTime Environment (PRRTE)") + (description + "The PMIx Reference RunTime Environment is a runtime environment +containing the reference implementation and capable of operating +within a host SMS. The reference RTE therefore provides an easy way of +exploring PMIx capabilities and testing PMIx-based applications +outside of a PMIx-enabled environment.") + (home-page "https://openpmix.github.io/") + ;; The provided license is kind of BSD-style but specific. + (license (license:fsf-free "https://github.com/openpmix/prrte?tab=License-1-ov-file#License-1-ov-file")))) -- 2.45.1 From debbugs-submit-bounces@debbugs.gnu.org Mon Aug 19 10:10:35 2024 Received: (at 72062-done) by debbugs.gnu.org; 19 Aug 2024 14:10:35 +0000 Received: from localhost ([127.0.0.1]:58887 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sg35f-0005aj-7g for submit@debbugs.gnu.org; Mon, 19 Aug 2024 10:10:35 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:6687) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sg35c-0005aQ-JJ for 72062-done@debbugs.gnu.org; Mon, 19 Aug 2024 10:10:33 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:in-reply-to:references:date: message-id:mime-version; bh=lCx0weumdvLXp17qUB1M5CKmepqRfDB35Q2S27EIPHs=; b=PA6KGUDIORk5DK5lilVH0qmMTc6ghsf3wOwCsEHO2fhH+sc61eVfv9cC szU6Jw0GZiWET68QAkdibtQtycLhssZXMADJOUiHTvQ29Em5+u3Cg+ExX 1wPEDlFJIlGl7YILWu2uUsUxR4UZtnhrDimwqwL8eXtt9B1j6Wkkmcb5r M=; Authentication-Results: mail3-relais-sop.national.inria.fr; dkim=none (message not signed) header.i=none; spf=SoftFail smtp.mailfrom=ludovic.courtes@inria.fr; dmarc=fail (p=none dis=none) d=inria.fr X-IronPort-AV: E=Sophos;i="6.10,159,1719871200"; d="scan'208";a="94310549" Received: from unknown (HELO ribbon) ([193.50.110.123]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 19 Aug 2024 16:09:43 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Romain GARBAGE Subject: Re: [bug#72062] [PATCH v3 0/5] Add OpenMPI 5.x. In-Reply-To: <20240712120140.20391-1-romain.garbage@inria.fr> (Romain GARBAGE's message of "Fri, 12 Jul 2024 14:00:00 +0200") References: <20240711143230.12467-1-romain.garbage@inria.fr> <20240712120140.20391-1-romain.garbage@inria.fr> Date: Mon, 19 Aug 2024 16:09:42 +0200 Message-ID: <87le0svc2h.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 72062-done Cc: 72062-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello, Romain GARBAGE skribis: > gnu: Add openpmix. > gnu: Add prrte. > gnu: slurm: Add PMIx support. > gnu: Add openmpi-5. > gnu: openmpi: Set default version to 4.x. I made the change below to ensure that all the versions of the =E2=80=98slu= rm=E2=80=99 package would still build. It took me a while :-) but in the end it=E2=80= =99s just about removing =E2=80=98openmpix=E2=80=99 from the inputs of older ver= sions. Will push shortly. Thank you! Ludo=E2=80=99. --=-=-= Content-Type: text/x-patch Content-Disposition: inline diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm index c62402cf5c..440a808f68 100644 --- a/gnu/packages/parallel.scm +++ b/gnu/packages/parallel.scm @@ -247,7 +247,10 @@ (define-public slurm (string-append "--with-munge=" #$(this-package-input "munge")) ;; Use PMIx bundled with Open MPI (this is required for Open MPI 5.x). - (string-append "--with-pmix=" #$(this-package-input "openpmix")) + #$(let ((openmpix (this-package-input "openpmix"))) + (if openmpix + #~(string-append "--with-pmix=" #$openmpix) + "--without-pmix")) ;; 32-bit support is marked as deprecated and needs to be ;; explicitly enabled. @@ -310,10 +313,10 @@ (define-public slurm-22.05 (define-public slurm-21.08 (package - (inherit slurm) + (inherit slurm-22.05) (version "21.08.8") (source (origin - (inherit (package-source slurm)) + (inherit (package-source slurm-22.05)) (method url-fetch) (uri (string-append "https://download.schedmd.com/slurm/slurm-" @@ -321,14 +324,19 @@ (define-public slurm-21.08 (patches '()) ;drop 'salloc' patch (sha256 (base32 - "1sjln54idc9rhg8f2nvm38sgs6fncncyzslas8ixy65pqz2hphbf")))))) + "1sjln54idc9rhg8f2nvm38sgs6fncncyzslas8ixy65pqz2hphbf")))) + + ;; This and older versions of slurm have PMIx support but they seem to + ;; require an older version of openpmix. Disable PMIx support. + (inputs (pk 'x (modify-inputs (package-inputs slurm-22.05) + (delete "openpmix")))))) (define-public slurm-20.11 (package - (inherit slurm) + (inherit slurm-21.08) (version "20.11.9") (source (origin - (inherit (package-source slurm)) + (inherit (package-source slurm-21.08)) (method url-fetch) (uri (string-append "https://download.schedmd.com/slurm/slurm-" @@ -340,10 +348,10 @@ (define-public slurm-20.11 (define-public slurm-20.02 (package - (inherit slurm) + (inherit slurm-20.11) (version "20.02.6-1") (source (origin - (inherit (package-source slurm)) + (inherit (package-source slurm-20.11)) (method url-fetch) (uri (string-append "https://download.schedmd.com/slurm/slurm-" @@ -353,7 +361,7 @@ (define-public slurm-20.02 (base32 "0qj4blfymrd2ry2qmb58l3jbr4jwygc3adcfw7my27rippcijlyc")))) (arguments - (substitute-keyword-arguments (package-arguments slurm) + (substitute-keyword-arguments (package-arguments slurm-20.11) ((#:configure-flags flags ''()) #~(append '("CFLAGS=-O2 -g -fcommon" "LDFLAGS=-fcommon") #$flags)))))) @@ -363,7 +371,7 @@ (define-public slurm-19.05 (inherit slurm-20.02) (version "19.05.8") (source (origin - (inherit (package-source slurm)) + (inherit (package-source slurm-20.02)) (method url-fetch) (uri (string-append "https://download.schedmd.com/slurm/slurm-" @@ -376,11 +384,11 @@ (define-public slurm-19.05 ;; Same as Debian 10 (define-public slurm-18.08 (package - (inherit slurm-20.02) + (inherit slurm-19.05) (version "18.08.9") (source (origin - (inherit (package-source slurm)) + (inherit (package-source slurm-20.02)) (uri (string-append "https://download.schedmd.com/slurm/slurm-" version ".tar.bz2")) --=-=-=-- From unknown Sun Jul 27 00:27:07 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Tue, 17 Sep 2024 11:24:11 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator