From unknown Sat Jul 26 16:38:29 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#44387 <44387@debbugs.gnu.org> To: bug#44387 <44387@debbugs.gnu.org> Subject: Status: SLURM client version must match daemon version Reply-To: bug#44387 <44387@debbugs.gnu.org> Date: Sat, 26 Jul 2025 23:38:29 +0000 retitle 44387 SLURM client version must match daemon version reassign 44387 guix submitter 44387 Ludovic Court=C3=A8s severity 44387 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 02 04:11:05 2020 Received: (at submit) by debbugs.gnu.org; 2 Nov 2020 09:11:05 +0000 Received: from localhost ([127.0.0.1]:39743 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZVrl-0001Gb-7J for submit@debbugs.gnu.org; Mon, 02 Nov 2020 04:11:05 -0500 Received: from lists.gnu.org ([209.51.188.17]:45160) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZVrj-0001GQ-8R for submit@debbugs.gnu.org; Mon, 02 Nov 2020 04:11:03 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:41484) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kZVrj-0002Oy-3W for bug-guix@gnu.org; Mon, 02 Nov 2020 04:11:03 -0500 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:30713) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kZVrg-0001CY-Ir for bug-guix@gnu.org; Mon, 02 Nov 2020 04:11:02 -0500 X-IronPort-AV: E=Sophos;i="5.77,444,1596492000"; d="scan'208";a="475329382" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 02 Nov 2020 10:10:55 +0100 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Subject: SLURM client version must match daemon version X-Debbugs-CC: Ricardo Wurmus X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 12 Brumaire an 229 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 02 Nov 2020 10:10:55 +0100 Message-ID: <87imaonmxs.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=192.134.164.83; envelope-from=ludovic.courtes@inria.fr; helo=mail2-relais-roc.national.inria.fr X-detected-operating-system: by eggs.gnu.org: First seen = 2020/11/02 02:33:22 X-ACL-Warn: Detected OS = ??? X-Spam_score_int: -68 X-Spam_score: -6.9 X-Spam_bar: ------ X-Spam_report: (-6.9 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.3 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) Hello, We=E2=80=99ve noticed the problem below on clusters running a foreign distro when slurmd is version 19.x and our clients are version 20.x: --8<---------------cut here---------------start------------->8--- [courtes@devel01 ~]$ guix time-machine --commit=3D2f107f273de3db1d01bdec66b= 13334edef7ad036 -- package -A slurm Mise =C3=A0 jour du canal =C2=AB guix =C2=BB depuis le d=C3=A9p=C3=B4t Git = =C2=AB https://git.savannah.gnu.org/git/guix.git =C2=BB... python-slurm-magic 0.0-0.73dd1a2 out gnu/packages/parallel.scm:2= 25:4 slurm 20.02.5 out gnu/packages/parallel.scm:109:2 slurm-drmaa 1.1.1 out gnu/packages/parallel.scm:194:2 [courtes@devel01 ~]$ guix time-machine --commit=3D2f107f273de3db1d01bdec66b= 13334edef7ad036 -- environment --ad-hoc slurm -- squeue Mise =C3=A0 jour du canal =C2=AB guix =C2=BB depuis le d=C3=A9p=C3=B4t Git = =C2=AB https://git.savannah.gnu.org/git/guix.git =C2=BB... slurm_load_jobs error: Zero Bytes were transmitted or received [courtes@devel01 ~]$ guix time-machine --commit=3D09b00a62b297edb92ac4dde6f= 4838261ac0cad16 -- package -A slurm Mise =C3=A0 jour du canal =C2=AB guix =C2=BB depuis le d=C3=A9p=C3=B4t Git = =C2=AB https://git.savannah.gnu.org/git/guix.git =C2=BB... python-slurm-magic 0.0-0.73dd1a2 out gnu/packages/parallel.scm:2= 25:4 slurm 19.05.3-2 out gnu/packages/parallel.scm:109:2 slurm-drmaa 1.1.1 out gnu/packages/parallel.scm:194:2 [courtes@devel01 ~]$ guix time-machine --commit=3D09b00a62b297edb92ac4dde6f= 4838261ac0cad16 -- environment --ad-hoc slurm -- squeue Mise =C3=A0 jour du canal =C2=AB guix =C2=BB depuis le d=C3=A9p=C3=B4t Git = =C2=AB https://git.savannah.gnu.org/git/guix.git =C2=BB... JOBID PARTITION NAME USER ST TIME NODES NODELIS= T(REASON) [courtes@devel01 ~]$ /usr/bin/squeue --version slurm 19.05.2 --8<---------------cut here---------------end--------------->8--- It means that we cannot generally use the Guix-provided SLURM on clusters running foreign distros. reads: Slurm daemons will support RPCs and state files from the two previous major releases (e.g. a version 17.11.x SlurmDBD will support slurmctld daemons and commands with a version of 17.11.x, 17.02.x or 16.05.x). Looking at , there=E2=80=99s been quit= e a few releases between 19.05.3-2 and 20.02.5, which may explain the problem I described. Apparently the only .so in Open=C2=A0MPI linked against SLURM is =E2=80=98lib/openmpi/mca_pmix_s1.so=E2=80=99. The diff suggests that the t= wo versions are not ABI-compatible, so one wouldn=E2=80=99t be able to use =E2=80=98--with-= graft=E2=80=99 to graft one version in lieu of the other: --8<---------------cut here---------------start------------->8--- [courtes@devel01 ~]$ guix time-machine --commit=3D09b00a62b297edb92ac4dde6f= 4838261ac0cad16 -- build slurm Mise =C3=A0 jour du canal =C2=AB guix =C2=BB depuis le d=C3=A9p=C3=B4t Git = =C2=AB https://git.savannah.gnu.org/git/guix.git =C2=BB... /gnu/store/37b7qnwck4pg51qia4w002i62g156xgw-slurm-19.05.3-2 [courtes@devel01 ~]$ guix time-machine --commit=3D2f107f273de3db1d01bdec66b= 13334edef7ad036 -- build slurm Mise =C3=A0 jour du canal =C2=AB guix =C2=BB depuis le d=C3=A9p=C3=B4t Git = =C2=AB https://git.savannah.gnu.org/git/guix.git =C2=BB... /gnu/store/7n6aks2wcmn2pxv03q8ij38hsj9zfzk9-slurm-20.02.5 [courtes@devel01 ~]$ abidiff --stat /gnu/store/37b7qnwck4pg51qia4w002i62g15= 6xgw-slurm-19.05.3-2/lib/slurm/libslurmfull.so /gnu/store/7n6aks2wcmn2pxv03= q8ij38hsj9zfzk9-slurm-20.02.5/lib/slurm/libslurmfull.so Functions changes summary: 0 Removed, 0 Changed, 0 Added function Variables changes summary: 0 Removed, 0 Changed, 0 Added variable Function symbols changes summary: 80 Removed, 162 Added function symbols no= t referenced by debug info Variable symbols changes summary: 3 Removed, 0 Added variable symbols not r= eferenced by debug info --8<---------------cut here---------------end--------------->8--- What can we do about it? At least, we should package several known-useful versions, so that people can use =E2=80=98--with-input=3Dslurm@X=3Dslurm@Y=E2=80=99 (if neede= d) or explicitly refer to the version they want in their profile. I=E2=80=99ll work on that. Anything else? I heard that PMIx, a scheduler-independent API, will eventually supersede SLURM in Open=C2=A0MPI. Let=E2=80=99s see if that loosens version requirements. Thanks, Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 02 09:36:59 2020 Received: (at 44387) by debbugs.gnu.org; 2 Nov 2020 14:36:59 +0000 Received: from localhost ([127.0.0.1]:40248 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZax9-0007TL-JO for submit@debbugs.gnu.org; Mon, 02 Nov 2020 09:36:59 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41060) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZax7-0007T9-KQ for 44387@debbugs.gnu.org; Mon, 02 Nov 2020 09:36:58 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:47173) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kZax2-0002n4-5s; Mon, 02 Nov 2020 09:36:52 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=51668 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kZax1-00052n-ND; Mon, 02 Nov 2020 09:36:51 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: 44387@debbugs.gnu.org Subject: Re: bug#44387: SLURM client version must match daemon version References: <87imaonmxs.fsf@inria.fr> Date: Mon, 02 Nov 2020 15:36:50 +0100 In-Reply-To: <87imaonmxs.fsf@inria.fr> ("Ludovic =?utf-8?Q?Court=C3=A8s=22?= =?utf-8?Q?'s?= message of "Mon, 02 Nov 2020 10:10:55 +0100") Message-ID: <877dr3lta5.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 44387 Cc: Ricardo Wurmus X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Ludovic Court=C3=A8s skribis: > At least, we should package several known-useful versions, so that > people can use =E2=80=98--with-input=3Dslurm@X=3Dslurm@Y=E2=80=99 (if nee= ded) or explicitly > refer to the version they want in their profile. I=E2=80=99ll work on th= at. I=E2=80=99ve reintroduced version 19.05: https://git.savannah.gnu.org/cgit/guix.git/commit/?id=3De1bd62eb5ce0f2410= b2607f157989588791b43e0 From debbugs-submit-bounces@debbugs.gnu.org Mon Nov 02 11:26:20 2020 Received: (at 44387) by debbugs.gnu.org; 2 Nov 2020 16:26:21 +0000 Received: from localhost ([127.0.0.1]:42366 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZcey-0000LZ-IN for submit@debbugs.gnu.org; Mon, 02 Nov 2020 11:26:20 -0500 Received: from sender4-of-o51.zoho.com ([136.143.188.51]:21129) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZces-0000L9-D1 for 44387@debbugs.gnu.org; Mon, 02 Nov 2020 11:26:19 -0500 ARC-Seal: i=1; a=rsa-sha256; t=1604334363; cv=none; d=zohomail.com; s=zohoarc; b=mmXzRgxGpZKuKP27G1MENI7wXRZrYe1b+buR+cm8ujDpwOjvh4Gw9Fq8XyjVLZouVD4azTYFQ9UWzyJXcMQrTtyjK/g+SHiryKwWUp2+4Te0sMbOSp5L37zNCsjoYcfJQjVrm3YwNYPxXBlRcZXkwbLNbCC0T9PEJf5lXt1Bz34= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1604334363; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:To; bh=2CPXcctTEsWkcYYwUmO3A8+b1E39mjR5gT+S4LJyZMU=; b=RTW5yz2g3IrUmxD5SaRxVFtywlPxRaMluKzWaaAapebAT0XaCz/RkyGSTOAtivUcJAgKJe3RZeVqQjj3J9Qnf6MLPf8EooeLPlrl8+5fgY88tnrBmVlozpWjiNDtpsx7bGhA72EWhY+NWMIb2iYn3aARa8z2x56ZY179DprknKU= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1604334363; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; bh=2CPXcctTEsWkcYYwUmO3A8+b1E39mjR5gT+S4LJyZMU=; b=TPKeo5ALjNANPZEJBochoOvG24grImkAUwXQ17f7Mky5QnSPZ4GeVsA0m5AyKWg5 oCmFQuD354ms9ivwZfrDUDI+jEBsQli/pNbgIkLUoqenjiZ1zQVXIrsYJpHCB80R3Pe wzqMheRDL9yQY3IlzTE//Wm+yHXCXewSajLLhAjQ= Received: from localhost (p54ad474d.dip0.t-ipconnect.de [84.173.71.77]) by mx.zohomail.com with SMTPS id 1604334362389924.5302185296682; Mon, 2 Nov 2020 08:26:02 -0800 (PST) References: <87imaonmxs.fsf@inria.fr> <877dr3lta5.fsf@gnu.org> User-agent: mu4e 1.4.13; emacs 27.1 From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: bug#44387: SLURM client version must match daemon version In-reply-to: <877dr3lta5.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Mon, 02 Nov 2020 17:27:54 +0100 Message-ID: <87361rzpth.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 44387 Cc: 44387@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Ludovic Court=C3=A8s writes: > Ludovic Court=C3=A8s skribis: > >> At least, we should package several known-useful versions, so that >> people can use =E2=80=98--with-input=3Dslurm@X=3Dslurm@Y=E2=80=99 (if ne= eded) or explicitly >> refer to the version they want in their profile. I=E2=80=99ll work on t= hat. > > I=E2=80=99ve reintroduced version 19.05: > > https://git.savannah.gnu.org/cgit/guix.git/commit/?id=3De1bd62eb5ce0f24= 10b2607f157989588791b43e0 Good call. It seems like a good idea to keep older major versions around. There=E2=80=99s a similar problem with postgres, which needs (or used to ne= ed) more than one version to upgrade existing data from an older version. --=20 Ricardo