GNU bug report logs - #27917
high performance fabric support for openmpi

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 27917 in the body.
You can then email your comments to 27917 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Dave Love <fx <at> gnu.org>
To: guix-patches <at> gnu.org
Subject: high performance fabric support for openmpi
Date: Wed, 02 Aug 2017 14:47:17 +0100

[Message part 1 (text/plain, inline)]

This adds RDMA support to openmpi, and also the ofi (libfabric) mtl.

It still needs psm(2)/infinipath support.  I don't know where that
should go in the source; libpsm(2) makes sense in rdma-core, like mlx5,
but has separate sources.

[0002-gnu-Add-libfabric.patch (text/x-diff, attachment)]

[0001-gnu-openmpi-Add-RDMA-and-libfabric-support.patch (text/x-diff, attachment)]

Message #10 received at 27917-done <at> debbugs.gnu.org (full text, mbox):

From: Marius Bakke <mbakke <at> fastmail.com>
To: Dave Love <fx <at> gnu.org>, 27917-done <at> debbugs.gnu.org
Subject: Re: [bug#27917] high performance fabric support for openmpi
Date: Fri, 18 Aug 2017 00:36:45 +0200

[Message part 1 (text/plain, inline)]

Dave Love <fx <at> gnu.org> writes:

> This adds RDMA support to openmpi, and also the ofi (libfabric) mtl.

Awesome!

> It still needs psm(2)/infinipath support.  I don't know where that
> should go in the source; libpsm(2) makes sense in rdma-core, like mlx5,
> but has separate sources.

Can it not be built as a standalone package?

> From e6384acc4e486e5668c99a6d168c2543328e07b0 Mon Sep 17 00:00:00 2001
> From: Dave Love <fx <at> gnu.org>
> Date: Wed, 2 Aug 2017 14:22:49 +0100
> Subject: [PATCH 2/2] gnu: Add libfabric.
>
> * gnu/packages/linux.scm (libfabric): New function.

[...]

> +    (inputs `(("rdma-core" ,rdma-core)
> +              ;; add psm, psm(2)

Added a "TODO: ".

> +              ("libnl" ,libnl)))
> +    (home-page "http://ofiwg.github.io/libfabric/")
> +    (synopsis "Open Fabric Interfaces")
> +    (description
> +     "OpenFabrics Interfaces (OFI) is a framework focused on exporting fabric
> +communication services to applications.  OFI is best described as a collection
> +of libraries and applications used to export fabric services.  The key
> +components of OFI are: application interfaces, provider libraries, kernel
> +services, daemons, and test applications.
> +
> +Libfabric is a core component of OFI.  It is the library that defines and
> +exports the user-space API of OFI, and is typically the only software that
> +applications deal with directly.  It works in conjunction with provider
> +libraries, which are often integrated directly into libfabric.")
> +    (license (list license:bsd-3 license:gpl2)))) ;dual

This is the FreeBSD license (aka BSD-2).

> * gnu/packages/mpi.scm (openmpi)[inputs]: Add rdma-core, libfabric.

Applied both, thanks!

[signature.asc (application/pgp-signature, inline)]

Message #13 received at 27917-done <at> debbugs.gnu.org (full text, mbox):

From: Dave Love <fx <at> gnu.org>
To: Marius Bakke <mbakke <at> fastmail.com>
Cc: 27917-done <at> debbugs.gnu.org
Subject: Re: [bug#27917] high performance fabric support for openmpi
Date: Wed, 23 Aug 2017 11:17:02 +0100

Marius Bakke <mbakke <at> fastmail.com> writes:

>> It still needs psm(2)/infinipath support.  I don't know where that
>> should go in the source; libpsm(2) makes sense in rdma-core, like mlx5,
>> but has separate sources.
>
> Can it not be built as a standalone package?

Yes, but I don't see why it should be treated differently from, e.g.,
Mellanox support, if it doesn't significantly increase the closure.
(PSM is probably more important than some of the hardware support in
rdma-core.)  If you're using verbs rather than the PSM interface, which
I think is possible with OPA (psm2) as well as Infinipath/True Scale,
you'll get rather obscure errors if the hardware support is missing.
It's a common problem with hardware support (e.g. mlx4) in separate
packages without suitable dependencies, as in current RHEL, so I think
psm should at least be a dependency.

>> +    (license (list license:bsd-3 license:gpl2)))) ;dual
>
> This is the FreeBSD license (aka BSD-2).

Oops!  I'm usually more careful.  That reminds me of something I should
raise about licences generally...

Message #16 received at 27917-done <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Dave Love <fx <at> gnu.org>
Cc: Marius Bakke <mbakke <at> fastmail.com>, 27917-done <at> debbugs.gnu.org
Subject: Re: [bug#27917] high performance fabric support for openmpi
Date: Thu, 31 Aug 2017 14:39:24 +0200

Dave Love <fx <at> gnu.org> skribis:

> Marius Bakke <mbakke <at> fastmail.com> writes:

[...]

>>> +    (license (list license:bsd-3 license:gpl2)))) ;dual
>>
>> This is the FreeBSD license (aka BSD-2).
>
> Oops!  I'm usually more careful.

Give M-x guix-licenses a try if you haven’t already.  :-)

Ludo’.

Message #19 received at 27917-done <at> debbugs.gnu.org (full text, mbox):

From: Dave Love <fx <at> gnu.org>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: Marius Bakke <mbakke <at> fastmail.com>, 27917-done <at> debbugs.gnu.org
Subject: Re: [bug#27917] high performance fabric support for openmpi
Date: Fri, 01 Sep 2017 12:34:15 +0100

Ludovic Courtès <ludo <at> gnu.org> writes:

> Dave Love <fx <at> gnu.org> skribis:
>
>> Marius Bakke <mbakke <at> fastmail.com> writes:
>
> [...]
>
>>>> +    (license (list license:bsd-3 license:gpl2)))) ;dual
>>>
>>> This is the FreeBSD license (aka BSD-2).
>>
>> Oops!  I'm usually more careful.
>
> Give M-x guix-licenses a try if you haven’t already.  :-)
>
> Ludo’.

I hadn't, but that doesn't help with checking the package description as
far as I can see.  licencecheck support would do, but for lint use it
would need a translation of licence tags and have to account for some
packages using a module prefix with them.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.