Discussion:
pmi and hwloc
Ralph Castain
2014-07-13 14:19:37 UTC
Permalink
Just to clarify something: this only occurs when --with-pmi is provided. We *never* link directly against libslurm for licensing reasons, and --with-slurm doesn't cause us to link against any Slurm libraries.

So the only impact here is that we would have to drop support for directly launching apps using srun, and require the use of mpirun instead. Regrettable, but my point is to clarify that this doesn't preclude use of OMPI under Slurm environments.

Obviously, we would prefer to see it resolved, and that libpmi stand alone as an LGPL library :-) This goes beyond what Mike is requesting, which is to at least remove the hwloc dependency as PMI clearly doesn't require it.
Hi guys,
libpmi.la
libslurmdb.la
libslurm.la
This breaks OMPI compilation when either –with-pmi or –with-slurm flags provided to OMPI “configure”.
I checked previous SLURM 2.6.x version and it does not have such dependency for hwloc.
http://www.open-mpi.org/community/lists/devel/2014/07/15130.php
Please fix.
Thanks
Kind Regards,
Mike Dubman | R&D Senior Director, HPC
Tel: +972 (74) 712 9214 | Fax: +972 (74) 712 9111
Mellanox Ltd. 13 Zarchin St., Bldg B, Raanana 43662, Israel
Andy Riebs
2014-07-15 21:18:40 UTC
Permalink
Is there a reason to have libpmi depend on hwloc for some
architectures, even though it's not relevant for RHEL x86_64
clusters today?

Andy

On 07/13/2014 10:19 AM, Ralph Castain
wrote:
Just to clarify something: this only occurs when --with-pmi is
provided. We *never* link directly against libslurm for licensing
reasons, and --with-slurm doesn't cause us to link against any
Slurm libraries.
So the only impact here is that we would have to drop support
for directly launching apps using srun, and require the use of
mpirun instead. Regrettable, but my point is to clarify that
this doesn't preclude use of OMPI under Slurm environments.
Obviously, we would prefer to see it resolved, and that
libpmi stand alone as an LGPL library :-)  This goes beyond what
Mike is requesting, which is to at least remove the hwloc
dependency as PMI clearly doesn't require it.
On Jul 13, 2014, at 4:24 AM, Mike Dubman <miked-VPRAkNaXOzVWk0Htik3J/***@public.gmane.org>
wrote:
Hi guys,
 
The new SLURM 14.x series
contains “–lhwloc” dependency mentioned in
the dependency_libs= string, in the slurm
provided .la files:
 
libpmi.la
libslurmdb.la
libslurm.la
 
This breaks OMPI
compilation when either –with-pmi or
–with-slurm flags provided to OMPI
“configure”.
 
I checked previous SLURM
2.6.x version and it does not have such
dependency for hwloc.
 
_http://www.open-mpi.org/community/lists/devel/2014/07/15130.php_
 
Please fix.
Thanks
Kind Regards,
 
*Mike
Dubman* | R&D
Senior Director, HPC
Tel:  +972 (74) 712
9214 | Fax:
+972 (74) 712 9111
Mellanox Ltd. 13
Zarchin St., Bldg B, Raanana 43662, Israel
Danny Auble
2014-07-15 21:21:38 UTC
Permalink
In 14.11 it doesn't.
Post by Andy Riebs
Is there a reason to have libpmi depend on hwloc for some
architectures, even though it's not relevant for RHEL x86_64 clusters
today?
Andy
Post by Ralph Castain
Just to clarify something: this only occurs when --with-pmi is
provided. We *never* link directly against libslurm for licensing
reasons, and --with-slurm doesn't cause us to link against any Slurm
libraries.
So the only impact here is that we would have to drop support for
directly launching apps using srun, and require the use of mpirun
instead. Regrettable, but my point is to clarify that this doesn't
preclude use of OMPI under Slurm environments.
Obviously, we would prefer to see it resolved, and that libpmi stand
alone as an LGPL library :-) This goes beyond what Mike is
requesting, which is to at least remove the hwloc dependency as PMI
clearly doesn't require it.
Hi guys,
The new SLURM 14.x series contains “–lhwloc” dependency
mentioned in the dependency_libs= string, in the slurm provided .la
libpmi.la
libslurmdb.la
libslurm.la
This breaks OMPI compilation when either –with-pmi or
–with-slurm flags provided to OMPI “configure”.
I checked previous SLURM 2.6.x version and it does not have such dependency for hwloc.
_http://www.open-mpi.org/community/lists/devel/2014/07/15130.php_
Please fix.
Thanks
Kind Regards,
*Mike Dubman*|R&D Senior Director, HPC
Tel: +972 (74) 712 9214|Fax: +972 (74) 712 9111
Mellanox Ltd. 13 Zarchin St., Bldg B, Raanana 43662, Israel
Andy Riebs
2014-07-16 12:05:41 UTC
Permalink
Thanks Danny!

Andy

On 07/15/2014 05:21 PM, Danny Auble
wrote:
In 14.11 it doesn't.

On 07/15/2014 02:18 PM, Andy Riebs
wrote:

Is
there a reason to have libpmi depend on hwloc for some
architectures, even though it's not relevant for RHEL x86_64
clusters today?

Andy

On 07/13/2014 10:19 AM, Ralph
Castain wrote:

Just to clarify something: this only occurs when
--with-pmi is provided. We *never* link directly against
libslurm for licensing reasons, and --with-slurm doesn't cause
us to link against any Slurm libraries.
So the only impact here is that we would have to drop
support for directly launching apps using srun, and require
the use of mpirun instead. Regrettable, but my point is to
clarify that this doesn't preclude use of OMPI under Slurm
environments.
Obviously, we would prefer to see it resolved, and that
libpmi stand alone as an LGPL library :-)  This goes beyond
what Mike is requesting, which is to at least remove the
hwloc dependency as PMI clearly doesn't require it.
On Jul 13, 2014, at 4:24 AM, Mike Dubman <miked-VPRAkNaXOzVWk0Htik3J/***@public.gmane.org>
wrote:
Hi guys,
 
The new SLURM 14.x
series contains “–lhwloc”
dependency mentioned in the dependency_libs=
string, in the slurm provided .la files:
 
libpmi.la
libslurmdb.la
libslurm.la
 
This breaks OMPI
compilation when either –with-pmi or
–with-slurm flags provided to OMPI
“configure”.
 
I checked previous
SLURM 2.6.x version and it does not have
such dependency for hwloc.
 
_http://www.open-mpi.org/community/lists/devel/2014/07/15130.php_
 
Please fix.
Thanks
Kind Regards,
 
*Mike
Dubman* | R&D
Senior Director, HPC
Tel:  +972 (74)
712 9214 | Fax:
+972 (74) 712 9111
Mellanox Ltd. 13
Zarchin St., Bldg B, Raanana 43662, Israel

Loading...