Discussion:
remote job submission
Erica Riello
2014-09-08 17:25:52 UTC
Permalink
Hi,

I have Slurm 14.03.7 running in 2 machine "cluster". Now I'm trying to
submit a job from a machine outside of this cluster, but I find no
documentation on remote submission.

Does anyone know how to do this?

Thanks in advance.
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
Uwe Sauter
2014-09-08 17:57:32 UTC
Permalink
This post might be inappropriate. Click to display it.
Jason Bacon
2014-09-08 18:06:35 UTC
Permalink
You don't really need any cluster configuration for this, hence it
wouldn't be in the SLURM docs. It can be easily done using ordinary ssh
commands, e.g.

scp file.sbatch login-***@public.gmane.org
ssh login-***@public.gmane.org sbatch file.sbatch

If ssh keys are configured between the cluster and the remote machine,
neither command will prompt for a password. ( Use keys only from
trusted remote machines, though. )

This kind of simple remote execution can be used between any two Unix
machines on a network and is the basis of how SLURM and other resource
managers dispatch jobs to compute nodes.

Regards,

JB
Post by Erica Riello
Hi,
I have Slurm 14.03.7 running in 2 machine "cluster". Now I'm trying to
submit a job from a machine outside of this cluster, but I find no
documentation on remote submission.
Does anyone know how to do this?
Thanks in advance.
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Jason W. Bacon
jwbacon-***@public.gmane.org

Circumstances don't make a man:
They reveal him.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Erica Riello
2014-09-08 18:19:35 UTC
Permalink
Uwe,

But then would I be able to submit jobs to different clusters?

Regards,

Erica

Jason,

I was thinking of something more simple, like the -q option in torque / pbs

Regards,

Erica
Post by Jason Bacon
You don't really need any cluster configuration for this, hence it
wouldn't be in the SLURM docs. It can be easily done using ordinary ssh
commands, e.g.
If ssh keys are configured between the cluster and the remote machine,
neither command will prompt for a password. ( Use keys only from trusted
remote machines, though. )
This kind of simple remote execution can be used between any two Unix
machines on a network and is the basis of how SLURM and other resource
managers dispatch jobs to compute nodes.
Regards,
JB
Hi,
Post by Erica Riello
I have Slurm 14.03.7 running in 2 machine "cluster". Now I'm trying to
submit a job from a machine outside of this cluster, but I find no
documentation on remote submission.
Does anyone know how to do this?
Thanks in advance.
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Jason W. Bacon
They reveal him.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
j***@public.gmane.org
2014-09-08 18:25:17 UTC
Permalink
See the -M/--clusters option for almost all Slurm commands as
described in the man pages.
Post by Erica Riello
Uwe,
But then would I be able to submit jobs to different clusters?
Regards,
Erica
Jason,
I was thinking of something more simple, like the -q option in torque / pbs
Regards,
Erica
Post by Jason Bacon
You don't really need any cluster configuration for this, hence it
wouldn't be in the SLURM docs. It can be easily done using ordinary ssh
commands, e.g.
If ssh keys are configured between the cluster and the remote machine,
neither command will prompt for a password. ( Use keys only from trusted
remote machines, though. )
This kind of simple remote execution can be used between any two Unix
machines on a network and is the basis of how SLURM and other resource
managers dispatch jobs to compute nodes.
Regards,
JB
Hi,
Post by Erica Riello
I have Slurm 14.03.7 running in 2 machine "cluster". Now I'm trying to
submit a job from a machine outside of this cluster, but I find no
documentation on remote submission.
Does anyone know how to do this?
Thanks in advance.
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Jason W. Bacon
They reveal him.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
--
Morris "Moe" Jette
CTO, SchedMD LLC

Slurm User Group Meeting
September 23-24, Lugano, Switzerland
Find out more http://slurm.schedmd.com/slurm_ug_agenda.html
Uwe Sauter
2014-09-08 18:28:32 UTC
Permalink
Erica,

my configuration includes at least one frontend per cluster from which
users submit their jobs. This frontend runs munge and has slurm
installed but no service running, just the same configuration as on the
controller and nodes.

So the question doesn't come to mind in my case as users log in to the
frontend to submit jobs and access the cluster filesystems.

Regards,

Uwe
Post by Erica Riello
Uwe,
But then would I be able to submit jobs to different clusters?
Regards,
Erica
Jason,
I was thinking of something more simple, like the -q option in torque / pbs
Regards,
Erica
You don't really need any cluster configuration for this, hence it
wouldn't be in the SLURM docs. It can be easily done using ordinary
ssh commands, e.g.
If ssh keys are configured between the cluster and the remote
machine, neither command will prompt for a password. ( Use keys
only from trusted remote machines, though. )
This kind of simple remote execution can be used between any two
Unix machines on a network and is the basis of how SLURM and other
resource managers dispatch jobs to compute nodes.
Regards,
JB
Hi,
I have Slurm 14.03.7 running in 2 machine "cluster". Now I'm
trying to
submit a job from a machine outside of this cluster, but I find no
documentation on remote submission.
Does anyone know how to do this?
Thanks in advance.
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~__~~~~~
Jason W. Bacon
They reveal him.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~__~~~~~
--
===============
Erica Riello
Aluna Engenharia de Computação PUC-Rio
Continue reading on narkive:
Loading...