Skip to content
Snippets Groups Projects
Commit e361f207 authored by Jan David Mol's avatar Jan David Mol
Browse files

Task #9522: Run srun from Docker directly, without ssh to localhost

parent dd111b38
No related branches found
No related tags found
No related merge requests found
...@@ -44,7 +44,7 @@ globalfs = yes ...@@ -44,7 +44,7 @@ globalfs = yes
# We take the following path to start a remote container: # We take the following path to start a remote container:
# #
# [container] --SSH--> [host] --SRUN--> [worker node] --DOCKER--> [container] # [container] --SRUN--> [worker node] --DOCKER--> [container]
# #
# This path is needed because running SRUN from within the container needs a lot of cluster-specific infra # This path is needed because running SRUN from within the container needs a lot of cluster-specific infra
# (SLURM config files, Munge keys, correct Munge user ID, munged). # (SLURM config files, Munge keys, correct Munge user ID, munged).
...@@ -70,4 +70,4 @@ globalfs = yes ...@@ -70,4 +70,4 @@ globalfs = yes
# /bin/bash -c # /bin/bash -c
# #
# Required because the pipeline framework needs some bash functionality in the commands it starts. # Required because the pipeline framework needs some bash functionality in the commands it starts.
cmdline = ssh -n -tt -x localhost srun --exclusive --ntasks=1 --cpus-per-task={nr_cores} --jobid={slurm_job_id} --job-name={job_name} docker-run-slurm.sh --rm -u {uid} -v /data:/data --net=host {docker_env} lofar-pipeline:${LOFAR_TAG} {command} cmdline = srun --exclusive --ntasks=1 --cpus-per-task={nr_cores} --jobid={slurm_job_id} --job-name={job_name} docker-run-slurm.sh --rm -u {uid} -v /data:/data --net=host {docker_env} lofar-pipeline:${LOFAR_TAG} {command}
...@@ -485,8 +485,7 @@ wget -O - -q "http://ganglia.control.lofar/ganglia/api/events.php?action=add&sta ...@@ -485,8 +485,7 @@ wget -O - -q "http://ganglia.control.lofar/ganglia/api/events.php?action=add&sta
# run the pipeline # run the pipeline
runcmd docker-run-slurm.sh --rm --net=host \ runcmd docker-run-slurm.sh --rm --net=host \
-e LOFARENV={lofarenv} \ -e LOFARENV={lofarenv} \
-u $UID -e USER=$USER \ -v $HOME/.ssh:$HOME/.ssh:ro \
-e HOME=$HOME -v $HOME/.ssh:$HOME/.ssh:ro \
-e SLURM_JOB_ID=$SLURM_JOB_ID \ -e SLURM_JOB_ID=$SLURM_JOB_ID \
-v /data:/data \ -v /data:/data \
{image} \ {image} \
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment