beautypg.com

How lsf-hpc and slurm launch and manage a job, Figure 10-1, User – HP XC System 3.x Software User Manual

Page 103

background image

Figure 10-1 How LSF-HPC and SLURM Launch and Manage a Job

N 1 6

N16

User

1

2

4

6

6

6

6

7

7

7

7

5

job_starter.sh
$ srun -nl

myscript

Login node

$ bsub-n4 -ext ”SLURM[nodes-4]” -o output.out./myscript

LSF Execution Host

lsfhost.localdomain

SLURM_JOBID=53
SLURM_NPROCS=4

$ hostname

hostname

$ hostname

n1

n1

hostname

hostname

hostname

Compute Node

N2

Compute Node

N3

Compute Node

N4

n2

n3

n4

N16

Compute Node

srun

N1

myscript

$ srun hostname

$ mpirun -srun ./hellompi

3

1.

A user logs in to login node n16.

2.

The user executes the following LSF bsub command on login node n16:

$ bsub -n4 -ext "SLURM[nodes=4]" -o output.out ./myscript

This bsub command launches a request for four cores (from the -n4 option of the bsub
command) across four nodes (from the -ext "SLURM[nodes=4]" option); the job is
launched on those cores. The script, myscript, which is shown here, runs the job:

#!/bin/sh
hostname
srun hostname
mpirun -srun ./hellompi

3.

LSF-HPC schedules the job and monitors the state of the resources (

compute node

s) in the

SLURM lsf partition. When the LSF-HPC scheduler determines that the required resources
are available, LSF-HPC allocates those resources in SLURM and obtains a SLURM job
identifier (jobID) that corresponds to the allocation.

In this example, four cores spread over four nodes (n1,n2,n3,n4) are allocated for myscript,
and the SLURM job id of 53 is assigned to the allocation.

10.8 How LSF-HPC and SLURM Launch and Manage a Job

103