3 using the gnu parallel make capability, Using the gnu parallel make, Capability – HP XC System 3.x Software User Manual
Page 119
$ sinfo
PARTITION AVAIL TIMELIMIT NODES STATE NODELIST
lsf up infinite 2 idle n[46,48]
According to the information returned about this HP XC system, LSF-HPC has two nodes available
for use, n46 and n48.
Determine the address of your monitor's display server, as shown at the beginning of
an X Terminal Session from a Remote Node”
. You can start an X terminal session using this
address information in a bsub command with the appropriate options. For example:
$ bsub -n4 -Ip srun -n1 xterm -display 14.26.206.134:0.0
Job <159> is submitted to default queue
<
<
The options used in this command are:
-n4
allocate 4 cores
-Ip
interact with the X terminal session
srun -n1
run the job on 1 core
xterm
the job is an X terminal session
-display
monitor's display server address
A remote X terminal session appears on your monitor. The X terminal session job is launched
from node n47, which is the LSF execution host node. You can view this job using LSF-HPC and
SLURM commands. For example:
$ sinfo
PARTITION AVAIL TIMELIMIT NODES STATE NODELIST
lsf up infinite 2 alloc n[46,48]
$ squeue
JOBID PARTITION NAME USER ST TIME NODES NODELIST
117 lsf hptclsf@ username R 0:25 2 n[46,48]
$ bjobs
JOBID USER STAT QUEUE FROM_HOST EXEC_HOST JOB_NAME SUBMIT_TIME
119 lsfadmi RUN norma n48 4*n47 *8.136:0.0 date and time
You can now run some jobs from the X terminal session that you started and make use of the
full allocation within the LSF-HPC node allocation. For example:
$ srun -n4 hostname
n46
n48
n46
n48
$ srun -n2 hostname
n46
n48
Exiting from the X terminal session ends the LSF-HPC job.
11.3 Using the GNU Parallel Make Capability
By default, the make command invokes the GNU make program. GNU make has the ability to
make independent targets concurrently. For example, if building a program requires compiling
10 source files, and the compilations can be done independently, make can manage multiple
compilations at once — the number of jobs is user selectable. More precisely, each target's rules
are run normally (sequentially within the rule). Typically the rules for an object file target is a
single compilation line, so it is common to talk about concurrent compilations, though GNU
make
is more general.
On non-cluster platforms or command nodes, matching concurrency to the number of cores often
works well. It also often works well to specify a few more jobs than cores so that one job can
proceed while another is waiting for I/O. On an HP XC system, there is the potential to use
compute nodes to do compilations, and there are a variety of ways to make this happen.
11.3 Using the GNU Parallel Make Capability
119