wiki.chpc.ac.za

This is an old revision of the document!

---

The following CHPC HPC systems (Sun Microsytems, Blue Gene and GPU) use schedulers and resources managers to schedule and run jobs in the systems. Below is the detail information:

Sun Microsystems - Moab (Scheduler) and Torque (Resource manager).
Blue Gene/P - Loadleveler (Resource manager).
GPU - Torque (Resources manager)

Below is an example of Moab script in Sun System:

###These lines are for Moab
#MSUB -l nodes=5:ppn=8
#MSUB -l partition=ALL
#MSUB -l walltime=168:00:00
#MSUB -m be
#MSUB -V
#MSUB -o /lustre/SCRATCH2/users/username/work/stdout.out
#MSUB -e /lustre/SCRATCH2/users/username/work/stderr.err
#MSUB -d /lustre/SCRATCH2/users/username/work
#MSUB -mb
#MSUB -M username@mail.co.za
##### Running commands
exe=/opt/gridware/dlpoly/DLPOLY_3.09.Y
nproc=`cat $PBS_NODEFILE | wc -l`
mpirun -np $nproc $exe

Below is an example of Loadleveler script in Blue Gene/P:

#@ job_type = bluegene
#@ bg_size = 64
#@ class = BGP
#@ input = /dev/null
#@ output = dlpoly.$(jobid).out
#@ error = dlpoly.$(jobid).err
#@ wall_clock_limit = 12:00:00
#@ resources = ConsumableCpus(1)
#@ node_usage = shared
#@ cluster_list = BGP
#@ notification = complete
#@ queue
/bgsys/drivers/ppcfloor/bin/mpirun -np 32 -mode VN -cwd /CHPC/work/username/test -exe EXECUTABLENAME 

There are various controls of Moab and Loadleveler that can help you to manage your job:

Some of Moab controls are as follows:

^ Commands | Description |