User Tools

Site Tools


quick:pbspro

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
quick:pbspro [2015/06/19 10:23]
ischeepers [Example 2 (b) : Amber job on normal nodes (Please use this for python,sander and other executables that do not work on GPU]
quick:pbspro [2025/09/22 17:47] (current)
kevin [Example 4 : empty job]
Line 1: Line 1:
 ====== Job submission using PBSPro ====== ====== Job submission using PBSPro ======
  
-As of January 2014, CHPC has a new scheduler - PBSPro.+The CHPC system uses the PBSPro scheduler.
  
-Main user documentation can be found at http://resources.altair.com/pbs/documentation/support/PBSProUserGuide12.1.pdf+Main user documentation can be found at [[https://www.altair.com/pbs-works-documentation/|Altair]]
  
 But here is a summary of how to submit jobs at CHPC. But here is a summary of how to submit jobs at CHPC.
Line 26: Line 26:
 A script can include just about anything which you could do during a terminal session such as set environment variables, change directories, and move files.  A script can include just about anything which you could do during a terminal session such as set environment variables, change directories, and move files. 
  
-''qsub myscriptname.sub''+> Job script files can be named to anything allowed for a regular file, but it is strongly recommended that you use ''.pbs'' as the file extension to make it easy to distinguish job scripts from other shell scripts (''.sh'').
  
  
Line 116: Line 116:
  
  
-===== Example : Quantum Espresso job =====+===== Example: Quantum Espresso ===== 
 + 
 + 
 +[[howto:quantum_espresso|Quantum Espresso]]
  
-<code> 
-#!/bin/sh 
-###These lines are for PBSpro 
-#PBS -N QEspresso 
-#PBS -l select=2:ncpus=8:mpiprocs=8:jobtype=nehalem 
-#PBS -l walltime=24:00:00 
-#PBS -q workq 
-#PBS -m be 
-#PBS -o stdout 
-#PBS -e stderr 
-##### Environment Settings 
-source /etc/profile.d/modules.sh 
-module add intel-XE/13.0 
-module add QEspresso/5.0.2 
-##### Running commands 
-NP=`cat $PBS_NODEFILE | wc -l` 
-cd $PBS_O_WORKDIR 
-mpirun -f $PBS_NODEFILE -r ssh -ib -env I_MPI_DEBUG 2 -np $NP pw.x -npool 3  -inp inputfile.inp  
-</code> 
  
 ===== Example 4 : empty job ===== ===== Example 4 : empty job =====
Line 157: Line 141:
 #<hosts> = number of hosts #<hosts> = number of hosts
 #<architecture> = architecture where the jobs will run (nehalem, westmere, dell) #<architecture> = architecture where the jobs will run (nehalem, westmere, dell)
-#<queue> = submission queue ( workq priorityq specialq intel_mic , spark , kepla_k20 , accelrys)+#<queue> = submission queue ( serialsmpnormal... accelrys)
 #<executable> = Binary to be run #<executable> = Binary to be run
  
Line 164: Line 148:
 </code> </code>
  
-//Note that the M9000 sparc queue is called 'spark'//+
  
 ===== Example 5 : MPI example ===== ===== Example 5 : MPI example =====
Line 176: Line 160:
 ... ...
 </code> </code>
- 
-===== Example 6 : job array ===== 
-See [[howto:pbs-pro_job_submission_examples#job_arrays|here]] for a longer explanation. 
-<file bash simple_job_array.pbs> 
-#! /bin/bash 
-#PBS -l select=1:ncpus=1 
-#PBS -l walltime=00:01:00 
-#PBS -o /export/home/username/scratch5/simple_jobarray.stdout 
-#PBS -e /export/home/username/scratch5/simple_jobarray.stderr 
-#PBS -M youremail@address.com 
-#PBS -m abe 
-#PBS -N J_example 
-#PBS -J 1-24 
- 
- 
-# Make sure we're in the right working directory 
-cd /export/home/username/scratch5/ 
- 
-#sleep a random number of seconds (<10) 
-sleep $[ ( $RANDOM % 10 )  + 1 ]s 
- 
-#see what happens when we write to a file... 
-echo "Wawaweewaa! This is sub-job ${PBS_ARRAY_INDEX} of job ${PBS_JOBID} running on ${HOSTNAME} run by ${USER} writing to stdout!" 
-echo "Wawaweewaa! This is sub-job ${PBS_ARRAY_INDEX} of job ${PBS_JOBID} running on ${HOSTNAME} run by ${USER} writing to stderr!" 1>&2 
-echo "Wawaweewaa! This is sub-job ${PBS_ARRAY_INDEX} of job ${PBS_JOBID} running on ${HOSTNAME} run by ${USER} appending to simple_jobarray.txt" >> simple_jobarray.txt 
-</file> 
- 
-Thing to note: the stdout and stderr outputs do not all get joined together as they might with an mpi job. 
- 
 ===== Further examples ===== ===== Further examples =====
   * Various [[howto:bioinformatics?&#basic_examples|bioinformatics examples]] illustrate some further possibilities. Specifically the blast examples illustrate job arrays and job dependencies.   * Various [[howto:bioinformatics?&#basic_examples|bioinformatics examples]] illustrate some further possibilities. Specifically the blast examples illustrate job arrays and job dependencies.
   * This [[howto:gpu_gromacs#pbs_job_script|gromacs example]] shows an interesting case where mpi, openmp and the gpus are used in a single job.   * This [[howto:gpu_gromacs#pbs_job_script|gromacs example]] shows an interesting case where mpi, openmp and the gpus are used in a single job.
/app/dokuwiki/data/attic/quick/pbspro.1434702208.txt.gz · Last modified: 2021/12/09 16:42 (external edit)