wiki.chpc.ac.za

User Tools

Site Tools

You are here: start » guide » gpu
Trace:
guide:gpu

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
guide:gpu [2023/03/07 17:49]
wikiadmin 		guide:gpu [2025/08/07 12:51] (current)
kevin
Line 27: Line 27:
 ====Access==== ====Access====
  
-Access to the GPU nodes is by PI application only through the CHPC [[https://users.chpc.ac.za/helpdesk/|Helpdesk]].+Principle Investigators apply for GPU access for their Research Programme members through the CHPC [[https://users.chpc.ac.za/helpdesk/|Helpdesk]].  RP members may not apply directly. E-mailed applications will not be considered. 
  
 ====Allocation===== ====Allocation=====
Line 52: Line 52:
  
 ^  Queue name  ^  Max. CPUs  ^  Max. GPUs  ^  PBSPro options  ^ Comments  ^ ^  Queue name  ^  Max. CPUs  ^  Max. GPUs  ^  PBSPro options  ^ Comments  ^
-|  **gpu_1**  |  10 |  1 | ''-q gpu_1''\\ ''-l select=1:ncpus=9:ngpus=1''  | Access one GPU device only per job.  | +|  **gpu_1**  |  9 |  1 | ''-q gpu_1''\\ ''-l select=1:ncpus=9:ngpus=1''  | Access one GPU device only per job.  | 
-|  **gpu_2**  |  20 |  2 | ''-q gpu_2''\\ ''-l select=1:ncpus=18:ngpus=2''  | Access two GPU devices per job.  | +|  **gpu_2**  |  18 |  2 | ''-q gpu_2''\\ ''-l select=1:ncpus=18:ngpus=2''  | Access two GPU devices per job.  | 
-|  **gpu_3**  |  36 |  3 | ''-q gpu_3''\\ ''-l select=1:ncpus=36:ngpus=3''  | Access three GPU devices per job.  |+|  **gpu_3**  |  36 |  3 | ''-q gpu_3''\\ ''-l select=1:ncpus=30:ngpus=3''  | Access three GPU devices per job.  |
 |  **gpu_4**  |  40 |  4 | ''-q gpu_4''\\ ''-l select=1:ncpus=40:ngpus=4''  | Access four GPU devices on NVLink nodes.  | |  **gpu_4**  |  40 |  4 | ''-q gpu_4''\\ ''-l select=1:ncpus=40:ngpus=4''  | Access four GPU devices on NVLink nodes.  |
  
-Note the ''ncpus'' parameters that should be set to match the number of GPU devices you need.+Note the ''ncpus'' parameters above is the maximum that should be set to match the number of GPU devices you need.
  
 ====GPU Queue Limits==== ====GPU Queue Limits====
Line 73: Line 73:
  
 <code bash> <code bash>
-qsub -I -q gpu_1 -P PRJT1234+qsub -I -q gpu_1 -P PRJT1234 -l select=1:ncpus=9:ngpus=1
 </code> </code>
 **NB:** Replace //''PRJT1234''// with **//your//** project number. **NB:** Replace //''PRJT1234''// with **//your//** project number.
Line 85: Line 85:
 #PBS -N nameyourjob #PBS -N nameyourjob
 #PBS -q gpu_1 #PBS -q gpu_1
-#PBS -l ncpus=10:ngpus=1+#PBS -l select=1:ncpus=4:ngpus=1
 #PBS -P PRJT1234 #PBS -P PRJT1234
 #PBS -l walltime=4:00:00 #PBS -l walltime=4:00:00
-#PBS -o /mnt/lustre/users/USERNAME/cuda_test/test1.out 
-#PBS -e /mnt/lustre/users/USERNAME/cuda_test/test1.err 
 #PBS -m abe #PBS -m abe
 #PBS -M your.email@address #PBS -M your.email@address
Line 104: Line 102:
 ./hello_cuda ./hello_cuda
 </code> </code>
 +
 +As usual, replace ''PRJT1234'' with your group's project name, ''your.email@address'' with your email address, and ''USERNAME'' with your cluster user name.
 +
 +====GPU Memory====
 +
 +Most of the V100 GPUs only have 16GiB of memory.  Two nodes each have three V100s with 32GiB of RAM.  To access these it is necessary to specify the exact node:
 +
 +  #PBS -l select=1:host=gpu2005:ncpus=9:ngpus=1
 +
 +or
 +
 +  #PBS -l select=1:host=gpu2006:ncpus=9:ngpus=1
 +
 +> Note that asking for a specific node is likely to lead to longer queue times as your job has to wait until that node becomes available.
 +  
  
 =====Compiling GPU Code===== =====Compiling GPU Code=====
/app/dokuwiki/data/attic/guide/gpu.1678204162.txt.gz · Last modified: 2023/03/07 17:49 by wikiadmin

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 3.0 Unported
CC Attribution-Noncommercial-Share Alike 3.0 Unported Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki