Differences

This shows you the differences between two versions of the page.

--- guide:gpu [2023/10/02 14:53]
wikiadmin [Interactive Job on a GPU Node]
+++ guide:gpu [2025/08/07 12:51] (current)
kevin
@@ Line 27: / Line 27: @@
 ====Access====
-Access to the GPU nodes is by PI application only through the CHPC [[https://users.chpc.ac.za/helpdesk/|Helpdesk]].
+Principle Investigators apply for GPU access for their Research Programme members through the CHPC [[https://users.chpc.ac.za/helpdesk/|Helpdesk]].  RP members may not apply directly. E-mailed applications will not be considered.
 ====Allocation=====
@@ Line 54: / Line 54: @@
 |  **gpu_1**  |  9 |  1 | ''-q gpu_1''\\ ''-l select=1:ncpus=9:ngpus=1''  | Access one GPU device only per job.  |
 |  **gpu_2**  |  18 |  2 | ''-q gpu_2''\\ ''-l select=1:ncpus=18:ngpus=2''  | Access two GPU devices per job.  |
-|  **gpu_3**  |  36 |  3 | ''-q gpu_3''\\ ''-l select=1:ncpus=36:ngpus=3''  | Access three GPU devices per job.  |
+|  **gpu_3**  |  36 |  3 | ''-q gpu_3''\\ ''-l select=1:ncpus=30:ngpus=3''  | Access three GPU devices per job.  |
 |  **gpu_4**  |  40 |  4 | ''-q gpu_4''\\ ''-l select=1:ncpus=40:ngpus=4''  | Access four GPU devices on NVLink nodes.  |
-Note the ''ncpus'' parameters that should be set to match the number of GPU devices you need.
+Note the ''ncpus'' parameters above is the maximum that should be set to match the number of GPU devices you need.
 ====GPU Queue Limits====
@@ Line 102: / Line 102: @@
 ./hello_cuda
 </code>
+As usual, replace ''PRJT1234'' with your group's project name, ''your.email@address'' with your email address, and ''USERNAME'' with your cluster user name.
+====GPU Memory====
+Most of the V100 GPUs only have 16GiB of memory.  Two nodes each have three V100s with 32GiB of RAM.  To access these it is necessary to specify the exact node:
+  #PBS -l select=1:host=gpu2005:ncpus=9:ngpus=1
+or
+  #PBS -l select=1:host=gpu2006:ncpus=9:ngpus=1
+> Note that asking for a specific node is likely to lead to longer queue times as your job has to wait until that node becomes available.
 =====Compiling GPU Code=====

wiki.chpc.ac.za

User Tools

Site Tools

Differences

Page Tools