User Tools

Site Tools


guide:gpu

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
guide:gpu [2019/02/18 14:03]
wikiadmin [GPU Nodes]
guide:gpu [2019/08/08 11:54] (current)
wikiadmin [GPU Nodes]
Line 1: Line 1:
 ======GPU Nodes====== ======GPU Nodes======
  
-The Lengau cluster at the CHPC includes 9 GPU compute nodes with a total of 24 Nvidia V100 GPU devices. ​ There are 6 gpu nodes with GPUs in each, and 3 gpu nodes with 4 GPUs in each.+**Upgraded: more GPUs added.** 
 + 
 +The Lengau cluster at the CHPC includes 9 GPU compute nodes with a total of 30 Nvidia V100 GPU devices. ​ There are 6 ''​gpu*'' ​nodes with GPUs in each, and 3 ''​gpu*'' ​nodes with 4 GPUs in each. 
 + 
 + 
 +^  GPU Node  ^  CPU Cores  ^  GPU Devices ​ ^  Interface ​ ^ 
 +| ''​gpu2001'' ​ |  36 | 3× Nvidia V100 16GB  | PCIe  | 
 +| ''​gpu2002'' ​ |  36 | 3× Nvidia V100 16GB  | PCIe  | 
 +| ''​gpu2003'' ​ |  36 | 3× Nvidia V100 16GB  | PCIe  | 
 +| ''​gpu2004'' ​ |  36 | 3× Nvidia V100 16GB  | PCIe  | 
 +| ''​gpu2005'' ​ |  36 | 3× Nvidia V100 32GB  | PCIe  | 
 +| ''​gpu2006'' ​ |  36 | 3× Nvidia V100 32GB  | PCIe  | 
 +| ''​gpu4001'' ​ |  40 | 4× Nvidia V100 16GB  | NVlink ​ | 
 +| ''​gpu4002'' ​ |  40 | 4× Nvidia V100 16GB  | NVlink ​ | 
 +| ''​gpu4003'' ​ |  40 | 4× Nvidia V100 16GB  | NVlink ​ | 
 + 
 +> Jobs that require 1, 2 or 3 GPUs can be allocated to any node, and will share the node if the job does not use all the GPU devices on that node.  Jobs that require 4 GPUs can only be allocated to ''​gpu4*''​ nodes and will not be shared, obviously. 
 + 
 + 
 + 
  
 =====Policies===== =====Policies=====
Line 29: Line 49:
 ====GPU Queues==== ====GPU Queues====
  
-There are three queues available in PBSPro which access the GPU nodes:+There are four queues available in PBSPro which access the GPU nodes:
  
 ^  Queue name  ^  Max. CPUs  ^  Max. GPUs  ^  PBSPro options ​ ^ Comments ​ ^ ^  Queue name  ^  Max. CPUs  ^  Max. GPUs  ^  PBSPro options ​ ^ Comments ​ ^
 |  **gpu_1** ​ |  10 |  1 | ''​-q gpu_1''​\\ ''​-l ncpus=10:​ngpus=1'' ​ | Access one GPU device only.  | |  **gpu_1** ​ |  10 |  1 | ''​-q gpu_1''​\\ ''​-l ncpus=10:​ngpus=1'' ​ | Access one GPU device only.  |
 |  **gpu_2** ​ |  20 |  2 | ''​-q gpu_2''​\\ ''​-l ncpus=20:​ngpus=2'' ​ | Access two GPU devices. ​ | |  **gpu_2** ​ |  20 |  2 | ''​-q gpu_2''​\\ ''​-l ncpus=20:​ngpus=2'' ​ | Access two GPU devices. ​ |
 +|  **gpu_3** ​ |  36 |  3 | ''​-q gpu_3''​\\ ''​-l ncpus=36:​ngpus=3'' ​ | Access three GPU devices. ​ |
 |  **gpu_4** ​ |  40 |  4 | ''​-q gpu_4''​\\ ''​-l ncpus=40:​ngpus=4'' ​ | Access four GPU devices on NVLink nodes. ​ | |  **gpu_4** ​ |  40 |  4 | ''​-q gpu_4''​\\ ''​-l ncpus=40:​ngpus=4'' ​ | Access four GPU devices on NVLink nodes. ​ |
  
/var/www/wiki/data/attic/guide/gpu.1550491403.txt.gz · Last modified: 2019/02/18 14:03 by wikiadmin