User Tools

Site Tools


howto:ultrafluidx

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
howto:ultrafluidx [2022/03/29 16:16]
ccrosby [Example PBS scripts]
howto:ultrafluidx [2022/03/29 16:23] (current)
ccrosby [Example PBS scripts]
Line 33: Line 33:
 UltraFluidX requires one more MPI rank than the number of GPUs.  Please refer to this table: UltraFluidX requires one more MPI rank than the number of GPUs.  Please refer to this table:
  
- Number of GPUs   ncpus   mpiprocs   ngpus ^ queue ^ Command line  ^ +^ Number of GPUs ^ ncpus ^ mpiprocs ^ ngpus ^ queue ^ Command line  ^ 
-| 1  |  2 | 2 | 1 | gpu_1 | ufx -np -inpFile .... | + 1  |  2      | gpu_1 | ufx -np -inpFile .... | 
-| 2  |  3 | 3 | 2 | gpu_2 | ufx -np -inpFile .... | + 2  |  3      | gpu_2 | ufx -np -inpFile .... | 
-| 3  |  4 | 4 | 3 | gpu_3 | ufx -np -inpFile .... | + 3  |  4      | gpu_3 | ufx -np -inpFile .... | 
-| 4  |  5 | 5 | 4 | gpu_4 | ufx -np -inpFile .... |+ 4  |  5      | gpu_4 | ufx -np -inpFile .... |
  
  
Line 77: Line 77:
 <code> qsub -l select=1:ncpus=5:mpiprocs=5:ngpus=4 -q gpu_4 -P MECH1234 -l walltime=4:00:00 </code> <code> qsub -l select=1:ncpus=5:mpiprocs=5:ngpus=4 -q gpu_4 -P MECH1234 -l walltime=4:00:00 </code>
  
-It gets more difficult if only two NVlinked GPUs are required.  It is then necessary to nominate a particular NVlink-equipped compute node:+It gets more difficult if only two or three NVlinked GPUs are required.  It is then necessary to nominate a particular NVlink-equipped compute node:
  
 <code> qsub -l select=1:ncpus=3:mpiprocs=3:ngpus=2:host=gpu4001 -q gpu_4 -P MECH1234 -l walltime=4:00:00 </code> <code> qsub -l select=1:ncpus=3:mpiprocs=3:ngpus=2:host=gpu4001 -q gpu_4 -P MECH1234 -l walltime=4:00:00 </code>
/app/dokuwiki/data/attic/howto/ultrafluidx.1648563361.txt.gz · Last modified: 2022/03/29 16:16 by ccrosby