User Tools

Site Tools


howto:mfix

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
howto:mfix [2020/10/07 15:01]
ccrosby [Introduction]
howto:mfix [2021/05/05 11:46] (current)
ccrosby [MFix-20.3.0]
Line 49: Line 49:
   #PBS -q normal   #PBS -q normal
   #PBS -l walltime=01:​00:​00   #PBS -l walltime=01:​00:​00
-  #PBS -o /home/username/lustre/​job01/​stdout +  #PBS -o /mnt/lustre3p/users/​username/​job01/​stdout 
-  #PBS -e /home/username/lustre/​job01/​stderr+  #PBS -e /mnt/lustre3p/users/​username/​job01/​stderr
   #PBS -m abe   #PBS -m abe
   #PBS -M username@email.co.za   #PBS -M username@email.co.za
Line 65: Line 65:
 where NX, NY and NZ should be replaced by the number of partitions along each physical principle axis of the model, so that NX*NY*NZ is the total number of cores requested in the submit script. In general, it is best to choose NX, NY and NZ where NX, NY and NZ should be replaced by the number of partitions along each physical principle axis of the model, so that NX*NY*NZ is the total number of cores requested in the submit script. In general, it is best to choose NX, NY and NZ
 such that largest number of partitions occur along the axis/axes corresponding roughly with the average flow direction. such that largest number of partitions occur along the axis/axes corresponding roughly with the average flow direction.
 +
 +====  MFix-20.3.0 ====
 +Please be advised that there is now also a version 20.3.0 in ''/​apps/​chpc/​compmech/​CFD/​MFIX/​20.3.0''​. ​ There is a source script in that directory, setMFix, which will load the correct gcc and MPI modules and append the $PATH to make the executable ''​mfixsolver''​ available. ​ This binary supports both thread-level (OpenMP) and distributed memory (MPI) parallel. ​ It uses mpich, and it is necessary to use the ''​-iface ib0''​ option to ensure the use of the Infiniband network. ​ A machinefile should not be used.  The following job script should work, but has not been tested:
 +
 +<file bash mfix.qsub>​
 +  #!/bin/sh
 +  #PBS -P projectid
 +  #PBS -l select=3:​ncpus=24:​mpiprocs=24:​mem=12GB:​nodetype=haswell_reg ​
 +  #PBS -q normal
 +  #PBS -l walltime=01:​00:​00
 +  #PBS -o /​mnt/​lustre3p/​users/​username/​job01/​stdout
 +  #PBS -e /​mnt/​lustre3p/​users/​username/​job01/​stderr
 +  #PBS -m abe
 +  #PBS -M username@email.co.za
 +  . /​apps/​chpc/​compmech/​CFD/​MFIX/​20.3.0/​setMFix
 +  cd ${PBS_O_WORKDIR}
 +  exe="​mfixsolver.exe"​
 +  nproc=`cat $PBS_NODEFILE | wc -l`
 +  mpirun -iface ib0 -np $nproc $exe -parallel >"​coarse.log"​ 2>&1
 +</​file>  ​
  
 ===== Postprocessing ===== ===== Postprocessing =====
/var/www/wiki/data/attic/howto/mfix.1602075667.txt.gz · Last modified: 2020/10/07 15:01 by ccrosby