This is an old revision of the document!
Table of Contents
Running the open-source Fire Dynamics Simulator FDS on the CHPC system
Introduction
Please refer to the FDS home page for more information on FDS, an open-source code targeted at fire simulation. The current version of the code is 6.7.0, and has been installed in '/apps/chpc/compmech/CFD/FDS'. There is a module for FDS installed on Lengau. module load chpc/compmech/FDS/6.7.0 will set up the appropriate environment.
Sample PBS script
- runFDS.qsub
#!/bin/bash ## The following line requests two 24 core compute nodes ## The $PBS_NODEFILE file will contain the hostnames for 16 MPI processes (2 X 8, as per mpiprocs) ## This is only meaningful if your model contains 16 grids ## The number of grids must match the number of MPI processes #PBS -l select=2:ncpus=24:mpiprocs=8 -q normal ## Specify your own project shortcode here #PBS -P MECH1234 ## The walltime should be a small overestimate of the expected run time ## Requesting a very long walltime may delay the start of your job ## If the requested walltime is too short, the job will be killed before it is finished #PBS -l walltime=6:00:00 ## Obviously use your own paths here #PBS -e /home/jblogs/lustre/FDS_Runs/stderr.txt #PBS -o /home/jblogs/lustre/FDS_Runs/stdout.txt export PBS_JOBDIR=/home/jblogs/lustre/FDS_Runs cd $PBS_JOBDIR module load chpc/compmech/FDS/6.7.0 ## Assign a sensible value for OMP_NUM_THREADS ## If your number of MPI processes is a multiple of ## 24, it will be best to set it to 1, ## and not use OpenMP at all ## A value greater than 3 does not help export OMP_NUM_THREADS=3 ## The number of MPI processes is extracted from the length of the machinefile $PBS_NODEFILE nproc=`cat $PBS_NODEFILE | wc -l` mpirun -np $nproc -machinefile $PBS_NODEFILE fds FDS_inputFile.fds > fds.out
Postprocessing
Smokeview is also installed on the system, and can be accessed with the command smokeview or smv. However, this is only possible when using one of the visualisation nodes chpcviz1 or chpclic1. Please read the instructions on setting up a VNC connection, and run Smokeview with the VirtualGL wrapper /opt/VirtualGL/bin/vglrun smokeview. It may also be practical to use the very well-developed visualisation codes Paraview or VisIt. Please experiment and provide feedback.
Parallel Scaling
Scaling graphs
