wiki.chpc.ac.za

User Tools

Site Tools

You are here: start » howto » cfx
Trace:
howto:cfx

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
howto:cfx [2014/05/08 15:06]
agill 		howto:cfx [2025/02/21 12:45] (current)
ccrosby [Running a CFX Job]
Line 5: Line 5:
 ===== Application Process ===== ===== Application Process =====
  
-If you are a **full time** student or staff at an **academic** institution then you may request access to use Ansys-CFD on the CHPC clusters.  Send  your request along with motivation and description of the work in an email to '''helpdesk@chpc.ac.za'''.+If you are a **full time** student or staff at an **academic** institution then you may request access to use Ansys-CFD on the CHPC clusters.  Send  your request along with motivation and description of the work in an email to ''helpdesk@chpc.ac.za''.
  
 ===== Installation ===== ===== Installation =====
  
-CFX version 5 is installed in '''/opt/gridware/applications/ANSYS/ansys_inc/v150/CFX'''. IcemCFD is installed under '''/opt/gridware/applications/ANSYS/ansys_inc/v150'''.+CFX versions are installed in ''/apps/chpc/compmech/CFD/ansys_inc/v???/CFX'', where ??? represents the software release version such as 242, for example. Similarly, IcemCFD is installed under ''/apps/chpc/compmech/CFD/ansys_inc/v???/icemcfd''.
  
  
Line 15: Line 15:
 ===== Licensing ===== ===== Licensing =====
  
-CHPC has academic licenses for AnsysCFD.  There are 5 "solver" processes, available as aa_r_cfd and 500 "HPC" licenses, available as aa_r_hpc.  There is a license resource management system.  If you request license resources (as in these example scripts), the scheduler will check for license availability before starting a job.  License unavailability will result in the job being held back until the necessary licenses have become available.  Although use of the license resource request is not mandatory, its use is strongly recommended.  If you do not use the license resource requests, the job will fail if no licenses are available.  A single aa_r_cfd license is required to start the solver, and includes up to 4 HPC licenses.  Therefore you should request ($nproc-4) aa_r_hpc licenses.+CHPC has academic licenses for AnsysCFD.  There are 25 "solver" processes and the license pool is not currently under heavy pressure.  There is a license resource management system to be used for Fluent, but it is not effective for older CFX versions.  
  
 ===== Running a CFX Job ===== ===== Running a CFX Job =====
  
-On the CHPC clusters all simulations are submitted as jobs to the PBS Pro job scheduler which will assign your job to the appropriate queue and machine.  Fluent runs on the three Intel Xeon based clusters: Nehalem, Westmere and Dell.+On the CHPC clusters all simulations are submitted as jobs to the PBS Pro job scheduler which will assign your job to the appropriate queue and machine.
  
 Example job script: Example job script:
  
-<code>+<file bash runCFX.qsub>
 #!/bin/bash #!/bin/bash
-#PBS -l select=2:ncpus=8:mpiprocs=8:jobtype=nehalem,place=free:group=nodetype+#PBS -P projectid 
 +#PBS -l select=4:ncpus=24:mpiprocs=24
 #PBS -l walltime=2:00:00 #PBS -l walltime=2:00:00
-#PBS -q workq +#PBS -q normal
-#PBS -m be+
 #PBS -V #PBS -V
-#PBS -o /export/home/username/testCFX/test.out +#PBS -o /mnt/lustre/users/username/testCFX/test.out 
-#PBS -e /export/home/username/testCFX/test.err+#PBS -e /mnt/lustre/users/username/testCFX/test.err
  
-cd /export/home/username/testCFX #change to CFX case directory +export LM_LICENSE_FILE=1055@login1 
-export CFX5RSH=ssh #force CFX to use ssh instead of rsh +export ANSYSLMD_LICENSE_FILE=1055@login1 
-cfx=/opt/gridware/applications/ANSYS/ansys_inc/v150/CFX/bin/cfx5solve #path to cfx5 solver +#change to CFX case directory 
-$cfx -batch -def testCFX.def -par-dist $(tr "\n" "," <$PBS_NODEFILE) +cd /mnt/lustre/users/username/testCFX  
-</code>+#force CFX to use ssh instead of rsh 
 +export CFX5RSH=ssh  
 +# Select IntelMPI-2018 instead of 2021 
 +export CFX5_IMPI_DIR=/apps/chpc/compmech/CFD/ansys_inc/v242/commonfiles/MPI/Intel/2018.3.222/linx64 
 +cfx=/apps/chpc/compmech/CFD/ansys_inc/v242/CFX/bin/cfx5solve #path to cfx5 solver 
 +$cfx -batch -def testCFX.def -par-dist $(tr "\n" "," <$PBS_NODEFILE | rev | cut -c2- | rev) > runcfx.log 
 +</file>
 ===== Different methods of uploading a simulation ===== ===== Different methods of uploading a simulation =====
  
Line 49: Line 55:
 ==== Build and test locally, upload geometry and script files only, mesh and pre-process remotely ==== ==== Build and test locally, upload geometry and script files only, mesh and pre-process remotely ====
 If your simulations files are too large, or your internet connection too slow, consider transferring geometry and script files only.  This will require careful scripting and testing, but is certainly practical. If your simulations files are too large, or your internet connection too slow, consider transferring geometry and script files only.  This will require careful scripting and testing, but is certainly practical.
-   * There are two methods available for meshing on the CHPC system.  Either work with IcemCFD or use the built-in T-Grid based meshing in Fluent itself.  Neither ANSYS-Mesh nor Gambit is available on the CHPC system. +   * Neither ANSYS-Mesh nor Gambit is available on the CHPC system, but ICEMCFD is. 
-   * If using IcemCFD, transfer the Icem .prj, .tin, .fbc and .blk (if using hexa) files, along with a recorded Icem script file for generating the mesh and exporting the file in Fluent format.  Watch for absolute path names in the script file.  Run IcemCFD with the -batch -script options to create the mesh.  A more comprehensive CFX script will be required to import the mesh and pre-process the case. **Test locally!**+   * If using IcemCFD, transfer the Icem .prj, .tin, .fbc and .blk (if using hexa) files, along with a recorded Icem script file for generating the mesh and exporting the file in CFX format.  Watch for absolute path names in the script file.  Run IcemCFD with the -batch -script options to create the mesh.  A more comprehensive CFX script will be required to import the mesh and pre-process the case. **Test locally!**
    * If your internet connection is too slow to permit easy case uploading, it will also be far too slow for downloading the results files.  Consider generating post-processing images "on the fly", or alternatively exporting only surface data on completion of the simulation.    * If your internet connection is too slow to permit easy case uploading, it will also be far too slow for downloading the results files.  Consider generating post-processing images "on the fly", or alternatively exporting only surface data on completion of the simulation.
  
/app/dokuwiki/data/attic/howto/cfx.1399554365.txt.gz · Last modified: 2021/12/09 16:42 (external edit)

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 3.0 Unported
CC Attribution-Noncommercial-Share Alike 3.0 Unported Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki