howto:starccm
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
howto:starccm [2024/07/09 15:09] ccrosby |
howto:starccm [2026/07/13 14:11] (current) ccrosby Added section advising users to not use dtn for license tunnels |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== STAR-CCM+ ====== | ====== STAR-CCM+ ====== | ||
| + | ===== NOTE on license tunnels ===== | ||
| + | Use '' | ||
| ==== New procedure for versions from 19.02.009 onwards ==== | ==== New procedure for versions from 19.02.009 onwards ==== | ||
| Line 14: | Line 16: | ||
| </ | </ | ||
| - | Similarly, | + | Similarly, |
| < | < | ||
| Line 21: | Line 23: | ||
| / | / | ||
| / | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| </ | </ | ||
| + | These are the two most recent singularity image files: | ||
| + | |||
| + | < | ||
| + | / | ||
| + | / | ||
| + | </ | ||
| + | |||
| + | Please list the contents of the directory ''/ | ||
| To enable the Singularity environment on all the compute nodes used in a run, it is necessary to insert the following statement in your .bashrc file: | To enable the Singularity environment on all the compute nodes used in a run, it is necessary to insert the following statement in your .bashrc file: | ||
| < | < | ||
| - | module load chpc/ | + | export PATH=/ |
| </ | </ | ||
| Line 44: | Line 64: | ||
| nproc=`cat $PBS_NODEFILE | wc -l` | nproc=`cat $PBS_NODEFILE | wc -l` | ||
| cat $PBS_NODEFILE > hosts.txt | cat $PBS_NODEFILE > hosts.txt | ||
| - | singularity exec / | + | singularity exec / |
| </ | </ | ||
| Line 58: | Line 78: | ||
| Some users have reported that they are unable to run FSI analyses using more than one node. If you are still experiencing such difficulties, | Some users have reported that they are unable to run FSI analyses using more than one node. If you are still experiencing such difficulties, | ||
| - | {{: | + | {{: |
| ==== Supplementary guidelines ==== | ==== Supplementary guidelines ==== | ||
| Line 78: | Line 98: | ||
| ===== Licensing ===== | ===== Licensing ===== | ||
| - | Because the cluster compute nodes do not have direct access to the internet, it is necessary to use ssh-tunneling through another node to contact the user's license server, which will need to have the license manager and vendor daemon ports open. Tunneling is done via a separate node, either chpclic1 or dtn. Please apply to [[http:// | + | Because the cluster compute nodes do not have direct access to the internet, it is necessary to use ssh-tunneling through another node to contact the user's license server, which will need to have the license manager and vendor daemon ports open. Tunneling is done via a separate node, either chpclic1 or dtn (NOTE: Ask CHPC staff for assistance, things have become more complicated as of July 2026. Please apply to [[http:// |
| - | For the majority of users simply checking out PoD licenses from the international STAR-CCM+ license servers, it is easiest to use the CHPC's permanent tunnels on either dtn or chpclic1 | + | For the majority of users simply checking out PoD licenses from the international STAR-CCM+ license servers, it is easiest to use the CHPC's permanent tunnels on chpclic1. |
| Line 108: | Line 128: | ||
| export PATH=/ | export PATH=/ | ||
| #### Tell solver where to look for the license. | #### Tell solver where to look for the license. | ||
| - | #### | + | #### |
| #### We are following a belts, braces and modest | #### We are following a belts, braces and modest | ||
| #### underwear approach here by specifying the LM and CDLMD license files as well as giving a license path on the | #### underwear approach here by specifying the LM and CDLMD license files as well as giving a license path on the | ||
| #### command line. | #### command line. | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| #### There is no -d option available under PBS Pro, therefore | #### There is no -d option available under PBS Pro, therefore | ||
| #### explicitly set working directory and change to that. | #### explicitly set working directory and change to that. | ||
| Line 121: | Line 141: | ||
| #### This is a minimal run instruction, | #### This is a minimal run instruction, | ||
| #### it will run the solver until reaching the stopping criteria set in the sim file. | #### it will run the solver until reaching the stopping criteria set in the sim file. | ||
| - | starccm+ -licpath 1999@dtn -batch run -power -podkey [your 22-character podkey] -rsh ssh -np $nproc -machinefile $PBS_NODEFILE simulationfilename.sim > run.out | + | starccm+ -licpath 1999@chpclic1 |
| </ | </ | ||
| Line 163: | Line 183: | ||
| #PBS -o / | #PBS -o / | ||
| #PBS -e / | #PBS -e / | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1055@1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| # Edit this next line to select the appropriate version. | # Edit this next line to select the appropriate version. | ||
| export PATH=/ | export PATH=/ | ||
| Line 170: | Line 190: | ||
| export PBS_JOBDIR=/ | export PBS_JOBDIR=/ | ||
| cd $PBS_JOBDIR | cd $PBS_JOBDIR | ||
| - | starccm+ -licpath 1999@dtn -batch run -power -podkey 12345ABCDE09876fghijk0 -rsh ssh -np $nproc -machinefile $PBS_NODEFILE -gpgpu auto:1 mysimfile.sim > run.out | + | starccm+ -licpath 1999@chpclic1 |
| </ | </ | ||
| Line 183: | Line 203: | ||
| #PBS -o / | #PBS -o / | ||
| #PBS -e / | #PBS -e / | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1055@1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| # Edit this next line to select the appropriate version. | # Edit this next line to select the appropriate version. | ||
| export PATH=/ | export PATH=/ | ||
| Line 190: | Line 210: | ||
| export PBS_JOBDIR=/ | export PBS_JOBDIR=/ | ||
| cd $PBS_JOBDIR | cd $PBS_JOBDIR | ||
| - | starccm+ -licpath 1999@dtn -batch run -power -podkey 12345ABCDE09876fghijk0 -rsh ssh -np $nproc -machinefile $PBS_NODEFILE -gpgpu auto:3 mysimfile.sim > run.out | + | starccm+ -licpath 1999@chpclic1 |
| </ | </ | ||
| Line 219: | Line 239: | ||
| #### Get the total number of cores | #### Get the total number of cores | ||
| nproc=`cat $PBS_NODEFILE | wc -l` | nproc=`cat $PBS_NODEFILE | wc -l` | ||
| - | # Build SSH tunnels for license | + | # Build SSH tunnels for DM license |
| - | # You may also prefer to use the existing tunnels on chpclic1 or dtn, see the simpler example above | + | # Use the existing tunnels on chpclic1 or chpclic1 for the PoD license |
| # Assume that DM license is in port 27120 on the server license.unseen.ac.za | # Assume that DM license is in port 27120 on the server license.unseen.ac.za | ||
| # STAR-CCM+ will look first for a PoD license | # STAR-CCM+ will look first for a PoD license | ||
| Line 226: | Line 246: | ||
| # consume PoD time very quickly | # consume PoD time very quickly | ||
| masternode=`hostname -s` | masternode=`hostname -s` | ||
| - | ssh -f jblogs@chpclic1 -L *: | ||
| - | ssh -f jblogs@chpclic1 -L *: | ||
| ssh -f jblogs@chpclic1 -L *: | ssh -f jblogs@chpclic1 -L *: | ||
| ssh -f jblogs@chpclic1 -L *: | ssh -f jblogs@chpclic1 -L *: | ||
| - | export CDLMD_LICENSE_FILE=1999@$masternode: | + | export CDLMD_LICENSE_FILE=1999@chpclic1: |
| - | export LM_LICENSE_FILE=1999@$masternode: | + | export LM_LICENSE_FILE=1999@chpclic1: |
| ##### Starccm+ run instruction. | ##### Starccm+ run instruction. | ||
| starlaunch jobmanager | starlaunch jobmanager | ||
| ### Remove the ssh tunnels: | ### Remove the ssh tunnels: | ||
| - | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| - | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| Line 291: | Line 307: | ||
| </ | </ | ||
| - | However, because there are a lot of users on Lengau using STAR-CCM+ this way, we have set up permanent ssh tunnels through | + | However, because there are a lot of users on Lengau using STAR-CCM+ this way, we have set up permanent ssh tunnels through chpclic1. |
| < | < | ||
| Line 298: | Line 314: | ||
| </ | </ | ||
| - | The server chpclic1 will shortly be retired, therefore we recommend that you use dtn instead. | + | The server chpclic1 will shortly be retired, therefore we recommend that you use chpclic1 |
| < | < | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| </ | </ | ||
/app/dokuwiki/data/attic/howto/starccm.1720530568.txt.gz · Last modified: 2024/07/09 15:09 by ccrosby
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 3.0 Unported
