howto:starccm
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
howto:starccm [2024/07/09 13:27] ccrosby [New procedure for versions from 19.02.009 onwards] |
howto:starccm [2026/07/13 14:11] (current) ccrosby Added section advising users to not use dtn for license tunnels |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== STAR-CCM+ ====== | ====== STAR-CCM+ ====== | ||
| + | ===== NOTE on license tunnels ===== | ||
| + | Use '' | ||
| ==== New procedure for versions from 19.02.009 onwards ==== | ==== New procedure for versions from 19.02.009 onwards ==== | ||
| Line 14: | Line 16: | ||
| </ | </ | ||
| - | Similarly, | + | Similarly, |
| < | < | ||
| Line 21: | Line 23: | ||
| / | / | ||
| / | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| </ | </ | ||
| + | These are the two most recent singularity image files: | ||
| + | |||
| + | < | ||
| + | / | ||
| + | / | ||
| + | </ | ||
| + | |||
| + | Please list the contents of the directory ''/ | ||
| To enable the Singularity environment on all the compute nodes used in a run, it is necessary to insert the following statement in your .bashrc file: | To enable the Singularity environment on all the compute nodes used in a run, it is necessary to insert the following statement in your .bashrc file: | ||
| < | < | ||
| - | module load chpc/ | + | export PATH=/ |
| </ | </ | ||
| Line 44: | Line 64: | ||
| nproc=`cat $PBS_NODEFILE | wc -l` | nproc=`cat $PBS_NODEFILE | wc -l` | ||
| cat $PBS_NODEFILE > hosts.txt | cat $PBS_NODEFILE > hosts.txt | ||
| - | singularity exec / | + | singularity exec / |
| </ | </ | ||
| Line 54: | Line 74: | ||
| - The PBS machinefile environment variable '' | - The PBS machinefile environment variable '' | ||
| - Starting from version 19.04.007, the executables installed on Lengau were compiled with the clang compiler from llvm 17 instead of gcc. This should make no discernible difference, but please let us know if you find anything anomalous. | - Starting from version 19.04.007, the executables installed on Lengau were compiled with the clang compiler from llvm 17 instead of gcc. This should make no discernible difference, but please let us know if you find anything anomalous. | ||
| - | - The singularity container does not include a web browser. | + | |
| + | === Post 19.02 versions and FSI === | ||
| + | Some users have reported that they are unable to run FSI analyses using more than one node. | ||
| + | |||
| + | {{: | ||
| ==== Supplementary guidelines ==== | ==== Supplementary guidelines ==== | ||
| Line 74: | Line 98: | ||
| ===== Licensing ===== | ===== Licensing ===== | ||
| - | Because the cluster compute nodes do not have direct access to the internet, it is necessary to use ssh-tunneling through another node to contact the user's license server, which will need to have the license manager and vendor daemon ports open. Tunneling is done via a separate node, either chpclic1 or dtn. Please apply to [[http:// | + | Because the cluster compute nodes do not have direct access to the internet, it is necessary to use ssh-tunneling through another node to contact the user's license server, which will need to have the license manager and vendor daemon ports open. Tunneling is done via a separate node, either chpclic1 or dtn (NOTE: Ask CHPC staff for assistance, things have become more complicated as of July 2026. Please apply to [[http:// |
| - | For the majority of users simply checking out PoD licenses from the international STAR-CCM+ license servers, it is easiest to use the CHPC's permanent tunnels on either dtn or chpclic1 | + | For the majority of users simply checking out PoD licenses from the international STAR-CCM+ license servers, it is easiest to use the CHPC's permanent tunnels on chpclic1. |
| Line 104: | Line 128: | ||
| export PATH=/ | export PATH=/ | ||
| #### Tell solver where to look for the license. | #### Tell solver where to look for the license. | ||
| - | #### | + | #### |
| #### We are following a belts, braces and modest | #### We are following a belts, braces and modest | ||
| #### underwear approach here by specifying the LM and CDLMD license files as well as giving a license path on the | #### underwear approach here by specifying the LM and CDLMD license files as well as giving a license path on the | ||
| #### command line. | #### command line. | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| #### There is no -d option available under PBS Pro, therefore | #### There is no -d option available under PBS Pro, therefore | ||
| #### explicitly set working directory and change to that. | #### explicitly set working directory and change to that. | ||
| Line 117: | Line 141: | ||
| #### This is a minimal run instruction, | #### This is a minimal run instruction, | ||
| #### it will run the solver until reaching the stopping criteria set in the sim file. | #### it will run the solver until reaching the stopping criteria set in the sim file. | ||
| - | starccm+ -licpath 1999@dtn -batch run -power -podkey [your 22-character podkey] -rsh ssh -np $nproc -machinefile $PBS_NODEFILE simulationfilename.sim > run.out | + | starccm+ -licpath 1999@chpclic1 |
| </ | </ | ||
| Line 159: | Line 183: | ||
| #PBS -o / | #PBS -o / | ||
| #PBS -e / | #PBS -e / | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1055@1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| # Edit this next line to select the appropriate version. | # Edit this next line to select the appropriate version. | ||
| export PATH=/ | export PATH=/ | ||
| Line 166: | Line 190: | ||
| export PBS_JOBDIR=/ | export PBS_JOBDIR=/ | ||
| cd $PBS_JOBDIR | cd $PBS_JOBDIR | ||
| - | starccm+ -licpath 1999@dtn -batch run -power -podkey 12345ABCDE09876fghijk0 -rsh ssh -np $nproc -machinefile $PBS_NODEFILE -gpgpu auto:1 mysimfile.sim > run.out | + | starccm+ -licpath 1999@chpclic1 |
| </ | </ | ||
| Line 179: | Line 203: | ||
| #PBS -o / | #PBS -o / | ||
| #PBS -e / | #PBS -e / | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1055@1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| # Edit this next line to select the appropriate version. | # Edit this next line to select the appropriate version. | ||
| export PATH=/ | export PATH=/ | ||
| Line 186: | Line 210: | ||
| export PBS_JOBDIR=/ | export PBS_JOBDIR=/ | ||
| cd $PBS_JOBDIR | cd $PBS_JOBDIR | ||
| - | starccm+ -licpath 1999@dtn -batch run -power -podkey 12345ABCDE09876fghijk0 -rsh ssh -np $nproc -machinefile $PBS_NODEFILE -gpgpu auto:3 mysimfile.sim > run.out | + | starccm+ -licpath 1999@chpclic1 |
| </ | </ | ||
| Line 215: | Line 239: | ||
| #### Get the total number of cores | #### Get the total number of cores | ||
| nproc=`cat $PBS_NODEFILE | wc -l` | nproc=`cat $PBS_NODEFILE | wc -l` | ||
| - | # Build SSH tunnels for license | + | # Build SSH tunnels for DM license |
| - | # You may also prefer to use the existing tunnels on chpclic1 or dtn, see the simpler example above | + | # Use the existing tunnels on chpclic1 or chpclic1 for the PoD license |
| # Assume that DM license is in port 27120 on the server license.unseen.ac.za | # Assume that DM license is in port 27120 on the server license.unseen.ac.za | ||
| # STAR-CCM+ will look first for a PoD license | # STAR-CCM+ will look first for a PoD license | ||
| Line 222: | Line 246: | ||
| # consume PoD time very quickly | # consume PoD time very quickly | ||
| masternode=`hostname -s` | masternode=`hostname -s` | ||
| - | ssh -f jblogs@chpclic1 -L *: | ||
| - | ssh -f jblogs@chpclic1 -L *: | ||
| ssh -f jblogs@chpclic1 -L *: | ssh -f jblogs@chpclic1 -L *: | ||
| ssh -f jblogs@chpclic1 -L *: | ssh -f jblogs@chpclic1 -L *: | ||
| - | export CDLMD_LICENSE_FILE=1999@$masternode: | + | export CDLMD_LICENSE_FILE=1999@chpclic1: |
| - | export LM_LICENSE_FILE=1999@$masternode: | + | export LM_LICENSE_FILE=1999@chpclic1: |
| ##### Starccm+ run instruction. | ##### Starccm+ run instruction. | ||
| starlaunch jobmanager | starlaunch jobmanager | ||
| ### Remove the ssh tunnels: | ### Remove the ssh tunnels: | ||
| - | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| - | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | kill -9 `ps ux | grep "ssh -f" | grep -o -E ' | ||
| Line 287: | Line 307: | ||
| </ | </ | ||
| - | However, because there are a lot of users on Lengau using STAR-CCM+ this way, we have set up permanent ssh tunnels through | + | However, because there are a lot of users on Lengau using STAR-CCM+ this way, we have set up permanent ssh tunnels through chpclic1. |
| < | < | ||
| Line 294: | Line 314: | ||
| </ | </ | ||
| - | The server chpclic1 will shortly be retired, therefore we recommend that you use dtn instead. | + | The server chpclic1 will shortly be retired, therefore we recommend that you use chpclic1 |
| < | < | ||
| - | export LM_LICENSE_FILE=1999@dtn | + | export LM_LICENSE_FILE=1999@chpclic1 |
| - | export CDLMD_LICENSE_FILE=1999@dtn | + | export CDLMD_LICENSE_FILE=1999@chpclic1 |
| </ | </ | ||
/app/dokuwiki/data/attic/howto/starccm.1720524469.txt.gz · Last modified: 2024/07/09 13:27 by ccrosby
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 3.0 Unported
