| Both sides previous revision
Previous revision
Next revision
|
Previous revision
|
guide:m9000 [2013/07/25 15:03] kevin |
guide:m9000 [2021/12/09 16:42] (current) |
| ^ Memory | 2 048 GB (2 TB)| | ^ Memory | 2 048 GB (2 TB)| |
| ^ Peak performance | 2 Tflops | | ^ Peak performance | 2 Tflops | |
| ^ Linpack peformance | [[wp>SPARC_Enterprise|1.032 Tflops]] | | ^ Linpack performance | [[wp>SPARC_Enterprise|1.032 Tflops]] | |
| ^ Interconnect | Jupiter | | ^ Interconnect | Jupiter | |
| ^ O.S. | Solaris 10 | | ^ O.S. | Solaris 10 | |
| | Scratch | XFS | ''/scratch''/* | 5.3 TB | Scratch (local) storage | | | Scratch | XFS | ''/scratch''/* | 5.3 TB | Scratch (local) storage | |
| | | | ''/scratch/work/'' | 5.3 TB | Local scratch **work** directory | | | | | ''/scratch/work/'' | 5.3 TB | Local scratch **work** directory | |
| | Gridware | NFS | ''/opt/gridware'' | 1.6 TB | Shared software: compilers, tools, libraries and applications | | | Gridware | NFS | ''/opt/gridware'' | 1.6 TB | Shared software*: compilers, tools, libraries and applications | |
| | Home | NFS | ''/export/home'' | 1.8 TB | Users' home directories from Sun cluster storage | | | Home | NFS | ''/export/home'' | 1.8 TB | Users' home directories from Sun cluster storage | |
| | Software | | ''/opt/software'' | | SPARC64-Soris compatible software: compilers and libraries| | | Software | | ''/opt/software'' | | SPARC64-Solaris compatible software: compilers and libraries| |
| | |
| | * **WARNING:** *Most of the software in ''/opt/gridware'' is compiled for the amd64 (x86_64) architecture of the Sun/Dell clusters and is **not** usable on the sparc architecture of the M9000. |
| |
| The M9000 does not mount the Lustre SCRATCH* file systems. If you need fast local storage for your processing jobs, request a sub-directory be created for you on ''/scratch/work/'' by emailing {{:guide:helpdesk.png?nolink|}}. | The M9000 does not mount the Lustre SCRATCH* file systems. If you need fast local storage for your processing jobs, request a sub-directory be created for you on ''/scratch/work/'' by emailing {{:guide:helpdesk.png?nolink|}}. |
| Example code from [[https://computing.llnl.gov/tutorials/openMP/samples/C/omp_hello.c]] | Example code from [[https://computing.llnl.gov/tutorials/openMP/samples/C/omp_hello.c]] |
| |
| With the Sun Studio compilers, use the ''-xopenmp=parallel'' option or the safer ''-xopenmp=noopt'' option. | With the Sun Studio compilers, use the ''-xopenmp=parallel'' option or the safer ''-xopenmp=noopt'' option. See Oracle's [[http://docs.oracle.com/cd/E19205-01/820-7883/820-7883.pdf|documentation]]. |
| |
| | ''-xopenmp=parallel'' | Enables recognition of OpenMP pragmas. **The minimum optimization level for ''-xopenmp=parallel'' is ''-xO3''**. The compiler changes the optimization from a lower level to ''-xO3'' if necessary, and issues a warning. | Not recommended unless you know what you are doing and really want full speed. | | | ''-xopenmp=parallel'' | Enables recognition of OpenMP pragmas. **The minimum optimization level for ''-xopenmp=parallel'' is ''-xO3''**. The compiler changes the optimization from a lower level to ''-xO3'' if necessary, and issues a warning. | Not recommended unless you know what you are doing and really want full speed. | |
| |
| ====MPI==== | ====MPI==== |
| | |
| | =====Job submission===== |
| | [Courtesy of Sean February] |
| | |
| | The queue name for the M9000 machine is spark. Your job script (see example below) must be located somewhere in ''/scratch/work/yourusername/'' (equivalently ''/export/home/yourusername/m9_scratch/''). Submission should be done normally via the PBS scheduler from the login node: |
| | <code> |
| | yourusername@login02:~/m9_scratch $ qsub jobscriptname |
| | </code> |
| | |
| | Example script: |
| | <code bash> |
| | #!/bin/sh |
| | #PBS -N test |
| | #PBS -q spark |
| | #PBS -l select=1:ncpus=10:mpiprocs=10 |
| | #PBS -l place=free |
| | #PBS -l walltime=01:00:00 |
| | #PBS -o /scratch/work/yourusername/stdout |
| | #PBS -e /scratch/work/yourusername/stderr |
| | cd $PBS_O_WORKDIR |
| | |
| | HOME_DIR=/scratch/work/yourusername/ |
| | LOG_NAME=testjob_log |
| | THIS_JOB=$HOME_DIR$LOG_NAME |
| | |
| | echo "My job starts here" > $THIS_JOB |
| | date >> $THIS_JOB |
| | pwd >> $THIS_JOB |
| | echo $PATH >> $THIS_JOB |
| | echo `cat $PBS_NODEFILE` >> $THIS_JOB |
| | |
| | date >> $THIS_JOB |
| | echo "My job ends here" >> $THIS_JOB |
| | </code> |
| |
| |