User Tools

Site Tools


guide:m9000

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
guide:m9000 [2013/07/25 15:03]
kevin
guide:m9000 [2021/12/09 16:42] (current)
Line 11: Line 11:
 ^ Memory | 2 048 GB (2 TB)| ^ Memory | 2 048 GB (2 TB)|
 ^ Peak performance | 2 Tflops | ^ Peak performance | 2 Tflops |
-^ Linpack peformance | [[wp>SPARC_Enterprise|1.032 Tflops]] |+^ Linpack performance | [[wp>SPARC_Enterprise|1.032 Tflops]] |
 ^ Interconnect | Jupiter | ^ Interconnect | Jupiter |
 ^ O.S. | Solaris 10 | ^ O.S. | Solaris 10 |
Line 31: Line 31:
 | Scratch | XFS | ''/scratch''/* | 5.3 TB | Scratch (local) storage | | Scratch | XFS | ''/scratch''/* | 5.3 TB | Scratch (local) storage |
 | | | ''/scratch/work/'' | 5.3 TB | Local scratch **work** directory | | | | ''/scratch/work/'' | 5.3 TB | Local scratch **work** directory |
-| Gridware | NFS | ''/opt/gridware'' | 1.6 TB | Shared software: compilers, tools, libraries and applications |+| Gridware | NFS | ''/opt/gridware'' | 1.6 TB | Shared software*: compilers, tools, libraries and applications |
 | Home | NFS | ''/export/home'' | 1.8 TB | Users' home directories from Sun cluster storage | | Home | NFS | ''/export/home'' | 1.8 TB | Users' home directories from Sun cluster storage |
-| Software | | ''/opt/software'' | | SPARC64-Soris compatible software: compilers and libraries|+| Software | | ''/opt/software'' | | SPARC64-Solaris compatible software: compilers and libraries| 
 + 
 +  * **WARNING:** *Most of the software in ''/opt/gridware'' is compiled for the amd64 (x86_64) architecture of the Sun/Dell clusters and is **not** usable on the sparc architecture of the M9000.
  
 The M9000 does not mount the Lustre SCRATCH* file systems.  If you need fast local storage for your processing jobs, request a sub-directory be created for you on ''/scratch/work/'' by emailing {{:guide:helpdesk.png?nolink|}}. The M9000 does not mount the Lustre SCRATCH* file systems.  If you need fast local storage for your processing jobs, request a sub-directory be created for you on ''/scratch/work/'' by emailing {{:guide:helpdesk.png?nolink|}}.
Line 86: Line 88:
 Example code from [[https://computing.llnl.gov/tutorials/openMP/samples/C/omp_hello.c]] Example code from [[https://computing.llnl.gov/tutorials/openMP/samples/C/omp_hello.c]]
  
-With the Sun Studio compilers, use the ''-xopenmp=parallel'' option or the safer ''-xopenmp=noopt'' option.+With the Sun Studio compilers, use the ''-xopenmp=parallel'' option or the safer ''-xopenmp=noopt'' option. See Oracle's [[http://docs.oracle.com/cd/E19205-01/820-7883/820-7883.pdf|documentation]].
  
 | ''-xopenmp=parallel'' | Enables recognition of OpenMP pragmas. **The minimum optimization level for ''-xopenmp=parallel'' is ''-xO3''**. The compiler changes the optimization from a lower level to ''-xO3'' if necessary, and issues a warning. | Not recommended unless you know what you are doing and really want full speed. | | ''-xopenmp=parallel'' | Enables recognition of OpenMP pragmas. **The minimum optimization level for ''-xopenmp=parallel'' is ''-xO3''**. The compiler changes the optimization from a lower level to ''-xO3'' if necessary, and issues a warning. | Not recommended unless you know what you are doing and really want full speed. |
Line 98: Line 100:
  
 ====MPI==== ====MPI====
 +
 +=====Job submission=====
 +[Courtesy of Sean February]
 +
 +The queue name for the M9000 machine is spark. Your job script (see example below) must be located somewhere in ''/scratch/work/yourusername/'' (equivalently ''/export/home/yourusername/m9_scratch/''). Submission should be done normally via the PBS scheduler from the login node:
 +<code>
 +yourusername@login02:~/m9_scratch $ qsub jobscriptname
 +</code>
 +
 +Example script:
 +<code bash>
 +#!/bin/sh
 +#PBS -N test
 +#PBS -q spark
 +#PBS -l select=1:ncpus=10:mpiprocs=10
 +#PBS -l place=free
 +#PBS -l walltime=01:00:00
 +#PBS -o /scratch/work/yourusername/stdout
 +#PBS -e /scratch/work/yourusername/stderr
 +cd $PBS_O_WORKDIR
 +
 +HOME_DIR=/scratch/work/yourusername/
 +LOG_NAME=testjob_log
 +THIS_JOB=$HOME_DIR$LOG_NAME
 +
 +echo "My job starts here" > $THIS_JOB
 +date >> $THIS_JOB
 +pwd >> $THIS_JOB
 +echo $PATH >> $THIS_JOB
 +echo `cat $PBS_NODEFILE` >> $THIS_JOB
 +
 +date >> $THIS_JOB
 +echo "My job ends here" >> $THIS_JOB 
 +</code>
  
  
/app/dokuwiki/data/attic/guide/m9000.1374757432.txt.gz · Last modified: 2021/12/09 16:42 (external edit)