This is an old revision of the document!
The Dell cluster consists of 240 Dell C6100 nodes (12 cores, two sockets, Intel Xeon 2.93 GHz, 36GB RAM, QDR ConnectX2 Infiniband) which are linked into the pre-existing cluster ethernet network and infiniband fabric.
These nodes are:
and run a single operating system image, which at the time of installation is based on the Centos 5.7 distribution of Linux (which is a rebuild of RedHat Enterprise 5.7). Features of this OS distribution include:
These differences lead to methods of code development which are distinct from the rest of Tsessebe system as it currently operates.
However all the Dell nodes see the same
/opt/gridware NFS and
scratch Lustre filesystems as the older nodes.
The following modifications should be made to the shell initialization scripts of new users; current users will need to make these changes individually. These changes are effective only on the Dell nodes (to be exact, on any node which has a file
/etc/redhat-release) and will have no effect on the older nodes.
# Added for new Dell nodes: if [ -f /etc/redhat-release ]; then . /etc/bashrc # Initialize CHPC modules: . /opt/gridware/modules-3.2.7/modules.sh module load dell/default-environment fi
# Added for new Dell nodes: if [ -f /etc/redhat-release ]; then . ~/.bashrc fi
These changes initialize the environment so that Dell-specific software is loaded into the search paths. The new module,
dell/default-environment, automatically loads the pre-existing module
inteltools (providing Intel compilers 12.0 and Intel MPI 4.0.1) and makes additional environment variable settings.
Please note that these changes are essential for proper operation of an account using the Dell compute nodes.
Custom changes to
~/.profile are still possible but care should be taken not to interfere with the initial environment set up above — this means that customisations should respect the following conditions:
LD_LIBRARY_PATHbut should append or prepend to them instead.