User Tools

Site Tools


guide:connect

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
guide:connect [2018/12/21 08:56]
ccrosby [Transferring Files]
guide:connect [2019/08/13 17:57] (current)
wikiadmin [Connecting to the CHPC]
Line 2: Line 2:
  
 The CHPC hosts a supercomputer comprising: The CHPC hosts a supercomputer comprising:
-    * 1008 regular compute nodes with 24 cores and 128 GiB of RAM each; and +    * 1008 regular compute nodes with 24 cores and 128 GiB of RAM each;  
-    * 5 large memory nodes with 56 cores 1TiB of RAM each+    * 360 regular computes nodes with 24 cores and 64 GiB of RAM each; 
 +    * 5 large memory nodes with 56 cores and 1TiB of RAM each
 +    * 9 [[guide:​gpu|GPU]] nodes.
  
-The cluster will be augmented in the future with: 
-  * a GPU-powered visualisation node; and 
-  * other specialised servers ​ 
  
 =====Host Name===== =====Host Name=====
Line 24: Line 23:
  
 ===== Dedicated scp.chpc.ac.za ===== ===== Dedicated scp.chpc.ac.za =====
-A dedicated node, ''​**scp.chpc.ac.za**''​ is available for large or long-running ​file transfers:+A dedicated node, ''​**scp.chpc.ac.za**''​ is available for scp file transfers:
 <​code>​ <​code>​
   scp src.tar.gz username@scp.chpc.ac.za:​~/​scratch/​   scp src.tar.gz username@scp.chpc.ac.za:​~/​scratch/​
Line 32: Line 31:
 ===== Transferring Files ===== ===== Transferring Files =====
  
-Use scp or sftp to transfer files to or from your home directory on the CHPC systems. ​ For example+**Large data sets should be transferred by means of [[howto:​globus|Globus]]. ​ Globus is faster and more reliable than scp.** 
 + 
 +You can also use scp or sftp to transfer files to or from your home directory on the CHPC systems. ​ For example
 <​code>​ <​code>​
   scp src.tar.gz username@scp.chpc.ac.za:​~/​lustre/​   scp src.tar.gz username@scp.chpc.ac.za:​~/​lustre/​
 </​code>​ </​code>​
-to copy the file //​src.tar.gz//​ to your lustre directory on the CHPC cluster. ​ Please note that storage space in your home directory is very limited. ​ Large amounts of data should rather be transferred to your storage space on the lustre file system. ​ For a ** typical ** user, there will be a symbolic link to the user's directory on lustre, hence the ~/lustre/ target. ​ Alternatively,​ you may wish to copy directly to your lustre storage, in which case you could do the following:+to copy the file //​src.tar.gz//​ to your lustre directory on the CHPC cluster.  ​**Please do not transfer files directly to lengau.chpc.ac.za.** It is a shared login node, and in order not to overload it, file transfer should be done to the dedicated scp server. ​Please note that storage space in your home directory is very limited. ​ Large amounts of data should rather be transferred to your storage space on the lustre file system. ​ For a ** typical ** user, there will be a symbolic link to the user's directory on lustre, hence the ~/lustre/ target. ​ Alternatively,​ you may wish to copy directly to your lustre storage, in which case you could do the following:
  
 <​code>​ <​code>​
/var/www/wiki/data/attic/guide/connect.1545375366.txt.gz · Last modified: 2018/12/21 08:56 by ccrosby