User Tools

Site Tools


howto:tipsandtricks

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
howto:tipsandtricks [2019/05/22 10:26]
ccrosby [Running software with GUI's]
howto:tipsandtricks [2019/07/15 13:20] (current)
ccrosby [Transferring files to the cluster]
Line 87: Line 87:
  
 ===== Transferring files to the cluster ===== ===== Transferring files to the cluster =====
-Command line scp and rsync are the usual methods for data transfer. ​ However, it is easy to make mistakes, and you need to have the path right. ​ MobaXterm (see above) has an easy to use "drag & drop" interface. ​ [[https://​filezilla-project.org|FileZilla]] is fast, easy to use and runs on Linux, Windows and OSX.  A different option is to use sshfs to mount your lengau directory directly on your workstation. ​ There is a [[https://​github.com/​Foreveryone-cz/​win-sshfs/​releases|Windows sshfs client]] that sort-of works. ​ Sometimes.+Large amounts of data should be transferred by means of [[howto:​globus|Globus]],​ which provides a GUI for managing your data transfers. ​ Globus is based on the GridFTP protocol, and is faster and more robust than scp-based methods. 
 + 
 +Command line scp and rsync are the usual methods for data transfer ​of smaller files. ​ Remember to transfer files to scp.chpc.ac.za rather than lengau.chpc.ac.za  ​However,​ it is easy to make mistakes, and you need to have the path right. ​ MobaXterm (see above) has an easy to use "drag & drop" interface. ​ [[https://​filezilla-project.org|FileZilla]] is fast, easy to use and runs on Linux, Windows and OSX.  A different option is to use sshfs to mount your lengau directory directly on your workstation. ​ There is a [[https://​github.com/​Foreveryone-cz/​win-sshfs/​releases|Windows sshfs client]] that sort-of works. ​ Sometimes.
  
  
 ===== How to qsub from a compute node ===== ===== How to qsub from a compute node =====
-Lengau is set up in such way that it is not possible to submit another ​PBS script (qsub) ​from a compute node.  However, it is possible to have an ssh command in a PBS script, so the obvious solution is to ssh to the login node in order to submit another PBS script, if you wanted to submit another PBS script at the completion of the current one, you could insert a line like this at the end of your first script:+You may have difficulties submitting ​a PBS job from a compute node.  However, it is possible to have an ssh command in a PBS script, so the obvious solution is to ssh to the login node in order to submit another PBS script, if you wanted to submit another PBS script at the completion of the current one, you could insert a line like this at the end of your first script:
 <​code>​ <​code>​
 ssh login2 qsub /​mnt/​lustre/​users/​jblogs/​scripts/​PBS_Script1 ssh login2 qsub /​mnt/​lustre/​users/​jblogs/​scripts/​PBS_Script1
/var/www/wiki/data/attic/howto/tipsandtricks.1558513580.txt.gz · Last modified: 2019/05/22 10:26 by ccrosby