User Tools

Site Tools


howto:globus

Using Globus to transfer data

:!: Please note: :!: Due to the previous version of Globus having been “end-of-lifed” at the end of 2023, it has been necessary to update the Globus software version on the CHPC's data transfer node. Unfortunately, this has introduced two additional steps in the process:

  1. The need to register a free Globus-ID.
  2. Request the CHPC to associate your Globus-ID with your Lengau login ID.

Background

Globus is a set of data transfer and management tools built on top of the GridFTP protocol. The aim of GridFTP is to provide a more reliable and higher performance file transfer protocol. It is thus particularly well-suited to the requirements of HPC cluster users.

Instructions

Go to Globus Connect Personal to set up a Globus endpoint on your workstation. Follow the instructions provided by Globus. You need to :

  1. Designate your workstation as an endpoint
  2. Generate a Setup Key for installation
  3. Download and install the software
  4. You will be prompted to log into Globus:
    • If you have an email address from an institution that has a Globus subscription, use that email address.
    • If you do not have such an email address, use any of your valid email addresses to register and log into Globus. You can then register a free Globus-ID when prompted.
  5. Once you have a valid Globus-ID or other Globus-aware email address, contact the CHPC helpdesk and request that your Globus-ID be associated with your Lengau login ID.

Once you have the software running, it will prompt for the setup key. Once you have the software running (as a web client), you can search for and select the CHPC's endpoint with the search terms CHPC South Africa - Lengau, which will bring up the server dtn.chpc.ac.za. You will no longer use your Lengau login credentials to authenticate on that endpoint. If your Globus-ID has been associated with your Lengau login ID, you will be authenticated automatically with ssh keys.

You will now be provided with a file manager interface, which you can use to explore the file systems on your endpoints. Files can be transferred between two remote endpoints, for example, without needing to pass through your local workstation. You can monitor and control the file transfer task with the “Activity” option on the sidebar menu.

/app/dokuwiki/data/pages/howto/globus.txt · Last modified: 2024/02/08 11:54 by ccrosby