Updated 2020-01-16

Using Globus to Transfer Files

Note

If you are looking for instructions on using the globus-url-copy command line tool, please visit the globus-url-copy Command Line Tool page.

Why use Globus?

  • PACE provides free access
  • Has a graphical web-based interface
  • Provides the option to encrypt files
  • Secure file transfer handles even protected data like HIPAA regulated data
  • Automatically resumes file transfer if system goes offline once it comes back online
  • Globus is the fastest and most effecient file transfer option, especially for large transfers

Step 1: Making an account

  • Georgia Tech already provides accounts, so all you have to do is sign in with your Gatech information
  • Go to https://www.globus.org/ and click Log In
  • Search for and select "Georgia Institute of Technology", you will then be taken to the Gatech login page
  • After logging in with your GT credentials, you will be redirected to the main file transfer screen

Step 2: Installing the Globus Personal Client

  • The Globus Connect Personal Client is how Globus will have access to your files
  • After installing the personal client, you will have to set up your computer as an endpoint to allow files to be transfered to and from it
  • Log in to Globus then follow these well documented guides on how to install the Globus Personal Client and set up an endpoint:
  • Windows
  • Mac
  • Linux. Linux is a bit tricky, after using tar to extract the files, if ./globusconnect & gives errors about tcllib, skip to the part of the guide titled "How to Install Globus Connect Personal for Linux Using the Command Line" and follow that.
  • On Linux, try ./globusconnectpersonal -start & if ./globusconnect & doesnt work

Warning

Linux: Globus also has a standalone command line tool, globus-cli which needs to be installed on Linux if you are installing the personal client through the command line

  • If you want to create an endpoint and do not have globus cli installed or cannot login, you can create the endpoint in the globus.org portal. Navigate to the endpoints link:

Screenshot

Choose globus connect personal Screenshot

Select generate setup key for a selected name (in our case rich116-f39-15-004) Screenshot

Copy the setup key and use in the globusconnectpersonal -setup <the key you copied> Screenshot

Step 3: Set Endpoints for transfer

Important

Make sure the Globus Personal Client is running on your computer before setting up endpoints

  • Log in, and you will be taken to the main file manager screen

Screenshot

  • To set up your computer as one endpoint:
    • Click on the Collection Bar at the top
    • click on "Your Collections"
    • if you set up your endpoint correctly following the documentation linked above, the endpoint you created should show up
    • select it and you should be taken back to the file manager page, with your computer's files available to transfer showing up on the left

Screenshot

  • To set up the cluster as the other endpoint:
    • Click "Transfer or Sync to" which should open up a blank endpoint screen right next to your computer's files

Screenshot

  • Select the top bar labeled "collection" (next to the name of your computer endpoint)
  • Search for "PACE", and select PACE Internal. PACE Internal is the node that is specifically meant for fast data transfer.

Screenshot

  • You will be prompted for a username and password, enter your GT username and password

Screenshot

  • Your cluster account and all your files on the cluster should now show up on the right
  • You can now transfer files between your account on the cluster and your personal computer

Tip

After the first time setting the endpoints, they will be saved under recent, so you can easily select them. The Globus Personal Client must be running before setting any endpoints

Transfer files and folders

  • Select the folder / file you want to transfer
  • Select Transfer or Sync to... on the menu in the middle
  • Select the folder you want to transfer to
  • Select one of the Start button at the bottom of the screen, with the arrow direction corresponding to the direction of transfer (i.e personal machine to cluster or cluster to personal machine)
  • Status of the transfer can be viewed in Activity located in the menu on the left (click on top left corner if it isnt shown")
  • Globus should send you an email when the transfer is complete
  • Example: Here I have selected the win-library folder on my laptop and my data folder on the cluster
    • Transfer from my laptop to the cluster: To transfer the win-library folder to the cluster, I would select the start arrow in the bottom left
    • Transfer from the cluster to my laptop: To transfer my data folder from the cluster to my laptop, I would select the start arrow in the bottom right

Screenshot

Using Globus Recap

Warning

Always make sure the Globus Personal Client is running before you go to transfer files

  1. Start globus personal client (using its program gui if on Windows or Mac)
    • On linux, navigate to where you installed the globuspersonalclient files, cd globuspersonalclient-x.y.z (x.y.x is version number) and then run ./globusconnectpersonal -start &
  2. Log into Globus, you should then be directed to the main file manager page. Other pages including activity page and endpoint manager are available in the drop down menu on the left (click top left if the menu is not visible)
  3. To set your personal machine as an endpoint, click on the "collection" bar on the top left (on file manager page), select your personal computer name (personal endpoint name you made). It should be under "recents" or in "your collections". To set the cluster as the other endpoint, click on the collection bar on the top right, search for PACE -> select PACE Internal. Log in with your GT username and password. The PACE Internal endpoint will also show up in your recents if you have used it before
  4. You can now transfer files and folders as you wish. Monitor transfer status with the Activity tab
  5. When you are done transfering files, logout of globus online, and logout of the personal client on you computer. For linux to logout run globus logout