Instructions for Transferring Data from Globus to the MSU HPCC
These step-by-step instructions are designed to help users new to Linux and High-Performance Computing (HPC) transfer data from Globus to the Michigan State University High-Performance Computing Center (MSU HPCC).
Prerequisites
- MSU NetID and Password: Ensure you have an active MSU NetID and password.
- HPCC Account: You must have an account on the MSU HPCC.
- Globus Account: No separate Globus account is needed; you’ll use your MSU credentials.
- Web Browser: Access to a web browser like Chrome, Firefox, or Safari.
Step-by-Step Guide
- Access Globus Online
- Open your web browser.
- Go to https://app.globus.org/.
- Log In with Your MSU Credentials
- On the Globus login page, find the section titled “Use your existing organizational login”.
- Click in the search bar under this section and type “Michigan State University”.
- Select “Michigan State University” from the dropdown list.
- Click the “Continue” button.
- Authenticate with MSU
- You will be redirected to the MSU login page.
- Enter your MSU NetID and password.
- Click “Login”.
- After successful login, you’ll be redirected back to the Globus web app.
- Navigate to the File Manager
- On the left-hand side menu, click on “File Manager”.
- Select the Source Data Collection (Starting Point)
- In the File Manager, you’ll see two panels side by side. The left panel is the source (where you’re transferring data from).
- In the source panel, click on the empty search bar next to “Collection”.
- Type the name of the data collection you wish to transfer from.
- Note: If you are receiving data from a genomics core or collaborator, click on the “Shared With You” tab to find your collection.
- Select the appropriate collection from the search results.
- Locate and Select Your Data
- Once the collection loads, navigate through the folders to find your data.
- Click to select the files or folders you want to transfer.
- You can select multiple items by holding down the Ctrl key (Windows) or Command key (Mac) while clicking.
- Set Up the Destination Endpoint (MSU HPCC)
- Above the source panel, click on “Transfer or Sync to…“ to open the destination panel on the right.
- In the destination panel, click on the empty search bar next to “Collection”.
- Type “msuhpcc”.
- Select “Michigan State University MSU ICER” from the list.
- Authenticate the MSU HPCC Endpoint (If Prompted)
- You may be prompted to authenticate the MSU HPCC endpoint.
- Click “Continue” or “Authenticate” as prompted.
- Follow any additional on-screen instructions to complete authentication.
- Specify the Destination Path on the HPCC
- In the destination panel, locate the “Path” field.
- Enter the path where you want to store your data on the HPCC.
- For example:
/mnt/scratch/$yourUsername
- Replace
$yourUsername
with your actual HPCC username.
- For example:
- Press Enter or click the arrow button to navigate to this directory.
- Note: If the directory doesn’t exist, ensure you have the correct path or create the directory using HPCC resources.
- Start the Transfer
- Review your selections:
- Ensure the correct files are selected in the source panel.
- Confirm the destination path is correct.
- Click the “Start” button to begin the transfer.
- Review your selections:
- Monitor the Transfer Progress
- Click on “Activity” in the left-hand menu to view transfer progress.
- You can see active, completed, and failed transfers.
- Globus may send you an email notification when the transfer is complete.
Additional Information
Understanding Key Terms
- Endpoint: A storage system or server where data can be transferred to or from.
- Collection: A shared set of data accessible via an endpoint.
- Path: The specific directory location within an endpoint’s file system.
Tips for New Users
- File Permissions: Ensure you have permission to access the source files and write to the destination directory.
- Data Size: Large data transfers may take time; you can close your browser, and the transfer will continue.
- Data Storage:
/mnt/scratch
is a temporary storage area with large capacity but is purged every 45 days.- For long-term storage, consider using your home directory or group-specific research storage on the HPCC.
Getting Help
- Globus Support: Visit Globus Support for help with the Globus interface.
- MSU HPCC Support:
- Email: general@rt.hpcc.msu.edu
- Phone: (517) 353-9309
- Website: https://contact.icer.msu.edu/contact
Summary
By following these steps, you should be able to transfer data from Globus to the MSU HPCC efficiently. If you encounter any issues or have questions, don’t hesitate to reach out to the support resources listed above.