Updated 2021-10-18

PACE Policies

Software Standards

  • Software is a critical component of the clusters. The primary software stack will be based on RedHat Enterprise Linux and other widely available open source tools. Available software and versions can be listed on systems using the "module spider" command. All software on PACE-administered clusters must be installed and used in compliance with Georgia Tech's Computer and Network Usage and Data Access Policies. Software installation policies can be found in below sections.

Maintenance Schedule

  • There are regularly scheduled maintenance windows scheduled four times annually. The degree of impact depends on the type of maintenance being performed. All efforts are made to limit downtime during prescribed maintenance periods. All users will be notified via email well in advance of upcoming scheduled maintenance events.

Job Scheduling

  • Jobs must be run using provided workload schedulers. We currently use Moab/Torque. This allows users to gain experience with standard HPC environments which are used in other places, including national labs and the XSEDE.

Headnodes (Login Nodes)

  • Headnodes (a.k.a login nodes) are shared by multiple users and must be used only for submitting jobs and other light weight activities. It is against policy to run any operation on the headnodes that will impact their responsiveness. These include user processes that consume 90% or more of a CPU, 50% of the available memory, and/or large data operations or transfers (including SFTP connections) that have visible adverse impact on the responsiveness of the headnodes. Processes violating this policy will be killed by the PACE team after 30min of run. PACE team will show best effort to contact the users before killing processes, but reserves the right to kill any processes in violation without notification.

Scratch Storage

Project and Home Directory Storage

  • Both home directories and project directories are subject to quotas. Quotas limit the amount of data that can be stored.
  • Project storage is subject to quotas based on requests from a PI. Authorized requests must be sent to pace-support@oit.gatech.edu.
  • Home and project space are backed up daily. Please contact pace-support@oit.gatech.edu to restore deleted files.

New User Policies

  • PACE clusters are available to all GT Faculty, staff, students, and external collaborators who have been granted access by an Authorized Requester, namely a member of the faculty (PI) or someone designated by the PI. Authorized requests must be sent to pace-support@oit.gatech.edu.
  • PACE clusters are a campus resource subject to the Georgia Tech Cyber Security Policies.

Continued Access to PACE After GT Affiliation Status Changes

  • Users can continue to access PACE after their status have changed (e.g. graduation, new research group, end of collaboration, etc) if approved by their PI and they have an active GT account that allows them to connect to VPN. Users who no longer have access to VPN can be provided with continued access to PACE after the following steps:
    1. Find a sponsor with active GT credentials (generally, the PI), who can open them a guest account from passport
    2. The PI should send pace-support@oit.gatech.edu a request, including the old and new (guest) usernames. If they need existing data migrated to the new account, this should be requested specifically in the ticket.
  • PACE will then create a new account using the guest credentials and migrate the files if requested. Ideally, the user will not see any differences in charge accounts or files, other than the changed username.
  • The GT sponsor hosting the guest account(s) assumes all responsibility for the users and their conformance to the GT and PACE usage policies. These accounts can be extended as needed by the GT sponsor from passport.