Storage Overview

This page describes the storage systems available at RCC and how to use them.

At A Glance

  • HPC Storage (GPFS) - The primary parallel storage system available on the High Performance Computing Cluster and Spear
    • Each user is entitled to 150gb of personal storage space in their home directory (/gpfs/home/[username]).
    • Certain research groups have access to dedicated volumes in the /gpfs/research volume.
    • Transfer data to and from GPFS using Globus or SFTP
  • Resarch Archival Storage - A low-cost, long-term storage platform for "at rest" research data
    • Archival storage is available for purchase at a lower rate than Parallel (Panasas/Lustre) storage.
    • Use Globus to transfer data to and from system
    • Use SFTP or SCP to transfer data to and from HPC and Spear systems for data processing
    • Ideal for custom applications with need for large unstructured data storage.  Examples:
      • Storage of unstructured data like image, video, or raw datafiles.
      • Storage of backup files, databasee dumps, and log files

Deprecated Storage Systems

  • Panasas - The primary parallel storage system available on the High Performance Computing Cluster.
    • Each user is entitled 100gb of personal storage in the General Access volume
    • Certain research groups have access to dedicated volumes with additional storage capacities.
    • Each volume resides at a different path in the system.
    • Refer to the Manage Account section of the website to see which Panasas volumes you have access to.
    • Transfer data to and from Panasas using Globus or SFTP.
  • Lustre - The primary parallel storage system available on the Spear Cluster, and used for various other systems.
    • Each user is entitled to 100gb of personal storage in the General Access volume
    • Certain research groups have access to dedicated volumes with additional storage capacities.
    • Each volume resides at a different path in the system.
    • Refer to the Manage Account section of the website to see which Lustre volumes you have access to.
    • Transfer data to and from Lustre using Globus or SFTP

Accessing Filesystems

You can access HPC Storage (GPFS) by logging into the HPC or Spear.  You can also access the filesystem to view and transfer files using an SFTP client or Globus.

To use the Research Archival system from a non-RCC server, you must use Globus.   You can use SFTP/SCP if you are logged in via SSH to any of our computing platforms. Contact us to learn more.