We provide scratch space on our Panasas file system for writing large amounts of temporary data for running jobs. Scratch space is provided first-come, first-serve and there are no individual user quotas.
What is Scratch Space for?
Sometimes a compute job may generate large amounts of temporary data while the job is running, but that data is then discarded when the job completes. Our scratch volume exists to accomodate this type of data.
If you expect that your compute job will generate more data than your allocated Panasas quota, you may wish to write temporary job I/O data to our scratch space.
Scratch Space Etiquitte
Scratch space is intended to be temporary storage for reading and writing to and from running jobs. Once your jobs complete, you should move any scratch data you have generated to a permanent storage volume (e.g your Panasas home directory), or discard it.
Since scratch space is a shared resource, we reserve the right to delete any data at any time that we feel is inhibiting the abiltiy of other RCC users to use the resource.
Currently, scratch space access is provided on an as-needed basis. Any RCC user can request access by sending us a support request.
Owner-Based Scratch Space
If you are a member of an owner-based group, such as IMB or COAPS, your account may have access to owner-based scratch space. Consult with your faculty sponsor or inquire with us.
Using General Access Scratch Space
If you have been granted access to scratch space on the HPC, then you can use it by accsesing your home directory in the home volume. This directory will be located in:
For example, for HPC user jsmith:
You can configure your HPC jobs to read/write to this directory during execution. For convenience, you may wish to create a symbolic link inside your home directory, which points to your scratch directory:
# Create the symbolic link named 'scratch' [jsmith@hpc-login-39 ~]$ ln -s /panfs/storage.local/scratch/jsmith scratch # From now on, you can use ~/scratch to refer to your scratch space: [jsmith@hpc-login-39 ~]$ ls ~/scratch