Storage Quota Management

This page describes how to manage your storage quota on our Lustre and Panasas storage systems.

Determine quota usage on the HPC/Spear (GPFS)

To determine how much of your quota you are using in your HPC or Spear home directory, login and run the following command:

$ gpfs_quota --home

Showing quota information for home dirctory: user
                         Block Limits                                    |     File Limits
Filesystem type         blocks      quota      limit   in_doubt    grace |    files   quota    limit in_doubt    grace  Remarks
home       USR          73.44G       150G       150G         1M     none |    10515       0        0        0     none DSS01.local

To determine how much of your quota your group is using in your purchased research allocation directory, login and run the following command:

$ gpfs_quota [fileset_name]

Showing quota information for research fileset: [filset_name]
                         Block Limits                                    |     File Limits
Filesystem type         blocks      quota      limit   in_doubt    grace |    files   quota    limit in_doubt    grace  Remarks
research   FILESET      3.902T     5.859T     5.859T     6.237G     none |  3139994       0        0    17734     none DSS01.local

Note, if you need more details or a different output format (such as bytes), you can use the mmlsquota command (refer to official documentation for more info on this command):

# Print home directory quota
/usr/lpp/mmfs/bin/mmlsquota home --block-size=auto

# Print research fileset quota
/usr/lpp/mmfs/bin/mmlsquota -j FILESET_NAME research --block-size=auto

Determine quota usage in Panasas

If your home directory is still located on Panasas, you can determine how much of your quota you are using by running:

$ pan_quota ~

This will produce output simliar to the following:

<GB> <soft> <hard> : <files>    <soft>    <hard> :  <path to volume> <pan_identity(name)>
65.52  95.00 100.00 :    4334 unlimited unlimited : /panfs/storage.local/genacc/home/USER uid:99999(USER)

If you are a member of one or more research groups that has purchased space in the Panasas filesystem, you can determine how much space your group is using and what your group quota is.  Before you can check your group's quota usage, you must know what path in the system your groups' volumes are mounted at.  If you do not know where these mountpoints are, you can contact RCC Support to get a list.

To see the quota usage for you're group's volume, simply run:

$ pan_df -h /panfs/storage.local/PATH/TO/GROUP/VOLUME

Determine quota usage in Lustre

If you still have a Lustre home directory, login to Spear and run:

$ lfs quota -h -g `whoami` /lustre

This command will produce output similar to the following:

     Filesystem    used   quota   limit   grace   files   quota   limit   grace
/lustre/genacc/home/YOUR_ACCT
                 3.237G     90G    100G       -    1779       0       0       -

If you are a member of a research group that has purchased space in Lustre, you can view your group's storage usage in Lustre by running (substitute the group name for <GROUPNAME>):

lfs quota -h -g <GROUPNAME> /lustre

This command will produce output similar to the following:

Disk quotas for group <GROUPNAME> (gid 999999):
     Filesystem    used   quota   limit   grace   files   quota   limit   grace
        /lustre      4k      2M      2M       -       1       0       0       -

You can determine which groups you belong to by running the groups command:

$ groups

Which directories or users are using the most storage space?

Within any directory on any filesystem, you can calculate the distribution of storage space used by using the du command.  Warning: This command can take a very long time to run, since it must read the file attributes for every single file in a given directory tree.  It is recommended you run this command in a screen session.

du -ch --max-depth=1 /PATH/TO/ANALYZE