Storage Quota Management

This page describes how to manage your storage quota on our Lustre and Panasas storage systems.

Determine quota usage in Panasas

To determine how much of your quota you are using in your Panasas home directory, login to the HPC and run:

$ pan_quota ~

This will produce output simliar to the following:

<GB> <soft> <hard> : <files>    <soft>    <hard> :  <path to volume> <pan_identity(name)>
65.52  95.00 100.00 :    4334 unlimited unlimited : /panfs/storage.local/genacc/home/USER uid:99999(USER)

If you are a member of one or more research groups that has purchased space in the Panasas filesystem, you can determine how much space your group is using and what your group quota is.  Before you can check your group's quota usage, you must know what path in the system your groups' volumes are mounted at.  If you do not know where these mountpoints are, you can contact RCC Support to get a list.

To see the quota usage for you're group's volume, simply run:

$ pan_df -h /panfs/storage.local/PATH/TO/GROUP/VOLUME

Determine quota usage in Lustre

To determine how much of your quota you are using in your Lustre home directory, login to Spear and run:

$ lfs quota -h -g `whoami` /lustre

This command will produce output similar to the following:

     Filesystem    used   quota   limit   grace   files   quota   limit   grace
/lustre/genacc/home/YOUR_ACCT
                 3.237G     90G    100G       -    1779       0       0       -

If you are a member of a research group that has purchased space in Lustre, you can view your group's storage usage in Lustre by running (substitute the group name for <GROUPNAME>):

lfs quota -h -g <GROUPNAME> /lustre

This command will produce output similar to the following:

Disk quotas for group <GROUPNAME> (gid 999999):
     Filesystem    used   quota   limit   grace   files   quota   limit   grace
        /lustre      4k      2M      2M       -       1       0       0       -

You can determine which groups you belong to by running the groups command:

$ groups

Which directories or users are using the most storage space?

Within any directory on Lustre or Panasas, you can calculate the distribution of storage space used, by using the du command.  Warning: This command can take a very long time to run, since it must read the file attributes for every single file in a given directory tree.  It is recommended you run this command in a screen session.

du -ch --max-depth=1 /PATH/TO/ANALYZE