Storage

User account Space

Each user account has a quota of 50GB in the home directory. Additional space is available, please send email to help-hpc@caltech.edu for information. 

Group Space

Each research group has a quota of 10TB in /central/groups/<groupname>. Additional space is available, please send email to help-hpc@caltech.edu for information. 

Scratch Space

There are two scratch directories available. A 500TB of standard, high speed disk mounted on /central/scratch and a 30TB high IO disk mounted on /central/scratchio.  Best practice dictates creating directory for yourself (e.g. /central/scratch/<username>) and working with files from inside of said directory.  These disks are truly meant as scratch space. Any files not accessed in 7 days will be automatically purged

Checking Quotas for User and Group

To check see how much storage you are using you can use the mmlsquota

mmlsquota  --block-size auto

To check for your group storage

mmlsquota -j  groupname  --block-size auto central

Snapshots

The GPFS based file system uses snapshot technology that will capture file changes in the following way:

  • Every 4 hours for 1 day
  • Every day for 1 week
  • Every week for 4 weeks
The snapshot directory is not listable, but can be found be changing directory to ".snapshot".

Backup and Archive

There is no formal BCP/DR style back up nor archival system in place. If you require traditional backups or archival storage please reach out to IMSS (help-hpc@caltech.edu) and we can help design a system for your needs.