We offer a limited backup service on the Pan cluster. Data in certain directories is backed up by the University of Auckland Information Technology Services (ITS) to a tape archive, and is generally retained for between three and six months after it is deleted from the cluster.
Which Directories are Backed Up?
Contents of the following directories are typically backed up to tape:
- User home directories
- User project directories
Contents of the following directories are typically not backed up:
- Contents of
nobackupdirectories in home and project directories
- The scratch directory
- The checkpoint directory
- Local temporary directories on the compute nodes
Might My Project be Excluded from Backups?
We may exclude specific projects or user home directories from the backup manifest. We are more likely to do so for projects that require large amounts of disk space or contain many files, especially where the data is expected to undergo frequent or substantial changes.
If we are considering excluding some or all of your project data or your home
directory from our backup manifest, we will usually discuss our plans with you.
We normally offer a
nobackup directory (or alternatively a
directory), so that you and your team can choose which data is most crucial to
be backed up.
What Data Integrity Guarantees does NeSI Offer?
While we do our best to protect data on our cluster against vandalism and accidental loss and damage, you put data on our storage systems at your own risk. We recommend that you keep other copies of any research data that is especially important or difficult or costly to replace.
NeSI does not offer a data archiving service, or data storage beyond the period of time during which the research programme connected with the data is registered with us and active. If you require a data archiving service, we encourage you to approach your institution's information technology division or explore commercial providers.