This announcement is an updated version of the email we sent to all active users on 8th November 2019.
From 26 November 2019 we will take next steps to implement data expiry and automated deletion to optimise the availability of the highest performance storage on our HPC platform -- /nesi/nobackup/ storage, a.k.a the “nobackup” filesystem.
What does this mean?
Project directories in /nesi/nobackup/ (e.g. /nesi/nobackup/nesi12345/) are intended for active data that needs to be accessed and stored by your HPC compute and analytics jobs or associated interactive processing. All NeSI projects also have a persistent project directory in /nesi/project/ which is available for the life of the project on NeSI.
Later this month, we will begin rolling out a new data expiry feature to remove inactive research data from /nesi/nobackup/ - data which hasn’t been accessed or modified within the last 120 days, stored in a nobackup project directory that takes up at least 1 TB of disk space.
NeSI Support has information and instructions here: Automatic cleaning of nobackup file system
How does this affect me?
Starting on 26 November, we will begin to roll out data expiry and automated deletion. This process carries through to late January 2020.
We will successively identify and work with a subset of project teams to implement data expiry and automated deletion on all associated /nesi/nobackup/<project code>/ directories.
We will contact each project team directly when this is being implemented on their project directories, and any files about to expire will be notified 2 weeks prior to actual deletions taking place. More information is available on NeSI Support: Automatic cleaning of nobackup file system
Look out for further updates as this rollout progresses.
If you have any questions, please contact our support team.
The NeSI Team