Kupe to Maui Data Migration

Important Message to NeSI Kupe Users

Date: 11 September 2018

This is an IMPORTANT update to the message we sent out on Tue 28/08/2018 (Subj: Platform migration update for NeSI Kupe users).

Data Synchronisation

We are in the process of synchronising (i.e. migrating) the data on the Kupe filesystems (/home, /nesi/project and /nesi/nobackup) to filesystems of the same name on the HPCF (i.e. those shared by Mahuika and Maui). 

VERY IMPORTANT: The synchronisation process treats the files on Kupe as the master list of files. Accordingly, only those files that are on Kupe will be present on the HPCF after the synchronisation is complete.

Please read the following 4 steps carefully, because not following these instructions could lead to a loss of data.

Step 1

If you have data on Kupe’s filesystems that you have no further need of, delete it now (this will speed-up the data migration process).

Step 2

If you have data on the HPCF filesystems, that is later than that on Kupe that you wish to retain, and have not received a previous email on this topic from us, please send an email to support@nesi.org.nz specifying which filesystems / directories should be excluded from synchronisation.  You must do this before 1800 NZST on Thursday 13th September. Failure to do so could lead to loss of data.

Step 3

From 1800 NZST, on Thursday 13th September, NeSI will begin synchronising your data from Kupe to the HPCF.

We are providing you with a tool that allows you to tell NeSI when to stop syncing your data.

  • If you want NeSI to stop syncing data from your Kupe home directory to the HPCF, then on Kupe:
    1. Delete the file: /home/<user name>/KUPE_SYNC
    2. The sync process will be stopped. If you need to re-enable a sync you will have to send an email to support@nesi.org.nz. Re-creating the file will not trigger a new sync.
    3. The file /home/<user name>/KUPE_LAST_SYNC contains information about the last completed synchronisation.
  • Similarly, if you want NeSI to stop syncing data from your Kupe project directory to the HPCF, then on Kupe,
    1. Delete the file: /nesi/project/<project_id>/KUPE_SYNC
    2. The sync process will be stopped. If you need to re-enable a sync you will have to send an email to support@nesi.org.nz. Re-creating the file will not trigger a new sync.
    3. The file /nesi/project/<project_id>/KUPE_LAST_SYNC contains information about the last completed synchronisation.
  • Similarly, if you want NeSI to stop syncing data from your Kupe nobackup directory to the HPCF, then on Kupe:
    1. Delete the file: /nesi/nobackup/<project_id>/KUPE_SYNC
    2. The sync process will be stopped. If you need to re-enable a sync you will have to send an email to support@nesi.org.nz. Re-creating the file will not trigger a new sync)
    3. The file /nesi/nobackup/<project_id>/KUPE_LAST_SYNC contains information about the last completed synchronisation.

Step 4

Once you have turned off syncing between Kupe and the HPCF, you should stop using Kupe. To do otherwise will only lead to confusion!

NOTE to NIWA/NeSI Users

Applies only to users who have personal nobackup directories (e.g. /nesi/nobackup/bloggs).

On the HPCF your personal directory will be set to Read Only.  This will allow you to copy relevant data into the correct project directory (e.g. to /nesi/nobackup/niwa00111/bloggs), as it is not possible to support personal nobackup directories on the HPCF.

Maui Access

Logins to Maui will be enabled later this week. We will provide more information prior to that date.  Users should plan to transition from Kupe to Maui as soon as possible (preferably within a week of the system being released for Service).

 

Labels: announcement
Was this article helpful?
0 out of 1 found this helpful