The table below specifies the significant differences between Maui and Kupe without regard to NeSI access (i.e. shows the complete set of resources available on both systems).
|
Component |
kupe (XC50) |
maui (XC50) |
Comment |
|
Login nodes (also known as eLogin nodes) |
80 cores in 2 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes |
80 cores in 2 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes |
Identical |
|
Compute nodes |
4,160 Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) cores |
18,560 Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) cores |
Kupe is Air Cooled, Maui is Liquid Cooled |
|
Hyperthreading |
Enabled |
Enabled |
Identical |
|
Theoretical Peak performance |
0.32PF |
1.43PF |
|
|
Memory capacity per login (build) node |
768 GB |
768 GB |
Identical |
|
Compute node memory |
All nodes have 96GB memory |
232 nodes have 96GB memory 232 nodes have 192 GB memory |
50% of Maui’s nodes have “large” memory |
|
Total System memory |
10.0TB |
66.8TB |
|
|
Interconnect |
Cray Aries, Dragonfly topology |
Cray Aries, Dragonfly topology |
Identical |
|
Workload Manager |
Slurm (Multi-Cluster) |
Slurm (Multi-Cluster) |
In Wellington, can submit jobs to all Slurm clusters (maui, maui_ancil and mahuika) |
|
Operating System |
Cray Linux Environment: SLES 12 SP2, and CLE 6.0 UP04 |
Cray Linux Environment: SLES 12 SP2, and CLE 6.0 UP06 |
Maui is on a later version of the Cray OS. |
|
|
|
|
|
|
Component |
kupe_mp (CS500) |
maui_ancil (CS500) |
Comment |
|
Ancillary nodes |
440 cores in 11 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes |
1,120 cores in 28 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes |
Some maui_ancil nodes are available to non-NIWA NeSI users |
|
Hyperthreading |
Enabled |
Enabled |
Identical |
|
Local Disk |
1.2TB SSD |
1.2TB SSD |
Identical |
|
Operating System |
CentOS 7 |
CentOS 7 |
Identical |
|
GGPGUs |
2 × Tesla P100 |
8 × Tesla P100 |
|
|
Remote Visualisation |
Identical |
||
|
Memory per node |
768 GB |
768 GB |
Identical |
|
Interconnect |
EDR (100 Gb/s) InfiniBand |
EDR (100 Gb/s) InfiniBand |
Identical |
|
Workload Manager |
Slurm (Multi-Cluster) |
Slurm (Multi-Cluster) |
Identical |
|
OpenStack |
Used to provide Virtual Machines to users |
Used to provide Virtual Machines to users |
Identical |
|
|
|
|
|
|
Storage |
kupe & kupe_mp |
maui & maui_ancil & mahuika |
Comment |
|
File system Hardware |
IBM ESS 1´GS4S, 2´GL6S, ~70GB/s Bandwidth |
IBM ESS 1´GS4S, 4´GL6S, ~140GB/s Bandwidth IBM ESS 1´GS4, 1´GL6S |
The GS4 and one GL6S are provided for NIWA forecast operations. |
|
Filesystem software |
IBM Spectrum Scale v 4.2.3 |
IBM Spectrum Scale v 5.0.1 |
Scale v5 is faster than Scale v4. |
|
/home and /project |
626 TB |
2,505TB |
Incudes NIWA only storage |
|
/nobackup |
2,505TB |
6,263TB |
Incudes NIWA only storage |
|
/devoper |
470TB |
626TB |
Available to NIWA only |
|
/oper |
626TB |
939TB |
Available to NIWA only |
|
/nearline |
470TB |
626TB |
Accessed via the Librarian |
|
Offline Storage |
>100PB |
>100PB |
Maui uses LT08 drives; Kupe, LTO7 drives. |