Kupe and Maui Compared

The table below specifies the significant differences between Maui and Kupe without regard to NeSI access (i.e. shows the complete set of resources available on both systems).

Component

kupe (XC50)

maui (XC50)

Comment

Login nodes (also known as eLogin nodes)

80 cores in 2 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes

80 cores in 2 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes

Identical

Compute nodes

4,160 Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) cores

18,560 Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) cores

Kupe is Air Cooled, Maui is Liquid Cooled

Hyperthreading

Enabled

Enabled

Identical

Theoretical Peak performance

0.32PF

1.43PF

 

Memory capacity per login (build) node

768 GB

768 GB

Identical

Compute node memory

All nodes have 96GB memory

232 nodes have 96GB memory

232 nodes have 192 GB memory

50% of Maui’s nodes have “large” memory

Total System memory

10.0TB

66.8TB

 

Interconnect

Cray Aries, Dragonfly topology

Cray Aries, Dragonfly topology

Identical

Workload Manager

Slurm (Multi-Cluster)

Slurm (Multi-Cluster)

In Wellington, can submit jobs to all Slurm clusters (maui, maui_ancil and mahuika)

Operating System

Cray Linux Environment: SLES 12 SP2, and CLE 6.0 UP04

Cray Linux Environment: SLES 12 SP2, and CLE 6.0 UP06

Maui is on a later version of the Cray OS.

 

 

 

 

Component

kupe_mp (CS500)

maui_ancil (CS500)

Comment

Ancillary nodes

440 cores in 11 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes

1,120 cores in 28 × Skylake (Gold 6148, 2.4 GHz, dual socket 20 cores per socket) nodes

Some maui_ancil nodes are available to non-NIWA NeSI users

Hyperthreading

Enabled

Enabled

Identical

Local Disk

1.2TB SSD

1.2TB SSD

Identical

Operating System

CentOS 7

CentOS 7

Identical

GGPGUs

2 × Tesla P100

8 × Tesla P100

 

Remote Visualisation

NICE DCV

NICE DCV

Identical

Memory per node

768 GB

768 GB

Identical

Interconnect

EDR (100 Gb/s) InfiniBand

EDR (100 Gb/s) InfiniBand

Identical

Workload Manager

Slurm (Multi-Cluster)

Slurm (Multi-Cluster)

Identical

OpenStack

Used to provide Virtual Machines to users

Used to provide Virtual Machines to users

Identical

 

 

 

 

Storage

kupe & kupe_mp

maui & maui_ancil & mahuika

Comment

File system Hardware

IBM ESS 1´GS4S, 2´GL6S, ~70GB/s Bandwidth

IBM ESS 1´GS4S, 4´GL6S, ~140GB/s Bandwidth

IBM ESS 1´GS4, 1´GL6S

The GS4 and one GL6S are provided for NIWA forecast operations.

Filesystem software

IBM Spectrum Scale v 4.2.3

IBM Spectrum Scale v 5.0.1

Scale v5 is faster than Scale v4.

/home and /project

626 TB

2,505TB

Incudes NIWA only storage

/nobackup

2,505TB

6,263TB

Incudes NIWA only storage

/devoper

470TB

626TB

Available to NIWA only

/oper

626TB

939TB

Available to NIWA only

/nearline

470TB

626TB

Accessed via the Librarian

Offline Storage

>100PB

>100PB

Maui uses LT08 drives; Kupe, LTO7 drives.

Was this article helpful?
0 out of 0 found this helpful