Nodes
Jump to navigation
Jump to search
Contents
Quick Node Overview
| Cluster Part | Mumber of Nodes |
CPUs per Node |
Cores per Node |
CPU Basic Frequency / All Core Max. [GHz] |
CPU Family | RAM per Node [GB] |
Extras Per Node | Function |
|---|---|---|---|---|---|---|---|---|
| Quantum Login nodes | 2 | 64 | 32 | 2.1 / 2.8 | Xeon Scalable (Skylake-SP) | 384 | nVidia Titan RTX | Login nodes (Currently one for QH and one for QH2) |
| Quantum 1 node | 1 | 448 | 224 | 2.5 / 3.2 | Xeon Scalable (Skylake-SP) | 6144 | Big Local NVMe Storage | Execution node for huge jobs requiring huge memory, large number of CPUs and big data. |
| Quantum 2 nodes | 3 | 96 | 48 | 3.2 / 3.9 | Xeon Scalable (Skylake-SP) | 1536 | Local NVMe Storage | Execution nodes for big jobs requiring fast CPUs. |
| Quantum 3 nodes | 7 | 64 | 32 | 2.3 / 2.8 | Xeon Scalable (Cascade Lake-SP) | 192 | Execution nodes primarily for ELI beamline experiments. | |
| Quantum GPU1 node | 1 | 16 | 8 | 3.8 / 3.9 | Xeon Scalable (Cascade Lake-SP) | 384 | 2x nVidia Tesla Volta V100 SXM2 (NVLink) | Execution node for jobs using GPU computations. |
| Hyperion nodes | 4 | 32 | 32 | 2.1 / 2.4 | Opteron 62xx (Interlagos) | 128 | Common execution nodes. | |
| 16 | 32 | 32 | 2.1 / 2.4 | Opteron 62xx (Interlagos) | 64 | |||
| 1 | 32 | 32 | 2.1 / 2.4 | Opteron 62xx (Interlagos) | 64 | nVidia GTX Titan | Common execution node with possibility of smaller GPU computations. | |
| Storage nodes | 1 | 40 | 20 | 2.2 / 2.4 | Xeon E5-26xx v4 (Broadwell) | 128 | 88 TB + 108 TB of effective storage | Main system and home storage and an object storage for large fast data. CFEngine policy source. |
| 1 | 32 | 16 | 2.4 / 2.9 | AMD EPYC (Naples) | 128 | 108 TB of effective storage | Object storage for large fast data. | |
| 1 | 32 | 16 | 2.4 / 2.9 | AMD EPYC (Naples) | 128 | 480 GB of effective fast Intel Optane storage | Metastorage for large fast data. | |
| 1 | 16 | 8 | 3.6 / 4.3 | Xeon Scalable (Cascade Lake-SP) | 384 | 10 TB + 8 GB of effective storage + 1 TB for fast caching and metastorage | Temporary main storage for testing cluster QH2. | |
| Auxiliary nodes | 1 | 4 | 4 | 3.2 / 3.4 | Intel Core i5-3470 (Ivy Bridge) | 8 | Cluster management services (DHCP, DNS, PXE, TFTP, ...). | |
| 1 | 16 | 8 | 2.26 / 2.39 | Intel Xeon-5xxx (Nehalem EP) | 64 | 10Gbps Router/NAT of the entire cluster | ||
| 1 | 12 | 6 | 2.3 / 2.6 | Intel Xeon E5-26xx (Sandy Bridge-EP) | 16 | Quantum Hyperion CFEngine Policy Hub | ||
| 1 | 16 | 8 | 2.26 / 2.39 | Intel Xeon-5xxx (Nehalem EP) | 64 | Auxiliary server for Quantum Hyperion 2 cluster (CFEngine policy distribution hub, SLURM control and database, etc.) | ||
| TOTAL | 43 | 2168 | 1422 | 15768 | ||||
Login Nodes
| Preview | Node Name | Logical CPUs |
Cores | CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Strange Charm |
64 | 32 | 2x Intel Xeon Gold 6130 | 2.1 / 2.8 | 384 GB | 480 GB | RAID1 | 2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (2x connected) 1x 100 Gbps Intel Omni-Path (1x connected) 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (not connected) |
1x nVidia Titan RTX | CentOS 7.9 |
Quantum 1 Node
| Preview | Node Name | Logical CPUs |
Cores | CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Quantum 1 | 448 | 224 | 8x Intel Xeon Gold 8180 | 2.5 / 3.2 | 6.0 TB | 480 GB 19.2 TB |
RAID1 RAID6 |
2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (2x connected) 1x 100 Gbps Intel Omni-Path (1x connected) 2x 1 Gbps Intel Ethernet (not connected) |
Big local NVMe storage | CentOS 7.9 |
Quantum 2 Nodes
| Preview | Node Name | Logical CPUs |
Cores | CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Quantum 2A Quantum 2B Quantum 2C |
96 | 48 | 4x Intel Xeon Gold 6146 | 3.2 / 3.9 | 1.5 TB | 480 GB 1.6 TB |
no-RAID RAID1 |
2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (2x connected) 1x 100 Gbps Intel Omni-Path (1x connected) 4x 1 Gbps Intel Ethernet (not connected) |
Local NVMe storage | CentOS 7.9 |
Quantum 3 Nodes
| Preview | Node Name | Logical CPUs |
Cores | CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Quantum 3A Quantum 3B Quantum 3C Quantum 3D Quantum 3E Quantum 3F Quantum 3G |
64 | 32 | 2x Intel Xeon Gold 5218 | 2.3 / 2.8 | 192 GB | 240 GB | no-RAID | 2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (2x connected) 1x 58 Gbps Intel Omni-Path (1x connected) 2x 1 Gbps Intel Ethernet (not connected) |
CentOS 7.9 |
Quantum GPU1 Node
| Preview | Node Name | Logical CPUs |
Cores | CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Quantum GPU1 | 16 | 8 | 2x Intel Xeon Gold 5222 | 3.8 / 3.9 | 384 GB | 240 GB | no-RAID | 2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (2x connected) 1x 58 Gbps Intel Omni-Path (1x connected) 2x 10 Gbps Intel Ethernet (not connected) |
2x nVidia Tesla V100 (SXM2) | CentOS 7.9 |
Hyperion Nodes
| Preview | Node Name | Logical CPUs |
CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS |
|---|---|---|---|---|---|---|---|---|---|---|
| Hyperion 1 Hyperion 2 Hyperion 3 Hyperion 4 |
32 | 2x AMD Opteron 6272 | 2.1 / 2.4 | 64 GB | 1 TB | no-RAID | 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (1x connected) |
CentOS 7.9 | ||
| Hyperion 5 Hyperion 6 Hyperion 7 Hyperion 8 |
32 | 2x AMD Opteron 6272 | 2.1 / 2.4 | 128 GB | 1 TB | no-RAID | 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (1x connected) |
CentOS 7.9 | ||
| Hyperion 9 Hyperion 10 Hyperion 11 Hyperion 12 Hyperion 13 Hyperion 14 Hyperion 15 Hyperion 16 Hyperion 17 Hyperion 18 Hyperion 19 Hyperion 20 |
32 | 2x AMD Opteron 6272 | 2.1 / 2.4 | 64 GB | 1 TB | no-RAID | 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (1x connected) |
CentOS 7.9 | ||
| Hyperion 21 | 32 | 2x AMD Opteron 6272 | 2.1 / 2.4 | 64 GB | 1 TB | no-RAID | 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (1x connected) |
1x nVidia Titan | CentOS 7.9 |
Storage Nodes
| Preview | Node Name | Logical CPUs |
CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS |
|---|---|---|---|---|---|---|---|---|---|---|
| Magnon | 40 | 2x Intel Xeon E5-2630 v4 | 2.2 / 2.4 | 128 GB | 200 GB 196 TB |
RAID1 RAID6 (x2) |
2x 100 Gbps Chelsio Ethernet with iWarp/RDMA (1x connected) 1x 100 Gbps Intel Omni-Path (1x connected) 2x 40 Gbps Intel QDR InfiniBand (2x connected) 4x 1 Gbps Intel Ethernet (not connected) |
2x 800 GB NVMe (RAID cache) | Gentoo | |
| Magnon 2 | 32 | 1x AMD EPYC 7351P | 2.4 / 2.9 | 128 GB | 240 GB 108 TB |
RAID1 RAID6 |
2x 100 Gbps Chelsio Ethernet with iWarp/RDMA (1x connected) 1x 100 Gbps Intel Omni-Path (1x connected) 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (not connected) |
CentOS 7.9 | ||
| Magnon 3 | 32 | 1x AMD EPYC 7351P | 2.4 / 2.9 | 128 GB | 240 GB 480 GB |
RAID1 RAID1 |
2x 100 Gbps Chelsio Ethernet with iWarp/RDMA (1x connected) 1x 100 Gbps Intel Omni-Path (1x connected) 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (not connected) |
Second RAID1 is on Intel Optane SSDs | CentOS 7.9 | |
| Magnon 4 | 16 | 1x Intel Xeon Gold 6244 | 3.6 / 4.3 | 384 GB | 500 GB (OS) 10 TB (RDMA/NFS) 8 TB (Lustre OST) |
no-RAID | 2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (1x connected) 1x 58 Gbps Intel Omni-Path (1x connected) 1x 40 Gbps Intel QDR InfiniBand (1x connected) 2x 1 Gbps Intel Ethernet (not connected) |
1x 1 TB NVMe (RAID cache + Lustre MDT/MGT) | CentOS 9 Stream |
Auxiliary Nodes
| Preview | Node Name | Logical CPUs |
CPU Type | CPU Frequency Base/All-Core [GHz] |
RAM | Total Disk Space |
Disk Topology |
Connections | Extras | OS | Services |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Muon | 4 | 1x Intel Core i5-3470 | 3.2 / 3.4 | 8 GB | 500 GB | no-RAID SSD | 1x 1 Gbps Intel 82579LM (Lewisville) (1x connected) 1x 1 Gbps Realtek RTL8111/8168 (1x connected) |
CentOS 9 Stream | Basic Quantum Hyperion ethernet network services (DHCP, PXE Install, TFTP Boot, DNS, NTP, ...) | ||
| Meson 2 | 16 | 2x Intel Xeon E5520 | 2.26 / 2.39 | 64 GB | 450 GB | no-RAID | 2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (2x connected) 2x 1 Gbps Intel Ethernet (1x connected) |
CentOS 7.7 | Quantum Hyperion NAT/Firewall/Router. | ||
| Muon 4 | 12 | 1x Intel Xeon E5-2630 | 2.3 / 2.6 | 16 GB | 900 GB 1200 GB |
RAID1 RAID5 |
4x 1 Gbps Intel i350 (1x connected) | CentOS 8.2 (reinstall to 7.7) |
Quantum Hyperion CFEngine Policy Hub | ||
| Muon 5 | 16 | 2x Intel Xeon E5520 | 2.26 / 2.39 | 64 GB | 500 GB | no-RAID SSD | 2x 10 Gbps Chelsio Ethernet with iWarp/RDMA (1x connected) 2x 1 Gbps Intel Ethernet (not connected) |
CentOS 9 Stream | Quantum Hyperion 2 auxiliary server (CFEngine policy distribution hub, SLURM master and database, etc.). |
