Hardware

From Grid5000
Jump to: navigation, search

Summary

  • 8 sites
  • 33 clusters
  • 1064 nodes
  • 12952 CPU cores
  • 88 GPUs
  • 208 SSDs and 1188 HDDs on nodes (total: 1126.93 TB)

Clusters

Site Cluster Queue Date of arrival Nodes CPU Cores Memory Storage Network Accelerators
Grenoble dahu default 2018-03-22 32 2 x Intel Xeon Gold 6130 16 cores/CPU 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Grenoble yeti testing 2018-01-16 4 4 x Intel Xeon Gold 6130 16 cores/CPU 768 GiB 480 GB SSD + 2 x 1.6 TB SSD + 3 x 2.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Lille chetemi default 2016-12-01 15 2 x Intel Xeon E5-2630 v4 10 cores/CPU 256 GiB 2 x 300 GB HDD 2 x 10 Gbps 
Lille chiclet default 2018-08-06 8 2 x AMD EPYC 7301 16 cores/CPU 128 GiB 480 GB SSD + 2 x 4.0 TB HDD 2 x 25 Gbps 
Lille chifflet default 2016-12-01 8 2 x Intel Xeon E5-2680 v4 14 cores/CPU 768 GiB 2 x 400 GB SSD + 2 x 4.0 TB HDD 2 x 10 Gbps  2 x Nvidia GTX 1080 Ti
Lille chifflot default 2018-08-01 8 2 x Intel Xeon Gold 6126 12 cores/CPU 192 GiB 2 x 480 GB SSD + 4 x 4.0 TB HDD 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100
[7-8]: 2 x Nvidia Tesla V100
Luxembourg granduc default 2011-12-01 11 2 x Intel Xeon L5335 4 cores/CPU 16 GiB 146 GB HDD 2 x 1 Gbps + 10 Gbps 
Luxembourg petitprince default 2013-09-10 15 2 x Intel Xeon E5-2630L 6 cores/CPU 32 GiB 250 GB HDD 2 x 10 Gbps 
Lyon hercule default 2012-10-02 4 2 x Intel Xeon E5-2620 6 cores/CPU 32 GiB 3 x 2.0 TB HDD 10 Gbps 
Lyon nova default 2016-12-01 23 2 x Intel Xeon E5-2620 v4 8 cores/CPU 64 GiB 598 GB HDD 10 Gbps 
Lyon orion default 2012-09-14 4 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps  Nvidia Tesla M2075
Lyon sagittaire default 2006-07-01 32 2 x AMD Opteron 250 1 core/CPU 2 GiB 73 GB HDD 1 Gbps 
Lyon taurus default 2012-09-14 16 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps 
Nancy graoully production 2016-01-04 16 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 2 x 600 GB HDD 10 Gbps + 56 Gbps InfiniBand
Nancy graphene default 2011-01-20 126 Intel Xeon X3440 4 cores/CPU 16 GiB 320 GB HDD 1 Gbps + 20 Gbps InfiniBand
Nancy graphique production 2015-05-12 6 2 x Intel Xeon E5-2620 v3 6 cores/CPU 64 GiB 299 GB HDD 10 Gbps + 56 Gbps InfiniBand 1: 2 x Nvidia Titan Black
[2-6]: 2 x Nvidia GTX 980
Nancy graphite default 2013-12-05 4 2 x Intel Xeon E5-2650 8 cores/CPU 256 GiB 2 x 300 GB SSD 10 Gbps + 56 Gbps InfiniBand Intel Xeon Phi 7120P
Nancy grcinq production 2013-04-09 48 2 x Intel Xeon E5-2650 8 cores/CPU 64 GiB 1.0 TB HDD 1 Gbps + 56 Gbps InfiniBand
Nancy grele production 2017-06-26 14 2 x Intel Xeon E5-2650 v4 12 cores/CPU 128 GiB 2 x 299 GB HDD 10 Gbps + 100 Gbps Omni-Path 2 x Nvidia GTX 1080 Ti
Nancy griffon default 2009-04-10 11 2 x Intel Xeon L5420 4 cores/CPU 16 GiB 320 GB HDD 1 Gbps 
Nancy grimani production 2016-08-30 6 2 x Intel Xeon E5-2603 v3 6 cores/CPU 64 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path 2 x Nvidia Tesla K40M
Nancy grimoire default 2016-01-22 8 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 200 GB SSD + 5 x 600 GB HDD 4 x 10 Gbps + 56 Gbps InfiniBand
Nancy grisou default 2016-01-04 51 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 2 x 600 GB HDD [1-48]: 1 Gbps + 4 x 10 Gbps 
49: 4 x 10 Gbps 
[50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand
Nancy grvingt production 2018-04-11 64 2 x Intel Xeon Gold 6130 16 cores/CPU 192 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Nantes econome default 2014-04-16 22 2 x Intel Xeon E5-2660 8 cores/CPU 64 GiB 2.0 TB HDD 10 Gbps 
Nantes ecotype default 2017-10-16 48 2 x Intel Xeon E5-2630L v4 10 cores/CPU 128 GiB 400 GB SSD 2 x 10 Gbps 
Rennes paranoia default 2014-02-21 8 2 x Intel Xeon E5-2660 v2 10 cores/CPU 128 GiB 5 x 600 GB HDD 1 Gbps + 2 x 10 Gbps 
Rennes parapide default 2010-01-25 21 2 x Intel Xeon X5570 4 cores/CPU 24 GiB 500 GB HDD 1 Gbps + 20 Gbps InfiniBand
Rennes parapluie default 2010-11-02 18 2 x AMD Opteron 6164 HE 12 cores/CPU 48 GiB 250 GB HDD 1 Gbps + 20 Gbps InfiniBand
Rennes parasilo default 2015-01-13 28 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 200 GB SSD + 5 x 600 GB HDD 2 x 10 Gbps 
Rennes paravance default 2015-01-13 72 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 2 x 600 GB HDD 2 x 10 Gbps 
Sophia suno default 2010-01-27 45 2 x Intel Xeon E5520 4 cores/CPU 32 GiB 598 GB HDD 1 Gbps 
Sophia uvb default 2011-01-04 44 2 x Intel Xeon X5670 6 cores/CPU 96 GiB 250 GB HDD 1 Gbps + 40 Gbps InfiniBand

Processors

Processors counts per families

Processor family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Processors total
AMD EPYC 16 16
AMD Opteron 64 36 100
Intel Xeon 80 62 52 94 582 140 258 178 1446
Sites total 80 78 52 158 582 140 294 178 1562

Processors counts per models

Microarchitecture Processor model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Processors total
K8 AMD Opteron 250 64 64
Clovertown Intel Xeon L5335 22 22
Harpertown Intel Xeon L5420 22 22
K10 AMD Opteron 6164 HE 36 36
Lynnfield Intel Xeon X3440 126 126
Nehalem Intel Xeon E5520 90 90
Nehalem Intel Xeon X5570 42 42
Westmere Intel Xeon X5670 88 88
Sandy Bridge Intel Xeon E5-2620 8 8
Sandy Bridge Intel Xeon E5-2630 40 40
Sandy Bridge Intel Xeon E5-2630L 30 30
Sandy Bridge Intel Xeon E5-2650 104 104
Sandy Bridge Intel Xeon E5-2660 44 44
Sandy Bridge Intel Xeon E5-2660 v2 16 16
Haswell Intel Xeon E5-2603 v3 12 12
Haswell Intel Xeon E5-2620 v3 12 12
Haswell Intel Xeon E5-2630 v3 150 200 350
Broadwell Intel Xeon E5-2620 v4 46 46
Broadwell Intel Xeon E5-2630 v4 30 30
Broadwell Intel Xeon E5-2630L v4 96 96
Broadwell Intel Xeon E5-2650 v4 28 28
Broadwell Intel Xeon E5-2680 v4 16 16
Skylake Intel Xeon Gold 6126 16 16
Skylake Intel Xeon Gold 6130 80 128 208
Zen AMD EPYC 7301 16 16
Sites total 80 78 52 158 582 140 294 178 1562

Cores counts per models

Microarchitecture Core model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cores total
K8 AMD Opteron 250 64 64
Clovertown Intel Xeon L5335 88 88
Harpertown Intel Xeon L5420 88 88
K10 AMD Opteron 6164 HE 432 432
Lynnfield Intel Xeon X3440 504 504
Nehalem Intel Xeon E5520 360 360
Nehalem Intel Xeon X5570 168 168
Westmere Intel Xeon X5670 528 528
Sandy Bridge Intel Xeon E5-2620 48 48
Sandy Bridge Intel Xeon E5-2630 240 240
Sandy Bridge Intel Xeon E5-2630L 180 180
Sandy Bridge Intel Xeon E5-2650 832 832
Sandy Bridge Intel Xeon E5-2660 352 352
Sandy Bridge Intel Xeon E5-2660 v2 160 160
Haswell Intel Xeon E5-2603 v3 72 72
Haswell Intel Xeon E5-2620 v3 72 72
Haswell Intel Xeon E5-2630 v3 1200 1600 2800
Broadwell Intel Xeon E5-2620 v4 368 368
Broadwell Intel Xeon E5-2630 v4 300 300
Broadwell Intel Xeon E5-2630L v4 960 960
Broadwell Intel Xeon E5-2650 v4 336 336
Broadwell Intel Xeon E5-2680 v4 224 224
Skylake Intel Xeon Gold 6126 192 192
Skylake Intel Xeon Gold 6130 1280 2048 3328
Zen AMD EPYC 7301 256 256
Sites total 1280 972 268 720 5152 1312 2360 888 12952

RAM size per node

RAM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Nodes total
2 GiB 32 32
16 GiB 11 137 148
24 GiB 21 21
32 GiB 15 24 45 84
48 GiB 18 18
64 GiB 23 60 22 105
96 GiB 44 44
128 GiB 8 89 48 108 253
192 GiB 32 8 64 104
256 GiB 15 4 19
768 GiB 4 8 12
Sites total 36 39 26 79 354 70 147 89 840

Networking

Network interconnects

Interconnect Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cards total
Ethernet 1 Gbps 11 32 233 47 89 412
Ethernet 10 Gbps 36 23 26 47 169 70 108 479
InfiniBand 20 Gbps 126 39 165
Ethernet 25 Gbps 16 16
InfiniBand 40 Gbps 44 44
InfiniBand 56 Gbps 84 84
Omni-Path 100 Gbps 36 84 120
Sites total 72 39 37 79 696 70 194 133 1320

Nodes with several Ethernet interfaces

Site Cluster Nodes 25G interfaces 10G interfaces 1G interfaces Interfaces (throughput)
Lille chetemi 15 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Lille chiclet 8 2 eth0/enp98s0f0 (25 Gbps), eth1/enp98s0f1 (25 Gbps)
Lille chifflet 8 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Lille chifflot 8 2 eth0/enp134s0f0 (25 Gbps), eth1/enp134s0f1 (25 Gbps)
Luxembourg granduc-[12,16] 2 1 2 eth0/eno1 (1 Gbps), eth1/eno2 (1 Gbps), eth2/enp13s0f1 (10 Gbps)
Luxembourg granduc-[2-4,6,9,15,18,20-21] 9 1 2 eth0/eno1 (1 Gbps), eth1/eno2 (1 Gbps), eth2/enp13s0f0 (10 Gbps)
Luxembourg petitprince 15 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Nancy grimoire 8 4 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp129s0f0 (10 Gbps), eth3/enp129s0f1 (10 Gbps)
Nancy grisou-49 1 4 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp3s0f0 (10 Gbps), eth3/enp3s0f1 (10 Gbps)
Nancy grisou-[1-48] 48 4 1 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp3s0f0 (10 Gbps), eth3/enp3s0f1 (10 Gbps), eth4/eno3 (1 Gbps)
Nancy grisou-[50-51] 2 4 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp129s0f0 (10 Gbps), eth3/enp129s0f1 (10 Gbps)
Nantes ecotype 48 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Rennes paranoia 8 2 1 eth0/enp3s0f0 (10 Gbps), eth1/enp3s0f1 (10 Gbps), eth2/eno1 (1 Gbps)
Rennes parasilo 28 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Rennes paravance 72 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)

Network interface models

Type Model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cards total
Ethernet Broadcom NetXtreme BCM5704 Gigabit Ethernet 32 32
Ethernet Broadcom NetXtreme II BCM5708 Gigabit Ethernet 11 11
Ethernet Broadcom NetXtreme II BCM5716 Gigabit Ethernet 45 45
Ethernet Broadcom NetXtreme II BCM57800 1/10 Gigabit Ethernet 6 6
Ethernet Broadcom NetXtreme II BCM57810 10 Gigabit Ethernet 15 15
Ethernet Intel 80003ES2LAN Gigabit Ethernet Controller (Copper) 11 11
Ethernet Intel 82574L Gigabit Network Connection 126 126
Ethernet Intel 82575EB Gigabit Network Connection 21 21
Ethernet Intel 82576 Gigabit Network Connection 18 44 62
Ethernet Intel 82598EB 10-Gigabit AF Dual Port Network Connection 11 11
Ethernet Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection 23 4 99 70 108 304
Ethernet Intel Ethernet 10G 2P X520 Adapter 43 59 102
Ethernet Intel Ethernet Controller X710 for 10GbE SFP+ 36 64 100
Ethernet Intel Ethernet Controller XXV710 for 25GbE SFP28 16 16
Ethernet Intel I350 Gigabit Network Connection 96 8 104
InfiniBand Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE] 39 39
InfiniBand Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s - IB DDR / 10GigE] 126 126
InfiniBand Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] 44 44
InfiniBand Mellanox Technologies MT27500 Family [ConnectX-3] 84 84
Omni-Path Intel Omni-Path HFI Silicon 100 Series [discrete] 36 84 120
Sites total 72 39 37 79 755 70 194 133 1379

Storage

Nodes with several disks

Site Cluster Number of nodes Main disk Additional HDDs Additional SSDs Disk reservation
Grenoble dahu 32 SSD 240 GB 1 (4.0 TB) 1 (480 GB) no
Grenoble yeti 4 SSD 480 GB 3 (2.0 TB, 2.0 TB, 2.0 TB) 2 (1.6 TB, 1.6 TB) yes
Lille chetemi 15 HDD 300 GB 1 (300 GB) 0 no
Lille chiclet 8 SSD 480 GB 2 (4.0 TB, 4.0 TB) 0 yes
Lille chifflet 8 SSD 400 GB 2 (4.0 TB, 4.0 TB) 1 (400 GB) yes
Lille chifflot 8 SSD 480 GB 4 (4.0 TB, 4.0 TB, 4.0 TB, 4.0 TB) 1 (480 GB) yes
Lyon hercule 4 HDD 2.0 TB 2 (2.0 TB, 2.0 TB) 0 no
Nancy graoully 16 HDD 600 GB 1 (600 GB) 0 no
Nancy graphite 4 SSD 300 GB 0 1 (300 GB) no
Nancy grele 14 HDD 299 GB 1 (299 GB) 0 no
Nancy grimoire 8 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 1 (200 GB) yes
Nancy grisou 51 HDD 600 GB 1 (600 GB) 0 no
Rennes paranoia 8 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 0 no
Rennes parasilo 28 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 1 (200 GB) yes
Rennes paravance 72 HDD 600 GB 1 (600 GB) 0 no

Accelerators (GPU, Xeon Phi)

Accelerator families

Accelerator family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Accelerators total
Intel Xeon Phi 4 4
Nvidia 32 4 52 88
Sites total 32 4 56 92

Accelerator models

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Accelerators total
Intel Xeon Phi 7120P 4 4
Nvidia GTX 1080 Ti 16 28 44
Nvidia GTX 980 10 10
Nvidia Tesla K40M 12 12
Nvidia Tesla M2075 4 4
Nvidia Tesla P100 12 12
Nvidia Tesla V100 4 4
Nvidia Titan Black 2 2
Sites total 32 4 56 92

Accelerator cores

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cores total
Intel Xeon Phi 7120P 244 244
Nvidia GTX 1080 Ti 57344 100352 157696
Nvidia GTX 980 20480 20480
Nvidia Tesla K40M 34560 34560
Nvidia Tesla M2075 1792 1792
Nvidia Tesla P100 43008 43008
Nvidia Tesla V100 20480 20480
Nvidia Titan Black 5760 5760
Sites total 120832 1792 161396 284020

Nodes models

Nodes model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Nodes total
Carri System 5393 126 126
Carri System CS-5393B 11 11
Dell PowerEdge 1950 11 11
Dell PowerEdge C6100 44 44
Dell PowerEdge C6220 4 48 22 74
Dell PowerEdge C6220 II 8 8
Dell PowerEdge C6420 32 64 96
Dell PowerEdge M620 15 15
Dell PowerEdge R410 45 45
Dell PowerEdge R430 23 23
Dell PowerEdge R630 15 75 48 100 238
Dell PowerEdge R720 20 10 30
Dell PowerEdge R730 8 20 28
Dell PowerEdge R740 8 8
Dell PowerEdge R7425 8 8
Dell PowerEdge R940 4 4
HP ProLiant DL165 G7 18 18
SUN FIRE X2270 21 21
Sun Fire V20z 32 32
Sites total 36 39 26 79 354 70 147 89 840
Last generated from the Grid'5000 Reference API on 2018-12-07 (commit b7958434c)