Hardware

From Grid5000
Revision as of 09:04, 29 May 2019 by Dloup (talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Summary

  • 8 sites
  • 31 clusters
  • 699 nodes
  • 12326 CPU cores
  • 88 GPUs
  • 208 SSDs and 1047 HDDs on nodes (total: 1081.31 TB)

Clusters

Site Cluster Queue Date of arrival Nodes CPU Cores Memory Storage Network Accelerators
Grenoble dahu default 2018-03-22 32 2 x Intel Xeon Gold 6130 16 cores/CPU 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Grenoble yeti default 2018-01-16 4 4 x Intel Xeon Gold 6130 16 cores/CPU 768 GiB 480 GB SSD + 2 x 1.6 TB SSD + 3 x 2.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Lille chetemi default 2016-12-01 15 2 x Intel Xeon E5-2630 v4 10 cores/CPU 256 GiB 2 x 300 GB HDD 2 x 10 Gbps 
Lille chiclet default 2018-08-06 8 2 x AMD EPYC 7301 16 cores/CPU 128 GiB 480 GB SSD + 2 x 4.0 TB HDD 2 x 25 Gbps 
Lille chifflet default 2016-12-01 8 2 x Intel Xeon E5-2680 v4 14 cores/CPU 768 GiB 2 x 400 GB SSD + 2 x 4.0 TB HDD 2 x 10 Gbps  2 x Nvidia GTX 1080 Ti
Lille chifflot default 2018-08-01 8 2 x Intel Xeon Gold 6126 12 cores/CPU 192 GiB 2 x 480 GB SSD + 4 x 4.0 TB HDD 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100
[7-8]: 2 x Nvidia Tesla V100
Luxembourg granduc default 2011-12-01 11 2 x Intel Xeon L5335 4 cores/CPU 16 GiB 146 GB HDD 2 x 1 Gbps + 10 Gbps 
Luxembourg petitprince default 2013-09-10 15 2 x Intel Xeon E5-2630L 6 cores/CPU 32 GiB 250 GB HDD 2 x 10 Gbps 
Lyon hercule default 2012-10-02 4 2 x Intel Xeon E5-2620 6 cores/CPU 32 GiB 3 x 2.0 TB HDD 10 Gbps 
Lyon nova default 2016-12-01 23 2 x Intel Xeon E5-2620 v4 8 cores/CPU 64 GiB 598 GB HDD 10 Gbps 
Lyon orion default 2012-09-14 4 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps  Nvidia Tesla M2075
Lyon sagittaire default 2006-07-01 31 2 x AMD Opteron 250 1 core/CPU 2 GiB 73 GB HDD 1 Gbps 
Lyon taurus default 2012-09-14 14 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 598 GB HDD 10 Gbps 
Nancy graoully production 2016-01-04 16 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 2 x 600 GB HDD 10 Gbps + 56 Gbps InfiniBand
Nancy graphique production 2015-05-12 6 2 x Intel Xeon E5-2620 v3 6 cores/CPU 64 GiB 299 GB HDD 10 Gbps + 56 Gbps InfiniBand 1: 2 x Nvidia Titan Black
[2-6]: 2 x Nvidia GTX 980
Nancy graphite default 2013-12-05 4 2 x Intel Xeon E5-2650 8 cores/CPU 256 GiB 2 x 300 GB SSD 10 Gbps + 56 Gbps InfiniBand Intel Xeon Phi 7120P
Nancy grcinq production 2013-04-09 48 2 x Intel Xeon E5-2650 8 cores/CPU 64 GiB 1.0 TB HDD 1 Gbps + 56 Gbps InfiniBand
Nancy grele production 2017-06-26 14 2 x Intel Xeon E5-2650 v4 12 cores/CPU 128 GiB 2 x 299 GB HDD 10 Gbps + 100 Gbps Omni-Path 2 x Nvidia GTX 1080 Ti
Nancy grimani production 2016-08-30 6 2 x Intel Xeon E5-2603 v3 6 cores/CPU 64 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path 2 x Nvidia Tesla K40M
Nancy grimoire default 2016-01-22 8 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 200 GB SSD + 5 x 600 GB HDD 4 x 10 Gbps + 56 Gbps InfiniBand
Nancy grisou default 2016-01-04 51 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 2 x 600 GB HDD [1-48]: 1 Gbps + 4 x 10 Gbps 
49: 4 x 10 Gbps 
[50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand
Nancy grvingt production 2018-04-11 64 2 x Intel Xeon Gold 6130 16 cores/CPU 192 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Nantes econome default 2014-04-16 22 2 x Intel Xeon E5-2660 8 cores/CPU 64 GiB 2.0 TB HDD 10 Gbps 
Nantes ecotype default 2017-10-16 48 2 x Intel Xeon E5-2630L v4 10 cores/CPU 128 GiB 400 GB SSD 2 x 10 Gbps 
Rennes paranoia default 2014-02-21 8 2 x Intel Xeon E5-2660 v2 10 cores/CPU 128 GiB 5 x 600 GB HDD 1 Gbps + 2 x 10 Gbps 
Rennes parapide default 2010-01-25 20 2 x Intel Xeon X5570 4 cores/CPU 24 GiB 500 GB HDD 1 Gbps + 20 Gbps InfiniBand
Rennes parapluie default 2010-11-02 18 2 x AMD Opteron 6164 HE 12 cores/CPU 48 GiB 250 GB HDD 1 Gbps + 20 Gbps InfiniBand
Rennes parasilo default 2015-01-13 28 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 200 GB SSD + 5 x 600 GB HDD 2 x 10 Gbps 
Rennes paravance default 2015-01-13 72 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 2 x 600 GB HDD 2 x 10 Gbps 
Sophia suno default 2010-01-27 45 2 x Intel Xeon E5520 4 cores/CPU 32 GiB 598 GB HDD 1 Gbps 
Sophia uvb default 2011-01-04 44 2 x Intel Xeon X5670 6 cores/CPU 96 GiB 250 GB HDD 1 Gbps + 40 Gbps InfiniBand

Processors

Processors counts per families

Processor family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Processors total
AMD EPYC 16 16
AMD Opteron 62 36 98
Intel Xeon 80 62 52 90 434 140 256 178 1292
Sites total 80 78 52 152 434 140 292 178 1406

Processors counts per models

Microarchitecture Processor model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Processors total
K8 AMD Opteron 250 62 62
Clovertown Intel Xeon L5335 22 22
K10 AMD Opteron 6164 HE 36 36
Nehalem Intel Xeon E5520 90 90
Nehalem Intel Xeon X5570 40 40
Westmere Intel Xeon X5670 88 88
Sandy Bridge Intel Xeon E5-2620 8 8
Sandy Bridge Intel Xeon E5-2630 36 36
Sandy Bridge Intel Xeon E5-2630L 30 30
Sandy Bridge Intel Xeon E5-2650 104 104
Sandy Bridge Intel Xeon E5-2660 44 44
Sandy Bridge Intel Xeon E5-2660 v2 16 16
Haswell Intel Xeon E5-2603 v3 12 12
Haswell Intel Xeon E5-2620 v3 12 12
Haswell Intel Xeon E5-2630 v3 150 200 350
Broadwell Intel Xeon E5-2620 v4 46 46
Broadwell Intel Xeon E5-2630 v4 30 30
Broadwell Intel Xeon E5-2630L v4 96 96
Broadwell Intel Xeon E5-2650 v4 28 28
Broadwell Intel Xeon E5-2680 v4 16 16
Skylake Intel Xeon Gold 6126 16 16
Skylake Intel Xeon Gold 6130 80 128 208
Zen AMD EPYC 7301 16 16
Sites total 80 78 52 152 434 140 292 178 1406

Cores counts per models

Microarchitecture Core model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cores total
K8 AMD Opteron 250 62 62
Clovertown Intel Xeon L5335 88 88
K10 AMD Opteron 6164 HE 432 432
Nehalem Intel Xeon E5520 360 360
Nehalem Intel Xeon X5570 160 160
Westmere Intel Xeon X5670 528 528
Sandy Bridge Intel Xeon E5-2620 48 48
Sandy Bridge Intel Xeon E5-2630 216 216
Sandy Bridge Intel Xeon E5-2630L 180 180
Sandy Bridge Intel Xeon E5-2650 832 832
Sandy Bridge Intel Xeon E5-2660 352 352
Sandy Bridge Intel Xeon E5-2660 v2 160 160
Haswell Intel Xeon E5-2603 v3 72 72
Haswell Intel Xeon E5-2620 v3 72 72
Haswell Intel Xeon E5-2630 v3 1200 1600 2800
Broadwell Intel Xeon E5-2620 v4 368 368
Broadwell Intel Xeon E5-2630 v4 300 300
Broadwell Intel Xeon E5-2630L v4 960 960
Broadwell Intel Xeon E5-2650 v4 336 336
Broadwell Intel Xeon E5-2680 v4 224 224
Skylake Intel Xeon Gold 6126 192 192
Skylake Intel Xeon Gold 6130 1280 2048 3328
Zen AMD EPYC 7301 256 256
Sites total 1280 972 268 694 4560 1312 2352 888 12326

RAM size per node

RAM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Nodes total
2 GiB 31 31
16 GiB 11 11
24 GiB 20 20
32 GiB 15 22 45 82
48 GiB 18 18
64 GiB 23 60 22 105
96 GiB 44 44
128 GiB 8 89 48 108 253
192 GiB 32 8 64 104
256 GiB 15 4 19
768 GiB 4 8 12
Sites total 36 39 26 76 217 70 146 89 699

Networking

Network interconnects

Interconnect Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cards total
Ethernet 1 Gbps 22 31 96 46 89 284
Ethernet 10 Gbps 36 46 41 45 346 118 216 848
Ethernet 25 Gbps 32 32
InfiniBand 20 Gbps 38 38
InfiniBand 40 Gbps 44 44
InfiniBand 56 Gbps 84 84
Omni-Path 100 Gbps 36 84 120
Sites total 72 78 63 76 610 118 300 133 1450

Nodes with several Ethernet interfaces

Site Cluster Nodes 25G interfaces 10G interfaces 1G interfaces Interfaces (throughput)
Lille chetemi 15 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Lille chiclet 8 2 eth0/enp98s0f0 (25 Gbps), eth1/enp98s0f1 (25 Gbps)
Lille chifflet 8 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Lille chifflot 8 2 eth0/enp134s0f0 (25 Gbps), eth1/enp134s0f1 (25 Gbps)
Luxembourg granduc-[12,16] 2 1 2 eth0/eno1 (1 Gbps), eth1/eno2 (1 Gbps), eth2/enp13s0f1 (10 Gbps)
Luxembourg granduc-[2-4,6,9,15,18,20-21] 9 1 2 eth0/eno1 (1 Gbps), eth1/eno2 (1 Gbps), eth2/enp13s0f0 (10 Gbps)
Luxembourg petitprince 15 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Nancy grimoire 8 4 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp129s0f0 (10 Gbps), eth3/enp129s0f1 (10 Gbps)
Nancy grisou-49 1 4 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp3s0f0 (10 Gbps), eth3/enp3s0f1 (10 Gbps)
Nancy grisou-[1-48] 48 4 1 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp3s0f0 (10 Gbps), eth3/enp3s0f1 (10 Gbps), eth4/eno3 (1 Gbps)
Nancy grisou-[50-51] 2 4 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps), eth2/enp129s0f0 (10 Gbps), eth3/enp129s0f1 (10 Gbps)
Nantes ecotype 48 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Rennes paranoia 8 2 1 eth0/enp3s0f0 (10 Gbps), eth1/enp3s0f1 (10 Gbps), eth2/eno1 (1 Gbps)
Rennes parasilo 28 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)
Rennes paravance 72 2 eth0/eno1 (10 Gbps), eth1/eno2 (10 Gbps)

Network interface models

Type Model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cards total
Ethernet Broadcom NetXtreme BCM5704 Gigabit Ethernet 31 31
Ethernet Broadcom NetXtreme II BCM5708 Gigabit Ethernet 11 11
Ethernet Broadcom NetXtreme II BCM5716 Gigabit Ethernet 45 45
Ethernet Broadcom NetXtreme II BCM57800 1/10 Gigabit Ethernet 6 6
Ethernet Broadcom NetXtreme II BCM57810 10 Gigabit Ethernet 15 15
Ethernet Intel 82575EB Gigabit Network Connection 20 20
Ethernet Intel 82576 Gigabit Network Connection 18 44 62
Ethernet Intel 82598EB 10-Gigabit AF Dual Port Network Connection 11 11
Ethernet Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection 23 4 99 70 108 304
Ethernet Intel Ethernet 10G 2P X520 Adapter 41 59 100
Ethernet Intel Ethernet Controller X710 for 10GbE SFP+ 36 64 100
Ethernet Intel Ethernet Controller XXV710 for 25GbE SFP28 16 16
Ethernet Intel I350 Gigabit Network Connection 96 8 104
InfiniBand Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE] 38 38
InfiniBand Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] 44 44
InfiniBand Mellanox Technologies MT27500 Family [ConnectX-3] 84 84
Omni-Path Intel Omni-Path HFI Silicon 100 Series [discrete] 36 84 120
Sites total 72 39 37 76 492 70 192 133 1111

Storage

Nodes with several disks

Site Cluster Number of nodes Main disk Additional HDDs Additional SSDs Disk reservation
Grenoble dahu 32 SSD 240 GB 1 (4.0 TB) 1 (480 GB) no
Grenoble yeti 4 SSD 480 GB 3 (2.0 TB, 2.0 TB, 2.0 TB) 2 (1.6 TB, 1.6 TB) yes
Lille chetemi 15 HDD 300 GB 1 (300 GB) 0 no
Lille chiclet 8 SSD 480 GB 2 (4.0 TB, 4.0 TB) 0 yes
Lille chifflet 8 SSD 400 GB 2 (4.0 TB, 4.0 TB) 1 (400 GB) yes
Lille chifflot 8 SSD 480 GB 4 (4.0 TB, 4.0 TB, 4.0 TB, 4.0 TB) 1 (480 GB) yes
Lyon hercule 4 HDD 2.0 TB 2 (2.0 TB, 2.0 TB) 0 no
Nancy graoully 16 HDD 600 GB 1 (600 GB) 0 no
Nancy graphite 4 SSD 300 GB 0 1 (300 GB) no
Nancy grele 14 HDD 299 GB 1 (299 GB) 0 no
Nancy grimoire 8 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 1 (200 GB) yes
Nancy grisou 51 HDD 600 GB 1 (600 GB) 0 no
Rennes paranoia 8 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 0 no
Rennes parasilo 28 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 1 (200 GB) yes
Rennes paravance 72 HDD 600 GB 1 (600 GB) 0 no

Accelerators (GPU, Xeon Phi)

Accelerator families

Accelerator family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Accelerators total
Intel Xeon Phi 4 4
Nvidia 32 4 52 88
Sites total 32 4 56 92

Accelerator models

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Accelerators total
Intel Xeon Phi 7120P 4 4
Nvidia GTX 1080 Ti 16 28 44
Nvidia GTX 980 10 10
Nvidia Tesla K40M 12 12
Nvidia Tesla M2075 4 4
Nvidia Tesla P100 12 12
Nvidia Tesla V100 4 4
Nvidia Titan Black 2 2
Sites total 32 4 56 92

Accelerator cores

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cores total
Intel Xeon Phi 7120P 244 244
Nvidia GTX 1080 Ti 57344 100352 157696
Nvidia GTX 980 20480 20480
Nvidia Tesla K40M 34560 34560
Nvidia Tesla M2075 1792 1792
Nvidia Tesla P100 43008 43008
Nvidia Tesla V100 20480 20480
Nvidia Titan Black 5760 5760
Sites total 120832 1792 161396 284020

Nodes models

Nodes model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Nodes total
Dell PowerEdge 1950 11 11
Dell PowerEdge C6100 44 44
Dell PowerEdge C6220 4 48 22 74
Dell PowerEdge C6220 II 8 8
Dell PowerEdge C6420 32 64 96
Dell PowerEdge M620 15 15
Dell PowerEdge R410 45 45
Dell PowerEdge R430 23 23
Dell PowerEdge R630 15 75 48 100 238
Dell PowerEdge R720 18 10 28
Dell PowerEdge R730 8 20 28
Dell PowerEdge R740 8 8
Dell PowerEdge R7425 8 8
Dell PowerEdge R940 4 4
HP ProLiant DL165 G7 18 18
SUN FIRE X2270 20 20
Sun Fire V20z 31 31
Sites total 36 39 26 76 217 70 146 89 699
Last generated from the Grid'5000 Reference API on 2019-05-29 (commit 21f0ec5c3)