Hardwaredev: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
Line 71: Line 71:
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2015-05-12||5||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620&nbsp;v3||6&nbsp;cores/CPU||64&nbsp;GiB||data-sort-value="278"|<b>299&nbsp;GB&nbsp;HDD</b>||data-sort-value="66000"|10&nbsp;Gbps&nbsp;+&nbsp;56&nbsp;Gbps&nbsp;InfiniBand||2&nbsp;x&nbsp;Nvidia GTX&nbsp;980&nbsp;(4&nbsp;GiB)
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2015-05-12||5||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620&nbsp;v3||6&nbsp;cores/CPU||64&nbsp;GiB||data-sort-value="278"|<b>299&nbsp;GB&nbsp;HDD</b>||data-sort-value="66000"|10&nbsp;Gbps&nbsp;+&nbsp;56&nbsp;Gbps&nbsp;InfiniBand||2&nbsp;x&nbsp;Nvidia GTX&nbsp;980&nbsp;(4&nbsp;GiB)
|-
|-
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||||2013-12-05||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2650||8&nbsp;cores/CPU||256&nbsp;GiB||data-sort-value="558"|<b>1&nbsp;x&nbsp;300&nbsp;GB&nbsp;SSD</b> +&nbsp;1&nbsp;x&nbsp;300&nbsp;GB&nbsp;SSD||data-sort-value="66000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;56&nbsp;Gbps&nbsp;InfiniBand||Intel Xeon Phi 7120P
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||||2013-12-05||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2650||8&nbsp;cores/CPU||256&nbsp;GiB||data-sort-value="558"|<b>1&nbsp;x&nbsp;300&nbsp;GB&nbsp;SSD</b> +&nbsp;1&nbsp;x&nbsp;300&nbsp;GB&nbsp;SSD||data-sort-value="66000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;56&nbsp;Gbps&nbsp;InfiniBand||Intel Xeon&nbsp;Phi&nbsp;7120P
|-
|-
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grappe|grappe]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2020-08-20||16||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;5218R||20&nbsp;cores/CPU||96&nbsp;GiB||data-sort-value="7899"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;8.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="25000"|25&nbsp;Gbps&nbsp;||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grappe|grappe]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b>&nbsp;queue||2020-08-20||16||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;Gold&nbsp;5218R||20&nbsp;cores/CPU||96&nbsp;GiB||data-sort-value="7899"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;8.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="25000"|25&nbsp;Gbps&nbsp;||

Revision as of 01:00, 24 May 2022

Summary

  • 8 sites
  • 40 clusters
  • 755 nodes
  • 15840 CPU cores
  • 321 GPUs
  • 102.36 TiB RAM + 6.0 TiB PMEM
  • 525 SSDs and 940 HDDs on nodes (total: 1.44 PB)
  • 622.0 TFLOPS (excluding GPUs)

Clusters

Site Cluster Access Condition Date of arrival Nodes CPU Cores Memory Storage Network Accelerators
Grenoble dahu 2018-03-22 32 2 x Intel Xeon Gold 6130 16 cores/CPU 192 GiB 240 GB SSD + 480 GB SSD + 4.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Grenoble drac exotic job type 2020-10-05 12 2 x Power POWER8NVL 1.0 10 cores/CPU 128 GiB 1 x 1.0 TB HDD + 1 x 1.0 TB HDD 10 Gbps + 2 x 100 Gbps InfiniBand 4 x Nvidia Tesla P100 (16 GiB)
Grenoble servan testing queue,
exotic job type
2021-12-15 2 2 x AMD EPYC 7352 24 cores/CPU 128 GiB 1 x 1.6 TB SSD + 1 x 1.6 TB SSD 25 Gbps + 2 x 100 Gbps Ethernet-FPGA Xilinx Alveo U200
Grenoble troll exotic job type 2019-12-23 4 2 x Intel Xeon Gold 5218 16 cores/CPU 384 GiB + 1.5 TiB PMEM 480 GB SSD + 1.6 TB SSD 25 Gbps (SR‑IOV) + 100 Gbps Omni-Path
Grenoble yeti exotic job type 2018-01-16 4 4 x Intel Xeon Gold 6130 16 cores/CPU 768 GiB 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD 10 Gbps + 100 Gbps Omni-Path
Lille chetemi 2016-12-01 15 2 x Intel Xeon E5-2630 v4 10 cores/CPU 256 GiB [1-9,11-15]: 1 x 300 GB HDD + 1 x 300 GB HDD
10: 600 GB HDD + 300 GB HDD
2 x 10 Gbps (SR‑IOV) 
Lille chiclet 2018-08-06 8 2 x AMD EPYC 7301 16 cores/CPU 128 GiB 480 GB SSD + 2 x 4.0 TB HDD* 2 x 25 Gbps 
Lille chifflet 2016-12-01 8 2 x Intel Xeon E5-2680 v4 14 cores/CPU 768 GiB 400 GB SSD + 400 GB SSD* + 2 x 4.0 TB HDD* 2 x 10 Gbps (SR‑IOV)  2 x Nvidia GTX 1080 Ti (11 GiB)
Lille chifflot 2018-08-01 8 2 x Intel Xeon Gold 6126 12 cores/CPU 192 GiB 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100 (16 GiB)
[7-8]: 2 x Nvidia Tesla V100 (32 GiB)
Luxembourg petitprince 2013-09-10 14 2 x Intel Xeon E5-2630L 6 cores/CPU 32 GiB 250 GB HDD 2 x 10 Gbps 
Lyon gemini exotic job type 2019-09-01 2 2 x Intel Xeon E5-2698 v4 20 cores/CPU 512 GiB 480 GB SSD + 4 x 1.92 TB SSD* 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand 8 x Nvidia Tesla V100 (32 GiB)
Lyon hercule 2012-10-02 4 2 x Intel Xeon E5-2620 6 cores/CPU 32 GiB 1 x 2.0 TB HDD + 2 x 2.0 TB HDD 10 Gbps (SR‑IOV) 
Lyon neowise exotic job type 2021-05-17 10 AMD EPYC 7642 48 cores/CPU 512 GiB 1.92 TB SSD 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand 8 x AMD MI50 (32 GiB)
Lyon nova 2016-12-01 22 2 x Intel Xeon E5-2620 v4 8 cores/CPU 64 GiB 598 GB HDD 10 Gbps (SR‑IOV) 
Lyon orion 2012-09-14 3 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 299 GB HDD 10 Gbps (SR‑IOV)  Nvidia Tesla M2075 (5 GiB)
Lyon pyxis exotic job type 2020-01-06 4 2 x ARM ThunderX2 99xx 32 cores/CPU 256 GiB 1 x 250 GB SSD + 1 x 250 GB SSD 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand
Lyon sagittaire 2006-07-01 10 2 x AMD Opteron 250 1 core/CPU 2 GiB 73 GB HDD 1 Gbps 
Lyon sirius exotic job type 2021-11-18 1 2 x AMD EPYC 7742 64 cores/CPU 1.0 TiB 1 x 1.92 TB SSD + 1 x 1.92 TB SSD + 4 x 3.84 TB SSD 1 Gbps  8 x Nvidia A100 (40 GiB)
Lyon taurus 2012-09-14 12 2 x Intel Xeon E5-2630 6 cores/CPU 32 GiB 299 GB HDD 10 Gbps (SR‑IOV) 
Nancy graffiti production queue 2019-06-07 13 2 x Intel Xeon Silver 4110 8 cores/CPU 128 GiB 479 GB HDD 10 Gbps  [1-12]: 4 x Nvidia RTX 2080 Ti (11 GiB)
13: 4 x Nvidia Quadro RTX 6000 (22 GiB)
Nancy graoully production queue 2016-01-04 16 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 600 GB HDD 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy graphique production queue 2015-05-12 5 2 x Intel Xeon E5-2620 v3 6 cores/CPU 64 GiB 299 GB HDD 10 Gbps + 56 Gbps InfiniBand 2 x Nvidia GTX 980 (4 GiB)
Nancy graphite 2013-12-05 4 2 x Intel Xeon E5-2650 8 cores/CPU 256 GiB 1 x 300 GB SSD + 1 x 300 GB SSD 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand Intel Xeon Phi 7120P
Nancy grappe production queue 2020-08-20 16 2 x Intel Xeon Gold 5218R 20 cores/CPU 96 GiB 480 GB SSD + 8.0 TB HDD* 25 Gbps 
Nancy grcinq production queue 2013-04-09 43 2 x Intel Xeon E5-2650 8 cores/CPU 64 GiB 1.0 TB HDD 1 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy grele production queue 2017-06-26 14 2 x Intel Xeon E5-2650 v4 12 cores/CPU 128 GiB 1 x 299 GB HDD + 1 x 299 GB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia GTX 1080 Ti (11 GiB)
Nancy grimani production queue 2016-08-30 6 2 x Intel Xeon E5-2603 v3 6 cores/CPU 64 GiB 1.0 TB HDD 10 Gbps (SR‑IOV) + 100 Gbps Omni-Path 2 x Nvidia Tesla K40M (11 GiB)
Nancy grimoire 2016-01-22 8 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* 4 x 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy grisou 2016-01-04 49 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 1 x 600 GB HDD + 1 x 600 GB HDD [1-32,34-43,45-48]: 1 Gbps + 4 x 10 Gbps (SR‑IOV) 
49: 4 x 10 Gbps (SR‑IOV) 
[50-51]: 4 x 10 Gbps (SR‑IOV) + 56 Gbps InfiniBand
Nancy gros 2019-09-04 124 Intel Xeon Gold 5220 18 cores/CPU 96 GiB 480 GB SSD + 960 GB SSD* 2 x 25 Gbps (SR‑IOV) 
Nancy grouille exotic job type 2021-01-13 2 2 x AMD EPYC 7452 32 cores/CPU 128 GiB 1.92 TB SSD + 960 GB SSD* 25 Gbps  2 x Nvidia A100 (40 GiB)
Nancy grue production queue 2019-11-25 5 2 x AMD EPYC 7351 16 cores/CPU 128 GiB 479 GB HDD 10 Gbps  4 x Nvidia Tesla T4 (15 GiB)
Nancy gruss production queue 2021-08-26 4 2 x AMD EPYC 7352 24 cores/CPU 256 GiB 1.92 TB SSD 25 Gbps  2 x Nvidia A40 (45 GiB)
Nancy grvingt production queue 2018-04-11 64 2 x Intel Xeon Gold 6130 16 cores/CPU 192 GiB 1.0 TB HDD 10 Gbps + 100 Gbps Omni-Path
Nantes econome 2014-04-16 22 2 x Intel Xeon E5-2660 8 cores/CPU 64 GiB 2.0 TB HDD 10 Gbps (SR‑IOV) 
Nantes ecotype 2017-10-16 48 2 x Intel Xeon E5-2630L v4 10 cores/CPU 128 GiB 400 GB SSD 2 x 10 Gbps (SR‑IOV) 
Rennes paranoia 2014-02-21 8 2 x Intel Xeon E5-2660 v2 10 cores/CPU 128 GiB 1 x 600 GB HDD + 4 x 600 GB HDD 1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) 
Rennes parasilo 2015-01-13 27 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* 2 x 10 Gbps (SR‑IOV) 
Rennes paravance 2015-01-13 72 2 x Intel Xeon E5-2630 v3 8 cores/CPU 128 GiB 1 x 600 GB HDD + 1 x 600 GB HDD 2 x 10 Gbps (SR‑IOV) 
Sophia uvb 2011-01-04 30 2 x Intel Xeon X5670 6 cores/CPU 96 GiB 250 GB HDD 1 Gbps (SR‑IOV) + 40 Gbps InfiniBand

Processors

Processors counts per families

Processor family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Processors total
AMD EPYC 4 16 12 22 54
AMD Opteron 20 20
Intel Xeon 88 62 28 86 600 140 214 60 1278
POWER8NVL 24 24
ThunderX2 8 8
Sites total 116 78 28 126 622 140 214 60 1384

Processors counts per models

Microarchitecture Processor model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Processors total
K8 AMD Opteron 250 20 20
Westmere Intel Xeon X5670 60 60
Sandy Bridge Intel Xeon E5-2620 8 8
Sandy Bridge Intel Xeon E5-2630 30 30
Sandy Bridge Intel Xeon E5-2630L 28 28
Sandy Bridge Intel Xeon E5-2650 94 94
Sandy Bridge Intel Xeon E5-2660 44 44
Sandy Bridge Intel Xeon E5-2660 v2 16 16
Haswell Intel Xeon E5-2603 v3 12 12
Haswell Intel Xeon E5-2620 v3 10 10
Haswell Intel Xeon E5-2630 v3 146 198 344
POWER8 POWER8NVL 1.0 24 24
Broadwell Intel Xeon E5-2620 v4 44 44
Broadwell Intel Xeon E5-2630 v4 30 30
Broadwell Intel Xeon E5-2630L v4 96 96
Broadwell Intel Xeon E5-2650 v4 28 28
Broadwell Intel Xeon E5-2680 v4 16 16
Broadwell Intel Xeon E5-2698 v4 4 4
Skylake Intel Xeon Gold 6126 16 16
Skylake Intel Xeon Gold 6130 80 128 208
Skylake Intel Xeon Silver 4110 26 26
Zen AMD EPYC 7301 16 16
Zen AMD EPYC 7351 10 10
Vulcan ThunderX2 99xx 8 8
Cascade Lake-SP Intel Xeon Gold 5218 8 8
Cascade Lake-SP Intel Xeon Gold 5218R 32 32
Cascade Lake-SP Intel Xeon Gold 5220 124 124
Zen 2 AMD EPYC 7352 4 8 12
Zen 2 AMD EPYC 7452 4 4
Zen 2 AMD EPYC 7642 10 10
Zen 2 AMD EPYC 7742 2 2
Sites total 116 78 28 126 622 140 214 60 1384

Cores counts per models

Microarchitecture Core model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cores total
K8 AMD Opteron 250 20 20
Westmere Intel Xeon X5670 360 360
Sandy Bridge Intel Xeon E5-2620 48 48
Sandy Bridge Intel Xeon E5-2630 180 180
Sandy Bridge Intel Xeon E5-2630L 168 168
Sandy Bridge Intel Xeon E5-2650 752 752
Sandy Bridge Intel Xeon E5-2660 352 352
Sandy Bridge Intel Xeon E5-2660 v2 160 160
Haswell Intel Xeon E5-2603 v3 72 72
Haswell Intel Xeon E5-2620 v3 60 60
Haswell Intel Xeon E5-2630 v3 1168 1584 2752
POWER8 POWER8NVL 1.0 240 240
Broadwell Intel Xeon E5-2620 v4 352 352
Broadwell Intel Xeon E5-2630 v4 300 300
Broadwell Intel Xeon E5-2630L v4 960 960
Broadwell Intel Xeon E5-2650 v4 336 336
Broadwell Intel Xeon E5-2680 v4 224 224
Broadwell Intel Xeon E5-2698 v4 80 80
Skylake Intel Xeon Gold 6126 192 192
Skylake Intel Xeon Gold 6130 1280 2048 3328
Skylake Intel Xeon Silver 4110 208 208
Zen AMD EPYC 7301 256 256
Zen AMD EPYC 7351 160 160
Vulcan ThunderX2 99xx 256 256
Cascade Lake-SP Intel Xeon Gold 5218 128 128
Cascade Lake-SP Intel Xeon Gold 5218R 640 640
Cascade Lake-SP Intel Xeon Gold 5220 2232 2232
Zen 2 AMD EPYC 7352 96 192 288
Zen 2 AMD EPYC 7452 128 128
Zen 2 AMD EPYC 7642 480 480
Zen 2 AMD EPYC 7742 128 128
Sites total 1744 972 168 1544 7996 1312 1744 360 15840

Memory

RAM size per node

RAM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Nodes total
2 GiB 10 10
32 GiB 14 19 33
64 GiB 22 54 22 98
96 GiB 140 30 170
128 GiB 14 8 107 48 107 284
192 GiB 32 8 64 104
256 GiB 15 4 8 27
384 GiB 4 4
512 GiB 12 12
768 GiB 4 8 12
1.0 TiB 1 1
Sites total 54 39 14 68 373 70 107 30 755

PMEM size per node

PMEM size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Nodes total
1.5 TiB 4 4
Sites total 4 4

Networking

Network interconnects

Interconnect Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cards total
Ethernet 1 Gbps 11 89 8 30 138
Ethernet 10 Gbps 48 46 28 67 355 118 214 876
Ethernet 25 Gbps 6 32 270 308
Ethernet-FPGA 100 Gbps 4 4
InfiniBand 40 Gbps 30 30
InfiniBand 56 Gbps 78 78
InfiniBand 100 Gbps 24 30 54
Omni-Path 100 Gbps 40 84 124
Sites total 122 78 28 108 876 118 222 60 1612

Nodes with several Ethernet interfaces

Site Cluster Nodes 25G interfaces 10G interfaces 1G interfaces Interfaces (throughput)
Lille chetemi 15 2 eno1 (10 Gbps), eno2 (10 Gbps)
Lille chiclet 8 2 enp98s0f0 (25 Gbps), enp98s0f1 (25 Gbps)
Lille chifflet 8 2 eno1 (10 Gbps), eno2 (10 Gbps)
Lille chifflot 8 2 ens5f0 (25 Gbps), ens5f1 (25 Gbps)
Luxembourg petitprince 14 2 eno1 (10 Gbps), eno2 (10 Gbps)
Lyon neowise 10 2 eno1 (10 Gbps), eno2 (10 Gbps)
Nancy grimoire 8 4 eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps)
Nancy grisou-49 1 4 eno1 (10 Gbps), eno2 (10 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps)
Nancy grisou-[1-32,34-43,45-48] 46 4 1 eno1 (10 Gbps), eno2 (10 Gbps), eno3 (1 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps)
Nancy grisou-[50-51] 2 4 eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps)
Nancy gros 124 2 eno1 (25 Gbps), eno2 (25 Gbps)
Nantes ecotype 48 2 eno1 (10 Gbps), eno2 (10 Gbps)
Rennes paranoia 8 2 1 eno1 (1 Gbps), enp3s0f0 (10 Gbps), enp3s0f1 (10 Gbps)
Rennes parasilo 27 2 eno1 (10 Gbps), eno2 (10 Gbps)
Rennes paravance 72 2 eno1 (10 Gbps), eno2 (10 Gbps)

Nodes with SR-IOV support

Site Cluster Nodes Interfaces (max number of Virtual Functions)
Grenoble troll 4 eno1 (63 VFs)
Lille chetemi 15 eno1 (63 VFs), eno2 (63 VFs)
Lille chifflet 8 eno1 (63 VFs), eno2 (63 VFs)
Lyon gemini 2 enp1s0f0 (63 VFs)
Lyon hercule 4 enp130s0f1 (63 VFs)
Lyon neowise 10 eno1 (8 VFs), eno2 (8 VFs)
Lyon nova 22 enp5s0f0 (63 VFs)
Lyon orion 3 enp68s0f0 (63 VFs)
Lyon pyxis 4 eno1 (96 VFs)
Lyon taurus 12 enp68s0f0 (63 VFs)
Nancy graoully 16 eno1 (63 VFs)
Nancy graphite 4 eno1 (63 VFs)
Nancy grcinq 43 eno1 (7 VFs)
Nancy grele 14 eno1 (63 VFs)
Nancy grimani 6 eno1 (63 VFs)
Nancy grimoire 8 eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs)
Nancy grisou-[1-32,34-43,45-49] 47 eno1 (63 VFs), eno2 (63 VFs), enp4s0f0 (63 VFs), enp4s0f1 (63 VFs)
Nancy grisou-[50-51] 2 eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs)
Nancy gros 124 eno1 (63 VFs), eno2 (63 VFs)
Nantes econome 22 enp3s0f0 (63 VFs)
Nantes ecotype 48 eno1 (63 VFs), eno2 (63 VFs)
Rennes paranoia 8 eno1 (7 VFs), enp3s0f0 (63 VFs), enp3s0f1 (63 VFs)
Rennes parasilo 27 eno1 (63 VFs), eno2 (63 VFs)
Rennes paravance 72 eno1 (63 VFs), eno2 (63 VFs)
Sophia uvb 30 eno1 (7 VFs)

Network interface models

Type Driver Model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cards total
Ethernet bnx2x Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet 12 5 17
Ethernet bnx2x Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet 14 14
Ethernet i40e Intel Ethernet Controller X710 for 10GbE SFP+ 36 82 118
Ethernet i40e Intel Ethernet Controller XXV710 for 25GbE SFP28 16 16 32
Ethernet ice Intel Ethernet Controller E810-C for SFP 2 2
Ethernet igb Intel 82576 Gigabit Network Connection 30 30
Ethernet igb Intel I210 Gigabit Network Connection 1 1
Ethernet igb Intel I350 Gigabit Network Connection 89 8 97
Ethernet ixgbe Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection 23 4 97 70 107 301
Ethernet ixgbe Intel Ethernet 10G 2P X520 Adapter 37 57 94
Ethernet ixgbe Intel Ethernet Controller 10-Gigabit X540-AT2 2 2
Ethernet mlx5_core Mellanox Technologies MT27710 Family [ConnectX-4 Lx] 4 10 124 138
Ethernet mlx5_core Mellanox Technologies MT27800 Family [ConnectX-5] 6 6
Ethernet qede QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller 4 4
Ethernet tg3 Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet 10 10
Ethernet-FPGA* xrt Xilinx Alveo U200 QSFP28 (100GbE) 2 2
InfiniBand mlx4_core Mellanox Technologies MT25408A0-FCC-QI ConnectX, Dual Port 40Gb/s InfiniBand / 10GigE Adapter IC with PCIe 2.0 x8 5.0GT/s Interface 30 30
InfiniBand mlx4_core Mellanox Technologies MT27500 Family [ConnectX-3] 78 78
InfiniBand mlx5_core Mellanox Technologies MT27700 Family [ConnectX-4] 12 12
InfiniBand mlx5_core Mellanox Technologies MT27800 Family [ConnectX-5] 2 2
InfiniBand mlx5_core Mellanox Technologies MT28908 Family [ConnectX-6] 14 14
Omni-Path hfi1 Intel Omni-Path HFI Silicon 100 Series [discrete] 40 84 124
Sites total 108 39 14 84 638 70 115 60 1128

*: By default network interface on FPGA card is not supported by OS

Storage

SSD models

SSD interface Model Size Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia SSDs total
NVME Dell Ent NVMe v2 AGN MU U.2 1.6TB 1.6 TB 4 4
NVME Dell Express Flash NVMe PM1725 1.6TB AIC 1.6 TB 7 7
NVME Dell Express Flash PM1725b 1.6TB AIC 1.6 TB 1 1
NVME Dell Samsung PM1735 1.6 TB 4 4
NVME Kioxia KCM6DRUL3T84 3.84 TB 4 4
NVME SAMSUNG MZ1LB1T9HALS-00007 1.92 TB 12 12
SAS Toshiba KRM5XVUG1T92 1.92 TB 2 2
SAS Toshiba PX02SSF020 200 GB 8 26 34
SAS Toshiba PX04SHB020 200 GB 1 1
SAS Toshiba PX04SMB040 400 GB 16 48 64
SAS Toshiba PX05SVB048Y 480 GB 8 8
SATA INTEL SSDSC2BB30 300 GB 8 8
SATA Intel SSDSC2KG480G7R 480 GB 3 16 19
SATA Intel SSDSC2KG480G8R 480 GB 1 16 17
SATA Intel SSDSC2KG960G8R 960 GB 1 1
SATA Micron MTFDDAK480TDN 480 GB 4 124 128
SATA Micron MTFDDAK960TDN 960 GB 123 123
SATA Micron MTFDDAK960TDT 960 GB 2 2
SATA SAMSUNG MZ7KM480 480 GB 2 2
SATA SAMSUNG MZ7LM1T9 1.92 TB 8 8
SATA Samsung MZ7KH1T9HAJR0D3 1.92 TB 1 1
SATA Samsung MZ7KM240HMHQ0D3 240 GB 32 32
SATA Samsung MZ7KM480HMHQ0D3 480 GB 32 32
SATA Samsung SSD 860 250 GB 8 8
SATA Sk Hynix HFS1T9G32FEH-BA1 1.92 TB 3 3
Sites total 88 40 34 288 48 27 525

Nodes with several disks

Site Cluster Number of nodes Main disk Additional HDDs Additional SSDs
Grenoble dahu 32 SSD 240 GB 1 (4.0 TB) 1 (480 GB)
Grenoble drac 12 HDD 1.0 TB 1 (1.0 TB) 0
Grenoble servan 2 SSD 1.6 TB 0 1 (1.6 TB)
Grenoble troll 4 SSD 480 GB 0 1 (1.6 TB)
Grenoble yeti 4 SSD 480 GB 3 (2.0 TB*, 2.0 TB*, 2.0 TB*) 2 (1.6 TB, 1.6 TB)
Lille chetemi-10 1 HDD 600 GB 1 (300 GB) 0
Lille chetemi-[1-9,11-15] 14 HDD 300 GB 1 (300 GB) 0
Lille chiclet 8 SSD 480 GB 2 (4.0 TB*, 4.0 TB*) 0
Lille chifflet 8 SSD 400 GB 2 (4.0 TB*, 4.0 TB*) 1 (400 GB*)
Lille chifflot 8 SSD 480 GB 4 (4.0 TB*, 4.0 TB*, 4.0 TB*, 4.0 TB*) 1 (480 GB*)
Lyon gemini 2 SSD 480 GB 0 4 (1.92 TB*, 1.92 TB*, 1.92 TB*, 1.92 TB*)
Lyon hercule 4 HDD 2.0 TB 2 (2.0 TB, 2.0 TB) 0
Lyon pyxis 4 SSD 250 GB 0 1 (250 GB)
Lyon sirius 1 SSD 1.92 TB 0 5 (1.92 TB, 3.84 TB, 3.84 TB, 3.84 TB, 3.84 TB)
Nancy graphite 4 SSD 300 GB 0 1 (300 GB)
Nancy grappe 16 SSD 480 GB 1 (8.0 TB*) 0
Nancy grele 14 HDD 299 GB 1 (299 GB) 0
Nancy grimoire 8 HDD 600 GB 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) 1 (200 GB*)
Nancy grisou 49 HDD 600 GB 1 (600 GB) 0
Nancy gros 124 SSD 480 GB 0 1 (960 GB*)
Nancy grouille 2 SSD 1.92 TB 0 1 (960 GB*)
Rennes paranoia 8 HDD 600 GB 4 (600 GB, 600 GB, 600 GB, 600 GB) 0
Rennes parasilo 27 HDD 600 GB 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) 1 (200 GB*)
Rennes paravance 72 HDD 600 GB 1 (600 GB) 0

*: disk is reservable

Accelerators (GPU, Xeon Phi, FPGA)

Accelerator families

Accelerator family Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Accelerators total
AMD GPU 80 80
Intel MIC 4 4
Nvidia GPU 48 32 27 134 241
Xilinx FPGA 2 2
Sites total 50 32 107 138 327

Accelerator models

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Accelerators total
AMD Radeon Instinct MI50 32GB 80 80
Intel Xeon Phi 7120P 4 4
Nvidia A100-PCIE-40GB 4 4
Nvidia A100-SXM4-40GB 8 8
Nvidia A40 8 8
Nvidia GeForce GTX 1080 Ti 16 28 44
Nvidia GeForce GTX 980 10 10
Nvidia GeForce RTX 2080 Ti 48 48
Nvidia Quadro RTX 6000 4 4
Nvidia Tesla K40m 12 12
Nvidia Tesla M2075 3 3
Nvidia Tesla P100-PCIE-16GB 12 12
Nvidia Tesla P100-SXM2-16GB 48 48
Nvidia Tesla T4 20 20
Nvidia Tesla V100-PCIE-32GB 4 4
Nvidia Tesla V100-SXM2-32GB 16 16
Xilinx Alveo U200 2 2
Sites total 50 32 107 138 327

Accelerator cores

Accelerator model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Cores total
AMD Radeon Instinct MI50 32GB 409600 409600
Intel Xeon Phi 7120P 244 244
Nvidia A100-PCIE-40GB 27648 27648
Nvidia A100-SXM4-40GB 55296 55296
Nvidia A40 86016 86016
Nvidia GeForce GTX 1080 Ti 57344 100352 157696
Nvidia GeForce GTX 980 20480 20480
Nvidia GeForce RTX 2080 Ti 208896 208896
Nvidia Quadro RTX 6000 18432 18432
Nvidia Tesla K40m 34560 34560
Nvidia Tesla M2075 1344 1344
Nvidia Tesla P100-PCIE-16GB 43008 43008
Nvidia Tesla P100-SXM2-16GB 172032 172032
Nvidia Tesla T4 51200 51200
Nvidia Tesla V100-PCIE-32GB 20480 20480
Nvidia Tesla V100-SXM2-32GB 81920 81920
Sites total 172032 120832 548160 547828 1388852

Nodes models

Nodes model Grenoble Lille Luxembourg Lyon Nancy Nantes Rennes Sophia Nodes total
AMD-Penguin Computing 10 10
Dell PowerEdge C6100 30 30
Dell PowerEdge C6220 4 43 22 69
Dell PowerEdge C6220 II 8 8
Dell PowerEdge C6420 32 64 96
Dell PowerEdge M620 14 14
Dell PowerEdge R430 22 22
Dell PowerEdge R630 15 73 48 99 235
Dell PowerEdge R640 4 140 144
Dell PowerEdge R720 15 9 24
Dell PowerEdge R730 8 20 28
Dell PowerEdge R740 8 8
Dell PowerEdge R7425 8 5 13
Dell PowerEdge R7525 2 6 8
Dell PowerEdge R940 4 4
Dell PowerEdge T640 13 13
IBM PowerNV S822LC (8335-GTB) 12 12
NVidia DGX A100 1 1
Nvidia DGX-1 2 2
R181-T92-00 4 4
Sun Fire V20z 10 10
Sites total 54 39 14 68 373 70 107 30 755

Last generated from the Grid'5000 Reference API on 2022-05-24 (commit 6bc296b05e)