Difference between revisions of "Hardware"
From Grid5000
Line 5: | Line 5: | ||
* 8 sites | * 8 sites | ||
* 39 clusters | * 39 clusters | ||
− | * | + | * 794 nodes |
− | * | + | * 16088 CPU cores |
− | * | + | * 306 GPUs |
− | * | + | * 101.89 TiB RAM + 6.0 TiB PMEM |
− | * 511 SSDs and | + | * 511 SSDs and 1004 HDDs on nodes (total: 1.44 PB) |
− | * 614. | + | * 614.3 TFLOPS (excluding GPUs) |
= Clusters = | = Clusters = | ||
Line 41: | Line 41: | ||
|[[Lille:Hardware|Lille]]||[[Lille:Hardware#chifflet|chifflet]]||||2016-12-01||8||2 x Intel Xeon E5-2680 v4||14 cores/CPU||768 GiB||data-sort-value="8196"|<b>400 GB SSD</b> + 400 GB SSD[[Disk_reservation|*]] + 2 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="20000"|2 x 10 Gbps , SR-IOV available||2 x Nvidia GTX 1080 Ti | |[[Lille:Hardware|Lille]]||[[Lille:Hardware#chifflet|chifflet]]||||2016-12-01||8||2 x Intel Xeon E5-2680 v4||14 cores/CPU||768 GiB||data-sort-value="8196"|<b>400 GB SSD</b> + 400 GB SSD[[Disk_reservation|*]] + 2 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="20000"|2 x 10 Gbps , SR-IOV available||2 x Nvidia GTX 1080 Ti | ||
|- | |- | ||
− | |[[Lille:Hardware|Lille]]||[[Lille:Hardware#chifflot|chifflot]]||||2018-08-01||8||2 x Intel Xeon Gold 6126||12 cores/CPU||192 GiB||data-sort-value="15798"|<b>480 GB SSD</b> + 480 GB SSD[[Disk_reservation|*]] + 4 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps | + | |[[Lille:Hardware|Lille]]||[[Lille:Hardware#chifflot|chifflot]]||||2018-08-01||8||2 x Intel Xeon Gold 6126||12 cores/CPU||192 GiB||data-sort-value="15798"|<b>480 GB SSD</b> + 480 GB SSD[[Disk_reservation|*]] + 4 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps ||[1-6]: 2 x Nvidia Tesla P100<br />[7-8]: 2 x Nvidia Tesla V100 |
|- | |- | ||
|[[Luxembourg:Hardware|Luxembourg]]||[[Luxembourg:Hardware#petitprince|petitprince]]||||2013-09-10||14||2 x Intel Xeon E5-2630L||6 cores/CPU||32 GiB||data-sort-value="232"|<b>250 GB HDD</b>||data-sort-value="20000"|2 x 10 Gbps || | |[[Luxembourg:Hardware|Luxembourg]]||[[Luxembourg:Hardware#petitprince|petitprince]]||||2013-09-10||14||2 x Intel Xeon E5-2630L||6 cores/CPU||32 GiB||data-sort-value="232"|<b>250 GB HDD</b>||data-sort-value="20000"|2 x 10 Gbps || | ||
Line 65: | Line 65: | ||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graoully|graoully]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2016-01-04||16||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graoully|graoully]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2016-01-04||16||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | ||
|- | |- | ||
− | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2015-05-12|| | + | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphique|graphique]]||<b>[[Grid5000:UsagePolicy#Rules_for_the_production_queue|production]]</b> queue||2015-05-12||5||2 x Intel Xeon E5-2620 v3||6 cores/CPU||64 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand||2 x Nvidia GTX 980 |
|- | |- | ||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||||2013-12-05||4||2 x Intel Xeon E5-2650||8 cores/CPU||256 GiB||data-sort-value="558"|<b>1 x 300 GB SSD</b> + 1 x 300 GB SSD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available||Intel Xeon Phi 7120P | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||||2013-12-05||4||2 x Intel Xeon E5-2650||8 cores/CPU||256 GiB||data-sort-value="558"|<b>1 x 300 GB SSD</b> + 1 x 300 GB SSD||data-sort-value="66000"|10 Gbps + 56 Gbps InfiniBand, SR-IOV available||Intel Xeon Phi 7120P | ||
Line 81: | Line 81: | ||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grisou|grisou]]||||2016-01-04||51||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="41000"|[1-48]: 1 Gbps + 4 x 10 Gbps , SR-IOV available<br />49: 4 x 10 Gbps , SR-IOV available<br />[50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grisou|grisou]]||||2016-01-04||51||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="41000"|[1-48]: 1 Gbps + 4 x 10 Gbps , SR-IOV available<br />49: 4 x 10 Gbps , SR-IOV available<br />[50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available|| | ||
|- | |- | ||
− | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#gros|gros]]||||2019-09-04||124||Intel Xeon Gold 5220||18 cores/CPU||96 GiB||data-sort-value="1341"|<b>480 GB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps || | + | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#gros|gros]]||||2019-09-04||124||Intel Xeon Gold 5220||18 cores/CPU||96 GiB||data-sort-value="1341"|<b>480 GB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps , SR-IOV available|| |
|- | |- | ||
|[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grouille|grouille]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2021-01-13||2||2 x AMD EPYC 7452||32 cores/CPU||128 GiB||data-sort-value="2682"|<b>1.92 TB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="25000"|25 Gbps ||2 x Nvidia A100 | |[[Nancy:Hardware|Nancy]]||[[Nancy:Hardware#grouille|grouille]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2021-01-13||2||2 x AMD EPYC 7452||32 cores/CPU||128 GiB||data-sort-value="2682"|<b>1.92 TB SSD</b> + 960 GB SSD[[Disk_reservation|*]]||data-sort-value="25000"|25 Gbps ||2 x Nvidia A100 | ||
Line 103: | Line 103: | ||
|[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#paravance|paravance]]||||2015-01-13||72||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="20000"|2 x 10 Gbps , SR-IOV available|| | |[[Rennes:Hardware|Rennes]]||[[Rennes:Hardware#paravance|paravance]]||||2015-01-13||72||2 x Intel Xeon E5-2630 v3||8 cores/CPU||128 GiB||data-sort-value="1116"|<b>1 x 600 GB HDD</b> + 1 x 600 GB HDD||data-sort-value="20000"|2 x 10 Gbps , SR-IOV available|| | ||
|- | |- | ||
− | |[[Sophia:Hardware|Sophia]]||[[Sophia:Hardware#uvb|uvb]]||||2011-01-04|| | + | |[[Sophia:Hardware|Sophia]]||[[Sophia:Hardware#uvb|uvb]]||||2011-01-04||30||2 x Intel Xeon X5670||6 cores/CPU||96 GiB||data-sort-value="232"|<b>250 GB HDD</b>||data-sort-value="41000"|1 Gbps + 40 Gbps InfiniBand, SR-IOV available|| |
|} | |} | ||
Line 125: | Line 125: | ||
|data-sort-value="002"|AMD Opteron||||||||28||||||32||||'''60''' | |data-sort-value="002"|AMD Opteron||||||||28||||||32||||'''60''' | ||
|- | |- | ||
− | |data-sort-value="003"|Intel Xeon||88||62||28||92|| | + | |data-sort-value="003"|Intel Xeon||88||62||28||92||612||140||248||60||'''1330''' |
|- | |- | ||
|data-sort-value="004"|POWER8NVL||24||||||||||||||||'''24''' | |data-sort-value="004"|POWER8NVL||24||||||||||||||||'''24''' | ||
Line 131: | Line 131: | ||
|data-sort-value="005"|ThunderX2||||||||8||||||||||'''8''' | |data-sort-value="005"|ThunderX2||||||||8||||||||||'''8''' | ||
|- | |- | ||
− | !'''Sites total'''!!'''112'''!!'''78'''!!'''28'''!!'''138'''!!''' | + | !'''Sites total'''!!'''112'''!!'''78'''!!'''28'''!!'''138'''!!'''626'''!!'''140'''!!'''280'''!!'''60'''!!'''1462''' |
|} | |} | ||
Line 155: | Line 155: | ||
|data-sort-value="2010, Nehalem"|Nehalem||data-sort-value="2010, Intel Xeon X5570"|Intel Xeon X5570||||||||||||||34||||'''34''' | |data-sort-value="2010, Nehalem"|Nehalem||data-sort-value="2010, Intel Xeon X5570"|Intel Xeon X5570||||||||||||||34||||'''34''' | ||
|- | |- | ||
− | |data-sort-value="2011, Westmere"|Westmere||data-sort-value="2011, Intel Xeon X5670"|Intel Xeon X5670|||||||||||||||| | + | |data-sort-value="2011, Westmere"|Westmere||data-sort-value="2011, Intel Xeon X5670"|Intel Xeon X5670||||||||||||||||60||'''60''' |
|- | |- | ||
|data-sort-value="2012, Sandy Bridge"|Sandy Bridge||data-sort-value="2012, Intel Xeon E5-2620"|Intel Xeon E5-2620||||||||8||||||||||'''8''' | |data-sort-value="2012, Sandy Bridge"|Sandy Bridge||data-sort-value="2012, Intel Xeon E5-2620"|Intel Xeon E5-2620||||||||8||||||||||'''8''' | ||
Line 171: | Line 171: | ||
|data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2603 v3"|Intel Xeon E5-2603 v3||||||||||12||||||||'''12''' | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2603 v3"|Intel Xeon E5-2603 v3||||||||||12||||||||'''12''' | ||
|- | |- | ||
− | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2620 v3"|Intel Xeon E5-2620 v3|||||||||| | + | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2620 v3"|Intel Xeon E5-2620 v3||||||||||10||||||||'''10''' |
|- | |- | ||
|data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2630 v3"|Intel Xeon E5-2630 v3||||||||||150||||198||||'''348''' | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2630 v3"|Intel Xeon E5-2630 v3||||||||||150||||198||||'''348''' | ||
Line 211: | Line 211: | ||
|data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7642"|AMD EPYC 7642||||||||10||||||||||'''10''' | |data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7642"|AMD EPYC 7642||||||||10||||||||||'''10''' | ||
|- | |- | ||
− | !'''Sites total'''!! !!'''112'''!!'''78'''!!'''28'''!!'''138'''!!''' | + | !'''Sites total'''!! !!'''112'''!!'''78'''!!'''28'''!!'''138'''!!'''626'''!!'''140'''!!'''280'''!!'''60'''!!'''1462''' |
|} | |} | ||
Line 235: | Line 235: | ||
|data-sort-value="2010, Nehalem"|Nehalem||data-sort-value="2010, Intel Xeon X5570"|Intel Xeon X5570||||||||||||||136||||'''136''' | |data-sort-value="2010, Nehalem"|Nehalem||data-sort-value="2010, Intel Xeon X5570"|Intel Xeon X5570||||||||||||||136||||'''136''' | ||
|- | |- | ||
− | |data-sort-value="2011, Westmere"|Westmere||data-sort-value="2011, Intel Xeon X5670"|Intel Xeon X5670|||||||||||||||| | + | |data-sort-value="2011, Westmere"|Westmere||data-sort-value="2011, Intel Xeon X5670"|Intel Xeon X5670||||||||||||||||360||'''360''' |
|- | |- | ||
|data-sort-value="2012, Sandy Bridge"|Sandy Bridge||data-sort-value="2012, Intel Xeon E5-2620"|Intel Xeon E5-2620||||||||48||||||||||'''48''' | |data-sort-value="2012, Sandy Bridge"|Sandy Bridge||data-sort-value="2012, Intel Xeon E5-2620"|Intel Xeon E5-2620||||||||48||||||||||'''48''' | ||
Line 251: | Line 251: | ||
|data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2603 v3"|Intel Xeon E5-2603 v3||||||||||72||||||||'''72''' | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2603 v3"|Intel Xeon E5-2603 v3||||||||||72||||||||'''72''' | ||
|- | |- | ||
− | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2620 v3"|Intel Xeon E5-2620 v3|||||||||| | + | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2620 v3"|Intel Xeon E5-2620 v3||||||||||60||||||||'''60''' |
|- | |- | ||
|data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2630 v3"|Intel Xeon E5-2630 v3||||||||||1200||||1584||||'''2784''' | |data-sort-value="2013, Haswell"|Haswell||data-sort-value="2013, Intel Xeon E5-2630 v3"|Intel Xeon E5-2630 v3||||||||||1200||||1584||||'''2784''' | ||
Line 291: | Line 291: | ||
|data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7642"|AMD EPYC 7642||||||||480||||||||||'''480''' | |data-sort-value="2019, Zen 2"|Zen 2||data-sort-value="2019, AMD EPYC 7642"|AMD EPYC 7642||||||||480||||||||||'''480''' | ||
|- | |- | ||
− | !'''Sites total'''!! !!'''1648'''!!'''972'''!!'''168'''!!'''1464'''!!''' | + | !'''Sites total'''!! !!'''1648'''!!'''972'''!!'''168'''!!'''1464'''!!'''7900'''!!'''1312'''!!'''2264'''!!'''360'''!!'''16088''' |
|} | |} | ||
Line 318: | Line 318: | ||
|data-sort-value="000048 GB"|48 GiB||||||||||||||16||||'''16''' | |data-sort-value="000048 GB"|48 GiB||||||||||||||16||||'''16''' | ||
|- | |- | ||
− | |data-sort-value="000064 GB"|64 GiB||||||||23|| | + | |data-sort-value="000064 GB"|64 GiB||||||||23||58||22||||||'''103''' |
|- | |- | ||
− | |data-sort-value="000096 GB"|96 GiB||||||||||140|||||| | + | |data-sort-value="000096 GB"|96 GiB||||||||||140||||||30||'''170''' |
|- | |- | ||
|data-sort-value="000128 GB"|128 GiB||12||8||||||109||48||107||||'''284''' | |data-sort-value="000128 GB"|128 GiB||12||8||||||109||48||107||||'''284''' | ||
Line 334: | Line 334: | ||
|data-sort-value="000768 GB"|768 GiB||4||8||||||||||||||'''12''' | |data-sort-value="000768 GB"|768 GiB||4||8||||||||||||||'''12''' | ||
|- | |- | ||
− | !'''Sites total'''!!'''52'''!!'''39'''!!'''14'''!!'''74'''!!''' | + | !'''Sites total'''!!'''52'''!!'''39'''!!'''14'''!!'''74'''!!'''375'''!!'''70'''!!'''140'''!!'''30'''!!'''794''' |
|} | |} | ||
Line 372: | Line 372: | ||
!|Cards total | !|Cards total | ||
|- | |- | ||
− | |data-sort-value="Ethernet 001000 Gbps"|Ethernet 1 Gbps||||||||14||95||||41|| | + | |data-sort-value="Ethernet 001000 Gbps"|Ethernet 1 Gbps||||||||14||95||||41||30||'''180''' |
|- | |- | ||
− | |data-sort-value="Ethernet 010000 Gbps"|Ethernet 10 Gbps||48||46||28||70|| | + | |data-sort-value="Ethernet 010000 Gbps"|Ethernet 10 Gbps||48||46||28||70||363||118||214||||'''887''' |
|- | |- | ||
|data-sort-value="Ethernet 025000 Gbps"|Ethernet 25 Gbps||4||32||||||266||||||||'''302''' | |data-sort-value="Ethernet 025000 Gbps"|Ethernet 25 Gbps||4||32||||||266||||||||'''302''' | ||
Line 380: | Line 380: | ||
|data-sort-value="InfiniBand 020000 Gbps"|InfiniBand 20 Gbps||||||||||||||33||||'''33''' | |data-sort-value="InfiniBand 020000 Gbps"|InfiniBand 20 Gbps||||||||||||||33||||'''33''' | ||
|- | |- | ||
− | |data-sort-value="InfiniBand 040000 Gbps"|InfiniBand 40 Gbps|||||||||||||||| | + | |data-sort-value="InfiniBand 040000 Gbps"|InfiniBand 40 Gbps||||||||||||||||30||'''30''' |
|- | |- | ||
− | |data-sort-value="InfiniBand 056000 Gbps"|InfiniBand 56 Gbps|||||||||| | + | |data-sort-value="InfiniBand 056000 Gbps"|InfiniBand 56 Gbps||||||||||82||||||||'''82''' |
|- | |- | ||
|data-sort-value="InfiniBand 100000 Gbps"|InfiniBand 100 Gbps||24||||||10||||||||||'''34''' | |data-sort-value="InfiniBand 100000 Gbps"|InfiniBand 100 Gbps||24||||||10||||||||||'''34''' | ||
Line 390: | Line 390: | ||
|data-sort-value="Omni-Path 100000 Gbps"|Omni-Path 100 Gbps||40||||||||84||||||||'''124''' | |data-sort-value="Omni-Path 100000 Gbps"|Omni-Path 100 Gbps||40||||||||84||||||||'''124''' | ||
|- | |- | ||
− | !'''Sites total'''!!'''116'''!!'''78'''!!'''28'''!!'''114'''!!''' | + | !'''Sites total'''!!'''116'''!!'''78'''!!'''28'''!!'''114'''!!'''890'''!!'''118'''!!'''288'''!!'''60'''!!'''1692''' |
|} | |} | ||
Line 464: | Line 464: | ||
|- | |- | ||
|[[Nancy:Network|Nancy]]||[[Nancy:Hardware#graoully|graoully]]||16||data-sort-value="63"|eno1 (63 VFs) | |[[Nancy:Network|Nancy]]||[[Nancy:Hardware#graoully|graoully]]||16||data-sort-value="63"|eno1 (63 VFs) | ||
− | |||
− | |||
|- | |- | ||
|[[Nancy:Network|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||4||data-sort-value="63"|eno1 (63 VFs) | |[[Nancy:Network|Nancy]]||[[Nancy:Hardware#graphite|graphite]]||4||data-sort-value="63"|eno1 (63 VFs) | ||
Line 480: | Line 478: | ||
|- | |- | ||
|[[Nancy:Network|Nancy]]||[[Nancy:Hardware#grisou|grisou-[50-51]]]||2||data-sort-value="252"|eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs) | |[[Nancy:Network|Nancy]]||[[Nancy:Hardware#grisou|grisou-[50-51]]]||2||data-sort-value="252"|eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs) | ||
+ | |- | ||
+ | |[[Nancy:Network|Nancy]]||[[Nancy:Hardware#gros|gros]]||124||data-sort-value="126"|eno1 (63 VFs), eno2 (63 VFs) | ||
|- | |- | ||
|[[Nantes:Network|Nantes]]||[[Nantes:Hardware#econome|econome]]||22||data-sort-value="63"|enp3s0f0 (63 VFs) | |[[Nantes:Network|Nantes]]||[[Nantes:Hardware#econome|econome]]||22||data-sort-value="63"|enp3s0f0 (63 VFs) | ||
Line 491: | Line 491: | ||
|[[Rennes:Network|Rennes]]||[[Rennes:Hardware#paravance|paravance]]||72||data-sort-value="126"|eno1 (63 VFs), eno2 (63 VFs) | |[[Rennes:Network|Rennes]]||[[Rennes:Hardware#paravance|paravance]]||72||data-sort-value="126"|eno1 (63 VFs), eno2 (63 VFs) | ||
|- | |- | ||
− | |[[Sophia:Network|Sophia]]||[[Sophia:Hardware#uvb|uvb]]|| | + | |[[Sophia:Network|Sophia]]||[[Sophia:Hardware#uvb|uvb]]||30||data-sort-value="7"|eno1 (7 VFs) |
|} | |} | ||
Line 510: | Line 510: | ||
!|Cards total | !|Cards total | ||
|- | |- | ||
− | |data-sort-value="Ethernet"|Ethernet||data-sort-value="bnx2x"|bnx2x||data-sort-value="Broadcom NetXtreme II BCM57800 1/10 Gigabit Ethernet"|Broadcom NetXtreme II BCM57800 1/10 Gigabit Ethernet||12|||||||| | + | |data-sort-value="Ethernet"|Ethernet||data-sort-value="bnx2x"|bnx2x||data-sort-value="Broadcom NetXtreme II BCM57800 1/10 Gigabit Ethernet"|Broadcom NetXtreme II BCM57800 1/10 Gigabit Ethernet||12||||||||5||||||||'''17''' |
|- | |- | ||
|data-sort-value="Ethernet"|Ethernet||data-sort-value="bnx2x"|bnx2x||data-sort-value="Broadcom NetXtreme II BCM57810 10 Gigabit Ethernet"|Broadcom NetXtreme II BCM57810 10 Gigabit Ethernet||||||14||||||||||||'''14''' | |data-sort-value="Ethernet"|Ethernet||data-sort-value="bnx2x"|bnx2x||data-sort-value="Broadcom NetXtreme II BCM57810 10 Gigabit Ethernet"|Broadcom NetXtreme II BCM57810 10 Gigabit Ethernet||||||14||||||||||||'''14''' | ||
Line 520: | Line 520: | ||
|data-sort-value="Ethernet"|Ethernet||data-sort-value="igb"|igb||data-sort-value="Intel 82575EB Gigabit Network Connection"|Intel 82575EB Gigabit Network Connection||||||||||||||17||||'''17''' | |data-sort-value="Ethernet"|Ethernet||data-sort-value="igb"|igb||data-sort-value="Intel 82575EB Gigabit Network Connection"|Intel 82575EB Gigabit Network Connection||||||||||||||17||||'''17''' | ||
|- | |- | ||
− | |data-sort-value="Ethernet"|Ethernet||data-sort-value="igb"|igb||data-sort-value="Intel 82576 Gigabit Network Connection"|Intel 82576 Gigabit Network Connection||||||||||||||16|| | + | |data-sort-value="Ethernet"|Ethernet||data-sort-value="igb"|igb||data-sort-value="Intel 82576 Gigabit Network Connection"|Intel 82576 Gigabit Network Connection||||||||||||||16||30||'''46''' |
|- | |- | ||
|data-sort-value="Ethernet"|Ethernet||data-sort-value="igb"|igb||data-sort-value="Intel I350 Gigabit Network Connection"|Intel I350 Gigabit Network Connection||||||||||95||||8||||'''103''' | |data-sort-value="Ethernet"|Ethernet||data-sort-value="igb"|igb||data-sort-value="Intel I350 Gigabit Network Connection"|Intel I350 Gigabit Network Connection||||||||||95||||8||||'''103''' | ||
Line 540: | Line 540: | ||
|data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx4_core"|mlx4_core||data-sort-value="Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE]"|Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE]||||||||||||||33||||'''33''' | |data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx4_core"|mlx4_core||data-sort-value="Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE]"|Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE]||||||||||||||33||||'''33''' | ||
|- | |- | ||
− | |data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx4_core"|mlx4_core||data-sort-value="Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]"|Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]|||||||||||||||| | + | |data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx4_core"|mlx4_core||data-sort-value="Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]"|Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]||||||||||||||||30||'''30''' |
|- | |- | ||
− | |data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx4_core"|mlx4_core||data-sort-value="Mellanox Technologies MT27500 Family [ConnectX-3]"|Mellanox Technologies MT27500 Family [ConnectX-3]|||||||||| | + | |data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx4_core"|mlx4_core||data-sort-value="Mellanox Technologies MT27500 Family [ConnectX-3]"|Mellanox Technologies MT27500 Family [ConnectX-3]||||||||||82||||||||'''82''' |
|- | |- | ||
|data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx5_core"|mlx5_core||data-sort-value="Mellanox Technologies MT27700 Family [ConnectX-4]"|Mellanox Technologies MT27700 Family [ConnectX-4]||12||||||||||||||||'''12''' | |data-sort-value="InfiniBand"|InfiniBand||data-sort-value="mlx5_core"|mlx5_core||data-sort-value="Mellanox Technologies MT27700 Family [ConnectX-4]"|Mellanox Technologies MT27700 Family [ConnectX-4]||12||||||||||||||||'''12''' | ||
Line 552: | Line 552: | ||
|data-sort-value="Omni-Path"|Omni-Path||data-sort-value="hfi1"|hfi1||data-sort-value="Intel Omni-Path HFI Silicon 100 Series [discrete]"|Intel Omni-Path HFI Silicon 100 Series [discrete]||40||||||||84||||||||'''124''' | |data-sort-value="Omni-Path"|Omni-Path||data-sort-value="hfi1"|hfi1||data-sort-value="Intel Omni-Path HFI Silicon 100 Series [discrete]"|Intel Omni-Path HFI Silicon 100 Series [discrete]||40||||||||84||||||||'''124''' | ||
|- | |- | ||
− | !'''Sites total'''!! !! !!'''104'''!!'''39'''!!'''14'''!!'''90'''!!''' | + | !'''Sites total'''!! !! !!'''104'''!!'''39'''!!'''14'''!!'''90'''!!'''648'''!!'''70'''!!'''181'''!!'''60'''!!'''1206''' |
|} | |} | ||
Line 658: | Line 658: | ||
|data-sort-value="002"|Intel Xeon Phi||||||||||4||||||||'''4''' | |data-sort-value="002"|Intel Xeon Phi||||||||||4||||||||'''4''' | ||
|- | |- | ||
− | |data-sort-value="003"|Nvidia||48||32||||20|| | + | |data-sort-value="003"|Nvidia||48||32||||20||126||||||||'''226''' |
|- | |- | ||
− | !'''Sites total'''!!'''48'''!!'''32'''!!!!'''100'''!!''' | + | !'''Sites total'''!!'''48'''!!'''32'''!!!!'''100'''!!'''130'''!!!!!!!!'''310''' |
|} | |} | ||
Line 687: | Line 687: | ||
|data-sort-value="005"|Nvidia GeForce GTX 980||||||||||10||||||||'''10''' | |data-sort-value="005"|Nvidia GeForce GTX 980||||||||||10||||||||'''10''' | ||
|- | |- | ||
− | |data-sort-value="006 | + | |data-sort-value="006"|Nvidia GeForce RTX 2080 Ti||||||||||48||||||||'''48''' |
− | |||
− | |||
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="007"|Nvidia Quadro RTX 6000||||||||||4||||||||'''4''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="008"|Nvidia Tesla K40m||||||||||12||||||||'''12''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="009"|Nvidia Tesla M2075||||||||4||||||||||'''4''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="010"|Nvidia Tesla P100-PCIE-16GB||||12||||||||||||||'''12''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="011"|Nvidia Tesla P100-SXM2-16GB||48||||||||||||||||'''48''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="012"|Nvidia Tesla T4||||||||||20||||||||'''20''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="013"|Nvidia Tesla V100-PCIE-32GB||||4||||||||||||||'''4''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="014"|Nvidia Tesla V100-SXM2-32GB||||||||16||||||||||'''16''' |
|- | |- | ||
− | !'''Sites total'''!!'''48'''!!'''32'''!!!!'''100'''!!''' | + | !'''Sites total'''!!'''48'''!!'''32'''!!!!'''100'''!!'''130'''!!!!!!!!'''310''' |
|} | |} | ||
Line 734: | Line 732: | ||
|data-sort-value="005"|Nvidia GeForce GTX 980||||||||||20480||||||||'''20480''' | |data-sort-value="005"|Nvidia GeForce GTX 980||||||||||20480||||||||'''20480''' | ||
|- | |- | ||
− | |data-sort-value="006 | + | |data-sort-value="006"|Nvidia GeForce RTX 2080 Ti||||||||||208896||||||||'''208896''' |
− | |||
− | |||
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="007"|Nvidia Quadro RTX 6000||||||||||18432||||||||'''18432''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="008"|Nvidia Tesla K40m||||||||||34560||||||||'''34560''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="009"|Nvidia Tesla M2075||||||||1792||||||||||'''1792''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="010"|Nvidia Tesla P100-PCIE-16GB||||43008||||||||||||||'''43008''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="011"|Nvidia Tesla P100-SXM2-16GB||172032||||||||||||||||'''172032''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="012"|Nvidia Tesla T4||||||||||51200||||||||'''51200''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="013"|Nvidia Tesla V100-PCIE-32GB||||20480||||||||||||||'''20480''' |
|- | |- | ||
− | |data-sort-value=" | + | |data-sort-value="014"|Nvidia Tesla V100-SXM2-32GB||||||||81920||||||||||'''81920''' |
|- | |- | ||
− | !'''Sites total'''!!'''172032'''!!'''120832'''!!!!'''493312'''!!''' | + | !'''Sites total'''!!'''172032'''!!'''120832'''!!!!'''493312'''!!'''461812'''!!!!!!!!'''1247988''' |
|} | |} | ||
Line 773: | Line 769: | ||
|data-sort-value="001"|AMD-Penguin Computing||||||||10||||||||||'''10''' | |data-sort-value="001"|AMD-Penguin Computing||||||||10||||||||||'''10''' | ||
|- | |- | ||
− | |data-sort-value="002"|Dell PowerEdge C6100|||||||||||||||| | + | |data-sort-value="002"|Dell PowerEdge C6100||||||||||||||||30||'''30''' |
|- | |- | ||
|data-sort-value="003"|Dell PowerEdge C6220||||||||4||47||22||||||'''73''' | |data-sort-value="003"|Dell PowerEdge C6220||||||||4||47||22||||||'''73''' | ||
Line 789: | Line 785: | ||
|data-sort-value="009"|Dell PowerEdge R640||4||||||||140||||||||'''144''' | |data-sort-value="009"|Dell PowerEdge R640||4||||||||140||||||||'''144''' | ||
|- | |- | ||
− | |data-sort-value="010"|Dell PowerEdge R720||||||||17|| | + | |data-sort-value="010"|Dell PowerEdge R720||||||||17||9||||||||'''26''' |
|- | |- | ||
|data-sort-value="011"|Dell PowerEdge R730||||8||||||20||||||||'''28''' | |data-sort-value="011"|Dell PowerEdge R730||||8||||||20||||||||'''28''' | ||
Line 815: | Line 811: | ||
|data-sort-value="022"|Sun Fire V20z||||||||14||||||||||'''14''' | |data-sort-value="022"|Sun Fire V20z||||||||14||||||||||'''14''' | ||
|- | |- | ||
− | !'''Sites total'''!!'''52'''!!'''39'''!!'''14'''!!'''74'''!!''' | + | !'''Sites total'''!!'''52'''!!'''39'''!!'''14'''!!'''74'''!!'''375'''!!'''70'''!!'''140'''!!'''30'''!!'''794''' |
− | |}''<small>Last generated from the Grid'5000 Reference API on 2021-08- | + | |}''<small>Last generated from the Grid'5000 Reference API on 2021-08-18 ([https://github.com/grid5000/reference-repository/commit/5361da2acb commit 5361da2acb])</small>'' |
Revision as of 11:56, 18 August 2021
Contents
Summary
- 8 sites
- 39 clusters
- 794 nodes
- 16088 CPU cores
- 306 GPUs
- 101.89 TiB RAM + 6.0 TiB PMEM
- 511 SSDs and 1004 HDDs on nodes (total: 1.44 PB)
- 614.3 TFLOPS (excluding GPUs)
Clusters
Site | Cluster | Access Condition | Date of arrival | Nodes | CPU | Cores | Memory | Storage | Network | Accelerators |
---|---|---|---|---|---|---|---|---|---|---|
Grenoble | dahu | 2018-03-22 | 32 | 2 x Intel Xeon Gold 6130 | 16 cores/CPU | 192 GiB | 240 GB SSD + 480 GB SSD + 4.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path | ||
Grenoble | drac | exotic job type | 2020-10-05 | 12 | 2 x POWER8NVL 1.0 | 10 cores/CPU | 128 GiB | 1 x 1.0 TB HDD + 1 x 1.0 TB HDD | 10 Gbps + 2 x 100 Gbps InfiniBand | 4 x Nvidia Tesla P100 |
Grenoble | troll | exotic job type | 2019-12-23 | 4 | 2 x Intel Xeon Gold 5218 | 16 cores/CPU | 384 GiB + 1.5 TiB PMEM | 480 GB SSD + 1.6 TB SSD | 25 Gbps + 100 Gbps Omni-Path, SR-IOV available | |
Grenoble | yeti | exotic job type | 2018-01-16 | 4 | 4 x Intel Xeon Gold 6130 | 16 cores/CPU | 768 GiB | 480 GB SSD + 3 x 2.0 TB HDD* + 2 x 1.6 TB SSD | 10 Gbps + 100 Gbps Omni-Path | |
Lille | chetemi | 2016-12-01 | 15 | 2 x Intel Xeon E5-2630 v4 | 10 cores/CPU | 256 GiB | [1-9, 10: 600 GB HDD + 300 GB HDD |
2 x 10 Gbps , SR-IOV available | ||
Lille | chiclet | 2018-08-06 | 8 | 2 x AMD EPYC 7301 | 16 cores/CPU | 128 GiB | 480 GB SSD + 2 x 4.0 TB HDD* | 2 x 25 Gbps | ||
Lille | chifflet | 2016-12-01 | 8 | 2 x Intel Xeon E5-2680 v4 | 14 cores/CPU | 768 GiB | 400 GB SSD + 400 GB SSD* + 2 x 4.0 TB HDD* | 2 x 10 Gbps , SR-IOV available | 2 x Nvidia GTX 1080 Ti | |
Lille | chifflot | 2018-08-01 | 8 | 2 x Intel Xeon Gold 6126 | 12 cores/CPU | 192 GiB | 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* | 2 x 25 Gbps | [1-6]: 2 x Nvidia Tesla P100 [7-8]: 2 x Nvidia Tesla V100 | |
Luxembourg | petitprince | 2013-09-10 | 14 | 2 x Intel Xeon E5-2630L | 6 cores/CPU | 32 GiB | 250 GB HDD | 2 x 10 Gbps | ||
Lyon | gemini | exotic job type | 2019-09-01 | 2 | 2 x Intel Xeon E5-2698 v4 | 20 cores/CPU | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps + 3 x 100 Gbps InfiniBand, SR-IOV available | 8 x Nvidia Tesla V100 |
Lyon | hercule | 2012-10-02 | 4 | 2 x Intel Xeon E5-2620 | 6 cores/CPU | 32 GiB | 1 x 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps , SR-IOV available | ||
Lyon | neowise | testing queue, exotic job type |
2021-05-17 | 10 | AMD EPYC 7642 | 48 cores/CPU | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps + 2 x 200 Gbps InfiniBand, SR-IOV available | 8 x AMD MI50 |
Lyon | nova | 2016-12-01 | 23 | 2 x Intel Xeon E5-2620 v4 | 8 cores/CPU | 64 GiB | 598 GB HDD | 10 Gbps , SR-IOV available | ||
Lyon | orion | 2012-09-14 | 4 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 598 GB HDD | 10 Gbps , SR-IOV available | Nvidia Tesla M2075 | |
Lyon | pyxis | exotic job type | 2020-01-06 | 4 | 2 x ThunderX2 99xx | 32 cores/CPU | 256 GiB | 1 x 250 GB SSD + 1 x 250 GB SSD | 10 Gbps + 100 Gbps InfiniBand, SR-IOV available | |
Lyon | sagittaire | 2006-07-01 | 14 | 2 x AMD Opteron 250 | 1 core/CPU | 2 GiB | 73 GB HDD | 1 Gbps | ||
Lyon | taurus | 2012-09-14 | 13 | 2 x Intel Xeon E5-2630 | 6 cores/CPU | 32 GiB | 598 GB HDD | 10 Gbps , SR-IOV available | ||
Nancy | graffiti | production queue | 2019-06-07 | 13 | 2 x Intel Xeon Silver 4110 | 8 cores/CPU | 128 GiB | 479 GB HDD | 10 Gbps | [1-12]: 4 x Nvidia RTX 2080 Ti 13: 4 x Nvidia Quadro RTX 6000 |
Nancy | graoully | production queue | 2016-01-04 | 16 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | 10 Gbps + 56 Gbps InfiniBand, SR-IOV available | |
Nancy | graphique | production queue | 2015-05-12 | 5 | 2 x Intel Xeon E5-2620 v3 | 6 cores/CPU | 64 GiB | 299 GB HDD | 10 Gbps + 56 Gbps InfiniBand | 2 x Nvidia GTX 980 |
Nancy | graphite | 2013-12-05 | 4 | 2 x Intel Xeon E5-2650 | 8 cores/CPU | 256 GiB | 1 x 300 GB SSD + 1 x 300 GB SSD | 10 Gbps + 56 Gbps InfiniBand, SR-IOV available | Intel Xeon Phi 7120P | |
Nancy | grappe | production queue | 2020-08-20 | 16 | 2 x Intel Xeon Gold 5218R | 20 cores/CPU | 96 GiB | 480 GB SSD + 8.0 TB HDD* | 25 Gbps | |
Nancy | grcinq | production queue | 2013-04-09 | 47 | 2 x Intel Xeon E5-2650 | 8 cores/CPU | 64 GiB | 1.0 TB HDD | 1 Gbps + 56 Gbps InfiniBand, SR-IOV available | |
Nancy | grele | production queue | 2017-06-26 | 14 | 2 x Intel Xeon E5-2650 v4 | 12 cores/CPU | 128 GiB | 1 x 299 GB HDD + 1 x 299 GB HDD | 10 Gbps + 100 Gbps Omni-Path, SR-IOV available | 2 x Nvidia GTX 1080 Ti |
Nancy | grimani | production queue | 2016-08-30 | 6 | 2 x Intel Xeon E5-2603 v3 | 6 cores/CPU | 64 GiB | 1.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path, SR-IOV available | 2 x Nvidia Tesla K40M |
Nancy | grimoire | 2016-01-22 | 8 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* | 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available | ||
Nancy | grisou | 2016-01-04 | 51 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | [1-48]: 1 Gbps + 4 x 10 Gbps , SR-IOV available 49: 4 x 10 Gbps , SR-IOV available [50-51]: 4 x 10 Gbps + 56 Gbps InfiniBand, SR-IOV available |
||
Nancy | gros | 2019-09-04 | 124 | Intel Xeon Gold 5220 | 18 cores/CPU | 96 GiB | 480 GB SSD + 960 GB SSD* | 2 x 25 Gbps , SR-IOV available | ||
Nancy | grouille | exotic job type | 2021-01-13 | 2 | 2 x AMD EPYC 7452 | 32 cores/CPU | 128 GiB | 1.92 TB SSD + 960 GB SSD* | 25 Gbps | 2 x Nvidia A100 |
Nancy | grue | production queue | 2019-11-25 | 5 | 2 x AMD EPYC 7351 | 16 cores/CPU | 128 GiB | 479 GB HDD | 10 Gbps | 4 x Nvidia Tesla T4 |
Nancy | grvingt | production queue | 2018-04-11 | 64 | 2 x Intel Xeon Gold 6130 | 16 cores/CPU | 192 GiB | 1.0 TB HDD | 10 Gbps + 100 Gbps Omni-Path | |
Nantes | econome | 2014-04-16 | 22 | 2 x Intel Xeon E5-2660 | 8 cores/CPU | 64 GiB | 2.0 TB HDD | 10 Gbps , SR-IOV available | ||
Nantes | ecotype | 2017-10-16 | 48 | 2 x Intel Xeon E5-2630L v4 | 10 cores/CPU | 128 GiB | 400 GB SSD | 2 x 10 Gbps , SR-IOV available | ||
Rennes | paranoia | 2014-02-21 | 8 | 2 x Intel Xeon E5-2660 v2 | 10 cores/CPU | 128 GiB | 1 x 600 GB HDD + 4 x 600 GB HDD | 1 Gbps + 2 x 10 Gbps , SR-IOV available | ||
Rennes | parapide | 2010-01-25 | 17 | 2 x Intel Xeon X5570 | 4 cores/CPU | 24 GiB | 500 GB HDD | 1 Gbps + 20 Gbps InfiniBand | ||
Rennes | parapluie | 2010-11-02 | 16 | 2 x AMD Opteron 6164 HE | 12 cores/CPU | 48 GiB | 250 GB HDD | 1 Gbps + 20 Gbps InfiniBand | ||
Rennes | parasilo | 2015-01-13 | 27 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* | 2 x 10 Gbps , SR-IOV available | ||
Rennes | paravance | 2015-01-13 | 72 | 2 x Intel Xeon E5-2630 v3 | 8 cores/CPU | 128 GiB | 1 x 600 GB HDD + 1 x 600 GB HDD | 2 x 10 Gbps , SR-IOV available | ||
Sophia | uvb | 2011-01-04 | 30 | 2 x Intel Xeon X5670 | 6 cores/CPU | 96 GiB | 250 GB HDD | 1 Gbps + 40 Gbps InfiniBand, SR-IOV available |
Processors
Processors counts per families
Processor family | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Processors total |
---|---|---|---|---|---|---|---|---|---|
AMD EPYC | 16 | 10 | 14 | 40 | |||||
AMD Opteron | 28 | 32 | 60 | ||||||
Intel Xeon | 88 | 62 | 28 | 92 | 612 | 140 | 248 | 60 | 1330 |
POWER8NVL | 24 | 24 | |||||||
ThunderX2 | 8 | 8 | |||||||
Sites total | 112 | 78 | 28 | 138 | 626 | 140 | 280 | 60 | 1462 |
Processors counts per models
Microarchitecture | Processor model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Processors total |
---|---|---|---|---|---|---|---|---|---|---|
K8 | AMD Opteron 250 | 28 | 28 | |||||||
K10 | AMD Opteron 6164 HE | 32 | 32 | |||||||
Nehalem | Intel Xeon X5570 | 34 | 34 | |||||||
Westmere | Intel Xeon X5670 | 60 | 60 | |||||||
Sandy Bridge | Intel Xeon E5-2620 | 8 | 8 | |||||||
Sandy Bridge | Intel Xeon E5-2630 | 34 | 34 | |||||||
Sandy Bridge | Intel Xeon E5-2630L | 28 | 28 | |||||||
Sandy Bridge | Intel Xeon E5-2650 | 102 | 102 | |||||||
Sandy Bridge | Intel Xeon E5-2660 | 44 | 44 | |||||||
Sandy Bridge | Intel Xeon E5-2660 v2 | 16 | 16 | |||||||
Haswell | Intel Xeon E5-2603 v3 | 12 | 12 | |||||||
Haswell | Intel Xeon E5-2620 v3 | 10 | 10 | |||||||
Haswell | Intel Xeon E5-2630 v3 | 150 | 198 | 348 | ||||||
POWER8 | POWER8NVL 1.0 | 24 | 24 | |||||||
Broadwell | Intel Xeon E5-2620 v4 | 46 | 46 | |||||||
Broadwell | Intel Xeon E5-2630 v4 | 30 | 30 | |||||||
Broadwell | Intel Xeon E5-2630L v4 | 96 | 96 | |||||||
Broadwell | Intel Xeon E5-2650 v4 | 28 | 28 | |||||||
Broadwell | Intel Xeon E5-2680 v4 | 16 | 16 | |||||||
Broadwell | Intel Xeon E5-2698 v4 | 4 | 4 | |||||||
Skylake | Intel Xeon Gold 6126 | 16 | 16 | |||||||
Skylake | Intel Xeon Gold 6130 | 80 | 128 | 208 | ||||||
Skylake | Intel Xeon Silver 4110 | 26 | 26 | |||||||
Zen | AMD EPYC 7301 | 16 | 16 | |||||||
Zen | AMD EPYC 7351 | 10 | 10 | |||||||
Vulcan | ThunderX2 99xx | 8 | 8 | |||||||
Cascade Lake-SP | Intel Xeon Gold 5218 | 8 | 8 | |||||||
Cascade Lake-SP | Intel Xeon Gold 5218R | 32 | 32 | |||||||
Cascade Lake-SP | Intel Xeon Gold 5220 | 124 | 124 | |||||||
Zen 2 | AMD EPYC 7452 | 4 | 4 | |||||||
Zen 2 | AMD EPYC 7642 | 10 | 10 | |||||||
Sites total | 112 | 78 | 28 | 138 | 626 | 140 | 280 | 60 | 1462 |
Cores counts per models
Microarchitecture | Core model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cores total |
---|---|---|---|---|---|---|---|---|---|---|
K8 | AMD Opteron 250 | 28 | 28 | |||||||
K10 | AMD Opteron 6164 HE | 384 | 384 | |||||||
Nehalem | Intel Xeon X5570 | 136 | 136 | |||||||
Westmere | Intel Xeon X5670 | 360 | 360 | |||||||
Sandy Bridge | Intel Xeon E5-2620 | 48 | 48 | |||||||
Sandy Bridge | Intel Xeon E5-2630 | 204 | 204 | |||||||
Sandy Bridge | Intel Xeon E5-2630L | 168 | 168 | |||||||
Sandy Bridge | Intel Xeon E5-2650 | 816 | 816 | |||||||
Sandy Bridge | Intel Xeon E5-2660 | 352 | 352 | |||||||
Sandy Bridge | Intel Xeon E5-2660 v2 | 160 | 160 | |||||||
Haswell | Intel Xeon E5-2603 v3 | 72 | 72 | |||||||
Haswell | Intel Xeon E5-2620 v3 | 60 | 60 | |||||||
Haswell | Intel Xeon E5-2630 v3 | 1200 | 1584 | 2784 | ||||||
POWER8 | POWER8NVL 1.0 | 240 | 240 | |||||||
Broadwell | Intel Xeon E5-2620 v4 | 368 | 368 | |||||||
Broadwell | Intel Xeon E5-2630 v4 | 300 | 300 | |||||||
Broadwell | Intel Xeon E5-2630L v4 | 960 | 960 | |||||||
Broadwell | Intel Xeon E5-2650 v4 | 336 | 336 | |||||||
Broadwell | Intel Xeon E5-2680 v4 | 224 | 224 | |||||||
Broadwell | Intel Xeon E5-2698 v4 | 80 | 80 | |||||||
Skylake | Intel Xeon Gold 6126 | 192 | 192 | |||||||
Skylake | Intel Xeon Gold 6130 | 1280 | 2048 | 3328 | ||||||
Skylake | Intel Xeon Silver 4110 | 208 | 208 | |||||||
Zen | AMD EPYC 7301 | 256 | 256 | |||||||
Zen | AMD EPYC 7351 | 160 | 160 | |||||||
Vulcan | ThunderX2 99xx | 256 | 256 | |||||||
Cascade Lake-SP | Intel Xeon Gold 5218 | 128 | 128 | |||||||
Cascade Lake-SP | Intel Xeon Gold 5218R | 640 | 640 | |||||||
Cascade Lake-SP | Intel Xeon Gold 5220 | 2232 | 2232 | |||||||
Zen 2 | AMD EPYC 7452 | 128 | 128 | |||||||
Zen 2 | AMD EPYC 7642 | 480 | 480 | |||||||
Sites total | 1648 | 972 | 168 | 1464 | 7900 | 1312 | 2264 | 360 | 16088 |
Memory
RAM size per node
RAM size | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Nodes total |
---|---|---|---|---|---|---|---|---|---|
2 GiB | 14 | 14 | |||||||
24 GiB | 17 | 17 | |||||||
32 GiB | 14 | 21 | 35 | ||||||
48 GiB | 16 | 16 | |||||||
64 GiB | 23 | 58 | 22 | 103 | |||||
96 GiB | 140 | 30 | 170 | ||||||
128 GiB | 12 | 8 | 109 | 48 | 107 | 284 | |||
192 GiB | 32 | 8 | 64 | 104 | |||||
256 GiB | 15 | 4 | 4 | 23 | |||||
384 GiB | 4 | 4 | |||||||
512 GiB | 12 | 12 | |||||||
768 GiB | 4 | 8 | 12 | ||||||
Sites total | 52 | 39 | 14 | 74 | 375 | 70 | 140 | 30 | 794 |
PMEM size per node
PMEM size | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Nodes total |
---|---|---|---|---|---|---|---|---|---|
1.5 TiB | 4 | 4 | |||||||
Sites total | 4 | 4 |
Networking
Network interconnects
Interconnect | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cards total |
---|---|---|---|---|---|---|---|---|---|
Ethernet 1 Gbps | 14 | 95 | 41 | 30 | 180 | ||||
Ethernet 10 Gbps | 48 | 46 | 28 | 70 | 363 | 118 | 214 | 887 | |
Ethernet 25 Gbps | 4 | 32 | 266 | 302 | |||||
InfiniBand 20 Gbps | 33 | 33 | |||||||
InfiniBand 40 Gbps | 30 | 30 | |||||||
InfiniBand 56 Gbps | 82 | 82 | |||||||
InfiniBand 100 Gbps | 24 | 10 | 34 | ||||||
InfiniBand 200 Gbps | 20 | 20 | |||||||
Omni-Path 100 Gbps | 40 | 84 | 124 | ||||||
Sites total | 116 | 78 | 28 | 114 | 890 | 118 | 288 | 60 | 1692 |
Nodes with several Ethernet interfaces
Site | Cluster | Nodes | 25G interfaces | 10G interfaces | 1G interfaces | Interfaces (throughput) |
---|---|---|---|---|---|---|
Lille | chetemi | 15 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
Lille | chiclet | 8 | 2 | enp98s0f0 (25 Gbps), enp98s0f1 (25 Gbps) | ||
Lille | chifflet | 8 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
Lille | chifflot | 8 | 2 | ens5f0 (25 Gbps), ens5f1 (25 Gbps) | ||
Luxembourg | petitprince | 14 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
Lyon | neowise | 10 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
Nancy | grimoire | 8 | 4 | eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps) | ||
Nancy | grisou-49 | 1 | 4 | eno1 (10 Gbps), eno2 (10 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps) | ||
Nancy | grisou-[1-48] | 48 | 4 | 1 | eno1 (10 Gbps), eno2 (10 Gbps), eno3 (1 Gbps), enp4s0f0 (10 Gbps), enp4s0f1 (10 Gbps) | |
Nancy | grisou-[50-51] | 2 | 4 | eno1 (10 Gbps), eno2 (10 Gbps), enp129s0f0 (10 Gbps), enp129s0f1 (10 Gbps) | ||
Nancy | gros | 124 | 2 | eno1 (25 Gbps), eno2 (25 Gbps) | ||
Nantes | ecotype | 48 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
Rennes | paranoia | 8 | 2 | 1 | eno1 (1 Gbps), enp3s0f0 (10 Gbps), enp3s0f1 (10 Gbps) | |
Rennes | parasilo | 27 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) | ||
Rennes | paravance | 72 | 2 | eno1 (10 Gbps), eno2 (10 Gbps) |
Nodes with SR-IOV support
Site | Cluster | Nodes | Interfaces (max number of Virtual Functions) |
---|---|---|---|
Grenoble | troll | 4 | eno1 (63 VFs) |
Lille | chetemi | 15 | eno1 (63 VFs), eno2 (63 VFs) |
Lille | chifflet | 8 | eno1 (63 VFs), eno2 (63 VFs) |
Lyon | gemini | 2 | enp1s0f0 (63 VFs) |
Lyon | hercule | 4 | enp130s0f1 (63 VFs) |
Lyon | neowise | 10 | eno1 (8 VFs), eno2 (8 VFs) |
Lyon | nova | 23 | enp5s0f0 (63 VFs) |
Lyon | orion | 4 | enp68s0f0 (63 VFs) |
Lyon | pyxis | 4 | eno1 (96 VFs) |
Lyon | taurus | 13 | enp68s0f0 (63 VFs) |
Nancy | graoully | 16 | eno1 (63 VFs) |
Nancy | graphite | 4 | eno1 (63 VFs) |
Nancy | grcinq | 47 | eno1 (7 VFs) |
Nancy | grele | 14 | eno1 (63 VFs) |
Nancy | grimani | 6 | eno1 (63 VFs) |
Nancy | grimoire | 8 | eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs) |
Nancy | grisou-[1-49] | 49 | eno1 (63 VFs), eno2 (63 VFs), enp4s0f0 (63 VFs), enp4s0f1 (63 VFs) |
Nancy | grisou-[50-51] | 2 | eno1 (63 VFs), eno2 (63 VFs), enp129s0f0 (63 VFs), enp129s0f1 (63 VFs) |
Nancy | gros | 124 | eno1 (63 VFs), eno2 (63 VFs) |
Nantes | econome | 22 | enp3s0f0 (63 VFs) |
Nantes | ecotype | 48 | eno1 (63 VFs), eno2 (63 VFs) |
Rennes | paranoia | 8 | eno1 (7 VFs), enp3s0f0 (63 VFs), enp3s0f1 (63 VFs) |
Rennes | parasilo | 27 | eno1 (63 VFs), eno2 (63 VFs) |
Rennes | paravance | 72 | eno1 (63 VFs), eno2 (63 VFs) |
Sophia | uvb | 30 | eno1 (7 VFs) |
Network interface models
Type | Driver | Model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cards total |
---|---|---|---|---|---|---|---|---|---|---|---|
Ethernet | bnx2x | Broadcom NetXtreme II BCM57800 1/10 Gigabit Ethernet | 12 | 5 | 17 | ||||||
Ethernet | bnx2x | Broadcom NetXtreme II BCM57810 10 Gigabit Ethernet | 14 | 14 | |||||||
Ethernet | i40e | Intel Ethernet Controller X710 for 10GbE SFP+ | 36 | 82 | 118 | ||||||
Ethernet | i40e | Intel Ethernet Controller XXV710 for 25GbE SFP28 | 16 | 16 | 32 | ||||||
Ethernet | igb | Intel 82575EB Gigabit Network Connection | 17 | 17 | |||||||
Ethernet | igb | Intel 82576 Gigabit Network Connection | 16 | 30 | 46 | ||||||
Ethernet | igb | Intel I350 Gigabit Network Connection | 95 | 8 | 103 | ||||||
Ethernet | ixgbe | Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection | 23 | 4 | 99 | 70 | 107 | 303 | |||
Ethernet | ixgbe | Intel Ethernet 10G 2P X520 Adapter | 40 | 59 | 99 | ||||||
Ethernet | ixgbe | Intel Ethernet Controller 10-Gigabit X540-AT2 | 2 | 2 | |||||||
Ethernet | mlx5_core | Mellanox Technologies MT27710 Family [ConnectX-4 Lx] | 4 | 10 | 124 | 138 | |||||
Ethernet | mlx5_core | Mellanox Technologies MT27800 Family [ConnectX-5] | 2 | 2 | |||||||
Ethernet | qede | QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller | 4 | 4 | |||||||
Ethernet | tg3 | Broadcom NetXtreme BCM5704 Gigabit Ethernet | 14 | 14 | |||||||
InfiniBand | mlx4_core | Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE] | 33 | 33 | |||||||
InfiniBand | mlx4_core | Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] | 30 | 30 | |||||||
InfiniBand | mlx4_core | Mellanox Technologies MT27500 Family [ConnectX-3] | 82 | 82 | |||||||
InfiniBand | mlx5_core | Mellanox Technologies MT27700 Family [ConnectX-4] | 12 | 12 | |||||||
InfiniBand | mlx5_core | Mellanox Technologies MT27800 Family [ConnectX-5] | 2 | 2 | |||||||
InfiniBand | mlx5_core | Mellanox Technologies MT28908 Family [ConnectX-6] | 14 | 14 | |||||||
Omni-Path | hfi1 | Intel Omni-Path HFI Silicon 100 Series [discrete] | 40 | 84 | 124 | ||||||
Sites total | 104 | 39 | 14 | 90 | 648 | 70 | 181 | 60 | 1206 |
Storage
NVMe SSD models
NVMe SSD models | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | NVMe SSDs total |
---|---|---|---|---|---|---|---|---|---|
Dell Express Flash NVMe PM1725 1.6TB AIC | 8 | 8 | |||||||
SAMSUNG MZ1LB1T9HALS-00007 | 10 | 10 | |||||||
Samsung PM1735 | 4 | 4 | |||||||
Sites total | 12 | 10 | 22 |
Nodes with several disks
Site | Cluster | Number of nodes | Main disk | Additional HDDs | Additional SSDs |
---|---|---|---|---|---|
Grenoble | dahu | 32 | SSD 240 GB | 1 (4.0 TB) | 1 (480 GB) |
Grenoble | drac | 12 | HDD 1.0 TB | 1 (1.0 TB) | 0 |
Grenoble | troll | 4 | SSD 480 GB | 0 | 1 (1.6 TB) |
Grenoble | yeti | 4 | SSD 480 GB | 3 (2.0 TB*, 2.0 TB*, 2.0 TB*) | 2 (1.6 TB, 1.6 TB) |
Lille | chetemi-10 | 1 | HDD 600 GB | 1 (300 GB) | 0 |
Lille | chetemi-[1-9, |
14 | HDD 300 GB | 1 (300 GB) | 0 |
Lille | chiclet | 8 | SSD 480 GB | 2 (4.0 TB*, 4.0 TB*) | 0 |
Lille | chifflet | 8 | SSD 400 GB | 2 (4.0 TB*, 4.0 TB*) | 1 (400 GB*) |
Lille | chifflot | 8 | SSD 480 GB | 4 (4.0 TB*, 4.0 TB*, 4.0 TB*, 4.0 TB*) | 1 (480 GB*) |
Lyon | gemini | 2 | SSD 480 GB | 0 | 4 (1.92 TB*, 1.92 TB*, 1.92 TB*, 1.92 TB*) |
Lyon | hercule | 4 | HDD 2.0 TB | 2 (2.0 TB, 2.0 TB) | 0 |
Lyon | neowise | 10 | SSD 1.92 TB | 0 | 1 (1.92 TB) |
Lyon | pyxis | 4 | SSD 250 GB | 0 | 1 (250 GB) |
Nancy | graoully | 16 | HDD 600 GB | 1 (600 GB) | 0 |
Nancy | graphite | 4 | SSD 300 GB | 0 | 1 (300 GB) |
Nancy | grappe | 16 | SSD 480 GB | 1 (8.0 TB*) | 0 |
Nancy | grele | 14 | HDD 299 GB | 1 (299 GB) | 0 |
Nancy | grimoire | 8 | HDD 600 GB | 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) | 1 (200 GB*) |
Nancy | grisou | 51 | HDD 600 GB | 1 (600 GB) | 0 |
Nancy | gros | 124 | SSD 480 GB | 0 | 1 (960 GB*) |
Nancy | grouille | 2 | SSD 1.92 TB | 0 | 1 (960 GB*) |
Rennes | paranoia | 8 | HDD 600 GB | 4 (600 GB, 600 GB, 600 GB, 600 GB) | 0 |
Rennes | parasilo | 27 | HDD 600 GB | 4 (600 GB*, 600 GB*, 600 GB*, 600 GB*) | 1 (200 GB*) |
Rennes | paravance | 72 | HDD 600 GB | 1 (600 GB) | 0 |
*: disk is reservable
Accelerators (GPU, Xeon Phi)
Accelerator families
Accelerator family | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Accelerators total |
---|---|---|---|---|---|---|---|---|---|
AMD | 80 | 80 | |||||||
Intel Xeon Phi | 4 | 4 | |||||||
Nvidia | 48 | 32 | 20 | 126 | 226 | ||||
Sites total | 48 | 32 | 100 | 130 | 310 |
Accelerator models
Accelerator model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Accelerators total |
---|---|---|---|---|---|---|---|---|---|
AMD Radeon Instinct MI50 32GB | 80 | 80 | |||||||
Intel Xeon Phi 7120P | 4 | 4 | |||||||
Nvidia A100-PCIE-40GB | 4 | 4 | |||||||
Nvidia GeForce GTX 1080 Ti | 16 | 28 | 44 | ||||||
Nvidia GeForce GTX 980 | 10 | 10 | |||||||
Nvidia GeForce RTX 2080 Ti | 48 | 48 | |||||||
Nvidia Quadro RTX 6000 | 4 | 4 | |||||||
Nvidia Tesla K40m | 12 | 12 | |||||||
Nvidia Tesla M2075 | 4 | 4 | |||||||
Nvidia Tesla P100-PCIE-16GB | 12 | 12 | |||||||
Nvidia Tesla P100-SXM2-16GB | 48 | 48 | |||||||
Nvidia Tesla T4 | 20 | 20 | |||||||
Nvidia Tesla V100-PCIE-32GB | 4 | 4 | |||||||
Nvidia Tesla V100-SXM2-32GB | 16 | 16 | |||||||
Sites total | 48 | 32 | 100 | 130 | 310 |
Accelerator cores
Accelerator model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Cores total |
---|---|---|---|---|---|---|---|---|---|
AMD Radeon Instinct MI50 32GB | 409600 | 409600 | |||||||
Intel Xeon Phi 7120P | 244 | 244 | |||||||
Nvidia A100-PCIE-40GB | 27648 | 27648 | |||||||
Nvidia GeForce GTX 1080 Ti | 57344 | 100352 | 157696 | ||||||
Nvidia GeForce GTX 980 | 20480 | 20480 | |||||||
Nvidia GeForce RTX 2080 Ti | 208896 | 208896 | |||||||
Nvidia Quadro RTX 6000 | 18432 | 18432 | |||||||
Nvidia Tesla K40m | 34560 | 34560 | |||||||
Nvidia Tesla M2075 | 1792 | 1792 | |||||||
Nvidia Tesla P100-PCIE-16GB | 43008 | 43008 | |||||||
Nvidia Tesla P100-SXM2-16GB | 172032 | 172032 | |||||||
Nvidia Tesla T4 | 51200 | 51200 | |||||||
Nvidia Tesla V100-PCIE-32GB | 20480 | 20480 | |||||||
Nvidia Tesla V100-SXM2-32GB | 81920 | 81920 | |||||||
Sites total | 172032 | 120832 | 493312 | 461812 | 1247988 |
Nodes models
Nodes model | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Nodes total |
---|---|---|---|---|---|---|---|---|---|
AMD-Penguin Computing | 10 | 10 | |||||||
Dell PowerEdge C6100 | 30 | 30 | |||||||
Dell PowerEdge C6220 | 4 | 47 | 22 | 73 | |||||
Dell PowerEdge C6220 II | 8 | 8 | |||||||
Dell PowerEdge C6420 | 32 | 64 | 96 | ||||||
Dell PowerEdge M620 | 14 | 14 | |||||||
Dell PowerEdge R430 | 23 | 23 | |||||||
Dell PowerEdge R630 | 15 | 75 | 48 | 99 | 237 | ||||
Dell PowerEdge R640 | 4 | 140 | 144 | ||||||
Dell PowerEdge R720 | 17 | 9 | 26 | ||||||
Dell PowerEdge R730 | 8 | 20 | 28 | ||||||
Dell PowerEdge R740 | 8 | 8 | |||||||
Dell PowerEdge R7425 | 8 | 5 | 13 | ||||||
Dell PowerEdge R7525 | 2 | 2 | |||||||
Dell PowerEdge R940 | 4 | 4 | |||||||
Dell PowerEdge T640 | 13 | 13 | |||||||
HP ProLiant DL165 G7 | 16 | 16 | |||||||
IBM PowerNV S822LC (8335-GTB) | 12 | 12 | |||||||
Nvidia DGX-1 | 2 | 2 | |||||||
R181-T92-00 | 4 | 4 | |||||||
SUN FIRE X2270 | 17 | 17 | |||||||
Sun Fire V20z | 14 | 14 | |||||||
Sites total | 52 | 39 | 14 | 74 | 375 | 70 | 140 | 30 | 794 |