Lyon:Hardware: Difference between revisions
No edit summary |
No edit summary |
||
(14 intermediate revisions by 6 users not shown) | |||
Line 2: | Line 2: | ||
__NOEDITSECTION__ | __NOEDITSECTION__ | ||
{{Portal|User}} | {{Portal|User}} | ||
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | <div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Toulouse:Hardware|Toulouse]]</div> | ||
'''See also:''' [[Lyon:Network|Network topology for Lyon]] | '''See also:''' [[Lyon:Network|Network topology for Lyon]] | ||
= Summary = | |||
* 9 clusters | |||
* 68 nodes | |||
* 1544 CPU cores | |||
* 107 GPUs | |||
* 548160 GPUs cores | |||
* 9.99 TiB RAM | |||
* 34 SSDs and 59 HDDs on nodes (total: 99.14 TB) | |||
* 43.8 TFLOPS (excluding GPUs) | |||
= | = Clusters = | ||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
!|Cluster | !rowspan=2|Cluster | ||
!|Access Condition | !rowspan=2|Access Condition | ||
!|Date of arrival | !rowspan=2|Date of arrival | ||
!data-sort-type="number"|Nodes | !rowspan=2|Manufacturing date | ||
!|CPU | !data-sort-type="number" rowspan=2|Nodes | ||
!colspan=4|CPU | |||
!data-sort-type="number" rowspan=2|Memory | |||
!data-sort-type="number" rowspan=2|Storage | |||
!data-sort-type="number" rowspan=2|Network | |||
!rowspan=2|Accelerators | |||
|- | |||
!data-sort-type="number"|# | |||
!|Name | |||
!data-sort-type="number"|Cores | !data-sort-type="number"|Cores | ||
! | !|Architecture | ||
|- | |||
|[[#gemini|gemini]]||<b>[[Exotic#Lyon:_gemini|exotic]]</b> job type||2019-09-01||2019-06-12||2||2||Intel Xeon E5-2698 v4||20 cores/CPU||x86_64||512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD[[Disk_reservation|*]]||data-sort-value="310000"|10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand||8 x Nvidia Tesla V100 (32 GiB) | |||
|- | |- | ||
|[[# | |[[#hercule|hercule]]||||2012-10-02||2012-07-19||4||2||Intel Xeon E5-2620||6 cores/CPU||x86_64||32 GiB||data-sort-value="5589"|<b>2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[# | |[[#neowise|neowise]]||<b>[[Exotic#Lyon:_neowise|exotic]]</b> job type||2021-05-17||2021-05-17||10||1||AMD EPYC 7642||48 cores/CPU||x86_64||512 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="220000"|2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand||8 x AMD MI50 (32 GiB) | ||
|- | |- | ||
|[[# | |[[#nova|nova]]||||2016-12-01||2016-10-28||22||2||Intel Xeon E5-2620 v4||8 cores/CPU||x86_64||64 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|[[# | |[[#orion|orion]]||||2012-09-14||2012-07-16||3||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||<s>Nvidia Tesla M2075 (5 GiB)</s>** | ||
|- | |- | ||
|[[# | |[[#pyxis|pyxis]]||<b>[[Exotic#Lyon:_pyxis|exotic]]</b> job type||2020-01-06||2019-11-07||4||2||Cavium ThunderX2 99xx||32 cores/CPU||aarch64||256 GiB||data-sort-value="464"|<b>250 GB SSD</b> + 250 GB SSD||data-sort-value="110000"|10 Gbps (SR‑IOV) + 100 Gbps InfiniBand|| | ||
|- | |- | ||
|[[# | |[[#sagittaire|sagittaire]]||||2006-07-01||2006-07-01||10||2||AMD Opteron 250||1 core/CPU||x86_64||2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps || | ||
|- | |- | ||
|[[# | |[[#sirius|sirius]]||<b>[[Exotic#Lyon:_sirius|exotic]]</b> job type||2021-11-18||2021-11-24||1||2||AMD EPYC 7742||64 cores/CPU||x86_64||1.0 TiB||data-sort-value="17880"|<b>1.92 TB SSD</b> + 1.92 TB SSD + 4 x 3.84 TB SSD||data-sort-value="100000"|100 Gbps ||8 x Nvidia A100 (40 GiB) | ||
|- | |- | ||
|[[# | |[[#taurus|taurus]]||||2012-09-14||2012-07-16||12||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
|} | |} | ||
''*: disk is [[Disk_reservation|reservable]]'' | ''*: disk is [[Disk_reservation|reservable]]'' | ||
== gemini == | ''**: crossed GPUs are not supported by Grid'5000 default environments'' | ||
= Clusters in the [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/ default queue] = | |||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=gemini%20only gemini] == | |||
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json]) | '''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json]) | ||
Line 48: | Line 64: | ||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p gemini</code> <code>-I</code>}} | ||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
| exotic job type<br/> | | [[Exotic#Lyon:_gemini|exotic]] job type<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Nvidia DGX-1<br/> | | Nvidia DGX-1<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-06-12<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 62: | Line 81: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU | | Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 89: | Line 108: | ||
|} | |} | ||
== hercule == | '''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_gemini|exotic]]''' page for more information.<br/> | ||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=hercule%20only hercule] == | |||
'''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json]) | '''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json]) | ||
Line 95: | Line 116: | ||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p hercule</code> <code>-I</code>}} | ||
{| | {| | ||
Line 101: | Line 122: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge C6220<br/> | | Dell PowerEdge C6220<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2012-07-19<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 106: | Line 130: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU | | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 126: | Line 150: | ||
|} | |} | ||
== neowise == | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=neowise%20only neowise] == | ||
'''10 nodes, 10 cpus, 480 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/neowise/nodes.json?pretty=1 json]) | '''10 nodes, 10 cpus, 480 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/neowise/nodes.json?pretty=1 json]) | ||
Line 132: | Line 156: | ||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p neowise</code> <code>-I</code>}} | ||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
| exotic job type<br/> | | [[Exotic#Lyon:_neowise|exotic]] job type<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| AMD-Penguin Computing<br/> | | AMD-Penguin Computing<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2021-05-17<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 146: | Line 173: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| AMD EPYC 7642 (Zen 2, 1 CPU/node, 48 cores/CPU | | AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 166: | Line 193: | ||
|} | |} | ||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_neowise|exotic]]''' page for more information.<br/> | |||
''' | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] == | ||
'''22 nodes, 44 cpus, 352 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p nova</code> <code>-I</code>}} | ||
{| | {| | ||
Line 178: | Line 207: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge R430<br/> | | Dell PowerEdge R430<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2016-10-28<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 183: | Line 215: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU | | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 202: | Line 234: | ||
|} | |} | ||
== orion == | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=orion%20only orion] == | ||
'''3 nodes, 6 cpus, 36 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/orion/nodes.json?pretty=1 json]) | '''3 nodes, 6 cpus, 36 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/orion/nodes.json?pretty=1 json]) | ||
Line 208: | Line 240: | ||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p orion</code> <code>-I</code>}} | ||
{| | {| | ||
Line 214: | Line 246: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge R720<br/> | | Dell PowerEdge R720<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2012-07-16<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 219: | Line 254: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU | | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 237: | Line 272: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| Nvidia Tesla M2075 (5 GiB)<br>Compute capability: 2.0<br/> | | <s>Nvidia Tesla M2075 (5 GiB)<br>Compute capability: 2.0</s><br>''not supported by Grid'5000 default environments''<br/> | ||
|- | |- | ||
|} | |} | ||
== pyxis == | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=pyxis%20only pyxis] == | ||
'''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json]) | '''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json]) | ||
Line 247: | Line 282: | ||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p pyxis</code> <code>-I</code>}} | ||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
| exotic job type<br/> | | [[Exotic#Lyon:_pyxis|exotic]] job type<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| R181-T92-00<br/> | | Gigabyte R181-T92-00<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2019-11-07<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 261: | Line 299: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU | | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 279: | Line 317: | ||
|} | |} | ||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_pyxis|exotic]]''' page for more information.<br/> | |||
''' | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sagittaire%20only sagittaire] == | ||
'''10 nodes, 20 cpus, 20 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p sagittaire</code> <code>-I</code>}} | ||
; sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores) | ; sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores) | ||
Line 292: | Line 332: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Sun Fire V20z<br/> | | Sun Fire V20z<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2006-07-01<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 297: | Line 340: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU | | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 313: | Line 356: | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
; sagittaire-[2- | ; sagittaire-[2-5,<wbr>13-16] (8 nodes, 16 cpus, 16 cores) | ||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Sun Fire V20z<br/> | | Sun Fire V20z<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2006-07-01<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 323: | Line 369: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU | | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 338: | Line 384: | ||
|} | |} | ||
== | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sirius%20only sirius] == | ||
'''1 node, 2 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sirius/nodes.json?pretty=1 json]) | '''1 node, 2 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sirius/nodes.json?pretty=1 json]) | ||
Line 382: | Line 390: | ||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">- | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p sirius</code> <code>-I</code>}} | ||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
| | | [[Exotic#Lyon:_sirius|exotic]] job type<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| NVidia DGX A100<br/> | | NVidia DGX A100<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2021-11-24<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 396: | Line 407: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| AMD EPYC 7742 (Zen 2, 2 CPUs/node, 64 cores/CPU | | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 412: | Line 423: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/enp225s0f0np0, Ethernet, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br /> | ||
* <span style="color:grey">eth1/ | * <span style="color:grey">eth1/enp226s0, Ethernet, model: Intel I210 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth2/enp225s0f1np1, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/enp225s0f1np1, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | * <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
Line 427: | Line 438: | ||
| 8 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/> | | 8 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on | |} | ||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Lyon:_sirius|exotic]]''' page for more information.<br/> | |||
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=taurus%20only taurus] == | |||
'''12 nodes, 24 cpus, 144 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p taurus</code> <code>-I</code>}} | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R720<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2012-07-16<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2012-09-14<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 32 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0</code>) (primary disk)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br /> | |||
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | |||
|- | |||
|}''<small>Last generated from the Grid'5000 Reference API on 2024-03-04 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/7f4aeb69ef commit 7f4aeb69ef])</small>'' |
Latest revision as of 11:20, 4 March 2024
See also: Network topology for Lyon
Summary
- 9 clusters
- 68 nodes
- 1544 CPU cores
- 107 GPUs
- 548160 GPUs cores
- 9.99 TiB RAM
- 34 SSDs and 59 HDDs on nodes (total: 99.14 TB)
- 43.8 TFLOPS (excluding GPUs)
Clusters
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
gemini | exotic job type | 2019-09-01 | 2019-06-12 | 2 | 2 | Intel Xeon E5-2698 v4 | 20 cores/CPU | x86_64 | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand | 8 x Nvidia Tesla V100 (32 GiB) |
hercule | 2012-10-02 | 2012-07-19 | 4 | 2 | Intel Xeon E5-2620 | 6 cores/CPU | x86_64 | 32 GiB | 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
neowise | exotic job type | 2021-05-17 | 2021-05-17 | 10 | 1 | AMD EPYC 7642 | 48 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) |
nova | 2016-12-01 | 2016-10-28 | 22 | 2 | Intel Xeon E5-2620 v4 | 8 cores/CPU | x86_64 | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
orion | 2012-09-14 | 2012-07-16 | 3 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | ||
pyxis | exotic job type | 2020-01-06 | 2019-11-07 | 4 | 2 | Cavium ThunderX2 99xx | 32 cores/CPU | aarch64 | 256 GiB | 250 GB SSD + 250 GB SSD | 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand | |
sagittaire | 2006-07-01 | 2006-07-01 | 10 | 2 | AMD Opteron 250 | 1 core/CPU | x86_64 | 2 GiB | 73 GB HDD | 1 Gbps | ||
sirius | exotic job type | 2021-11-18 | 2021-11-24 | 1 | 2 | AMD EPYC 7742 | 64 cores/CPU | x86_64 | 1.0 TiB | 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD | 100 Gbps | 8 x Nvidia A100 (40 GiB) |
taurus | 2012-09-14 | 2012-07-16 | 12 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) |
*: disk is reservable
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
gemini
2 nodes, 4 cpus, 80 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Nvidia DGX-1 |
Manufacturing date: | 2019-06-12 |
Date of arrival: | 2019-09-01 |
CPU: | Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB) Compute capability: 7.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
hercule
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
Model: | Dell PowerEdge C6220 |
Manufacturing date: | 2012-07-19 |
Date of arrival: | 2012-10-02 |
CPU: | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: |
|
Network: |
|
neowise
10 nodes, 10 cpus, 480 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | AMD-Penguin Computing |
Manufacturing date: | 2021-05-17 |
Date of arrival: | 2021-05-17 |
CPU: | AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU |
Memory: | 512 GiB |
Storage: | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:82:00.0-nvme-1 ) (primary disk) |
Network: |
|
GPU: | 8 x AMD Radeon Instinct MI50 32GB (32 GiB) |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
nova
22 nodes, 44 cpus, 352 cores (json)
Reservation example:
Model: | Dell PowerEdge R430 |
Manufacturing date: | 2016-10-28 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 64 GiB |
Storage: | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
orion
3 nodes, 6 cpus, 36 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Manufacturing date: | 2012-07-16 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
GPU: | Compute capability: 2.0 not supported by Grid'5000 default environments |
pyxis
4 nodes, 8 cpus, 256 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Gigabyte R181-T92-00 |
Manufacturing date: | 2019-11-07 |
Date of arrival: | 2020-01-06 |
CPU: | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
Note: This cluster is defined as exotic. Please read the exotic page for more information.
sagittaire
10 nodes, 20 cpus, 20 cores, split as follows due to differences between nodes (json)
Reservation example:
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: | Sun Fire V20z |
Manufacturing date: | 2006-07-01 |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
- sagittaire-[2-5,
13-16] (8 nodes, 16 cpus, 16 cores)
Model: | Sun Fire V20z |
Manufacturing date: | 2006-07-01 |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
sirius
1 node, 2 cpus, 128 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | NVidia DGX A100 |
Manufacturing date: | 2021-11-24 |
Date of arrival: | 2021-11-18 |
CPU: | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU |
Memory: | 1.0 TiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0 |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
taurus
12 nodes, 24 cpus, 144 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Manufacturing date: | 2012-07-16 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
Last generated from the Grid'5000 Reference API on 2024-03-04 (commit 7f4aeb69ef)