Difference between revisions of "Lyon:Hardware"
From Grid5000
Jlelaurain (talk | contribs) |
|||
(44 intermediate revisions by 10 users not shown) | |||
Line 2: | Line 2: | ||
__NOEDITSECTION__ | __NOEDITSECTION__ | ||
{{Portal|User}} | {{Portal|User}} | ||
− | <div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | + | <div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Toulouse:Hardware|Toulouse]]</div> |
+ | '''See also:''' [[Lyon:Network|Network topology for Lyon]] | ||
+ | = Summary = | ||
+ | * 9 clusters | ||
+ | * 68 nodes | ||
+ | * 1544 CPU cores | ||
+ | * 107 GPUs | ||
+ | * 9.99 TiB RAM | ||
+ | * 34 SSDs and 59 HDDs on nodes (total: 99.14 TB) | ||
+ | * 43.8 TFLOPS (excluding GPUs) | ||
− | = | + | = Clusters = |
− | |||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
− | !|Cluster | + | !rowspan=2|Cluster |
− | !|Access Condition | + | !rowspan=2|Access Condition |
− | !|Date of arrival | + | !rowspan=2|Date of arrival |
− | !data-sort-type="number"|Nodes | + | !data-sort-type="number" rowspan=2|Nodes |
− | !|CPU | + | !colspan=4|CPU |
+ | !data-sort-type="number" rowspan=2|Memory | ||
+ | !data-sort-type="number" rowspan=2|Storage | ||
+ | !data-sort-type="number" rowspan=2|Network | ||
+ | !rowspan=2|Accelerators | ||
+ | |- | ||
+ | !data-sort-type="number"|# | ||
+ | !|Name | ||
!data-sort-type="number"|Cores | !data-sort-type="number"|Cores | ||
− | ! | + | !|Architecture |
− | |||
− | |||
− | |||
|- | |- | ||
− | |[[#gemini|gemini]]||||2019-09-01||2||2 | + | |
+ | |[[#gemini|gemini]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2019-09-01||2||2||Intel Xeon E5-2698 v4||20 cores/CPU||x86_64||512 GiB||data-sort-value="7599"|<b>480 GB SSD</b> + 4 x 1.92 TB SSD[[Disk_reservation|*]]||data-sort-value="310000"|10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand||8 x Nvidia Tesla V100 (32 GiB) | ||
|- | |- | ||
− | |[[#hercule|hercule]]||||2012-10-02||4||2 | + | |[[#hercule|hercule]]||||2012-10-02||4||2||Intel Xeon E5-2620||6 cores/CPU||x86_64||32 GiB||data-sort-value="5589"|<b>2.0 TB HDD</b> + 2 x 2.0 TB HDD||data-sort-value="10000"|10 Gbps (SR‑IOV) || |
|- | |- | ||
− | |[[# | + | |[[#neowise|neowise]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2021-05-17||10||1||AMD EPYC 7642||48 cores/CPU||x86_64||512 GiB||data-sort-value="1788"|<b>1.92 TB SSD</b>||data-sort-value="220000"|2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand||8 x AMD MI50 (32 GiB) |
|- | |- | ||
− | |[[# | + | |[[#nova|nova]]||||2016-12-01||22||2||Intel Xeon E5-2620 v4||8 cores/CPU||x86_64||64 GiB||data-sort-value="557"|<b>598 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || |
|- | |- | ||
− | |[[# | + | |[[#orion|orion]]||||2012-09-14||3||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) ||<s>Nvidia Tesla M2075 (5 GiB)</s>** |
|- | |- | ||
− | |[[# | + | |[[#pyxis|pyxis]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2020-01-06||4||2||Cavium ThunderX2 99xx||32 cores/CPU||aarch64||256 GiB||data-sort-value="464"|<b>250 GB SSD</b> + 250 GB SSD||data-sort-value="110000"|10 Gbps (SR‑IOV) + 100 Gbps InfiniBand|| |
+ | |- | ||
+ | |[[#sagittaire|sagittaire]]||||2006-07-01||10||2||AMD Opteron 250||1 core/CPU||x86_64||2 GiB||data-sort-value="68"|<b>73 GB HDD</b>||data-sort-value="1000"|1 Gbps || | ||
+ | |- | ||
+ | |[[#sirius|sirius]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b> job type||2021-11-18||1||2||AMD EPYC 7742||64 cores/CPU||x86_64||1.0 TiB||data-sort-value="17880"|<b>1.92 TB SSD</b> + 1.92 TB SSD + 4 x 3.84 TB SSD||data-sort-value="100000"|100 Gbps ||8 x Nvidia A100 (40 GiB) | ||
+ | |- | ||
+ | |[[#taurus|taurus]]||||2012-09-14||12||2||Intel Xeon E5-2630||6 cores/CPU||x86_64||32 GiB||data-sort-value="278"|<b>299 GB HDD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |- | ||
− | |||
− | |||
|} | |} | ||
+ | ''*: disk is [[Disk_reservation|reservable]]'' | ||
− | = | + | ''**: crossed GPUs are not supported by Grid'5000 default environments'' |
+ | = Clusters in the [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/ default queue] = | ||
− | == gemini == | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=gemini%20only gemini] == |
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json]) | '''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p gemini</code> <code>-I</code>}} | ||
+ | |||
{| | {| | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
+ | | exotic job type<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
Line 49: | Line 76: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU | + | | Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 56: | Line 83: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
− | * 480 GB SSD | + | * disk0, 480 GB SSD SATA Samsung SAMSUNG MZ7KM480 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0</code>) (primary disk)<br /> |
− | * 1.92 TB SSD | + | * disk1, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0</code>) [[Disk_reservation|(reservable)]] <br /> |
− | * 1.92 TB SSD | + | * disk2, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0</code>) [[Disk_reservation|(reservable)]] <br /> |
− | * 1.92 TB SSD | + | * disk3, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0</code>) [[Disk_reservation|(reservable)]] <br /> |
− | * 1.92 TB SSD | + | * disk4, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0</code>) [[Disk_reservation|(reservable)]] <br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br /> | + | * eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled<br /> |
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br /> | ||
* ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> | * ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> | ||
− | * | + | * ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> |
− | * | + | * ib2, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br /> |
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | * <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment</span><br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
− | | 8 x Nvidia Tesla V100<br/> | + | | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB)<br>Compute capability: 7.0<br/> |
|- | |- | ||
|} | |} | ||
− | == hercule == | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=hercule%20only hercule] == |
'''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json]) | '''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p hercule</code> <code>-I</code>}} | ||
+ | |||
{| | {| | ||
|- | |- | ||
Line 88: | Line 120: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU | + | | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 95: | Line 127: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
− | * 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 | + | * disk0, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:1f.2-ata-1</code>) (primary disk)<br /> |
− | * 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 | + | * disk1, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:1f.2-ata-2</code>) <br /> |
− | * 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 | + | * disk2, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:1f.2-ata-3</code>) <br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* <span style="color:grey">eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br /> | ||
− | * eth1/enp130s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br /> | + | * eth1/enp130s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br /> |
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
Line 108: | Line 140: | ||
|} | |} | ||
− | == nova == | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=neowise%20only neowise] == |
+ | |||
+ | '''10 nodes, 10 cpus, 480 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/neowise/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p neowise</code> <code>-I</code>}} | ||
+ | |||
+ | {| | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
+ | | exotic job type<br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
+ | | AMD-Penguin Computing<br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
+ | | 2021-05-17<br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
+ | | AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU<br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
+ | | 512 GiB<br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
+ | | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:82:00.0-nvme-1</code>) (primary disk)<br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
+ | | | ||
+ | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br /> | ||
+ | * eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled - no KaVLAN<br /> | ||
+ | * ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br /> | ||
+ | * ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
+ | | 8 x AMD Radeon Instinct MI50 32GB (32 GiB)<br/> | ||
+ | |- | ||
+ | |} | ||
+ | |||
+ | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] == | ||
+ | |||
+ | '''22 nodes, 44 cpus, 352 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p nova</code> <code>-I</code>}} | ||
− | |||
{| | {| | ||
|- | |- | ||
Line 120: | Line 197: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU | + | | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 126: | Line 203: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
− | | 598 GB HDD | + | | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0</code>) (primary disk)<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * eth0/enp5s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe<br /> | + | * eth0/enp5s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br /> |
* <span style="color:grey">eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br /> | ||
− | * <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | + | * <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> |
− | * <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | + | * <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> |
− | * <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | + | * <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> |
− | * <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/> | + | * <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/> |
|- | |- | ||
|} | |} | ||
− | == orion == | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=orion%20only orion] == |
+ | |||
+ | '''3 nodes, 6 cpus, 36 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/orion/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p orion</code> <code>-I</code>}} | ||
− | |||
{| | {| | ||
|- | |- | ||
Line 151: | Line 233: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU | + | | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 157: | Line 239: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
− | | | + | | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0</code>) (primary disk)<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe<br /> | + | * eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br /> |
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
Line 169: | Line 251: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
− | | Nvidia Tesla M2075<br/> | + | | <s>Nvidia Tesla M2075 (5 GiB)<br>Compute capability: 2.0</s><br>''not supported by Grid'5000 default environments''<br/> |
|- | |- | ||
|} | |} | ||
− | == pyxis | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=pyxis%20only pyxis] == |
'''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json]) | '''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p pyxis</code> <code>-I</code>}} | ||
+ | |||
{| | {| | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
+ | | exotic job type<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
Line 185: | Line 275: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU | + | | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 192: | Line 282: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
− | * 250 GB | + | * disk0, 250 GB SSD SATA Samsung Samsung SSD 860 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:0f:00.0-sas-phy2-lun-0</code>) (primary disk)<br /> |
− | * 250 GB | + | * disk1, 250 GB SSD SATA Samsung Samsung SSD 860 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:0f:00.0-sas-phy3-lun-0</code>) <br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede<br /> | + | * eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled<br /> |
* <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br /> | ||
* ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/> | * ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/> | ||
Line 203: | Line 293: | ||
|} | |} | ||
− | == sagittaire == | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sagittaire%20only sagittaire] == |
+ | |||
+ | '''10 nodes, 20 cpus, 20 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
− | + | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p sagittaire</code> <code>-I</code>}} | |
− | ; sagittaire-[ | + | |
+ | ; sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores) | ||
{| | {| | ||
|- | |- | ||
Line 216: | Line 311: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU | + | | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 222: | Line 317: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
− | | 73 GB HDD SCSI | + | | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0</code>) (primary disk)<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br /> | + | * <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br /> |
− | * eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/> | + | * eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/> |
|- | |- | ||
|} | |} | ||
<hr style="height:10pt; visibility:hidden;" /> | <hr style="height:10pt; visibility:hidden;" /> | ||
− | ; sagittaire-[ | + | ; sagittaire-[2-5,<wbr>13-16] (8 nodes, 16 cpus, 16 cores) |
{| | {| | ||
|- | |- | ||
Line 242: | Line 337: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU | + | | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 248: | Line 343: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
− | | 73 GB HDD SCSI Seagate | + | | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0</code>) (primary disk)<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br /> | + | * <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br /> |
− | * eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/> | + | * eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/> |
|- | |- | ||
|} | |} | ||
− | |||
− | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sirius%20only sirius] == | |
+ | |||
+ | '''1 node, 2 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sirius/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p sirius</code> <code>-I</code>}} | ||
+ | |||
{| | {| | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | ||
+ | | exotic job type<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
− | | | + | | NVidia DGX A100<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
− | | | + | | 2021-11-18<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | AMD | + | | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
− | | | + | | 1.0 TiB<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
− | | | + | | |
+ | * disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:22:00.0-nvme-1</code>) (primary disk)<br /> | ||
+ | * disk1, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:23:00.0-nvme-1</code>) <br /> | ||
+ | * disk2, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:09:00.0-nvme-1</code>) <br /> | ||
+ | * disk3, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk3</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:52:00.0-nvme-1</code>) <br /> | ||
+ | * disk4, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:ca:00.0-nvme-1</code>) <br /> | ||
+ | * disk5, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:8a:00.0-nvme-1</code>) <br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * <span style="color:grey"> | + | * eth0/enp225s0f0np0, Ethernet, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br /> |
− | * | + | * <span style="color:grey">eth1/enp226s0, Ethernet, model: Intel I210 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> |
+ | * <span style="color:grey">eth2/enp225s0f1np1, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib4, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib5, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib6, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br /> | ||
+ | * <span style="color:grey">ib7, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br/> | ||
+ | |- | ||
+ | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
+ | | 8 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/> | ||
|- | |- | ||
|} | |} | ||
− | == taurus == | + | == [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=taurus%20only taurus] == |
+ | |||
+ | '''12 nodes, 24 cpus, 144 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json]) | ||
+ | |||
+ | '''Reservation example:''' | ||
+ | |||
+ | {{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p taurus</code> <code>-I</code>}} | ||
− | |||
{| | {| | ||
|- | |- | ||
Line 295: | Line 422: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
− | | Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU | + | | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 301: | Line 428: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
− | | | + | | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0</code>) (primary disk)<br/> |
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
− | * eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe<br /> | + | * eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br /> |
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br /> | * <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br /> | ||
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | * <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br /> | ||
Line 312: | Line 439: | ||
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | * <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/> | ||
|- | |- | ||
− | |}''<small>Last generated from the Grid'5000 Reference API on | + | |}''<small>Last generated from the Grid'5000 Reference API on 2023-09-25 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/a77807cf81 commit a77807cf81])</small>'' |
Latest revision as of 10:27, 25 September 2023
Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Toulouse
See also: Network topology for Lyon
Summary
- 9 clusters
- 68 nodes
- 1544 CPU cores
- 107 GPUs
- 9.99 TiB RAM
- 34 SSDs and 59 HDDs on nodes (total: 99.14 TB)
- 43.8 TFLOPS (excluding GPUs)
Clusters
Cluster | Access Condition | Date of arrival | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | ||||||||
gemini | exotic job type | 2019-09-01 | 2 | 2 | Intel Xeon E5-2698 v4 | 20 cores/CPU | x86_64 | 512 GiB | 480 GB SSD + 4 x 1.92 TB SSD* | 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand | 8 x Nvidia Tesla V100 (32 GiB) |
hercule | 2012-10-02 | 4 | 2 | Intel Xeon E5-2620 | 6 cores/CPU | x86_64 | 32 GiB | 2.0 TB HDD + 2 x 2.0 TB HDD | 10 Gbps (SR‑IOV) | ||
neowise | exotic job type | 2021-05-17 | 10 | 1 | AMD EPYC 7642 | 48 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD | 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand | 8 x AMD MI50 (32 GiB) |
nova | 2016-12-01 | 22 | 2 | Intel Xeon E5-2620 v4 | 8 cores/CPU | x86_64 | 64 GiB | 598 GB HDD | 10 Gbps (SR‑IOV) | ||
orion | 2012-09-14 | 3 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) | ||
pyxis | exotic job type | 2020-01-06 | 4 | 2 | Cavium ThunderX2 99xx | 32 cores/CPU | aarch64 | 256 GiB | 250 GB SSD + 250 GB SSD | 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand | |
sagittaire | 2006-07-01 | 10 | 2 | AMD Opteron 250 | 1 core/CPU | x86_64 | 2 GiB | 73 GB HDD | 1 Gbps | ||
sirius | exotic job type | 2021-11-18 | 1 | 2 | AMD EPYC 7742 | 64 cores/CPU | x86_64 | 1.0 TiB | 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD | 100 Gbps | 8 x Nvidia A100 (40 GiB) |
taurus | 2012-09-14 | 12 | 2 | Intel Xeon E5-2630 | 6 cores/CPU | x86_64 | 32 GiB | 299 GB HDD | 10 Gbps (SR‑IOV) |
*: disk is reservable
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
gemini
2 nodes, 4 cpus, 80 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Nvidia DGX-1 |
Date of arrival: | 2019-09-01 |
CPU: | Intel Xeon E5-2698 v4 (Broadwell), x86_64, 2.20GHz, 2 CPUs/node, 20 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB) Compute capability: 7.0 |
hercule
4 nodes, 8 cpus, 48 cores (json)
Reservation example:
Model: | Dell PowerEdge C6220 |
Date of arrival: | 2012-10-02 |
CPU: | Intel Xeon E5-2620 (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: |
|
Network: |
|
neowise
10 nodes, 10 cpus, 480 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | AMD-Penguin Computing |
Date of arrival: | 2021-05-17 |
CPU: | AMD EPYC 7642 (Zen 2), x86_64, 1 CPU/node, 48 cores/CPU |
Memory: | 512 GiB |
Storage: | disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:82:00.0-nvme-1 ) (primary disk) |
Network: |
|
GPU: | 8 x AMD Radeon Instinct MI50 32GB (32 GiB) |
nova
22 nodes, 44 cpus, 352 cores (json)
Reservation example:
Model: | Dell PowerEdge R430 |
Date of arrival: | 2016-12-01 |
CPU: | Intel Xeon E5-2620 v4 (Broadwell), x86_64, 2.10GHz, 2 CPUs/node, 8 cores/CPU |
Memory: | 64 GiB |
Storage: | disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
orion
3 nodes, 6 cpus, 36 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|
GPU: | Compute capability: 2.0 not supported by Grid'5000 default environments |
pyxis
4 nodes, 8 cpus, 256 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | R181-T92-00 |
Date of arrival: | 2020-01-06 |
CPU: | Cavium ThunderX2 99xx (Vulcan), aarch64, 2 CPUs/node, 32 cores/CPU |
Memory: | 256 GiB |
Storage: |
|
Network: |
|
sagittaire
10 nodes, 20 cpus, 20 cores, split as follows due to differences between nodes (json)
Reservation example:
- sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
- sagittaire-[2-5,
13-16] (8 nodes, 16 cpus, 16 cores)
Model: | Sun Fire V20z |
Date of arrival: | 2006-07-01 |
CPU: | AMD Opteron 250 (K8), x86_64, 2 CPUs/node, 1 core/CPU |
Memory: | 2 GiB |
Storage: | disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0 ) (primary disk) |
Network: |
|
sirius
1 node, 2 cpus, 128 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | NVidia DGX A100 |
Date of arrival: | 2021-11-18 |
CPU: | AMD EPYC 7742 (Zen 2), x86_64, 2 CPUs/node, 64 cores/CPU |
Memory: | 1.0 TiB |
Storage: |
|
Network: |
|
GPU: | 8 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0 |
taurus
12 nodes, 24 cpus, 144 cores (json)
Reservation example:
Model: | Dell PowerEdge R720 |
Date of arrival: | 2012-09-14 |
CPU: | Intel Xeon E5-2630 (Sandy Bridge), x86_64, 2.30GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0 , by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0 ) (primary disk) |
Network: |
|