Lyon:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
(32 intermediate revisions by 9 users not shown)
Line 2: Line 2:
__NOEDITSECTION__
__NOEDITSECTION__
{{Portal|User}}
{{Portal|User}}
<div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div>
'''See also:''' [[Lyon:Network|Network topology for Lyon]]
= Summary =
* 9 clusters
* 68 nodes
* 1544 CPU cores
* 107 GPUs
* 9.99&nbsp;TiB RAM
* 34 SSDs and 59 HDDs on nodes (total: 99.14&nbsp;TB)
* 43.8 TFLOPS (excluding GPUs)


= Summary =
= Clusters =
'''7 clusters, 72 nodes, 1010 cores, 24.6 TFLOPS'''
{|class="wikitable sortable"
{|class="wikitable sortable"
|-
|-
!|Cluster
!rowspan=2|Cluster
!|Access Condition
!rowspan=2|Access Condition
!|Date of arrival
!rowspan=2|Date of arrival
!data-sort-type="number"|Nodes
!data-sort-type="number" rowspan=2|Nodes
!|CPU
!colspan=4|CPU
!data-sort-type="number" rowspan=2|Memory
!data-sort-type="number" rowspan=2|Storage
!data-sort-type="number" rowspan=2|Network
!rowspan=2|Accelerators
|-
!data-sort-type="number"|#
!|Name
!data-sort-type="number"|Cores
!data-sort-type="number"|Cores
!data-sort-type="number"|Memory
!|Architecture
!data-sort-type="number"|Storage
|-
!data-sort-type="number"|Network
 
!|Accelerators
|[[#gemini|gemini]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2019-09-01||2||2||Intel Xeon E5-2698 v4||20&nbsp;cores/CPU||x86_64||512&nbsp;GiB||data-sort-value="7599"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;4&nbsp;x&nbsp;1.92&nbsp;TB&nbsp;SSD[[Disk_reservation|*]]||data-sort-value="310000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;3&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100&nbsp;(32&nbsp;GiB)
|-
|[[#hercule|hercule]]||||2012-10-02||4||2||Intel Xeon E5-2620||6&nbsp;cores/CPU||x86_64||32&nbsp;GiB||data-sort-value="5589"|<b>2.0&nbsp;TB&nbsp;HDD</b> +&nbsp;2&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|-
|[[#neowise|neowise]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2021-05-17||10||1||AMD EPYC 7642||48&nbsp;cores/CPU||x86_64||512&nbsp;GiB||data-sort-value="1788"|<b>1.92&nbsp;TB&nbsp;SSD</b>||data-sort-value="220000"|2&nbsp;x&nbsp;10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;2&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||8&nbsp;x&nbsp;AMD MI50&nbsp;(32&nbsp;GiB)
|-
|-
|[[#gemini|gemini]]||||2019-09-01||2||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2698&nbsp;v4||20&nbsp;cores/CPU||512&nbsp;GiB||data-sort-value="7599"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;4&nbsp;x&nbsp;1.92&nbsp;TB&nbsp;SSD[[Disk_reservation|*]]||data-sort-value="310000"|10&nbsp;Gbps&nbsp;+&nbsp;3&nbsp;x&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100
|[[#nova|nova]]||||2016-12-01||22||2||Intel Xeon E5-2620 v4||8&nbsp;cores/CPU||x86_64||64&nbsp;GiB||data-sort-value="557"|<b>598&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|-
|-
|[[#hercule|hercule]]||||2012-10-02||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="5589"|<b>1&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD</b> +&nbsp;2&nbsp;x&nbsp;2.0&nbsp;TB&nbsp;HDD||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
|[[#orion|orion]]||||2012-09-14||3||2||Intel Xeon E5-2630||6&nbsp;cores/CPU||x86_64||32&nbsp;GiB||data-sort-value="278"|<b>299&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||<s>Nvidia Tesla&nbsp;M2075&nbsp;(5&nbsp;GiB)</s>**
|-
|-
|[[#nova|nova]]||||2016-12-01||23||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2620&nbsp;v4||8&nbsp;cores/CPU||64&nbsp;GiB||data-sort-value="557"|<b>598&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
|[[#pyxis|pyxis]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2020-01-06||4||2||ThunderX2 99xx||32&nbsp;cores/CPU||aarch64||256&nbsp;GiB||data-sort-value="464"|<b>250&nbsp;GB&nbsp;SSD</b> +&nbsp;250&nbsp;GB&nbsp;SSD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||
|-
|-
|[[#orion|orion]]||||2012-09-14||4||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2630||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="557"|<b>598&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||Nvidia Tesla&nbsp;M2075
|[[#sagittaire|sagittaire]]||||2006-07-01||10||2||AMD Opteron 250||1&nbsp;core/CPU||x86_64||2&nbsp;GiB||data-sort-value="68"|<b>73&nbsp;GB&nbsp;HDD</b>||data-sort-value="1000"|1&nbsp;Gbps&nbsp;||
|-
|-
|[[#pyxis|pyxis]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2020-01-06||4||2&nbsp;x&nbsp;ThunderX2&nbsp;99xx||32&nbsp;cores/CPU||256&nbsp;GiB||data-sort-value="464"|<b>1&nbsp;x&nbsp;250&nbsp;GB&nbsp;SSD</b> +&nbsp;1&nbsp;x&nbsp;250&nbsp;GB&nbsp;SSD||data-sort-value="110000"|10&nbsp;Gbps&nbsp;+&nbsp;100&nbsp;Gbps&nbsp;InfiniBand||
|[[#sirius|sirius]]||<b>[[Getting_Started#Selecting_specific_resources|exotic]]</b>&nbsp;job&nbsp;type||2021-11-18||1||2||AMD EPYC 7742||64&nbsp;cores/CPU||x86_64||1.0&nbsp;TiB||data-sort-value="17880"|<b>1.92&nbsp;TB&nbsp;SSD</b> +&nbsp;1.92&nbsp;TB&nbsp;SSD +&nbsp;4&nbsp;x&nbsp;3.84&nbsp;TB&nbsp;SSD||data-sort-value="100000"|100&nbsp;Gbps&nbsp;||8&nbsp;x&nbsp;Nvidia A100&nbsp;(40&nbsp;GiB)
|-
|-
|[[#sagittaire|sagittaire]]||||2006-07-01||21||2&nbsp;x&nbsp;AMD&nbsp;Opteron&nbsp;250||1&nbsp;core/CPU||2&nbsp;GiB||data-sort-value="68"|<b>73&nbsp;GB&nbsp;HDD</b>||data-sort-value="1000"|1&nbsp;Gbps&nbsp;||
|[[#taurus|taurus]]||||2012-09-14||12||2||Intel Xeon E5-2630||6&nbsp;cores/CPU||x86_64||32&nbsp;GiB||data-sort-value="278"|<b>299&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||
|-
|-
|[[#taurus|taurus]]||||2012-09-14||14||2&nbsp;x&nbsp;Intel&nbsp;Xeon&nbsp;E5-2630||6&nbsp;cores/CPU||32&nbsp;GiB||data-sort-value="557"|<b>598&nbsp;GB&nbsp;HDD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
|}
|}
''*: disk is [[Disk_reservation|reservable]]''
''*: disk is [[Disk_reservation|reservable]]''
= Clusters in default queue =


== gemini ==
''**: crossed GPUs are not supported by Grid'5000 default environments''
= Clusters in the [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/ default queue] =
 
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=gemini%20only gemini] ==


'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])
'''2 nodes, 4 cpus, 80 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/gemini/nodes.json?pretty=1 json])
Line 43: Line 62:
'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='gemini'"</code> <code>-I</code>}}
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p gemini</code> <code>-I</code>}}


{|
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
Line 61: Line 83:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 480&nbsp;GB SSD SAS Samsung SAMSUNG MZ7KM480 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0)  (primary disk)<br />
* disk0, 480&nbsp;GB SSD SATA Samsung SAMSUNG MZ7KM480 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0</code>)  (primary disk)<br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdb*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) [[Disk_reservation|(reservable)]] <br />
* disk1, 1.92&nbsp;TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0</code>) [[Disk_reservation|(reservable)]] <br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdc*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) [[Disk_reservation|(reservable)]] <br />
* disk2, 1.92&nbsp;TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0</code>) [[Disk_reservation|(reservable)]] <br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sdd*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) [[Disk_reservation|(reservable)]] <br />
* disk3, 1.92&nbsp;TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0</code>) [[Disk_reservation|(reservable)]] <br />
* 1.92&nbsp;TB SSD SAS Samsung SAMSUNG MZ7LM1T9 (dev: /dev/sde*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) [[Disk_reservation|(reservable)]] <br />
* disk4, 1.92&nbsp;TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]], by-path: <code class="file">/dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0</code>) [[Disk_reservation|(reservable)]] <br/>
''*: the disk block device name /dev/sd? may vary in deployed environments, prefer referring to the by-path identifier''<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe<br />
* eth0/enp1s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled<br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br />
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core<br />
Line 78: Line 99:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100-SXM2-32GB<br/>
| 8&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100-SXM2-32GB&nbsp;(32&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;7.0<br/>
|-
|-
|}
|}


== hercule ==
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=hercule%20only hercule] ==


'''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json])
'''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/hercule/nodes.json?pretty=1 json])
Line 88: Line 109:
'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='hercule'"</code> <code>-I</code>}}
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p hercule</code> <code>-I</code>}}


{|
{|
Line 106: Line 127:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1)  (primary disk)<br />
* disk0, 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:1f.2-ata-1</code>)  (primary disk)<br />
* 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2)  <br />
* disk1, 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:1f.2-ata-2</code>)  <br />
* 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/sdc, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3)  <br/>
* disk2, 2.0&nbsp;TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:1f.2-ata-3</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* <span style="color:grey">eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br />
* eth1/enp130s0f1, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe<br />
* eth1/enp130s0f1, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled<br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
* <span style="color:grey">eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
Line 119: Line 140:
|}
|}


== nova ==
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=neowise%20only neowise] ==
 
'''10 nodes, 10 cpus, 480 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/neowise/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p neowise</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| AMD-Penguin Computing<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2021-05-17<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD EPYC 7642 (Zen 2, 1&nbsp;CPU/node, 48&nbsp;cores/CPU)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 512&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 1.92&nbsp;TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:82:00.0-nvme-1</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled<br />
* eth1/eno2, Ethernet, configured rate: 10&nbsp;Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled - no KaVLAN<br />
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br />
* ib1, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 8&nbsp;x&nbsp;AMD Radeon&nbsp;Instinct&nbsp;MI50&nbsp;32GB&nbsp;(32&nbsp;GiB)<br/>
|-
|}
 
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=nova%20only nova] ==


'''23 nodes, 46 cpus, 368 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes.json?pretty=1 json])
'''22 nodes, 44 cpus, 352 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/nova/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='nova'"</code> <code>-I</code>}}
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p nova</code> <code>-I</code>}}


{|
{|
Line 142: Line 203:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  598&nbsp;GB HDD SCSI Dell (Raid) PERC H330 Mini (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0)  (primary disk)<br/>
disk0, 598&nbsp;GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp5s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe<br />
* eth0/enp5s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br />
* <span style="color:grey">eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/>
* <span style="color:grey">eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/>
|-
|-
|}
|}


== orion ==
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=orion%20only orion] ==


'''4 nodes, 8 cpus, 48 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/orion/nodes.json?pretty=1 json])
'''3 nodes, 6 cpus, 36 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/orion/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='orion'"</code> <code>-I</code>}}
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p orion</code> <code>-I</code>}}


{|
{|
Line 178: Line 239:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
598&nbsp;GB HDD SCSI Dell (Raid) PERC H710 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)  (primary disk)<br/>
disk0, 299&nbsp;GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp68s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe<br />
* eth0/enp68s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br />
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
Line 190: Line 251:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| Nvidia Tesla&nbsp;M2075<br/>
| <s>Nvidia Tesla&nbsp;M2075&nbsp;(5&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;2.0</s><br>''not supported by Grid'5000 default environments''<br/>
|-
|-
|}
|}


== pyxis ==
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=pyxis%20only pyxis] ==


'''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json])
'''4 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/pyxis/nodes.json?pretty=1 json])
Line 200: Line 261:
'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p "cluster='pyxis'"</code> <code>-I</code>}}
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p pyxis</code> <code>-I</code>}}


{|
{|
Line 221: Line 282:
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  
|  
* 250&nbsp;GB SSD SATA Samsung Samsung SSD 860 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy2-lun-0)  (primary disk)<br />
* disk0, 250&nbsp;GB SSD SATA Samsung Samsung SSD 860 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:0f:00.0-sas-phy2-lun-0</code>)  (primary disk)<br />
* 250&nbsp;GB SSD SATA Samsung Samsung SSD 860 (dev: /dev/sdb, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy3-lun-0)  <br/>
* disk1, 250&nbsp;GB SSD SATA Samsung Samsung SSD 860 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:0f:00.0-sas-phy3-lun-0</code>)  <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede<br />
* eth0/eno1, Ethernet, configured rate: 10&nbsp;Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled<br />
* <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br />
* <span style="color:grey">eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment</span><br />
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/>
* ib0, InfiniBand, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br/>
Line 232: Line 293:
|}
|}


== sagittaire ==
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sagittaire%20only sagittaire] ==


'''21 nodes, 42 cpus, 42 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json])
'''10 nodes, 20 cpus, 20 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sagittaire/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='sagittaire'"</code> <code>-I</code>}}
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p sagittaire</code> <code>-I</code>}}


; sagittaire-[1,<wbr>17,<wbr>24] (3 nodes, 6 cpus, 6 cores)
; sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
{|
{|
|-
|-
Line 256: Line 317:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  73&nbsp;GB HDD SCSI Fujitsu MAT3073NC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk)<br/>
disk0, 73&nbsp;GB HDD SCSI Seagate ST373307LC (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br />
* eth1/enp2s2f1, Ethernet, configured rate: 1&nbsp;Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/>
* eth1/enp2s2f1, Ethernet, configured rate: 1&nbsp;Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />
<hr style="height:10pt; visibility:hidden;" />


; sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
; sagittaire-[2-5,<wbr>13-16] (8 nodes, 16 cpus, 16 cores)
{|
{|
|-
|-
Line 282: Line 343:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  73&nbsp;GB HDD SCSI Seagate ST373307LC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk)<br/>
disk0, 73&nbsp;GB HDD SCSI Seagate ST373207LC (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br />
* <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br />
* eth1/enp2s2f1, Ethernet, configured rate: 1&nbsp;Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/>
* eth1/enp2s2f1, Ethernet, configured rate: 1&nbsp;Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/>
|-
|-
|}
|}
<hr style="height:10pt; visibility:hidden;" />


; sagittaire-[2-6,<wbr>13-16,<wbr>18-20,<wbr>27,<wbr>29-31] (16 nodes, 32 cpus, 32 cores)
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=sirius%20only sirius] ==
 
'''1 node, 2 cpus, 128 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/sirius/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p sirius</code> <code>-I</code>}}
 
{|
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| exotic job type<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| Sun Fire V20z<br/>
| NVidia DGX A100<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2006-07-01<br/>
| 2021-11-18<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| AMD Opteron 250 (K8, 2&nbsp;CPUs/node, 1&nbsp;core/CPU)<br/>
| AMD EPYC 7742 (Zen 2, 2&nbsp;CPUs/node, 64&nbsp;cores/CPU)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 2&nbsp;GiB<br/>
| 1.0&nbsp;TiB<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
73&nbsp;GB HDD SCSI Seagate ST373207LC (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0)  (primary disk)<br/>
|  
* disk0, 1.92&nbsp;TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:22:00.0-nvme-1</code>) (primary disk)<br />
* disk1, 1.92&nbsp;TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: <code class="file">/dev/disk1</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:23:00.0-nvme-1</code>)  <br />
* disk2, 3.84&nbsp;TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk2</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:09:00.0-nvme-1</code>)  <br />
* disk3, 3.84&nbsp;TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk3</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:52:00.0-nvme-1</code>)  <br />
* disk4, 3.84&nbsp;TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk4</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:ca:00.0-nvme-1</code><br />
* disk5, 3.84&nbsp;TB SSD NVME Kioxia KCM6DRUL3T84 (dev: <code class="file">/dev/disk5</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:8a:00.0-nvme-1</code>) <br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* <span style="color:grey">eth0/enp2s2f0, Ethernet, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment</span><br />
* eth0/enp225s0f0np0, Ethernet, configured rate: 100&nbsp;Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core<br />
* eth1/enp2s2f1, Ethernet, configured rate: 1&nbsp;Gbps, model: Broadcom NetXtreme BCM5704 Gigabit Ethernet, driver: tg3<br/>
* <span style="color:grey">eth1/enp226s0, Ethernet, model: Intel I210 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth2/enp225s0f1np1, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib1, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib2, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib3, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib4, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib5, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib6, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br />
* <span style="color:grey">ib7, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment</span><br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| 8&nbsp;x&nbsp;Nvidia A100-SXM4-40GB&nbsp;(40&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.0<br/>
|-
|-
|}
|}


== taurus ==
== [https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?filter=taurus%20only taurus] ==


'''14 nodes, 28 cpus, 168 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])
'''12 nodes, 24 cpus, 144 cores''' ([https://public-api.grid5000.fr/stable/sites/lyon/clusters/taurus/nodes.json?pretty=1 json])


'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p "cluster='taurus'"</code> <code>-I</code>}}
{{Term|location=flyon|cmd=<code class="command">oarsub</code> <code class="env">-p taurus</code> <code>-I</code>}}


{|
{|
Line 340: Line 428:
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
598&nbsp;GB HDD SCSI Dell (Raid) PERC H710 (dev: /dev/sda, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0)  (primary disk)<br/>
disk0, 299&nbsp;GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0</code>)  (primary disk)<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|  
|  
* eth0/enp68s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe<br />
* eth0/enp68s0f0, Ethernet, configured rate: 10&nbsp;Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled<br />
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
* <span style="color:grey">eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br />
Line 351: Line 439:
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
* <span style="color:grey">eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment</span><br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2020-12-17 ([https://github.com/grid5000/reference-repository/commit/7a21cf4c8 commit 7a21cf4c8])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2022-09-28 ([https://github.com/grid5000/reference-repository/commit/c2546dd443 commit c2546dd443])</small>''

Revision as of 09:07, 28 September 2022

See also: Network topology for Lyon

Summary

  • 9 clusters
  • 68 nodes
  • 1544 CPU cores
  • 107 GPUs
  • 9.99 TiB RAM
  • 34 SSDs and 59 HDDs on nodes (total: 99.14 TB)
  • 43.8 TFLOPS (excluding GPUs)

Clusters

Cluster Access Condition Date of arrival Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
gemini exotic job type 2019-09-01 2 2 Intel Xeon E5-2698 v4 20 cores/CPU x86_64 512 GiB 480 GB SSD + 4 x 1.92 TB SSD* 10 Gbps (SR‑IOV) + 3 x 100 Gbps InfiniBand 8 x Nvidia Tesla V100 (32 GiB)
hercule 2012-10-02 4 2 Intel Xeon E5-2620 6 cores/CPU x86_64 32 GiB 2.0 TB HDD + 2 x 2.0 TB HDD 10 Gbps (SR‑IOV) 
neowise exotic job type 2021-05-17 10 1 AMD EPYC 7642 48 cores/CPU x86_64 512 GiB 1.92 TB SSD 2 x 10 Gbps (SR‑IOV) + 2 x 100 Gbps InfiniBand 8 x AMD MI50 (32 GiB)
nova 2016-12-01 22 2 Intel Xeon E5-2620 v4 8 cores/CPU x86_64 64 GiB 598 GB HDD 10 Gbps (SR‑IOV) 
orion 2012-09-14 3 2 Intel Xeon E5-2630 6 cores/CPU x86_64 32 GiB 299 GB HDD 10 Gbps (SR‑IOV)  Nvidia Tesla M2075 (5 GiB)**
pyxis exotic job type 2020-01-06 4 2 ThunderX2 99xx 32 cores/CPU aarch64 256 GiB 250 GB SSD + 250 GB SSD 10 Gbps (SR‑IOV) + 100 Gbps InfiniBand
sagittaire 2006-07-01 10 2 AMD Opteron 250 1 core/CPU x86_64 2 GiB 73 GB HDD 1 Gbps 
sirius exotic job type 2021-11-18 1 2 AMD EPYC 7742 64 cores/CPU x86_64 1.0 TiB 1.92 TB SSD + 1.92 TB SSD + 4 x 3.84 TB SSD 100 Gbps  8 x Nvidia A100 (40 GiB)
taurus 2012-09-14 12 2 Intel Xeon E5-2630 6 cores/CPU x86_64 32 GiB 299 GB HDD 10 Gbps (SR‑IOV) 

*: disk is reservable

**: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the default queue

gemini

2 nodes, 4 cpus, 80 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -t exotic -p gemini -I
Access condition: exotic job type
Model: Nvidia DGX-1
Date of arrival: 2019-09-01
CPU: Intel Xeon E5-2698 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 20 cores/CPU)
Memory: 512 GiB
Storage:
  • disk0, 480 GB SSD SATA Samsung SAMSUNG MZ7KM480 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:14:0) (primary disk)
  • disk1, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:15:0) (reservable)
  • disk2, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:16:0) (reservable)
  • disk3, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:17:0) (reservable)
  • disk4, 1.92 TB SSD SATA Samsung SAMSUNG MZ7LM1T9 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:81:00.0-scsi-0:0:18:0) (reservable)
Network:
  • eth0/enp1s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe, SR-IOV enabled
  • eth1/enp1s0f1, Ethernet, model: Intel Ethernet Controller 10-Gigabit X540-AT2, driver: ixgbe - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • ib2, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core
  • ib3, InfiniBand, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core - unavailable for experiment
GPU: 8 x Nvidia Tesla V100-SXM2-32GB (32 GiB)
Compute capability: 7.0

hercule

4 nodes, 8 cpus, 48 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -p hercule -I
Model: Dell PowerEdge C6220
Date of arrival: 2012-10-02
CPU: Intel Xeon E5-2620 (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage:
  • disk0, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-1) (primary disk)
  • disk1, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-2)
  • disk2, 2.0 TB HDD SATA Western Digital WDC WD2003FYYS-1 (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:00:1f.2-ata-3)
Network:
  • eth0/enp130s0f0, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment
  • eth1/enp130s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

neowise

10 nodes, 10 cpus, 480 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -t exotic -p neowise -I
Access condition: exotic job type
Model: AMD-Penguin Computing
Date of arrival: 2021-05-17
CPU: AMD EPYC 7642 (Zen 2, 1 CPU/node, 48 cores/CPU)
Memory: 512 GiB
Storage: disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:82:00.0-nvme-1) (primary disk)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Mellanox Technologies MT27710 Family [ConnectX-4 Lx], driver: mlx5_core, SR-IOV enabled - no KaVLAN
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core
  • ib1, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core
GPU: 8 x AMD Radeon Instinct MI50 32GB (32 GiB)

nova

22 nodes, 44 cpus, 352 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -p nova -I
Model: Dell PowerEdge R430
Date of arrival: 2016-12-01
CPU: Intel Xeon E5-2620 v4 (Broadwell, 2.10GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 64 GiB
Storage: disk0, 598 GB HDD RAID-0 (2 disks) Dell PERC H330 Mini (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:01:00.0-scsi-0:2:0:0) (primary disk)
Network:
  • eth0/enp5s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled
  • eth1/enp5s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

orion

3 nodes, 6 cpus, 36 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -p orion -I
Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: Nvidia Tesla M2075 (5 GiB)
Compute capability: 2.0

not supported by Grid'5000 default environments

pyxis

4 nodes, 8 cpus, 256 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -t exotic -p pyxis -I
Access condition: exotic job type
Model: R181-T92-00
Date of arrival: 2020-01-06
CPU: ThunderX2 99xx (Vulcan, 2 CPUs/node, 32 cores/CPU)
Memory: 256 GiB
Storage:
  • disk0, 250 GB SSD SATA Samsung Samsung SSD 860 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy2-lun-0) (primary disk)
  • disk1, 250 GB SSD SATA Samsung Samsung SSD 860 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:0f:00.0-sas-phy3-lun-0)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede, SR-IOV enabled
  • eth1/eno2, Ethernet, model: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller, driver: qede - unavailable for experiment
  • ib0, InfiniBand, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core

sagittaire

10 nodes, 20 cpus, 20 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png flyon:
oarsub -p sagittaire -I
sagittaire-[11-12] (2 nodes, 4 cpus, 4 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: disk0, 73 GB HDD SCSI Seagate ST373307LC (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

sagittaire-[2-5,13-16] (8 nodes, 16 cpus, 16 cores)
Model: Sun Fire V20z
Date of arrival: 2006-07-01
CPU: AMD Opteron 250 (K8, 2 CPUs/node, 1 core/CPU)
Memory: 2 GiB
Storage: disk0, 73 GB HDD SCSI Seagate ST373207LC (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:04.0-scsi-0:0:1:0) (primary disk)
Network:
  • eth0/enp2s2f0, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3 - unavailable for experiment
  • eth1/enp2s2f1, Ethernet, configured rate: 1 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme BCM5704 Gigabit Ethernet, driver: tg3

sirius

1 node, 2 cpus, 128 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -t exotic -p sirius -I
Access condition: exotic job type
Model: NVidia DGX A100
Date of arrival: 2021-11-18
CPU: AMD EPYC 7742 (Zen 2, 2 CPUs/node, 64 cores/CPU)
Memory: 1.0 TiB
Storage:
  • disk0, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:22:00.0-nvme-1) (primary disk)
  • disk1, 1.92 TB SSD NVME Samsung SAMSUNG MZ1LB1T9HALS-00007 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:23:00.0-nvme-1)
  • disk2, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:09:00.0-nvme-1)
  • disk3, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: /dev/disk3, by-path: /dev/disk/by-path/pci-0000:52:00.0-nvme-1)
  • disk4, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:ca:00.0-nvme-1)
  • disk5, 3.84 TB SSD NVME Kioxia KCM6DRUL3T84 (dev: /dev/disk5, by-path: /dev/disk/by-path/pci-0000:8a:00.0-nvme-1)
Network:
  • eth0/enp225s0f0np0, Ethernet, configured rate: 100 Gbps, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core
  • eth1/enp226s0, Ethernet, model: Intel I210 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth2/enp225s0f1np1, Ethernet, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib0, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib1, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib2, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib3, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib4, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib5, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib6, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
  • ib7, InfiniBand, model: Mellanox Technologies MT28908 Family [ConnectX-6], driver: mlx5_core - unavailable for experiment
GPU: 8 x Nvidia A100-SXM4-40GB (40 GiB)
Compute capability: 8.0

taurus

12 nodes, 24 cpus, 144 cores (json)

Reservation example:

Terminal.png flyon:
oarsub -p taurus -I
Model: Dell PowerEdge R720
Date of arrival: 2012-09-14
CPU: Intel Xeon E5-2630 (Sandy Bridge, 2.30GHz, 2 CPUs/node, 6 cores/CPU)
Memory: 32 GiB
Storage: disk0, 299 GB HDD RAID-0 (1 disk) Dell PERC H710 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0) (primary disk)
Network:
  • eth0/enp68s0f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe, SR-IOV enabled
  • eth1/enp68s0f1, Ethernet, model: Intel Ethernet 10G 2P X520 Adapter, driver: ixgbe - unavailable for experiment
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

Last generated from the Grid'5000 Reference API on 2022-09-28 (commit c2546dd443)