Lille:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
← Older editNewer edit →
No edit summary
No edit summary
Line 38: Line 38:
|[[#chifflot|chifflot]]||||2018-08-01||2018-07-17||8||2||Intel Xeon Gold 6126||12&nbsp;cores/CPU||x86_64||192&nbsp;GiB||data-sort-value="15798"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD[[Disk_reservation|*]] +&nbsp;4&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||[1-6]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100&nbsp;(16&nbsp;GiB)<br />[7-8]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100&nbsp;(32&nbsp;GiB)
|[[#chifflot|chifflot]]||||2018-08-01||2018-07-17||8||2||Intel Xeon Gold 6126||12&nbsp;cores/CPU||x86_64||192&nbsp;GiB||data-sort-value="15798"|<b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;480&nbsp;GB&nbsp;SSD[[Disk_reservation|*]] +&nbsp;4&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||[1-6]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;P100&nbsp;(16&nbsp;GiB)<br />[7-8]: 2&nbsp;x&nbsp;Nvidia Tesla&nbsp;V100&nbsp;(32&nbsp;GiB)
|-
|-
|[[#chirop|chirop]]||<b>testing</b>&nbsp;queue||2024-01-25||2023-05-02||5||2||Intel Xeon Platinum 8358||32&nbsp;cores/CPU||x86_64||512&nbsp;GiB||data-sort-value="8940"|<b>1.92&nbsp;TB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;3.84&nbsp;TB&nbsp;SSD||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||
|[[#chirop|chirop]]||||2024-01-25||2023-05-02||5||2||Intel Xeon Platinum 8358||32&nbsp;cores/CPU||x86_64||512&nbsp;GiB||data-sort-value="8940"|<b>1.92&nbsp;TB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;3.84&nbsp;TB&nbsp;SSD||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||
|-
|-
|}
|}
Line 304: Line 304:
|-
|-
|}
|}
= Clusters in the testing queue =


== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chirop%20only chirop] ==
== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chirop%20only chirop] ==
Line 313: Line 311:
'''Reservation example:'''
'''Reservation example:'''


{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p chirop</code> <code>-I</code>}}
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="env">-p chirop</code> <code>-I</code>}}


{|
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
| testing queue<br/>
|-
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
Line 346: Line 341:
* eth1/ens10f1np1, Ethernet, configured rate: 25&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN<br/>
* eth1/ens10f1np1, Ethernet, configured rate: 25&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-01-22 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/af8ac67538 commit af8ac67538])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2024-02-13 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/f5599ab232 commit f5599ab232])</small>''

Revision as of 12:45, 13 February 2024

Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Toulouse

See also: Network topology for Lille

Summary

  • 3 clusters
  • 21 nodes
  • 768 CPU cores
  • 16 GPUs
  • 63488 GPUs cores
  • 5.0 TiB RAM
  • 39 SSDs and 48 HDDs on nodes (total: 251.57 TB)
  • 47.1 TFLOPS (excluding GPUs)

Clusters

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
chiclet 2018-08-06 2018-07-27 8 2 AMD EPYC 7301 16 cores/CPU x86_64 128 GiB 480 GB SSD + 2 x 4.0 TB HDD* 2 x 25 Gbps 
chifflot 2018-08-01 2018-07-17 8 2 Intel Xeon Gold 6126 12 cores/CPU x86_64 192 GiB 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100 (16 GiB)
[7-8]: 2 x Nvidia Tesla V100 (32 GiB)
chirop 2024-01-25 2023-05-02 5 2 Intel Xeon Platinum 8358 32 cores/CPU x86_64 512 GiB 1.92 TB SSD + 2 x 3.84 TB SSD 2 x 25 Gbps 

*: disk is reservable

**: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the default queue

chiclet

8 nodes, 16 cpus, 256 cores (json)

Reservation example:

flille:
oarsub -p chiclet -I
Model: Dell PowerEdge R7425
Manufacturing date: 2018-07-27
Date of arrival: 2018-08-06
CPU: AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:2:0) (reservable)
Network:
  • eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

chifflot

8 nodes, 16 cpus, 192 cores, split as follows due to differences between nodes (json)

Reservation example:

flille:
oarsub -p chifflot -I
chifflot-[1,4-5] (3 nodes, 6 cpus, 72 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-2 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-3 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-6 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG08SDA400NY (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-[7-8] (2 nodes, 4 cpus, 48 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla V100-PCIE-32GB (32 GiB)
Compute capability: 7.0

chirop

5 nodes, 10 cpus, 320 cores (json)

Reservation example:

flille:
oarsub -p chirop -I
Model: DL360 Gen10+
Manufacturing date: 2023-05-02
Date of arrival: 2024-01-25
CPU: Intel Xeon Platinum 8358 (Ice Lake), x86_64, 2.60GHz, 2 CPUs/node, 32 cores/CPU
Memory: 512 GiB
Storage:
  • disk0, 1.92 TB SSD NVME Kioxia KCD6XLUL1T92 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:47:00.0-scsi-0:2:1:0) (primary disk)
  • disk1, 3.84 TB SSD SATA HP VK003840GWSRV (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:47:00.0-scsi-0:2:2:0)
  • disk2, 3.84 TB SSD SATA HP VK003840GWSRV (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:47:00.0-scsi-0:2:3:0)
Network:
  • eth0/ens10f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN
  • eth1/ens10f1np1, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN

Last generated from the Grid'5000 Reference API on 2024-02-13 (commit f5599ab232)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Lille:Hardware&oldid=101982"