Lille:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
 
Line 10: Line 10:
* 352256 GPUs cores
* 352256 GPUs cores
* 10.0 TiB RAM
* 10.0 TiB RAM
* 75 SSDs and 46 HDDs on nodes (total: 317.82 TB)
* 75 SSDs and 45 HDDs on nodes (total: 313.82 TB)
* 58.9 TFLOPS (excluding GPUs)
* 58.9 TFLOPS (excluding GPUs)


Line 34: Line 34:
|-
|-


|[[#chiclet|chiclet]]||||2018-08-06||2018-07-27||debian13||8||2||AMD EPYC 7301||16&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="7899"|[1-7]: <b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]<br />8: <b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||
|[[#chiclet|chiclet]]||||2018-08-06||2018-07-27||debian13||8||2||AMD EPYC 7301||16&nbsp;cores/CPU||x86_64||data-sort-value="137438953472"|128&nbsp;GiB||data-sort-value="7899"|[1-5,<wbr>7]: <b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;2&nbsp;x&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]<br />[6,<wbr>8]: <b>480&nbsp;GB&nbsp;SSD</b> +&nbsp;4.0&nbsp;TB&nbsp;HDD[[Disk_reservation|*]]||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;||
|-
|-
|[[#chicoree|chicoree]]||<b>[[Exotic#Lille:_chicoree|exotic]]</b>&nbsp;job&nbsp;type||2026-04-03||2026-03-04||debian13||1||2||Intel Xeon 6530P||32&nbsp;cores/CPU||x86_64||data-sort-value="1099511627776"|1.0&nbsp;TiB||data-sort-value="11920"|<b>3.2&nbsp;TB&nbsp;SSD</b> +&nbsp;3&nbsp;x&nbsp;3.2&nbsp;TB&nbsp;SSD||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||4&nbsp;x&nbsp;Nvidia h200&nbsp;(140&nbsp;GiB)
|[[#chicoree|chicoree]]||<b>[[Exotic#Lille:_chicoree|exotic]]</b>&nbsp;job&nbsp;type||2026-04-03||2026-03-04||debian13||1||2||Intel Xeon 6530P||32&nbsp;cores/CPU||x86_64||data-sort-value="1099511627776"|1.0&nbsp;TiB||data-sort-value="11920"|<b>3.2&nbsp;TB&nbsp;SSD</b> +&nbsp;3&nbsp;x&nbsp;3.2&nbsp;TB&nbsp;SSD||data-sort-value="50000"|2&nbsp;x&nbsp;25&nbsp;Gbps&nbsp;(SR&#8209;IOV)&nbsp;||4&nbsp;x&nbsp;Nvidia h200&nbsp;(140&nbsp;GiB)
Line 58: Line 58:
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p chiclet</code> <code>-I</code>}}
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p chiclet</code> <code>-I</code>}}


; chiclet-[1-7] (7 nodes, 14 cpus, 224 cores)
; chiclet-[1-5,<wbr>7] (6 nodes, 12 cpus, 192 cores)
{|
{|
|-
|-
Line 93: Line 93:
<hr style="height:10pt; visibility:hidden;" />
<hr style="height:10pt; visibility:hidden;" />


; chiclet-8 (1 node, 2 cpus, 32 cores)
; chiclet-[6,<wbr>8] (2 nodes, 4 cpus, 64 cores)
{|
{|
|-
|-
Line 512: Line 512:
| 4&nbsp;x&nbsp;Nvidia A100-SXM4-40GB&nbsp;(40&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.0<br/>
| 4&nbsp;x&nbsp;Nvidia A100-SXM4-40GB&nbsp;(40&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;8.0<br/>
|-
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2026-09-22 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/a8541e9976 commit a8541e9976])</small>''
|}''<small>Last generated from the Grid'5000 Reference API on 2026-09-29 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/11bbcacd4e commit 11bbcacd4e])</small>''

Latest revision as of 09:16, 29 September 2026

Hardware: Global | Bordeaux | Grenoble | Lille | Louvain | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

See also: Network topology for Lille

Summary

  • 5 clusters
  • 30 nodes
  • 1088 CPU cores
  • 52 GPUs
  • 352256 GPUs cores
  • 10.0 TiB RAM
  • 75 SSDs and 45 HDDs on nodes (total: 313.82 TB)
  • 58.9 TFLOPS (excluding GPUs)

Clusters summary

Cluster Access Condition Date of arrival Manufacturing date Default env. Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
chiclet 2018-08-06 2018-07-27 debian13 8 2 AMD EPYC 7301 16 cores/CPU x86_64 128 GiB [1-5,7]: 480 GB SSD + 2 x 4.0 TB HDD*
[6,8]: 480 GB SSD + 4.0 TB HDD*		 2 x 25 Gbps 
chicoree exotic job type 2026-04-03 2026-03-04 debian13 1 2 Intel Xeon 6530P 32 cores/CPU x86_64 1.0 TiB 3.2 TB SSD + 3 x 3.2 TB SSD 2 x 25 Gbps (SR‑IOV)  4 x Nvidia h200 (140 GiB)
chifflot 2018-08-01 2018-07-17 debiannvlegacy13 8 2 Intel Xeon Gold 6126 12 cores/CPU x86_64 192 GiB [1,3-8]: 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD*
2: 480 GB SSD + 480 GB SSD* + 3 x 4.0 TB HDD*		 [1-2,5-8]: 2 x 25 Gbps 
[3-4]: 25 Gbps 		 [1-6]: 2 x Nvidia Tesla P100 (16 GiB)
[7-8]: 2 x Nvidia Tesla V100 (32 GiB)
chirop 2024-01-25 2023-05-02 debian13 5 2 Intel Xeon Platinum 8358 32 cores/CPU x86_64 512 GiB 1.92 TB SSD + 2 x 3.84 TB SSD 2 x 25 Gbps 
chuc 2024-01-22 2023-05-02 debian13 8 1 AMD EPYC 7513 32 cores/CPU x86_64 512 GiB 1.92 TB SSD + 3 x 1.92 TB SSD 2 x 25 Gbps (SR‑IOV)  4 x Nvidia A100 (40 GiB)

*: disk is reservable

**: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the default queue

chiclet

8 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png flille:
oarsub -q default -p chiclet -I
chiclet-[1-5,7] (6 nodes, 12 cpus, 192 cores)
Model: Dell PowerEdge R7425
Manufacturing date: 2018-07-27
Date of arrival: 2018-08-06
Default environment: debian13
CPU: AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: /dev/disk0) (primary disk)
  • disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
Network:
  • eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
chiclet-[6,8] (2 nodes, 4 cpus, 64 cores)
Model: Dell PowerEdge R7425
Manufacturing date: 2018-07-27
Date of arrival: 2018-08-06
Default environment: debian13
CPU: AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU
Memory: 128 GiB
Storage:
  • disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: /dev/disk0) (primary disk)
  • disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk1*) (reservable)
Network:
  • eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)

chicoree

1 node, 2 cpus, 64 cores (json)

Reservation example:

Terminal.png flille:
oarsub -q default -t exotic -p chicoree -I
Access condition: exotic job type
Model: Proliant DL380a Gen12
Manufacturing date: 2026-03-04
Date of arrival: 2026-04-03
Default environment: debian13
CPU: Intel Xeon 6530P (Granite Rapids), x86_64, 2 CPUs/node, 32 cores/CPU
Memory: 1.0 TiB
Storage:
  • disk0, 3.2 TB SSD NVME HP MO003200KYDNC (dev: /dev/disk0) (primary disk)
  • disk1, 3.2 TB SSD NVME HP MO003200KYDNC (dev: /dev/disk1)
  • disk2, 3.2 TB SSD NVME HP MO003200KYDNC (dev: /dev/disk2)
  • disk3, 3.2 TB SSD NVME HP MO003200KYDNC (dev: /dev/disk3)
Network:
  • eth0/enp1s0f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core, SR-IOV enabled
  • eth1/enP1s27f1np1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT2894 Family [ConnectX-6 Lx], driver: mlx5_core, SR-IOV enabled (multi NICs example)
GPU: 4 x Nvidia H200 NVL (140 GiB)
Compute capability: 9.0

Note: This cluster is defined as exotic. Please read the exotic page for more information.

chifflot

8 nodes, 16 cpus, 192 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png flille:
oarsub -q default -p chifflot -I
chifflot-[1,5] (2 nodes, 4 cpus, 48 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
Default environment: debiannvlegacy13
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-2 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
Default environment: debiannvlegacy13
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-3 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
Default environment: debiannvlegacy13
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-4 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
Default environment: debiannvlegacy13
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-6 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
Default environment: debiannvlegacy13
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG08SDA400NY (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-[7-8] (2 nodes, 4 cpus, 48 cores)
Model: Dell PowerEdge R740
Manufacturing date: 2018-07-17
Date of arrival: 2018-08-01
Default environment: debiannvlegacy13
CPU: Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*) (reservable)
  • disk2, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk2*) (reservable)
  • disk3, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk3*) (reservable)
  • disk4, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk4*) (reservable)
  • disk5, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk5*) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
GPU: 2 x Nvidia Tesla V100-PCIE-32GB (32 GiB)
Compute capability: 7.0

chirop

5 nodes, 10 cpus, 320 cores (json)

Reservation example:

Terminal.png flille:
oarsub -q default -p chirop -I
Model: DL360 Gen10+
Manufacturing date: 2023-05-02
Date of arrival: 2024-01-25
Default environment: debian13
CPU: Intel Xeon Platinum 8358 (Ice Lake-SP), x86_64, 2.60GHz, 2 CPUs/node, 32 cores/CPU
Memory: 512 GiB
Storage:
  • disk0, 1.92 TB SSD NVME Kioxia KCD6XLUL1T92 (dev: /dev/disk0) (primary disk)
  • disk1, 3.84 TB SSD SATA HP VK003840GWSRV (dev: /dev/disk1)
  • disk2, 3.84 TB SSD SATA HP VK003840GWSRV (dev: /dev/disk2)
Network:
  • eth0/ens10f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en
  • eth1/ens10f1np1, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en (multi NICs example)

chuc

8 nodes, 8 cpus, 256 cores (json)

Reservation example:

Terminal.png flille:
oarsub -q default -p chuc -I
Model: Apollo 6500 Gen10 Plus
Manufacturing date: 2023-05-02
Date of arrival: 2024-01-22
Default environment: debian13
CPU: AMD EPYC 7513 (Zen 3), x86_64, 1 CPU/node, 32 cores/CPU
Memory: 512 GiB
Storage:
  • disk0, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk0) (primary disk)
  • disk1, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk1)
  • disk2, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk2)
  • disk3, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: /dev/disk3)
Network:
  • eth0/ens15f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled
  • eth1/ens15f1np1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled (multi NICs example)
GPU: 4 x Nvidia A100-SXM4-40GB (40 GiB)
Compute capability: 8.0

Last generated from the Grid'5000 Reference API on 2026-09-29 (commit 11bbcacd4e)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Lille:Hardware&oldid=109410"