Lille:Hardware: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
Line 37: | Line 37: | ||
|- | |- | ||
|[[#chifflot|chifflot]]||||2018-08-01||2018-07-17||8||2||Intel Xeon Gold 6126||12 cores/CPU||x86_64||data-sort-value="206158430208"|192 GiB||data-sort-value="15798"|<b>480 GB SSD</b> + 480 GB SSD[[Disk_reservation|*]] + 4 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|[1-2,<wbr>5-8]: 2 x 25 Gbps <br />[3-4]: 25 Gbps ||[1-6]: 2 x Nvidia Tesla P100 (16 GiB)<br />[7-8]: 2 x Nvidia Tesla V100 (32 GiB) | |[[#chifflot|chifflot]]||||2018-08-01||2018-07-17||8||2||Intel Xeon Gold 6126||12 cores/CPU||x86_64||data-sort-value="206158430208"|192 GiB||data-sort-value="15798"|<b>480 GB SSD</b> + 480 GB SSD[[Disk_reservation|*]] + 4 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|[1-2,<wbr>5-8]: 2 x 25 Gbps <br />[3-4]: 25 Gbps ||[1-6]: 2 x Nvidia Tesla P100 (16 GiB)<br />[7-8]: 2 x Nvidia Tesla V100 (32 GiB) | ||
|- | |||
|[[#chirop|chirop]]||||2024-01-25||2023-05-02||5||2||Intel Xeon Platinum 8358||32 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="8940"|<b>1.92 TB SSD</b> + 2 x 3.84 TB SSD||data-sort-value="50000"|2 x 25 Gbps || | |||
|- | |- | ||
|} | |} | ||
Line 61: | Line 63: | ||
|[[#chiconade1|chiconade1]]||<b>testing</b> queue||2025-04-25||2025-04-03||1||1||Intel Xeon Gold 5420+||28 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="745"|<b>800 GB SSD</b>||data-sort-value="50000"|2 x 25 Gbps ||Nvidia Tesla L40S (45 GiB) | |[[#chiconade1|chiconade1]]||<b>testing</b> queue||2025-04-25||2025-04-03||1||1||Intel Xeon Gold 5420+||28 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="745"|<b>800 GB SSD</b>||data-sort-value="50000"|2 x 25 Gbps ||Nvidia Tesla L40S (45 GiB) | ||
|- | |- | ||
|[[#chuc|chuc]]||<b>testing</b> queue||2024-01-22||2023-05-02||8||1||AMD EPYC 7513||32 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7152"|<b>1.92 TB SSD</b> + 3 x 1.92 TB SSD||data-sort-value="50000"|2 x 25 Gbps (SR‑IOV) ||4 x Nvidia A100 (40 GiB) | |[[#chuc|chuc]]||<b>testing</b> queue||2024-01-22||2023-05-02||8||1||AMD EPYC 7513||32 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7152"|<b>1.92 TB SSD</b> + 3 x 1.92 TB SSD||data-sort-value="50000"|2 x 25 Gbps (SR‑IOV) ||4 x Nvidia A100 (40 GiB) | ||
Line 376: | Line 376: | ||
|} | |} | ||
= | == [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chirop%20only chirop] == | ||
'''5 nodes, 10 cpus, 320 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chirop/nodes.json?pretty=1 json]) | |||
''' | |||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q | {{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p chirop</code> <code>-I</code>}} | ||
{| | {| | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| | | DL360 Gen10+<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | ||
| | | 2023-05-02<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2024-01-25<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Platinum 8358 (Ice Lake-SP), x86_64, 2.60GHz, 2 CPUs/node, 32 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 512 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | | ||
* disk0, 1.92 TB SSD NVME Kioxia KCD6XLUL1T92 (dev: <code class="file">/dev/disk0</code>) (primary disk)<br /> | |||
* disk1, 3.84 TB SSD SATA HP VK003840GWSRV (dev: <code class="file">/dev/disk1</code>) <br /> | |||
* disk2, 3.84 TB SSD SATA HP VK003840GWSRV (dev: <code class="file">/dev/disk2</code>) <br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/ens10f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en<br /> | ||
* eth1/ | * eth1/ens10f1np1, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | ||
| | |||
|- | |- | ||
|} | |} | ||
== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter= | = Clusters in the testing queue = | ||
== [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chiconade1%20only chiconade1] == | |||
''' | '''1 node, 1 cpu, 28 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chiconade1/nodes.json?pretty=1 json]) | ||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p | {{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p chiconade1</code> <code>-I</code>}} | ||
{| | {| | ||
Line 433: | Line 430: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| | | ProLiant DL320 Gen11<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | ||
| | | 2025-04-03<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| | | 2025-04-25<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon | | Intel Xeon Gold 5420+ (Sapphire Rapids), x86_64, 1 CPU/node, 28 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| | | 128 GiB<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| | | disk0, 800 GB SSD NVME HP MO000800KXPRV (dev: <code class="file">/dev/disk0</code>) (primary disk)<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/enp1s0f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN<br /> | ||
* eth1/ | * eth1/ens14f1np1, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - no KaVLAN<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| Nvidia L40S (45 GiB)<br>Compute capability: 8.9<br/> | |||
|- | |- | ||
|} | |} | ||
Line 503: | Line 500: | ||
| 4 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/> | | 4 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on 2025- | |}''<small>Last generated from the Grid'5000 Reference API on 2025-05-05 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/bcb123fd45 commit bcb123fd45])</small>'' |
Latest revision as of 16:20, 5 May 2025
Hardware: Global | Grenoble | Lille | Louvain | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse
See also: Network topology for Lille
Summary
- 5 clusters
- 30 nodes
- 1052 CPU cores
- 49 GPUs
- 302848 GPUs cores
- 9.13 TiB RAM
- 72 SSDs and 47 HDDs on nodes (total: 309.82 TB)
- 59.5 TFLOPS (excluding GPUs)
Clusters summary
Default queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
chiclet | 2018-08-06 | 2018-07-27 | 8 | 2 | AMD EPYC 7301 | 16 cores/CPU | x86_64 | 128 GiB | [1-7]: 480 GB SSD + 2 x 4.0 TB HDD* 8: 480 GB SSD + 4.0 TB HDD* |
2 x 25 Gbps | ||
chifflot | 2018-08-01 | 2018-07-17 | 8 | 2 | Intel Xeon Gold 6126 | 12 cores/CPU | x86_64 | 192 GiB | 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* | [1-2, [3-4]: 25 Gbps |
[1-6]: 2 x Nvidia Tesla P100 (16 GiB) [7-8]: 2 x Nvidia Tesla V100 (32 GiB) | |
chirop | 2024-01-25 | 2023-05-02 | 5 | 2 | Intel Xeon Platinum 8358 | 32 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD + 2 x 3.84 TB SSD | 2 x 25 Gbps |
*: disk is reservable **: crossed GPUs are not supported by Grid'5000 default environments
Testing queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
chiconade1 | testing queue | 2025-04-25 | 2025-04-03 | 1 | 1 | Intel Xeon Gold 5420+ | 28 cores/CPU | x86_64 | 128 GiB | 800 GB SSD | 2 x 25 Gbps | Nvidia Tesla L40S (45 GiB) |
chuc | testing queue | 2024-01-22 | 2023-05-02 | 8 | 1 | AMD EPYC 7513 | 32 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD + 3 x 1.92 TB SSD | 2 x 25 Gbps (SR‑IOV) | 4 x Nvidia A100 (40 GiB) |
*: disk is reservable **: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
chiclet
8 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)
Reservation example:
- chiclet-[1-7] (7 nodes, 14 cpus, 224 cores)
Model: | Dell PowerEdge R7425 |
Manufacturing date: | 2018-07-27 |
Date of arrival: | 2018-08-06 |
CPU: | AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
- chiclet-8 (1 node, 2 cpus, 32 cores)
Model: | Dell PowerEdge R7425 |
Manufacturing date: | 2018-07-27 |
Date of arrival: | 2018-08-06 |
CPU: | AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU |
Memory: | 128 GiB |
Storage: |
|
Network: |
|
chifflot
8 nodes, 16 cpus, 192 cores, split as follows due to differences between nodes (json)
Reservation example:
- chifflot-[1,
5] (2 nodes, 4 cpus, 48 cores)
Model: | Dell PowerEdge R740 |
Manufacturing date: | 2018-07-17 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 |
- chifflot-2 (1 node, 2 cpus, 24 cores)
Model: | Dell PowerEdge R740 |
Manufacturing date: | 2018-07-17 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 |
- chifflot-3 (1 node, 2 cpus, 24 cores)
Model: | Dell PowerEdge R740 |
Manufacturing date: | 2018-07-17 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 |
- chifflot-4 (1 node, 2 cpus, 24 cores)
Model: | Dell PowerEdge R740 |
Manufacturing date: | 2018-07-17 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 |
- chifflot-6 (1 node, 2 cpus, 24 cores)
Model: | Dell PowerEdge R740 |
Manufacturing date: | 2018-07-17 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 |
- chifflot-[7-8] (2 nodes, 4 cpus, 48 cores)
Model: | Dell PowerEdge R740 |
Manufacturing date: | 2018-07-17 |
Date of arrival: | 2018-08-01 |
CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU |
Memory: | 192 GiB |
Storage: |
|
Network: |
|
GPU: | 2 x Nvidia Tesla V100-PCIE-32GB (32 GiB) Compute capability: 7.0 |
chirop
5 nodes, 10 cpus, 320 cores (json)
Reservation example:
Model: | DL360 Gen10+ |
Manufacturing date: | 2023-05-02 |
Date of arrival: | 2024-01-25 |
CPU: | Intel Xeon Platinum 8358 (Ice Lake-SP), x86_64, 2.60GHz, 2 CPUs/node, 32 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
Clusters in the testing queue
chiconade1
1 node, 1 cpu, 28 cores (json)
Reservation example:
Access condition: | testing queue |
Model: | ProLiant DL320 Gen11 |
Manufacturing date: | 2025-04-03 |
Date of arrival: | 2025-04-25 |
CPU: | Intel Xeon Gold 5420+ (Sapphire Rapids), x86_64, 1 CPU/node, 28 cores/CPU |
Memory: | 128 GiB |
Storage: | disk0, 800 GB SSD NVME HP MO000800KXPRV (dev: /dev/disk0 ) (primary disk) |
Network: |
|
GPU: | Nvidia L40S (45 GiB) Compute capability: 8.9 |
chuc
8 nodes, 8 cpus, 256 cores (json)
Reservation example:
Access condition: | testing queue |
Model: | Apollo 6500 Gen10 Plus |
Manufacturing date: | 2023-05-02 |
Date of arrival: | 2024-01-22 |
CPU: | AMD EPYC 7513 (Zen 3), x86_64, 1 CPU/node, 32 cores/CPU |
Memory: | 512 GiB |
Storage: |
|
Network: |
|
GPU: | 4 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0 |
Last generated from the Grid'5000 Reference API on 2025-05-05 (commit bcb123fd45)