Luxembourg:Hardware: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
(34 intermediate revisions by 12 users not shown) | |||
Line 1: | Line 1: | ||
__NOEDITSECTION__ | __NOEDITSECTION__ | ||
{{Portal|User}} | {{Portal|User}} | ||
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | <div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Louvain:Hardware|Louvain]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Strasbourg:Hardware|Strasbourg]] | [[Toulouse:Hardware|Toulouse]]</div> | ||
'''See also:''' [[Luxembourg:Network|Network topology for Luxembourg]] | '''See also:''' [[Luxembourg:Network|Network topology for Luxembourg]] | ||
= Summary = | |||
* 4 clusters | |||
* 67 nodes | |||
* 2252 CPU cores | |||
* 36 GPUs | |||
* 342016 GPUs cores | |||
* 11.84 TiB RAM | |||
* 56 SSDs and 11 HDDs on nodes (total: 34.12 TB) | |||
* 115.8 TFLOPS (excluding GPUs) | |||
= | = Clusters summary = | ||
== Default queue resources == | |||
{|class="wikitable sortable" | {|class="wikitable sortable" | ||
|- | |- | ||
!|Cluster | !rowspan=2|Cluster | ||
!|Access Condition | !rowspan=2|Access Condition | ||
!|Date of arrival | !rowspan=2|Date of arrival | ||
!data-sort-type="number"|Nodes | !rowspan=2|Manufacturing date | ||
!|CPU | !data-sort-type="number" rowspan=2|Nodes | ||
!colspan=4|CPU | |||
!data-sort-type="number" rowspan=2|Memory | |||
!data-sort-type="number" rowspan=2|Storage | |||
!data-sort-type="number" rowspan=2|Network | |||
!rowspan=2|Accelerators | |||
|- | |||
!data-sort-type="number"|# | |||
!|Name | |||
!data-sort-type="number"|Cores | !data-sort-type="number"|Cores | ||
! | !|Architecture | ||
|- | |- | ||
|[[#larochette|larochette]]||||2024-06-24||2024-07-24||7||2||Intel Xeon Platinum 8568Y+||48 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="2980"|<b>3.2 TB SSD</b>||data-sort-value="25000"|25 Gbps ||4 x AMD MI210 (64 GiB) | |||
|- | |||
|[[#petitprince|petitprince]]||||2013-09-10||2012-10-30||11||2||Intel Xeon E5-2630L||6 cores/CPU||x86_64||data-sort-value="34359738368"|32 GiB||data-sort-value="232"|<b>250 GB HDD</b>||data-sort-value="20000"|2 x 10 Gbps || | |||
|- | |||
|[[#vianden|vianden]]||<b>[[Exotic#Luxembourg:_vianden|exotic]]</b> job type||2025-01-06||2024-07-14||1||2||Intel Xeon Platinum 8470||52 cores/CPU||x86_64||data-sort-value="2199023255552"|2.0 TiB||data-sort-value="2980"|<b>3.2 TB SSD</b>||data-sort-value="120000"|2 x 10 Gbps + 100 Gbps ||8 x AMD MI300X (192 GiB) | |||
|- | |||
|} | |} | ||
''**: crossed GPUs are not supported by Grid'5000 default environments'' | |||
== Testing queue resources == | |||
{|class="wikitable sortable" | |||
|- | |||
!rowspan=2|Cluster | |||
!rowspan=2|Access Condition | |||
!rowspan=2|Date of arrival | |||
!rowspan=2|Manufacturing date | |||
!data-sort-type="number" rowspan=2|Nodes | |||
!colspan=4|CPU | |||
!data-sort-type="number" rowspan=2|Memory | |||
!data-sort-type="number" rowspan=2|Storage | |||
!data-sort-type="number" rowspan=2|Network | |||
!rowspan=2|Accelerators | |||
|- | |||
!data-sort-type="number"|# | |||
!|Name | |||
!data-sort-type="number"|Cores | |||
!|Architecture | |||
|- | |||
= | |[[#clervaux|clervaux]]||<b>testing</b> queue||2025-09-01||2016-12-29||48||2||Intel Xeon E5-2680 v4||14 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="111"|<b>120 GB SSD</b>||data-sort-value="10000"|10 Gbps (SR‑IOV) || | ||
|- | |||
|} | |||
''**: crossed GPUs are not supported by Grid'5000 default environments'' | |||
= | = Clusters in the [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/ default queue] = | ||
''' | == [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=larochette%20only larochette] == | ||
'''7 nodes, 14 cpus, 672 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/larochette/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | '''Reservation example:''' | ||
{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="env">-p " | {{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p larochette</code> <code>-I</code>}} | ||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge R760XA<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2024-07-24<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2024-06-24<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon Platinum 8568Y+ (Emerald Rapids), x86_64, 2 CPUs/node, 48 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 512 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| disk0, 3.2 TB SSD SAS Dell Dell NVMe ISE PS (dev: <code class="file">/dev/disk0</code>) (primary disk)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/enp1s0f0np0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice<br /> | |||
* <span style="color:grey">eth1/eno12409, Ethernet, model: Intel Ethernet Controller E810-XXV for SFP, driver: ice - unavailable for experiment</span><br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 4 x AMD Instinct MI210 (64 GiB)<br/> | |||
|- | |||
|} | |||
== [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=petitprince%20only petitprince] == | |||
'''11 nodes, 22 cpus, 132 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/petitprince/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p petitprince</code> <code>-I</code>}} | |||
{| | {| | ||
Line 37: | Line 119: | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| Dell PowerEdge M620<br/> | | Dell PowerEdge M620<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2012-10-30<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
Line 42: | Line 127: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| Intel Xeon E5-2630L (Sandy Bridge, 2.00GHz, 2 CPUs/node, 6 cores/CPU | | Intel Xeon E5-2630L (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU<br/> | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
Line 48: | Line 133: | ||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| 250 GB HDD SATA Seagate ST9250610NS (dev: /dev/ | | disk0, 250 GB HDD SATA Seagate ST9250610NS (dev: <code class="file">/dev/disk0</code>) (primary disk)<br/> | ||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet, driver: bnx2x<br /> | |||
* eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet, driver: bnx2x [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
|- | |||
|} | |||
== [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=vianden%20only vianden] == | |||
'''1 node, 2 cpus, 104 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/vianden/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="replace">-t exotic</code> <code class="env">-p vianden</code> <code>-I</code>}} | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| [[Exotic#Luxembourg:_vianden|exotic]] job type<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge XE9680<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2024-07-14<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2025-01-06<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon Platinum 8470 (Sapphire Rapids), x86_64, 2 CPUs/node, 52 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 2.0 TiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| disk0, 3.2 TB SSD NVME Dell Dell Ent NVMe PM1735a MU 3.2TB (dev: <code class="file">/dev/disk0</code>) (primary disk)<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| | |||
* eth0/enp158s0f0np0, Ethernet, configured rate: 100 Gbps, model: Mellanox Technologies MT2892 Family [ConnectX-6 Dx], driver: mlx5_core<br /> | |||
* <span style="color:grey">eth1/enp158s0f1np1, Ethernet, model: Mellanox Technologies MT2892 Family [ConnectX-6 Dx], driver: mlx5_core - unavailable for experiment</span><br /> | |||
* eth2/enp1s0f0np0, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* eth3/eno12409np1, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br /> | |||
* <span style="color:grey">eth4/eno12419np2, Ethernet, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth5/eno12429np3, Ethernet, model: Broadcom Inc. and subsidiaries BCM57504 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet, driver: bnxt_en - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth6/eno8303, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br /> | |||
* <span style="color:grey">eth7/eno8403, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment</span><br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| 8 x AMD AMD Instinct MI300X (192 GiB)<br/> | |||
|- | |||
|} | |||
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Luxembourg:_vianden|exotic]]''' page for more information.<br/> | |||
= Clusters in the testing queue = | |||
== [https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?filter=clervaux%20only clervaux] == | |||
'''48 nodes, 96 cpus, 1344 cores''' ([https://public-api.grid5000.fr/stable/sites/luxembourg/clusters/clervaux/nodes.json?pretty=1 json]) | |||
'''Reservation example:''' | |||
{{Term|location=fluxembourg|cmd=<code class="command">oarsub</code> <code class="replace">-q testing</code> <code class="env">-p clervaux</code> <code>-I</code>}} | |||
{| | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:''' | |||
| testing queue<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| Dell PowerEdge C6320<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| 2016-12-29<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| 2025-09-01<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| Intel Xeon E5-2680 v4 (Broadwell), x86_64, 2.40GHz, 2 CPUs/node, 14 cores/CPU<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| 128 GiB<br/> | |||
|- | |||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| disk0, 120 GB SSD SATA Intel INTEL SSDSC2BB12 (dev: <code class="file">/dev/disk0</code>) (primary disk)<br/> | |||
|- | |- | ||
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| | | | ||
* eth0/ | * eth0/enp1s0f0np0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled - no KaVLAN<br /> | ||
* eth1/eno2, Ethernet | * <span style="color:grey">eth1/eno2, Ethernet, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe - unavailable for experiment</span><br/> | ||
|- | |- | ||
|}''<small>Last generated from the Grid'5000 Reference API on | |}''<small>Last generated from the Grid'5000 Reference API on 2025-09-02 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/a3c0b2d501 commit a3c0b2d501])</small>'' |
Latest revision as of 16:11, 2 September 2025
Hardware: Global | Grenoble | Lille | Louvain | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse
See also: Network topology for Luxembourg
Summary
- 4 clusters
- 67 nodes
- 2252 CPU cores
- 36 GPUs
- 342016 GPUs cores
- 11.84 TiB RAM
- 56 SSDs and 11 HDDs on nodes (total: 34.12 TB)
- 115.8 TFLOPS (excluding GPUs)
Clusters summary
Default queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
larochette | 2024-06-24 | 2024-07-24 | 7 | 2 | Intel Xeon Platinum 8568Y+ | 48 cores/CPU | x86_64 | 512 GiB | 3.2 TB SSD | 25 Gbps | 4 x AMD MI210 (64 GiB) | |
petitprince | 2013-09-10 | 2012-10-30 | 11 | 2 | Intel Xeon E5-2630L | 6 cores/CPU | x86_64 | 32 GiB | 250 GB HDD | 2 x 10 Gbps | ||
vianden | exotic job type | 2025-01-06 | 2024-07-14 | 1 | 2 | Intel Xeon Platinum 8470 | 52 cores/CPU | x86_64 | 2.0 TiB | 3.2 TB SSD | 2 x 10 Gbps + 100 Gbps | 8 x AMD MI300X (192 GiB) |
**: crossed GPUs are not supported by Grid'5000 default environments
Testing queue resources
Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# | Name | Cores | Architecture | |||||||||
clervaux | testing queue | 2025-09-01 | 2016-12-29 | 48 | 2 | Intel Xeon E5-2680 v4 | 14 cores/CPU | x86_64 | 128 GiB | 120 GB SSD | 10 Gbps (SR‑IOV) |
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
larochette
7 nodes, 14 cpus, 672 cores (json)
Reservation example:
Model: | Dell PowerEdge R760XA |
Manufacturing date: | 2024-07-24 |
Date of arrival: | 2024-06-24 |
CPU: | Intel Xeon Platinum 8568Y+ (Emerald Rapids), x86_64, 2 CPUs/node, 48 cores/CPU |
Memory: | 512 GiB |
Storage: | disk0, 3.2 TB SSD SAS Dell Dell NVMe ISE PS (dev: /dev/disk0 ) (primary disk) |
Network: |
|
GPU: | 4 x AMD Instinct MI210 (64 GiB) |
petitprince
11 nodes, 22 cpus, 132 cores (json)
Reservation example:
Model: | Dell PowerEdge M620 |
Manufacturing date: | 2012-10-30 |
Date of arrival: | 2013-09-10 |
CPU: | Intel Xeon E5-2630L (Sandy Bridge), x86_64, 2.00GHz, 2 CPUs/node, 6 cores/CPU |
Memory: | 32 GiB |
Storage: | disk0, 250 GB HDD SATA Seagate ST9250610NS (dev: /dev/disk0 ) (primary disk) |
Network: |
|
vianden
1 node, 2 cpus, 104 cores (json)
Reservation example:
Access condition: | exotic job type |
Model: | Dell PowerEdge XE9680 |
Manufacturing date: | 2024-07-14 |
Date of arrival: | 2025-01-06 |
CPU: | Intel Xeon Platinum 8470 (Sapphire Rapids), x86_64, 2 CPUs/node, 52 cores/CPU |
Memory: | 2.0 TiB |
Storage: | disk0, 3.2 TB SSD NVME Dell Dell Ent NVMe PM1735a MU 3.2TB (dev: /dev/disk0 ) (primary disk) |
Network: |
|
GPU: | 8 x AMD AMD Instinct MI300X (192 GiB) |
Note: This cluster is defined as exotic. Please read the exotic page for more information.
Clusters in the testing queue
clervaux
48 nodes, 96 cpus, 1344 cores (json)
Reservation example:
Access condition: | testing queue |
Model: | Dell PowerEdge C6320 |
Manufacturing date: | 2016-12-29 |
Date of arrival: | 2025-09-01 |
CPU: | Intel Xeon E5-2680 v4 (Broadwell), x86_64, 2.40GHz, 2 CPUs/node, 14 cores/CPU |
Memory: | 128 GiB |
Storage: | disk0, 120 GB SSD SATA Intel INTEL SSDSC2BB12 (dev: /dev/disk0 ) (primary disk) |
Network: |
|
Last generated from the Grid'5000 Reference API on 2025-09-02 (commit a3c0b2d501)