Lille:Hardware: Difference between revisions
		
		
		
		
		
		Jump to navigation
		Jump to search
		
				
		
		
	
| No edit summary | No edit summary | ||
| (81 intermediate revisions by 18 users not shown) | |||
| Line 1: | Line 1: | ||
| __NOEDITSECTION__ | __NOEDITSECTION__ | ||
| <div class="sitelink">[[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]]</div> | {{Portal|User}} | ||
| <div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Louvain:Hardware|Louvain]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Strasbourg:Hardware|Strasbourg]] | [[Toulouse:Hardware|Toulouse]]</div> | |||
| '''See also:''' [[Lille:Network|Network topology for Lille]] | |||
| = Summary = | |||
| * 4 clusters | |||
| * 29 nodes | |||
| * 1024 CPU cores | |||
| * 48 GPUs | |||
| * 284672 GPUs cores | |||
| * 9.0 TiB RAM | |||
| * 71 SSDs and 47 HDDs on nodes (total: 309.02 TB) | |||
| * 57.8 TFLOPS (excluding GPUs) | |||
| =  | = Clusters summary = | ||
| {|class="wikitable sortable" | {|class="wikitable sortable" | ||
| |- | |- | ||
| !|Cluster | !rowspan=2|Cluster | ||
| !| | !rowspan=2|Access Condition | ||
| !|Date of arrival | !rowspan=2|Date of arrival | ||
| !data-sort-type="number"|Nodes | !rowspan=2|Manufacturing date | ||
| !|CPU | !data-sort-type="number" rowspan=2|Nodes | ||
| !colspan=4|CPU | |||
| !data-sort-type="number" rowspan=2|Memory | |||
| !data-sort-type="number" rowspan=2|Storage | |||
| !data-sort-type="number" rowspan=2|Network | |||
| !rowspan=2|Accelerators | |||
| |- | |||
| !data-sort-type="number"|# | |||
| !|Name | |||
| !data-sort-type="number"|Cores | !data-sort-type="number"|Cores | ||
| !data-sort- | !|Architecture | ||
| |- | |||
| |[[#chiclet|chiclet]]||||2018-08-06||2018-07-27||8||2||AMD EPYC 7301||16 cores/CPU||x86_64||data-sort-value="137438953472"|128 GiB||data-sort-value="7899"|[1-7]: <b>480 GB SSD</b> + 2 x 4.0 TB HDD[[Disk_reservation|*]]<br />8: <b>480 GB SSD</b> + 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|2 x 25 Gbps || | |||
| |- | |||
| |[[#chifflot|chifflot]]||||2018-08-01||2018-07-17||8||2||Intel Xeon Gold 6126||12 cores/CPU||x86_64||data-sort-value="206158430208"|192 GiB||data-sort-value="15798"|<b>480 GB SSD</b> + 480 GB SSD[[Disk_reservation|*]] + 4 x 4.0 TB HDD[[Disk_reservation|*]]||data-sort-value="50000"|[1-2,<wbr>5-8]: 2 x 25 Gbps <br />[3-4]: 25 Gbps ||[1-6]: 2 x Nvidia Tesla P100 (16 GiB)<br />[7-8]: 2 x Nvidia Tesla V100 (32 GiB) | |||
| |- | |||
| |[[#chirop|chirop]]||||2024-01-25||2023-05-02||5||2||Intel Xeon Platinum 8358||32 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="8940"|<b>1.92 TB SSD</b> + 2 x 3.84 TB SSD||data-sort-value="50000"|2 x 25 Gbps || | |||
| |- | |||
| |[[#chuc|chuc]]||||2024-01-22||2023-05-02||8||1||AMD EPYC 7513||32 cores/CPU||x86_64||data-sort-value="549755813888"|512 GiB||data-sort-value="7152"|<b>1.92 TB SSD</b> + 3 x 1.92 TB SSD||data-sort-value="50000"|2 x 25 Gbps (SR‑IOV) ||4 x Nvidia A100 (40 GiB) | |||
| |- | |||
| |} | |||
| ''*: disk is [[Disk_reservation|reservable]]'' | |||
| ''**: crossed GPUs are not supported by Grid'5000 default environments'' | |||
| = Clusters in the [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/ default queue] = | |||
| == [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chiclet%20only chiclet] == | |||
| '''8 nodes, 16 cpus, 256 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chiclet/nodes.json?pretty=1 json]) | |||
| '''Reservation example:''' | |||
| {{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p chiclet</code> <code>-I</code>}} | |||
| ; chiclet-[1-7] (7 nodes, 14 cpus, 224 cores) | |||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R7425<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-27<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-06<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 128 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| |- | |||
| |} | |||
| <hr style="height:10pt; visibility:hidden;" /> | |||
| ; chiclet-8 (1 node, 2 cpus, 32 cores) | |||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R7425<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-27<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-06<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 128 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| |- | |||
| |} | |||
| == [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chifflot%20only chifflot] == | |||
| '''8 nodes, 16 cpus, 192 cores,''' split as follows due to differences between nodes ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chifflot/nodes.json?pretty=1 json]) | |||
| '''Reservation example:''' | |||
| {{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p chifflot</code> <code>-I</code>}} | |||
| ; chifflot-[1,<wbr>5] (2 nodes, 4 cpus, 48 cores) | |||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R740<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-17<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-01<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 192 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)<br>Compute capability: 6.0<br/> | |||
| |- | |||
| |} | |||
| <hr style="height:10pt; visibility:hidden;" /> | |||
| ; chifflot-2 (1 node, 2 cpus, 24 cores) | |||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R740<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-17<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-01<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 192 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| |- | |- | ||
| | | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)<br>Compute capability: 6.0<br/> | |||
| |- | |- | ||
| | | |} | ||
| <hr style="height:10pt; visibility:hidden;" /> | |||
| ; chifflot-3 (1 node, 2 cpus, 24 cores) | |||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R740<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-17<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-01<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 192 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk2, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk4, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk5, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * <span style="color:grey">eth1/ens5f1, Ethernet, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e - unavailable for experiment</span><br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)<br>Compute capability: 6.0<br/> | |||
| |- | |||
| |} | |} | ||
| <hr style="height:10pt; visibility:hidden;" /> | |||
| =  | ; chifflot-4 (1 node, 2 cpus, 24 cores) | ||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R740<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-17<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-01<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 192 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * <span style="color:grey">eth1/ens5f1, Ethernet, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e - unavailable for experiment</span><br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)<br>Compute capability: 6.0<br/> | |||
| |- | |||
| |} | |||
| <hr style="height:10pt; visibility:hidden;" /> | |||
| ==  | ; chifflot-6 (1 node, 2 cpus, 24 cores) | ||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R740<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-17<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-01<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 192 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk5, 4.0 TB HDD SAS Toshiba MG08SDA400NY (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)<br>Compute capability: 6.0<br/> | |||
| |- | |||
| |} | |||
| <hr style="height:10pt; visibility:hidden;" /> | |||
| ; chifflot-[7-8] (2 nodes, 4 cpus, 48 cores) | |||
| {| | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | |||
| | Dell PowerEdge R740<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2018-07-17<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | |||
| | 2018-08-01<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | |||
| | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | |||
| | 192 GiB<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | |||
| |  | |||
| * disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | |||
| * disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: <code class="file">/dev/disk1</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk2, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk2</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk3, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk3</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk4, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk4</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br /> | |||
| * disk5, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: <code class="file">/dev/disk5</code>[[Disk_reservation|*]]) [[Disk_reservation|(reservable)]] <br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | |||
| |  | |||
| * eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e<br /> | |||
| * eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | |||
| | 2 x Nvidia Tesla V100-PCIE-32GB (32 GiB)<br>Compute capability: 7.0<br/> | |||
| |- | |||
| |} | |||
| == [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chirop%20only chirop] == | |||
| '''5 nodes, 10 cpus, 320 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chirop/nodes.json?pretty=1 json]) | |||
| '''Reservation example:''' | |||
| {{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p chirop</code> <code>-I</code>}} | |||
| {| | {| | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| |  | | DL360 Gen10+<br/> | ||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2023-05-02<br/> | |||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| |  | | 2024-01-25<br/> | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| | Intel Xeon  | | Intel Xeon Platinum 8358 (Ice Lake-SP), x86_64, 2.60GHz, 2 CPUs/node, 32 cores/CPU<br/> | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| |  | | 512 GiB<br/> | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| |   | |   | ||
| *  | * disk0, 1.92 TB SSD NVME Kioxia KCD6XLUL1T92 (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | ||
| *  | * disk1, 3.84 TB SSD SATA HP VK003840GWSRV (dev: <code class="file">/dev/disk1</code>)  <br /> | ||
| * disk2, 3.84 TB SSD SATA HP VK003840GWSRV (dev: <code class="file">/dev/disk2</code>)  <br/> | |||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| |   | |   | ||
| * eth0/ | * eth0/ens10f0np0, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en<br /> | ||
| * eth1/ens10f1np1, Ethernet, configured rate: 25 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| *  | |||
| |- | |- | ||
| |} | |} | ||
| ==  | == [https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?filter=chuc%20only chuc] == | ||
| '''8 nodes, 8 cpus, 256 cores''' ([https://public-api.grid5000.fr/stable/sites/lille/clusters/chuc/nodes.json?pretty=1 json]) | |||
| '''Reservation example:''' | |||
| {{Term|location=flille|cmd=<code class="command">oarsub</code> <code class="replace">-q default</code> <code class="env">-p chuc</code> <code>-I</code>}} | |||
| {| | {| | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:''' | ||
| |  | | Apollo 6500 Gen10 Plus<br/> | ||
| |- | |||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:''' | |||
| | 2023-05-02<br/> | |||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:''' | ||
| |  | | 2024-01-22<br/> | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:''' | ||
| |  | | AMD EPYC 7513 (Zen 3), x86_64, 1 CPU/node, 32 cores/CPU<br/> | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:''' | ||
| |  | | 512 GiB<br/> | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:''' | ||
| |   | |   | ||
| *  | * disk0, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk0</code>)  (primary disk)<br /> | ||
| *  | * disk1, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk1</code>)  <br /> | ||
| *  | * disk2, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk2</code>)  <br /> | ||
| *  | * disk3, 1.92 TB SSD SAS HPE VO001920RZWUV (dev: <code class="file">/dev/disk3</code>)  <br/> | ||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:''' | ||
| |   | |   | ||
| * eth0/ | * eth0/ens15f0np0, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled<br /> | ||
| * eth1/ens15f1np1, Ethernet, configured rate: 25 Gbps, model: Mellanox Technologies MT27800 Family [ConnectX-5], driver: mlx5_core, SR-IOV enabled [[Advanced_KaVLAN#A_simple_multi_NICs_example|(multi NICs example)]]<br/> | |||
| *  | |||
| |- | |- | ||
| | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | | valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:''' | ||
| |  | | 4 x Nvidia A100-SXM4-40GB (40 GiB)<br>Compute capability: 8.0<br/> | ||
| |- | |- | ||
| |}''<small> | |}''<small>Last generated from the Grid'5000 Reference API on 2025-09-15 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/f90901d189 commit f90901d189])</small>'' | ||
Latest revision as of 08:30, 15 September 2025
Hardware: Global | Grenoble | Lille | Louvain | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse
See also: Network topology for Lille
Summary
- 4 clusters
- 29 nodes
- 1024 CPU cores
- 48 GPUs
- 284672 GPUs cores
- 9.0 TiB RAM
- 71 SSDs and 47 HDDs on nodes (total: 309.02 TB)
- 57.8 TFLOPS (excluding GPUs)
Clusters summary
| Cluster | Access Condition | Date of arrival | Manufacturing date | Nodes | CPU | Memory | Storage | Network | Accelerators | |||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| # | Name | Cores | Architecture | |||||||||
| chiclet | 2018-08-06 | 2018-07-27 | 8 | 2 | AMD EPYC 7301 | 16 cores/CPU | x86_64 | 128 GiB | [1-7]: 480 GB SSD + 2 x 4.0 TB HDD* 8: 480 GB SSD + 4.0 TB HDD* | 2 x 25 Gbps | ||
| chifflot | 2018-08-01 | 2018-07-17 | 8 | 2 | Intel Xeon Gold 6126 | 12 cores/CPU | x86_64 | 192 GiB | 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* | [1-2, [3-4]: 25 Gbps | [1-6]: 2 x Nvidia Tesla P100 (16 GiB) [7-8]: 2 x Nvidia Tesla V100 (32 GiB) | |
| chirop | 2024-01-25 | 2023-05-02 | 5 | 2 | Intel Xeon Platinum 8358 | 32 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD + 2 x 3.84 TB SSD | 2 x 25 Gbps | ||
| chuc | 2024-01-22 | 2023-05-02 | 8 | 1 | AMD EPYC 7513 | 32 cores/CPU | x86_64 | 512 GiB | 1.92 TB SSD + 3 x 1.92 TB SSD | 2 x 25 Gbps (SR‑IOV) | 4 x Nvidia A100 (40 GiB) | |
*: disk is reservable
**: crossed GPUs are not supported by Grid'5000 default environments
Clusters in the default queue
chiclet
8 nodes, 16 cpus, 256 cores, split as follows due to differences between nodes (json)
Reservation example:
- chiclet-[1-7] (7 nodes, 14 cpus, 224 cores)
| Model: | Dell PowerEdge R7425 | 
| Manufacturing date: | 2018-07-27 | 
| Date of arrival: | 2018-08-06 | 
| CPU: | AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU | 
| Memory: | 128 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
- chiclet-8 (1 node, 2 cpus, 32 cores)
| Model: | Dell PowerEdge R7425 | 
| Manufacturing date: | 2018-07-27 | 
| Date of arrival: | 2018-08-06 | 
| CPU: | AMD EPYC 7301 (Zen), x86_64, 2 CPUs/node, 16 cores/CPU | 
| Memory: | 128 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
chifflot
8 nodes, 16 cpus, 192 cores, split as follows due to differences between nodes (json)
Reservation example:
- chifflot-[1,5] (2 nodes, 4 cpus, 48 cores) 
| Model: | Dell PowerEdge R740 | 
| Manufacturing date: | 2018-07-17 | 
| Date of arrival: | 2018-08-01 | 
| CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU | 
| Memory: | 192 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
| GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 | 
- chifflot-2 (1 node, 2 cpus, 24 cores)
| Model: | Dell PowerEdge R740 | 
| Manufacturing date: | 2018-07-17 | 
| Date of arrival: | 2018-08-01 | 
| CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU | 
| Memory: | 192 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
| GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 | 
- chifflot-3 (1 node, 2 cpus, 24 cores)
| Model: | Dell PowerEdge R740 | 
| Manufacturing date: | 2018-07-17 | 
| Date of arrival: | 2018-08-01 | 
| CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU | 
| Memory: | 192 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
| GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 | 
- chifflot-4 (1 node, 2 cpus, 24 cores)
| Model: | Dell PowerEdge R740 | 
| Manufacturing date: | 2018-07-17 | 
| Date of arrival: | 2018-08-01 | 
| CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU | 
| Memory: | 192 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
| GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 | 
- chifflot-6 (1 node, 2 cpus, 24 cores)
| Model: | Dell PowerEdge R740 | 
| Manufacturing date: | 2018-07-17 | 
| Date of arrival: | 2018-08-01 | 
| CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU | 
| Memory: | 192 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
| GPU: | 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB) Compute capability: 6.0 | 
- chifflot-[7-8] (2 nodes, 4 cpus, 48 cores)
| Model: | Dell PowerEdge R740 | 
| Manufacturing date: | 2018-07-17 | 
| Date of arrival: | 2018-08-01 | 
| CPU: | Intel Xeon Gold 6126 (Skylake-SP), x86_64, 2.60GHz, 2 CPUs/node, 12 cores/CPU | 
| Memory: | 192 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
| GPU: | 2 x Nvidia Tesla V100-PCIE-32GB (32 GiB) Compute capability: 7.0 | 
chirop
5 nodes, 10 cpus, 320 cores (json)
Reservation example:
| Model: | DL360 Gen10+ | 
| Manufacturing date: | 2023-05-02 | 
| Date of arrival: | 2024-01-25 | 
| CPU: | Intel Xeon Platinum 8358 (Ice Lake-SP), x86_64, 2.60GHz, 2 CPUs/node, 32 cores/CPU | 
| Memory: | 512 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
chuc
8 nodes, 8 cpus, 256 cores (json)
Reservation example:
| Model: | Apollo 6500 Gen10 Plus | 
| Manufacturing date: | 2023-05-02 | 
| Date of arrival: | 2024-01-22 | 
| CPU: | AMD EPYC 7513 (Zen 3), x86_64, 1 CPU/node, 32 cores/CPU | 
| Memory: | 512 GiB | 
| Storage: | 
 | 
| Network: | 
 | 
| GPU: | 4 x Nvidia A100-SXM4-40GB (40 GiB) Compute capability: 8.0 | 
Last generated from the Grid'5000 Reference API on 2025-09-15 (commit f90901d189)
