Toulouse:Hardware: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
 
(27 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{Template:Site link|Hardware}}
__NOEDITSECTION__
{{Portal|User}}
<div class="sitelink">Hardware: [[Hardware|Global]] | [[Grenoble:Hardware|Grenoble]] | [[Lille:Hardware|Lille]] | [[Luxembourg:Hardware|Luxembourg]] | [[Lyon:Hardware|Lyon]] | [[Nancy:Hardware|Nancy]] | [[Nantes:Hardware|Nantes]] | [[Rennes:Hardware|Rennes]] | [[Sophia:Hardware|Sophia]] | [[Toulouse:Hardware|Toulouse]]</div>
'''See also:''' [[Toulouse:Network|Network topology for Toulouse]]
= Summary =
* 2 clusters
* 22 nodes
* 416 CPU cores
* 12 GPUs
* 6144 GPUs cores
* 2.88&nbsp;TiB RAM
* 22 SSDs and 0 HDDs on nodes (total: 33.61&nbsp;TB)
* 36.6 TFLOPS (excluding GPUs)


== Violette : Sun Nodes [RETIRED] ==
= Clusters summary =
{{Compute node|
{|class="wikitable sortable"
model_qty=57|
|-
model=[[Computer#Sun Fire V20z|Sun Fire V20z]]|
!rowspan=2|Cluster
model_family=[[Computer#Sun Fire|Sun Fire]]|
!rowspan=2|Access Condition
cpu_qty=2|
!rowspan=2|Date of arrival
cpu_total=116|
!rowspan=2|Manufacturing date
cpu_core_qty=1|
!data-sort-type="number" rowspan=2|Nodes
cpu_core_total=116|
!colspan=4|CPU
cpu=[https://en.wikipedia.org/wiki/List_of_AMD_Opteron_microprocessors AMD Opteron 248]|
!data-sort-type="number" rowspan=2|Memory
cpu_family=AMD Opteron|
!data-sort-type="number" rowspan=2|Storage
cpu_prop=2.2GHz |
!data-sort-type="number" rowspan=2|Network
mem=2 GB|
!rowspan=2|Accelerators
storage_size=73 GB|
|-
storage_int=SCSI|
!data-sort-type="number"|#
storage_misc=|
!|Name
storage_drv=mptspi|
!data-sort-type="number"|Cores
net=
!|Architecture
* Gigabit Ethernet
|-
* Gigabit Ethernet (unused) |
net_drv=tg3|
misc=-|
arrival=09/2004 and 06/2005
}}


== Pastel: Sun Nodes ==
|[[#estats|estats]]||<b>[[Exotic#Toulouse:_estats|exotic]]</b>&nbsp;job&nbsp;type||2023-06-13||2022-12-01||12||1||Nvidia Carmel||8&nbsp;cores/CPU||aarch64||data-sort-value="34359738368"|32&nbsp;GiB||data-sort-value="1863"|<b>2.0&nbsp;TB&nbsp;SSD</b>||data-sort-value="1000"|1&nbsp;Gbps&nbsp;||Nvidia AGX&nbsp;Xavier&nbsp;(30&nbsp;GiB)
{{Compute node|
|-
model_qty=140|
|[[#montcalm|montcalm]]||||2022-12-01||2022-11-06||10||2||Intel Xeon Silver 4314||16&nbsp;cores/CPU||x86_64||data-sort-value="274877906944"|256&nbsp;GiB||data-sort-value="894"|<b>960&nbsp;GB&nbsp;SSD</b>||data-sort-value="10000"|10&nbsp;Gbps&nbsp;||
model=[[Computer#Sun Fire X2200 M2|Sun Fire X2200 M2]]|
|-
model_family=[[Computer#Sun Fire|Sun Fire]]|
|}
cpu_qty=2|
''**: crossed GPUs are not supported by Grid'5000 default environments''
cpu_total=280|
= Clusters in the [https://intranet.grid5000.fr/oar/Toulouse/drawgantt-svg/ default queue] =
cpu_core_qty=2|
 
cpu_core_total=560|
== [https://intranet.grid5000.fr/oar/Toulouse/drawgantt-svg/?filter=estats%20only estats] ==
cpu=[https://en.wikipedia.org/wiki/List_of_AMD_Opteron_microprocessors AMD Opteron 2218]|
 
cpu_family=AMD Opteron|
'''12 nodes, 12 cpus, 96 cores''' ([https://public-api.grid5000.fr/stable/sites/toulouse/clusters/estats/nodes.json?pretty=1 json])
cpu_prop=2.6GHz / 1MB / 667MHz|
 
mem=8 GB|
'''Reservation example:'''
storage_size=250 GB|
 
storage_int=SATA|
{{Term|location=ftoulouse|cmd=<code class="command">oarsub</code> <code class="replace">-t exotic</code> <code class="env">-p estats</code> <code>-I</code>}}
storage_misc=|
 
storage_drv=sata_nv|
{|
net=
|-
*2 x Gigabit Ethernet (NVIDIA MCP55 Pro, only one in use on nodes)
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Access condition:'''
*2 x Gigabit Ethernet (Broadcom BCM5715c, tg3 driver, disabled)|
| [[Exotic#Toulouse:_estats|exotic]] job type<br/>
net_drv=forcedeth|
|-
arrival=nov 29 2007|
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
misc=
| Connecttech/Nvidia Jetson AGX Xavier<br/>
}}
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2022-12-01<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2023-06-13<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Nvidia Carmel (Carmel), aarch64, 1&nbsp;CPU/node, 8&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 32&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 2.0&nbsp;TB SSD NVME Samsung Samsung SSD 970 EVO Plus 2TB (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/platform-14180000.pcie-pci-0000:01:00.0-nvme-1</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0, Ethernet, configured rate: 1&nbsp;Gbps, model: N/A, driver: nvethernet - no KaVLAN<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''GPU:'''
| Nvidia AGX&nbsp;Xavier&nbsp;(30&nbsp;GiB)<br>Compute&nbsp;capability:&nbsp;7.2<br/>
|-
|}
 
'''Note:''' This cluster is defined as exotic. Please read the '''[[Exotic#Toulouse:_estats|exotic]]''' page for more information.<br/>
 
== [https://intranet.grid5000.fr/oar/Toulouse/drawgantt-svg/?filter=montcalm%20only montcalm] ==
 
'''10 nodes, 20 cpus, 320 cores''' ([https://public-api.grid5000.fr/stable/sites/toulouse/clusters/montcalm/nodes.json?pretty=1 json])
 
'''Reservation example:'''
 
{{Term|location=ftoulouse|cmd=<code class="command">oarsub</code> <code class="env">-p montcalm</code> <code>-I</code>}}
 
{|
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Model:'''
| HPE Proliant DL360 Gen10+<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Manufacturing date:'''
| 2022-11-06<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Date of arrival:'''
| 2022-12-01<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''CPU:'''
| Intel Xeon Silver 4314 (Ice Lake), x86_64, 2.40GHz, 2&nbsp;CPUs/node, 16&nbsp;cores/CPU<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Memory:'''
| 256&nbsp;GiB<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Storage:'''
|  disk0, 960&nbsp;GB SSD SATA HP VK000960GXAWL (dev: <code class="file">/dev/disk0</code>, by-path: <code class="file">/dev/disk/by-path/pci-0000:00:17.0-ata-1</code>)  (primary disk)<br/>
|-
| valign="top" style="background-color: #f9f9f9; padding: 0px 10px 0px 3px;" |'''Network:'''
|
* eth0/ens10f0np0, Ethernet, configured rate: 10&nbsp;Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en<br />
* <span style="color:grey">eth1/ens10f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment</span><br/>
|-
|}''<small>Last generated from the Grid'5000 Reference API on 2024-03-29 ([https://gitlab.inria.fr/grid5000/reference-repository/commit/f13d97f135 commit f13d97f135])</small>''

Latest revision as of 16:17, 29 March 2024

Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Toulouse

See also: Network topology for Toulouse

Summary

  • 2 clusters
  • 22 nodes
  • 416 CPU cores
  • 12 GPUs
  • 6144 GPUs cores
  • 2.88 TiB RAM
  • 22 SSDs and 0 HDDs on nodes (total: 33.61 TB)
  • 36.6 TFLOPS (excluding GPUs)

Clusters summary

Cluster Access Condition Date of arrival Manufacturing date Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
estats exotic job type 2023-06-13 2022-12-01 12 1 Nvidia Carmel 8 cores/CPU aarch64 32 GiB 2.0 TB SSD 1 Gbps  Nvidia AGX Xavier (30 GiB)
montcalm 2022-12-01 2022-11-06 10 2 Intel Xeon Silver 4314 16 cores/CPU x86_64 256 GiB 960 GB SSD 10 Gbps 

**: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the default queue

estats

12 nodes, 12 cpus, 96 cores (json)

Reservation example:

Terminal.png ftoulouse:
oarsub -t exotic -p estats -I
Access condition: exotic job type
Model: Connecttech/Nvidia Jetson AGX Xavier
Manufacturing date: 2022-12-01
Date of arrival: 2023-06-13
CPU: Nvidia Carmel (Carmel), aarch64, 1 CPU/node, 8 cores/CPU
Memory: 32 GiB
Storage: disk0, 2.0 TB SSD NVME Samsung Samsung SSD 970 EVO Plus 2TB (dev: /dev/disk0, by-path: /dev/disk/by-path/platform-14180000.pcie-pci-0000:01:00.0-nvme-1) (primary disk)
Network:
  • eth0, Ethernet, configured rate: 1 Gbps, model: N/A, driver: nvethernet - no KaVLAN
GPU: Nvidia AGX Xavier (30 GiB)
Compute capability: 7.2

Note: This cluster is defined as exotic. Please read the exotic page for more information.

montcalm

10 nodes, 20 cpus, 320 cores (json)

Reservation example:

Terminal.png ftoulouse:
oarsub -p montcalm -I
Model: HPE Proliant DL360 Gen10+
Manufacturing date: 2022-11-06
Date of arrival: 2022-12-01
CPU: Intel Xeon Silver 4314 (Ice Lake), x86_64, 2.40GHz, 2 CPUs/node, 16 cores/CPU
Memory: 256 GiB
Storage: disk0, 960 GB SSD SATA HP VK000960GXAWL (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:00:17.0-ata-1) (primary disk)
Network:
  • eth0/ens10f0np0, Ethernet, configured rate: 10 Gbps, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en
  • eth1/ens10f1np1, Ethernet, model: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller, driver: bnxt_en - unavailable for experiment

Last generated from the Grid'5000 Reference API on 2024-03-29 (commit f13d97f135)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Toulouse:Hardware&oldid=102522"