Rennes:Hardware

From Grid5000
Revision as of 15:46, 19 June 2023 by Nperrin (talk | contribs)
Jump to navigation Jump to search
Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Toulouse

See also: Network topology for Rennes

Summary

  • 4 clusters
  • 108 nodes
  • 1820 CPU cores
  • 6 GPUs
  • 14.25 TiB RAM
  • 33 SSDs and 314 HDDs on nodes (total: 199.6 TB)
  • 67.4 TFLOPS (excluding GPUs)

Clusters

Cluster Access Condition Date of arrival Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
abacus25 testing queue 2023-06-05 2 2 AMD EPYC 7413 24 cores/CPU x86_64 512 GiB 960 GB SSD + 2 x 960 GB SSD 10 Gbps (SR‑IOV)  3 x Nvidia A40 (45 GiB)
paranoia production queue 2014-02-21 7 2 Intel Xeon E5-2660 v2 10 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD 1 Gbps (SR‑IOV) + 2 x 10 Gbps (SR‑IOV) 
parasilo 2015-01-13 27 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 4 x 600 GB HDD* + 200 GB SSD* 2 x 10 Gbps (SR‑IOV) 
paravance 2015-01-13 72 2 Intel Xeon E5-2630 v3 8 cores/CPU x86_64 128 GiB 600 GB HDD + 600 GB HDD 2 x 10 Gbps (SR‑IOV) 

*: disk is reservable

**: crossed GPUs are not supported by Grid'5000 default environments

Clusters in the default queue

parasilo

27 nodes, 54 cpus, 432 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png frennes:
oarsub -p parasilo -I
parasilo-[1-5,7-12,14-15,17-24,26-28] (24 nodes, 48 cpus, 384 cores)
Model: Dell PowerEdge R630
Date of arrival: 2015-01-13
CPU: Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 200 GB SSD SAS Toshiba PX02SSF020 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
parasilo-6 (1 node, 2 cpus, 16 cores)
Model: Dell PowerEdge R630
Date of arrival: 2015-01-13
CPU: Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 200 GB SSD SAS Toshiba PX04SHB020 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
parasilo-13 (1 node, 2 cpus, 16 cores)
Model: Dell PowerEdge R630
Date of arrival: 2015-01-13
CPU: Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 600 GB HDD SAS Toshiba AL15SEB060NY (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 200 GB SSD SAS Toshiba PX02SSF020 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
parasilo-25 (1 node, 2 cpus, 16 cores)
Model: Dell PowerEdge R630
Date of arrival: 2015-01-13
CPU: Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 600 GB HDD SAS Seagate ST600MP0005 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 200 GB SSD SAS Toshiba PX02SSF020 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

paravance

72 nodes, 144 cpus, 1152 cores (json)

Reservation example:

Terminal.png frennes:
oarsub -p paravance -I
Model: Dell PowerEdge R630
Date of arrival: 2015-01-13
CPU: Intel Xeon E5-2630 v3 (Haswell, 2.40GHz, 2 CPUs/node, 8 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

Clusters in the production queue

paranoia

7 nodes, 14 cpus, 140 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png frennes:
oarsub -q production -p paranoia -I

Max walltime per nodes:

  • paranoia-[1-4]: 12h
  • paranoia-[5-7]: 168h
paranoia-[1-2,5,7] (4 nodes, 8 cpus, 80 cores)
Access condition: production queue
Model: Dell PowerEdge C6220 II
Date of arrival: 2014-02-21
CPU: Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)
  • disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0)
  • disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0)
  • disk3, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk3, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0)
  • disk4, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0)
Network:
  • eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled (multi NICs example)
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
paranoia-3 (1 node, 2 cpus, 20 cores)
Access condition: production queue
Model: Dell PowerEdge C6220 II
Date of arrival: 2014-02-21
CPU: Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Western Digital WD6002BKTG (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)
  • disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0)
  • disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0)
  • disk3, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk3, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0)
  • disk4, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0)
Network:
  • eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled (multi NICs example)
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
paranoia-4 (1 node, 2 cpus, 20 cores)
Access condition: production queue
Model: Dell PowerEdge C6220 II
Date of arrival: 2014-02-21
CPU: Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)
  • disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0)
  • disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0)
  • disk3, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk3, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0)
  • disk4, 600 GB HDD SAS Western Digital WD6002BKTG (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0)
Network:
  • eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled (multi NICs example)
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
paranoia-8 (1 node, 2 cpus, 20 cores)
Access condition: production queue
Model: Dell PowerEdge C6220 II
Date of arrival: 2014-02-21
CPU: Intel Xeon E5-2660 v2 (Sandy Bridge, 2.20GHz, 2 CPUs/node, 10 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy0-lun-0) (primary disk)
  • disk1, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy1-lun-0)
  • disk2, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy2-lun-0)
  • disk3, 600 GB HDD SAS Seagate ST600MM0006 (dev: /dev/disk3, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy3-lun-0)
  • disk4, 600 GB HDD SAS Western Digital WD6001BKHG (dev: /dev/disk4, by-path: /dev/disk/by-path/pci-0000:82:00.0-sas-phy4-lun-0)
Network:
  • eth0/enp3s0f0, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/enp3s0f1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno1, Ethernet, configured rate: 1 Gbps, model: Intel I350 Gigabit Network Connection, driver: igb, SR-IOV enabled (multi NICs example)
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

Clusters in the testing queue

abacus25

2 nodes, 4 cpus, 96 cores (json)

Reservation example:

Terminal.png frennes:
oarsub -q testing -p abacus25 -I
Access condition: testing queue
Model: HPE ProLiant DL385 Gen10+ v2
Date of arrival: 2023-06-05
CPU: AMD EPYC 7413 (Zen 3, 2 CPUs/node, 24 cores/CPU)
Memory: 512 GiB
Storage:
  • disk0, 960 GB SSD SAS HPE MO000960RXKRC (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:64:00.0-scsi-0:2:1:0) (primary disk)
  • disk1, 960 GB SSD SATA HP VK000960GZCNF (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:64:00.0-scsi-0:2:2:0)
  • disk2, 960 GB SSD SATA HP VK000960GZCNF (dev: /dev/disk2, by-path: /dev/disk/by-path/pci-0000:64:00.0-scsi-0:2:3:0)
Network:
  • eth0/ens10f0, Ethernet, configured rate: 10 Gbps, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e, SR-IOV enabled - no KaVLAN
  • eth1/ens10f1, Ethernet, model: Intel Ethernet Controller X710 for 10GbE SFP+, driver: i40e - unavailable for experiment
GPU: 3 x Nvidia A40 (45 GiB)
Compute capability: 8.6

Last generated from the Grid'5000 Reference API on 2023-06-19 (commit eed917075a)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Rennes:Hardware&oldid=99273"