Lille:Hardware

From Grid5000
Revision as of 13:39, 7 June 2022 by Amerlin (talk | contribs)
Jump to navigation Jump to search
Hardware: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia

See also: Network topology for Lille

Summary

  • 4 clusters
  • 39 nodes
  • 972 CPU cores
  • 32 GPUs
  • 12.25 TiB RAM
  • 40 SSDs and 94 HDDs on nodes (total: 283.27 TB)
  • 39.6 TFLOPS (excluding GPUs)

Clusters

Cluster Access Condition Date of arrival Nodes CPU Memory Storage Network Accelerators
# Name Cores Architecture
chetemi 2016-12-01 15 2 Intel Xeon E5-2630 v4 10 cores/CPU x86_64 256 GiB [1-9,11-15]: 300 GB HDD + 300 GB HDD
10: 600 GB HDD + 300 GB HDD		 2 x 10 Gbps (SR‑IOV) 
chiclet 2018-08-06 8 2 AMD EPYC 7301 16 cores/CPU x86_64 128 GiB 480 GB SSD + 2 x 4.0 TB HDD* 2 x 25 Gbps 
chifflet 2016-12-01 8 2 Intel Xeon E5-2680 v4 14 cores/CPU x86_64 768 GiB 400 GB SSD + 400 GB SSD* + 2 x 4.0 TB HDD* 2 x 10 Gbps (SR‑IOV)  2 x Nvidia GTX 1080 Ti (11 GiB)
chifflot 2018-08-01 8 2 Intel Xeon Gold 6126 12 cores/CPU x86_64 192 GiB 480 GB SSD + 480 GB SSD* + 4 x 4.0 TB HDD* 2 x 25 Gbps  [1-6]: 2 x Nvidia Tesla P100 (16 GiB)
[7-8]: 2 x Nvidia Tesla V100 (32 GiB)

*: disk is reservable

Clusters in the default queue

chetemi

15 nodes, 30 cpus, 300 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png flille:
oarsub -p chetemi -I
chetemi-[1-9,11-15] (14 nodes, 28 cpus, 280 cores)
Model: Dell PowerEdge R630
Date of arrival: 2016-12-01
CPU: Intel Xeon E5-2630 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 10 cores/CPU)
Memory: 256 GiB
Storage:
  • disk0, 300 GB HDD SAS Seagate ST300MP0005 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 300 GB HDD SAS Seagate ST300MP0005 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
chetemi-10 (1 node, 2 cpus, 20 cores)
Model: Dell PowerEdge R630
Date of arrival: 2016-12-01
CPU: Intel Xeon E5-2630 v4 (Broadwell, 2.20GHz, 2 CPUs/node, 10 cores/CPU)
Memory: 256 GiB
Storage:
  • disk0, 600 GB HDD SAS Seagate ST600MP0036 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 300 GB HDD SAS Seagate ST300MP0005 (dev: /dev/disk1, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment

chiclet

8 nodes, 16 cpus, 256 cores (json)

Reservation example:

Terminal.png flille:
oarsub -p chiclet -I
Model: Dell PowerEdge R7425
Date of arrival: 2018-08-06
CPU: AMD EPYC 7301 (Zen, 2 CPUs/node, 16 cores/CPU)
Memory: 128 GiB
Storage:
  • disk0, 480 GB SSD SAS Toshiba PX05SVB048Y (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:61:00.0-scsi-0:0:2:0) (reservable)
Network:
  • eth0/enp98s0f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/enp98s0f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth3/eno2, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth4/eno3, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment
  • eth5/eno4, Ethernet, model: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe, driver: tg3 - unavailable for experiment

chifflet

8 nodes, 16 cpus, 224 cores (json)

Reservation example:

Terminal.png flille:
oarsub -p chifflet -I
Model: Dell PowerEdge R730
Date of arrival: 2016-12-01
CPU: Intel Xeon E5-2680 v4 (Broadwell, 2.40GHz, 2 CPUs/node, 14 cores/CPU)
Memory: 768 GiB
Storage:
  • disk0, 400 GB SSD SAS Toshiba PX04SMB040 (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 400 GB SSD SAS Toshiba PX04SMB040 (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SATA Toshiba TOSHIBA MG04ACA4 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SATA Toshiba TOSHIBA MG04ACA4 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:03:00.0-scsi-0:0:3:0) (reservable)
Network:
  • eth0/eno1, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled
  • eth1/eno2, Ethernet, configured rate: 10 Gbps, model: Intel 82599ES 10-Gigabit SFI/SFP+ Network Connection, driver: ixgbe, SR-IOV enabled (multi NICs example)
  • eth2/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia GeForce GTX 1080 Ti (11 GiB)
Compute capability: 6.1

chifflot

8 nodes, 16 cpus, 192 cores, split as follows due to differences between nodes (json)

Reservation example:

Terminal.png flille:
oarsub -p chifflot -I
chifflot-[1,4-5] (3 nodes, 6 cpus, 72 cores)
Model: Dell PowerEdge R740
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-2 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-3 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG04SCA40ENY (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-6 (1 node, 2 cpus, 24 cores)
Model: Dell PowerEdge R740
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Seagate ST4000NM0295 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Toshiba MG08SDA400NY (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla P100-PCIE-16GB (16 GiB)
Compute capability: 6.0
chifflot-[7-8] (2 nodes, 4 cpus, 48 cores)
Model: Dell PowerEdge R740
Date of arrival: 2018-08-01
CPU: Intel Xeon Gold 6126 (Skylake, 2.60GHz, 2 CPUs/node, 12 cores/CPU)
Memory: 192 GiB
Storage:
  • disk0, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk0, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:0:0) (primary disk)
  • disk1, 480 GB SSD SATA Intel SSDSC2KG480G7R (dev: /dev/disk1*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:1:0) (reservable)
  • disk2, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk2*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:2:0) (reservable)
  • disk3, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk3*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:3:0) (reservable)
  • disk4, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk4*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:4:0) (reservable)
  • disk5, 4.0 TB HDD SAS Hitachi HUS726040ALS210 (dev: /dev/disk5*, by-path: /dev/disk/by-path/pci-0000:18:00.0-scsi-0:0:5:0) (reservable)
Network:
  • eth0/ens5f0, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e
  • eth1/ens5f1, Ethernet, configured rate: 25 Gbps, model: Intel Ethernet Controller XXV710 for 25GbE SFP28, driver: i40e (multi NICs example)
  • eth2/eno1, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth3/eno2, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth4/eno3, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
  • eth5/eno4, Ethernet, model: Intel I350 Gigabit Network Connection, driver: igb - unavailable for experiment
GPU: 2 x Nvidia Tesla V100-PCIE-32GB (32 GiB)
Compute capability: 7.0

Last generated from the Grid'5000 Reference API on 2022-06-07 (commit 5d4b87f3e6)

Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Lille:Hardware&oldid=96066"