Lyon:Network: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
Line 27: Line 27:


== HPC Network - Infiniband ==
== HPC Network - Infiniband ==
* [https://www.mellanox.com/files/related-docs/prod_ib_switch_systems/pb_sb7800.pdf switch "''swib''"] : SB7800 (4xEDR, 100Gb/s)
* [https://www.nvidia.com/en-us/networking/infiniband/sb7800/ switch "''swib''"] : SB7800 (4xEDR, 100Gb/s)
* gemini : 3 interfaces connected to ''swib'' (4xEDR 100Gb/s)
* gemini : 3 interfaces connected to ''swib'' (4xEDR 100Gb/s)
** Card model: ''Mellanox Technologies MT27800 Family (MT4119)''
** Card model: ''Mellanox Technologies MT27800 Family (MT4119)''

Revision as of 13:58, 15 June 2022

See also: Hardware description for Lyon

Overview of Ethernet network topology

LyonNetwork.png


Network devices models

  • force10: Force10 S4810
  • gw: Dell EMC S4128F-ON
  • salome: FESX448+2XG-PREM
  • sneowise: Arctica 4808xs
  • sneowiseib1: Mellanox QM8700
  • sneowiseib2: Mellanox QM8700
  • swib: Mellanox SB7800

More details (including address ranges) are available from the Grid5000:Network page.

IP networks in use

You have to use a public network range to run an experiment between several Grid5000 sites.

Public Networks

  • computing : 172.16.48.0/20
  • virtual : 10.140.0.0/14

Local Networks

  • admin : 172.17.48.0/20
  • nat : 192.168.69.0/30

HPC Network - Infiniband

  • switch "swib" : SB7800 (4xEDR, 100Gb/s)
  • gemini : 3 interfaces connected to swib (4xEDR 100Gb/s)
    • Card model: Mellanox Technologies MT27800 Family (MT4119)
    • driver: mlx5_core
  • pyxis : 1 interface connected to swib (4xEDR, 100Gb/s)
    • Card model: Mellanox Technologies MT28908 Family [ConnectX-6] (MT4123)
    • driver: mlx5_core
  • alcor (group storage): 1 interface connected to swib (4xFDR, 56Gb/s)
    • Card model: Mellanox Technologies MT27800 Family [ConnectX-5] (MT4119)
    • driver: mlx5_core

LyonHPCNetwork.png
(image generated from ibnetdiscover and InfiniBand-Graphviz-ualization)