Lyon:Network: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
(9 intermediate revisions by 4 users not shown)
Line 4: Line 4:
{{Maintainer|Simon Delamare}}
{{Maintainer|Simon Delamare}}


'''See also:''' [[Lyon:Hardware|Hardware description for Lyon]]
= Overview of Ethernet network topology =
[[File:LyonNetwork.png|800px]]
{{:Lyon:GeneratedNetwork}}


= IP networks in use =
= IP networks in use =
Line 19: Line 26:
* nat : '''192.168.69.0/30'''
* nat : '''192.168.69.0/30'''


= Network =
== HPC Network - Infiniband ==
 
* [https://www.mellanox.com/files/related-docs/prod_ib_switch_systems/pb_sb7800.pdf switch "''swib''"] : SB7800 (4xEDR, 100Gb/s)
[[Image:Lyon_net.png|Lyon Network Topology]]
* gemini : 3 interfaces connected to ''swib'' (4xEDR 100Gb/s)
** Card model: ''Mellanox Technologies MT27800 Family (MT4119)''
** driver: ''mlx5_core''
* pyxis : 1 interface connected to ''swib'' (4xEDR, 100Gb/s)
** Card model: ''Mellanox Technologies MT28908 Family [ConnectX-6] (MT4123)''
** driver: ''mlx5_core''
* alcor (''group storage''): 1 interface connected to ''swib'' (4xFDR, 56Gb/s)
** Card model: ''Mellanox Technologies MT27800 Family [ConnectX-5] (MT4119)''
** driver: ''mlx5_core''
[[File:LyonHPCNetwork.png|1500px]]<br/>
''(image generated from ibnetdiscover and [https://github.com/cyberang3l/InfiniBand-Graphviz-ualization InfiniBand-Graphviz-ualization])''

Revision as of 11:08, 26 April 2021

See also: Hardware description for Lyon

Overview of Ethernet network topology

LyonNetwork.png


Network devices models

  • force10: Force10 S4810
  • gw: Dell EMC S4128F-ON
  • salome: FESX448+2XG-PREM
  • sneowise: Arctica 4808xs
  • sneowiseib1: Mellanox QM8700
  • sneowiseib2: Mellanox QM8700
  • swib: Mellanox SB7800

More details (including address ranges) are available from the Grid5000:Network page.

IP networks in use

You have to use a public network range to run an experiment between several Grid5000 sites.

Public Networks

  • computing : 172.16.48.0/20
  • virtual : 10.140.0.0/14

Local Networks

  • admin : 172.17.48.0/20
  • nat : 192.168.69.0/30

HPC Network - Infiniband

  • switch "swib" : SB7800 (4xEDR, 100Gb/s)
  • gemini : 3 interfaces connected to swib (4xEDR 100Gb/s)
    • Card model: Mellanox Technologies MT27800 Family (MT4119)
    • driver: mlx5_core
  • pyxis : 1 interface connected to swib (4xEDR, 100Gb/s)
    • Card model: Mellanox Technologies MT28908 Family [ConnectX-6] (MT4123)
    • driver: mlx5_core
  • alcor (group storage): 1 interface connected to swib (4xFDR, 56Gb/s)
    • Card model: Mellanox Technologies MT27800 Family [ConnectX-5] (MT4119)
    • driver: mlx5_core

LyonHPCNetwork.png
(image generated from ibnetdiscover and InfiniBand-Graphviz-ualization)