Nancy:Network

From Grid5000
Revision as of 13:42, 18 April 2007 by Lhablot (talk | contribs) (Adding template on the top of page)
Jump to navigation Jump to search


HP ProCurve 3400cl-48G switch
HP ProCurve 2824 switch
HP ProCurve 2650 switch

Cluster's nodes are connected on an experimentation network, to compute, and on a management network, for their monitoring. The cluster is also interconnected to Grid'5000, to compute with nodes from the rest of the grid, and to Loria, to permit an access to the cluster from outside.

Experiment network

Topology

The experiments network is composed of two switches :

  • 48-port HP ProCurve 3400cl-48G, which receives Grid'5000 traffic
  • 24-port HP ProCurve 2824, which receives Laboratory traffic

All the compute nodes are connected to the 48-port switch, to avoid jump between switchs during an experiment. The service nodes are connected to the 24-port switch.

The 48-port switch is equipped with a 10Gbit transceiver. It receives Grid'5000 traffic on this uplink from the others clusters of the grid. The 24-port switch is connected to the laboratory with one of its 1Gbit uplink.

Nancy's experiment network topology


Addressing

Compute nodes, service nodes and network switches possess an IP address on the experiment network. All these materials are independently numbered. Moreover the two network interfaces of the compute nodes are also independently numbered. So there is a service node n°1 and compute node n°1, with a n°1A for its first interface and a n°1B for its second. It is important that the IP address coroborates this numbering. So, the chosen IP network is 172.28.52.0/22.

Address:   172.28.52.0          10101100.00011100.001101 00.00000000
Netmask:   255.255.252.0 = 22   11111111.11111111.111111 00.00000000
Wildcard:  0.0.3.255            00000000.00000000.000000 11.11111111
=>
Network:   172.28.52.0/22       10101100.00011100.001101 00.00000000
HostMin:   172.28.52.1          10101100.00011100.001101 00.00000001
HostMax:   172.28.55.254        10101100.00011100.001101 11.11111110
Broadcast: 172.28.55.255        10101100.00011100.001101 11.11111111
Hosts/Net: 1022                  Class B, Private Internet

This network range is divided between the materials this way :

  • 172.28.52.[1-255] are dedicated to this network switches
  • 172.28.53.[1-255] are dedicated to service nodes
  • 172.28.54.[1-254] are dedicated to compute nodes first interface
  • 172.28.55.[1-254] are dedicated to compute nodes second interface


Naming

Compute nodes, service nodes and network switches are named on the experiment network. Each possess 2 kind of name : one defined in the Grid'5000 specification and another one derived from the cluster name. These names contain the material numbering, which coroborates the IP address.

Switch

  • switch[1-255].nancy.grid5000.fr
  • sgrillon[1-255].nancy.grid5000.fr

Service node

  • frontale[1-255].nancy.grid5000.fr
Note: frontale.nancy.grid5000.fr is also used for default service node.
  • fgrillon[1-255].nancy.grid5000.fr
Note: fgrillon.nancy.grid5000.fr is also used for default service node.

Compute node

Each compute network interface possess its own name :

  • node-[X]-a.nancy.grid5000.fr
Note: node-[X].nancy.grid5000.fr is also used for the first interface.
  • grillon-[X]-a.nancy.grid5000.fr
Note: grillon-[X].nancy.grid5000.fr is also used for the first interface.
  • node-[X]-b.nancy.grid5000.fr
  • grillon-[X]-b.nancy.grid5000.fr


Management network

Topology

The management network is composed of one switch :

  • 50-port HP ProCurve 2650

All compute nodes are connected to the management switch with their iLO management card. Service nodes are also connected to this switch with their second compute network interface. This way, you can access the management network from these service nodes.

The service node iLO management cards are connected to the 24-port experiment switch. Thanks to this, these interfaces can be accessed from the laboratory network. They are not part of the management network.

Nancy's management network topology


Addressing

Compute nodes, service nodes and the switch, that participates, possess an IP address on the management network. The numbering used is the same as the experiment network one. IP address keeps coroborate this numbering. So, the chosen IP network is 172.28.152.0/22.

Address:   172.28.152.0         10101100.00011100.100110 00.00000000
Netmask:   255.255.252.0 = 22   11111111.11111111.111111 00.00000000
Wildcard:  0.0.3.255            00000000.00000000.000000 11.11111111
=>
Network:   172.28.152.0/22      10101100.00011100.100110 00.00000000
HostMin:   172.28.152.1         10101100.00011100.100110 00.00000001
HostMax:   172.28.155.254       10101100.00011100.100110 11.11111110
Broadcast: 172.28.155.255       10101100.00011100.100110 11.11111111
Hosts/Net: 1022                  Class B, Private Internet

This network range is divided between the materials in a similar way as experiment network does :

  • 172.28.152.[1-255] are dedicated to this network switches
  • 172.28.153.[1-255] are dedicated to service nodes
  • 172.28.154.[1-254] are dedicated to compute nodes


Naming

Compute nodes, service nodes and network switches are named on the experiment network. Each possess only one name, derived from cluster name in a manner to keep in mind that the interface is dedicated to management tasks. Names contain the material numbering, which coroborates the IP address.

  • sgrillade[1-255].nancy.grid5000.fr are dedicated to this network switches
  • fgrillade[1-255].nancy.grid5000.fr are dedicated to service nodes
  • grillade-[1-255].nancy.grid5000.fr are dedicated to compute nodes


Grid'5000 interconnect

Topology

Connection to others Grid'5000 sites uses the national research network, called Renater. This network uses the 10Gbit Ethernet technology.

Nancy Grid'5000 interconnect

The local Renater site is managed by the CIRIL, which is located at 2 km from the Loria, which hosts Nancy's Grid'5000 cluster. This distance implies the use of a fiber medium with the 10GBASE-LR technology. The 48-port experiment network switch, which is equipped with a 10GbE LR transceiver, takes in charge the Grid'5000 interconnect.

Fiber linking to the CIRIL is not direct. Firstly, fiber goes down to the Faculté des Sciences. After that, it goes to Loria. Finally, it arrives on the cluster.

Nancy's Grid'5000 linking

Note: All the used fiber cables are dedicated to our Grid'5000 interconnect. When it is said trunk on the above figure it means a more rigid garter.

Addressing

Not yet defined


Naming

There is no specific naming for the Grid'5000 interconnect, because the experiment network names are used on the entire grid.


Loria interconnect

Topology

The Loria laboratory possess a 1Gbit Ethernet network. Service nodes of the cluster are connected to this network. So the 24-port experiment switch, which connects service nodes, makes the uplink to this network.

Nancy's Loria interconnect

Nancy's Grid'5000 cluster is hosted in Loria building. So cabling distance is short. 1000BASE-T technology is used with an RJ-45 CAT6 cable. The 24-port experiment switch is directly linked to the Loria router.

Nancy's Loria linking


Addressing

Loria uses a public IP address range for its materials : 152.81.0.0/16. Within this range, the subnet 152.81.45.0/24 is dedicated to Grid'5000 cluster:

  • 152.81.45.[101-1??] are dedicated to service node first experiment interface
  • 152.81.44.[201-2??] are dedicated to service node management interface
Note.png Note

Service node first experiment interfaces possess 2 IP addresses:

  • eth0 for cluster's intraconnect: 172.28.53.[1-X]
  • eth0:0 for Loria's interconnect: 152.81.45.[101-1XX]

Naming

Service node interfaces connected to Loria network are also named on it. These names are gathered into grid5000.loria.fr subdomain :

  • fgrillon[1-??].grid5000.loria.fr are dedicated to service node second experiment interface
Note: fgrillon.grid5000.loria.fr, grillon.grid5000.loria.fr and acces.nancy.grid5000.fr are also used for default service node.
  • fgrillade[1-??].grid5000.loria.fr are dedicated to service node management interface