Cluster's nodes are connected on an experimentation network, to compute, and on a management network, for their monitoring. The cluster is also interconnected to Grid'5000, to compute with nodes from the rest of the grid, and to Loria, to permit an access to the cluster from outside.
The experiments network is composed of two switches :
- 48-port HP ProCurve 3400cl-48G, which receives Grid'5000 traffic
- 24-port HP ProCurve 2824, which receives Laboratory traffic
All the compute nodes are connected to the 48-port switch, to avoid jump between switchs during an experiment. The service nodes are connected to the 24-port switch.
The 48-port switch is equipped with a 10Gbit transceiver. It receives Grid'5000 traffic on this uplink from the others clusters of the grid. The 24-port switch is connected to the laboratory with one of its 1Gbit uplink.
Compute nodes, service nodes and network switches possess an IP address on the experiment network. All these materials are independently numbered. Moreover the two network interfaces of the compute nodes are also independently numbered. So there is a service node n°1 and compute node n°1, with a n°1A for its first interface and a n°1B for its second. It is important that the IP address coroborates this numbering. So, the chosen IP network is
Address: 172.28.52.0 10101100.00011100.001101 00.00000000 Netmask: 255.255.252.0 = 22 11111111.11111111.111111 00.00000000 Wildcard: 0.0.3.255 00000000.00000000.000000 11.11111111 => Network: 172.28.52.0/22 10101100.00011100.001101 00.00000000 HostMin: 172.28.52.1 10101100.00011100.001101 00.00000001 HostMax: 172.28.55.254 10101100.00011100.001101 11.11111110 Broadcast: 172.28.55.255 10101100.00011100.001101 11.11111111 Hosts/Net: 1022 Class B, Private Internet
This network range is divided between the materials this way :
172.28.52.[1-255]are dedicated to this network switches
172.28.53.[1-255]are dedicated to service nodes
172.28.54.[1-254]are dedicated to compute nodes first interface
172.28.55.[1-254]are dedicated to compute nodes second interface
Compute nodes, service nodes and network switches are named on the experiment network. Each possess 2 kind of name : one defined in the Grid'5000 specification and another one derived from the cluster name. These names contain the material numbering, which coroborates the IP address.
frontale.nancy.grid5000.fr is also used for default service node)
fgrillon.nancy.grid5000.fr is also used for default service node)
Each compute network interface possess its own name :
node-[X].nancy.grid5000.fr is also used for the first interface)
grillon-[X].nancy.grid5000.fr is also used for the first interface)
The management network is composed of one switch :
- 50-port HP ProCurve 2650
All compute nodes are connected to the management switch with their iLO management card. Service nodes are also connected to this switch with their second compute network interface. This way, you can access the management network from these service nodes.
The service node iLO management cards are connected to the 24-port experiment switch. Thanks to this, these interfaces can be accessed from the laboratory network #Loria interconnect. They are not part of the management network.
Compute nodes, service nodes and the switch, that participates, possess an IP address on the management network. The numbering used is the same as the experiment network one. IP address keeps coroborate this numbering. So, the chosen IP network is
Address: 172.28.152.0 10101100.00011100.100110 00.00000000 Netmask: 255.255.252.0 = 22 11111111.11111111.111111 00.00000000 Wildcard: 0.0.3.255 00000000.00000000.000000 11.11111111 => Network: 172.28.152.0/22 10101100.00011100.100110 00.00000000 HostMin: 172.28.152.1 10101100.00011100.100110 00.00000001 HostMax: 172.28.155.254 10101100.00011100.100110 11.11111110 Broadcast: 172.28.155.255 10101100.00011100.100110 11.11111111 Hosts/Net: 1022 Class B, Private Internet
This network range is divided between the materials in a similar way as experiment network does :
172.28.152.[1-255]are dedicated to this network switches
172.28.153.[1-255]are dedicated to service nodes
172.28.154.[1-254]are dedicated to compute nodes
Compute nodes, service nodes and network switches are named on the experiment network. Each possess only one name, derived from cluster name in a manner to keep in mind that the interface is dedicated to management tasks. Names contain the material numbering, which coroborates the IP address.
sgrillade[1-255].nancy.grid5000.frare dedicated to this network switches
fgrillade[1-255].nancy.grid5000.frare dedicated to service nodes
grillade-[1-255].nancy.grid5000.frare dedicated to compute nodes
Connection to others Grid'5000 sites uses the national research network, called Renater. This network uses the 10Gbit Ethernet technology.
The local Renater site is managed by the CIRIL, which is located at 2 km from the Loria, which hosts Nancy's Grid'5000 cluster. This distance implies the use of a fiber medium with the 10GBASE-LR technology. The 48-port experiment network switch, which is equipped with a 10GbE LR transceiver, takes in charge the Grid'5000 interconnect.
Fiber linking to the CIRIL is not direct. Firstly, fiber goes down to the Faculté des Sciences. After that, it goes to Loria. Finally, it arrives on the cluster.
Not yet defined
There is no specific naming for the Grid'5000 interconnect, because the experiment network names are used on the entire grid.
The Loria laboratory possess a 1Gbit Ethernet network. Service nodes of the cluster are connected to this network. So the 24-port experiment switch, which connects service nodes, makes the uplink to this network.
Nancy's Grid'5000 cluster is hosted in Loria building. So cabling distance is short. 1000BASE-T technology is used with an RJ-45 CAT6 cable. The 24-port experiment switch is directly linked to the Loria router.
Loria uses a public IP address range for its materials :
220.127.116.11/16. Within this range, the subnet
18.104.22.168/24 is used for all clustering activities of the laboratory:
152.81.44.[21-??]are dedicated to service node second experiment interface
152.81.44.[121-1??]are dedicated to service node management interface
Service node interfaces connected to Loria network are also named on it. These names are gathered into
grid5000.loria.fr subdomain :
fgrillon[1-??].grid5000.loria.frare dedicated to service node second experiment interface
acces.nancy.grid5000.fr are also used for default service node)
fgrillade[1-??].grid5000.loria.frare dedicated to service node management interface