Rennes:Network

Network: Global | Grenoble | Lille | Luxembourg | Lyon | Nancy | Nantes | Rennes | Sophia | Strasbourg | Toulouse

IP networks in use

You have to use a public network range to run an experiment between several Grid5000 sites.

Public networks

• computing : 131.254.202.0/23

Routed private networks

• virtual : 10.156.0.0/14

Local networks

• ipmi : 192.168.202.0/23
• 10G nets : 192.168.200.0/24 : see High Performance Networks

Network

Experiment Network

• Our network connectivity is provided by a single switch: a Cisco 6509. It provides us with a gigabit ethernet connection to each cluster node, a 10G uplink to Renater and a Gigabit uplink to the IRISA Network (used for DNS/NTP access, and connection to satellite sites).

Node names

• Compute nodes must be reserved before use with OAR on frontend.rennes.grid5000.fr

Cluster	Compute Nodes Alias
Dell	paramount-{1..33}.rennes.grid5000.fr	paramount-{1..33}-eth0.rennes.grid5000.fr
HP Proliant	parapluie-{1..40}.rennes.grid5000.fr	parapluie-{1..40}-eth1.rennes.grid5000.fr
Carri System	paradent-{1..64}.rennes.grid5000.fr	paradent-{1..64}-eth0.rennes.grid5000.fr
Sun Microsystem	parapide-{1..25}.rennes.grid5000.fr	parapide-{1..25}-eth0.rennes.grid5000.fr

High Performance Networks

Myrinet 10G on DELL nodes (paramount)

Nodes

• paramount-1 to paramount-33 have a 10GB Myrinet card.

• Sources path : /usr/local/src/mx-1.2.11
• Installation options :

$ ./configure --prefix=/usr

• OAR property : myri10g=YES and myri10gmodel=10g-pcie-8a-c ([1]).
• IP over MX addressing : paramount-[1..33]-myri0.rennes.grid5000.fr (192.168.201.171 à 192.168.201.203)

Switch

• slot m M3-MONITOR
  • uc microcode version: M3 Switch Firmware v3.0 Type: LCMONITOR Compiled on: Oct 29 2004 16:44:54
  • uc rom version: 9S08 Monitor v1.0 Compiled on: Oct 17 2004 23:15:08
  • firmware: vv0.9.9.35 Feb 5 2009 18:20:36
• slot 0 10G-SW16LC-6C2ER
  • uc microcode version: M4 Switch Firmware v1.2 Type: 10G-SW16LC-6C2ER Compiled on: Oct 31 2008 14:57:55
  • uc rom version: 9S08 Monitor v1.0 Compiled on: Oct 17 2004 23:15:08
• slot 1 10G-SW16LC-8C
  • uc microcode version: M4 Switch Firmware v0.9 Type: 10G-SW16LC-8C Compiled on: Nov 28 2005 16:49:14
  • uc rom version: 9S08 Monitor v1.0 Compiled on: Oct 17 2004 23:15:08
• slot 2 10G-SW16LC-8C
• slot 3 10G-SW16LC-8C
• slot 4 10G-SW16LC-8C
• slot 5 10G-SW16LC-8C
• slot 6 10G-SW16LC-8C
• slot 7 10G-SW16LC-8C
• slot 12 10G-SW16LC-8C
• slot 13 10G-SW16LC-8C
• slot 14 10G-SW16LC-8C
• slot 15 10G-SW16LC-8C
• slot 16 10G-SW16LC-8C

10G Infiniband SDR (parapide, parapluie)

Nodes

• parapide-1 to parapide-25 have a 10G Infiniband SDR card.
• parapluie-1 to parapluie-40 have a 10G Infiniband SDR card.

• sources path : /usr/local/src/OFED-1.5

• OAR property : ib10g=YES and ib10gmodel=MT25418.
• IP over IB addressing : parapide-[1..25]-ib0.rennes.grid5000.fr (192.168.200.221 à 192.168.200.245)
• IP over IB addressing : parappluie-[1..40]-ib0.rennes.grid5000.fr (192.168.201.1 à 192.168.201.40)

Voltaire Switch ISR2012-056c

• Gateway : 192.168.200.1
• Hardware :

L:ISR2012-056c# version show
version: 5.4.0
date:    Mar 19 2009 02:47:23 PM
build Id:958

L:ISR2012-056c# front show 
Device: HW Version: B02; Serial Number: CN2309001330
sFB-2012 #1: Temperature: 32C; HW Version: A05; Serial Number: CN1409000632
sFB-2012 #2: Temperature: 31C; HW Version: A05; Serial Number: CN1409000631
sFB-2012 #3: Temperature: 30C; HW Version: A05; Serial Number: CN1409000634
sFB-2012 #4: Temperature: 34C; HW Version: A05; Serial Number: CN1409000630
sMB: Temperature: 28C; HW Version: E01; Serial Number: CN2309001258
sFU-8: Temperature: 24C
sFU-4: Temperature: 22C

L:ISR2012-056c# rear show
sLB-2024 #1: Temperature: 32C; HW Version: A03; Serial Number: CN1409000554
sRB-20210G #2: Temperature: 35C; HW Version: B00; Serial Number: CN2709001005
sLB-2024 #3: Temperature: 28C; HW Version: A04; Serial Number: CN0610001939

OpenMPI

• Source path : /usr/local/src/openmpi-1.4.1-g5k
• Installation options :

$ ./configure --prefix=/usr --with-mx=/usr --with-openib=/usr