Special Features

From Grid5000
Jump to: navigation, search


This page lists features, special hardware or software that is known to be available in Grid'5000 or on the network of Grid'5000 sites, but that is not maintained by the support-staff.

Energy monitoring

See Power Monitoring Devices for more detailed information.

Network probes

High performance networks probes where explored on a few sites. A machine receives a mirror of the outgoing 10G link in Rennes and Lille, and Lyon has dedicated hardware. Rennes and Lyon also have a machine with 2 10G network cards for traffic shaping. Best contact for this is Matthieu Imbert for Lyon, and Pascal Morillon for Rennes.

Nodes with multiple cabled Ethernet interfaces

Grid'5000 provides some clusters with nodes with more than one single cabled Ethernet interface.

List of the clusters

Paranoia (Rennes)

Paranoia has a second network interface of 10Gbps, on enp3s0f1 and a third of 1Gbps on eno1. See the Rennes:Hardware and Rennes:Network#Network pages.

Paravance (Rennes)

Paravance has a second network interface of 10Gbps, on eno2. See the Rennes:Hardware and Rennes:Network#Network pages.

Parasilo (Rennes)

Parasilo has a second network interface of 10Gbps, on eno2. See the Rennes:Hardware and Rennes:Network#Network pages.

Example of usage of the extra network interfaces

We show here how to reserve and configure multiple Ethernet network interfaces.

First we reserve a deploy job:

Terminal.png frontend:
oarsub -I -t deploy -p "eth_count > 1 and cluster = 'cluster-name' " -l nodes=nb_node,walltime=02:00:00

Then we deploy the stretch environment:

Terminal.png frontend:
kadeploy3 -f $OAR_NODEFILE -k -e debian9-x64-nfs


See cluster section to know which Ethernet interfaces can be used. For exemple, on paranoia (Rennes), eth1/enp3s0f1 and eth2/eno1 are cabled. Use I=1 and J=2 for paranoia.

Get node name with interfaces:

Terminal.png frontend:
uniq $OAR_FILE_NODES | sed -e 's/\([^\.]*\)\(.*\)/\1-ethI\2/' > nodes_second_int
Terminal.png frontend:
uniq $OAR_FILE_NODES | sed -e 's/\([^\.]*\)\(.*\)/\1-ethJ\2/' > nodes_third_int

Reserve two Vlan:

Terminal.png frontend:
oarsub -I -t deploy -l {"type='kavlan'"}/vlan=2,walltime=03:00:00

Show vlan number:

Terminal.png frontend:
kavlan -V

Put interfaces on the two different vlan:

Terminal.png frontend:
kavlan -i vlan1 -s -f nodes_second_int
Terminal.png frontend:
kavlan -i vlan2 -s -f nodes_third_int

Get ip on second and third interface :

Terminal.png frontend:
taktuk -d -1 -l root -f `uniq $OAR_NODEFILE` broadcast exec [ 'dhclient enp3s0f1' ]
Terminal.png frontend:
taktuk -d -1 -l root -f `uniq $OAR_NODEFILE` broadcast exec [ 'dhclient eno1' ]

At this moment your node should have 3 IP:

Terminal.png node:
ip a
root@paranoia-8:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether f0:4d:a2:73:ce:3d brd ff:ff:ff:ff:ff:ff
    inet 10.24.70.8/18 brd 10.24.127.255 scope global eno1
       valid_lft forever preferred_lft forever
    inet6 fe80::f24d:a2ff:fe73:ce3d/64 scope link
       valid_lft forever preferred_lft forever
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether f0:4d:a2:73:ce:3e brd ff:ff:ff:ff:ff:ff
4: enp3s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether a0:36:9f:28:a9:18 brd ff:ff:ff:ff:ff:ff
    inet 172.16.100.8/20 brd 172.16.111.255 scope global enp3s0f0
       valid_lft forever preferred_lft forever
    inet6 fe80::a236:9fff:fe28:a918/64 scope link
       valid_lft forever preferred_lft forever
5: enp3s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether a0:36:9f:28:a9:1a brd ff:ff:ff:ff:ff:ff
    inet 10.24.7.8/18 brd 10.24.63.255 scope global enp3s0f1
       valid_lft forever preferred_lft forever
    inet6 fe80::a236:9fff:fe28:a91a/64 scope link
       valid_lft forever preferred_lft forever

For more information, please look at the KaVLAN pages.