Status: Difference between revisions

From Grid5000
Jump to navigation Jump to search
m (→‎DrawOARGantt: Reims alpha order)
(46 intermediate revisions by 10 users not shown)
Line 1: Line 1:
{{Maintainer|Florian Le Goff}}
{{Maintainer|Sebastien Badia}}
{{Author|Florian Le Goff}}
{{Status|In production}}
{{Status|In production}}
{{Portal|User}}
{{Portal|User}}
{{Portal|Platform}}
{{Portal|Platform}}


= [https://api.grid5000.fr/ui/events.html Current events] (maintenance, issues...) =
= [https://www.grid5000.fr/status/ Current events] (maintenance, issues...) =
If you experience problems, please [https://api.grid5000.fr/ui/events.html check the grid administration schedule], where past, present and future incidents (planned or not...) are notified for all sites.
If you experience problems, please [https://www.grid5000.fr/status/ check the platform's administration schedule], where past, present and future incidents (planned or not...) are notified for all sites.


= Monika =
= Monika =
[http://oar.imag.fr/ Monika] displays current and scheduled [[OAR]] jobs.
[http://oar.imag.fr/ Monika] displays current and scheduled OAR jobs.


You can select an individual site or cluster:
You can select an individual site or cluster:
Line 14: Line 15:
|-
|-
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Bordeaux/monika.cgi Bordeaux]
[https://intranet.grid5000.fr/oar/Grenoble/monika.cgi Grenoble]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Grenoble/monika.cgi Grenoble]
[https://intranet.grid5000.fr/oar/Lille/monika.cgi Lille]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Lille/monika.cgi Lille]
[https://intranet.grid5000.fr/oar/Luxembourg/monika.cgi Luxembourg]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Lyon/monika.cgi Lyon]
[https://intranet.grid5000.fr/oar/Lyon/monika.cgi Lyon]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Nancy/monika.cgi Nancy]
[https://intranet.grid5000.fr/oar/Nancy/monika.cgi Nancy]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Orsay/monika.cgi Orsay]
[https://intranet.grid5000.fr/oar/Nancy/monika-prod.cgi Nancy (production)]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Reims/monika.cgi Reims]
[https://intranet.grid5000.fr/oar/Nantes/monika.cgi Nantes]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Rennes/monika.cgi Rennes]
[https://intranet.grid5000.fr/oar/Rennes/monika.cgi Rennes]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Sophia/monika.cgi Sophia]
[https://intranet.grid5000.fr/oar/Sophia/monika.cgi Sophia]
|}
 
= Drawgantt =
[http://oar.imag.fr/ Drawgantt] displays past, current and future OAR jobs.
 
Default view:
{|
|-
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/ Grenoble]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/ Lille]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/ Luxembourg]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/ Lyon]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/ Nancy]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Toulouse/monika.cgi Toulouse]
[https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/ Nancy (production)]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Nantes/drawgantt-svg/ Nantes]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Rennes/drawgantt-svg/ Rennes]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://intranet.grid5000.fr/oar/Sophia/drawgantt-svg/ Sophia]
|}
|}


Or view the [https://www.grid5000.fr/gridstatus/oargridmonika.cgi global snapshot of the grid].


= DrawOARGantt =
Forecast over 1 week:
[http://oar.imag.fr/ DrawOARGantt] displays past, current and scheduled [[OAR]] jobs.
 
You can select an individual site or cluster:
{|
{|
|-
|-
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Bordeaux/DrawOARGantt.pl Bordeaux]
[https://intranet.grid5000.fr/oar/Grenoble/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Grenoble]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Grenoble/DrawOARGantt.pl Grenoble]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Lille/DrawOARGantt.pl Lille]
[https://intranet.grid5000.fr/oar/Lille/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Lille]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Lyon/DrawOARGantt.pl Lyon]
[https://intranet.grid5000.fr/oar/Luxembourg/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Luxembourg]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Nancy/DrawOARGantt.pl Nancy]
[https://intranet.grid5000.fr/oar/Lyon/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Lyon]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Orsay/DrawOARGantt.pl Orsay]
[https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Nancy]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Reims/DrawOARGantt.pl Reims]
[https://intranet.grid5000.fr/oar/Nancy/drawgantt-svg-prod/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Nancy (production)]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Rennes/DrawOARGantt.pl Rennes]
[https://intranet.grid5000.fr/oar/Nantes/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Nantes]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Sophia/DrawOARGantt.pl Sophia]
[https://intranet.grid5000.fr/oar/Rennes/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Rennes]
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#ffffff" valign="top" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[https://helpdesk.grid5000.fr/oar/Toulouse/DrawOARGantt.pl Toulouse]
[https://intranet.grid5000.fr/oar/Sophia/drawgantt-svg/?relative_start=-28800&relative_stop=604800&filter=all%20clusters&timezone=Europe/Paris&resource_base=host&scale=10 Sophia]
|}
|}


Or view the [https://www.grid5000.fr/gridstatus/oargridgantt.cgi global grid Gantt diagram].
 
Or view the [https://www.grid5000.fr/gridstatus/oargridgantt.cgi global Grid'5000 Gantt diagram].


= Network Monitoring =
= Network Monitoring =
== Backbone network status and load ==
[http://pasillo.renater.fr/weathermap/weathermap_g5k.html Grid'5000 Weathermap]  (courtesy of Renater)
Shows the actual state of the opticals links between the Grid'5000 10Gb-ready sites. A link painted in black on the weathermap means that you won't be able to access this site nodes from the Grid'5000 internal network.
== Sites network traffic ==
[https://intranet.grid5000.fr/supervision/grenoble/monitoring/network/last/minute/ Grenoble]
[https://intranet.grid5000.fr/supervision/lille/monitoring/network/last/minute/ Lille]
[https://intranet.grid5000.fr/supervision/lyon/monitoring/network/last/minute/ Lyon]
[https://intranet.grid5000.fr/supervision/luxembourg/monitoring/network/last/minute/ Luxembourg]
[https://intranet.grid5000.fr/supervision/nancy/monitoring/network/last/minute/ Nancy]
[https://intranet.grid5000.fr/supervision/nantes/monitoring/network/last/minute/ Nantes]
[https://intranet.grid5000.fr/supervision/rennes/monitoring/network/last/minute/ Rennes]
[https://intranet.grid5000.fr/supervision/sophia/monitoring/network/last/minute/ Sophia]
== Latency monitoring ==
[https://intranet.grid5000.fr/smokeping/Lille/?target=G5KCore Grid'5000 Interlink Latency] (please check  [http://oss.oetiker.ch/smokeping/doc/reading.en.html Reading the Graphs] if you are not used to Smokeping graphs).
We are using the ping / ICMP probes in order to monitor the backbone's latency. Smokeping forks Fping every 300 seconds on each site in order to ping 20 times the adminfront of each site (including himself). Each site is trying to ping the others one, allowing us to get a full view of the network from each site.
Each host is pinged 20 times (similar to a ping -c 20) in order to study :
* '''Packet Loss''' (PL) occurring the link. Packet Loss can be caused by the saturation of a link. When a router or switch buffers are unable to store packets, the packets are dropped. It may also be caused by a faulty transmitting equipment somewhere, a link flapping (up/down/up/down...) caused by a faulty component.
* '''The variance between each ping'''. If the first comes back in 10ms, then the second in 50ms, then 5ms... there is something weird going on (network overload or routing issues). The graphs is plotting the median value then drawing smoke under and upper the point. If the median is 20ms, the min 10m and max 80ms, you will have a colored point at 20ms then smoke going from 10ms to 80ms.
A dashboard combining links and real-time data is also available on the [https://intranet.grid5000.fr/net/Lille/ Grid'5000 Backbone Network Monitoring] page.


We provide a complete range of network monitoring and metrology tools that you may find on [[Network_interlink#Monitoring]].
= Power Monitoring =
* [https://intranet.grid5000.fr/supervision/lille/monitoring/energy/last/minute/ Lille]
* [https://intranet.grid5000.fr/supervision/lyon/monitoring/energy/last/minute/ Lyon]
* [https://intranet.grid5000.fr/supervision/nancy/monitoring/energy/last/minute/ Nancy]
* [https://intranet.grid5000.fr/supervision/rennes/monitoring/energy/last/minute/ Rennes]


A dashboard combining links and real-time data is also available on the [https://helpdesk.grid5000.fr/net/Lille/ Grid5000 Backbone Network Monitoring] page.
= Usage statistics =
[https://intranet.grid5000.fr/stats/ Site availability] over time gathers a lot of statistics about raw usage of the platform


= Kaspied =
= Kaspied =
Kaspied is a statistic tool provided to show who is using the platform.
Kaspied is a statistic tool provided to show who is using the platform.


https://www.grid5000.fr/kaspied
https://www.grid5000.fr/kaspied/


= Ganglia =
= Ganglia =
[http://ganglia.sourceforge.net/ Ganglia] provides resources usage metrics (memory, cpu, jobs...) for individual sites or the whole grid.
[http://ganglia.sourceforge.net/ Ganglia] provides resources usage metrics (memory, cpu, jobs...) for individual sites or the whole platform.


https://helpdesk.grid5000.fr/ganglia/
https://intranet.grid5000.fr/ganglia/


= Nagios =
= Nagios =
[http://www.nagios.org/ Nagios] monitors critical grid servers and services and automatically reports incidents and failures.
[http://www.nagios.org/ Nagios] monitors critical servers and services and automatically reports incidents and failures.


[https://helpdesk.grid5000.fr/nagios/ Grid'5000 Nagios monitoring page.]
[https://intranet.grid5000.fr/nagios/ Grid'5000 Nagios monitoring page.]

Revision as of 14:12, 29 January 2018


Current events (maintenance, issues...)

If you experience problems, please check the platform's administration schedule, where past, present and future incidents (planned or not...) are notified for all sites.

Monika

Monika displays current and scheduled OAR jobs.

You can select an individual site or cluster:

Grenoble

Lille

Luxembourg

Lyon

Nancy

Nancy (production)

Nantes

Rennes

Sophia

Drawgantt

Drawgantt displays past, current and future OAR jobs.

Default view:

Grenoble

Lille

Luxembourg

Lyon

Nancy

Nancy (production)

Nantes

Rennes

Sophia


Forecast over 1 week:

Grenoble

Lille

Luxembourg

Lyon

Nancy

Nancy (production)

Nantes

Rennes

Sophia


Or view the global Grid'5000 Gantt diagram.

Network Monitoring

Backbone network status and load

Grid'5000 Weathermap (courtesy of Renater)

Shows the actual state of the opticals links between the Grid'5000 10Gb-ready sites. A link painted in black on the weathermap means that you won't be able to access this site nodes from the Grid'5000 internal network.

Sites network traffic

Grenoble Lille Lyon Luxembourg Nancy Nantes Rennes Sophia

Latency monitoring

Grid'5000 Interlink Latency (please check Reading the Graphs if you are not used to Smokeping graphs).

We are using the ping / ICMP probes in order to monitor the backbone's latency. Smokeping forks Fping every 300 seconds on each site in order to ping 20 times the adminfront of each site (including himself). Each site is trying to ping the others one, allowing us to get a full view of the network from each site.

Each host is pinged 20 times (similar to a ping -c 20) in order to study :

  • Packet Loss (PL) occurring the link. Packet Loss can be caused by the saturation of a link. When a router or switch buffers are unable to store packets, the packets are dropped. It may also be caused by a faulty transmitting equipment somewhere, a link flapping (up/down/up/down...) caused by a faulty component.
  • The variance between each ping. If the first comes back in 10ms, then the second in 50ms, then 5ms... there is something weird going on (network overload or routing issues). The graphs is plotting the median value then drawing smoke under and upper the point. If the median is 20ms, the min 10m and max 80ms, you will have a colored point at 20ms then smoke going from 10ms to 80ms.


A dashboard combining links and real-time data is also available on the Grid'5000 Backbone Network Monitoring page.

Power Monitoring

Usage statistics

Site availability over time gathers a lot of statistics about raw usage of the platform

Kaspied

Kaspied is a statistic tool provided to show who is using the platform.

https://www.grid5000.fr/kaspied/

Ganglia

Ganglia provides resources usage metrics (memory, cpu, jobs...) for individual sites or the whole platform.

https://intranet.grid5000.fr/ganglia/

Nagios

Nagios monitors critical servers and services and automatically reports incidents and failures.

Grid'5000 Nagios monitoring page.