Grid5000:Home: Difference between revisions

From Grid5000
Jump to navigation Jump to search
(Add news about CLCAR)
No edit summary
 
(143 intermediate revisions by 13 users not shown)
Line 1: Line 1:
__NOTOC__ __NOEDITSECTION__
__NOTOC__ __NOEDITSECTION__
{|width="95%"
{|width="95%"
|-
|- valign="top"
| width="20%" |
|bgcolor="#888888" style="border:1px solid #cccccc;padding:2em;padding-top:1em;"|
[[Image:Logo_Aladdin.png|250px]]
[[File:Slices-ri-white-color.png|260px|left|link=https://www.slices-ri.eu]]
|
<b>Grid'5000 is a precursor infrastructure of [https://www.slices-ri.eu SLICES-RI], Scientific Large Scale Infrastructure for Computing/Communication Experimental Studies.</b>
= ALADDIN-G5K : ensuring the development of '''Grid'5000''' =
<br/>
= for the 2008-2012 period =
Content on this website is partly outdated. Technical information remains relevant.
 
''An infrastructure distributed in 9 sites around France, for research in large-scale parallel and distributed systems''
 
Engineers ensuring the development and day to day support of the infrastructure are mostly provided by INRIA, under the ''ADT ALADDIN-G5K''  initiative.
 
|}
|}


Line 17: Line 12:
|- valign="top"
|- valign="top"
|bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
==Latest news==
[[Image:g5k-backbone.png|thumbnail|260px|right|Grid'5000|link=https://www.grid5000.fr]]
[[Image:CLCAR2009.jpg|left|120px]]
'''Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing, including Cloud, HPC, Big Data and AI.'''
=== Grid'5000 Tutorial at [http://eventos.saber.ula.ve/eventos/conferenceDisplay.py?confId=56 CLCAR 2009] in Venezuela  ===
 
[https://www.grid5000.fr/mediawiki/index.php/Special:G5KReports?menu=renderreport&username=Ygeorgiou Yiannis Georgiou] will present a Grid5000 tutorial at the 2nd edition of Latin American Conference on High Performance Computing (CLCAR) held in Merida, Venezuela (21-25 September 2009).
Key features:
----
* provides '''access to a large amount of resources''': 15000 cores, 800 compute-nodes grouped in homogeneous clusters, and featuring various technologies: PMEM, GPU, SSD, NVMe, 10G and 25G Ethernet, Infiniband, Omni-Path
=== Latest updated experiment descriptions ===
* '''highly reconfigurable and controllable''': researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer
{{#experiments:3}}
* '''advanced monitoring and measurement features for traces collection of networking and power consumption''', providing a deep understanding of experiments
----
* '''designed to support Open Science and reproducible research''', with full traceability of infrastructure and software changes on the testbed
=== Latest updated publications ===
* '''a vibrant community''' of 500+ users supported by a solid technical team
{{#publications:3}}
 
----
<br>
=== Best Student Demo Award given to Grid'5000 users at [http://www.sigmetrics.org/sigmetrics/ Sigmetrics/Performance 2009] at Seattle ===
Read more about our [[Team|teams]], our [[Publications|publications]], and the [[Grid5000:UsagePolicy|usage policy]] of the testbed. Then [[Grid5000:Get_an_account|get an account]], and learn how to use the testbed with our [[Getting_Started|Getting Started tutorial]] and the rest of our [[:Category:Portal:User|Users portal]].
This award was given to [https://www.grid5000.fr/mediawiki/index.php/Special:G5KReports?menu=renderreport&username=Ploiseau Patrick Loiseau], [https://www.grid5000.fr/mediawiki/index.php/Special:G5KReports?menu=renderreport&username=rguillie Romaric Guillier], [https://www.grid5000.fr/mediawiki/index.php/Special:G5KReports?menu=renderreport&username=Ogoga Oana Goga], [https://www.grid5000.fr/mediawiki/index.php/Special:G5KReports?menu=renderreport&username=Mimbert Matthieu Imbert], [https://www.grid5000.fr/mediawiki/index.php/Special:G5KReports?menu=renderreport&username=Pgoncalves Paulo Goncalves], [https://www.grid5000.fr/mediawiki/index.php/Special:G5KReports?menu=renderreport&username=Pprimet Pascale Vicat-Blanc Primet] (INRIA, ENS-Lyon, University of Lyon, France) for their demo [http://www.sigmetrics.org/sigmetrics/demo/Demo_Loiseau_et_al.pdf Automated Traffic Measurements and Analysis in Grid'5000] demo at the [http://www.sigmetrics.org/sigmetrics/program_sigmetrics-demo.shtml demo session]
 
----
<br>
=== Grid'5000 under extension to Porto Alegre, Brazil ===
Published documents and presentations:
July 21st, 2009, INRIA and UFRGS signed a Memorandum of Understanding marking
* [[Media:Grid5000.pdf|Presentation of Grid'5000]] (April 2019)
the cooperation of the two institutes towards the extension of the
* [https://www.grid5000.fr/mediawiki/images/Grid5000_science-advisory-board_report_2018.pdf Report from the Grid'5000 Science Advisory Board (2018)]
Grid'5000 platform to Brazil.


According to the terms of this memo, UFRGS will contribute to Grid'5000
Older documents:
by operating a local site in Porto Alegre and INRIA will fully
* [https://www.grid5000.fr/slides/2014-09-24-Cluster2014-KeynoteFD-v2.pdf Slides from Frederic Desprez's keynote at IEEE CLUSTER 2014]
integrate this local site into Grid'5000 in order to gain an
* [https://www.grid5000.fr/ScientificCommittee/SAB%20report%20final%20short.pdf Report from the Grid'5000 Science Advisory Board (2014)]
international scale. Researchers from both partners will therefore gain
access to one of the major scientific instruments for the study of
large-scale parallel and distributed problems in computer science. With
this cooperation, Grid'5000 gives its users the possibility to study the
effects of inter-continental networks links on these problems.


For Grid'5000 users, access to the new site during the integration phase
<br>
is possible using portoalegre.grenoble as name of the new site
Grid'5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several Universities as well as other organizations. Inria has been supporting Grid'5000 through ADT ALADDIN-G5K (2007-2013), ADT LAPLACE (2014-2016), and IPL [[Hemera|HEMERA]] (2010-2014).
----
=== Grid'5000 showcased during the Open Days of Bell Labs France ===
June 2nd, 2009, MEtroflux/NXE tools where shown using Grid'5000 during a week during the Open Days of Bell Labs France, demonstrating the potential of Grid'5000 as a research instrument.
----
[[Grid5000:News|read more news]]
|}
|}


<br>
<br>
==Grid'5000 at a glance==
{{#status:0|0|0|http://bugzilla.grid5000.fr/status/upcoming.json}}
[[Image:site_map.png|thumbnail|128px|right|Grid'5000 sites]]
<br>
* '''Grid'5000''' is a scientific instrument for the study of large scale parallel and distributed systems. It aims at providing a '''highly reconfigurable, controlable and monitorable experimental platform''' to its users. The initial aim (circa 2003) was to reach 5000 processors in the platform. It has been reframed at 5000 cores, and was reached during winter 2008-2009.
 
* The infrastructure of Grid'5000 is geographically distributed on different sites hosting the instrument, initialy 9 in France. Porto Alegre, Brazil is now officially becoming the 10th site.
== Random pick of publications ==
===Sites:===
{{#publications:}}
{|width="75%" cellspacing="3"  
 
==Latest news==
<rss max=4 item-max-length="2000">https://www.grid5000.fr/rss/G5KNews.php</rss>
----
[[News|Read more news]]
 
=== Grid'5000 sites===
{|width="100%" cellspacing="3"  
|- valign="top"
|- valign="top"
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Bordeaux:Home|Bordeaux]]
* [[Grenoble:Home|Grenoble]]
* [[Grenoble:Home|Grenoble]]
* [[Lille:Home|Lille]]
* [[Lille:Home|Lille]]
* [[Luxembourg:Home|Luxembourg]]
* [[Louvain:Home|Louvain]]
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Lyon:Home|Lyon]]
* [[Lyon:Home|Lyon]]
* [[Nancy:Home|Nancy]]
* [[Nancy:Home|Nancy]]
* [[Orsay:Home|Orsay]]
* [[Nantes:Home|Nantes]]
* [[PortoAlegre:Home|Porto Alegre]]
* [[Rennes:Home|Rennes]]
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Rennes:Home|Rennes]]
* [[Sophia:Home|Sophia-Antipolis]]
* [[Sophia:Home|Sophia-Antipolis]]
* [[Strasbourg:Home|Strasbourg]]
* [[Toulouse:Home|Toulouse]]
* [[Toulouse:Home|Toulouse]]
|-
|-
|}
|}
[[Image:Software layers.png|thumbnail|271px|left|Grid'5000 allows experiments in all these software layers]]
* '''Grid'5000''' is a research effort developping a '''large scale nation wide infrastructure for large scale parallel and distributed computing research'''.
* '''17 [[Grid5000:Laboratories|laboratories]]''' are involved in France with the objective of providing the community a testbed allowing experiments in all the software layers between the network protocols up to the applications.
The current plans are to extend from the 9 initial sites each with 100 to a thousand PCs, connected by the [http://www.renater.fr RENATER] Education and Research Network to a bigger platform including a few sites outside France not necessarily connected through a dedicated network connection. Sites in Brazil and Luxembourg should join shortly.
All sites in France are connected to [http://www.renater.fr RENATER] with a 10Gb/s link.
This high collaborative research effort is funded by INRIA, CNRS, the Universities of all sites and some regional councils.
== Initial Rationale==
'''The foundations of Grid'5000''' have emerged from a thorough analysis and numerous discussions about methodologies used for scientific research in the Grid domain. A report presents the [http://www-sop.inria.fr/aci/grid/public/Library/rapport-grid5000-V3.pdf rationale for Grid'5000].
In addition to theory, simulators and emulators, there is a strong need for '''large scale testbeds''' where real life experimental conditions hold. '''The size of Grid'5000''', in terms of number of sites and number of processors per site, was established according to the scale of the experiments and the number of researchers involved in the project.


== Current funding ==
== Current funding ==
As from June 2008, INRIA is the main contributor to [[Grid5000:Funding|Grid'5000 funding]].
{|width="100%" cellspacing="3"
{|width="100%" cellspacing="3"
|-
|-
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===INRIA===
===INRIA===
[[Image:Logo-inria.png]]
[[Image:Logo_INRIA.gif|300px|link=https://www.inria.fr]]
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===CNRS===
===CNRS===
[[Image:Logo-cnrs.png]]
[[Image:CNRS-filaire-Quadri.png|125px|link=https://www.cnrs.fr]]
|-
|-
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===Universities===
===Universities===
University Joseph Fourier, Grenoble<br/>
IMT Atlantique<br/>
University of Rennes 1, Rennes<br/>
Université Grenoble Alpes, Grenoble INP<br/>
Université Rennes 1, Rennes<br/>
Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse<br/>
Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse<br/>
University Bordeaux 1, Bordeaux<br/>
Université Bordeaux 1, Bordeaux<br/>
University Lille 1, Lille<br/>
Université Lille 1, Lille<br/>
Ecole Normale Supérieure, Lyon<br/>
École Normale Supérieure, Lyon<br/>
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===Regional councils===
===Regional councils===
Aquitaine<br/>
Aquitaine<br/>
Auvergne-Rhône-Alpes<br/>
Bretagne<br/>
Bretagne<br/>
Champagne-Ardenne<br/>
Provence Alpes Côte d'Azur<br/>
Provence Alpes Côte d'Azur<br/>
Nord Pas de Calais<br/>
Hauts de France<br/>
Lorraine<br/>
Lorraine<br/>
|}
|}

Latest revision as of 10:02, 11 July 2025

Slices-ri-white-color.png

Grid'5000 is a precursor infrastructure of SLICES-RI, Scientific Large Scale Infrastructure for Computing/Communication Experimental Studies.
Content on this website is partly outdated. Technical information remains relevant.

Grid'5000

Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing, including Cloud, HPC, Big Data and AI.

Key features:

  • provides access to a large amount of resources: 15000 cores, 800 compute-nodes grouped in homogeneous clusters, and featuring various technologies: PMEM, GPU, SSD, NVMe, 10G and 25G Ethernet, Infiniband, Omni-Path
  • highly reconfigurable and controllable: researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer
  • advanced monitoring and measurement features for traces collection of networking and power consumption, providing a deep understanding of experiments
  • designed to support Open Science and reproducible research, with full traceability of infrastructure and software changes on the testbed
  • a vibrant community of 500+ users supported by a solid technical team


Read more about our teams, our publications, and the usage policy of the testbed. Then get an account, and learn how to use the testbed with our Getting Started tutorial and the rest of our Users portal.


Published documents and presentations:

Older documents:


Grid'5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several Universities as well as other organizations. Inria has been supporting Grid'5000 through ADT ALADDIN-G5K (2007-2013), ADT LAPLACE (2014-2016), and IPL HEMERA (2010-2014).


Current status (at 2025-12-02 17:41): 9 current events, 7 planned (details)


Random pick of publications

Five random publications that benefited from Grid'5000 (at least 2925 overall):

  • Gaël Vila, Emmanuel Medernach, Inés Gonzalez, Axel Bonnet, Yohan Chatelain, et al.. The Impact of Hardware Variability on Applications Packaged with Docker and Guix: a Case Study in Neuroimaging. ACM REP'24, ACM, Jun 2024, Rennes, France. pp.75-84, 10.1145/3641525.3663626. hal-04480308v2 view on HAL pdf
  • Anderson Andrei Da Silva. Investigating the Impacts of Multi-Object Scheduling Policies for Serverless Functions on the Edge-Cloud Continuum. Machine Learning cs.LG. Université Grenoble Alpes 2020-.., 2023. English. NNT : 2023GRALM078. tel-04974687 view on HAL pdf
  • Tristan Benoit, Jean-Yves Marion, Sébastien Bardin. Scalable program clone search through spectral analysis. ESEC/FSE '23 - 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Dec 2023, San Francisco, United States. 10.48550/arXiv.2210.13063. hal-03826726v4 view on HAL pdf
  • Juliette Luiselli, Jonathan Rouzaud-Cornabas, Nicolas Lartillot, Guillaume Beslon. Genome Streamlining: Effect of Mutation Rate and Population Size on Genome Size Reduction. Genome Biology and Evolution, 2024, 16, 10.1093/gbe/evae250. hal-04905734 view on HAL pdf
  • Ahmed Alharbi, Charles Bouillaguet. Artificial Results From Hardware Synthesis. 2025. hal-04896063 view on HAL pdf


Latest news

Rss.svgEcotaxe cluster is now in default queue at Nantes

We are pleased to announce that the ecotaxe cluster of Nantes is now available in the default queue.

As a reminder, ecotaxe is a cluster composed of 2 HPE ProLiant DL385 Gen10 Plus v2 servers[1].

Each node features:

  • 2 AMD EPYC 7453 (Zen 3), 28 cores/CPU
  • 3 Nvidia A100 80GB GPU
  • 256 GB memory
  • 1x 1.92 To SSD + 2x 7.68 To SSD
  • 100 Gb/s Intel Ethernet adapter [2].
  • To submit a job on this cluster, the following command may be used:

    oarsub -t exotic -p ecotaxe

    This cluster is co-funded by Région Pays de la Loire, FEDER and REACT EU via the CPER SAMURAI [3].

    [1] https://www.grid5000.fr/w/Nantes:Hardware#ecotaxe

    [2] The observed throughput depends on multiple parameters such as the workload, the number of streams, ... [3] https://www.imt-atlantique.fr/fr/recherche-innovation/collaborer/projet/samurai

    -- Grid'5000 Team 14:10, 02 December 2025 (CET)

    Rss.svgSome changes on the hardware configuration of Grenoble nodes

    We recently did some hardware changes on clusters yeti, troll and dahu.

    The changes are as follows:

  • yeti :
  • Following a malfunction of the two NVMe disks on yeti-3, an NVMe disk from yeti-1 has been transferred to yeti-3 to ensure that we have at least one functional NVMe disk per yeti node. New NVMe configuration of the nodes:
    • yeti-[1,3]: 1× NVMe
    • yeti-[2,4]: 2× NVMe

  • troll :
  • Due to experimentation needs, the steering committee agreed to change the hardware configuration of the troll cluster, replacing the Omnipath HPC network interconnect (interconnecting troll to yeti and dahu) by the Infiniband HPC network interconnect already available for the drac cluster.

  • dahu :
  • A few nodes of the dahu cluster recently encountered a recurrent problem with their OPA interfaces. Instead of fully retiring those nodes, we chose to disable their OPA interfaces.
    This change means that if you want to reserve a dahu node with OPA, you must specify it in your oarsub request. For example:

    oarsub -I -p "dahu and opa_count > 0"

    The nodes that have been modified are dahu-18, dahu-26 and dahu-30. More nodes may be added to this list in the future.

    -- Grid'5000 Team 14:50, 24 November 2025 (CEST)

    Rss.svgCluster "clervaux" is now in the default queue in Luxembourg

    We are pleased to announce that the clervaux[1] cluster of Luxembourg is now available in the default queue.

    Clervaux is a cluster composed of 48 CPU nodes.

    Each node features:

  • 2x CPU Intel Xeon E5-2680 v4 (14 cores/CPU, 2 threads/cores)
  • 128 GiB RAM
  • 1x 120GB SSD SATA disk
  • This cluster was funded by the University of Luxembourg.

    [1] https://www.grid5000.fr/w/Luxembourg:Hardware#clervaux

    -- Grid'5000 Team 10:50, 21 October 2025 (CEST)

    Rss.svgTutorials of the SLICES-FR school 2025

    Ecole-SLICES-FR-2025.png

    The tutorial of the first SLICES-FR School, which was held from July 7th to 11th in Lyon are available on the following pages:

  • All tutorials
  • Grid'5000 tutorials
  • -- Grid'5000 Team 15:19, 1 October 2025 (CEST)


    Read more news

    Grid'5000 sites

    Current funding

    INRIA

    Logo INRIA.gif

    CNRS

    CNRS-filaire-Quadri.png

    Universities

    IMT Atlantique
    Université Grenoble Alpes, Grenoble INP
    Université Rennes 1, Rennes
    Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse
    Université Bordeaux 1, Bordeaux
    Université Lille 1, Lille
    École Normale Supérieure, Lyon

    Regional councils

    Aquitaine
    Auvergne-Rhône-Alpes
    Bretagne
    Champagne-Ardenne
    Provence Alpes Côte d'Azur
    Hauts de France
    Lorraine