Grid5000:Home: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
 
(291 intermediate revisions by 17 users not shown)
Line 1: Line 1:
__NOTOC__ __NOEDITSECTION__
__NOTOC__ __NOEDITSECTION__
''5000 CPUs distributed in 9 sites for research in Grid Computing, eScience and Cyber-infrastructures''
{|width="95%"
|- valign="top"
|bgcolor="#888888" style="border:1px solid #cccccc;padding:2em;padding-top:1em;"|
[[File:Slices-ri-white-color.png|260px|left|link=https://www.slices-ri.eu]]
<b>Grid'5000 is a precursor infrastructure of [https://www.slices-ri.eu SLICES-RI], Scientific Large Scale Infrastructure for Computing/Communication Experimental Studies.</b>
<br/>
Content on this website is partly outdated. Technical information remains relevant.
|}


{|width="95%"
{|width="95%"
|- valign="top"
|- valign="top"
|bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[[Image:Logo_sc05.gif|64px|left|SC2005]]
[[Image:g5k-backbone.png|thumbnail|260px|right|Grid'5000|link=https://www.grid5000.fr]]
==Fresh news==
'''Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing, including Cloud, HPC, Big Data and AI.'''
* '''Grid'5000 @ SC2005''': Grid'5000 demonstations are being presented at SuperComputing
 
Key features:
* provides '''access to a large amount of resources''': 15000 cores, 800 compute-nodes grouped in homogeneous clusters, and featuring various technologies: PMEM, GPU, SSD, NVMe, 10G and 25G Ethernet, Infiniband, Omni-Path
* '''highly reconfigurable and controllable''': researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer
* '''advanced monitoring and measurement features for traces collection of networking and power consumption''', providing a deep understanding of experiments
* '''designed to support Open Science and reproducible research''', with full traceability of infrastructure and software changes on the testbed
* '''a vibrant community''' of 500+ users supported by a solid technical team
 
<br>
Read more about our [[Team|teams]], our [[Publications|publications]], and the [[Grid5000:UsagePolicy|usage policy]] of the testbed. Then [[Grid5000:Get_an_account|get an account]], and learn how to use the testbed with our [[Getting_Started|Getting Started tutorial]] and the rest of our [[:Category:Portal:User|Users portal]].
 
<br>
Published documents and presentations:
* [[Media:Grid5000.pdf|Presentation of Grid'5000]] (April 2019)
* [https://www.grid5000.fr/mediawiki/images/Grid5000_science-advisory-board_report_2018.pdf Report from the Grid'5000 Science Advisory Board (2018)]
 
Older documents:
* [https://www.grid5000.fr/slides/2014-09-24-Cluster2014-KeynoteFD-v2.pdf Slides from Frederic Desprez's keynote at IEEE CLUSTER 2014]
* [https://www.grid5000.fr/ScientificCommittee/SAB%20report%20final%20short.pdf Report from the Grid'5000 Science Advisory Board (2014)]


more news [[Grid5000:News|here]]
<br>
Grid'5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several Universities as well as other organizations. Inria has been supporting Grid'5000 through ADT ALADDIN-G5K (2007-2013), ADT LAPLACE (2014-2016), and IPL [[Hemera|HEMERA]] (2010-2014).
|}
|}


<br>
<br>
==Grid'5000 at a glance==
{{#status:0|0|0|http://bugzilla.grid5000.fr/status/upcoming.json}}
[[Image:CarteSites.JPG|thumbnail|128px|right|Grid'5000 sites]]
<br>
* '''Grid'5000''' project aims at building a '''highly reconfigurable, controlable and monitorable experimental Grid platform''' gathering '''9 sites''' geographically distributed in France featuring a total of 5000 CPUs:
 
===Sites:===
== Random pick of publications ==
{|width="75%" cellspacing="3"  
{{#publications:}}
 
==Latest news==
<rss max=4 item-max-length="2000">https://www.grid5000.fr/rss/G5KNews.php</rss>
----
[[News|Read more news]]
 
=== Grid'5000 sites===
{|width="100%" cellspacing="3"  
|- valign="top"
|- valign="top"
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Bordeaux:Home|Bordeaux]]
* [[Grenoble:Home|Grenoble]]
* [[Grenoble:Home|Grenoble]]
* [[Lille:Home|Lille]]
* [[Lille:Home|Lille]]
* [[Luxembourg:Home|Luxembourg]]
* [[Louvain:Home|Louvain]]
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Lyon:Home|Lyon]]
* [[Lyon:Home|Lyon]]
* [[Nancy:Home|Nancy]]
* [[Nancy:Home|Nancy]]
* [[Orsay:Home|Orsay]]
* [[Nantes:Home|Nantes]]
* [[Rennes:Home|Rennes]]
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Rennes:Home|Rennes]]
* [[Sophia:Home|Sophia-Antipolis]]
* [[Sophia:Home|Sophia-Antipolis]]
* [[Strasbourg:Home|Strasbourg]]
* [[Toulouse:Home|Toulouse]]
* [[Toulouse:Home|Toulouse]]
|-
|-
|}
|}


* The main purpose of this platform is to serve as an experimental testbed for research in Grid Computing.
== Current funding ==
* This project is one initiative of the '''French ACI Grid''' Incentive [[Image:LogoACIGRID.jpg]]
 
<br>
==Introduction==
* '''Grid'5000''' is a research effort developping a '''large scale nation wide infrastructure for Grid research'''.
 
* '''17 [[Grid5000:Laboratories|laboratories]]''' are involved, nation wide, in the objective of providing the community of Grid researchers a testbed allowing experiments in all the software layers between the network protocols up to the applications:
{|
|
{| border=1
|- bgcolor="#EEEEEE"
| Applications
|- bgcolor="#DDDDDD"
| Algorithms
|- bgcolor="#CCCCCC"
| Runtime
|- bgcolor="#BBBBBB"
| Middleware
|- bgcolor="#AAAAAA"
| Operating Systems
|- bgcolor="#999999"
| Network protocols
|}
| Grid'5000 will allow Grid experiments France wide in all these software layers
|}
The current plans are to assemble a physical platform featuring 9 clusters, each with 100 to a thousand PCs, connected by the [http://www.renater.fr RENATER] Education and Research Network. All clusters will be connected to Renater at 1 Gb/s (10 Gb/s is expected in near future).
 
This high collaborative research effort is funded by the French ministry of Education and Research, INRIA, CNRS, the Universities of all sites and some regional councils.
 
<br>
==Rationale==
'''The foundations of Grid'5000''' have emerged from a thorough analysis and numerous discussions about methodologies used for scientific research in the Grid domain. A report presents the rational for Grid'5000.
 
In addition to theory, simulators and emulators, there is a strong need for '''large scale testbeds''' where real life experimental conditions hold. '''The size of Grid'5000''', in terms of number of sites and number of CPUs per site, was established according to the scale of the experiments and the number of researchers involved in the project.
 
<br>
==Funding Institutions==
{|width="100%" cellspacing="3"
{|width="100%" cellspacing="3"
|-
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===Ministère de l'Education, de la Jeunesse et de la Recherche===
[[Image:Logo-Ministere-Recherche.jpg]]
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===ACI Grid===
[[Image:LogoACIGRID.jpg]]
|-
|-
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===INRIA===
===INRIA===
[[Image:Logo-inria.gif]]
[[Image:Logo_INRIA.gif|300px|link=https://www.inria.fr]]
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===CNRS===
===CNRS===
[[Image:Logo-cnrs.gif]]
[[Image:CNRS-filaire-Quadri.png|125px|link=https://www.cnrs.fr]]
|-
|-
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===Universities===
===Universities===
University of Paris Sud, Orsay<br/>
IMT Atlantique<br/>
University Joseph Fourier, Grenoble<br/>
Université Grenoble Alpes, Grenoble INP<br/>
University of Nice-Sophia Antipolis, Sophia Antipolis<br/>
Université Rennes 1, Rennes<br/>
University of Rennes 1, Rennes<br/>
Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse<br/>
Institut National Polytechnique de Toulouse / INSA / FERIA, Toulouse<br/>
Université Bordeaux 1, Bordeaux<br/>
University Bordeaux 1, Bordeaux<br/>
Université Lille 1, Lille<br/>
University Lille 1 / GENOPOLE, Lille<br/>
École Normale Supérieure, Lyon<br/>
Ecole Normale Supérieure / MYRICOM, Lyon<br/>
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===Regional councils===
===Regional councils===
Aquitaine<br/>
Auvergne-Rhône-Alpes<br/>
Bretagne<br/>
Bretagne<br/>
Champagne-Ardenne<br/>
Provence Alpes Côte d'Azur<br/>
Provence Alpes Côte d'Azur<br/>
Aquitaine<br/>
Hauts de France<br/>
Ile de France<br/>
Lorraine<br/>
===General Councils===
Alpes Maritimes
|}
|}

Latest revision as of 10:02, 11 July 2025

Slices-ri-white-color.png

Grid'5000 is a precursor infrastructure of SLICES-RI, Scientific Large Scale Infrastructure for Computing/Communication Experimental Studies.
Content on this website is partly outdated. Technical information remains relevant.

Grid'5000

Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing, including Cloud, HPC, Big Data and AI.

Key features:

  • provides access to a large amount of resources: 15000 cores, 800 compute-nodes grouped in homogeneous clusters, and featuring various technologies: PMEM, GPU, SSD, NVMe, 10G and 25G Ethernet, Infiniband, Omni-Path
  • highly reconfigurable and controllable: researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer
  • advanced monitoring and measurement features for traces collection of networking and power consumption, providing a deep understanding of experiments
  • designed to support Open Science and reproducible research, with full traceability of infrastructure and software changes on the testbed
  • a vibrant community of 500+ users supported by a solid technical team


Read more about our teams, our publications, and the usage policy of the testbed. Then get an account, and learn how to use the testbed with our Getting Started tutorial and the rest of our Users portal.


Published documents and presentations:

Older documents:


Grid'5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several Universities as well as other organizations. Inria has been supporting Grid'5000 through ADT ALADDIN-G5K (2007-2013), ADT LAPLACE (2014-2016), and IPL HEMERA (2010-2014).


Current status (at 2025-12-14 18:27): 7 current events, 1 planned (details)


Random pick of publications

Five random publications that benefited from Grid'5000 (at least 2924 overall):

  • Matthieu Simonin, Anne-Cécile Orgerie. Méthodologies de calculs de l'empreinte carbone sur une plateforme de calcul - L'exemple du site de Rennes de Grid'5000. JRES 2024 – Journée Réseaux de l'Enseignement Supérieur, Dec 2024, Rennes, France. pp.1-13. hal-04762718v2 view on HAL pdf
  • Jean-Eudes Ayilo, Mostafa Sadeghi, Romain Serizel. Diffusion-based speech enhancement with a weighted generative-supervised learning loss. International Conference on Acoustics Speech and Signal Processing (ICASSP), IEEE, Apr 2024, Seoul (Korea), South Korea. 10.48550/arXiv.2309.10457. hal-04210729v2 view on HAL pdf
  • Reda Khoufache, Mustapha Lebbah, Hanene Azzag, Etienne Goffinet, Djamel Bouchaffra. Distributed Collapsed Gibbs Sampler for Dirichlet Process Mixture Models in Federated Learning. SIAM International Conference on Data Mining (SDM24), Apr 2024, Houston, Texas, United States. pp.815 - 823, 10.1137/1.9781611978032.93. hal-04457596 view on HAL pdf
  • William Mocaër, Eric Anquetil, Richard Kulpa. Early gesture detection in untrimmed streams: A controlled CTC approach for reliable decision-making. Pattern Recognition, 2024, pp.110733. 10.1016/j.patcog.2024.110733. hal-04634678 view on HAL pdf
  • Thomas Firmin, Pierre Boulet, El-Ghazali Talbi. Asynchronous Multi-fidelity Hyperparameter Optimization Of Spiking Neural Networks. International Conference on Neuromorphic Systems (ICONS 2024), Jul 2024, Washington, United States. hal-04781629 view on HAL pdf


Latest news

Rss.svgEnd of support for centOS7/8 and centOSStream8 environments

Support for the centOS7/8 and centOSStream8 kadeploy environments is stopped due to the end of upstream support and compatibility issues with recent hardware.

The last version of the centOS7 environments (version 2024071117), centOS8 environments (version 2024071119), centOSStream8 environments (version 2024070316) will remain available on /grid5000. Older versions can still be accessed in the archive directory (see /grid5000/README.unmaintained-envs for more information).

-- Grid'5000 Team 08:44, 4 December 2025 (CEST)

Rss.svgEcotaxe cluster is now in default queue at Nantes

We are pleased to announce that the ecotaxe cluster of Nantes is now available in the default queue.

As a reminder, ecotaxe is a cluster composed of 2 HPE ProLiant DL385 Gen10 Plus v2 servers[1].

Each node features:

  • 2 AMD EPYC 7453 (Zen 3), 28 cores/CPU
  • 3 Nvidia A100 80GB GPU
  • 256 GB memory
  • 1x 1.92 To SSD + 2x 7.68 To SSD
  • 100 Gb/s Intel Ethernet adapter [2].

    • To submit a job on this cluster, the following command may be used:

    oarsub -t exotic -p ecotaxe

    This cluster is co-funded by Région Pays de la Loire, FEDER and REACT EU via the CPER SAMURAI [3].

    [1] https://www.grid5000.fr/w/Nantes:Hardware#ecotaxe

    [2] The observed throughput depends on multiple parameters such as the workload, the number of streams, ... [3] https://www.imt-atlantique.fr/fr/recherche-innovation/collaborer/projet/samurai

    -- Grid'5000 Team 14:10, 02 December 2025 (CET)

    Rss.svgSome changes on the hardware configuration of Grenoble nodes

    We recently did some hardware changes on clusters yeti, troll and dahu.

    The changes are as follows:

  • yeti :

    • Following a malfunction of the two NVMe disks on yeti-3, an NVMe disk from yeti-1 has been transferred to yeti-3 to ensure that we have at least one functional NVMe disk per yeti node. New NVMe configuration of the nodes:
    • yeti-[1,3]: 1× NVMe
    • yeti-[2,4]: 2× NVMe

  • troll :

    • Due to experimentation needs, the steering committee agreed to change the hardware configuration of the troll cluster, replacing the Omnipath HPC network interconnect (interconnecting troll to yeti and dahu) by the Infiniband HPC network interconnect already available for the drac cluster.

  • dahu :

    • A few nodes of the dahu cluster recently encountered a recurrent problem with their OPA interfaces. Instead of fully retiring those nodes, we chose to disable their OPA interfaces.
    This change means that if you want to reserve a dahu node with OPA, you must specify it in your oarsub request. For example:

    oarsub -I -p "dahu and opa_count > 0"

    The nodes that have been modified are dahu-18, dahu-26 and dahu-30. More nodes may be added to this list in the future.

    -- Grid'5000 Team 14:50, 24 November 2025 (CEST)

    Rss.svgCluster "clervaux" is now in the default queue in Luxembourg

    We are pleased to announce that the clervaux[1] cluster of Luxembourg is now available in the default queue.

    Clervaux is a cluster composed of 48 CPU nodes.

    Each node features:

  • 2x CPU Intel Xeon E5-2680 v4 (14 cores/CPU, 2 threads/cores)
  • 128 GiB RAM
  • 1x 120GB SSD SATA disk

    • This cluster was funded by the University of Luxembourg.

    [1] https://www.grid5000.fr/w/Luxembourg:Hardware#clervaux

    -- Grid'5000 Team 10:50, 21 October 2025 (CEST)

    Read more news

    Grid'5000 sites

    Current funding

    INRIA

    Logo INRIA.gif

    CNRS

    CNRS-filaire-Quadri.png

    Universities

    IMT Atlantique
    Université Grenoble Alpes, Grenoble INP
    Université Rennes 1, Rennes
    Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse
    Université Bordeaux 1, Bordeaux
    Université Lille 1, Lille
    École Normale Supérieure, Lyon

    Regional councils

    Aquitaine
    Auvergne-Rhône-Alpes
    Bretagne
    Champagne-Ardenne
    Provence Alpes Côte d'Azur
    Hauts de France
    Lorraine

    Retrieved from "https://www.grid5000.fr/mediawiki/index.php?title=Grid5000:Home&oldid=106859"