Grid5000:Home: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
No edit summary
(121 intermediate revisions by 11 users not shown)
Line 1: Line 1:
__NOTOC__ __NOEDITSECTION__
__NOTOC__ __NOEDITSECTION__
{|width="95%"
{|width="95%"
|-
|- valign="top"
| width="20%" |
|bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[[Image:Logo_Aladdin.png|250px]]
[[Image:renater5-g5k.jpg|thumbnail|250px|right|Grid'5000]]
|
'''Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing including Cloud, HPC and Big Data and AI.'''
= ALADDIN-G5K : ensuring the development of '''Grid'5000''' =
= for the 2008-2012 period =


''An infrastructure distributed in 9 sites around France, for research in large-scale parallel and distributed systems''
Key features:
* provides '''access to a large amount of resources''': 15000 cores, 800 compute-nodes grouped in homogeneous clusters, and featuring various technologies: PMEM, GPU, SSD, NVMe, 10G and 25G Ethernet, Infiniband, Omni-Path
* '''highly reconfigurable and controllable''': researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer
* '''advanced monitoring and measurement features for traces collection of networking and power consumption''', providing a deep understanding of experiments
* '''designed to support Open Science and reproducible research''', with full traceability of infrastructure and software changes on the testbed
* '''a vibrant community''' of 500+ users supported by a solid technical team


Engineers ensuring the development and day to day support of the infrastructure are mostly provided by INRIA, under the ''ADT ALADDIN-G5K''  initiative.
<br>
Read more about our [[Team|teams]], our [[Publications|publications]], and the [[Grid5000:UsagePolicy|usage policy]] of the testbed. Then [[Grid5000:Get_an_account|get an account]], and learn how to use the testbed with our [[Getting_Started|Getting Started tutorial]] and the rest of our [[:Category:Portal:User|Users portal]].


|}
<b>Grid'5000 is merging with [https://fit-equipex.fr FIT] to build the [http://www.silecs.net/ SILECS Infrastructure for Large-scale Experimental Computer Science]. Read [http://www.silecs.net/wp-content/uploads/2018/04/Desprez-SILECS.pdf an Introduction to SILECS] (April 2018)</b>


{|width="95%"
<br>
|- valign="top"
Recently published documents and presentations:
|bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Media:Grid5000.pdf|Presentation of Grid'5000]] (April 2019)
==Latest news==
* [https://www.grid5000.fr/mediawiki/images/Grid5000_science-advisory-board_report_2018.pdf Report from the Grid'5000 Science Advisory Board (2018)]
[[Image:G5KSS10-Carre.png|left|120px|]]
=== [[Grid5000:School2010|G5kSS10]] Challenge winner: deploying a sky computing environment (3 clouds) based on [http://www.nimbusproject.org/ Nimbus] in 30mn ! ===
The Grid'5000 Spring School challenge winner is Pierre Riteau, who demonstrated the deployment of a sky computing environment based on nimbus in 31mn ! These include the deployment of the nodes using kadeploy3 and their configuration to form a sky computing environment located in 3 sites and managing 278 VMMs providing 1628 virtual cpus and 2 124 Gb of memory. Details in the [https://www.grid5000.fr/school2010/slides/Challenge_Riteau.pdf winner's presentation].<br>
The runner-up is Marko Obrovac, who demonstrated scripts enabling the deployment of XtreemOS on Grid'5000. The script brought up an linux-ssi favour version of XtreemOS putting a virtual SMP of 156 processors online in less than 30mn.<br>
Each win an ipod touch for their entry.<br>
(<small>image ©-maxime-dufour-photographies</small>)
----
[[Image:G5KSS10-Carre.png|left|120px|]]
=== [[Grid5000:School2010|Grid'5000 Spring School 2010 award winners announced]] ===
The Grid'5000 spring school took place between April 6th, 2010 and April 9th, 2010 in Lille. This highly successful edition brought together 78 registered participants for 4 days of tutorials and talks focusing on best-practices, results and links to other tools for experiment-driven research. The [[Grid5000:School2010_Program|presentation program]] has been updated with the slides of the presentations. Most [[Grid5000:School2010_TPs|practical sessions]] are available to people that did not take part during the school.
Two awards were given for presentations made during the event :<br>
(<small>image ©-maxime-dufour-photographies</small>)
{|width="75%" cellspacing="3"
|- valign="top" align="center"
|width="50%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
[[Image:BestPresentationAward2010.png|300px|center|Best presentation award to Cristian Klein]]


Best presentation award to Cristian Klein
Older documents:
* [https://www.grid5000.fr/slides/2014-09-24-Cluster2014-KeynoteFD-v2.pdf Slides from Frederic Desprez's keynote at IEEE CLUSTER 2014]
* [https://www.grid5000.fr/ScientificCommittee/SAB%20report%20final%20short.pdf Report from the Grid'5000 Science Advisory Board (2014)]


|width="50%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
<br>
[[Image:MostSignificantExperimentAward2010.png|300px|center|Most Significant Experiment for the progress of Grid'5000 to Emmanuel Thomé]]
Grid'5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several Universities as well as other organizations. Inria has been supporting Grid'5000 through ADT ALADDIN-G5K (2007-2013), ADT LAPLACE (2014-2016), and IPL [[Hemera|HEMERA]] (2010-2014).
|}


Most Significant Experiment for the progress of Grid'5000 to Emmanuel Thomé
<br>
|-
{{#status:0|0|0|http://bugzilla.grid5000.fr/status/upcoming.json}}
|}
<br>


== Random pick of publications ==
{{#publications:}}


==Latest news==
<rss max=4 item-max-length="2000">https://www.grid5000.fr/mediawiki/index.php?title=News&action=feed&feed=atom</rss>
----
----
=== Latest updated experiment descriptions ===
[[News|Read more news]]
{{#experiments:3}}
----
=== Latest updated publications ===
{{#publications:3}}
----
=== Research in Grids - Production Grids workshop held October 13th, 2009 ===
L’[http://www.idgrilles.fr Institut des Grilles (IdG)] et l’action Aladdin INRIA lancent un [[Appel Interfaces Recherche en grilles/Grilles de production 2009|appel commun à propositions]] pour dynamiser les recherches à l’interface entre la recherche sur les grilles, les grilles de recherche, et les grilles de production.
 
Le colloque présentera les questions ouvertes aux interfaces et les projets proposés dans le cadre de cet appel, afin de favoriser la création de nouveaux réseaux. Le but de la journée est de faire émerger des synergies. La présentation de travaux en cours est donc vivement encouragée. [http://graal.ens-lyon.fr/~desprez/FILES/ProdRech.html Plus d’informations].
---


[[Grid5000:News|read more news]]
=== Grid'5000 sites===
|}
{|width="100%" cellspacing="3"  
 
<br>
==Grid'5000 at a glance==
[[Image:site_map.png|thumbnail|128px|right|Grid'5000 sites]]
* '''Grid'5000''' is a scientific instrument for the study of large scale parallel and distributed systems. It aims at providing a '''highly reconfigurable, controlable and monitorable experimental platform''' to its users. The initial aim (circa 2003) was to reach 5000 processors in the platform. It has been reframed at 5000 cores, and was reached during winter 2008-2009.
* The infrastructure of Grid'5000 is geographically distributed on different sites hosting the instrument, initialy 9 in France. Porto Alegre, Brazil is now officially becoming the 10th site.
===Sites:===
{|width="75%" cellspacing="3"  
|- valign="top"
|- valign="top"
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Bordeaux:Home|Bordeaux]]
* [[Grenoble:Home|Grenoble]]
* [[Grenoble:Home|Grenoble]]
* [[Lille:Home|Lille]]
* [[Lille:Home|Lille]]
Line 77: Line 53:
* [[Lyon:Home|Lyon]]
* [[Lyon:Home|Lyon]]
* [[Nancy:Home|Nancy]]
* [[Nancy:Home|Nancy]]
* [[Orsay:Home|Orsay]]
* [[Nantes:Home|Nantes]]
* [[PortoAlegre:Home|Porto Alegre]]
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
|width="33%" bgcolor="#f5f5f5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
* [[Rennes:Home|Rennes]]
* [[Rennes:Home|Rennes]]
Line 85: Line 60:
|-
|-
|}
|}
[[Image:Software layers.png|thumbnail|271px|left|Grid'5000 allows experiments in all these software layers]]
* '''Grid'5000''' is a research effort developping a '''large scale nation wide infrastructure for large scale parallel and distributed computing research'''.
* '''17 [[Grid5000:Laboratories|laboratories]]''' are involved in France with the objective of providing the community a testbed allowing experiments in all the software layers between the network protocols up to the applications.
The current plans are to extend from the 9 initial sites each with 100 to a thousand PCs, connected by the [http://www.renater.fr RENATER] Education and Research Network to a bigger platform including a few sites outside France not necessarily connected through a dedicated network connection. Sites in Brazil and Luxembourg should join shortly.
All sites in France are connected to [http://www.renater.fr RENATER] with a 10Gb/s link.
This high collaborative research effort is funded by INRIA, CNRS, the Universities of all sites and some regional councils.
== Initial Rationale==
'''The foundations of Grid'5000''' have emerged from a thorough analysis and numerous discussions about methodologies used for scientific research in the Grid domain. A report presents the [http://www-sop.inria.fr/aci/grid/public/Library/rapport-grid5000-V3.pdf rationale for Grid'5000].
In addition to theory, simulators and emulators, there is a strong need for '''large scale testbeds''' where real life experimental conditions hold. '''The size of Grid'5000''', in terms of number of sites and number of processors per site, was established according to the scale of the experiments and the number of researchers involved in the project.


== Current funding ==
== Current funding ==
As from June 2008, INRIA is the main contributor to [[Grid5000:Funding|Grid'5000 funding]].  
As from June 2008, Inria is the main contributor to [[Grid5000:Funding|Grid'5000 funding]].  
{|width="100%" cellspacing="3"
{|width="100%" cellspacing="3"
|-
|-
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===INRIA===
===INRIA===
[[Image:Logo-inria.png]]
[[Image:Logo_INRIA.gif|300px]]
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===CNRS===
===CNRS===
[[Image:Logo-cnrs.png]]
[[Image:CNRS-filaire-Quadri.png|125px]]
|-
|-
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===Universities===
===Universities===
University Joseph Fourier, Grenoble<br/>
Université Grenoble Alpes, Grenoble INP<br/>
University of Rennes 1, Rennes<br/>
Université Rennes 1, Rennes<br/>
Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse<br/>
Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse<br/>
University Bordeaux 1, Bordeaux<br/>
Université Bordeaux 1, Bordeaux<br/>
University Lille 1, Lille<br/>
Université Lille 1, Lille<br/>
Ecole Normale Supérieure, Lyon<br/>
École Normale Supérieure, Lyon<br/>
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
| width="50%" bgcolor="#f5f5f5" valign="top" align="center" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"|
===Regional councils===
===Regional councils===
Aquitaine<br/>
Aquitaine<br/>
Auvergne-Rhône-Alpes<br/>
Bretagne<br/>
Bretagne<br/>
Champagne-Ardenne<br/>
Provence Alpes Côte d'Azur<br/>
Provence Alpes Côte d'Azur<br/>
Nord Pas de Calais<br/>
Hauts de France<br/>
Lorraine<br/>
Lorraine<br/>
|}
|}

Revision as of 23:57, 11 February 2020

Grid'5000

Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing including Cloud, HPC and Big Data and AI.

Key features:

  • provides access to a large amount of resources: 15000 cores, 800 compute-nodes grouped in homogeneous clusters, and featuring various technologies: PMEM, GPU, SSD, NVMe, 10G and 25G Ethernet, Infiniband, Omni-Path
  • highly reconfigurable and controllable: researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer
  • advanced monitoring and measurement features for traces collection of networking and power consumption, providing a deep understanding of experiments
  • designed to support Open Science and reproducible research, with full traceability of infrastructure and software changes on the testbed
  • a vibrant community of 500+ users supported by a solid technical team


Read more about our teams, our publications, and the usage policy of the testbed. Then get an account, and learn how to use the testbed with our Getting Started tutorial and the rest of our Users portal.

Grid'5000 is merging with FIT to build the SILECS Infrastructure for Large-scale Experimental Computer Science. Read an Introduction to SILECS (April 2018)


Recently published documents and presentations:

Older documents:


Grid'5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several Universities as well as other organizations. Inria has been supporting Grid'5000 through ADT ALADDIN-G5K (2007-2013), ADT LAPLACE (2014-2016), and IPL HEMERA (2010-2014).


Current status (at 2024-03-29 00:42): 1 current events, None planned (details)


Random pick of publications

Five random publications that benefited from Grid'5000 (at least 2503 overall):

  • Thomas Lambert, Shadi Ibrahim, Twinkle Jain, David Guyon. Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival. CCGrid 2022 - 22nd International Symposium on Cluster, Cloud and Internet Computing, May 2022, Taormina, Italy. pp.747-751, 10.1109/CCGrid54584.2022.00084. hal-03777656 view on HAL pdf
  • Amina Guermouche. Combining uncore frequency and dynamic power capping to improve power savings. 2022 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), May 2022, Lyon, France. pp.1028-1037. hal-03563120 view on HAL pdf
  • Ali Tehranijamsaz, Mihail Popov, Akash Dutta, Emmanuelle Saillard, Ali Jannesari. Learning Intermediate Representations using Graph Neural Networks for NUMA and Prefetchers Optimization. IPDPS 2022 - 36th IEEE International Parallel & Distributed Processing Symposium, May 2022, Lyon / Virtual, France. hal-03603118 view on HAL pdf
  • Julia Lawall, Himadri Chhaya-Shailesh, Jean-Pierre Lozi, Baptiste Lepers, Willy Zwaenepoel, et al.. OS Scheduling with Nest: Keeping Tasks Close Together on Warm Cores. EuroSys 2022 - Seventeenth European Conference on Computer Systems, Apr 2022, Rennes, France. 10.1145/3492321.3519585. hal-03612592 view on HAL pdf
  • Sirine Sayadi, Venceslas Douillard, Nicolas Vince, Mario Südholt, Pierre-Antoine Gourraud. Distributing human leukocyte antigen HLA database in histocompatibility: a shift in HLA data governance. Exploration of Immunology, 2022, 2, pp.749-759. 10.37349/ei.2022.00080. hal-03747555 view on HAL pdf


Latest news

Failed to load RSS feed from https://www.grid5000.fr/mediawiki/index.php?title=News&action=feed&feed=atom: Error parsing XML for RSS


Read more news

Grid'5000 sites

Current funding

As from June 2008, Inria is the main contributor to Grid'5000 funding.

INRIA

Logo INRIA.gif

CNRS

CNRS-filaire-Quadri.png

Universities

Université Grenoble Alpes, Grenoble INP
Université Rennes 1, Rennes
Institut National Polytechnique de Toulouse / INSA / FERIA / Université Paul Sabatier, Toulouse
Université Bordeaux 1, Bordeaux
Université Lille 1, Lille
École Normale Supérieure, Lyon

Regional councils

Aquitaine
Auvergne-Rhône-Alpes
Bretagne
Champagne-Ardenne
Provence Alpes Côte d'Azur
Hauts de France
Lorraine