Grid5000:Home
|
Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing including Cloud, HPC and Big Data and AI. Key features:
Grid'5000 is merging with FIT to build the SILECS Infrastructure for Large-scale Experimental Computer Science. Read an Introduction to SILECS (April 2018)
Older documents:
|
Random pick of publications
Five random publications that benefited from Grid'5000 (at least 2177 overall):
- Jean Luca Bez, Alberto Miranda, Ramon Nou, Francieli Zanon Boito, Toni Cortes, et al.. Arbitration Policies for On-Demand User-Level I/O Forwarding on HPC Platforms. IPDPS 2021 - 35th IEEE International Parallel and Distributed Processing Symposium, May 2021, Portland, Oregon / Virtual, United States. hal-03149582 view on HAL pdf
- Adrien Faure, Giorgio Lucarelli, Olivier Richard, Denis Trystram. Online Scheduling with Redirection for Parallel Jobs. IPDPSW 2020 - IEEE International Parallel and Distributed Processing Symposium Workshops, May 2020, New Orleans, France. pp.1-4, 10.1109/IPDPSW50202.2020.00066. hal-02944032 view on HAL pdf
- Sara Dahmani, Vincent Colotte, Slim Ouni. Étude comparative des paramètres d'entrée pour la synthèse expressive audiovisuelle de la parole par DNNs. 6e conférence conjointe Journées d'Études sur la Parole (JEP, 33e édition), Traitement Automatique des Langues Naturelles (TALN, 27e édition), Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RÉCITAL, 22e édition). Volume 1 : Journées d'Études sur la Parole, Jun 2020, Nancy, France. pp.127-135. hal-02798526v3 view on HAL pdf
- Anne-Cécile Orgerie. From Understanding to Greening the Energy Consumption of Distributed Systems. Networking and Internet Architecture cs.NI. Ecole Normale Supérieure de Rennes, 2020. tel-03158492 view on HAL pdf
- Simon Delamare, Lucas Nussbaum. Kwollect: Metrics Collection for Experiments at Scale. CNERT 2021 - Workshop on Computer and Networking Experimental Research using Testbeds, May 2021, Virtual, United States. pp.1-6. hal-03236421 view on HAL pdf
Latest news
Debian 11 "Bullseye" std environment is now the default environment on nodes
We are pleased to announce that Debian 11 (Bullseye) std environment (debian11-std) is now the default environment on nodes. See `kaenv3 -l debian11%` for an exhaustive list of available variants.
New features and changes in Debian 11 are described in: https://www.debian.org/releases/bullseye/amd64/release-notes/ch-whats-new.en.html .
In particular, it includes many software updates:
- Cuda 11.2.2 / Nvidia Drivers 460.91.03
- OpenJDK 17
- Python 3.9.2
- python3-numpy 1.19.5
- python3-scipy 1.6.0
- python3-pandas 1.1.5
- Perl 5.32.1
- GCC 9.3 and 10.2
- G++ 10.2
- Libboost 1.74.0
- Ruby 2.7.4
- CMake 3.18.4
- GFortran 10.2.1
- Liblapack 3.9.0
- libatlas 3.10.3
- RDMA 33.2
- OpenMPI 4.1.0
Some additional important changes have to be noted:
- Python 2 is not included as it is deprecated since Jan. 2020, and `/usr/bin/python` is symlinked to `/usr/bin/python3`. Note that Python2 packages are still available on repositories and that you can install the 'python-is-python2' package to change the symlink.
- OpenMPI
- The OpenMPI backend used for Infiniband and Omnipath networks is UCX (this is similar to mainstream OpenMPI, but differs from the default behaviour in Debian 11).
- The libfabric package has been recompiled to disable a buggy EFA provider (AWS)¹.
- Apache MXNet deep learning framework is no more officially supported by the team, as his documentation.
- As Ganglia monitoring has been replaced by Kwollect², Ganglia services have been removed from environments.
- The BeeGFS client is not operational³, which impacts the grcinq and grvingt clusters. As a workaround, users can deplo...
Kadeploy: Machine's architecture added to environments description
Kadeploy environments now require the architecture information in a new field named “arch” in the environment’s descriptions.
Current valid architectures on Grid’5000 are: x86_64, ppc64le (drac cluster in Grenoble), aarch64 (pyxis cluster in Lyon).
We have already added the architecture information in every recorded environment (kaenv database). If you deploy from an environment description (-a option of kadeploy), you will need to add this new field yourself. Please contact support-staff@lists.grid5000.fr in case of issues.
If multiple environments share the same name but have different architectures, Kadeploy will automatically select the appropriate architecture for a given cluster.
Taking advantage of this new feature, the architecture code names will soon be removed from the Grid’5000 reference environments names. For instance, debian11-x64-big will become debian11-big: “x64” disappears but “x86_64” is set in the environment architecture tag.
-- Grid'5000 Team 11:38, November 18th 2021 (CET)
Cluster "neowise" from AMD is available in the default queue
We have the pleasure to announce that the "neowise" cluster is now available at Lyon in the default queue. It features 10 nodes, each including an AMD EPYC 7642 CPU with 48 cores, 8 AMD Radeon Instinct MI50 GPUs (32 GB), 512GB of RAM and an Infiniband network.
Remind that this cluster is tagged as "exotic", so the `-t exotic` option must be provided to oarsub to select neowise.
The cluster has been donated by AMD to Genci and Inria, in particular to support research against COVID-19. We would like to thank AMD for this donation and Genci for their successful collaboration in making this machine available in Grid'5000.
-- Grid'5000 Team 13:20, November 9th 2021 (CET)
New cluster “gruss” available in Nancy
We have the pleasure to announce that a new cluster named “gruss” is available in Nancy in the production queue. It features 4 Dell R7525 nodes with two AMD EPYC 7352 24-Cores CPUs, two NVidia A40-48GB GPUs, 256GB of DDR-4 RAM, one 1.92TB SAS SSD.
This cluster has been funded mainly by the MULTISPEECH research team (Grant from the Ministère des Armées on the application of deep learning techniques for domain adaptation in speech processing - ANR projects JCJC DiSCogs, Deep Privacy, LEAUDS, Flash Open Science HARPOCRATES), helped by the TANGRAM (ANR project Prespin) and CAPSID (H2020 ITN project RNAct) research teams.
About the name: Gruss is a well known French Circus family whose some roots [1] are in Lorraine (Nancy’s region). Strange coincidence: It happens that the Arlette Gruss Circus [2] is currently on tour in Nancy…
¹: https://fr.wikipedia.org/wiki/Alexis_Grüss_Sénior
-- Grid'5000 Team 15:20, November 5th 2021 (CET)
Grid'5000 sites
Current funding
As from June 2008, Inria is the main contributor to Grid'5000 funding.
INRIA
|
CNRS
|
UniversitiesUniversité Grenoble Alpes, Grenoble INP |
Regional councilsAquitaine |
