Grid5000:Home
|
Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing including Cloud, HPC and Big Data and AI. Key features:
Grid'5000 is merging with FIT to build the SILECS Infrastructure for Large-scale Experimental Computer Science. Read an Introduction to SILECS (April 2018)
Older documents:
|
Random pick of publications
Five random publications that benefited from Grid'5000 (at least 2139 overall):
- Alessio Pagliari, Fabrice Huet, Guillaume Urvoy-Keller. Towards a High-Level Description for Generating Stream Processing Benchmark Applications. The Third IEEE International Workshop on Benchmarking, Performance Tuning and Optimization for Big Data Applications (BPOD 2019), Dec 2019, Los Angeles, United States. hal-02371215 view on HAL pdf
- Tien-Dat Phan, Guillaume Pallez, Shadi Ibrahim, Padma Raghavan. A New Framework for Evaluating Straggler Detection Mechanisms in MapReduce. ACM Transactions on Modeling and Performance Evaluation of Computing Systems, ACM, 2019, X, pp.1-22. 10.1145/3328740. hal-02172590v2 view on HAL pdf
- Alessio Pagliari, Fabrice Huet, Guillaume Urvoy-Keller. On the Cost of Acking in Data Stream Processing Systems. 2019 19th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGRID), May 2019, Larnaca, Cyprus. 10.1109/CCGRID.2019.00047. hal-02134654 view on HAL pdf
- Jad Darrous, Shadi Ibrahim, Amelie Chi Zhou, Christian Pérez. Nitro: Network-Aware Virtual Machine Image Management in Geo-Distributed Clouds. CCGrid 2018 - 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2018, Washington D.C., United States. pp.553-562, 10.1109/CCGRID.2018.00082. hal-01745405 view on HAL pdf
- Maha Alsayasneh, Vivien Quéma, Renaud Lachaize. The Case for Dynamic Placement of Distributed Systems Components. Conférence d’informatique en Parallélisme, Architecture et Système 2018 (COMPAS 2018), Jul 2018, Toulouse, France. hal-01885794v2 view on HAL pdf
Latest news
Major update of BIOS and other firmwares and future strategy
In the recent months, we have performed a campaign of firmware updates (BIOS, Network interface Cards, RAID adapters…) of the nodes of most Grid'5000 clusters.
Those updates improved the overall reliability of our deployment process, but they also included mitigations for security issues such as Spectre/Meltdown.
It was also an opportunity to align clusters with similar hardware on the same firmware versions.
Unfortunately, we understand that those changes may have an impact on your experiments (particularly in terms of performance). This is a difficult issue where there is no good solution, as it is often hard or impossible to downgrade BIOS versions.
However, those firmware versions are included in the reference API. We recommend that you use this information to track down changes that could affect your experiment.
For instance, in https://api.grid5000.fr/stable/sites/nancy/clusters/gros/nodes/gros-1.json?pretty=1 , see bios.version and firmware_version.
You can also browse previous versions using the API ¹, or using the Github commit history ²
We will continue to update such firmwares in the future, about twice a year, keeping similar hardware in sync, and documenting the versions in the reference API.
¹: https://api.grid5000.fr/doc/3.0/reference/spec.html#get-3-0-item-uri-versions
²: https://github.com/grid5000/reference-repository/commits/master
-- Grid'5000 Team 16:15, March 27th 2020 (...
Support for persistent memory (PMEM)
Grid'5000 now features, among the different technologies it provides, some nodes with persistent memory.
Please find an introduction and some documentation on how to experiment on the persistent memory technology in the PMEM page.
-- Grid'5000 Team 17:35, February 19th 2020 (CET)
New cluster "troll" available in Grenoble
We have the pleasure to announce that a new cluster called "troll" is available in Grenoble¹.
It features 4 Dell R640 nodes with 2 Intel® Xeon® Gold 5218, 16 cores/CPU, 384GB DDR4, 1.5 TB PMEM (Intel® Optane™ DC Persistent Memory)²³, 1.6 TB NVME SSD, 10Gbps Ethernet, and 100Gb Omni-Path.
Energy monitoring⁴ is available for this cluster, provided by the same devices used for the other clusters in Grenoble.
This cluster has been funded by the PERM@RAM project from Laboratoire d'Informatique de Grenoble (CNRS/INS2I grant).
¹: https://www.grid5000.fr/w/Grenoble:Hardware
³: https://docs.pmem.io/persistent-memory/
⁴: https://www.grid5000.fr/w/Energy_consumption_monitoring_tutorial
-- Grid'5000 Team 17:00, February 3rd 2020 (CET)
New cluster available in Nancy: grue (20 GPUs)
We have the pleasure to announce that the Grue cluster in Nancy¹ (production queue) is now available:
It features 5 Dell R7425 servers nodes with four Tesla T4², 128 GB DDR4, 1x480 GB SSD, 2 x AMD EPYC 7351, 16 cores/CPU
As this cluster features 4 GPU per node, we remind you that you can monitor GPU (and node) usage using the Ganglia tool (std environment only) and looking a the grue nodes.
If your experiments do not require all the GPU of a single node, it is possible to reserve resources at the GPU level³ (also see this previous news for some examples).
You can also use the nvidia-smi and htop commands on your reserved nodes to get more information about your GPU and CPU usage.
This cluster has been funded by Ihe CPER LCHN project (Langues, Connaissances & Humanités Numériques, Contrat de plan État / Région Lorraine 2015-2020), and the LARSEN and MULTISPEECH teams at LORIA / Inria Nancy Grand Est.
As a reminder, since this cluster is part of the "production" queue, specific usage rules apply.
¹: https://www.grid5000.fr/w/Hardware
³: https://www.grid5000.fr/w/Accelerators_on_Grid5000#Reserving_GPU_uni...
Grid'5000 sites
Current funding
As from June 2008, Inria is the main contributor to Grid'5000 funding.
INRIA
|
CNRS
|
UniversitiesUniversité Grenoble Alpes, Grenoble INP |
Regional councilsAquitaine |
