Difference between revisions of "Grid5000:Home"
Ddelabroye (talk | contribs) |
|||
| (12 intermediate revisions by 2 users not shown) | |||
| Line 4: | Line 4: | ||
|bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"| | |bgcolor="#f5fff5" style="border:1px solid #cccccc;padding:1em;padding-top:0.5em;"| | ||
[[Image:renater5-g5k.jpg|thumbnail|250px|right|Grid'5000]] | [[Image:renater5-g5k.jpg|thumbnail|250px|right|Grid'5000]] | ||
| − | '''Grid'5000 is a large-scale and | + | '''Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing including Cloud, HPC and Big Data and IA.''' |
Key features: | Key features: | ||
| − | * provides '''access to a large amount of resources''': | + | * provides '''access to a large amount of resources''': 12000 cores, 800 compute-nodes grouped in homogeneous clusters, and featuring various technologies: GPU, SSD, NVMe, 10G and 25G Ethernet, Infiniband, Omni-Path |
* '''highly reconfigurable and controllable''': researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer | * '''highly reconfigurable and controllable''': researchers can experiment with a fully customized software stack thanks to bare-metal deployment features, and can isolate their experiment at the networking layer | ||
* '''advanced monitoring and measurement features for traces collection of networking and power consumption''', providing a deep understanding of experiments | * '''advanced monitoring and measurement features for traces collection of networking and power consumption''', providing a deep understanding of experiments | ||
| Line 15: | Line 15: | ||
<br> | <br> | ||
Read more about our [[Team|teams]], our [[Publications|publications]], and the [[Grid5000:UsagePolicy|usage policy]] of the testbed. Then [[Grid5000:Get_an_account|get an account]], and learn how to use the testbed with our [[Getting_Started|Getting Started tutorial]] and the rest of our [[:Category:Portal:User|Users portal]]. | Read more about our [[Team|teams]], our [[Publications|publications]], and the [[Grid5000:UsagePolicy|usage policy]] of the testbed. Then [[Grid5000:Get_an_account|get an account]], and learn how to use the testbed with our [[Getting_Started|Getting Started tutorial]] and the rest of our [[:Category:Portal:User|Users portal]]. | ||
| + | |||
| + | <b>Grid'5000 is merging with [https://fit-equipex.fr FIT] to build the [http://www.silecs.net/ SILECS Infrastructure for Large-scale Experimental Computer Science]. Read [http://www.silecs.net/wp-content/uploads/2018/04/Desprez-SILECS.pdf an Introduction to SILECS] (April 2018)</b> | ||
<br> | <br> | ||
Recently published documents and presentations: | Recently published documents and presentations: | ||
| − | * [ | + | * [[Media:Grid5000.pdf|Presentation of Grid'5000]] (April 2019) |
* [https://www.grid5000.fr/mediawiki/images/Grid5000_science-advisory-board_report_2018.pdf Report from the Grid'5000 Science Advisory Board (2018)] | * [https://www.grid5000.fr/mediawiki/images/Grid5000_science-advisory-board_report_2018.pdf Report from the Grid'5000 Science Advisory Board (2018)] | ||
| − | |||
Older documents: | Older documents: | ||
| − | * https://www.grid5000.fr/slides/2014-09-24-Cluster2014-KeynoteFD-v2.pdf Slides from Frederic Desprez's keynote at IEEE CLUSTER 2014] | + | * [https://www.grid5000.fr/slides/2014-09-24-Cluster2014-KeynoteFD-v2.pdf Slides from Frederic Desprez's keynote at IEEE CLUSTER 2014] |
* [https://www.grid5000.fr/ScientificCommittee/SAB%20report%20final%20short.pdf Report from the Grid'5000 Science Advisory Board (2014)] | * [https://www.grid5000.fr/ScientificCommittee/SAB%20report%20final%20short.pdf Report from the Grid'5000 Science Advisory Board (2014)] | ||
| Line 82: | Line 83: | ||
===Regional councils=== | ===Regional councils=== | ||
Aquitaine<br/> | Aquitaine<br/> | ||
| + | Auvergne-Rhône-Alpes<br/> | ||
Bretagne<br/> | Bretagne<br/> | ||
Champagne-Ardenne<br/> | Champagne-Ardenne<br/> | ||
Latest revision as of 07:23, 4 October 2019
|
Grid'5000 is a large-scale and flexible testbed for experiment-driven research in all areas of computer science, with a focus on parallel and distributed computing including Cloud, HPC and Big Data and IA. Key features:
Grid'5000 is merging with FIT to build the SILECS Infrastructure for Large-scale Experimental Computer Science. Read an Introduction to SILECS (April 2018)
Older documents:
|
Random pick of publications
Five random publications that benefited from Grid'5000 (at least 2077 overall):
- Orcun Yildiz. Efficient Big Data Processing on Large-Scale Shared Platforms ˸ managing I/Os and Failure. Performance cs.PF. École normale supérieure de Rennes, 2017. English. NNT : 2017ENSR0009. tel-01723850 view on HAL pdf
- Anuvabh Dutt, Denis Pellerin, Georges Quénot. Coupled Ensembles of Neural Networks. Sixth International Conference on Learning Representations - Workshop Track (ICLR 2018), Apr 2018, Vancouver, Canada. hal-01887644 view on HAL pdf
- David Guyon, Anne-Cécile Orgerie, Christine Morin. An Experimental Analysis of PaaS Users Parameters on Applications Energy Consumption. IC2E 2018 - IEEE International Conference on Cloud Engineering, Apr 2018, Orlando, United States. pp.170-176, 10.1109/IC2E.2018.00040. hal-01711516 view on HAL pdf
- Vinicius Pinto, Lucas Mello Schnorr, Arnaud Legrand, Samuel Thibault, Luka Stanisic, et al.. Detecção de Anomalias de Desempenho em Aplicações de Alto Desempenho baseadas em Tarefas em Clusters Híbridos. WPerformance 2018 - 17º Workshop em Desempenho de Sistemas Computacionais e de Comunicação, Jul 2018, Natal, Brazil. pp.1-14. hal-01842038 view on HAL pdf
- Nicolas Turpault, Romain Serizel, Emmanuel Vincent. Semi-supervised triplet loss based learning of ambient audio embeddings. ICASSP, 2019, Brighton, France. hal-02025824 view on HAL pdf
Latest news
New cluster "gemini" available at Lyon
We have the pleasure to announce you the availability of the new cluster "gemini" at Lyon.
Gemini includes two "Nvidia DGX-1" nodes, each with 8 Nvidia V100 GPUs, 2 Intel Xeon E5-2698 v4 @ 2.20GHz CPUs, 512GB DDR4, Infiniband EDR and 10Gbps Ethernet interfaces and 4 reservable¹ SSD disks.
Energy monitoring is also available for this cluster, provided by the same devices used for the other clusters in Lyon².
Remember that if you don't need the 8 GPUs, individual GPU may be reserved³. A script to install nvidia-docker is also available if you want to use Nvidia's images built for Docker⁴.
This cluster has been funded by the CPER LECO++ Project (FEDER, Région Auvergne-Rhone-Alpes, DRRT, Inria).
¹: https://www.grid5000.fr/w/Disk_reservation
²: https://www.grid5000.fr/w/Energy_consumption_monitoring_tutorial
³: https://www.grid5000.fr/w/Accelerators_on_Grid5000#Reserving_GPU_units_on_nodes_with_many_GPUs
⁴: https://www.grid5000.fr/w/Docker#Nvidia-docker
-- Grid'5000 Team 15:00, November 12th 2019 (CET)
Group Storage service officially available
We are glad to announce that the Group Storage service is now no longer in beta. Additionally to the two servers in Lille, 5 storage servers in Lyon, Rennes, Nancy, Luxembourg and Sophia are now providing Group Storage volumes on demand.
See https://www.grid5000.fr/w/Group_Storage for details and https://www.grid5000.fr/w/Storage for an overview of our storage options.
-- Grid'5000 Team 11:00, November 12th 2019 (CET)
New cluster available in Nancy: gros (124 nodes with reservable disks)
We have the pleasure to announce that the Gros cluster in Nancy (default queue) is now available:
It features 124 Dell R640 servers nodes with one Intel Gold 5220 (18 cores / 36 threads), 96 GB DDR4, 1x480 GB SSD + 1x960 GB reservable SSD [1] and 2x25Gbps Ethernet interfaces.
However, the installation of this cluster is not yet fully completed:
- Two nodes (gros-3 and gros-4) are in an artificial Dead state due to a kavlan issue we still have to fix with the new model of the network switches of Gros network.
- This cluster will be equipped with a high precision monitoring system for electrical power consumption (Multilab-R, from Omegawatt [2]) that is already used in Grid'5000 at Lyon [3] or Grenoble [4]. It will be available for general use by the beginning of December.
- At the present time, the uplink between the Gros cluster and the Grid5000 network operates at 10Gbs. It will improved up to 2x40Gb/s in the next month.
This cluster has been funded by the CPER Cyber Entreprises project (Contrat de plan État / Région Lorraine 2015-2020).
Again, many thanks go to the former SIC and SG services at LORIA / Inria Nancy Grand Est for their help and support during this operation.
About the name:
Gros is a french adjective which usually means large, big or fat, but when used as a noun in Lorraine (which is the region Nancy belongs to), it means something else. It is used here generally to talk about people one cares (friends, children, companions). Some examples:
- Comment que c'est gros ? (how do you do buddy ?). This is the most famous one, and we are pleased to shout it out loud when we enter into gros's server room. It seems to be spreading outside Lorraine as well[5].
- Les gros sont à l'école (children are at school)
- Wha gros c'est schteuff ! (Listen my friend, it's amazing !)
[1] ...
CentOS 8 now available for kadeployment
We are please to announce that CentOS 8 (centos8-x64-min) is now available and registered in all sites with Kadeploy, along with CentOS 7 (centos7-x64-min), Ubuntu 18.04 (ubuntu1804-x64-min), Debian testing (debiantesting-x64-min) and the Debian 9 and 10 variants.
Feedback from users is very welcome (issues, missing features, etc.).
The CentOS 8 environment is built with Kameleon (just like other Grid'5000 environments).
The recipe is available in the master branch of the environments-recipes git repository.
Please note that Redhat chose to not support anymore some old SAS adapters (RAID cards), which impacts some of the Grid'5000 clusters as they cannot boot CentOS 8 due to that reason:
- Graphite (Nancy)
- Paranoia (Rennes)
- Suno (Sophia)
- Sagittaire (Lyon)
- Granduc (Luxembourg)
A workaround may be provided in the future.
If you need other system images for your work, please let us know.
-- Grid'5000 Team 11:00, October 28th 2019 (CET)
Grid'5000 sites
Current funding
As from June 2008, Inria is the main contributor to Grid'5000 funding.
INRIA
|
CNRS
|
UniversitiesUniversité Grenoble Alpes, Grenoble INP |
Regional councilsAquitaine |
