Grid'5000 experiment

Jump to: navigation, search

Building a hierachical distributed memory for the grid (Middleware)

Conducted by

Loic Cudennec

Description

Managing data over distributed applications is a real challenge regarding properties such as data availability, persistency, consistency or transparency. Over the last decade, the computational grid, mainly cluster federations, has emerged as the natural infrastructure for code-coupled applications such as numerical simulations or co-operative design. These applications generate a large amount of data that have to be efficiently shared among participants. JuxMem (Juxtaposed Memory) is a data sharing service for the grid based on both DSM (distributed shared memory) and P2P (peer-to-peer) paradigms. It offers a global transparent access to data stored in physical memory as well as a generic platform to test different fault tolerance strategies and data consistency protocols. Gfarm is a grid file system designed to offer a global virtual file system for high performance distributed and parallel applications. GFarm proposes mechanisms for file fragmentation, replication and smart replica selection. We propose to add secondary persistent storage capabilities to the JuxMem service, using the Gfarm file system. Different common architectures are discussed to benefit from the the complementary properties of both systems. Experimentations show that our proposition provides efficient accesses to shared data thanks to the JuxMem service while offering large storage capabilities and persistency guarantees thanks to the Gfarm FS. This work has been conducted in collaboration with the Gfarm team, Tsukuba, Japan.

Status

achieved

Resources

  • Nodes involved: 20
  • Sites involved: 2
  • Minimum walltime: 1h
  • Batch mode: yes
  • Use kadeploy: no
  • CPU bound: no
  • Memory bound: no
  • Storage bound: no
  • Network bound: no
  • Interlink bound: no

Tools used

No information

Results

Not yet

Shared by: Loic Cudennec
Last update: 2008-08-08 17:31:11
Experiment #494

Personal tools
Namespaces

Variants
Views
Actions
Public Portal
Users Portal
Admin portal
Wiki special pages
Toolbox