Grid'5000 experiment

Jump to: navigation, search

File broadcasting in a node / grid (Middleware)

Conducted by

Guillaume Huard, Raphael Jamet

Description

This experiments aims at improving the file broadcast software used in Grid'5000. Rather than a line of transfers, we are trying to mix peer-to-peer technology and broadcast trees to create a failsafe and noticeably faster tool, able to take into account the network structure.

Status

achieved

Resources

  • Nodes involved: 30
  • Sites involved: 3
  • Minimum walltime: 1h
  • Batch mode: yes
  • Use kadeploy: no
  • CPU bound: no
  • Memory bound: no
  • Storage bound: yes
  • Network bound: yes
  • Interlink bound: yes

Tools used

Perl

Results

Firsts tests show that it would take something like 15-20 seconds to broadcast 450 Mb to 9 nodes. There's still an unidentified problem which causes results under the previsions (we suspect disk access), but this experiment is in standby for now (my internship has ended).

Shared by: Guillaume Huard, Raphael Jamet
Last update: 2011-02-16 15:07:45
Experiment #588

Personal tools
Namespaces

Variants
Views
Actions
Public Portal
Users Portal
Admin portal
Wiki special pages
Toolbox