File broadcasting in a node / grid (Middleware)
Conducted byGuillaume Huard, Raphael Jamet
DescriptionThis experiments aims at improving the file broadcast software used in Grid'5000. Rather than a line of transfers, we are trying to mix peer-to-peer technology and broadcast trees to create a failsafe and noticeably faster tool, able to take into account the network structure.
- Nodes involved: 30
- Sites involved: 3
- Minimum walltime: 1h
- Batch mode: yes
- Use kadeploy: no
- CPU bound: no
- Memory bound: no
- Storage bound: yes
- Network bound: yes
- Interlink bound: yes
ResultsFirsts tests show that it would take something like 15-20 seconds to broadcast 450 Mb to 9 nodes. There's still an unidentified problem which causes results under the previsions (we suspect disk access), but this experiment is in standby for now (my internship has ended).
Shared by: Guillaume Huard, Raphael Jamet
Last update: 2011-02-16 15:07:45