Execo On G5K: Difference between revisions

From Grid5000
Jump to navigation Jump to search
No edit summary
 
(3 intermediate revisions by 3 users not shown)
Line 14: Line 14:
suited for quick and easy creation of reproducible experiments on
suited for quick and easy creation of reproducible experiments on
distributed hosts. It is a huge improvement over using shell script
distributed hosts. It is a huge improvement over using shell script
for experiment development. You can have a look at the [[File:Execo_G5K.pdf|presentation]].
for experiment development.
 
You can have a look at the following presentation:
 
[[File:Execo_G5K.pdf|presentation]].


It offers:
It offers:
* Asynchronous control of local and remote commands.
* Asynchronous control of local and remote commands.
* Efficient and scalable execution (transparent usage of [[TakTuk]]).
* Efficient and scalable execution (transparent usage of [[Using TakTuk|TakTuk]]).
* Interaction with Grid'5000 resources (planning, submission, deployment, API).
* Interaction with Grid'5000 resources (planning, submission, deployment, API).
* Tools for rapid development of reproducible experiments.  
* Tools for rapid development of reproducible experiments.  
Line 28: Line 32:
==Installation==
==Installation==
Connect on a frontend and use easy_install:
Connect on a frontend and use easy_install:
{{Term|location=frontend|cmd=export http_proxy="http://proxy:3128" ; export https_proxy="https://proxy:3128"}}
{{Term|location=frontend|cmd=<code class="command">easy_install</code> --user execo}}
{{Term|location=frontend|cmd=<code class="command">easy_install</code> --user execo}}


Optionaly create a file name ''.execo.conf.py'' in your home directory if you need some specific  
Optionaly create a file name ''.execo.conf.py'' in your home directory if you need some specific  
[http://execo.gforge.inria.fr/doc/latest-stable/execo_g5k.html#execo-g5k-configuration configuration]
[https://mimbert.gitlabpages.inria.fr/execo/execo_g5k.html#execo-g5k-configuration configuration]


==Usage==
==Usage==
===Process management===
===Process management===
To learn how to manage local and ssh process, have a look at [http://execo.gforge.inria.fr/doc/latest-stable/userguide.html#processes Process examples]
To learn how to manage local and ssh process, have a look at [https://mimbert.gitlabpages.inria.fr/execo/userguide.html#processes Process examples]


===Working with G5K===
===Working with G5K===
To know how to interact with Grid'5000 infrastrucure (jobs, deployment, planning, API), see the [http://execo.gforge.inria.fr/doc/latest-stable/userguide.html#execo-g5k execo g5k section] of the user guide.
To know how to interact with Grid'5000 infrastrucure (jobs, deployment, planning, API), see the [https://mimbert.gitlabpages.inria.fr/execo/userguide.html#execo-g5k execo g5k section] of the user guide.


===Automating experiments===
===Automating experiments===
Execo offers an engine that allows to automatize experiments. An example measuring TCP congestion on Grid'5000 can be found [http://execo.gforge.inria.fr/doc/latest-stable/userguide.html#using-execo-engine-for-experiment-development here]
Execo offers an engine that allows to automatize experiments. An example measuring TCP congestion on Grid'5000 can be found [https://mimbert.gitlabpages.inria.fr/execo/userguide.html#using-execo-engine-for-experiment-development here]


==Documentation==
==Documentation==
A complete user guide is available [http://execo.gforge.inria.fr/doc/latest-stable/userguide.html here].
A complete user guide is available [https://mimbert.gitlabpages.inria.fr/execo/userguide.html here].
You may also want to have a look at [http://execo.gforge.inria.fr/doc/latest-stable/apidoc.html API reference].
You may also want to have a look at [https://mimbert.gitlabpages.inria.fr/execo/apidoc.html API reference].
A grid5000 tutorial is available: [[Execo Practical Session]]
A grid5000 tutorial is available: [[Execo Practical Session]]

Latest revision as of 11:18, 28 September 2021

Execo offers a Python API to manage processes execution. It is well suited for quick and easy creation of reproducible experiments on distributed hosts. It is a huge improvement over using shell script for experiment development.

You can have a look at the following presentation:

presentation.

It offers:

  • Asynchronous control of local and remote commands.
  • Efficient and scalable execution (transparent usage of TakTuk).
  • Interaction with Grid'5000 resources (planning, submission, deployment, API).
  • Tools for rapid development of reproducible experiments.

Execo.png


Installation

Connect on a frontend and use easy_install:

Terminal.png frontend:
easy_install --user execo

Optionaly create a file name .execo.conf.py in your home directory if you need some specific configuration

Usage

Process management

To learn how to manage local and ssh process, have a look at Process examples

Working with G5K

To know how to interact with Grid'5000 infrastrucure (jobs, deployment, planning, API), see the execo g5k section of the user guide.

Automating experiments

Execo offers an engine that allows to automatize experiments. An example measuring TCP congestion on Grid'5000 can be found here

Documentation

A complete user guide is available here. You may also want to have a look at API reference. A grid5000 tutorial is available: Execo Practical Session