From Grid5000

HowTo Create an kadeploy suitable image from an ISO file.

Contents 1 Other documentations 2 Debian 3 Ubuntu 3.1 Preparation 3.2 Boot vm from ISO file 3.3 Installation 3.4 Create your g5k image 3.4.1 Post Configurations 3.4.2 Image and registration 3.5 Test it 4 Scientific Linux 4.1 Preparation 4.2 Boot vm from ISO file 4.3 Installation 4.4 Create your g5k image 4.4.1 Post Configurations 4.4.2 Image and registration 4.5 Test it 5 ArchLinux 5.1 Preparation 5.2 Boot vm from ISO file 5.3 Installation 5.4 Image and registration 5.5 Test it 6 Debian kfreeBSD 6.1 Preparation 6.2 Boot vm from ISO file 6.3 Installation 6.4 Image and registration 6.5 Test it 7 FreeBSD 8 Tips 8.1 make a change in g5k deployment kernel 8.2 Create a custom initrd 8.3 Customise an initrd (redhat) 8.4 Recover your deploy session

Other documentations

• Basis
  • Deploy_environment-OAR2
• Advanced
  • Environment_from_scratch
• Deployment kernel
  • Deployment_environment_kernel_upgrade
  • Deployment_environment_upgrade

Debian

• Same as ubuntu :)

Ubuntu

• Ubuntu

Preparation

• Make an OAR reservation (if possible 2h mini)

• Deploy Squeeze base image

• Download an Ubuntu ISO on you laptop, and upload it on the fresh deployed node.

• Install qemu (necessary for install vm with ISO)

• Umount /tmp (sda5 partition), this partition is needed for host installation

Boot vm from ISO file

• In another terminal launch an connection to the node with X forward

• And boot ISO
  • For 32bits image use simply qemu

• • For 64bits image use qemu-system-x86_64 (Recommended)

Installation

1. Basique ubuntu installation (if possible minimal).
2. Skip network configuration.
3. On taskel select base system and ssh server
4. Remember proxy config (http://proxy:3128)
5. Format and install distribution on sda5 partition, all in /, and with ext3 filesystem
6. When is finish, shutdown vm (CTRL+C in qemu teminal).

Create your g5k image

Post Configurations

• Some steps are needed

• Create a script in dhclient-exit-hook for set the hostname dynamicaly

cat << EOF > /mnt/etc/dhcp/dhclient-exit-hooks.d/g5k-hostname
EOF

#!/bin/sh

if [ -n "$new_host_name" ]; then
	if [ -n "$new_domain_name" ]; then
		hostname="${new_host_name}.${new_domain_name}"
	else
		hostname="${new_host_name}"
	fi

	echo "$hostname" > /etc/hostname 2> /dev/null
	hostname "$hostname"
	echo "$hostname" > /etc/mailname 2> /dev/null
fi

• And make it executable

• Remove fstab file (this file is installed by adminpostinstall (sed -e'/sda5/sda3/' -i /mnt/etc/fstab)

• Remove also interfaces file, set by admin postinstall.

Image and registration

• Finaly everythings is ok, make your tgz image.

• Copy description file of squeeze-x64-base

• Modify description

###
name : ubuntu-x64
version : 2
description : Ubuntu Oneiric 11.10
author : sebastien.badia@inria.fr
tarball : http://public.nancy.grid5000.fr/~sbadia/ubuntu-oneiric.tgz|tgz
postinstall : /grid5000/postinstalls/debian-x64-min-1.0-post.tgz|tgz|traitement.ash /rambin
kernel : /boot/vmlinuz-3.0.0-12-server
initrd : /boot/initrd.img-3.0.0-12-server
fdisktype : 83
filesystem : ext3
environment_kind : linux
visibility : shared
demolishing_env : 0

• Private: Just for you
• Shared: You and other users (kaven3 -l -u sbadia)
• Public: Only for reference/prod images
• So save it on kadeploy database

Test it

• Deploy your fresh image with debug mode (in case of :D)

Scientific Linux

Preparation

• Make an OAR reservation (if possible 2h mini)

• Deploy Squeeze base image

• Download an Scientific Linux ISO on you laptop, and upload it on the fresh deployed node.

• Install qemu (necessary for install vm with ISO)

• Umount /tmp (sda5 partition), this partition is needed for host installation

Boot vm from ISO file

• In another terminal launch an connection to the node with X forward

• And boot ISO

Installation

1. Minimal install, witch ssh server
2. No SeLinux, firewall desactivated
3. Proxy config (http://proxy:3128)
4. Format and install distribution on sda5 partition, all in /, and with ext3 filesystem
5. When is finish, shutdown vm (CTRL+C in qemu teminal).

Create your g5k image

Post Configurations

• Some steps are needed

• Create a script in dhclient-exit-hook for set the hostname dynamicaly

cat << EOF > /mnt/etc/dhcp/dhclient-exit-hooks.d/g5k-hostname
EOF

#!/bin/sh

if [ -n "$new_host_name" ]; then
	if [ -n "$new_domain_name" ]; then
		hostname="${new_host_name}.${new_domain_name}"
	else
		hostname="${new_host_name}"
	fi

	echo "$hostname" > /etc/hostname 2> /dev/null
	hostname "$hostname"
	echo "$hostname" > /etc/mailname 2> /dev/null
fi

• And make it executable

• Remove fstab file (this file is installed by adminpostinstall (sed -e'/sda5/sda3/' -i /mnt/etc/fstab)

• Remove also interfaces file, set by admin postinstall.

$ cat dest/etc/yum.conf 
[main]
cachedir=/var/cache/yum
keepcache=1
debuglevel=2
logfile=/var/log/yum.log
distroverpkg=redhat-release
tolerant=1
exactarch=1
obsoletes=1
gpgcheck=0
plugins=1
metadata_expire=72000
<[PROXY_AVAILABILITY]>proxy=http://proxy.<[SITE]>.grid5000.fr:3128/

# Default for installonlyn.  
# Uncomment and set to 0 to turn off
# installonly_limit = 4

# PUT YOUR REPOS HERE OR IN separate files named file.repo
# in /etc/yum.repos.d

Image and registration

• Finaly everythings is ok, make your tgz image.

• Copy description file of squeeze-x64-base

• Modify description

###
name : sl55-x64
version : 6
description : http://www.scientificlinux.org/distributions/5x/55/
author : sebastien.badia@inria.fr
tarball : http://public.nancy.grid5000.fr/~sbadia/scientific-linux-55-x64.tgz|tgz
postinstall : http://public.nancy.grid5000.fr/~sbadia/sl56-post.tgz|tgz|traitement.ash /rambin
kernel : /vmlinuz
initrd : /initrd.img
fdisktype : 83
filesystem : ext3
environment_kind : linux
visibility : shared
demolishing_env : 0

• So save it on kadeploy database

Test it

• Deploy your fresh image with debug mode (in case of :D)

ArchLinux

Preparation

• Make an OAR reservation (if possible 2h mini)

• Deploy Squeeze base image

• Download an Arch Linux ISO on you laptop, and upload it on the fresh deployed node.

• Install qemu (necessary for install vm with ISO)

• Umount /tmp (sda5 partition), this partition is needed for host installation

Boot vm from ISO file

• In another terminal launch an connection to the node with X forward

• And boot ISO

Installation

1. km (set your keyboard layout)
2. /arch/setup (install arch)
3. setup medium to local cd
4. cfdisk -> install on sda5 (ext3), no swap
5. install grub
6. install base system and ssh server
7. Configure sshd at startup, and dhcp on eth0 (rc.conf -> DAEMONS=(hwclock syslog-ng network netfs crond sshd))

Image and registration

• Finaly everythings is ok, make your tgz image.

• Copy description file of squeeze-x64-base

• Modify description

• So save it on kadeploy database

Test it

• Deploy your fresh image with debug mode (in case of :D)

Debian kfreeBSD

• Debian GNU/kFreeBSD
• Image use for the netinstall

Preparation

• Make an OAR reservation (if possible 2h mini)

• Deploy Squeeze base image

• Download an GNU Debian/kfreeBSD ISO on you laptop, and upload it on the fresh deployed node.

• Install qemu (necessary for install vm with ISO)

• Umount /tmp (sda5 partition), this partition is needed for host installation

Boot vm from ISO file

• In another terminal launch an connection to the node with X forward

• And boot ISO

Installation

1. Note network is iface em0
2. Setup the proxy for installation.
3. Change the fstype of <sda3> partition to a5 (initial linux 82).
4. Install debian kfreebsd.
5. Reboot on <sda3> partiton, bsd <ad4s3>.
6. Install grub on the hd0,3.

Image and registration

• Reboot node and install grub

• Finaly everythings is ok, make your tgz image.

• Copy description file of squeeze-x64-base

• Modify description

###
name : debkfreebsd-x64
version : 2
description : GNU/Debian kFreeBSD squeeze 6.0.3
author : sebastien.badia@inria.fr
tarball : http://public.nancy.grid5000.fr/~sbadia/debian-kfreebsd.dd.gz|ddgz
postinstall : http://public.nancy.grid5000.fr/~sbadia/kfreebsd-1.0.tgz|tgz|traitement.ash /rambin
kernel : chainload
initrd : foo
fdisktype : a5
filesystem : ext2
environment_kind : other
visibility : shared
demolishing_env : 1

• So save it on kadeploy database

Test it

• Deploy your fresh image on another node with debug mode (in case of :D)

GNU/kFreeBSD griffon-14.nancy.grid5000.fr 8.1-1-amd64 #0 Tue Aug 17 23:12:29 CEST 2011 x86_64 amd64 Intel(R) Xeon(R) CPU           L5420  @ 2.50GHz GNU/kFreeBSD

FreeBSD

• See FreeBSD_in_Rennes

Tips

Some usefull tips

make a change in g5k deployment kernel

mkdir /tmp/deploy

• Decompress initrd

gzip -dc /var/lib/tftpboot/kernels/deploy-initrd-2.6.32.1-big > /tmp/deploy.ext2.img

• Mount

mount -o loop -t ext2 /tmp/deploy.ext2.img /tmp/deploy

• Make your changes :)
• And recreate inirtd

cat deploy.ext2.img | gzip -9 -c > initrd.img

Create a custom initrd

mkinitrd -f --fstab=/etc/fstab.g5k --omit-lvm-modules /boot/initrd.g5k.img 2.6.9-55.EL \
--with=mptsas --with=mptspi --with=sata_nv --with=tg3 --with=sata_sil --with=sata_svw \
--with=ata_piix --with=e1000 --with=megaraid_sas  --with=mptscsih --with=cciss \
--with=libata --with=sd_mod --with=scsi_mod --with=bnx2 --with=scsi_transport_spi

Customise an initrd (redhat)

• Decompress actual initrd

cd /root

mkdir initrd

cd initrd

echo "--> utilisation de l'initrd $(uname -r)"

gzip -dc /boot/initrd-$(uname -r).img | cpio -id --no-absolute-filenames

• Modify your init (in my case, add some disk_drv)
• And recompress

find . | cpio --dereference -H newc -o | gzip -9 > /boot/initrd-$(uname -r).img

Recover your deploy session

• re-make your réservation with the deploy type.

oarsub -I -t deploy -l nodes=1,walltime=9 -p "host='griffon-$x.nancy.grid5000.fr'"

• and kareboot the node to the deploy part.

kareboot3 -l hard -p 3 -r env_recorded -e debian-x64-5-prod -m griffon-$x.nancy.grid5000.fr