Is Virtualization Killing SSI Research?

(1)

Is Virtualization Killing SSI

Research?

Jérôme Gallard, Geoffroy Vallée, Adrien Lèbre, Christine Morin, Pascal Gallard and Stephen L. Scott VHPC'08 Las Palmas de Gran Canaria – Aug, 26th

(2)

Outline

Context

Cluster BS/SSI

Virtualization

➔

Combining Virtualization and SSI

Conclusion

Lessons learnt

Perspectives

(3)

VHPC'08 Las Palmas de Gran Canaria August 2008 3

Introduction

3

Cluster exploitation:

➔

How to execute jobs on a cluster architecture?

- Batch scheduler (BS)

- Single System Image (SSI)

(4)

(5)

Batch Scheduler (BS)

6 N0

head node compute nodes

Wait queue of jobs

N1 _N2 _N3

N4 N5 N6

Users interact only with the head node

(6)

(7)

Single System Image (SSI)

6 compute nodes N1 _N2 _N3 N4 N5 N6 no head node

Users have the illusion to manage a SMP machine

with UNIX standard tools

(8)

Interesting functionality:

- Global management of ressources

(such as the memory)

(9)

VHPC'08

Las Palmas de Gran Canaria

August 2008 9

Virtualization Technologies

(10)

Virtualization Technologies

N0 VM0

VM1 VM2

compute node

(11)

VHPC'08

August 2008 11

Virtualization with BS

N0

head node (BS) compute nodes

Wait queue of VMs (JAWS, Haizea) N1 _N2 _N3 N4 N5 N6 8

(12)

Combining BS + VM

Simplify:

- Management and deployement of applications

- Management of resources

(13)

VHPC'08

August 2008 13

VMs vs SSI

Is virtualization killing system image research?

What's about combining both approaches ?

(14)

VMs vs SSI

Container SSI

X

O

X

O

Container

X

O

SSI

O

X

bottom top

TypeI TypeII

TypeI

TypeII

(15)

SystemLevel Virtualization

Goldberg:

TypeII-virtualization

11

(16)

SystemLevel Virtualization

Hardware Hypervisor Host OS VM VM Kernel space User space

Goldberg:

TypeII-virtualization

...

Example of typeII: Vmware, QEMU

App1

(17)

VHPC'08

August 2008 17

TypeIIVirtualization

upon

SSI

N1 N2 N3

(18)

TypeIIVirtualization

upon

SSI

N1 N2 N3

(19)

VHPC'08

August 2008 19

TypeIIVirtualization

upon

SSI

N1 N2 N3

Host OS: SSI Hypervisor

(20)

TypeIIVirtualization

upon

SSI

N1 N2 N3

Host OS: SSI

VM1 VM2

(21)

VHPC'08

August 2008 21

TypeIIVirtualization

upon

SSI

N1 N2 N3

Host OS: SSI

App1 App2

VM1 VM2

Hypervisor

12

(22)

TypeIIVirtualization

upon

SSI

N1 N2 N3

Host OS: SSI

App1 App2

VM1 VM2

Hypervisor Advantages:

VM could use virtual

resources composed with several physical nodes (for instance, memory)

(23)

VHPC'08

August 2008 23

SSI

upon

TypeIIVirtualization

(24)

SSI

upon

TypeIIVirtualization

N1 N2 N3

App1 App2 App3

Host OS1 Host OS2 host OS3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4

Advantages:

Possibility to have Virtual Cluster and to

(25)

VHPC'08

August 2008 25

SSI

upon

TypeIIVirtualization

N1 N2 N3

App1 App2 App3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4

Advantages:

migrate it from nodes to others

(26)

SSI

upon

TypeIIVirtualization

N1 N2 N3

App1 App2 App3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4

Advantages:

(27)

VHPC'08

August 2008 27

SSI

upon

TypeIIVirtualization

N1 N2 N3

App1 App2 App3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4

Advantages:

13

N4

host OS4

(28)

SSI

upon

TypeIIVirtualization

N1 N2 N3

App1 App2 App3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4

Advantages:

N4

host OS4

(29)

VHPC'08

August 2008 29

SSI

upon

TypeIIVirtualization

N1 N2 N3

App1 App2 App3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4

Advantages:

13

N4

host OS4

Hyp4 VM4

(30)

SSI

upon

TypeIIVirtualization

N1 N2 N3

App1 App2 App3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4

Advantages:

N4

host OS4

Hyp4 VM4

(31)

SystemLevel Virtualization

Goldberg:

TypeI-virtualization

14

(32)

SystemLevel Virtualization

Goldberg:

TypeI-virtualization

Hardware Hypervisor Host OS (Dom0) VM

Kernel Space User Space

... VM

Example of typeI-virtualization: XEN

Guest OS Guest OS

(33)

VHPC'08

August 2008 33

TypeIVirtualization

upon

SSI

N1 N2 N3

Host OS

(Dom0) VM1 VM2

App1 App2 App3

Example: ScaleMP is like a distributed superbios

15

Guest OS Guest OS

(34)

TypeIVirtualization

upon

SSI

N1 N2 N3

Host OS

(Dom0) VM1 VM2

App1 App2 App3

Characteristics:

Distributed hypervisor

Example: ScaleMP is like a distributed superbios

Guest OS Guest OS

(35)

VHPC'08

August 2008 35

SSI

upon

TypeIVirtualization

VM1 VM3

SSI

App1 App2 App3

H o st O S (D om 0 ) H o st O S (D om 0 ) Hypervisor N2 VM2 Hypervisor N1 Same as

SSI upon TypeII-Virtualization

(36)

NOT in Goldberg classification, but more and more used nowadays

(37)

VHPC'08 Las Palmas de Gran Canaria August 2008 37 Host OS + Hypervisor Kernel Space User Space Hardware cntr1 cntr2 Kernel Space User Space

NOT in Goldberg classification, but more and more used nowadays

17

Example of containers: OpenVZ, chroot

Host OS + Hypervisor

(38)

Container on the top of SSI

Ctnr1 Ctnr2 Ctnr3

N1 N2 N3 N4

App1 App2 App3 App4

(39)

Container on the top of SSI

Ctnr1 Ctnr2 Ctnr3 N1 N2 N3 N4

App1 App2 App3 App4

18

Container + SSI Distributed

Host OS including containers

(40)

Container on the top of SSI

Ctnr1 Ctnr2 Ctnr3

N1 N2 N3 N4

App1 App2 App3 App4

Advantages: To have containers taken advantage of distributed SMP Container + SSI Distributed Host OS including containers

(41)

SSI on the top of Container

OS0 Ctnr1 Ctnr2 Ctnr3 Ctnr4 N1 N2 N3 N4 SSI

OS0 OS0 OS0

Ctnr5 Architecture irrelevant:

The same kernel is shared between all containers (they have not their own kernel)

(42)

OS0

Ctnr1 Ctnr2 Ctnr3 Ctnr4

N1 N2 N3 N4

SSI

OS0 OS0 OS0

Ctnr5 Architecture irrelevant:

The same kernel is shared between all containers (they have not their own kernel)

(43)

VHPC'08

August 2008 43

Lessons Learnt

➔

Containers on top of single system image clusters

➔

The SSI system combines all the advantages enabled by

containers on a real SMP machine in a cluster

environment

(44)

Lessons Learnt

➔

Virtual Machines on top of SSI clusters

➔

Same advantage as containers

➔

Virtualization solves application portability issues

➔

example :

➔

Possibility to run an application developed for process

technology A and OS B on top of computers running

SSI OS based on OS C and developped for achitecture

processor D.

(45)

VHPC'08

August 2008 45

Lessons Learnt

➔

SSI on top of VMs

➔

VM migration and suspend functionalities provide:

➔

Flexible, simple and ''On Demand'' resource allocation

mechanisms for the applications

➔

Transparent adaptation mechanisms in case of

hardware changes (for instance, node additions /

removals).

(46)

Lessons Learnt

➔

Virtualization and SSI complement each other

➔

SSI abstracts resources

(47)

Combining Virtualization and SSI

Isolation of Two Distinct SSIs

N1 N2 N3 SSI 1

App1 App2 App3

OS1 OS2 OS3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4 VM5

SSI 2 Possibility to run several

isolated SSIs on the same cluster.

(48)

Combining Virtualization and SSI

Three layers of flexibilities

N1 N2 SSI VM1 VM2 VM1 VM2 App1 Possibility to run a windows application

on a linux SSI cluster running upon MACOS X systems

(49)

VHPC'08

August 2008 49

Conclusion

➔

Combining VM/SSI setup:

- Very attractive

- Installation and use are quite simple

(evaluated with TypeII)

➔

Developpement of a framework allowing to

- Deploy VM on G5K

- Deploy SSI (Kerrighed) on physical/virtual nodes

➔

Facility of deploying experiments

(50)

Future Work

➔

Performance evaluation

➔

Extend the Goldberg's classification to present in a

uniform way:

➔

The hardware,

➔

The emulated hardware,

➔

The OS and SSI,

➔

The different kinds of virtualization techniques,

➔

The containers.

(51)

VHPC'08

August 2008 51

Future Work

➔

Investigate SSI scheduler and hypervisor scheduler:

➔

does the SSI scheduler directly manage VMs ?

➔

Extend to the Grid: interests of such hybrid approaches

(VM/SSI) in XtreemOS

(52)

Is Virtualization Killing SSI Research?