Is Virtualization Killing SSI Research?

Is Virtualization Killing SSI

Research?

Jérôme Gallard

Paris Project-Team Seminar Dinard – November 2007

My subject ! ;)

Reliability and performance of execution in

the context of grid environment

Outline

Context

- Cluster / grid

- SSI

- Virtualization

➔

Combining Virtualization and SSI

Conclusion

Introduction

N0 _{N1 N2}

N3 N4 N5

Cluster Exploitation:

➔

How to execute jobs on a cluster architecture?

- Batch scheduler (BS)

Batch Scheduler (BS)

N0

head node compute nodes

Wait queue of jobs

N1 _{N2 N3}

Single System Image (SSI) 1/2

compute nodes

N1 _{N2 N3}

N4 N5 N6

no head node

Single System Image (SSI) 2/2

Functionalities:

- Global management of processes

- Migration of processes

Virtualization Technologies 1/2

N0 VM0

VM1 VM2

compute node

Virtualization Technologies 2/2

➔

Combining virtualization with BS

N0

head node (BS) compute nodes Wait queue

of VMs

(JAWS [Grit2007])

N1 _{N2 N3}

Combining BS + VM

Simplify:

- Deployment of applications

- Management of applications

VMs vs SSI

Is virtualization killing system image research?

Introduction To Virtualization 1/5

●

Virtualization properties:

➔

Isolation

?

VM1

simulation _{web server}Apache

virtual machines

Introduction To Virtualization 3/5

●

Virtualization properties:

➔

Isolation

➔

Server consolidation

➔

Virtual machine portability

N0

VM0 virtual

Introduction To Virtualization 3/5

●

Virtualization properties:

➔

Isolation

➔

Server consolidation

➔

Virtual machine portability

Introduction To Virtualization 4/5

●

Virtualization properties:

➔

Isolation

➔

Server consolidation

➔

Virtual machine portability

➔

Application portability

VM0 virtual

machines

Introduction To Virtualization 5/5

●

Virtualization properties:

➔

Isolation

➔

Server consolidation

➔

Virtual machine portability

➔

Application portability

➔

Suspend/restart

VM0 virtual

Virtualization Classification 1/3

Goldberg [Goldberg1973]:

typeI-virtualization

Kernel Space User Space

... VM

The Host OS manages devices.

VMs are instances of virtual machines The Hypervisor (like a superbios):

* schedules the Host OS and VMs

Virtualization Classification 2/3

Goldberg:

typeII-virtualization

process.

VMs are instances of virtual machines

Virtualization Classification 3/3

Container based virtualization

Host OS + Hypervisor Kernel Space User Space Hardware Host OS + Hypervisor cntr1 cntr2 Kernel Space User Space

Combining Container and SSI

Container on the top of SSI 1/2

Container + SSI

Ctnr1 Ctnr2 Ctnr3

N1 N2 N3 N4

App1 App2 App3 App4

Combining container and SSI

SSI on the top of Container 2/2

OS0

Ctnr1 Ctnr2 Ctnr3 Ctnr4

N1 N2 N3 N4

SSI

OS0 OS0 OS0

Ctnr5 Architecture irrelevant:

Combining Virtualization and SSI

TypeI-Virtualization upon SSI 1/2

Hypervisor + part1 of SSI

N1 N2 N3

Host OS (Dom0)

part2 of SSI VM1 VM2

App1 App2 App3

Combining Virtualization and SSI

SSI upon TypeI-Virtualization 2/2

Combining Virtualization and SSI

TypeII-Virtualization upon SSI 1/2

N1 N2 N3

SSI

App1 App2 App3

Combining Virtualization and SSI

SSI upon TypeII-Virtualization 2/2

N1 N2 N3

SSI

App1 App2 App3

OS1 OS2 OS3

Hyp1 Hyp2 Hyp3

Combining Virtualization and SSI

Isolation of Two Distinct SSIs

N1 N2 N3

SSI 1

App1 App2 App3

OS1 OS2 OS3

Hyp1 Hyp2 Hyp3

VM1 VM2 VM3 VM4 VM5

SSI 2 Possibility to run several SSIs on

Combining Virtualization and SSI

Three layers of flexibilities

N1 N2 N3

SSI

VM1 VM2

VM1 VM2

App1 Possibility to run a windows application

Lessons Learnt 1/4

➔

Containers on top of single system image clusters

➔

The SSI system combines all the advantages enabled by

Lessons Learnt 2/4

➔

Virtual Machines on top of SSI clusters

➔

Same isolation advantage as containers

➔

Virtualization solves application portability issues

example :

➔

Possibility to run an application developed for process

Lessons Learnt 3/4

➔

SSI on top of VMs

➔

VM migration and suspend functionalities provide:

➔

Flexible, simple and ''On Demand'' resource allocation

mechanisms for the applications

➔

Transparent adaptation mechanisms in case of

Lessons Learnt 4/4

➔

Virtualization and SSI complement each other

➔

SSI abstracts resources

Conclusion

➔

Performance evaluation:

➔

VM usage does not significantly impact performances (4%

with MrBayes application in MPI mode)

➔

Combining VM/SSI setup:

- Very attractive

- Installation and use are quite simple

(evaluated with TypeII)

Future Works 1/2

➔

Extend the Goldberg's classification to present in a

uniform way:

➔

The hardware,

➔

The emulated hardware,

The OS and SSI,

Future Works 2/2

➔

Investigate SSI scheduler and hypervisor scheduler:

does the SSI scheduler directly manage VMs ?

➔

Extend to the Grid: interests of such hybrid approaches

References

➔[Grit2007] L. Grit, D. Irwin, V.Marupadi, P. Shivam, A. Yumerefendi, J. Chase, and J. Albrecht. Harnessing virtual machine resource control for job management. March 2007.

➔[Goldberg1973] R. P. Goldberg. Architecture of virtual machines. AFIPS National Computer Conference, July 1973.

➔[OpenVZ2007] OpenVZ. OpenVZ welcome page, 2007. Available as http://wiki.openvz.org/Main_page.

➔[Chroot2007] GNU. Chroot, 2007. Available as

http://www.gnu.org/software/coreutils/manual/coreutils.html#chroot-invocation

➔[Barham2003] P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and Warfield. Xen and the art of virtualization. Bolton Landing, New-York, USA, October 2003. SOSP'03.

➔[VMware2007] VMware. VMware welcome page, 2007. Available as http://www.vmware.com

[Bellard2005] F. Bellard. QEMU, a fast and portable dynamic translator. Technical report, USENIX Association, 2005.

➔[Huelsenbeck] J. P. Huelsenbeck and F. Ronquist. MrBayes: a program for the

Bayesian inference of phylogeny.