OW2 Open Source Cloudware Initiative

(1)

OW2 Open Source Cloudware

Initiative

Denis Caromel, INRIA, CNRS I3S Frédéric Dang Tran, Orange Labs Jean-Pierre Laisné, Bull, OW2

Alexandre Lefebvre, Orange Labs, OW2,

Jean-Marc Menaud, Ecole des Mines de Nantes, Benoît Pelletier, Bull

Franca Perrina, INRIA

(2)

Cloud computing is a long-term

business opportunity

Five-year annual growth rate of 26 percent--over six times the rate of

traditional IT offerings. 2009 2010 2011 2012 2013 0,0 10,0 20,0 30,0 40,0 50,0

Worldwide IT Cloud Revenue

by Product/Service Type Servers Storage Infrastructure SW App Dev/Deploy Applications

Source IDC, September 2009

b ill io n d o lla rs

 A disruptive innovation driven by two key industry trends

 Commoditized enterprise IT: hardware, software and

networks and standardized enterprise usage

 New Internet-based IT usage: new economic models to

absorb fluctuating or peak demands

(3)

Open source software is critical

for cloud computing openness

 While openness seems still a distant reality...

 Different meanings

 Proprietary core business

 Few consensus on standards

 ...Open Source Software is now critical for Cloud Computing ...

 General consensus about costs reduction and facilitated

adoption

 Open APIs for pragmatic reasons

 OSS and open standards

 … but Cloud Computing is also a risk for OSS

 OSS enclosure

 OSS is at the heart of Cloud

 Virtualization technologies:

Xen, KV, OpenVZ, VirtualBox, etc.

 Infrastructure management:

OpenNebula, Eucalyptus, Libcloud, etc.

 Platform environment:

Heroku, etc.

 OSS a unique proposition for

 Interoperability

 Transparency / Privacy / Security

 Sovereignty

 De facto open standards

(4)

An industry empowerment

startegy

 Furthermore, most consortia managing open source

development and marketing are based in the United States and funded by US IT companies.

 If the cloud computing research aims at realizing a sustainable European economic opportunity as envisioned in 2010, this imbalance needs to be addressed.

(...)

 The EC should promote the European leadership position in software through commercially relevant open source approaches.

 Maintaining an open source

approach for research results and cloud infrastructure support tools

ensures uptake and simplifies

adaptation to different environments. The European open source

movement should thereby work strongly together with industry to

The OW2 opportunity... OW2 to foster Cloud projects to be funded within EU "Future of Internet" programmes and PPP mechanisms

(5)

Open Source Cloudware Initiative

A business ecosystem at work

•Software Vendors •Systems Integrators •Academia •Enterprises •Telcos •SMEs •Public Entities STAKEHOLDERS STAKEHOLDERS

VISION & GOALS

OW2 Technology Vision Jet Stream discussion From Middleware to Cloudware Open Cloud Computing Open Source Empowerment 3

3rdrd_{party projects}_{party projects}

OW2 projects

Collaborative projects

(6)

OW2 OSC Initiative: Roadmap



Priorities

1. Define research and

development agenda

2. Define, develop, integrate,

deliver and promote all open

source components aiming

to deliver OW2 Open Source

Cloudware

3. Global lobbying for Open

Source Cloudware



Milestones

May 2010:

Launch and initiative

participant recruitment drive

Sept 2010:

Workshops, seminars

Dec 2010:

First

Research Agenda

Cloudware white paper

Mid 2011:

First

OSC implementations

(7)

Elasticity for Green

Java EE PaaS

(8)

Cloud Computing at Orange



Context:



Large-scale datacenters (+40,000 x86 servers)



JavaEE JOnAS middleware stack: +250 applications,

+1,000 application server instances



Static server consolidation (12/1) through virtualization:

• Utilization level increased from 20% to 75%



Next step: migration to a Cloud model



On-demand JavaEE server provisioning according to

demand fluctuations



Automation of the management of virtualized JavaEE

clusters: deployment, update, auto-scaling etc.



Open (source) cloud management stacks alternatives

(9)

Self-sizing for Java EE PaaS



Goal : improve the platform efficiency

(performance, energy cost)



Challenges



Cluster growth/shrink capabilities according to

workload



Datacenter multi-tenancy with limited capacities

requires arbitration policies



Datacenter placement for minimizing the energy

consumption

(10)

OW2 code base



JOnAS (http://jonas.ow2.org)



Enterprise OSGi & Java EE 5 certified server



JASMINe (http://jasmine.ow2.org)



Management tools for SOA platform



Monitoring module (probe, mediation, graphs)



Decision module (rules engine based)



Virtual Machine Management (Xen, VmWare, ...)



CLIF (http://clif.ow2.org)



Load testing



Selfbenchmarking



Entropy (in progress)

(11)

Architecture for self-sizing

VM placement

VM provisioning

Scale up/down

IaaS

PaaS

(12)

Before

After

25% Energy Savings

Task 1 Task 2 Task 3 Task 4 Server 1 Server 2 Server 3 Server 4

(13)

To conclude



Future Work in SelfXL



DSL (shell)



Control loop coordination



Beyond SelfXL



International contributions

• University of Fortaleza (Brazil)

– Cloud APIs in JASMINe (EC2, OpenNebula, Eucalyptus, …)

• Beihang University of Aeronautics & Astronautics,

Peking University (China)



Collaborative projects

• COMPATIBLE ONE (System@tic )

• Cool-IT (System@tic)

• 4Caast (FP7)



OW2 Open Source Cloudware Inititiative



Open Cloud based on Open Source and Open

(14)

Application acceleration

and Cloud Management

(15)

Java Parallel

Toolkit Multi-Platform Job Scheduler ResourceManager

Strong Differentiation:

q

Java Parallel Programming

+ Integration +

q

Portability: Linux, Windows, Mac

+

q

Versatility: Desktops, Cluster, Grid, Clouds = Perfect Flexibility

Used in Production Today:

50 Cores → 300 Cores early 2010

(16)

ProActive with Desktops, Grids,

Clouds (EC2)

(17)

ProActive Parallel Suite

q

_{Workflows in Java}

q

_{Master/Workers}

q

_SPMD

q

_Components

q

_…

(18)

(19)

ProActive Scheduling

RESOURCES

§ Multi-platform Graphical Client (RCP) § File-based or LDAP authentication

§ Static Workflow Job Scheduling, Native and

Java tasks, Retry on Error, Priority Policy, Configuration Scripts,…

§ Dynamic and Static node sources, Resource

Selection by script, Monitoring and Control GUI,…

§ ProActive Deployment capabilities:

Desktops, Clusters, Clouds,… ProActive

Scheduler

ProActive

(20)

(21)

(22)

(23)

ActiveEon: company born of INRIA

q

_{Co-developing, Support for}

ProActive Parallel Suite

q

_{Worldwide Customers:}

Fr, UK, USA

(24)

For more informations Please contact Cedric Thomas (CEO) cedric thomas @ ow2 org

www.ow2.org

(25)

There is more to Cloud openness

than just open source software

Sources:

http://www.linux-magazine.com/Online/News/Richard-Stallman-Cloud-Computing-a-Trap

 The need for openness

 Corporate customers and

consumers alike will want to be able

to shift from one cloud to another

in search of the best experience

and the best pricing, and they’ll want the cloud services they choose to be able to interact with each

other, in the background, on their behalf.

 All vendors will pledge 'Cloud

Openness'...

 In the 90s, all hardware vendors

were selling 'open systems' ;-)

 OSI-like criteria for Cloud Openness

 No barriers to entry

 No barriers to exit

 No discrimination

 Interoperability

 Free/Open source licenses

(26)

OW2 to interact with existing

open source cloud communities

 Cloud stacks  TioLive  Virtualization technologies  KVM.org  VirtualBox.org  Xen.org

• Incl. Xen Cloud Platform initiative

 OpenVZ  Infrastructure mgt technologies  Open Nebula  Eucalyptus  LibVirt  Apache Hadoop  HPC on demand technologies  XtreemOS

 Others - Non open source  Enomaly (Infra Mgt)

(27)

Generally accepted service layers

and main offerings positioning

 Complete end-user-oriented applications customizable within limits.

 The broadest market. In this case the provider allows the customer only to use its applications.

 The software interacts with the user through a user interface.

 API to build higher-level applications. Pre-built application components

 A set of software and development tools hosted on the provider's servers.

 Developers can create applications using the provider's APIs and underlying data models and constructs.

 No interoperability standards (yet), so some providers may not allow customers to move applications to another platform

 Execution resources, servers, storage and network

 Provides virtual servers with unique IP

addresses and blocks of storage on demand.

 Customers can pay for exactly the amount of service they use: this service is also called utility computing. Software as a Service SaaS Platform as a Service PaaS Infrastructure as a Service IaaS  SalesForce.com  GoogleDoc  Google Apps

 Amazon Web Services (AWS)

 Google AppEngine

 Microsoft Azure

(28)

Tentative mapping of OW2

existing projects

 SaaS platform

 OW2 Spagic, Talend, Xwiki,

 "on-demand" information System

 includes OW2 middleware stack + OW2 architecture (Fractal, Dream, Chameleon)

 Development and composition environment

 OW2 Acceleo, Chameleon/Cilia mediation, Talend

 Cloud testing and cloudified testing platform

 OW2 CLIF

 VM (appliance) building and management

 to be used for development, testing, pre-prod, production

 embedded OW2 middleware in the VM

• includes JOnAS/JASMINe, PEtALS, eXo, xWiki, Talend, JORAM, Bonita, Spago, Orbeon, …

 management of such VMs (versioning, deployment) • OW2 JASMINe, UShareSoft partnership

 Autonomic Cloud Application Servers

 JASMINe evolutions (Context of ANR SelfXL project)

 SLA verification

 OW2 Chameleon/Cilia mediation

 Open Cloud (IaaS)

 Cloud interoperability, migration between clouds providers

 ProActive

 Personal Storage Cloud

 OW2 Funambol, OpenMobileIS, Ingres

* OW2 Stack: JOnAS/JASMINe, PEtALS, eXo, xWiki, Talend, JORAM, Bonita, Spago, Orbeon, … OW2 Stack ...But do members have a mid- to long-term Cloud Computing strategy?

(29)

JetStream: Cloud computing in

our technology vision?

 Develop, integrate, deliver and promote the "OW2 Cloud Stack"

 Drive OW2 projects evolution toward cloud computing

 Drive OW2 alignment with relevant standards

 Foster OW2 OSS for cloud computing

 Develop a network of cloud-oriented partners

 Promote and integrate "best of breed" Cloud Floss

 Generally promote OW2 and its projects and members

A path from

«Cloud Aware»

(30)

OW2 to align with most current

cloud open standards



Areas to follow include



data and application

portability,



cloud interoperability



management, monitoring,

metering



security and privacy



HPC



Many standard bodies



DTMF



Cloud incubator, includes

OVF (Open Virtualization

Format)



Open Grid Forum (OGF)



Open Cloud Computing

Interface (OCCI) working

group



Open Cloud Consortium

(OCC)



Cloud Computing

Interoperability Forum

(CCIF)

(31)

Homework



What is our definition of Cloud computing?



Is Cloud computing an opportunity for OW2?



What is our window of opportunity?



Should OW2 develop a Cloud computing

strategy and how?



What can OW2 contribute to Cloud

computing? What are our resources?



Which OW2 members have an interest in

Cloud computing? A strategy?



What do we want to do? What can OW2 do?



What should we expect from the TC do? From

(32)

Conclusion

Java Parallel

Toolkit Multi-Platform Job Scheduler ResourceManager

q

Flexibility

Clutch Power

q

Portability:

Windows, Linux, Mac

q

Versatility:

Desktops, Grids, Clouds

Free Professional Open Source Software

Multi-Core: Ready for the next revolution

Virtualization: Dynamic Load Balancing onto VMs

(33)

ProActive Scheduling Big Picture

RESOURCES

Scheduler

ProActive

(34)

ProActive Scheduling Big Picture

RESOURCES

Scheduler

ProActive