Interoperability in a Cloud Ecosystem
Architecture as bare necessity
Agenda
Setting the stage of Cloud Computing
Introduction to the IBM Cloud Computing
Reference Architecture (CCRA)
Hybrid Cloud Dimensions
1. Application integration (interoperability)
2. Application migration (portability)
3. Service orchestration
4. Security
5. IT Service management
6. Governance and Organisation
Closing
12.30 – 13.00: Welcome
13.00 – 13.30: Introduction CCRA
13.30 – 15.00: Dialogue part 1
14.45 – 15.00: Break (coffee)
15.00 – 16.30: Dialogue part 1
16.30 – 17.00: Closing (drinks)
3
Introduction
1 Min. per person
•
Name
•
Organization
•
Expectations
Edwin Schouten
IT Architect, Cloud Specialist
Presentor
Eric Michiels
IBM Liaison of the GSE
Architecture Working Group
Jan Willen de Hondt
Client IT Architect
Setting the stage of Cloud
Computing
5
Cloud computing definition
Business Process as a Service
Software as a Service
Platform as a Service
Infrastructure as a Service
Cloud computing is a model for enabling ubiquitous, convenient,
on-demand
network access to a
shared
pool of configurable computing resources (e.g. servers, storage, network, applications, and
services) that can be
rapidly provisioned and released
with minimal management effort or service
provider interaction.
Automation
Virtualization
Standardization
Public Cloud
Private Cloud
Hybrid Cloud
On demand self-service
Broad network access
Resource pooling
Rapid elasticity
Measured service
NIST * (Technical Definition)
Characteristics
Consumption models
Deployment models
Cloud
computing
NIST * (Technical Definition)
Characteristics
Consumption models
Deployment models
Cloud
computing
NIST * (Technical Definition)
Characteristics
Consumption models
Deployment models
Cloud
computing
NIST * (Technical Definition)
Characteristics
Consumption models
Deployment models
Cloud
computing
NIST * (Technical Definition)
Characteristics
Consumption models
Service models
Cloud
computing
Characteristics
Consumption models
Deployment models
Cloud
computing
Characteristics
Consumption models
Deployment models
Cloud
computing
Characteristics
Consumption models
Deployment models
Cloud
computing
Characteristics
Consumption models
Deployment models
Cloud
computing
Characteristics
Service models
Deployment models
Cloud
computing
Cloud computing - Service Models (NIST)
Networking
Networking
Networking
Networking
Storage
Storage
Storage
Storage
Servers
Servers
Servers
Servers
Virtualization
Virtualization
Virtualization
Virtualization
Operating system
Operating system
Operating system
Operating system
Middleware
Middleware
Middleware
Middleware
Runtime
Runtime
Runtime
Runtime
Application
Application
Application
Application
(Meta) Data
(Meta) Data
(Meta) Data
(Meta) Data
Traditional
on-premises
Infrastructure
as a Service
Platform
as a Service
Software
as a Service
C lie n t M a n a g e s V e n d o r M a n a g e s in C lo u d V e n d o r M a n a g e s in C lo u d V e n d o r M a n a g e s in C lo u d C lie n t M a n a g e s C lie n t M a n a g e sCustomization; higher costs; slower time to value
Standardization; lower costs; faster time to value
Servers,
Storage,
Network...
Web, App,
Database,
Messaging...
Email, CRM,
HRM...
(Meta) Data
7
One level deeper inside the Cloud Computing Consumption
Models.
• Operating system (OS) installation • Managed cloud portal
• Manged hypervisor (virtualisation) • Middleware installation
• Image & application catalogue • Change, issue & risk management • Configuration, licence & asset
management
• Backup management & monitoring • Security management & monitoring • Anti-virus installation & mngt. • OS monitoring & patching
Middleware
Functional application
Operating System
• Server & storage hardware • Rack & netwerk patching • LAN connectivity
• Datacenter facility
Traditional
• Middleware support & updates • Middleware monitoring & patching • Application Licenses
• Application support & updates • Application monitoring & patching
Additional service of in-house Managed service
Security &
patching
Backup, restore &
disaster recovery
WAN, VPN & Internet connectivity
• WAN, VPN en internet connectivityHosted
IaaS
IaaS
PaaS
Cloud computing is driving Business Transformation and IT
Efficiency.
Efficiencies
Changing the economics of IT
Automating service delivery
IT governance and policies
Radically exploiting standardization
Rapidly deploying new capabilities
IT-focused
An evolution of information technology
Business-focused
Creating new business models
Enabling speed and innovation
Reengineering business process
Supporting new levels of collaboration
Unleashing the end user productivity
An enabler of business transformation
10
Ways businesses are introducing Cloud Technologies to
support Agile development.
Disruptors
• Create radically different value propositions
• Generate new customer needs/segments.
• Disintermediate existing industries and/or
create new ecosystems
Innovators
• Significantly extend customer value
propositions to develop new revenues
• Transform their role within their industry
and/or enter a different industry ecosystem
Optimizers
• Incrementally enhance customer value
propositions
• Improve organizational efficiency
Im
p
ro
v
e
T
ra
n
s
fo
rm
C
re
a
te
Enhance
Extend
Invent
V
a
lu
e
C
h
a
in
Customer Value Proposition
Optimizers
Disruptors
Innovators
Introduction to the IBM Cloud
Computing Reference
12
Applications with
complex processes &
transactions
Not yet virtualized
applications
Highly customized
applications
Moving
to Cloud
Moving
to Cloud
May be
ready
for
Cloud
May be
ready
for
Cloud
Not
Ready
for
Cloud
Not
Ready
for
Cloud
Big Data & Analytics
Collaboration
Social Business
Mobile
DevOps
Front Office / Desktop
Business Processes
Web Applications
e-Commerce
Customer Service
ERP / CRM
HR / Workforce
Development
& Test
Compute
Disaster Recovery
High Performance Computing
Archive
Database
Risk & Compliance
Storage
Applications with
Sensitive Data
Regulation
Intensive
Applications
Information
Intensive
Applications
Isolated applications
Mature applications
Batch
processing
Performance & Scalability Multi-tenancy “Production cloud” Virtualization Management Hybrid Cloud Resiliency
Metering, Rating and Accounting BSS De-composition
Security
How to implement cloud computing according to the CCRA
Architecture Overview Component Model Operational Model S ta n d a rd s A rc h ite c tu ra l D e c is io n s Service Flows Use Cases Non-functional Requirements
+
+
+
+
There is a well-defined process for using the RA to implement a cloud service: – A cloud is constituted by a CCMP implementation and a set of cloud services delivered andmanaged by it.
A dedicated presentation and document is available describing the process for using the CCRA to
develop the management aspects for a cloud
service.
CCRA work products also serve as authoritative reference on specific technical topics for education purposes.
Define requirements and use implementation guidance for cloud
service and cloud platform implementation. Define requirements
and use implementation guidance for cloud
service and cloud platform implementation.
Create cloud service and cloud
platform implementation-specific architecture
overview. Create cloud service and cloud
platform implementation-specific architecture overview. 1 1 22
Define cloud service and CCMP-implementation
details. Define cloud service
and CCMP-implementation details. 3 3 Leverage architectural decisions documented in the
CCRA and make implementation-specific ones throughout the entire process. Leverage architectural decisions documented in the
CCRA and make implementation-specific ones throughout the entire process.
+
+
Leverage guidance on specific technicalareas as input for developing a cloud service and CCMP implementation. Leverage guidance on specific technical
areas as input for developing a cloud service and CCMP implementation. 3a 3a 3b 3b Cloud Service Creation Consumability
14
Follow a stepwise analysis of requirements in order to propose
a solution that meets the business drivers, and is scalable and
extendable into the future.
Hybrid Cloud: An Integrated Solution Across Multiple IT Layers
Security, Resiliency, Performance & Consumability
One or More Cloud Service Providers Common Cloud Management Platform (CCMP) Operational Support Services (OSS) Cloud Services Software-as-a-Service Business-Process-as-a-Service Business Support Services (BSS) Infrastructure Existing & 3rdparty
services, Partner Ecosystems
Platform-as-a-Service Infrastructure-as-a-Service
Server Virtualization Storage Virtualization Network Virtualization
Service Automation Management Service Quality Management Service Asset Management Service Operations Management
Platform & Virtualization Management Image Lifecycle Management Service Offering Management Customer Management Subscription Management Financial Management Consumer In-house IT Infrastructure Middleware Applications Business Processes S e rv ic e M a n a g e m e n t Cloud Service Integration Tools Process Integration Application & Data
Integration Identity Integration
Management Federation Spillover & Failover
Service Creation Tools Service Management Development Tools Service Runtime Development Tools Software Development Tools Image Creation Tools
Server Storage Network Facilities
Deployment and integration across datacenter IT
operations Deployment and integration
across datacenter IT operations On-premise, as well as off-premise, based infrastructure, connectivity, security and compliance requirements, standardization and automation, compatibility for hybrid
workloads On-premise, as well as off-premise, based infrastructure, connectivity, security and compliance requirements, standardization and automation, compatibility for hybrid
workloads
Integration across one or more cloud
providers’ management services Integration across one
or more cloud providers’ management services
Integration and consumption of different types of cloud
based services Integration and consumption of different types of cloud
based services Integration and consumption of different types of cloud
based services Integration and consumption of different types of cloud
based services Integration and consumption of different types of cloud
based services Integration and consumption of different types of cloud
based services Workload specific service creation, deployment, and management across hybrid cloud Workload specific service creation, deployment, and management across hybrid cloud Analysis and transformation of in-house infrastructure, middleware, applications, and business and IT processes for integration in hybrid cloud Analysis and transformation of in-house infrastructure, middleware, applications, and business and IT processes for integration in hybrid cloud
16
Hybrid Cloud - Scope and Dimensions
Scope and Purpose
• Use Cases: Identify use cases and scenarios for
hybrid cloud setup, operations, and management.• Patterns: Identify solution patterns for integration
of on-premise with services in public cloud(s).
• Lifecycle: Identify and define workload migration
and life cycle events for services in the hybrid cloud.
• Roles: Identify roles associated with hybrid cloud
operations and services.
• Decisions: Define architectural decisions for the
hybrid cloud integration framework and for hybrid cloud management services.Perspectives
• Operating Perspective: Seamlessly move
peek workloads from on-premise infrastructure to public cloud(s).• Sourcing Perspective: Different types of
workloads provisioned by the most effective cloud from the perspective of cost, functionality,availability, performance, security.
• Management Perspective: Unified view and
capability to manage resources and information on-premise and in off-on-premise clouds, combined with management and integration of workloads and resources across the whole hybrid cloud.Dimensions
– Integration:
How to connect on-premise services and data to off-premise counterparts, including business data mapping and service integration.– Security:
How to integrate on-premise/off-premiseidentities, policies, auditing systems; how to ensure proper security of off-premise cloud workloads; How to secure management and payload interactions.
– Monitoring:
Integrate monitoring of off-premiseinfrastructure and applications with an on-premise management system; Enable on-premise monitoring and event infrastructure to reach into clouds.
– Management:
Manage capacity in the cloud;provisioning- and de-provisioning based on monitoring data, capacity overflow from on-premise to Cloud; DR and resiliency.
– Governance:
Who can, does, or should use which cloud-based services; characteristics of service request management of on- and off-premise resources.– IT Service Management:
Operational aspects of IT services and cloud adoption impact on ITDimension 1
Application integration (interoperability)
18
A system that involves cloud computing typically includes data,
application, platform, and infrastructure components
Networking
Storage
Servers
Virtualization
Operating system
Middleware
Runtime
Application
(Meta) Data
Data is the machine-processable representation of
information, held in computer storage
Applications are software programs that perform functions
related to business problems
Platforms are programs that support the applications and
perform generic functions that are not business-related
Infrastructure is a collection of physical computation, storage
Cloud computing portability and interoperability categories
Networking
Storage
Servers
Virtualization
Operating system
Middleware
Runtime
Application
(Meta) Data
Networking
Storage
Servers
Virtualization
Operating system
Middleware
Runtime
Application
(Meta) Data
Platform portability
Platform interoperability
Application portability
Application interoperability
Data portability
Data interoperability
Management interoperability
Provider A
Provider B
• Moving VMs and virtual appliances
between clouds
• Tools for monitoring and managing
multiple clouds
• Migration between clouds
• Single sign-on access to multiple clouds
• Orchestrated processes accross clouds
20
Today’s DevOps landscape contains selective and siloed
solutions limit visibility across people, process and tools and
create gaps in the delivery process…
Manual
handoffs
GAP
Software DevelopmentManual
handoffs
GAP
Operations Test Line of BusinessPoor
alignment
GAP
•
Agile developer
tools
•
Build automation
•
Continuous
integration
•
Test infrastructure
automation
•
Test Management
•
Test Automation
•
Cloud,
virtualization
•
Infrastructure
provisioning
automation
•
App and
middleware
deployment
automation
•
Portfolio
management
•
Business process
management
•
Big Data/Analytics
Dimension 2
Application migration (portabiliteit)
22
OpenStack Compute
Provision and manage large networks of virtual machines • Platform integration
• High Availability enhancements • Resource optimization
• Live upgrade contributions
• Enablement for P & Z Systems, DB2 • ESXi support
• VM group enablement in scheduler • CPU allocation for vCPUs
• Cross hypervisor testing and validation
OpenStack Storage
Create petabytes of secure, reliable storage using standard HW
• Block & object storage enablement for IBM capability • Nova blueprints
• Cinder local storage & local instance clone
• Efficient clone image in Cinder SVC driver for cFlex • Nova & Cinder storage blueprints
• Storwise/SVC driver update – support iSCSI CHAP auth • Wsgi application interface enabling external web server • Swift / Keystone interface for Keystone v3 API
OpenStack Networking
Create petabytes of secure, reliable storage using standard HW
• Support for key emerging networking standards • Quantum blueprints & migration from Nova • FibreChannel support
OpenStack Shared Services
Libraries that provide image management, authentication & security across all OpenStack projects
• Security & authentication enhancements • Image activation for OVF
• Guest level metric collection
• APIs: Enablement for key emerging standards • Membership services enhancements
• Glance: multiple image locations
General OpenStack contributions
• Globalization and crowd-sourced translation integration • Drive IBM value-add capability from SCP
• Community facing contributions – bug fixing, community building & promotion
• QA items
TOSCA – Technical Overview
---Scripts Installables ImagesCloud Service ARchive (CSAR)
Topology and Orchestration Specification for Cloud Applications
A language for defining Service Templates … … including a Topology Template describing the structure of a service
… including the definition of building blocks for services … including the definition implementation artifacts for manageability operations … including the definition deployment artifacts for components
TOSCA defines a packaging format (CSAR) for packaging models and all related
… including the definition plans for orchestrating the application
24
Dimension 3
Service orchestration
30
Cloud management services
Orchestratie Services:
• Worklflows, leveraging existing skills,
processes and technology artifacts
(OSLC from OASIS)
Platform Services:
• Simplifies deployment and lifecycle
management of middleware and
application patterns (TOSCA from
OASIS)
Infrastructure Services:
• Highly flexible, scalable infrastructure
on heterogeneous resources
(OpenStack)
Extensibility:
• Plug and play operational service
management integration
• Rational development tooling
integration
• Pre-built images, patterns, process /
configuration automation
Orchestratie Services
Platform Level Services
O
p
e
ra
ti
o
n
a
l
E
x
te
n
s
io
n
s
(
A
P
Is
)
Infrastructure Level Services
D
e
v
e
lo
p
m
e
n
t
E
x
te
n
s
io
n
s
(
T
o
o
li
n
g
)
(Image Lifecycle Mgmt) (Pattern Services)
(Provisioning, configuration, resource allocation, security,
metering, etc.)
Cloud Resources
Governance
Security, Resiliency, Performance & Consumability
Cloud Service Creator Cloud Service Provider
Cloud Service Consumer Cloud Services IaaS PaaS SaaS BPaaS Common Cloud Management Platform Cloud Service Integration Tools Consumer In-house IT Infrastructure Middleware Applications Business Processes
OSS – Operational Support Services BSS – Business Support Services Subscription Management Pricing Entitlement Management
Metering Rating Billing
Clearing & Settlement Accounts Payable Accounts Receivable Customer Account Management Service Offering Catalog Service Offering Management Contracts & Agreement Management Service Request Management Order Management Transition Manager Deployment Architect Operations Manager
Service Provider Portal & API
Consumer Administrator Consumer Business Manager Consumer End user Service Creation Tools Service Management Development Tools Service Runtim e Developm ent Tools Software Development Tools Image Creation Tools Service Component Developer Inf rastructure Security & Risk Manager Customer Care Service Manager Business Manager Service Composer Offering Manager Service Integrator S e rv ic e M a n a g e m e n t S er vic e C on su m er P or ta l & A P I S er vic e D ev elo pm en t P or ta l & A P I A P I A P I A P I A P I Existing & 3rdparty services, Partner Ecosystems Provisioning Incident & Problem Management IT Service Level Management Service Automation Management
Service Delivery Catalog
Service Request Management Change & Configuration Management Image Lifecycle Management Monitoring & Event Management IT Asset & License Management Capacity & Performance Management
Platform & Virtualization Management
In fr as tr uc tu re M g m t I nt er fa ce s P la tfo rm M g m t In te rf ac es S of tw ar e M g m t In te rf ac es B P M g m t In te rf ac es
32
• Standardization is required to build up a community
contributing to a Cloud ecosystem:
• Need for standardized description for Cloud services;
• Need for standardized packaging format;
• Need for standardized APIs.
• Cloud Management and Orchestration (CMO)
standardization effort defines a model for managing Cloud
Services throughout their complete lifecycle:
• Initial deployment of a service instance;
• Operational management of a service instance (e.g. capacity
modification, patch management, incident management, etc.);
• Termination of a service instance.
• CMO defines:
• A structural model for services, (i.e. components and their
relationships);
• A process model for build- and management plans based on
BPMN 2.0 standard;
• APIs for requesting and managing Cloud services;
• A packaging specification for Cloud services and related
deployment artifacts.
OVA OVA----Definition
Artifacts
Packaging
Packaging
CSAR
EARs Images Scripts Workflows
Cloud Management and Orchestration Standardization Overview
Dimension 4
Security
34
Low-risk Mid-risk High-risk
Mission-critical workloads, personal information
Business Risk
Need for
Security
Assurance
Low High Training, testing with non-sensitive dataToday’s clouds are primarily here:
● Lower risk workloads ● One-size-fits-all approach to data protection ● No significant assurance ● Price is key
Tomorrow’s high value / high risk workloads need:
● Quality of protection
adapted to risk
● Direct visibility and
control ● Significant level of assurance Analysis & simulation with public data
One-size does not fit-all:
Business Security Reference Model
A
rc
h
it
e
c
tu
ra
l
P
ri
n
c
ip
le
s
Application and Process
People and Identity
IT Infrastructure: Network, Server,
End Point
Physical Infrastructure Data and Information Governance, Risk,
Compliance (GRC)
Security Services and Infrastructure
Security Policy Infrastructure Identity, Access and
Entitlement Infrastructure Security Info and
Event Infrastructure
Host and End-point Security
Storage Security Application Security Network Security Physical Security Service Management
Infrastructure
Designs Config Info and Registry Data Repositories and Classification Code and Images Policies Identities and Attributes Operational Context IT Security Knowledge Events and Logs Security Service Levels
Identity, Access and Entitlement Management
Threat and Vulnerability Management Data and Information
Protection Management Software, System and
Service Assurance
Security Policy Management
Risk and Compliance Assessment Command and Control
Management
Physical Asset Management
IT Service Management
Crypto, Key and Certificate Infrastructure
Foundational Security Management
38
Dimension 5
IT Service management
Service integration continues to evolve however there are mixed
views of how the hybrid integration / cloud service broker market
will develop
Fourth Generation Sourcing*
integrating a set of cloud and other service providers as part of an IT ecosystem to deliver
end-to-end IT services to the business
*
Master of the Outsourcing Game: Dan McNicholl, CIO ofGM North America, 2003
Generation I – do it yourself Generation II – single-source Generation III – multi-source Generation IV – integrate
"The service integrator model, in its various instantiations, is a good model for IT
organizations going forward relative to managing a diversified service delivery channel and
portfolio," says KPMG's Lepeak. "But like any model, it is evolving.“
cio.com The Outsourcing Year in Review – Grading our Predictions, Dec 2013
The third-party managed sourcing
model—[which I call] multi-sourcing
Integration-as-a-Service--is poised to
accelerate as the enterprise IT model
of the future.
Shaun Daly, partner, Sourcing Advisory
As cloud adoption proliferates, more IT
organizations in midsize to large organizations are
adopting the internal CSB role. Using external
providers exclusively to
manage all aspects of CSB is less likely.
43
Governance
Security, Resiliency, Performance & Consumability
Cloud Service Provider
Common Cloud
Management Platform (CCMP)
Operational Support Services
(OSS) Business Support Services (BSS)
Cloud Service Integrati on Tools Consume r In-house IT Service Creation Tools Infrastructure Cloud Services IaaS PaaS SaaS BPaaS Existing & 3rd party services, Partner Ecosystems Common Cloud Management Platform
OSS – Operational Support Services
BSS – Business Support Services
Customer Account Management Service Offering Catalog Service Offering Management
Service Provider Portal & API
S e rv ic e C o n s u m e r P o rta l & A P I S e rv ic e D e v e lo p m e n t P o rta l & A P I Change & Configuration Management Incident & Problem Management IT Asset & License Management Service Orchestration
Service Delivery Catalog
Service Request Management Provisioning Image Lifecycle Management
Platform & Virtualization Management
Cloud Service Broker Integration for Monitoring Metering,
Secure Connectivity, Policy Management
Hybrid Cloud Integrator:
Client controlled from within the enterprise
Enabled for Hybrid Cloud
Hybrid Cloud enabled on consumer side
Dimension 6
Governance and Organisation
45
Only 10% of Cloud Computing is about Technology; the rest is
about a new delivery model for IT services, impacting the
Business, Technology and Organization.
BIO=
Business+IT+Organization
The impact
of
Cloud Computing
The impact
of
Cloud Computing
Business
Go 2 Market
From Capex to Opex
Return on Assets
Balancesheet
Technology
Standardization
Consolidation
Virtualization
Automation
Organization
ITIL processes
Management System
Roles & Responsibilities
Skills
O
B
The Governance of a Cloud Computing does require special
focus on: IT alignment with changing Client service
requirements, control of the IT Service Catalog, and
relationships with Cloud Providers.
47
Closing
Final thoughts, on to the drinks!
To say thanks!
Cloudonomics The Business Value of Cloud Computing, by
Weinman, Joe
49