Yann Guerin
Cloud Architect – IBM Services SouthWest Europe Cloud Center of Excellence
IBM Infrastructure Montpellier Customer Center (PSSC) Cloud Leader
[email protected]
=
Reduced Cost
VIRTUALIZATION + STANDARDIZATION + AUTOMATION Increased
Flexibility
CLOUD COMPUTING
Monitor & Manage Services & Resources
Cloud Administrator Datacenter Infrastructure Service Catalog, Component Library Service Consumers Component Vendors/ Software Publishers
Publish & Update Components, Service Templates
IT Cloud
Access Services
The characteristics of
the Cloud Computing
IT delivery model are :
1) Service Based
2) Scalable & Elastic
3) Shared
4) Metered by use
5) Internet based
Public
Hybrid
Private
Banks use automated teller
machines to improve service
and lower cost
Manufacturers use robotics
to improve quality and lower
cost
…Breakthroughs like these are enabled by service management systems
Telcos automate traffic
through switches to assure
service and lower cost
SELF-SERVE PORTAL SERVICE REQUEST SERVICE PROVISIONING DYNAMIC INFRASTRUCTURE
“Self-service” plus standardization drives lower costs and unlocks
productivity for delivering workloads more effectively
End User Requests & Operators
…
Service Request & Operations Design & Build Image Library (Store) Deployment Operational Lifecycle of Images IT Infrastructure & Application Provider Service Creation & Deployment Virtual Image Management Service Catalog Request UI Operational UI Optimized Middleware(image deployment, integrated security, workload mgmt., high-availability)
Service Oriented Architecture Information Architecture
User Request Management/Self Service Portal
Security: Identity, Access, Integrity, Isolation, Audit & Compliance
Usage Accounting License Management Image Lifecycle Management Provisioning Performance Management Availability/Backup/ Restore
Service Lifecycle Management
Service Management
Virtual Resources & Aggregations
SMP Servers Storage Servers Network Hardware
System Resources
Blades Storage
Virtualized Infrastructure
Server Virt. Storage Virt. Network Virt.
Cloud Service Developer Cloud Service Provider
Security & Resiliency
Service Development
Tools
Common Cloud Management Platform
OSS – Operational Support System Instantiates & Manages Cloud Service Instances
BSS – Business Support System Manages the business aspects of Cloud Service Instances
Cloud Services
IT capability provided to Cloud Service Consumer
Virtualized Infrastructure – Server, Storage, Network, Facilities Infrastructure for hosting Cloud Services and Common Cloud Management Platform
Cloud Service Consumer
Partner Clouds
Customer In-house IT
Cloud Service Developer Cloud Service Provider
Common Cloud Management Platform
Virtualized Infrastructure – Server, Storage, Network, Facilities Cloud Service Consumer Partner Clouds Customer In-house IT Consumer Administrator Consumer Business Manager Developer
Service Business Manager Service Operations Manager
Cloud Services U s e r Inte rfac e Consumer End user API Software-as-a-Service Platform-as-as-Service Infrastructure-as-a-Service Business-Process-as-a-Service
Metering, Analytics & Reporting
Service Provider Portal
Service Development Tools Service Definition Tools Image Creation Tools Configuration Mgmt Offering Mgmt Order Mgmt
Accounting & Billing
Customer Mgmt
Entitlements
Contract Mgmt ReportingSLA
Pricing & Rating
Peering & Settlement Subscriber Mgmt
Service Offering Catalog Invoicing
Service Automation Management
Virtualization Mgmt Provisioning
Monitoring &
Event Management IT Asset & License Management Service Request Management
IT Service Level Management Image Lifecycle Management
Capacity & Performance Management Incident, Problem &
Change Management BSS Business Support System S e rvice Dev e lo pm e n t P o rt al API S e rvice Delivery P o rt al OSS Operational Support System
Service Transition Manager Service Delivery Catalog
Service Templates
Cloud Service Developer Cloud Service Provider
Common Cloud Management Platform
Virtualized Infrastructure – Server, Storage, Network, Facilities Cloud Service Consumer Partner Clouds Customer In-house IT Consumer Administrator Consumer Business Manager Developer
Service Business Manager Service Operations Manager
Cloud Services U s e r Inte rfac e Consumer End user API Software-as-a-Service Platform-as-as-Service Infrastructure-as-a-Service Business-Process-as-a-Service
Metering, Analytics & Reporting
Service Provider Portal
Service Development Tools Service Definition Tools Image Creation Tools Configuration Mgmt Offering Mgmt Order Mgmt
Accounting & Billing
Customer Mgmt
Entitlements
Contract Mgmt ReportingSLA
Pricing & Rating
Peering & Settlement Subscriber Mgmt
Service Offering Catalog Invoicing
Service Automation Management
Virtualization Mgmt Provisioning
Monitoring &
Event Management IT Asset & License Management Service Request Management
IT Service Level Management Image Lifecycle Management
Capacity & Performance Management Incident, Problem &
Change Management BSS Business Support System S e rvice Dev e lo pm e n t P o rt al API S e rvice Delivery P o rt al OSS Operational Support System
Service Transition Manager Service Delivery Catalog
Service Templates
Management Concerns in Cloud Architecture
Image Management
• Design, build and manage images for cloud services
Service Automation Management
– Interpret and Execute Build- and Management Plans
– Orchestrate Management Componentry
Security
• Design for Multi-Tenancy
• Protect assets through Isolation, integrity, image- risk and
compliance management
Usage Metering and Accounting
• Flexible support of delivery models
Heat and Power Management
• Control Energy Consumption
Virtualized Resource Management
• Deploy cloud services on virtualized resources
Lifecycle of a Cloud Service from a User view
B ro w s e C a ta lo g Co nfi gu rati on , Pri cin g & Ord eri ng Onboar ding Produc tion T er m in at io n Service Consumer Customer IT Architect Customer Administrator Service Catalog Browse Browse offerings of interest from menu via portal Configuration, pricing and ordering -Select a service, configure options, and price, and purchase-Interim Move, Add, Change, configuration change, reorders Customer Business Manager On-boarding
Provide additional IT asset information via portal for service initiation Service Consumer Service Instance Termination Cancel service Production
-Portal for service requests, reporting, notifications, and other cloud services -Billing -Payment Cloud Service Service Management Platform
Process Engine yMiddleware Virtualized and Standardized Resources yPhysical Assets
INFRASTRUCTURE SERVICES APPLICATION SERVICES PLATFORM SERVICES
Lifecycle of a Cloud Service from a Provider view
D e fi n it io n Off eri ng Subscr iption & Instant iation Produc tion T er m in at io n IBM / ISV / IT Dept Subscriber (e.g. Line of Business) Administrator / SLM Service Template DefinitionCreate Build- and Management Plans for Service Service Offering Creation & Registration Define Service based on Template and register it in
the Catalog Service Catalog Manager
Service Offering Subscription & Instantiation
-Select Service, specify parameters and SLA’s -Automatically instantiate the Service Subscriber (e.g. Line of Business) Service Instance Termination Destroy Service and free up resources Cloud Service Manual or Autonomic Execution of Management Plans leveraging Automation and Virtualization Ensure SLA Conformance Service Management Platform
Process Engine yMiddleware Virtualized and Standardized Resources yPhysical Assets
INFRASTRUCTURE SERVICES APPLICATION SERVICES PLATFORM SERVICES
PSSC Clouds Architecture Overview Diagram
Service Request & Operations IT Infrastructure & Application Provider Service Creation & Deployment Setup Manager Provisioning Manager X86 Manage-through Servers Power Manage-through Servers z Manage-through Servers z Pool POWER Endpoints x86 Injection Pool x86 Light Pool Storage Manage-through Servers Production User Managed Storage Endpoint Reservation Engine Web Portal OpenVPN Server e-mail Web Portal Pre-production EnvironmentTask and Resource Automation Products
TPM, TSM, TPC, ITM, etc.
Task and Resource Automation Products TPM, TSM, TPC, ITM, etc. Tools Tools Process Automation Process Automation Operational Interface Operational Interface
Service Automation Manager
Service Offering Service Instance Interface Service Center Management Service Operational Dashboard Service Offering Definition Assets CCMDB Service Requestor Service Subscriber Service Center Administrator Service Center Operator Service Catalog Manager Service Request Interface
Tivoli Service Automation Manager : What is it?
An integration of existing Tivoli capabilities and additional new capabilities,
workflows, and best practices packaged together as a single solution
Tivoli
Provisioning
Tivoli process automation engine
Tivoli Service
Catalog
Tivoli CCMDB (configuration mgmt)TSAM
Monitoring•
Provides capabilities for deploying, requesting & managing Cloud Services
•
Self-Service request, instantiation and automated delivery of Cloud Services
•
Integrated Management of Cloud Services along their lifecycle
•
Automation based on templates and management plans including human and automated
management components
•
Allows end users and IT administrators to manage Cloud Services as a first
class resource
•
An integration of existing Tivoli capabilities and additional new capabilities,
workflows, and best practices packaged together as a single solution for our
clients
TSRM Application service catalog offering service request … TSAM Application service template instances topology/nodes mgmt plans …
TSAM Admin GUI
TPAE/Maximo
• Interaction with end user
• Collect parameters for management plans
• Prepare service request from given input
parameters • Perform reservation of resources • Approval and notifications on business level TSRM GUI Dojo based widgets TPM 7.1.1 Workflows LDOs query/set/.. DCM … DCM CMDB • Topology definition
• Orchestration by management plans
• Management plan definition
• Management plan execution
- push down on eg. TPM (or Script)
• Approval and notifications on technical level (admin)
• Situation governance
incl. error handling by admin
• Management plan
fulfillment by executing TPM workflows/LDOs … or native scripts … or Java based actions … or manual tasks
• Change resource state
GUI TSRM TSAM TPM
Java I/F TSAM Admin GUI
Script I/F
TSAM architecture and control flow
Business value
Automate the OS deployment of complex and large
scale of desktop computers Common OSD technology for IBM solutions Data center management: Server support
Major themes
Consolidate in the desktop market 2006-2007 2007-2008 Consolidate in the server market RDM integration TCM integration Sparc support for the sunV4 architecture
e ESX se rver
Secure hard-disk disposal
Hardware support refresh
Partial P2V support
Linux LVM
Director 6.1 integration
TPM 7.1 integration
Hardware configuration on X86 and x(6-64 (DELL/IBM/HP)
AIX on p deployment support
Linux on p deployment
Linux on cell deployment
Manage-to Windows 2008
Vista/Win2008 offline patching
Enhanced driver injection
Automate
the installation of an
Operating System (from scratch)
• Remotely manage target machines with no agents or boot disks required
• Configure hardware and Install applications as part of the process
• Configure OS parameters
Make the process
universal
• Inject drivers automatically to use a single image on multiple hardware targets
• Separate applications and settings from the image to reduce the number of images
• Have the same process for different target Operating Systems
Integrated
as
OSD technology
in other products
• TPM7.1,Director 6.1,RDM 4.40,TCM 4.2Managed Through Capabilities : TPM for OSD value proposition
Golden Images
Design
Build
Store
Deploy
Manage
Governance Flows
Graphical design environment for virtual images
Build image repository
Storage linked repository Network linked repository Import/ Export
Image Deployment Tooling (per Hypervisor)
Z P x86
Operational DSL (Images + other Soft.)
CMDB
Software Deployment Tooling
Z P x86
Dev-test
Operations
Capture Patch/Software Install Capture Tooling Integration System Z Ap p Ap p OS Ap p Ap p OSNetwork Sub system
Network Sub system
System P Ap p Ap p OS Ap p Ap p OS System x Ap p Ap p OS Ap p Ap p OS STORAGE Resides in
Image Library & Mgmt.
Build tooling & Metadata editing Platform specific repositories Copy Activation & Configuration Engine Overall Orchestrator
Business value
Automate the OS deployment of complex and large
scale of desktop computers Common OSD technology for IBM solutions Data center management: Server support Foundation for the automation of Data Center optimization best practices.
Major themes
Consolidate in the desktop market 2006-2007 2007-2008 Consolidate in the server market Optimization tool at support of
• Dynamic Data Center & Cloud computing Virtualization • VMWare,XEN/Microsoft support • Full P2V/V2V/V2P migrations support
Bare Metal Restore
DTM integration
Image management integration ( Zephyr/Encompass)
Hardware configuration on Sparc and PowerPC pSeries cloning OS currency Engine improvements( WinPE/MCP) Standalone deployments(pull) FIPS compliance
Cerificate based access
MAC support OS currency Partial P2V support Linux LVM Director 6.1 integration TPM 7.1 integration
Hardware configuration on X86 and x(6-64 (DELL/IBM/HP)
AIX on p deployment support
Linux on p deployment
Linux on cell deployment
Manage-to Windows 2008
Vista/Win2008 offline patching
Enhanced driver injection
RDM integration
TCM integration
Sparc support for the sunV4 architecture
VMW
areESX server
Secure hard-disk disposal
Hardware support refresh
2008-2011 Expand in High and Mid markets
How to handle Image Sprawl: Customer needs a way for organizing, inventorying, securing, managing and deploying images to the various virtualized platforms in a scalable manner.
– Discovery of VM instances and dormant images on different Virtualization infrastructure (Hyper-V, VMWare, xVM, KVM, XEN)
– Support of multiple image formats (VMDK, VHD, RAW, VDI)
– Consolidated view (images browser) of heterogeneous physical and virtual images
How to efficiently store images: Sprawl introduces also the challenge of how to optimize the store of thousands of images (Image are large - many GBs)
– Image shared repository allowing efficient storage support for both block-based and file-based approach
– Smart sector mode capturing ( implicit disk and file system de-fragmentation )
– Optimized image transfers by sending only unknown files or blocks through the network
How to easily and seamlessly automate the management of heterogeneous virtual and physical servers using the same techniques, same integrated life cycle and same skill set?
– OSD built in technology ( universal image and driver injection capabilities) may enable any kind of image migration process ( P2P / P2V / V2V / V2P )
– OSD provides an intuitive interface hiding the differences between heterogeneous virtualization infrastructures and between the physical and virtual world
Dormant images needs maintenance too. (E.g. security patches)
– OSD offer the capability to patch offline different type of images ( VMDK,VHD, VDI, RAW , OSD , Physical) using the same techniques . This use case allows to do the following on dormant images:
• Install hot-fixes/patches
• Add new files in the image or modify existing ones
– Patch images immediately or keep a dormant patch until machine is powered up next time
Customers need to protect their investments and not get trapped by one virtualization infrastracture
– OSD is a hypervisor-independent baseline for image management – OSD is a part of the foundation of IBM Service Management strategy
• Strategic solution ready to integrate in the Tivoli family
Problems that TPM for Images solves
Tivoli Portfolio for Provisioning the Datacenter
Heterogeneous OS Deployment and management
Image Management
Resource Provisioning and Configuration Management
IT Service Delivery for Cloud
Tivoli Provisioning Manager for OS Deployment IT Service Delivery for Cloud Resource Provisioning and Configuration Management Image Management Heterogeneous OS Deployment and Management Tivoli Provisioning Manager TPM for OS Deployment Included in TPM TPM for Images Chargeable Component Tivoli Provisioning Manager For Images Tivoli Service Automation Manager TPM Included in TSAM TPM for OS Deployment Included in TSAM TPM for Images Included in TSAM Cloudburst (HW Appliance) TPM Included in CloudBurst TPM for OS Deployment Included in CloudBurst TPM for Images Included in CloudBurst TPM for OS Deployment TSAM Included In CB
Cloud Platform & Infrastructure
Management
IBM Virtualization Strategy
Improve Total Cost of Ownership (TCO)
Decrease management costs
Increase asset utilization
Manage consolidated systems to drive down energy requirements
Access through shared infrastructure
Leverage common tools across many systems
Improve business resilience and security
Establish foundation for
Service-Oriented Architecture (SOA) Increase flexibility Simplify by masking complexity
Create pools of system resources
Maintain freedom of choice with open standards
LEVERAGE VIRTUALIZATION for SERVICE MANAGEMENT
RESOURCE VIRTUALIZATION
Clients Servers Network Storage
VIRTUALIZATION MANAGEMENT
Physical and virtual platforms
Flexible Resource Entitlement & Allocation
- Dedicated or shared - Capped or uncapped
Complete Resource Virtualization - Including LAN and Disks
- In-roads in Memory Virtualization Combined with Business Offerings - Capacity upgrade on Demand
Physical Micro-Partitionin g Sys2 Sys1 Application A Application B Application C Sys3 IBM develops Hypervisor that would become VM on the mainframe IBM announces first machines to do Physical Partitioning IBM announces LPAR on the mainframe POWER LPAR design begins IBM introduces LPAR in POWER4 based systems with AIX / Linux Advanced POWER Virtualizatio n ships IBM announces PowerVM™
1967
1973
1987
1997
2001
2004
2008
Logical/Dynamic Live Partition Mobility
IBM UNIX Virtualization
Leadership for
Virtual disk
Storage area network (SAN)
IBM TotalStorage® HP EMC IBM DS-4000™ IBM DS-8000™ HDS Storage pool Virtual disk Virtual disk Virtual disk Virtual disk
Manage the storage pool from a central point
Æ Reduced
management complexity Combine the capacity from multiple arrays into
a single pool of storage
Æ Optimized capacity utilisation
Make changes to the storage
without disrupting host applications
Æ Improves application availability
Æ Non-disruptive data migration
Apply common copy services across the storage pool Æ disk vendor independent replication options
SAN Volume Controller advanced copy services
Physical Server Installed
Base (Millions)
Source: IDC, 2006
Server Mgt and Admin Costs
$0 $50 $100 $150 $200 $250 $300
199
6
199
7
199
8
199
9
200
0
200
1
200
2
200
3
200
4
200
5
200
6
200
7
200
8
200
9
201
0
Spending (US$B)New Server Spending
Power and Cooling Costs
0 5 10 15 20 25 30 35 40 45 50 55 60 60 Virtual+Physical Server Installed Base (Millions)
• IDC projects that use of server virtualization
will result in a significant increase in the number
of servers (physical + virtual) to be managed
• The projected increase is not yet reflected in
their forecast of server management costs
Virtualization Management
Gap
VMControl Unifies Virtualization Management
Enabling consistent multi-platform management for IBM Systems
• Manages Power Systems, System z
®, System x
®, storage and network
resources
• Integrates management of virtual servers, appliances, storage, networks and
clouds
System Pools: Next Step in Evolution of Virtualization
Managing a pool of server resources with single systems simplicity
Combines multiple virtual resources into one manageable entity
Automates virtual image mobility for optimal utilization and resilience
Optimizes virtual assets for performance, availability and energy use
Integrates server, storage and network virtualization
Compute Memory Network Storage
Virtualization
Compute Memory Network Storage
IT Resources
Virtual Images
System Pools
Mobility Optimized for Availability Performance EnergyIBM Cloudburst
A complete solution to start your private cloud delivered with hardware, software and services
The IBM Cloudburst functionnalities
z A user self service portal z A services & product catalog z An automation infrastructure z Pre configured templates
z Network,hardware & software virtualization z Accounting & Charging systems
Mid-plane
AMM2
AMM2 Mid-plane
Customer SAN Network Customer Ethernet Network
x3650 M2
HS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 BladeHS22 Blade
24 port 1Gps Ethernet Switch 24 port 1Gps Ethernet Switch
10G Ethernet Switch MSIM-L Bay 9 10G Ethernet Switch MSIM-L Bay 7 20port FC SM 20port FC SM Bay 3 Bay 4 Controller Controller
CloudBurst
Service
Management
CloudBurst
Infrastructure
Management
IBM CloudBurst Anatomy
Optional WebSphere CloudBurst
Optional Central TSAM 7.2
Manage External Resources
BladeCenter H
HS22 Blades
IBM CloudBurst is the Cloud appliance proposition of the market
aggregating software and hardware around TSAM
High Availability
& Automation
1 2 3 4 5 6 7 8 9 10 11 12 13 14 BladeCenter H Chassis
Image delivery
VMware ESXi 3.5 u4 Hypervisor on imbedded HS22 USB SUSE DB2 / WAS TDS SUSE DB2 ITM TEMS/TEPS SUSE NFS HTTP DB2 SUSE TUAM EE TPAE Monitoring & Energy Usage & Accounting Cloud Management TSRM TSAM PMP TPM TPM for OSD TPM for Images Self- Service Virtual Service Management
SAMBA
Virtual Server Virtual Server Virtual Server Virtual Server
IP1 IP2 IP3 IP4
3650 M2 Server
Microsoft®Windows Server
IBM Storage Manager
Microsoft®SQL Server
IBM BladeCenter Open Fabric Manager
IBM ToolsCenter IBM Active Energy IBM System Director
VMware®Virtual Center Server
Virtualizat Virtualizat.. Mgt Mgt IT Service IT Service Automation Automation & control & control Consumer Consumer management management Cloud Service Developer Cost Cost control control Software as a Service Platform as a Service Infrastructure as a Service SecureSecure d, d, SelfSelf --servicservic e e PortalPortal Cloud Service Consumer Ser Ser vic vic e e Del Del ive ive ry ry Por Por tal tal
Cloud Service Provider
Se Se rvi rvi ce ce D D ev ev el el op op m m en en t t Po Po rta rta l l Customer in-house IT Partner Clouds Consumer Administrator Consumer Business Manager Service User Developer User
Service Definition & Development Tools
Ensembles IT Service Level
management
IT Service request & catalog
Service Management foundation automation
Common operations
Resources management Release & deployment
automation Accounting & Billing
Peering & Settlement Pricing / Rating managementContract Invoicing Customer management Offering management Subscriber management Service Offering Catalog Entitlements SLA Reporting Order management
Service quality & resiliency Metering, Reporting & Analytics Audit & compliance
BSS
OSS
So, what layers does Cloudburst 1.2 cover ?
Rational contribution
TSAM
TUAM
IBM Systems Director
TSAM TSAM, TSM
Optional ISS, more to come
TSAM / TPM
Tivoli Monitoring
TSAM
Building Private Clouds - The Stages of Adoption and Benefits of a
Dynamic Infrastructure
Business Value
Ability to Dynamically Respond
Reduce Costs
Decrease complexity
Improve operating efficiency
Reduce Costs
Decrease complexity
Improve operating efficiency
Standardization
Standardization ConsolidationConsolidation
Power Mgt
Power Mgt
Increase Availability and Performance
Better manage IT
Automate systems and data management tasks
Increase Availability and Performance
Better manage IT
Automate systems and data management tasks
Provisioning Provisioning Virtualization Virtualization Automation Automation
React with Agility and Flexibility
Dynamically respond to changing business needs
Meet service level agreements
React with Agility and Flexibility
Dynamically respond to changing business needs
Meet service level agreements
Cloud Computing Cloud Computing Service Mgt Service Mgt Orchestration Orchestration Bus ines s R esili ence , Sec urity Info rmat ion Infra stru ctur e Bus ines s R esili ence , Sec urity Info rmat ion Infra stru ctur e
Infrastructure
Systems Mgmt.
Lower Gain From External Cloud
Higher Gain From External Cloud
Lower Pain To
Cloud Delivery
Higher Pain To
Cloud Delivery
Web Serving Numerical[Low Data/Compute] Mail & Collaboration
conferencing Application Dev’t. & Test Virtual Desktop
Start Here
Business Applications ERPs, Specific appsTransaction Processing and Database
DB, Data warehouse Transaction,Batch
CRM
A practical approach to cloud computing
Start with an isolated cloud deployment •Choose low-risk workload such as test and development
•Standardize applications and systems •Deploy self-service portal
Define cloud strategy & roadmap •Assess cloud deployment models, service
options and workloads •Plan cloud strategy and roadmap
•Choose initial project
Use trusted cloud services to supplement data center capabilities for: •Infrastructure as a Service (IaaS)
•Platform as a Service (PaaS) •Software as a Service (SaaS) Test & Deploy
Extend & Evolve Plan & Prepare
Condition your existing infrastructure for cloud •Virtualize and automate existing systems
•Add service management, service catalog
