© 2009 IBM Corporation
Terena – IBM Cloud Computing
Pol Mac Aonghusa
CTO
IBM Emerging Business Incubation Center
Dublin, Ireland
IBM in Ireland is driving IBM leadership in Cloud
Computing
Center Charter
• Worldwide Cloud delivery infrastructure
• Deep skills and resources
• Research – IBM & Partner
DUBLIN, IRELAND and ARMONK, N.Y, March 19, 2008
'Today IBM (NYSE: IBM) and the Industrial Development Agency of Ireland (IDA Ireland)
announced the establishment of Europe’s first Cloud Computing Center.'
"IBM's European hub for Cloud Computing highlights Ireland’s role as
an important contributor to IBM's global research, development and
innovation strategy.”
– Micheál Martin TD, Minister for Enterprise, Trade and Employment
“This new facility and the cloud computing model, the wealth of talent
at IBM's software lab in Ireland will be accessible to not only the rest of Europe, but Africa and the Middle East
as well."
– Steve Mills, Senior Vice President and Group Executive, IBM Software Group.
February 12 , 2009 Terena © 2009 IBM Corporation
3
Dublin is part of a network of IBM Cloud Centers around the World
Seattle, WA
San Jose, CA US, East Coast Wuxi, China Dublin, Ireland
South Africa
Hanoi, Vietnam Bangalore, India
São Paulo, Brazil
Seoul, S Korea Beijing, China
Fast growth of connected devices & users
Cloud Computing – a computing platform for the Universe of Things
A “cloud” is an IT delivery infrastructure with:
• Virtualization of hardware & software
• A simple interface for scheduling & provisioning resources • Support to create optimised service level policies
• Standards for defining, managing & inter-operation of multiple clouds
“By 2012, 80% of Fortune 1000 enterprises will use some Cloud Computing services”
- Gartner
Skyrocketing utility costs Exponential growth of
processing & storage demands
Demand for higher efficiency Optimised load-balancing policies Standardization & Interoperability Complex collections of hardware & software Scale rapidly and simply in a
February 12 , 2009 Terena © 2009 IBM Corporation
5
2000: IBM BCRS
2000: UDDI 1.0; “SaaS” coined 2001: Dot com bubble bursts
2005: IBM AoD
2006: Amazon EC2
2007: Google Health; force.com launch 2008: IBM ww Cloud Computing centers
Cloud Computing is the culmination of a long term trend to simplify access to IT Services
1990: Berners-Lee invents the World-Wide Web 1994: CommerceNet
1998: RosettaNet
1999: i-Mode mobile internet 1961: John McCarthy proposes computing as a utility
1961: IBM Services Bureau
1975: First inter-industry EDI standards
2010
1980 1990 2000
1981: SMTP defines the standard electronic mail service 1985: United Nations sponsors EDIFACT
1970
IBM Service Bureau (1961)
Cloud Computing Logical Architecture
IBM System z, p, x, BladeCenter Storage Networking
Physical Hardware
Virtualization
Virtual Storage Virtual Application Server Virtual Application Server Virtual Application Server Virtual Networks Virtual ServersWorkloads
Innovation Enablement Software Development Virtual Classroom Web 2.0 Data Intensive Processing Scalable Transaction ProcessingRequest Driven Provisioning
Monitoring SLA
Capacity Planning
Dynamic Scheduling
February 12 , 2009 Terena © 2009 IBM Corporation
Cloud - Hosting Software Development
China Cloud Computing Center
• New Enterprise Data Center built by IBM
for municipal government of Wuxi, China
• Eleven parks across China for software
development
• Accelerates transformation to a
service-led economy
Benefits
• Fast deployment of Rational software
development environments
• Up to 200K software developers, 100
companies
• Cost efficient shared infrastructure
Virtualization
Physical Hardware
Workloads
Request Driven Provisioning
Company A Dynamic Scheduling Monitoring Virtual Application Server Virtual Application Server Virtual Application Server; Company B CompanyC
Securely isolated development and test environments
Cloud – Enabling Virtual Classrooms
Google/IBM Academic Initiative
•Promote open standards & Hadoop
parallel computing model
•Jointly provide compute platform of the
future Benefits
•Trains students with next generation
computing skills
•Optimizes emerging Internet scale
workloads such as search, video, audio, 3D Internet, machine learning, mobile computing
Virtualization
Physical Hardware
Workloads
Request Driven Provisioning
Stanford Dynamic Scheduling Monitoring Virtual Application Server Virtual Application Server Virtual Application Server; Carnegie Mellon University of Washington
February 12 , 2009 Terena © 2009 IBM Corporation
9
9
Page 9
Steps towards cloud computing – IBM Blue Cloud
SOA, Cloud Service
Management, Ensembles, … Abstraction and Pooling Multi-System Virtualization Virtual Servers, Storage, Networks Storage Servers Networks V V V Scale-Out Sprawl Windows Servers Linux Servers Unix Servers Management Servers Switches Storage Firewalls, Routers Physical Consolidation Windows Server Linux Server Mainframe or Unix Server Networks Storage V V V V V
Reduce complexity and management overheads, increase efficiency
Ensemble
Ensemble
Ensemble
An ensemble is a pool of like systems that is manageable as a single system
– It integrates compatible networked systems, virtualization, and management functions – It scales from few to 1000’s of nodes, while having management complexity and cost
like that of a single system – essentially independent of the ensemble size
We are here Complex
Shared network delivered services
Amazon, Yahoo, eBay, …
IBM:
– Blue Gene supercomputer
– System z Parallel Sysplex, up to 32 nodes
– SVC cluster (IBM TotalStorage San Volume Controller)
– XIV Nextra (IBM acquisition – clustered SAN solution)
Incremental Value of Storage Ensembles
– Autonomic management
functions: (provisioning /
de-provisioning, tuning, alert exception handling..)
–
Improved staff
efficiency
, business
adaptability
for
competitive advantage, position for cloud computing
Some existing ensembles
February 12 , 2009 Terena © 2009 IBM Corporation
11
The storage challenge…where to next?
Growth in stored data will continue to rise exponentially ...
– “Mankind will generate more information in the next 3 years than it did in all
the previous 300,000 years”
How will we manage all this data?
Virtualization and cloud computing with autonomic management is a
key part of the solution
2005 2006 2007 2008 2009 2010 CAGR
E-mail 269 423 673 1,119 1,512 3,553 68%
Database 222 386 639 1,102 2,062 4,073 79%
Unstructured 2,295 3,272 4,784 7,180 11,501 19,580 54%
Segmentation of (Storage) Clouds
Product v/s Services
Arms provider offerings
Storage as a Service offering – Public – Private (Hosted or On-Premise) Standalone v/s Integrated Standalone/Direct
– Provides data storage,
access and transfer
interfaces, that are directly used by the consumer. e.g. GTS Virtual Storage Cloud Service proposal
Integrated with a “storage”
consumer
– E.g. Storage Ensemble
integration with Server Ensemble for image
deployment / Management
– E.g. Google Gmail, Docs
integration of storage
Functionality
Data hosting, data
access, data protection
Content Delivery
Database storage
service
February 12 , 2009 Terena © 2009 IBM Corporation 13 Infrastructure Services Platform Services Application Services Business Services 2000 2006 ‘People’ Services 2009 S er vi ce C lo ud L ay er s
Static, dedicated, outsourced Network-delivered, off-premises Shared, automated, dynamic
Providing knowledge-enablement technologies that break the linear relationship between revenue and headcount, and exploit crowdsourcing.
As a composer and integrator, using deep customer knowledge to design composite cloud solutions that combine disparate information.
As a business platform provider, establishing industry-specific / standard cloud platforms through which customers can develop and offer their services. Providing leading development and management technologies for overcoming the potential complexities/ downsides of clouds.
As a systems innovator, using cloud technologies to help solve “out-of-space, out-of-power” and lower costs.
Research Topics in Cloud Computing
• XTP – eXtreme Transaction Processing
– Today = ‘kiloCloud’ ~104 – 105 ensemble objects
– 2010 > ‘megaCloud’ … ~ 106 – 109 ensemble objects
– Advanced storage & data management
– Strong on parallel programming in a non-critical model
• Mission critical applications require robust & resilient
‘pseudo-serial’ processing model
• New architectures to exploit massive scalability of Cloud
– Data intensive grid processing on Cloud – Stream processing
– True virtualization of software – for example - multi-tenancy! – IPC in a mega or tera Cloud cluster!
February 12 , 2009 Terena © 2009 IBM Corporation
15
Current Research Topics in Cloud Computing
• Device Management
– Explosion in Real World Aware devices – producing & consuming data
• Nokia estimates there will be 4+ billion phones by 2010
– Streaming data versus traditional data management
• Internet 2008 exabytes (1021 bytes) • Internet 2010 zettabytes (1021 bytes)
– Advanced techniques required for mass back-end & front-end device management
– Complex ensemble management
• Scalable Security Services (in the Cloud)
– Consistent security & profiling services from device -> edge -> workload – Must be dynamic & persistent across provisioning ensembles
Cloud Computing and Storage
• Storage Research Challenges
– Advanced caching algorithms
– Advanced functions for high end disk arrays
– Archiving
– Cloud computing – storage ensembles
– Massive scaling
February 12 , 2009 Terena © 2009 IBM Corporation
17
Example R&D in Cloud: Managing Complex
Ensembles
Image Management
– Virtual image Management for pre-built software stacks, distribution, deployment, licensing,
maintenance, archival and service/ support
Model based solution creation
and composition tool
– A tool to allow administrator to quickly assemble solutions from ready-made building blocks and pre-built templates
Isolation & connectivity management
– Extend isolation beyond the hypervisor boundary to networks of virtual resources
Scalability and optimization
– integrated management and optimization of Ensembles
– Performance, availability & power management
Image Repository Image Manager Image Creation Tool Deploy Pre-configured Building Blocks Server Ensemble Manager Server Ensemble Manager Storage Ensemble Manager
Physical Servers Physical Ensemble Storage Ensemble B2 A1C2 B1 C1A3 A2C3 B3 A4C4 Virtual Resources Virtualization Platform Virtualization Platform Virtualization Platform Virtualization Platform Virtualization Platform Virtualization Platform Virtualization Platform Physical Resources
Solution Deployment and Management
A1 A2 A3 A4 B1 B2 B3 C1 C2 C3 C4
Logical Resource Topology
Solution Composition Tool
Solutions
A
B C
Check Out Check In
Three Key Points
Cloud: Evolution not revolution
Cloud computing is a natural evolution catalysed by technological
maturity and compelling business needs.
IBM has proven Cloud experience - today
IBM has experience implementing cloud technologies inside IBM for
use carrying real workloads
IBM is pursuing capabilities of tomorrow's Cloud
IBM is engaged in a broad range of R&D into cloud computing
technologies
February 12 , 2009 Terena © 2009 IBM Corporation