© 2008 Hewlett-Packard Development Company, L.P.
The information contained herein is subject to change without notice
Cloud Computing Paradigm
Julio Guijarro
Automated Infrastructure Lab HP Labs Bristol, UK
16 / September / 2010
What Is Cloud Computing?
The Third Wave of Connected
Computing
reach
1970 1980 1990 2000 2010
time
2005 2020
The Internet
The Web
The Cloud
connectivity
information &
e-commerce
everything as a service
Definitions—Cloud Computing
Cloud computing is Internet-based ("cloud") development and use of computer technology ("computing"). It is a style of computing in which IT-related capabilities are provided “as a service”, allowing users to access technology-
enabled services from the Internet ("in the cloud") without knowledge of, expertise with, or control over the technology infrastructure that supports them.
http://en.wikipedia.org/wiki/Cloud_computing
Cloud computing is a style of computing where massively scalable IT-enabled capabilities are delivered “as a service”
to external customers using Internet technologies.
Gartner, Cloud Computing: Defining and Describing an Emerging Phenomenon (G00156220) Cloud is an emerging style of Information Technology infrastructure designed for rapid delivery of computing
resources.
IBM
The terms cloud computing and utility computing are often used to mean the same thing. But experts say the cloud is an advance on utility computing. Yes, it will also provide pooled resources on demand. Yet the point of difference is that clouds will be purpose built, ultra-powerful new infrastructures where tailored solutions are designed, deployed and run extreme-performance virtual applications. Further, they will be
sharing resources and able to dynamically go up and down in size, while offering fail-safe redundancy.
HP, Sky’s the limit for cloud computing The cloud is IT as a Service, delivered by IT resources that are independent of location
The 451 Group A pool of abstracted, highly scalable, and managed infrastructure capable of hosting end-customer applications and
billed by consumption
Forrester
Cloud Embodies a Confluence of
Technologies and Concepts
• Grid computing, utility computing, virtualization, SOA
• Because Cloud Computing is a conceptual service model, where:
− Services are delivered remotely from a logical resource
• The details behind the scenes are hidden; may use the techs. above
− Are paid for based on how much service is consumed
− Are genuinely on-demand
• Cloud computing is a real trend driven by
− The ubiquity of internet connectivity
− Low-cost commodity hardware and open source software
− Figuring out a bunch of technical stuff
IT as a Service, Delivered by the Cloud
Search
Email Productivity Apps
Social
Networking Infrastructure
on Demand Backup
Media sharing Business Apps
Management Apps
Mobile Services
Location-Based Services
Storage on Demand Platform
on Demand
And ...
• At massive scale
− Millions of users
• With unprecedented flexibility
− Mash-ups, aggregation, enhancing services, flexing up and down, ...
• Offering evolving APIs to exploit and extend
• At breakthrough cost levels
− Economies of scale
− New revenue models
− Eliminating old sources of cost (SaaS vs. CD)
15 Ways to Tell it‘s not a Cloud
• If you peel back the label and it‘s says
―Grid‖ or ―OGSA‖ underneath… it‘s not a cloud
• If you need to send a 40 page
requirements document to the vendor then… it‘s not cloud
• If you can‘t buy it on your personal credit card… it‘s not a cloud
• If they are trying to sell you hardware…
it‘s not a cloud.
• If there is no API… it‘s not a cloud.
• If you need to re-architect your systems for it… it‘s not a cloud.
• If it takes more than ten minutes to provision… it‘s not a cloud
• If you can‘t de-provision in less than ten minutes… it‘s not a cloud
• If you know where the machines are…
it‘s not a cloud
• If there is a consultant in the room… it‘s not a cloud
• If you need to specify the number of machines you want upfront… it‘s not a cloud
• If it only runs one operating system… it‘s not a cloud
• If you can‘t connect to it from your own machine… it‘s not a cloud
• If you need to install software to use it…
it‘s not a cloud
• If you own all the hardware… it‘s not a cloud
James Governor, Redmonk
Get ready for the Cloud …
Following the Hype Cycle - 2008
Following the Hype Cycle - 2009
Following the Hype Cycle - 2010
Source: Gartner August 2010
A definition …
Cloud Computing
IT delivered as a logical service, available on demand, charged by usage
Logical Service: details of delivery hidden
On demand: scales up and down immediately and seamlessly
Charged by usage: metering and billing of services, pay for what you use
Cloud Taxonomies
Cloud Types
17
Public Clouds
Hybrid Cloud Private
Cloud
Hybrid Cloud
Users
Enterprises Consumers
1
2
3 4
Cloud Workloads
• Legacy workloads
− Can we move today‘s IT applications to the cloud?
• ‗Cloud-ready‘ workloads
− The cloud is ushering in new styles of application development
− Large data-sets, parallel computation, very high scalability
− Context-driven applications: many cloud services sharing context information from multiple sources
Cloud Service Layers
Cloud Infrastructure Services (IaaS) Cloud Platform Services (PaaS)
Cloud End-User Services (SaaS)
Physical Infrastructure
Service Users
Why Cloud Computing?
Why Cloud Computing?
Consumer View
• Convenience
• Cost
• Collaboration
• Connect anywhere
• Constant improvement
• Configuration simplicity
• Protection of valuable data
• Choice of services
• Access from a range of devices
Why Cloud Computing?
Business View
• Cost management
− Benefit from economies of scale
− Predictability of spend
− Avoids cost of over-provisioning
− Reduction in up-front capital investment
− But be careful: costs can fluctuate.
• Risk reduction
− Someone else worries about running the data-centre, protecting your data, and providing disaster recovery
− Reduces risk of under-provisioning
• Flexibility
− Add/remove services
− Scale up and down as needed – rapidly
• Service Evolution
− Services evolve and improve behind the scenes, no time-consuming local upgrades
• Ubiquity
− Access from any place, any device, any time
Barriers to Business Adoption
• Security
• Trust in the service vendors
− Service levels
− Stability
− Geographic presence
• ISV support not widespread
• Few have taken the plunge in a big way
• Customizability of service offerings for specific needs of each enterprise
• Concerns about lock-in, lack of multi-vendor options
• Regulatory concerns
• Data locality
• Challenge of migrating from in-house (or outsourced) apps
• Vested interests
The cloud hype is around cost;
The cloud reality is about new value
What‘s new?
Service users Service providers
New connections:
information in context New capabilities:
multi-tenant software New access:
everything is a service
Cost
Value
?
Cloud Computing:
A Disruptive Technology?
Time
Performance
Disruptive Technology
Where is the catch?
Cloud Computing changes
• how applications are delivered
• how applications are designed
• how teams work
Cloud Eliminates
• Buying hardware based on predicted load
• 2+ week lead time on new hardware, storage
• High Availability
• Homogeneity
• Static machine names, addresses and capabilities
• Stable machines
• A fast private network
• Someone in the datacentre who cares about you
Assumptions that are now invalid (1/3)
• Systems have a long lifespan
• It is slow/expensive to create a new system
• It is expensive to duplicate one
• Systems can/should be managed by hand
• Clocks proceed at the same rate
• Physical RAM doesn‘t get swapped out
• Running machines can't be moved/cloned
Assumptions that are now invalid (2/3)
• System failure is an unusual event
• 100% availability can be achieved
• Data is always near the server
• You need physical access to the servers
• Databases are the best form of storage
• You need millions of $/£/€ to play
Assumptions that are now invalid (3/3)
• Terabyte datasets are hard to work with
• Code runs on a single machine
• Sequential code is better than parallel code
• RAID hardware is the best way to store data
• Databases are better than filesystems
• Low-value data isn't worth collecting even if you don't have a use for it now
Example Service: Map/Reduce
Commodity data processing for commodity data
Example Service: Hadoop
• Apache Hadoop
Map/Reduce framework
− Enabling new types of large-scale, parallelised, data-intensive
applications
− Scale: Hadoop test cluster at Yahoo! == 4000 8-core nodes, 16PB data-set
Summary
• Cloud Computing is here to stay
• It will bring new business opportunities. Most of them are unknown today.
• Revisit your assumptions about what is and what is not possible.
• There is a learning curve:
− start now.
− But: be careful, some things got easier, others changed radically.
Thanks!
35
14 September, 2010
Cloud Computing in HP Labs
HPL Cloud Infrastructure Research:
Cells
• An infrastructure-level Cloud service
• Delivering secure, isolated virtual
infrastructures – Cells – to multiple customers simultaneously
• Offering enterprise- grade properties
• Running on large-scale, flexible and modular
physical infrastructures
CellCell
CellCell
Cell Manager
Building on Cells:
Cloud Platform Capabilities
Cell
Cell Manager
System modelling and design:
component configuration, dimensioning, etc.
Automatic system deployment
System management:
adaptation, upgrade, removal
Deep telemetry: VMs, networks, storage, performance, billing, failures, etc.
Autonomic responses to changing
conditions Dynamic constraint
solving for resource
allocation, etc. System
orchestration and automation
Example Service: Hadoop
• Apache Hadoop
Map/Reduce framework
− Enabling new types of large-scale, parallelised, data-intensive
applications
− Scale: Hadoop test cluster at Yahoo! == 4000 8-core nodes, 16PB data-set
Dynamic Hadoop as a Service
• Configuration, automated deployment and management using HP Labs SmartFrog
− Create and manage a Hadoop service in a dynamic Cell
• Offer as a service to other applications
