Page 1 8/21/2012
Marco T. Chou
Cloud Computing:
The Next Technology Wave
Page 2
Marco T. Chou
Former Sr. Planning Consultant (Information Architect) of Allstate Insurance Company
www.linkedin.com/in/marcochou [email protected]
C: 847-226-2263
ProAct Consulting, Inc.
Training, Education, and Consulting
Database Administration, Information Management, and Cloud Computing Big Data, Hadoop, and NoSQL
CSC454 Database Administration & Management CSC554 Advanced Database Management IS 536 Enterprise Cloud Computing
IPD 360 SQL Server Business Intelligence Program IPD 363 SQL Server Database Administration Program IPD 355 Cloud Computing Fundamentals Program IPD 353 Cloud Computing with Amazon Web Services Technology workshops for educators
Multimedia, Digital teaching & learning
Certified Hadoop Administrator
Page 3
Agenda
Introduction
Technology Trends in 2012 and Beyond
Cloud Computing Concepts
Cloud Architecture and Services
The Future of The Cloud
CDM/IPD Courses
Page 41970
Mainframe
1980
PC
1990
Network
Client/Server File Sharing WEB HTML Legacy 32702000
Wireless
Mobile XMLThe Internet is Changing Everything…
2010
Cloud
Open Share
Page 5
Business is Outpacing IT…
The drivers of cloud growth
Enterprises losing control & IT partners missing revenue opportunities
Business
IT
Cloud has potential to close the gap …
• Speed innovation
• Reduce time to build
• Accelerate business processes
Cloud Is the Foundation for the Instant-On Enterprise• Faster Revenue Growth
Business and IT aligned - - > IT accelerates Business
• Increased Agility
Respond to opportunity immediately
• Investment Protection
Integrate traditional IT and new cloud services
• Lower Cost
Reduce CAPEX and OPEX
• Too slow • Too expensive • Hard to deal with
Page 6
Business Value
Cloud Delivery Increases Business Value
Reduce time for new projects
Improve market responsiveness and agility
Increase revenue opportunities
Architecture Design & Engineering Vendor / Product Selection Application Development CBA/TCO/ROI Resource Allocation Testing & Deployment to Production Building Infrastructure
Traditional (months --> years)
Virtualization (days --> weeks)
Page 7
A perfect storm
Page 8
Page 9
Are You Ready?
Page 10
IT Infrastructure: Top 10 Technologies to Consider for 2012
Each year at its October symposium in Orlando, Fla.,
Gartner
publishes a report highlighting the
top 10
technologies
that could impact the enterprise market in the
next three years.
The research firm bases its selections on their
potential
to
disrupt IT or business, the
demand for investing
considerable dollars in a
technology
, as well as the
risk
for
companies that come late to a particular technology.
Some of these selections are duplicated each year, while
others knock previous entries out of the batch.
Heading into 2012, here are Gartner's top 10 strategic
technologies that companies should consider as they
prepare their business plans for the new year.
Page 11
Page 12
Gartner's top technologies for 2011
Source: Gartner Symposium conference
Page 13
Page 14
From IT Productivity to an Intelligent Economy
http://www.idc.com/research/Predictions12/Main/index.jsp
Work
Hard
Work
Smart
Page 15
IBM's Top 12 Tech Trends for 2012
– 12/05/2011The four technologies that emerged as keys for future success
are business analytics, mobile, cloud and social business.
http://www.eweek.com/c/a/Cloud-Computing/IBMs-Top-12-Tech-Trends-for-2012-Include-Cloud-Analytics-Mobile-221458/
Page 16
Myths & Facts
Myths
Cloud computing will eliminate IT expense
Cloud computing will eliminate the need for IT personnel
Facts
Cloud technology is real
This technology should
not
be ignored
The future of Cloud
The next evolution of the Internet
Cloud computing is
not
the end of IT
A world where the PC is replaced by a slew of simple, low-cost
devices that are constantly connected to the Internet and through
that to cloud-based services
The future will revolve around connected devices and
continuous services
Cloud providers will operate
standardized environments
that let
customers move workloads around
The Iron Age is over. The Cloud Age is here!
Page 17
Cloud Trends In 2012 And Beyond
Cloud computing is re-energizing the technology industry …
From
S
erer to
S
ervice
From
S
erver Inventory to
S
ervice Catalog
From
DP
(Data Processing) to
IT
(Infrastructure/Technical
Support) to
Trusted Business Partner
(Solution Provider)
Server + Software + Storage + Security + Network + App + …
=
Services
Cloud Computing (in Plain English)
+
+
Page 18
Cloud Architecture and Services
New Standards for Cloud Computing
Workload and Resource Utilization Models
Cloud Consumption models (5 Key Cloud Characteristics)
Cloud Services Models (The SPI Model)
Exploiting Software as a Service (SaaS)
Delivering Platform as a Service (PaaS)
Deploying Infrastructure as a Service (IaaS)
Cloud Delivery Models
Public cloud
Private cloud
Hybrid cloud
Community cloud
Government cloud
Personal cloud
Page 19
Cloud Standards Organizations
Cloud Computing Interoperability Forum (CCIF) Cloud Security Alliance (CSA)
Distributed Management Task Force (DMTF)
The European Telecommunications Standards Institute (ETSI) National Institute of Standards and Technology (NIST) Open Grid Forum (OGF)
Object Management Group (OMG) Open Cloud Consortium (OCC)
Organization for the Advancement of Structured Information Standards (OASIS) Storage Networking Industry Association (SNIA)
The Open Group
Association for Retail Technology Standards (ARTS)
The development of a Cloud Landscape to overview the various efforts and introduce terms and definitions that allow each standard to be described in common language, and an entry for each standard categorized by organization.
Page 20
National Institute of Standards & Technology (NIST) Definition
Three service models Software as a Service (SaaS) Platform as a Service (PaaS) Infrastructure as a Service (IaaS) Four deployment models
Public Cloud Private Cloud Hybrid Cloud Community Cloud
Five essential characteristics On-demand self-service Broad network access Resource pooling Rapid elasticity Measured Service
Note: Cloud computing is still an evolving paradigm. Its definitions, use cases, underlying
technologies, issues, risks, and benefits will be refined in a spirited debate by the public and private sectors. These definitions, attributes, and characteristics will evolve and change over time.
“Cloud Computing is a model for enabling convenient, on-demand access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or service provider interaction.”
Page 21
On-Premise
Application runs
on-premises
Buy my own
hardware, and
manage my own
data center
Application runs
on-premises
• Bring my own machines, software, connectivity, etc.• Complete control and responsibility
• Upfront capital costs for the infrastructure
Page 22
Companies to Consider Cloud Computing
What are your biggest challenges with your on-premises
business applications?
Page 23
On and Off
Usage C o m p u te Time Average Inactivity PeriodOn & off workloads (e.g. batch job)
Installed over provisioned capacity is wasted when not being used Users twiddle thumbs expensively while waiting for jobs to finish Time to market can be cumbersome
Example: Scientists running modeling software for new drug Finance people waiting for quarterly financial statement
Page 24
Growing Fast
Successful services needs to grow/scale Keeping up with growth is big IT challenge Complex lead time for deployment
Need capital for software development and/or expanding data center Example: new Internet game that catches on deployment and scaling lags can stunt growth at key critical moment.
Average Usage C o m p u te Time
Page 25
Predictable Bursting
Peaks due to periodic increased demand IT complexity and poor capacity planning
Installed capacity is wasted when not being used, but lack of sufficient capacity at key moment could kill business
C o m p u te Time Average Usage Page 26
Unpredictable Bursting
Unexpected/unplanned peak in demand Sudden spike impacts performance
Can’t afford to provision for extreme case, but failure to handle it well can kill a brand
If you depend on handling bursts for your company’s life, be very careful about Service Level Agreement (SLA)
C o m p u te Time Average Usage
Page 27
Elasticity: Provisioning for Peak
Real World Server Utilization Is 5% to 20%
Many Services Peak Exceeds Average by a Factor of 2 to 10
Most Provision for Peak
Provisioning for Peak Without Elasticity, We Waste Resources
(Shaded Areas) During Non-Peak Times
Page 28 Under-Provisioning #2
Some Users Respond to Under-Provisioning by Permanently Deserting the
Site... Bad for Revenue!
Elasticity: Risks of Under-Provisioning
Under-Provisioning #1
Potential Revenue (Shaded Area) Is Sacrificed
Page 29
In a traditional (non-Cloud view), there are inefficiencies
1stQT 2nd QT 3rd QT 4th QT
Page 30
Page 31
Platform Continuum
• Bring your own machines, connectivity, software, etc.
• Complete control • Complete responsibility • Static capabilities • Upfront capital costs for
the infrastructure
• Renting machines, connectivity, software • Less control
• Fewer responsibilities • Lower capital costs • More flexible
• Pay for fixed capacity, even if idle
• Shared, multi-tenant infrastructure • Virtualized & dynamic • Scalable & available • Abstracted from the
infrastructure • Higher-level services • Pay as you go
On-Premises
Servers
Hosted Servers
Cloud
Platform
Page 32
5 Key Cloud Characteristics
(The consumption model)
Page 33
Three Service Models of Cloud Computing
Cloud computing is a model for enabling convenient,
on-demand
network access to a
shared
pool of configurable
computing
resources
(e.g., networks, servers, storage, applications, and
services) that can be
rapidly provisioned and released
with
minimal management effort
or service provider interaction.
National Institute of Standards and Technologies (NIST) and
other organizations have broken cloud computing services into three
categories, commonly referred to as the "SPI model"
Page 34
Service Model: Software as a Service (Saas)
Software-as-a-Service (SaaS) offerings are finished applications.
Usually software companies that provide such SaaS host their software themselves, and then upgrade and maintain it for their customers.
Customers can't modify the application or service provided, but it may be possible to perform some lightweight customizations.
These solutions tend to be sold based on the number of users inside your company, and you can adjust the number and assignment of seats on-demand.
Software supplied via the cloud is often easy to use and requires little intervention from the user to get the service up and running.
The consumer of these services can be anyone inside a business from human resources, sales management, or remote workers, depending on what value the SaaS solution provides.
Page 35
Service Model: Platform as a Service (PaaS)
Platform-as-a-Service (PaaS) is a build-deploy-manage
environment.
These Cloud services provide a framework and a software system for
application developers to create new services and rapidly deploy
them on the Internet.
Cloud PaaS supplies these platform stacks to users, without the need
for them to maintain the underlying hardware or upgrade the
supporting software.
It's becoming common to see PaaS offerings designed specifically for
the enhanced use of a SaaS service.
Page 36
Service Model: Infrastructure as a Service (Iaas)
Infrastructure-as-a-Service (IaaS) is an on-demand virtual hosting environment.
When people think about infrastructure, they think of servers, wires, cooling systems, and all the other things necessary to run today's data centers. But when infrastructure is purchased through the cloud, none of these
components are necessary; instead, users of cloud-based infrastructure only need to concern themselves with developing platforms and software.
These services let more sophisticated developers procure virtual machines in minutes, fill them with whatever they want, and deploy.
The VMs are metered for actual resource consumption (CPU hours,
bandwidth, and storage consumed), which constitutes the bill for the service. Use a little, pay a little. Use a lot, pay a lot. For example, AWS, Rackspace
Infrastructure as a five layer stack including:
Servers (physical and virtual) Storage (NAS and SAN)
Network (Routers, Switches, Firewalls, Load Balancers) Facilities (Power, Cooling, Space)
Page 37
Microsoft Data Centers (Gen 4)
Vision Go Inside Containers Energy Efficient
Chicago San Antonio Dublin Amsterdam Hong Kong Singapore Page 38 Upper Tier (Software as a Services) Middle Tier (Platform as a Services) Lower Tier (Infrastructure as a Services)
Page 39
A Taxonomy Of Cloud Computing Services
October 2009 “TechRadar™ For Infrastructure & Operations Professionals: Cloud Computing, Q3 2009”
Page 40
Page 41
Service Catalog Example
Page 42
Resource Management
Private On-Premise Storage Server HW Networking Servers Databases Virtualization Runtimes Applications Security, Integration & Backups Y o u m a n a g e User Admin SaaS Software as a Service Storage Server HW Networking Servers Databases Virtualization Runtimes Security, Integration & Backups Applications Y o u m a n a g e M a n a g e d b y V e n d o r User Admin M a n a g e d b y V e n d o r IaaS Infrastructure as a Service Storage Server HW Networking Servers Databases Virtualization Runtimes Applications Security, Integration & Backups Y o u m a n a g e User Admin PaaS Platform as a Service Storage Server HW Networking Servers Databases Virtualization Runtimes Applications Security, Integration & Backups Y o u m a n a g e M a n a g e d b y V e n d o r User Admin Resource: MicrosoftPage 43
Four Cloud Delivery Models
Amazon Virtual Private Cloud (Amazon VPC)
Page 44
Government Cloud -
apps.gov
A website that lets government agencies
find and buy access to cloud-computing
tools and services.
Page 45
Federal Government is moving to the Cloud
May 20, 2010, NIST-organized forum, Federal CIO Vivek Kundra calls for industry and government to work together to accelerate government Cloud Computing adoption by focusing on standards development and leveraging the Cloud certification work performed by other agencies.
http://www.nist.gov/itl/csd/cloud_060910.cfm
Page 46
Federal Government Cloud Computing Initiative
Centralize certification of Cloud
solutions
Leverage
Public Cloud
Develop standards for security,
interoperability, & data
portability
Cloud Computing is a major change in computing technology and may well change the way we look at & use computers for decades to come.
Announced the Cloud Computing Initiative on Sept. 15, 2009.
Partnership with State and Local Governments
Page 47
Federal Government
Amazon Web Services (AWS) offers federal government
agencies a secure, reliable, and cost-effective computing
platform in the cloud. By using AWS products, government
organizations can focus on meeting their mission-critical
objectives, and spend less time procuring, developing, or
managing IT resources.
AWS’s compliance framework covers FISMA, PCI DSS, ISO
27001, SOC 1/SSAE 16/ISAE 3402 (formerly SAS 70 Type II),
and HIPAA.
Federal Government Customers
U.S. Department of State U.S. Department of Agriculture The US Department of the Treasury NASA Jet Propulsion Laboratory
Page 48
Personal Cloud
The Personal Cloud is Different From “The Cloud”
The Personal Cloud is about
you
. It’s the stuff that
you
care about.
It’s the web sites that you interact with. It’s the media you consume,
and the customizations (like playlists) that you make.
It’s your email, and your identity. It’s how you store your passwords,
and how you find and enjoy the content or media that you own.
The Personal Cloud is about turning all of those things into one easily
accessible, customizable thing.
Page 49
Low-Risk Apps in the Cloud
SOURCE: "CLOUD COMPUTING 2011 ADOPTION SURVEY," TECHTARGET INC., MARCH 2011
When asked which applications they would be most likely to move
to the cloud, respondents targeted nonmission-critical and low-risk
programs.
Page 50
Cloud in the future
“Cloud by default”
deployments in offices
It is possible to run your entire organization through cloud
services, for example:
Microsoft Office 365 or Gmail
Google Docs for document and project collaboration Dropbox for file transfer and sharing
Quickbooks for finance management Expensify for expense management Evernote for note taking
Salesforce for CRM
Can you deploy a new application in days rather than months?
Be the first or the best!
Page 51
Sky is the limit
Rethink possible
New thinking of old world (think outside the box)
Redefine opportunity
New way of running business
Reengineer business process
Faster, Better, Cheaper, Easier, Safer, Greener
Reuse & repurpose
Leverage resources
Reshape IT
Agile development
Reinvent yourself
Be marketable and valuable
Page 52 Big Data and …
Big Data and …
My Database/Cloud Computing/Big Data Courses at DePaul
CSC454 Database Administration & Management IPD 363 SQL Server DB Administration CSC554 Advanced Database Management IPD 360/460 SQL Server Business Intelligence IPD 355 Cloud Computing Fundamentals Program IS536 Enterprise Cloud
Computing
IPD 353 Cloud Computing with Amazon
Web Services
Spring, 2012 Winter, 2013
Big Data and NoSQL
Winter, 2012
Winter, 2011 Since 2006
Since 2006
Since 2002 Since 2008
Page 53
CL#1: Cloud Computing Overview
CL#2: IT AS A Services (IaaS, PaaS, SaaS, etc.) CL#3: Personal Cloud
CL#4: Microsoft Windows Azure
CL#5: IBM Cloud strategy & Database in the Cloud CL#6: Create a Cloud environment using Amazon Cloud CL#7: Application Design for Multi-tenant – Salesforce
CL#8: Cloud migration, best practices, and case studies CL#9: Security, compliance, ownership, management, etc. CL#10: Cloud future and final project presentation
IPD355 Cloud Computing Fundamentals
(Since January 2011)
Taste of Cloud
Provides core Cloud Computing knowledge for those
interested in pursuing a career in Cloud Computing
Page 54
IPD353 Cloud Computing Using Amazon Web Services
Date Class Topic Lab/Homework
9/15 1
Cloud Computing Review & AWS Overview
AS#1-1 AWS & Elasticfox setup AS#1-2 Cloud Computing Assessment 9/15 2 EC2 (Elastic Compute Cloud) AS#2-1 EC2
9/29 3 EBS (Elastic Block Storage) AS#3-1/2/3 EBS 9/29 4 SES and Route53 AS#4 SES and Route53 10/13 5 S3, CloudFront AS#5-1/2 S3 and CloudFront 10/13 6 RDS, DynamoDB AS#6 RDS, DynamoDB
10/27 7 SQS, SNS AS#7 SQS, SNS
10/27 8 EMR / Hadoop AS#8 EMR/Hadoop
11/10 9 Load balancing, autoscaling, CloudWatchAS#9 Load balancing 11/10 10
Security (security groups, VPC, IAM), BeanStalk, CloudFormation
Page 55
IS536 Enterprise Cloud Computing
Class Date
Topic
1
4-Sep Introduction, Cloud Computing Overview
2
11-Sep
Cloud Computing Workload, Architecture & Service Models3
18-Sep Cloud Computing Operations and Deployment Models
4
25-Sep Windows Azure overview
5
2-Oct
Take-home Midterm
6
9-Oct
SQL Azure overview
7
16-Oct Building and Deploying a LightSwitch Application
8
23-Oct Building and Deploying an ASP.MVC Application
9
30-Oct Building and Deploying an ASP.Net Application
10 6-Nov Review and Final Project Walkthrough
11 13-Nov Take-home Final Exam
Page 56
Page 57
http://ctatweet.com/
Page 58