Introduction to Cloud Computing

(1)

Adam Skogman, Jayway

Photo by Mark Bonassera

Introduction

to

(2)

(3)

(4)

(5)

(6)

Didn’t We Solve This?

Ease

(7)

Didn’t We Solve This?

Hardware

Virtualization Web Hotel

Ease

Flexibility

Cloud

(8)

Cutting through the FUD

What is

Cloud?

(9)

Utility Computing

Per Hour

Per GB Per Month

Per GB Per Month Per

Hour

Per

Request Per GB

(10)

On-Demand Capacity

Proc Node Data Proc Node Data Data Proc Node Data Proc Node Data Proc Node

(11)

On-Demand Capacity

Proc Node Data Proc Node Data Data Proc Node Data Proc Node Data Proc Node

•

API

•

GUI

(12)

Grid Computing

Proc Node

Data

Proc

Node NodeProc NodeProc

Proc

Node NodeProc NodeProc NodeProc

Proc

Node NodeProc NodeProc NodeProc

Data Data Data

(13)

Content Delivery Network

Client

DB

Client

CDN

Prod Server

(14)

Content Delivery Network

Client

DB

Client

CDN

Prod Server

(15)

Distributed Cloud

Client

(16)

Distributed Cloud

Client

DB

Client

DB

Client

DB

Prod Server Prod

Server

Prod Server

(17)

There are Lots of Clouds

(18)

Infrastructure as a Service

(19)

(20)

Bandwidth

•

$0.10 / GB to Amazon

•

$0.17 / GB from Amazon

(21)

Small

m1.small 32 bit 1x1 CPU

1.7 GB 1 x 160 GB

$0.085 <$0.05 Large m1.large 64 bit 2x2 CPU 7.5 GB 2 x 420 GB

$0.34 <$0.18 Extra Large m1.xlarge 64 bit 4x2 CPU 15 GB 4 x 420 GB

$0.68

<$0.35 _Medium

c1.medium 32 bit

2x2.5 CPU 1.7 GB 1 x 160 GB

$0.17 <$0.09

Large

m1.large 64 bit

8x2.5 CPU 7 GB 2 x 420 GB

$0.68 <$0.35 Double Extra Large m2.2xlarge 64 bit

4x3.25 CPU

34.2 GB

2 x 420 GB

$1.20

Quadruple Extra Large

m2.4xlarge 64 bit

8x2.5 CPU

68.4 GB

4 x 420 GB

$2.40

Virtual Machines

(22)

Ephemeral Storage

Virtual Machine

(23)

Ephemeral Storage

Virtual Machine

/ /mnt

Disappears When You Shut Down

(24)

•

Amazon Elastic Block Storage (EBS)

•

RAIDed!

•

Database files

•

Private data

•

Price Model

•

$0.10 per GB provisioned / Month

•

$0.10 Per 1 Million Request

Block Storage

Virtual Machine

/ /mnt

EBS /ebs/db

(25)

Snapshots and Cloning

S3 Virtual Machine

/ /mnt

EBS

/ebs/db 2009-10-08

Virtual Machine

/ /mnt

EBS /ebs/db

(26)

File Storage

(27)

File Storage

•

Amazon Simple Storage Service (S3)

(28)

File Storage

•

Unlimited Redundant Storage

(29)

File Storage

•

REST API / HTTP

(30)

File Storage

•

REST API / HTTP

•

Price Model (not complete)

•

$0.15 per GB and Month (first 50 TB)

•

$0.17 per GB transferred out (first 10 TB)

(31)

Scaling Out with Redundancy

Zone A Zone B

Amazon Elastic Load Balancing

Rest

Services ServicesRest

Master

Rest

Services ServicesRest 2nd

Master X

(32)

•

$0.05 / hour

•

$0.10 / GB to Amazon

•

$0.17 / GB from Amazon

Virtual Private Cloud

Internet Amazon VPC Enterprise Active Drectory GW App _IPsec VPN Tunnel App_App App_App App

(33)

Cloud Front

•

Serve static content close to user

•

Major cities in US, EU, Asia

•

Amsterdam, Dublin, Frankfurt, London

• Serves from S3 Bucket

•

Single domain name for all caches: foo123.cloudfront.net

•

1 GB/s, 1000 requests/s

Client Client DB Client CDN CDN CDN Prod Server

(34)

Classic Architecture

My First

Clouds

(35)

Spring LDAP

Dev _LDAPOpen

Apache DS

Active Directory

(36)

Spring LDAP

Dev _LDAPOpen

Apache DS

Active Directory

Build Server

(37)

Spring LDAP

Dev _LDAPOpen

Apache DS

Active Directory

Build Server

(38)

Web Start-Up Company

Prod Server

DB Prod

Server ServerProd

(39)

Web Start-Up Company

Prod Server

DB Prod

Server ServerProd

Load

Stage Server

DB Stage

Server ServerStage

(40)

Web Start-Up Company

Prod Server

DB Prod

Server ServerProd

Load

Stage Server

DB Stage

Server ServerStage

Load

Prod Server

DB Prod

Server ServerProd

Load

Test

(41)

Load-Test Business Case

Prod Server

DB Prod

Server ServerProd

Load

Test

Client ClientTest ClientTest

•

Physical/virtual

•

8 servers

•

>8000 SEK / month

•

Cloud

•

2 hours / night

•

20 nights / month

•

$2.50 per night

(42)

Load-Test Business Case

Prod Server

DB Prod

Server ServerProd

Load

Test

>90%

less

•

Physical/virtual

•

8 servers

•

>8000 SEK / month

•

Cloud

•

2 hours / night

•

20 nights / month

•

$2.50 per night

(43)

Current Project

VPS Content Ingestion S3 Content Files SQ S

Public REST Services

Social Media Integration EBS DB Disk DB Disk DB Disk

ELB _ELB _ELB

Mon OPS DB Mgmt SQ S Event Stream

(44)

With Great Power Comes Overwhelming Complexity

Cloud

(45)

What Do We Want?

Prod Server

DB Prod

Server ServerProd

Load

Test

(46)

Starting Out

Amazon

Server

App

32 bit

Ubuntu

Amazon

Server

64 bit

Ubuntu

(47)

Templates

Amazon

Server

App Server

Template

32 bit

Ubuntu

Amazon

Server

64 bit

Ubuntu

DB Server

(48)

Automation

Amazon Server App Server Role 32 bit Ubuntu Amazon Server 64 bit Ubuntu DB Server Role Admin Server Java Deployment "Script"

(49)

(50)

(51)

Our Experiences with Amazon EC2

(52)

Our Experiences with Amazon EC2

•

Works Great

(53)

Our Experiences with Amazon EC2

•

Works Great

•

Super Fast

(54)

Our Experiences with Amazon EC2

•

Works Great

•

Super Fast

(55)

Our Experiences with Amazon EC2

•

Works Great

•

Super Fast

•

They donʼt Power Off Machines

(56)

Our Experiences with Amazon EC2

•

Works Great

•

Super Fast

•

They donʼt Power Off Machines

•

Itʼs a Loooooong Way To North Carolina

(57)

Services Ecosystem

•

Right Scale

•

Auto-scale based on SLA

•

Multi-server deployment plans

•

Scalr.net

•

Auto-restart on failure

(58)

Services Ecosystem

•

Right Scale

•

Auto-scale based on SLA

•

Multi-server deployment plans

•

Scalr.net

•

Auto-restart on failure

(59)

Cloud

(60)

HOW COULD YOU

(61)

Platform As A Service

Application

Clouds

(62)

Application Cloud

•

Everything is Services

•

Persistence, Caching, Mail, Users

•

Automatic Scaling...?

•

Less Control

(63)

(64)

My New Cloud

DB

App Streaming_Service File

Service

Client

flash streaming static

(65)

Something’s Got To Give

App App App App App App App App App App

(66)

Something’s Got To Give

DB DB

(67)

Something’s Got To Give

DB DB

DB DB DB DB DB DB DB DB DB

Client DB Client DB Client DB Prod Server Prod Server Prod Server

(68)

BigTable

FirstName 1 Adam 2 LastName Skogman Company Jayway Phone

+46 701 469291 +46 40 6023100

id user

Shoping Cart

date 100 foo ...

101 fie ...

id cart

Shoping Cart Item

count product

200 100 1 300 201 100 1 301 102 fum ...

id name Product

Price 300 MacBook $999 301 MacMini $599

(69)

BigTable

FirstName 1 Adam 2 LastName Skogman Company Jayway Phone

+46 701 469291 +46 40 6023100 FirstName 1 Adam 2 LastName Skogman Company Jayway Phone

+46 701 469291 +46 40 6023100

id user

Shoping Cart

date 100 foo ...

101 fie ...

id cart

Shoping Cart Item

count product

200 100 1 300 201 100 1 301 102 fum ...

id name Product

(70)

BigTable

user 100 foo cart 100 200 100 201 100 count 1 1 product 300 301 user 100 foo cart 100 200 100 201 100 count 1 1 product 300 301 id user Shoping Cart date 100 foo ...

101 fie ...

id cart

Shoping Cart Item

count product

200 100 1 300 201 100 1 301 102 fum ...

id name Product

(71)

BigTable

value foo $1598 fie $1998 fum $599 count:macbook 1 2 value:macbook $999 $999 count:macmini 1 1 value:macmini $599 $599 value foo $1598 fie $1998 fum $599 count:macbook 1 2 value:macbook $999 $999 count:macmini 1 1 value:macmini $599 $599 id user Shoping Cart date 100 foo ...

101 fie ...

id cart

Shoping Cart Item

count product

200 100 1 300 201 100 1 301 102 fum ...

id name Product

(72)

BigTable

value foo $1598 count:macbook 1 value:macbook $999 count:macmini 1 value:macmini $599

$1598_$1598 1₁ $999_$999 1₁ $599_$599 _{t=2009-11-03 12:00} value foo $1598 count:macbook 1 value:macbook $999 count:macmini 1 value:macmini $599

$1598_$1598 1₁ $999_$999 1₁ $599_$599 _{t=2009-11-03 12:00}

id user

Shoping Cart

date 100 foo ...

101 fie ...

id cart

Shoping Cart Item

count product

200 100 1 300 201 100 1 301 102 fum ...

id name Product

(73)

ACID Before

•

Atomic

•

Consistent

•

Isolated

•

Durable

BASE Today

•

Basically Available

•

Soft State

•

Eventually Consistent

(74)

(75)

(76)

(77)

Virtualization on Tap

Scaling Business Model

(78)

Virtualization on Tap

Scaling Business Model

Architecture Style

(79)

Virtualization on Tap

Scaling Business Model

Architecture Style

Not a Magic Silver Bullet

(80)

Virtualization on Tap

Scaling Business Model

Test Env of Tomorrow

Architecture Style

Not a Magic Silver Bullet

(81)

From Zero to

Cloud

(82)

[email protected]