Economic Cloud Computing What to keep in mind when using the Cloud...

(1)

Economic Cloud Computing

research

edinburgh

data.intensive

Gary A. McGilvary

1

(2)

1. Introduction

2. Uncontrollable Cloud Costs

3. Human Factors Affecting Cost

4. Conclusions

OUTLINE

2 Cloud Load

Instance Processors

Cloud Correctness

End-user Location

Job Configuration

Instance Security

Motivation

Cloud/Human Factors

(3)

INTRODUCTION

• Investigate factors influencing cost

Cloud Computing Provider

• Underlying performance

- Cloud load vs time of day

- Instance processors

• Correctness of recorded cloud usage

Human Factors

• End-user Location

• Configuration

- Underutilization

• Security

• Lower costs for cloud users

(4)

SPRINT

• Simple Parallel R INTerface

- provides parallel functions of R

• Functions:

- pcor: parallel correlation

pcor(t (x, y = x)

- pmaxT: parallel permutation test

pmaxT(x, classlabel, B=150000)

http://r-sprint.org/

(5)

1. Introduction

2. Uncontrollable Cloud Costs

3. Human Factors Affecting Cost

4. Conclusions/Future Work

OUTLINE

5 Cloud Load

Instance Processors

Cloud Correctness

Motivation

Cloud/Human Factors

(6)

6 Cloud Load vs Time of Day?

Improving High-Performance Computations on Clouds Through Resource Underutilization

(7)

INSTANCE PROCESSORS

• Instances deployed on varying processors

• EC2 Compute Unit (1.0 - 1.2 GHz, Xeon 2007)

- Large instance = 2 EC2 CU’s per core (2cores), 4.0 -4.8 GHz

Processor Type

Min Usage

Max Usage

Intel Xeon E5507

2.27 GHz

( x2 - 4.54 GHz)

88.1%

100%

Intel Xeon E5645

2.4 GHz

(x2 - 4.8 GHz)

83.3%

100%

Intel Xeon E5430

2.66 GHz

(x2 - 5.32 GHz)

75.1%

90.22%

• Experiment Setup:

(8)

8

INSTANCE PROCESSORS

(9)

Network - Regions

CLOUD CORRECTNESS

(10)

Network - Availability Zones

_IDT

RDT

AZDT

CLOUD CORRECTNESS

(11)

CLOUD CORRECTNESS

Variability of Data Transfer Usage Charges

• Regional Data Transfer (RDT)

• Transferred 84.3 MB’s from EC2 Ubuntu Repository to the instance

0"

10"

20"

30"

40"

50"

60"

70"

80"

90"

1"

2"

3"

4"

5"

6"

7"

8"

9"

10"

11"

12"

MB

's

%C

on

su

m

ed

%

Experiment%

Regional%Data%Transfer%In%

Usage"Report"

tcpdump"

(12)

1. Introduction

2. Uncontrollable Cloud Costs

3. Human Factors Affecting Cost

4. Conclusions/Future Work

OUTLINE

12 Cloud Load

Instance Processors

Cloud Correctness

End-user Location

Job Configuration

Instance Security

Motivation

Cloud/Human Factors

(13)

Cost vs User Location:

• Submit in person, not VPN

• Typical application:

- stage input data

- execute job

- return output

• Invoice and Usage report

(14)

Cost vs User Location:

COST VARIABILITY

23/02/2011 12:33 about:blank

Page 1 of 1

Amazon Web Services

Billing Statement: February 1 - February 28, 2011 Date Printed: February 23, 2011

Name: Gary McGilvary

Email: [email protected] Account Number: 0864-1647-1363

Totals

Amazon Elastic Compute Cloud US East (Northern Virginia) Region Amazon EC2 running Linux/UNIX

$0.085 per Small Instance (m1.small)

instance-hour (or partial hour) 10 Hrs 0.85 Amazon EC2 EBS

$0.00 per GB-month of provisioned

storage under monthly free tier 0.024 GB-Mo 0.00 $0.00 per 1 million I/O requests under

monthly free tier 5,422 IOs 0.00 $0.00 per 10,000 gets (when loading a

snapshot) under monthly free tier 2,048 Requests 0.00 Amazon CloudWatch

$0.015 per monitored instance-hour (or

partial hour) 5 Hrs 0.08

» 0.93

Amazon Simple Notification Service US East (Northern Virginia) Region

First 100,000 Amazon SNS API

Requests per month are free 36 Requests 0.00

» 0.00

Amazon Simple Storage Service US Standard Region

$0.00 per request - PUT, COPY, POST, or LIST requests under the monthly global free tier

17 Requests 0.00

» 0.00

Amazon Virtual Private Cloud

» 0.00

AWS Data Transfer (excluding Amazon CloudFront)

$0.000 per GB - data transfer in under_{the monthly global free tier} 0.040 GB 0.00 $0.000 per GB - data transfer out under

the monthly global free tier 0.004 GB 0.00

$0.010 per GB regional data transfer -in/out/between EC2 Avail Zones or when using public/elastic IP addresses or ELB

0.511 GB 0.01

0.01

Taxes

Estimated Taxes | VAT Registration

(Due March 1, 2011)

0.19 Total Charges due on March 1, 2011† $1.13

23/02/2011 12:33 about:blank

Page 1 of 1

Amazon Web Services

Billing Statement: February 1 - February 28, 2011 Date Printed: February 23, 2011

Name: Gary McGilvary

Email: [email protected] Account Number: 0864-1647-1363

Totals

Amazon Elastic Compute Cloud US East (Northern Virginia) Region Amazon EC2 running Linux/UNIX

$0.085 per Small Instance (m1.small)

instance-hour (or partial hour) 10 Hrs 0.85 Amazon EC2 EBS

$0.00 per GB-month of provisioned

storage under monthly free tier 0.024 GB-Mo 0.00 $0.00 per 1 million I/O requests under

monthly free tier 5,422 IOs 0.00 $0.00 per 10,000 gets (when loading a

snapshot) under monthly free tier 2,048 Requests 0.00 Amazon CloudWatch

$0.015 per monitored instance-hour (or

partial hour) 5 Hrs 0.08

» 0.93

Amazon Simple Notification Service US East (Northern Virginia) Region

First 100,000 Amazon SNS API

Requests per month are free 36 Requests 0.00

» 0.00

Amazon Simple Storage Service US Standard Region

$0.00 per request - PUT, COPY, POST, or LIST requests under the monthly global free tier

17 Requests 0.00

» 0.00

Amazon Virtual Private Cloud

» 0.00

AWS Data Transfer (excluding Amazon CloudFront) $0.000 per GB - data transfer in under

the monthly global free tier 0.040 GB 0.00 $0.000 per GB - data transfer out under

the monthly global free tier 0.004 GB 0.00

$0.010 per GB regional data transfer -in/out/between EC2 Avail Zones or when using public/elastic IP addresses or ELB

0.511 GB 0.01

0.01

Taxes

Estimated Taxes | VAT Registration

(Due March 1, 2011)

0.19 Total Charges due on March 1, 2011† $1.13

<?xml version="1.0" encoding="UTF-8"?> <ServiceUsage>

<ServiceName>AmazonEC2</ServiceName>

<OperationName>RunInstances</OperationName>

<UsageType>DataTransfer-In-Bytes</UsageType>

<OperationName>GetMetricStatistics</OperationName>

<UsageType>Calls</UsageType>

<OperationName>RunInstances</OperationName>

<UsageType>BoxUsage</UsageType>

<OperationName>InterZone-Out</OperationName>

<UsageType>DataTransfer-Regional-Bytes</UsageType>

(15)

Cost vs User Location:

• Difference in taxation levels

-

Scale with use and expensive for prolonged time periods

-

Businesses/Individuals in a tax free zone will benefit

e.g. $4000 per month equals $9600 of tax per year

• Difference in resource usages

-

dependent on location or cloud load?

(16)

JOB CONFIGURATION

Underutilization

• Reserving more resources while using a small % of each

e.g Reserving 4 instances but only using a total of 2 instances

• Two Cases:

(Large: 2 cores at 2 EC2 CU’s)

1. Each process per instance

- e.g

4 processes = 4 instances

(one core per instance)

R

VS

R

2 GHz

2. Each process per instance core

-

e.g

4 processes = 2 instances (4 cores)

(17)

Case Study: SPRINT

(18)