How to Leverage Cloud to Quickly Build Scalable Applications

How to Leverage Cloud to Quickly Build

Scalable Applications

Chris Keyser – Principal Solution Architect

David Polley – Senior Director Cloud Product Management

Cloud Growth

• Recent IDC cloud research shows that

spending on public IT cloud services will

reach $47.4 billion in 2013 and is expected to

be more than $107 billion in 2017. Over the

2013–2017 forecast period, public IT cloud

services will have a compound annual growth

rate (CAGR) of 23.5%, five times that of the

industry overall.

• By 2017, IDC expects public IT cloud

services will drive 17% of the IT product

spending and nearly half of all growth across

five technology categories: applications,

system infrastructure software, platform as a

service (PaaS), servers, and basic services.

Myths and Reality of Cloud

Cloud Myths

Security & Privacy

Regulations

Performance

Loss of Flexibility

Immature Platforms

Fast Deployments

On-Demand Scalability

Lower Operational Cost & TCO

Reduced Operational Skills

Rapid Access to New Capabilities

Focus on Content

Easier Integration

Cloud Reality

Massive Flexibility

Performance on Demand

Amazon Web Services

Gartner Magic Quadrant for Cloud Infrastructure as a Service

What is AWS?

AWS Global Infrastructure

Application Services

Networking

Deployment & Administration

Database

Storage

Compute

Security is Job Zero

Network

Security

Physical Security Platform

Security

People &

Procedures

Build everything on a constantly improving security baseline

AWS Foundation Services

Compute Storage Database ^Networking

Availability Zones

AWS is

responsible for

the security OF

GxP

ISO 13485

AS9100

ISO/TS 16949

AWS global infrastructure

11 Regions

28 Availability Zones

52 Edge locations

Unconstrained Big Data Growth

• IT/Application server logs

IT Infrastructure logs, Metering, Audit logs,

Change logs

• Websites/Mobile apps/Ads

Clickstream, User Engagement

• Sensor data/IoT

Weather, Smart Grids, Wearables

• Social media, user content

450MM+ Tweets/day

TB

PB

ZB

EB

Technologies and techniques for working

productively with data, at any scale.

Big Data

Creating Value from Data Assets

Recommendations,

Collective Intelligence

Machine Learning

Visualization

Dashboards Business Intelligence

Measuring Functionality

and Services

Ad Hoc Queries A/B Testing

Hypothesis Testing

& Predictions

Statistical Analysis

Learning from Social

Media Conversations

Sentiment Analysis

SOCIAL

BIG DATA

Machine Learning Dashboards

Business Intelligence Ad Hoc Queries A/B Testing Statistical

Analysis Sentiment Analysis

Potentially massive datasets

Iterative, experimental style of data

manipulation and analysis

Frequently not a steady-state workload;

peaks and valleys

Time to results is key

Hard to configure/manage

Massive, virtually unlimited capacity

Iterative, experimental style of

infrastructure deployment/usage

Highly efficient with variable

workloads

Parallel clusters from single source

Managed services

AWS Cloud

Big Data

AWS Big Data Portfolio

Analyze

Ingest

Amazon Kinesis

AWS Import/Export AWS Direct Connect

Collect

Amazon Glacier Amazon S3

Amazon DynamoDB

Store

Amazon Elastic MapReduce

Amazon EC2

Kinesis

Amazon S3

Share

Amazon Redshift Amazon

Redshift

AWS Data

Pipeline

Partners

AWS Online Software Store

aws.amazon.com/marketplace

AWS Marketplace

Amazon RDS: managed SQL in the cloud

• Simple and fast to deploy

• Handles repetitive management tasks

• Compatible with your applications

– And introducing Amazon Aurora

• Fast, predictable performance

• Simple and fast to scale

• Secure

Amazon RDS

Amazon Redshift

Fast, simple, petabyte-scale data warehousing for less than $1,000/TB/Year

Common Use Cases for Amazon Redshift

• Reduce costs by extending

DW rather than adding HW

• Migrate completely from

existing DW systems

• Respond faster to business

• Improve performance by an

order of magnitude

• Make more data available

for analysis

• Access business data via

standard reporting tools

• Add analytic functionality to

applications

• Scale DW capacity as

demand grows

• Reduce HW & SW costs by

Traditional Enterprise DW Companies with Big Data SaaS Companies

Amazon Redshift Architecture

• Leader Node

– SQL endpoint

– Stores metadata

– Coordinates query execution

• Compute Nodes

– Local, columnar storage

– Execute queries in parallel

– Parallel Load, backup, restore

• HW optimized for data processing

– DW1: HDD; scale from 2TB to 2PB

– DW2: SSD; scale from 160GB to 326TB

10 GigE (HPC)

Ingestion Backup Restore

JDBC/ODBC

Amazon Redshift has security built-in

• SSL to secure data in transit

– ECDHE perfect forward security

• Encryption to secure data at rest

– AES-256; hardware accelerated

– All blocks on disks & in Amazon S3

encrypted

– On-premises HSM & CloudHSM support

• Audit logging & AWS CloudTrail

integration

• Amazon VPC support

• SOC 1/2/3, PCI-DSS Level 1, FedRAMP

10 GigE (HPC)

Ingestion Backup Restore

Customer VPC

Internal VPC

JDBC/ODBC

Hadoop 1.x & 2.x / HDFS clusters

Easy to use; fully managed

Support for EC2 Spot Instances

S3, DynamoDB, Redshift & Kinesis Integration

Amazon

Elastic

MapReduce

(EMR)

A Typical Amazon EMR Cluster

Master instance group

Task instance group Core instance group

HDFS HDFS

Amazon EMR

Amazon S3

1. Put the

data into

Amazon S3

2. Choose Hadoop distribution,

# of nodes, types of nodes, and

Hadoop apps like Hive, Pig

and HBase

4. Get the output

from Amazon S3

3. Launch the cluster using

the EMR console, CLI,

SDK, or APIs

How Does Amazon EMR Work?

EMR

Amazon EMR

You can easily resize

the cluster

And launch parallel

clusters using the same

How Does Amazon EMR Work?

EMR

Amazon EMR

Use Spot nodes

to save time and

money

How Does Amazon EMR Work?

EMR

Amazon EMR

How Do Amazon EMR and MicroStrategy Work?

odbc

MicroStrategy Cloud

Changing How BI is Delivered

Traditional Implementations can be lengthy and costly

Understand Business 1

Define

Requirements 2

Assign Resources 3

Research 4

RFIs, RFPs and POCs 5

Select Providers 6

Negotiate Agreements 7

Approvals 8

Build Purchase Orders

9

Hire Technical Staff

10

Receive Equipment 11

Install and Configure 12

Test

Environment 13

Build Application 14

Test and Deploy 15

Finish 16

Accelerate time to market. Improve business agility. Reduce Risk.

Changing How BI is Delivered

Build

Application

Test and

Deploy

Finish

Understand

Business

Define

Requirements

Sign Cloud

Agreement

1

2

3

5

6

7

* Based on MicroStrategy Cloud Implementations in 2012 & 2013

Two Cloud Options

MicroStrategy-managed and Customer-managed

AWS Marketplace

Enterprise analytics meets unlimited computing power

MicroStrategy Marketplace:

http://www.microstrategy.com/us/platforms/analytics/cloud?utm_s ource=mstr-world-

2014&utm_medium=presentation&utm_campaign=cloud- aws#get-started

AWS Marketplace:

https://aws.amazon.com/marketplace/search/results/ref=gtw_nav

• Optimized for companies that have

strong in house MicroStrategy

Expertise

• Want complete control over the

management of the BI solution

• Need Rapid provisioning and high

flexibility in the availability of the

solution.

• Want to rapidly connect to Data stored

in the AWS Ecosystem

MicroStrategy on AWS Marketplace

MicroStrategy Managed Cloud

Secure Cloud

Analytics Services

Data Warehouse Services

Data Integration Services

Secure Infrastructure

Integra tio n Ser v ic es

Mobile Services Identity & Security Services

Business Users

MicroStrategy Experts

•Mobile and Web Apps

•Run Reports/Dashboards

•Manage Subscriptions

•Self-service Visual Exploration

•Monitor System

•Tune Operational Environment

•Optimize Performance

•Adjust Capacity

•Manage Upgrades

•Design Reports / Dashboards

•Create BI Metadata

•Database Design

IT Professionals

Optimal Distribution of Expertise

MicroStrategy BI Servers

Out-of-the-Box Value

Plug-and-play analytics platform

 Flexible Environments

 Clustering, high availability options

 Data backups

 Operational expertise

 DBA, VM, ETL, MSTR, OS, …

 Performance management

 24*7 Monitoring

 Customer Success Manager

 Access to database services

 Options from cost effective to large scale enterprise-class

 Access to ETL services

 Options range from cost effective cloud implementation to high performance single tenant solutions

 Metadata database hosting

 LDAP, SFTP services

 Data backup

 MicroStrategy software platform

 Mobile

 Transaction services

 Clustering

 Multisource

 Office

 Distribution Services

 OLAP services

 Networking

 High speed connections

 Routers/switches

 Secure dedicated VLAN

 Security

 Secure network architecture

 Intrusion detection

 VPN configuration and management

Flexible Data Connection Options

Choose Where the Data Lives

Let Us Do the Heavy Lifting

Cloud Data Services

Best Hardware and Software On-Demand

No Need to Move the Data

Direct Connect

MicroStrategy Architecture Optimizes Performance On premises data

Secure VPN

Data Integration Data Warehouse

Secure Cloud Business Analytics Platform

Service Organization Controls (SOC) over the security, availability, and

processing integrity of a system and the confidentiality and privacy of the

information processed by the system.

Health Insurance Portability and Accountability Act (HIPAA) designed to provide privacy standards to protect patients' medical records and other health information.

Safe Harbor is intended for organizations within the EU or US that store customer data and is designed to prevent accidental

Payment Card Industry Data Security Standard (PCI DSS) is a proprietary information security standard for organizations that handle cardholder information.

• Architecture

• Customer Isolation

• Encryption

• Authentication

• Certifications & Controls

• Vulnerability & Penetration Testing

• 24x7 Monitoring & alerts

• Controls map to : SOC 2 Type II, PCI, HIPAA

• Facilities

• SOC2 Type II

• Surveillance, Biometrics

Cloud Support Lifecycle

Level of interactivity

Who are they?

• The ultimate customer advocate

What is their role?

• Proactively engage with customers to ensure

MicroStrategy Cloud delivers optimal value

• Ensure all requests efficiently flow through

MicroStrategy

• Schedule regular status meetings to review open

issues and align with customer objectives

• Regularly review Cloud usage and performance

metrics with customer

• Ensure optimally tuned systems and conduct capacity

planning reviews

• Particularly critical at 3 stages: onboarding, upgrades,

and production roll-outs

Optional Value Added Services

Professional Services and Premium Support

Business Intelligence Data Services (DW, DI)

Platform Management & Support Dedicated Implementation Support Professional Services

Consulting Managed Services

• Requirements

• Application Architecture

• Application Development

• Quality Assurance

• Application tuning

• … and more …

Platform

Application

Cloud Plus Cloud Complete

Available Options:

• Dedicated Case Manager

• Dedicated Support Engineer

• 24x7x365 Support

• Critical Issue Notification

• … and more …

Get Started Now

30 day free trial on the

http://www.microstrategy.com/us/analytics/get-started

Join the MicroStrategy 10 Beta Program on the Cloud

At MicroStrategy, we continually work to improve our existing products, develop new ones and bring you leading edge technology. Before our software is available to the general public, Beta Participants evaluate new products in their own environments.

Questions