MICROSTRATEGY ON AWS
MicroStrategy World 2015 Tuesday, January 27th3:30 – 4:30 PM Track 8 | Session 3
WWW.IOLAP.COM 1
Presented by:
INTRODUCTIONS
iOLAP
Data Warehousing and Business Intelligence consultancy
MicroStrategy partner for 15 years
Headquarters in Frisco, TX with national customer base
50+ U.S. employees and 25+ developers in Europe
Nick Larsen
Managing Partner
10 years at iOLAP
MicroStrategy Architect
AWS Architect
WHERE ARE YOU ON THE CLOUD JOURNEY?
What’s your current MicroStrategy infrastructure deployment?
Evaluating
Stealth
IT closet
Corporate data center
Public data center
Public Cloud (MicroStrategy/AWS/Azure/RackSpace/Other)
Is your organization running anything in a public cloud?
Who is currently an AWS customer?
61%
Moving to cloud in next 2 years
70%
Considering the cloud as primary platform for new analytics projects10%
On-premise analytics deployments by 2020WWW.IOLAP.COM 3
PRESENTATION GOALS
Provide an overview of Amazon Web Services products
Describe AWS architectures that can benefit your data warehouse and BI platform
Explore MicroStrategy deployment models in AWS and alternative use-cases
Illustrate some experience differences of a cloud deployment
Demonstrate an easy deployment of a disaster recovery scenario
CUSTOMER DEMANDS
Harder. Better. Faster. Cheaper.
“Developers are like artists; they produce their best work if they have the
freedom to do so, but they need good tools…agility is a function of
experimentation and fast failures.”
Werner Vogels | CTO | Amazon.com
WWW.IOLAP.COM 5
KEY DW/BI AWS PRODUCTS
Workspaces
Cloud Formation EC2
Compute
S3 Glacier
Storage
RDS Redshift
Databases
VPC Direct Connect Route 53 Networking
EMR Kinesis Data Pipeline Data Processing
BIG PICTURE
corporate data center
3rd Party Resources
S3
EMR Kinesis Data Pipeline Data Processing
EC2 Compute
RDS Redshift
Databases
EC2
Glacier Workspaces
WWW.IOLAP.COM 7
NETWORK & SECURITY ARCHITECTURE
us-east-1 us-east-1b
SUBNET1 SUBNET2
ISERV1
us-west-1 us-west-1a
SUBNET3 SUBNET4
ISERV2 WEB1
WEB2
SCALING MICROSTRATEGY
General Purpose
T2: Development environments
M3: Test and small production environments
Compute Optimized
C3/C4: Large general production
Memory Optimized
R3: High usage of Intelligence Cubes
IP Distribution
Data Warehouse
http://aws.amazon.com/ec2/instance-types/ WWW.IOLAP.COM 9
EXAMPLE DEPLOYMENT – INFRASTRUCTURE
Create basic services with Cloud Formation
EC2
RDS
Redshift
Note Internal IP addresses
Attach an Elastic IP to the Web Server
MICROSTRATEGY AMI
MicroStrategy offers a free 30 day trial in an easy to deploy Amazon Machine
Image (AMI) from the AWS Marketplace. It includes 25 users and is deployed with
SQL Server 2012 to handle the metadata repository.
https://aws.amazon.com/marketplace/pp/B00JK1ZEK6/
Additional AMI’s are available for 50, 100, 250, and 1000 users. Pricing is by the
hour or annually plus EC2 usage, EBS storage, and data transfer fees.
WWW.IOLAP.COM 11
USE CASES – STARTING THE JOURNEY
Upgrades
Easily upgrade your metadata and regression test against your primary environment using Integrity Manager
Address issues in your AWS environment, upgrade your primary environment, and merge your changes back in
POC
Mobile deployments
New applications
Portal integrations
Temporary Environments
8.x 9.x
USE CASES – GAINING TRACTION
Secondary Environments
Disaster Recovery
Maintain an EBS snapshot of a MicroStrategy installation and have your CloudFormation scripts ready to go. When disaster strikes, create your environment and point it to your metadata or restore your latest metadata snapshot to RDS. Update DNS to point to AWS.
Development Branches
Keep you existing development and test environments separate from external labor or special project needs
Dev/Test
AWS is the perfect place for development and test environments
Deploy Amazon Workspaces for client tools and forget about lost IServer connections
WWW.IOLAP.COM 13
USE CASES – ALMOST THERE
Unique Requirements
Seasonal Performance
Additional hardware needs during certain time periods
Cost effective…pay only for what you use
Geo Based Performance/Security
Client connections must be routed to local data centers
Reduce internet hops and latency
USE CASES – ALL IN
Temporary Environments Secondary Environments Unique Requirements
Assimilate
WWW.IOLAP.COM 15
CLOUD JOURNEY - EXAMPLE
Starting the Journey
POC ingesting vendor PO and store inventory data
Tech: Redshift, DMX on EC2
Gaining Traction
Integrate daily store databases
Tech: Redshift, custom .NET agent, S3, Python scripting on EC2, DMX on EC2
Almost There
Integrate near real time store data
Tech: Redshift, custom Java agent, S3, Python scripting
All In
Migrated all websites to EC2
Migrated all transactional databases to RDS
Deployed multiple new applications that were previously outsourced
EXAMPLE DEPLOYMENT - CONFIGURATION
Connection from Web to iServer
Connection from iServer to Redshift
Determine private IP of Metadata (RDS)
Connection from iServer to Metadata (RDS)
Start the iServer
Connect Web to iServer
WWW.IOLAP.COM 17
CONSIDERATIONS FOR A CLOUD DEPLOYMENT
Location of Data
Latency between data centers
Security over network
Data transfer costs
Security
AWS provides multiple layers
AWS warns you of unsafe configurations
Control
You’ve lost some of it
Cost Management
Monitor spending and adjust behaviors
Purchase reserved instances
BYOL vs. Marketplace
Capital vs. expense
Do the math
Skillset
A new kind of Architect may be needed
QUICK NOTE ON SECURITY
Physical
24/7 trained security guards
Electronic surveillance and multi-factor access control
Other Features
SSL/TLS encrypted endpoints
Security groups (firewalls)
User management via IAM
Private subnets via VPC
Encrypted data storage
Security logs
Identification and configuration
Sharing the Responsibility
With Infrastructure services, you own:
Patching the OS
Securing software
Securing the security group
With Platform services:
AWS patches the OS
You secure access to the service
WWW.IOLAP.COM 19
WHAT’S NEXT
As experts in Data Warehousing, Business Intelligence, and Cloud Architecture, iOLAP
is uniquely positioned to help you move through your cloud journey.
Services include:
Cloud ready assessment
Custom cloud architecture planning
Cloud POC or Pilot
Cloud migration
Managed cloud service
www.iolap.com | 214.618.5206 | [email protected] Frisco, TX, USA | Rijeka, Croatia
QUESTIONS?
THANK YOU
Nick Larsen
[email protected]
T (214) 618-5215
C (214) 223-4722
WWW.IOLAP.COM 21