Storage for Different Compute Clouds
Session D-203, OpenStorage: Use Cases
Joe Arnold
CEO, SwiftStack Inc.
Santa Clara, CA USA
Storage for Different Compute Clouds
Essential elements of Cloud
Different compute cloud environments
Different storage options for cloud
Focus on Object Storage for unstructured data
Use case examples
Essential Elements of IT
(
including Cloud
)
Santa Clara, CA USA
October 2013 3
Applications
Applications are changing
• SaaS, collaboration, social
Compute
Optimized to serve application users
• Steady state, burst, periodic / scheduled load
Santa Clara, CA USA
Networking
Optimized to move data, from storage, to users
Storage
Different than compute and networking
• Data accumulates, much harder to move
Santa Clara, CA USA
“Open” is the preference for Cloud
Avoiding lock-in
• Platform
• Data
• Tools
Better visibility into how it works
• Troubleshooting
Types of Cloud Storage
Public
Private
Block
File
Object
Santa Clara, CA USA
Types of cloud storage
Traditional
Private Storage
Public Cloud
Object Storage
Open Private
Cloud Storage
Scale
Hard
Easy
Easy
Resiliency
Good
Very Good
Very Good
Ownership
Strong
Weak
Strong
Control
High
Low
High
Lock-in
Yes
Yes
No
Public Cloud Storage
Optimized for the compute offered by that
vendor
Pros
• Very easy to get started
• Very scalable
• Good resiliency
Cons
• Cost at scale
• Migration when needed
• Control and custody
Santa Clara, CA USA
When to choose Public Cloud
When data is fairly small
• <100TB
When you don’t have a datacenter
• Can have “private” hosted
When testing / proving application
If privacy is not a concern
Private Cloud Storage
Can be used with any compute environment
Pros
• Cost certainty at scale
• Strong control and ownership
• Scalability and resiliency
When to choose
• Anytime privacy / control is a requirement
• Scale 100TB and beyond
• For new applications
Santa Clara, CA USA
Durability ensured by distributed
replication checks
Santa Clara, CA USA
Shared nothing architecture – The Ring
Santa Clara, CA USA
Seagate Kinetic – Ethernet,
key/value devices
Storage Node: Current System
Santa Clara, CA USA
Seagate Kinetic & SwiftStack
Resources
Seagate Platform Developer Kit:
http://seagate.com/www/kinetic
SwiftStack Resources
http://www.seagate.com/solutions/partners/swiftstack/
https://github.com/swiftstack/kinetic-swift
http://swiftstack.com/blog/
Santa Clara, CA USA
Affinity Writes
Santa Clara, CA USA
Example: OpenStack Swift
Web addressable
• Everything has URL | Content served directly to devices
Easy to use
• Simple, RESTful API and a wide range of client tools
99.99999% Durability
• All data replicated 3x
Massive concurrency
• Ideal for many concurrent users
Multi-tenant
• Huge, flat namespace for all your applications
Santa Clara, CA USA
October 2013 25
Standard
Hardware
Private Cloud Use Case - Enterprise
SaaS Expense Reporting –
Receipts from mobile devices
Microsoft compute environment
Two geographically-distributed
data centers to lower latency
Private Cloud Use Case - Infrastructure
Santa Clara, CA USA October 2013
Largest Cloud at
Disney - supporting
online gaming & more
Citrix Cloud Platform
compute environment
“Product” not Project
Integration with their
Enterprise - LDAP
Other Private Cloud Use Cases
Online Gaming
Cost / Control /
Concurrency
Amazon environment
Millions of users /
Massive concurrency
Booting 100s of VMs
Service Provider
Multi-tenant
storage-as-a-service
CA AppLogic
environment
Regional focus, global
footprint
Broadcasting
High cost and of video
archives, sharing limits
Microsoft environment
800 events / yr.
Tape not on-demand
CIFS / NFS interface
What’s Next – OpenStack Swift
1. Flexible Storage
2. Optimized Storage
Platforms
3. Erasure Codes
4. Storage Policies
Santa Clara, CA USA
