Software-Defined Storage & VMware Virtual SAN
Luc Gallet
VMware Delivers:
The Foundation for the Software-Defined Enterprise
Compute
Physical Hardware
Policy-based Management &
Automation Cloud Automation Cloud Operations Cloud Business
Software-Defined Data Center
Private Clouds Public Clouds Hybrid Cloud VMware & vCloud Data Center Partners
Virtualized Infrastructure
Abstract & Pool
Compute Abstraction = Server Virtualization Network Network Abstraction = Virtual Networking Storage Storage Abstraction = Software-Defined Storage Applications
End User Computing Desktop Mobile
Virtual Workspace
Modern SaaS
Traditional
The Software-Defined Data Center
Transform
storage
by aligning it with
app demands
Management
tools give way
to automation
Expand virtual
compute to all
applications
Virtualize the
network
for speed
The Software-Defined Data Center
Transform
storage
by aligning it with
app demands
Today’s Challenge: Massive Increase in Storage Demand &
Complexity
24% 26% 28% 28% 31% 42% Management Complexity Provisioning Time/budget Data Migrations Troubleshooting Meeting SLAMost Pressing Storage Challenges
M 20M 40M 60M 80M 100M 120M 2008 2009 2010 2011 2012 2013 2014 2015 2016 Terabytes Sold Terabytes Sold
Source: IDC, Yezhkova, Worldwide Enterprise Storage Systems Forecast, November 2013, #244293
Storage Growth
41% YoY
Storage Market in Midst of Disruption
6
Key Drivers
Server flash
Falling storage prices Abundant CPU cycles Hypervisor-converged infrastructure Cloud economics
Server Storage
20-30 years ago
Shared Storage
10-15 years ago
New Forms
Today
New Storage Tiers Are Rapidly Growing
7
• Flash: Enables New Storage Architectures
• Flash is 50x – 2,000x faster than HDD
– 110K/140K IOPs R/W from 360GB MLC PCIe card1
– Less than $0.10 per IOP
• Eliminates the need to stripe across 100s of HDDs
• Enables high performance server-side storage
• Cloud: Enables Cost-Effective Storage
• Highly scalable, pay-as-you-go
• Access through standard APIs
• Low cost for capacity
– $0.05 per GB per month2
• Forecasted to grow at 40% annually to 20183
Cloud Storage
The Hypervisor Opens Up New Opportunities
8
SAN / NAS
x86 Servers Cloud Storage
vSphere
The virtualization platform: • Knows the needs of all
apps in real time
• Sits directly in the I/O path • Global view of underlying
infrastructure
Object-based Pool SAN/NAS Pool Hypervisor Converged Pool
Leveraging The Hypervisor We Can Transform Storage
Today Software-defined Storage
Abstract and pool
(Virtualized Data Plane)
Automate SLAs via VM-centric policies
(Policy-based Control Plane)
VM level Data services
(Virtual Data Services)
SAN / NAS x86 Servers Cloud Object Storage vSphere Replication Snapshots LUN Array A LUN LUN Array B LUN LUN
Device specific management Lack of VM awareness
Rigid SLAs management from LUNs
VMware Virtual SAN
Virtual SAN: Radically Simple Hypervisor-Converged Storage
vSphere + Virtual SAN
…
• Software-defined storage embedded in
vSphere
• Runs on any standard x86 server
• Pools HDD/flash into a shared datastore
• Managed through storage policy-based
management framework
• High performance through flash acceleration
• Highly resilient - zero data loss in the event of
hardware failures
• Deeply integrated with the VMware stack
The Basics Hard disks SSD Hard disks SSD Hard disks SSD
Virtual SAN Shared Datastore
Two Ways to Build a Virtual SAN Node
12
Completely Hardware Independent
1. Virtual SAN Ready Node
…with multiple options available at GA + 30 Preconfigured server ready to use Virtual SAN…
2. Build Your Own
…using the Virtual SAN Compatibility Guide* Choose individual components …
SSD or PCIe
SAS/NL-SAS/ SATA HDDs Any Server on vSphere Hardware Compatibility List
HBA/RAID Controller
⃰ Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page
Flexibly Configure For Performance And Capacity
Performance 2xCPU – 8-core 128GB Memory 2xCPU – 8-core 128GB Memory 2xCPU – 8-core 128GB Memory 1x 400GB MLC SSD (~15% of usable capacity) 1x 400GB MLC SSD (~10% of usable capacity) 2x 400GB MLC SSD (~4% of usable capacity) 5x 1.2TB 10K SAS 7x 2TB 7.2K NL-SAS 10x 4TB 7.2K NL-SAS IOPS1 Raw Capacity ~20-15K 6TB ~15-10K 14TB ~10-5K 40TB Capacity1. Mix workload 70% Read, 80% Random
Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)
Why Virtual SAN?
14
• Two click Install • Single pane of glass • Policy-driven
• Self-tuning
• Integrated with VMware stack
Radically Simple
• Embedded in vSphere kernel • Flash-accelerated
• Up to 2M IOPs from 32 nodes • Granular and linear scaling
High Performance Lower TCO
• Server-side economics
• No large upfront investments • Grow-as-you-go
• Easy to operate with powerful automation
Virtual SAN Components
• Virtual SAN components are chunks of
objects distributes across multiple hosts in a cluster in order to tolerate simultaneous
failures and meet performance requirements.
• Virtual SAN utilizes a Distributed RAID
architecture to distribute data across the cluster.
• Components are distributed with the use of two main techniques:
– Striping (RAID0)
– Mirroring (RAID1)
• Number of component replicas created is based on the object policy definition.
disk group disk group disk group disk group disk group
VSAN network VSAN network VSAN network VSAN network VSAN network vsanDatastore replica-1 replica-2 RAID1 HDD HDD HDD HDD HDD
vSphere + Virtual SAN
16
Simple to set up via policy
Delivered on per VM basis
Zero data loss in case of disk, network or host failures
Ensures zero downtime from disk or
network failures
Interoperable with vSphere HA and Maintenance Mode
Virtual SAN Is Highly Resilient Against Any Hardware Failure
Scale UP
Add more Disks
IOPS Capacity 40 TB 400 TB 4.4 PB Scale OUT Add more nodes Elastic
Grow or shrink on demand Granular
Add single nodes or disks Non-disruptive
No app downtime
Virtual SAN Enables Elastic Linear Scaling
of Performance and Capacity
No More Complex Forecasting & Large Upfront Investments
“Virtual SAN enables us to scale our storage infrastructure and while
providing the necessary redundancy. This allows us to be more agile and bring our solutions to market faster.”
— Frans Van Rooyen Cloud Architect, Adobe
Virtual SAN Delivers Enterprise-Grade Scale
182M
IOPS
3,200
VMs
4.4
Petabytes
Maximum Scalability per Virtual SAN Cluster
32
High Performance with Elastic and Linear Scalability
80K 160K 320K 480K 640K 253K 505K 1M 1.5M 2M 4 8 16 24 32 IOP SNumber of Hosts In Virtual SAN Cluster
Mixed 100% Read 286 473 677 767 805 3 5 7 8
Number of Hosts In Virtual SAN Cluster
Number of VDI VMs
VSAN All SSD Array
Notes: based on IOmeter benchmark
Mixed = 70% Read, 4K 80% random Notes: Based on View Planner benchmark
20
Two clicks to deploy!
Virtual SAN Simplifies Storage
Virtual SAN is Deeply Integrated with VMware Stack
Ideal for VMware Environments
vMotion vSphere HA DRS Storage vMotion vSphere Snapshots Linked Clones VDP Advanced vSphere Replication Data Protection VMware View Virtual Desktop
vCenter Operations Manager vCloud Automation Center
IaaS
Cloud Ops and Automation
Site Recovery Manager
Disaster Recovery
Site A Site B
Virtual SAN
Virtual SAN Puts The App In Charge
22
Simpler and Automated Storage Management Through Application-centric Approach
Today
1. Pre-define storage configurations
2. Pre-allocate static bins
3. Expose pre-allocated bins
4. Select appropriate bin
5. Consume from pre-allocated bin
1. Define storage policy
2. Apply policy at VM creation
Virtual SAN Shared Datastore
Resource and data service are automatically provisioned and maintained.
✖ Overprovisioning
(Better safe than sorry!)
✖ Wasted resources, wasted time
✖ Frequent data migrations
No overprovisioning
Less resources, less time
Easy to change
Virtual SAN Simplifies And Automates Storage Management
Per VM Storage Service Levels From a Single Self-tuning Datastore
Storage Policy-Based Management
Virtual SAN Shared Datastore vSphere + Virtual SAN
SLAs
Software Automates Control of Service Levels
No more LUNs/Volumes!
Policies Set Based on Application Needs Capacity Performance Availability Per VM Storage Policies
“Virtual SAN is easy to deploy, just a few check boxes. No need to configure RAID.”
— Jim Streit
Virtual SAN Reduces CAPEX and OPEX for Better TCO
24
CAPEX
• Server-side economics
• No Fibre Channel network
• Pay-as-you-grow
OPEX
• Simplified storage configuration
• No LUNs
• Managed directly through vSphere Web Client
• Automated VM provisioning
• Simplified capacity planning
As Low as $0.50/GB2 As Low as $0.25/IOPS 5X Lower OPEX4 Up to 50% TCO Reduction As Low as $50/Desktop 1 1. Full clones 2. Usable capacity
3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)
26
Management Clusters
Use Cases
Backup and DR Target
DMZ / Isolated Tier 2 / Tier 3
Test / Dev / Staging
Private cloud
Virtual Desktop
Small environments / ROBO
VDI
Site A Site B
vSphere
Why Virtual SAN?
• Two click Install • Single pane of glass • Policy-driven
• Self-tuning
• Integrated with VMware stack
Radically Simple
• Embedded in vSphere kernel • Flash-accelerated
• Up to 2M IOPs from 32 nodes • Granular and linear scaling
High Performance Lower TCO
• Server-side economics
• No large upfront investments • Grow-as-you-go
• Easy to operate with powerful automation
Introducing VMware EVO:RAIL
TMHyper-Converged Infrastructure Appliance Powered by VMware
VMware EVO:RAIL
•
EVO:RAIL software with vSphere and Virtual SAN technology is the key enabler
•
Single SKU procurement model creates design and price predictability
•
Simple, streamlined deployment and ongoing SDDC lifecycle management
•
One support call
VMware EVO:RAIL Offers Unique Customer Value
31
• Built on core vSphere that you already know and use
• Built with Virtual SAN • Highly resilient by design
• Compatible with existing VMware infrastructure products and
ecosystem
100% Powered By VMware
Choice of
Qualified EVO:RAIL Partner
• Broad and expanding partner ecosystem
• Support from your Preferred EVO:RAIL Partner
• Single SKU purchase for
hardware, software, and support
• Time to Value to first VM in minutes
• Simple configuration and management
• Automated scale out
• Non-disruptive patching and upgrade
Transformational User Experience
VMware EVO:RAIL Delivers Hyper-Converged Infrastructure
• Simplicity Transformed
– Power-on to VM creation in minutes, radically easy
VM deployment, one-click non-disruptive patch and upgrades, simplified management
• Software Defined Building Block
– Delivering compute, network, and storage resources
for server or desktop workloads
• Trusted Foundation – 100% VMware software
• Highly Resilient by Design
– Fault tolerance within and across appliances
• Infrastructure at the Speed of Innovation
– Simplify design with predictable sizing and scaling,
streamline purchase and deployment
• Freedom of Choice
2U/4-Node hardware platform optimized for EVO:RAIL
• 4 independent nodes for compute, network, and storage • Each node has dual processors & 192GB of Memory • Total of 16TB of Flash and HDD Storage via Virtual SAN
VMware EVO:RAIL Appliance
New
New EVO:RAIL Software Bundle
• EVO:RAIL rapid deployment,
configuration, and management engine • Compute, network & storage virtualization
with vSphere and Virtual SAN • VMware Support & Services (SnS) • Software bundle provided to qualifying
Per Node
• Dual Intel E5-26x0v2 6 core processors
• 192 GB memory
• 3 x 1.2 TB HDD
• 1 x 400 GB Intel SSD
• 2 x 10 GbE NIC port
• 1 x 1GbE management port
Per Appliance
• 48 CPU cores ~ 100 GHz
• 768 GB memory capacity
• 14.4 TB storage capacity
• 1.6 TB flash capacity
• 80 GbE network bandwidth
• Dual redundant power supplies
33
Configuration - Time to Value:
Power on to Creating VMs in minutes
Configuration - Time to Value:
Configuration - Time to Value:
Power on to Creating VMs in minutes
Easy VM Creation & Management
• Intuitive UI with simplified VM creation and lifecycle management
Easy VM Creation & Management
• Intuitive UI with simplified VM creation and lifecycle management
• Grid View of all the VMs across multiple appliances
Simplified Hardware Management
• Hardware Summary Status of each node, appliance, or cluster
• Warning and fault notifications
Zero-Downtime Patch and Upgrade Management
• Easy upgrade and patch with no workload downtime
– Full redundancy as each appliance has 4 independent nodes
• Updates pre-validated for the appliance before application
Ideal Environments for EVO:RAIL
• Virtual Desktop Solution
– POC and Pay & Scale as you grow
• R&D and Test Environments
– Tight budget for compute/storage; Quick deployment of infrastructure
• Remote/Branch Office Locations
– Data Center in a Box
• Private Cloud Infrastructure
– On-site cloud for employees or customers; Off-site co-located
• Limited IT staff
- Simplified, repeatable deployment/management
• Geographic Data Locality
– Limited footprint for in-country solution
42 ROBO Virtual Private Cloud VDI General Purpose
Global Reach and Customer Choice
43