The next step in Software-Defined Storage with Virtual SAN

The next step in Software-Defined

Storage with Virtual SAN

Today’s Challenge: Massive Increase in Storage

Demand & Complexity

4 24% 26% 28% 28% 31% 42% Manageme nt Complexity Provisioning Time/budge t Data Migrations Troublesho oting Meeting SLA

Most Pressing Storage Challenges M 20M 40M 60M 80M 100M 120M 2008 2009 2010 2011 2012 2013 2014 2015 2016 Terabytes Sold Terabytes Sold

Source: IDC, Yezhkova, Worldwide Enterprise Storage Systems Forecast, November 2013, #244293

Storage Growth

41% YoY

Storage Market in Midst of Disruption

Key

Drivers

Server flash

The Hypervisor Opens Up New Opportunities

• Knows the needs of all apps in real time

• Sits directly in the I/O path

• Global view of underlying

infrastructure

Object-based Pool SAN/NAS Pool Hypervisor Converged Pool

Leveraging The Hypervisor We Can Transform

Storage

• Today • Software-defined Storage

LUN Array A LUN LUN Array B LUN LUN Abstract and pool

(Virtualized Data Plane)

Automate SLAs via VM-centric policies (Policy-based Control Plane) VM level Data services

(Virtual Data Services)

VMware Virtual SAN

VMware Virtual SAN

• Storage scale out architecture

built into the hypervisor

• Simple cluster level feature tick

to enable!

• Aggregates locally attached

storage from each ESXi host in a cluster

• Dynamic capacity and performance scalability

• Flash optimized storage solution

• Fully integrated with vSphere

and interoperable:

• vMotion, DRS, HA, VDP, VR …

• VM-centric data operations vSphere + Virtual SAN

Hard disks Hard disks

SSD SSD SSD _{Hard disks}

…

Virtual SAN Shared Datastore

12,000+

95%

90%

Unprecedented Customer Interest And

Validation

Virtual SAN Simplifies And Automates Storage

Management

Per VM Storage Service Levels From a Single Self-tuning Datastore

Storage Policy-Based Management

Virtual SAN Shared Datastore

vSphere + Virtual SAN SLAs

Software Automates Control of Service

Levels

No more LUNs/Volumes!

Virtual SAN

Virtual SAN Puts The App In Charge

• Simpler and Automated Storage Management Through

Application-centric Approach

12

Today

1. Pre-define storage configurations

2. Pre-allocate static bins 3. Expose pre-allocated bins 4. Select appropriate bin

5. Consume from pre-allocated bin

1. Define storage policy 2. Apply policy at VM creation

Resource and data service are automatically provisioned and maintained. Virtual SAN Shared Datastore ✖ Overprovisioning

(Better safe than sorry!)

✖ Wasted resources, wasted time

✖ Frequent data migrations

 No overprovisioning

 Less resources, less time

 Easy to change

Virtual SAN Delivers Enterprise-Grade Scale

2M

IOPS

3,20

0

VMs

4.4

Petabytes

Maximum Scalability per Virtual SAN Cluster

32

Hosts

“Virtual SAN allows us to build out scalable heterogeneous storage infrastructure like the Facebooks and Googles of the world. Virtual SAN allows us to add scale, add resources, while being able to service high performance

workloads.”

— Dave Burns

Scale UP Add more Disks IOPS Capacity 40 TB 400 TB 4.4 PB Scale OUT Add more nodes  Elastic Grow or shrink on demand  Granular

Add single nodes or disks

 Non-disruptive

No app downtime

Virtual SAN Enables Elastic Linear Scaling

of Performance and Capacity

No More Complex Forecasting & Large Upfront Investments

“Virtual SAN enables us to scale our storage infrastructure and while providing the necessary redundancy. This allows us to be more agile and bring our solutions to market faster.”

Frans Van Rooyen, Cloud Architect, Adobe

Virtual Desktop

(VDI) Tier 2 / Tier 3 / Staging DR Target

• Rapid storage provisioning and complete automation • Ideal price/performance • Enables Cloud Architect to easily provision storage • Integrated with vSphere Replication and VMware SRM • Reduces cost of storage • Minimizes data center footprint • Handle peak performance requirements (boot, login, read/write storms) • Granularly scale from

POC to production without huge upfront investments

• Support high VDI density

Virtual SAN Use Cases

• Use Cases for Virtual SAN 5.5

Virtual SAN: Deeply Integrated with VMware Stack

16

Ideal for VMware Environments

vMotion vSphere HA DRS Storage vMotion vSphere Snapshots Linked Clones VDP Advanced vSphere Replication Data Protection VMware View Virtual Desktop vCenter Operations Mgr vCloud Automation Center IaaS

Virtual SAN Implementation Requirements

• Virtual SAN requires:

– Minimum of 3 hosts in a cluster configuration

– All 3 host MUST!!! contribute storage

• vSphere 5.5 U1 or later – Maximum of 32 hosts

– Locally attached disks

• Magnetic disks (HDD) • Flash-based devices (SSD) – Network connectivity • 1GB Ethernet • 10GB Ethernet (preferred) esxi-01

local storage local storage local storage

vSphere 5.5 U1 Cluster

esxi-02 esxi-03

cluster

HDD

Two Ways to Build a Virtual SAN Node

• Completely Hardware Independent

18

1. Virtual SAN Ready Node

…with multiple options available at GA + 30

Preconfigured server ready to use Virtual SAN…

2. Build Your Own

…using the Virtual SAN Compatibility Guide* Choose individual components … SSD or PCIe SAS/NL-SAS/ SATA HDDs Any Server on vSphere Hardware Compatibility List HBA/RAID Controller

⃰ Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page

Virtual SAN Disk Groups

• Virtual SAN uses the concept of disk groups to pool together flash

devices and magnetic disks as single management constructs

• Disk groups are composed of at least 1 flash device and 1-7 magnetic

disks

– Flash devices are use for performance (Read cache + Write buffer)

– Magnetic disks are used for storage capacity

– Disk groups cannot be created without a flash device

disk group disk group disk group disk group disk group

Virtual SAN Datastore

• Virtual SAN is an object store solution that is presented to vSphere as

a file system

• The object store mounts the VMFS volumes from all hosts in a cluster

and presents them as a single shared datastore

– Only members of the cluster can access the Virtual SAN datastore

– Not all hosts need to contribute storage, but its recommended

20

vsanDatastore

esxi-01

disk group disk group disk group disk group

Single VSAN datastore per cluster

Virtual SAN I/O flow – Write Acknowledgement

vsan network

vmdk vmdk

esxi-01 esxi-02 esxi-03 esxi-04

VSAN mirrors write IOs to all active mirrors, these are acknowledged when they hit the flash buffer!

witness

Destaging to HDD is done independently between hosts.

VSAN IO flow – Reads

vsan network

witness

esxi-01 esxi-02 esxi-03

Read Cache Write Buffer Magnetic Disks Read Cache Write Buffer Magnetic Disks

VSAN track of where IO resides and reads from where located

Read block 1 and 2. Block 1 is owned by esxi-01 and block 2

by esxi-03.

vmdk vmdk

1MB(1)

Virtual SAN Network

• New Virtual SAN traffic VMkernel interface.

– Dedicated for Virtual SAN intra-cluster communication and data replication.

• Supports both Standard and Distributes vSwitches

– Leverage NIOC for QoS in shared scenarios

• NIC teaming – used for availability and not for bandwidth aggregation.

• Layer 2 Multicast must be enabled on physical switches. – Much easier to manage and implement than Layer 3 Multicast

Management Virtual Machines vMotion Virtual SAN

Distributed Switch

20 shares 30 shares 50 shares 100 shares

uplink1 uplink2

vmk1 vmk2

vSphere + Virtual SAN

24

 Simple to set up via policy  Delivered on per VM basis

 Zero data loss in case of disk, network or host failures  Interoperable with vSphere

HA and Maintenance Mode

Virtual SAN Is Highly Resilient Against Any

Hardware Failure

Virtual SAN is Designed to Ensure Data is Never Lost in Case of Failures

vsan network

vmdk

vmdk witness

esxi-01 esxi-02 esxi-03 esxi-04

~50% of I/O ~50% of I/O

Virtual SAN Policy: “Number of failures to tolerate = 1”

 Installs in two clicks  Managed from vSphere

Client

 Policy-based management  Self-tuning and elastic  Deep integration with

VMware stack

Radically Simple

 Embedded in vSphere kernel

 Flash-accelerated

 Matches the VDI density of all flash array

 Best price/performance  100 kazillion IOps

High Performance Lower TCO

 Eliminates large upfront investments (CAPEX)  Grow-as-you-go (OPEX)  Flexible choice of industry

standard hardware  Does not require

specialized skills