VMware Software-Defined Storage & Virtual SAN 5.5.1

(1)

VMware Software-Defined Storage &

Virtual SAN 5.5.1

Peter Keilty

Sr. Systems Engineer Software Defined Storage [email protected]

@keiltypeter

May, 2014

Grant Challenger Area Sales Manager – East Software Defined Storage VMware, Inc.

[email protected]

(2)

The Software-Defined Data Center

Transform storage by aligning it with app demands

Management tools give way to automation Expand virtual

compute to all applications

Virtualize the network for speed and efficiency

2

(3)

The Software-Defined Data Center

Transform storage by aligning it with app demands

3

(4)

New Storage Tiers Are Rapidly Growing

Flash: Enables New Storage Architectures

• Flash is 50x – 2,000x faster than HDD

– 110K/140K IOPs R/W from 360GB MLC PCIe card¹

– Less than $0.10 per IOP

• Eliminates the need to stripe across 100s of HDDs

• Enables high performance server-side storage

Cloud: Enables Cost-Effective Storage

• Highly scalable, pay-as-you-go

• Access through standard APIs

• Low cost for capacity

– $0.05 per GB per month²

• Forecasted to grow at 40% annually to 2018³

4

Cloud Storage

1. Source: FuisionIO ioDrive2, Feb 2014 2. Source: Amazon S3, Feb 2014

3. Source: MarketsandMarkets Cloud Storage report -

http://www.marketsandmarkets.com/PressReleases/cloud-storage.asp

(5)

The Hypervisor Opens Up New Opportunities

5

SAN / NAS

x86 Servers Cloud Storage

vSphere

The virtualization platform:

• Knows the needs of all apps in real time

• Sits directly in the I/O path

• Global view of underlying infrastructure

• Hardware agnostic

(6)

6

2011-2013

2008-2010 2005-2007

VI 3.x

 VMFS

 Snapshots

 Storage vMotion

 NAS & iSCSI support

vSphere 5.x

 Storage DRS

 Profile-driven Storage

 VASA

 SPBM

 vSphere Storage Appliance

 vSphere Data Protection

 vSphere Replication

 vSphere Flash Read

vSphere 4.x

 Thin Provisioning

 Storage I/O control

 Boot from SAN

 VAAI

 Linked mode

2014+

Software-defined Storage

VMware Leads the Way to A New Approach

Software-Defined Storage represents the next step in Storage Evolution

• Virtual SAN

• VASA

• Storage Policy Based Management (SPBM)

• Virtual Volumes

(7)

Software-Defined Storage

7

Bringing the efficient operational model of virtualization to storage

Virtual Data Services

Data Protection Mobility Performance

Policy-driven Control Plane

SAN / NAS SAN/NAS Pool

Virtual Data Plane

x86 Servers Hypervisor-converged

Storage pool Object Storage Pool

Cloud Object Storage

Virtual SAN

VVOL VASA

(8)

VMware Virtual SAN 5.5

Radically Simple Hypervisor-Converged Storage

(9)

Virtual SAN Scale Out

esxi-01 esxi-02 esxi-03

SDD 1

Disk Group 1

HDD 1

SDD 1 HDD 1

esxi-04

Disk Group 1

(10)

SDD 1

Disk Group 1

HDD 1

SDD 1

HDD 1 HDD 2 HDD 3 HDD 4 HDD 5 HDD 6

Disk Group 1

HDD 7

Virtual SAN Scale Up - Capacity

(11)

Virtual SAN Enabled vSphere Cluster Scaled Up and Out 3 Hosts

(12)

(13)

2.2 Petabytes

1M IOPS

(14)

4.4 Petabytes

2M IOPS

(15)

Virtual SAN (VSAN) is NOT a Virtual Storage Appliance (VSA)

15

– Virtual SAN is fully integrated with vSphere (ESXi & vCenter)

– Drivers embedded in ESXi 5.5 contain the Virtual SAN smarts

– Kernel modules:

• Provide the shortest path for I/O

• Remove unnecessary management overheads when dealing with an appliance

• Do not consume resources unnecessarily

Virtual SAN – Embedded into vSphere Virtual SAN – Not a VSA

VSA

(16)

Virtual SAN: Radically Simple Hypervisor-Converged Storage

16

vSphere + Virtual SAN

…

• Software-defined storage embedded in vSphere

• Runs on any standard x86 server

• Pools HDD/flash into a shared datastore

• Managed through storage policy-based management framework

• High performance through flash acceleration

• Highly resilient - zero data loss in the event of hardware failures

• Deeply integrated with the VMware stack

The Basics

Hard disks

SSD SSD Hard disks

Hard disks SSD

Virtual SAN Shared Datastore

(17)

vSphere + Virtual SAN

17

 Simple to set up via policy

 Delivered on per VM basis

 Zero data loss in case of disk, network or host failures

 Ensures zero downtime from disk or network failures

 Interoperable with vSphere HA and Maintenance Mode

Virtual SAN Is Highly Resilient Against Any Hardware Failure

Virtual SAN is Designed to Ensure Data is Never Lost in Case of Failures

w

(18)

Maintenance Mode – planned downtime

 3 Maintenance mode options:

 Ensure accessibility

 Full data migration

 No data migration

(19)

19

Two clicks to deploy!

Virtual SAN Simplifies Storage

If You Know vSphere, You Know Virtual SAN

(20)

Simplified Provisioning For Applications

20

Storage Policy-Based Management

vSphere

Software Automates Workload Placement Policies Set Based

on Application Needs

Capacity

Performance

Availability

Per VM Storage Policies

Virtual SAN

External Array

Storage vMotion

1 2 3

4

Abstract and pool

(Virtualized Data Plane)

Automate SLAs via VM-centric policies

(Policy-based Control Plane)

VM level Data services

(Virtual Data Services)

Replication

Snapshots

(21)

Two Ways to Build a Virtual SAN Node

21

Completely Hardware Independent

1. Virtual SAN Ready Node

…with multiple options available at GA + 30 Preconfigured server ready to use Virtual SAN…

2. Build Your Own

…using the Virtual SAN Compatibility Guide*

Choose individual components …

SSD or PCIe

SAS/NL-SAS/ SATA HDDs Any Server on vSphere Hardware Compatibility List

HBA/RAID Controller

⃰ Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page

⃰ Components for Virtual SAN must be chosen from Virtual SAN HCL, using any other components is unsupported

http://www.vmware.com/resources/compatibility/search.php?deviceCategory=vsan

(22)

Flexibly Configure For Performance And Capacity

22

Performance

2xCPU – 8-core 128GB Memory

2xCPU – 8-core 128GB Memory 1x

400GB MLC SSD

(~15% of usable capacity)

1x

400GB MLC SSD

2x

400GB MLC SSD

5x

1.2TB 10K SAS

7x

2TB 7.2K NL-SAS

10x

4TB 7.2K NL-SAS IOPS¹

Raw Capacity

~20-15K 6TB

~15-10K 14TB

~10-5K 40TB

Capacity

1. Mix workload 70% Read, 80% Random

Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)

$0.32/IOPS

$2.12/GB

$0.57/IOPS

$1.02/GB

$1.38/IOPS

$0.52/GB

(23)

Broad Partner Ecosystem Support for Virtual SAN

23

Storage Server / Systems

Solution

Data Protection Solution

(24)

Virtual SAN is Deeply Integrated with VMware Stack

24

Ideal for VMware Environments

vMotion vSphere HA

DRS

Storage vMotion

vSphere

Snapshots Linked Clones

VDP Advanced vSphere Replication

Data Protection

VMware View

Virtual Desktop

vCenter Operations Manager vCloud Automation Center

IaaS

Cloud Ops and Automation

Site Recovery Manager

Disaster Recovery

Site A Site B

Storage Policy-Based Management

(25)

Observing performance

 Monitor performance:

 esxtop

 Performance Manager UI

 Ruby vSphere Console & VSAN Observer

 In-depth monitoring of VSAN’s physical disk layer performance, cache hit rates, latencies, etc.

 Deploy a separate VCVA appliance to use for the Observer

 Increase the data gathering time beyond the default (2 hours) if necessary.

(26)

High Performance with Elastic and Linear Scalability

26

80K 160K

320K

480K

640K 253K

505K

1M

1.5M

2M

4 8 16 24 32

IOPS

Number of Hosts In Virtual SAN Cluster Mixed 100% Read

305

508

803

3 5 8

Number of Hosts In Virtual SAN Cluster Number of VDI VMs

VSAN All SSD Array

Notes: based on IOmeter benchmark

Mixed = 70% Read, 4K 80% random Notes: Based on View Planner benchmark

Up to 2M IOPs in 32 Node Cluster Comparable VDI density to an All Flash Array

(27)

• Compared to external storage at scale

• Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)

• Additional savings come from reduced Opex through automation

• Virtual SAN configuration: 9 VMs per core, with 40GB per VM, 2 copies for availability and 10% SSD for performance

Granular Scaling Eliminates Overprovisioning

Delivers Predictable Scaling and ability to Control Costs

VSAN enables predictable linear

scaling

Spikes correspond to scaling out due to IOPs requirements

27

$40

$90

$140

$190

$240

500 1000 1500 2000 2500 3000

Storage Cost Per Desktop

Number of Desktops

$/VDI Storage Cost

Virtual SAN Midrange Hybrid Array

(28)

Virtual SAN Reduces CAPEX and OPEX for Better TCO

28

CAPEX

• Server-side economics

• No Fibre Channel network

• Pay-as-you-grow

OPEX

• Simplified storage configuration

• No LUNs

• Managed directly through vSphere Web Client

• Automated VM provisioning

• Simplified capacity planning

As Low as

$0.50/GB² As Low as

$0.25/IOPS

5X Lower OPEX⁴

Up to 50%

TCO Reduction As Low as

$50/Desktop

1

1. Full clones 2. Usable capacity

3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)

4. Source: Taneja Group

(29)

Virtual Desktop

(VDI) Tier 2 / Tier 3 / Staging DR Target

• Rapid storage provisioning and complete automation

• Ideal price/performance

• Enables Cloud Architect to easily provision storage

• Integrated with vSphere Replication and VMware SRM

• Reduces cost of storage

• Minimizes data center footprint

• Handle peak performance requirements (boot, login, read/write storms)

• Granularly scale from POC to production without huge upfront investments

• Support high VDI density

“VSAN is easy to use and will allow us to scale out a VDI environment using existing hardware without impacting our existing storage environment.”

—Joshua Stark

System Admin, OfficeMax

“Virtual SAN’s simple storage setup and ability to scale make it a

compelling technology for our Tier II and III workloads. Virtual SAN greatly reduces the complexity in managing storage compared to a traditional SAN or NAS.”

— Harry Le

System Admin, Travelocity.com

Virtual SAN Use Cases

29

Use Cases for Virtual SAN 5.5

“Virtual SAN allows us to build

geographically dispersed clusters in a metro area, allowing a level of

redundancy previously not available.

More importantly, Virtual SAN provides an unmatched TCO for private cloud infrastructures.”

— Dave Burns

VP of Tech Ops, Cincinnati Bell

Site A Site B

(30)

30

Management Clusters

Use Cases

Backup and DR Target

DMZ / Isolated Tier 2 / Tier 3

Test / Dev / Staging Private cloud

Virtual Desktop

ROBO

VDI

Site A Site B

vSphere VSAN

(31)

Why Virtual SAN?

31

• Two click Install

• Single pane of glass

• Policy-driven

• Self-tuning & Self-healing

• Integrated with VMware stack

Radically Simple

• Embedded in vSphere kernel

• Flash-accelerated

• Up to 2M IOPs from 32 nodes

• Granular and linear scaling

High Performance Lower TCO

• Server-side economics

• No large upfront investments

• Grow-as-you-go

• Easy to operate with powerful automation

• No specialized skillset

(32)

Additional Resources

32

Product Page

http://www.vmware.com/products/virtual-san/

VSAN Community

https://communities.vmware.com/community/vmtn/vsan VIP Tool

vip.vmware.com/salessignup Hands-On-Lab

http://vmware.com/go/vsanlab

Virtual SAN 60-day Free Evaluation

http://www.vmware.com/go/try-vsan-en Software-defined Storage Sales Team [email protected]

mylearn

• VMware Virtual SAN Fundamentals [V5.5]

• VMware Virtual SAN: Deploy and Manage [V5.5]

(33)

Thank You

Peter Keilty

Sr. Systems Engineer - East Software Defined Storage VMware, Inc.

603-498-3979

[email protected]

@keiltypeter

http://livevirtually.wordpress.com

Grant Challenger

Area Sales Manager – East Software Defined Storage VMware, Inc.

617-413-3113

[email protected]