Choosing Right All-Flash-Array

(1)

Choosing Right All-Flash-Array

Aleksandr Shvadtshenko

Sr. Systems Engineer

(2)

INDUSTRY TRENDS – A FEDERATION PERSPECTIVE

HOW 5 TRENDS ARE INTERCONNECTED

Flash Trend

New Levels of Performance

COTS Trend

New Levels of Efficiency

Software-Defined Data Center Trend

Hybrid Cloud Trend

Next Generation Applications Trend

PaaS, Mobile, Hadoop

Converged Infrastructure Trend

2 Key Changes To

The Underlying

Storage Market

Elastic, Agile,

Data Center

Running Next

Generation Apps

Which Will Be

Deployed In CI

Which Will Be Used

As Building Blocks

Which Will Enable

(3)

0

1

2

3

4

5

6

7 Years Since Product Availability

(4)

• This research shows that

flash will become the lowest

cost media for almost all

storage from 2016 and

beyond, and that a shared

data philosophy is required

to maximize the potential

from both storage cost and

application functionality

perspectives.

Evolution of All-Flash Array Architectures

(5)

(6)

Why Flash?

Challenge #1:

• Latency

(7)

Why Flash?

Latency cause: CPU – HDD performance gap

2000

2010

2020

LATENCY

10000x

100x

_800x

CPU IS FAST AND GETS FASTER

(8)

Why Flash?

Solution: Flash will close the performance gap

2000

2010

2020

10000x

100x

_800x

CPU IS FAST AND GETS FASTER

(9)

(10)

The Evolution of “FLASH” Arrays

Flash Optimized Hybrids

• Dual Controller

• Limited Scale

• Single Workloads

• Some Data Services

Gen 2

Scale Up All Flash Arrays

• Dual Controller

• Limited Scale

• Single Workloads

• “Sometimes” Data Services

• Compromise Between

• Performance &

• Efficiency - Data Svcs

Gen 3

Scale Out All Flash Arrays

• Multi Controller (16-XtremIO)

• Petabyte Scale

• Mixed Workloads

• In-Line Data Services

• Lowest TCO

• Highest Performance

• All Flash Data Center

Gen 4

Gen

1 F

la

sh Sy

stems

L

e

g

a

cy

Di

sk

Arra

y

s

Gen 1

(11)

Changing Tides…

Gartner 2013 AFA Market Share

_{IDC 1H 2014 AFA Market Share}

Revenue ($M)

Share (%)

EMC

112.3

22.6 Pure

90.0

18.3 IBM

82.9

16.7 Revenue ($M)

Share (%)

EMC

1,575.8

35.5 NetApp

891.8

20.1 Hitachi

521.2

11.7

(12)

CONSISTENT & PREDICTABLE PERFORMANCE @ SCALE

(NO SYSTEM-LEVEL GARBAGE COLLECTION)

Why Architecture Matters: Key Ingredients

sub 1ms latency

Linear Scale IOPS & Capacity

Software-Defined

SCALE-OUT

Writeable Snapshots

Flash Data Protection

Deduplication

Thin Provisioning

Compression

Encryption

Data Reduction Efficiencies

Inline & Unstoppable

DATA SERVICES

HA/DR, Management, Converged

(13)

Avoiding Bad Design Choices

5 Common Things AFAs Borrow from Disk

Log Structuring

Metadata De-stage

RAID

Post-Process

Par ity Par ity Par ity Par ity

Uneven SSD wear

Performance inconsistency

SSD Wear - Write Amplification

Performance inconsistency

XTREMIO DOES NOT USE ANY OF THESE

(14)

14

XTREMIO DATA PROTECTION

• Designed for SSD

• No legacy RAID baggage

• Highly efficient- only 8% overhead

• Lowest write amplification

(15)

Array Controller

Typical AFA System Level Garbage Collection

• Huge back-end I/O amplification initiated by array controller

• Cannot defer process when array must free up space

(16)

XtremIO

Controller

XtremIO – No System Level Tax

• SSD controllers have ideal knowledge of the NAND

• Zero back-end I/O initiated by the array controllers

• No tax on array controllers

ASIC

Performed by Each SSD Controller ASIC

(17)

(18)

Why Customers Choose XtremIO

Consistent High Performance & Low Latency

Actual customer data | Workload: OLTP with 8KB Block Size

Traditional Flash Array

XtremIO ‘X-Brick’

Lat

en

cy

Latency Spikes

• 2-4.5ms = Gen 3 Flash

_{• Various latency spikes}

• <1ms = XtremIO

• Consistent & Predictable (~0.5ms)

Lat

en

cy

• 20-40ms = Gen 3 Flash

_{• Latency increases with capacity}

• <1ms = XtremIO

• Always Consistent & Predictable

System-Level Garbage Collection Impact

(19)

XtremIO X-Brick

Cluster Building Block

Active

Controller 1

Controller 2

Active

(20)

X-Brick 3

X-Brick 1

X-Brick 2

X-Brick 4

SHARED MEMORY METADATA

RDMA

FABRIC

Unique User Data

(21)

5–320TB physical, PBs effective capacity based on 10, 20, & 40 TB X-Bricks

NO TUNING

SCALE-OUT

<1ms LATENCY

RICH DATA SERVICES

Starter

5TB

Product Family,

On-Demand Linear Scale-Out

150K mixed IOPS

250K read IOPS

<1ms Latency

From 2 – 16 N-way Active Controllers

1.2M mixed IOPS

2M read IOPS

(22)

100% PERFORMANCE

Identical read IOPS

Identical write IOPS

Identical latency

INCREDIBLE SCALE

Instant application clones

to petabyte scale

100% OPTIMIZED

Identical data services

Always on, always inline

UNMATCHED

Use XtremIO where

all-flash arrays were never

before viable

100% IN-MEMORY

Any topology

Instant creation

Instant deletion

100% SPACE

EFFICIENT

No space reservations

No metadata bloat

(23)

Today’s Applications Environment

PRODUCTION

6 DATABASE

COPIES

3 ARRAYS/POOLS

1 USE CASE

FOR FLASH

(24)

Game-Changing Consolidation, Agility

1 XTREMIO CLUSTER

1 0

DATABASE

INSTANCES

0 BRUTE FORCE

COPIES

x

DEV INST 1 DEV INST 2 DEV INST 3 DEV INST 1 DEV INST 2 DEV INST 3

TEST/DEV COPIES

HIGH PERFORMANCE

PRODUCTION

FREE, FAST DEV/TEST

DATAMART COPIES

FIN COPY

OPS COPY

SALES COPY

FREE, FAST ANALYTICS

(25)

XtremIO Simplicity & Automation

1

CREATE

VOLUMES

2

CREATE

INITIATOR

GROUPS

Management Impact:

• Zero Planning & Tuning

• No storage skills

• No certifications

• Provision in seconds!

Integration:

• VMware vCenter

• EMC ViPR, ESA, ESI, SRM

• Microsoft Hyper-V

• App Consoles: Oracle, SAP,

System Center, etc

• REST API & CLI

3

MAP

(26)

XtremIO: Leading Use Cases

• Consolidate production,

dev/test,

BI/analytics/reporting

instances

• Solve the toughest SLA

challenges

• TCO savings across storage,

servers, app licensing

Database &

Business Apps

• Uncompromising user experience,

at scale and all desktop types

• Scale-out as VDI grows for

any mix of desktop types

• Lowest Opex & Capex,

<$100/Desktop

Virtual Desktops

& DaaS

• Private cloud mixed workload

consolidation

• Mission-critical app virtualization

• Application-as-a-Service

• Software Dev/Ops Infrastructure

• Cloud-scale TCO savings for

Capex and Opex

Cloud & Virtual

Servers

Infrastructure

Best User

Experience

Consistent

(27)

* The rates listed above are only examples and do not necessarily reflect real life values

Data Reduction Guidelines

Below are a few examples for data reduction rates:

Use Case

Dedupe Ratio

Compression Ratio

Data Reduction Ratio

VDI (full clones)

6:1 – 10:1

1.3:1 - 1.5:1

7.8:1 – 15:1

VDI (linked clones)

1.5:1

1.3:1 - 1.5:1

2:1 – 2.3:1

Virtual Servers

1.5:1 – 3:1

1.3:1 – 2:1

2:1 – 6:1

SQL Server

1.1:1

1.5:1 – 1.8:1

1.6:1 – 2:1

(28)

MAINTENANCE

PRICE

PROTECTION

7 YEARS

3-YEAR

MONEY-BACK

WARRANTY

2014-2017

FLASH

ENDURANCE

PROTECTION

7 YEARS

* For qualifying customers through December 31, 2015. See EMC.com/XpectMore for details, terms and conditions.

XPECT MORE PROGRAM

*

(29)

The Rise of Server SAN

(30)

2ND AND 3RD PLATFORM ARCHITECTURE

COTS, Storage Software

(31)

EMC SCALEIO

SOFTWARE-DEFINED, SCALE-OUT

Utilize commodity hardware for block

storage

Run storage and applications on the

same servers

Experience flexible & scalable

performance & capacity on demand

(32)

Hyper-converged architecture

ScaleIO

Compute

Network

Storage

ETH/IB

Flash | SSD | HDD | RAID Cache | RAM

(33)

Hyper-converged architecture

ScaleIO

2,250,000 IOPS

100 TB

Flash | SSD | HDD | RAID Cache | RAM

Bare Metal | KVM | VMware | Hyper-V

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

225K IOPS

10 TB

C

(34)

agnostic

Bare Metal

PCIe Flash

(35)

Mapping storage: RAW DEVICE or partition

(36)

Mapping storage: RAW DEVICE or partition

(37)

• Utility Distributed with SDS Windows Software

• Prepares a File to use in ScaleIO.

• .\create_file_storage.exe --create_file --size_gb 100

--file_name c:\scaleio1.bin

• Can be used in the CSV Deployment Manager

Mapping device: FILE WITH PREPARE_FILE utility

(38)

scaleIO hyperconvergance: resource utilization

ScaleIO architecture:

• Impact on server is below 10% CPU load

–

Usually far below

(39)

• Dynamically add, move, remove storage and compute

resources “on the fly” with no downtime

• Automatic volume rebuilds and rebalancing

• Mix

–

Server brands

–

Configurations

–

OS platforms (physical & virtual)

–

Devices

(SSD, HDD, PCIe, LUNs, partitions, files)

• No capacity planning required!

Automatic data rebalancing

(40)

• Auto-balance of resources across

nodes/clusters

• Auto-rebalance when resources are

added

• Auto-rebuild when resources fail or

removed

Elastic architecture

Add, remove, re-allocate, on the fly

BALANCED BALANCED BALANCED BALANCED BALANCED

(41)

Scalability

ScaleIO

• Scale to thousands of

nodes

• Add devices and servers

to increase capacity and

performance

(42)

PERFORMANCE Scales Linearly

ScaleIO

• ~31M IOPs is about 8X better than the latest high-end HDS storage

(G1000) for a fraction of the cost

• If we were to extrapolate the lines, we would get ~180M IOPs for

(43)

SUB-MILLISECOND LATENCY

ScaleIO

Typical read latency

figures with flash and

10GbE

Write figures are ~1.5X

to 2X

4KB: 304 usec

8KB: 344 usec

128KB: 778 usec

Measured from the

(44)

PERFORMANCE

MB/S

& IOPS

READS/

WRITES

VIEW AGGREGATE

CAPACITY

SCALEIO

NODE COUNT

• Automated installation scripts

and easy configuration

• Manage the entire data center

stack from single UI

• Monitor HW/SW failure

recovery—no administrative

intervention required

• Options: CLI, UI, REST, ViPR

Controller, ViPR SRM, vSphere,

OpenStack

System wide visibility, cost effective management at scale

(45)

Enterprise Grade

PERFORMANCE

INTEROPERABILITY

MONITORING

FAULT TOLERANCE

RESILIENCY

MULTI-TENANCY

PROTECTION

SECURITY

ELASTICITY

EFFICIENCY

SNMP &

Call Home

OpenStack &

vSphere

Data Masking

Protection

Domains & QoS

Controls

Flash Cache &

XtremCache

High Availability

Rack Level

RecoverPoint

(46)

Use Cases

ANY APPLICATION THAT USES BLOCK STORAGE

ANALYTICS

(47)

EMC ScaleIO node

• Bundled EMC commodity servers

and ScaleIO software

– Fully architected

– Simplified planning and building

(48)

SUPREME

ELASTICITY

MASSIVE

SCALABILITY

UNPARALLELED

FLEXIBILITY

EXTREME

PERFORMANCE

COMPELLING

ECONOMICS

30-60

%

TCO Savings

Up To

1k+

NODES

Scales To

EFFICIENCY

50 %

Over Traditional SAN

8x

ATTAIN

(49)

.Next Steps

Download

Free & Frictionless

_{version of ScaleIO}

Visit

EMC.com/ScaleIO

Join the ECN ScaleIO Product Community

Follow Us on Twitter @EMCScaleIO

where you’ll have access to

(50)

(51)

2ND AND 3RD PLATFORM ARCHITECTURE

COTS, Storage Software

(52)

ViPR CONTROLLER CLOAKS & MANAGES ALL

Control

Abstraction

Isilon

VMAX

VNX

VBLOCK

XtremIO

_ScaleIO

EMC

DIAMOND

GOLD

(53)

(54)

(55)