DDN in Seismic Workflows

DDN in Seismic Workflows

October, 2014

Agenda

►

About DDN

►

Technology & Product Portfolio

DDN | About Us

►

Established: 1998

►

Revenue: $250M+ – Profitable, Fast Growth

►

Main Office: Sunnyvale, California, USA

►

Employees: ~650 Worldwide

►

Development Centers: Sunnyvale, Los Angeles, Colorado

Springs, Columbia MD, Minsk, Chennai

►

Worldwide Presence: 20 Countries

►

Installed Base: 1,000+ End Customers; 50+ Countries

►

Go To Market: Global Partners, Resellers, Direct

►

Smallest Deployment is 10s of TB, Largest is 10’s of PB

DDN is a Leader in Massively Scalable Platforms and

Solutions for Big Data and Cloud Applications

DDN | A Thriving, Global Channel

HPC Roots:

Foundation for Big Data Leadership

5

2000

DDN founded

Largest Private

Storage Co

.

First Real-Time Appliance

for High-Scale Big Data

Revolutionizing

Big Data

1

st

_Customer

NASA

1998

EXAScaler

TM

DDN’s First Parallel

File System Offering ft.

Lustre®

First in Data Center

Density

First Application-Aware

Hybrid Caching

SFX

Flash Tiering

First in Bandwidth + IOPS

First In-Storage Processing™

2009

First Hyperscale

Object Storage

2002

2005

2006

2008

2013

2014

100 GB/s

2012

1 TB/s

_PB/Rack

5



2/3

of the Top100

6

Product Portfolio: Three Strong Pillars

7

Platforms: SFA

• SSD, SAS, SATA

• Embedded F/S and Apps

• Storage and Processors

File Systems:

[x]Scaler

• Accelerating Time to Insight

• Scale in GB/s, IOPS, TB

• Mixed Workloads

Object Storage: WOS

• Collaboration and Global Distribution

Private and Public Cloud

DDN Integrated Portfolio

8

Public

Cloud

End-to-End Resource Management

Storage Fusion Architecture (SFA)

Software Stack

Accelerating Big Data and Cloud, Optimizing TCO

Over 1 Million Lines of S/W Code – First Customer Shipped 2008

Designed Specifically for Big Data and Cloud Workloads

Parallel State-Machine Design

Maximum Performance, Lowest

Latency

Virtualized Processing

Optimized Environment for Big Data

Application Hosting

Robust Data Protection

Quality of Service and Performance

Without Compromise

Flexible & Massively Scalable

Best-In-Class Scalability and Density

Storage Fusion Architecture™

[Core Storage S/W Engine]

In-Storage Processing™ Engine & DMA Driver

DirectMon™: Infrastructu

re Management

Low-Latency Connect: FC, IB, Memory

Real-Time, Interrupt-Free Storage Processing

ReACT™ Adaptive Cache Technology

DirectProtect™ Data Integrity Management

Quality of Service Engine

Storage Fusion Fabric™

Storage Fusion Xcelerator (SFX™) Flash Caching

EXAScaler™

Lustre

_Storage

GRIDScaler™

hScaler™

DDN SFA Feature Breakdown

High Density Array

Up to 840 HDDs in a single rack.

84 HDDs and SSDs in 4U

Storage Fusion Fabric

Highly-Over-Provisioned

Backend - RAIDed Fabric

Withstands Failures of Drives,

Enclosures, Cables, etc

DirectProtect™

Real-Time Data Integrity

Verification for every I/O

Drive Power Cycling to Eliminate

False Positives

ReACT Cache Management

Real-Time I/O Data-Aware Cache

Optimizer, Small IOs Go to Cache;

Large & Streaming I/Os Bypass Cache

SFA Embedded

(Optional)

Low-Latency KVM Environment

with Custom DDN DMA Memory

Drivers to Host File Servers and

Pre/Post Process Analytics

SFX Storage Cache

Automated and API-driven

caching system to enable

hybrid SSD & HDD pools

QoS Engine

Real-Time Quality of Service

for Read Operations

Real-Time, Multi-CPU RAID Engine

Full Implementation of Real-Time Storage

OS, Interrupt-Free; Massively Parallel I/O

Delivery System

DDN SFA | ReACT:

Real-Time Adaptive Cache Technology

Traditional Storage Caches Are Congested By

Competing Streaming and Random Workloads, Resulting

in Poor Performance In Mixed Workloads

High-Speed

Cache Link

Full Stripe

Cache

Partial Stripe

With DDN, Avoid write mirroring penalty, more headroom for random, unaligned I/Os

Battery-Backed

SFA L2 Cache

Battery-Backed

SFA L2 Cache

DDN SFA | DirectProtect™

Intelligent & Reliable Drive Management

►

Delivers Enterprise-class data protection at ½ the price

•

Makes large SATA pools reliable (not just less expensive)

•

Works on any class of disk drive

•

Ensures the data you wrote is the data you read, always

►

Key Features

•

Detects and corrects silent data corruption (PCOR & DIF Options)

•

Protects against double disk failures in each tier

•

Superior drive self-healing via automatic power cycling & partial rebuilding

•

Minimal impact during drive failure events

“

DDN Technology is preventative data protection. As our

data stores get bigger, the need for preventative data

Best-In-Class Performance

World-Leading IOPS, Throughput, Scale-Out & Latency

0 300 600 900 1200

HNAS 3200 OnTap 8.1 OneFS GRIDScaler 0 10 20 30 40 50 6616 VNX7500 e5500 SFA12K-40

Write

Read

0.0

0.5

1.0

1.5

Millions

Write

Read

System

R/W Latency

SFA12K-40

24 µs / 88 µs

Violin 6616

25 µs / 90 µs

Transactional Performance

Appliance IOPS

Streaming Performance

Appliance Bandwidth

Scale-Out Performance

File System Bandwidth

Best-In-Class Performance & Efficiency

Across All Dimensions, Ideal for

DDN Parallel File System Appliances

►

Easy-to-deploy

►

Scale-out storage for Big Data

►

Massively Scalable

►

Highest Performance and Density

Broadly Accelerating Big Data

Analytics...

1-Trillion Row

Big Data Queries

in less than 20s.

Best Runtime Ever

for Drug Discovery,

Warranty, Risk

Analytics

Up to 570% faster

FSI back-testing and

risk management

Enterprise Hadoop

With 200%-700%

Performance Gain

Validated By Industry Experts

Success Is Driven By The Growth in Big Data

16

2013 MarketScape Worldwide

Object-Based Storage Vendor Assessment

2013 Magic Quadrant for

General-Purpose Disk Arrays

DDN Is

The

Breakout Story

From

The 2013 Magic Quadrant

DDN Is A Recognized

Leader

In Object-Based Storage

Challengers

Leaders

DataDirect Networks

Fujitsu

Oracle

Huawei Technologies

NEC

Nexsan

AMI

Dot Hill

Infortrend

SGI

Promise Technology

EMC

NetApp

Hitachi

IBM

Dell

HP

Nimble Storage

X-IO

Coraid

Visionaries

Niche Players

Completeness of Vision

Ability

to

Execute

Capabilities

Stratagies

Web Object Scaler (WOS

®

)

Why Object Storage

17

True Object Storage

Online Archive

Collaboration

Data Protection

Publication

Cost-effectively archive data from 10s

of TB to 10s of PB; locally or remotely

Secure private & Hybrid cloud for

collaborative workflows

Configurable, efficient and automated

data protection

Publish results, data, products simply

and securely

Web Object Scaler (WOS

®

)

Software Stack

18

Enabling Real-Time Global Collaboration

Web-Scale, High-Performance Cloud Storage Appliances

99% Efficiency, Petabyte-Class Peer-to-Peer Object Storage

WOS API

C++, Java, Python,

PHP, HTTP,

HTTP CDN Caching

Android, iOS & S3

Multi-Tenancy

Layer

WOS Bridge

for GRIDScaler

& EXAScaler

WOS Cluster

Management

Utility

NFS & CIFS

ObjectAssure

®

_{Erasure Coding}

Replication Engine

WOS Policy Engine

De-clustered Data Management & Fast Rebuild

Self-Healing Storage Clustering with Intra-Node Failover

Latency-Aware Access Manager

WOS Core:

Peer-to-Peer Object Storage

User-Defined Metadata and Search

Limitless Scale and Speed

Eliminates Limitations of Traditional

File Systems - Access Data at

Millions of Objects per Second.

Scale to support 32 Trillion objects

Store Objects Intelligently

User-Defined Metadata Allows

Customers to Understand Their Data

Global, Peer: Peer

Distribute Data Across 64 Sites in

one Namespace

Self-Healing

Intelligent Data Management

System Recovers from Failures

Rapidly and Autonomously

WOS Feature Breakdown

19

Fully-Integrated Object

Storage Appliance

60 Drives in 4U

WOS7000 Nodes Support In-Node

Failover for Ideal HA*

Federated, Global Object

Storage Namespace

Supports Clustering of up to 8,000 Nodes

Across 64 Geographies, Replicate Data

With Smart Policies for Performance and/or

Disaster Recovery on a Per-Object Basis

Object Disk Architecture

Formats Drives With Custom Wos Disk File

System, no Linux File I/Os, no Fragmentation,

Fully Contiguous Object Read and Write

Operations for Maximum Disk Efficiency

Latency-Aware Access Manager

WOS Intelligently Makes Decisions on

the Best Geographies to get From

Based Upon Location Access Load and

Latency

User Defined Metadata and

Metadata Search*

Applications can Assign Their own Metadata via

Object Storage API, WOS now Also Supports

Simple Search of WOS User Metadata

DeClustered Data Protection

No Hard tie Between Physical Disks and

Data. Failed Drives are Recovered Through

Dispersed Data Placement—Rebuilds

Happen at Read, not Write, Speed

Rebuilding Only Data.

Flexible Data Protection

Chose Between Replication,

Erasure Coding or Both

REPLICATION AND/OR

ERASURE CODING

Cloud Scale & Economic

Paradigm Shift

20

$1

$2

$3

$4

$5

$6

Cloud Storage Acquisition

Costs ($/GB)

Total Cost of Ownership • 1PB, 5 Years

$1

$2

$3

$4

Traditional

WOS

Storage Acquisition Costs

($/GB)

Source: File Storage Costs Less

Economics ($M)

$3M in Savings

Over 5 Years

Economics ($M)

Amazon

WOS

10

20

30

40

50

60

EMC

WOS

Billi

ons

Performance

IME Delivers Extreme Application

Acceleration and Highly Efficient

I/O Provisioning



Decouples Performance and Capacity

in Physical Storage



Delivers Full Utilization of Compute

Processing Capabilities



IME is a Game Changer for Big Data

Workflows

IME Delivers Extreme Application

Acceleration and Highly Efficient

I/O Provisioning



Decouples Performance and Capacity

in Physical Storage



Delivers Full Utilization of Compute

Processing Capabilities



IME is a Game Changer for Big Data

Workflows

1,000x Application Acceleration



Run More Complex Simulations

Faster with less Hardware

Half the Latency of Flash Arrays



Optimizing Workload

Performance to Reduce

Time to Insight and Discovery

80% Lower Cost



Infinite Scalability; Provisions I/O

Performance With Highest Efficiency

IME:

Infinitely Extendable Non-Volatile Memory

The largest, application transparent memory

engine available for HPC workloads!

DATA CENTER EFFICIENCY

APPLICATION ACCELERATION

Infinite Performance Engine

Smarter Storage Performance Provisioning

►

Scale I/O and Bandwidth,

Without

Adding Drives to Your Storage Array

►

Purchase HDDs

Only for

Capacity Requirements

►

Faster Than All-Flash Arrays

and More

Economical

►

Fully Utilize the Capacity of all HDDs,

Reduce

Data Center

Footprint,

Components and Power

►

Standard I/O Interfaces with

no Custom

Coding Required

Infinite Memory Engine

Enabling Full Compute Performance Utilization

►

Reclaim 30%

of Your Compute Cycles

►

Liberate Compute and

Applications

From File

System Activities and Bottlenecks

►

Dramatically

Reduce

HPC Compute Costs

►

Reduce Quantity of Servers and

Networking

by Orders or Magnitude

►

Checkpoint With

1/10th the HDDs

and floor space

R&D Direction

23

Core

Converge and Simplify

DDN’s Storage and

Processing Platform

Cloud

Enable Global

Collaboration & Cloud

Scale

Private Cloud Tools &

MTDL Enhancements

Storage Class

Memory

Breaking through file

system scaling barriers

Radically new compute

architectures

Build the market-leading provider of massively scalable storage

and processing technology for unstructured & big data applications.