DIGITAL STORAGE
CONCERNS AND CONSIDERATIONS
BUSINESS DRIVERS – WHY DO THIS?
• Improve Product Safety
• Increase Manufacturing Quality / Yield
• Better Manage Component Vendor & Contractors
• Comply with Regulatory Requirements
• Mitigate Potential Liability
• Support Asset Maintenance & Lifecycle Initiatives
CONSIDERATIONS
• Volume
• Growth
• Retention
UNSTRUCTURED DATA GROWTH
2015
71 EB
75%
78%
80%
2016
106 EB
2017
133 EB
NDE DATA GROWTH
• RESOLUTION
• 3D
• MULTI-MODAL
• INCREASED SAMPLING
• LONGER RETENTION
• VIRTUAL/AUGMENTED REALITY?
SCALE-UP SYSTEM ARCHITECTURE
Flash drives
SAS drives
LCC
LCC
SPS
SPS
Power Supply
Power Supply
LAN
Near-Line SAS drives
Service Processor
Failover
Clients
Database
Servers
Exchange servers
Unified Storage
Application servers
SAN
Failover
VNX X-Blade
Service Processor
FILE
BLOCK
VMware and Hyper-V
FC
iSCSI FCoETBD
FC
iSCSI FCoEVNX X-Blade
VNX X-Blade
DataMover
10Gb Enet
10Gb Enet
TBD
SCALE-OUT ARCHITECTURE
OneFS Operating
Environment
Intra-cluster
Communication
Layer
Servers
Client/
Application
Layer
Ethernet Layer
Servers
Servers
CIFS
NFS
FTP
HTTP
HDFS
for
Hadoop
SCALE-OUT SYSTEMS
OneFS Operating
Environment
Intra-cluster
Communication
Layer
Servers
Client/
Application
Layer
Ethernet Layer
Servers
Servers
CIFS
NFS
FTP
HTTP
HDFS
for
Hadoop
ISILON AUTOBALANCE
EXPANDABILITY / UPGRADEABILITY
•
AutoBalance automatically moves content to new
storage nodes
•
No server, client mount point or application
changes
•
Eliminates “hot spots”
•
Enables unmatched storage capacity utilization
of more than 80%
EMPTY EMPTY EMPTY EMPTY EMPTY FULL FULL FULL FULL BALANCED BALANCED BALANCED BALANCED BALANCEDAUTOBALANC
E
Automated data balancing across nodes reduces
costs, complexity, and risks for scaling storage
CONSIDERATIONS
• Volume
• Growth
• Retention
• Risk of Loss
• Compliance
HIGHLY RESILIENT, CLUSTERED ARCHITECTURE
DATA PROTECTION AND AVAILABILITY
100% 100% 100% 100% 100% 100% 100% 100% FAILED FAILED
With N+2, N+3, and
N+4 protection,
data is 100% available
if multiple drives or
nodes fail
With N+1 protection,
d
ata is 100% available
even if a single drive
or node fails
And with Isilon, the
more nodes in the
cluster, the faster
drive rebuild time
LOCAL PROTECTION:
UNIFIED SNAPSHOTS
Redirect on Write
Storage Pool
A
B
C
D
D’
A’
Modify Data ‘D’
Source
Snap
Modify Data ‘A’
•
Provides point-in-time
snapshot copies of data
•
Snapshots provided for
both block and file
resources
•
Used as the foundation for
native asynchronous
replication on Unity
•
Local Replication:
NATIVE ASYNC REPLICATION (FILE &
BLOCK)
Source
Destination
•
Remote:
–
One to One (1:1)
–
One to Many (1:N)
–
Many to One (N:1)
Houston
Austin
Atlanta
Boston
S1
D1
D2
D3
S2
S3
FAST, EASY BACKUP AND DISASTER RECOVERY
ENTERPRISE DATA PROTECTION OPTIONS
WAN/LAN
Backup Isilon
Cluster
Primary Isilon
Cluster
•
Disk-to-disk backup
•
Remote archive and DR
•
Efficient snapshots with
SnapshotIQ
•
Data replication with
SyncIQ
•
Push-button simple
failover/failback
CORE
TIERING OF DATA
CLOUD PROVIDER
HOT DATA
>30 days
WARM DATA
1-2 Months
FROZEN DATA
1-2 years
APPS & USERS
SEAMLESS
CLOUD
INTEGRATION
CORE
CLOUD PROVIDER
SECURITY AND COMPLIANCE OPTIONS
LEGAL
IT
ACCOUNTING
MARKETING
•
Roles-based access control (RBAC)
•
Access Zones for secure isolation
•
WORM Data Protection
•
File System Auditing
•
Data at Rest Encryption (DARE) with
Self-Encrypting Drives (SEDs)
•
Security and Technical Implementation
Guide (STIG) hardening
•
CAC/PIV Smartcard authentication
CONSIDERATIONS
• Volume
• Growth
• Retention
• Risk of Loss
• Compliance
• Untapped Value
NEXT-GEN ACCESS METHODS
FILE
FILE
HPC
Backup/Archive
Analytics
Mobile
File Shares
Cloud Apps
In-place analytics
•
Native integration speeds time to insight
Enterprise data protection
•
Fast snapshots, backup, and data recovery
•
Simple, efficient data replication for disaster recovery
Lower costs
•
Eliminates the need for dedicated Hadoop infrastructure
•
Much more efficient than DAS-based approach
Increase flexibility
•
Simultaneous support for any Apache-compliant Hadoop distribution
•
Ambari integration for management, monitoring, and provisioning
THE ISILON ADVANTAGE FOR HADOOP
22 © Copyright 2016 EMC Corporation. All rights reserved.
Anticipate Growth
Start with storage architecture aligned to your Rhythm Archive objectives
Protect
Based on value/risk, implement proper data protection strategies
Maximize Efficiency
Tier data to lower-cost storage if rapid access not required
*
Extract Additional Information
Analytics to reduce cost and/or deliver additional value
Plan for the future
Enable easy tech refreshes and migrations
*
If regulatory compliance permits
SCALE-UP SYSTEM ARCHITECTURE
Flash drives
SAS drives
LCC
LCC
SPS
SPS
Power Supply
Power Supply
LAN
Near-Line SAS drives
VNX SP
Failover
Clients
Database
Servers
Exchange servers
Unified Storage
Application servers
SAN
Failover
VNX X-Blade
VNX SP
FILE
BLOCK
VMware and Hyper-V
FC
iSCSI FCoETBD
FC
iSCSI FCoEVNX X-Blade
VNX X-Blade
VNX X-Blade
10Gb Enet
10Gb Enet