Unified Storage for the Private Cloud
Dennis Chapman
NetApp
2012 Storage Developer Conference. © NetApp All Rights Reserved.
Data Center Transformation
2
Cloud
Business
Production
IT Production
Application-
Based Silos
Public Cloud
Zones of
Virtualization
Private Cloud
Storage Servers Apps
Network
Hybrid
Scale infrastructure and operations cost effectively
Higher service levels for business apps
Storage Choices (Physical server)
Local
Windows App Server Physical DAS Remote FC iSCSI SMB
Linux App Server Physical Local DAS Remote FC iSCSI NFS OS storage App storage OS storage App storage
2012 Storage Developer Conference. © NetApp All Rights Reserved.
Storage Affinities (Physical server)
Storage
Access
Windows OS
“C:\”
Windows App
data
Linux OS
Linux App
data
Local
DAS
Primary
Secondary
Primary
Secondary
Remote
FC
Limited
Primary
Limited
Primary
iSCSI
Limited
Primary
Limited
Primary
NFS
N/A
N/A
Limited
Primary
SMB
N/A
Secondary
N/A
N/A
Storage Choices (Virtual server)
iSCSI Windows App Server
Virtual Local vmdk file Remote SMB OS storage App storage App storage OS storage App storage App storage FC iSCSI Local DAS Remote NFS
Linux App Server
Virtual Local vhdx file Remote iSCSI NFS Local DAS Remote FC iSCSI SMB
2012 Storage Developer Conference. © NetApp All Rights Reserved.
Storage workload affinities
Storage
Access
Boot & swap
Linux OS
Windows OS
Boot & page
Linux App
Data
Windows App
data
Local
DAS Primary (P) Primary (P) Secondary (P) Secondary (P) Hypervisor Primary (V) Primary (V) Primary(V) Primary(V) Remote
FC Secondary (P) Secondary (P) Primary (P)
Primary (P4V) Primary (P4V) Primary (P) iSCSI Secondary (P) Secondary (V) Secondary (P)
Secondary (V) Secondary (P) Primary (V) NFS Secondary (P) N/A Primary (P)
Primary (V) N/A SMB N/A N/A N/A Secondary (P)
Secondary (V)
6
P – Physical app server
V – Virtual app server instance P4V – Hypervisor sourced storage
Distributed workload state
Workload Domain
• Application in-core buffers • Guest OS & file system state
Hypervisor Domain
• Guest scheduling and resources • VMFS and CSV state
Storage Domain
• Guest direct connect storage
2012 Storage Developer Conference. © NetApp All Rights Reserved.
Guest point-in-time consistency
8
Crash consistency
• Snapshot of a naïve guest’s storage resource Hibernation consistency
• Put the guest to sleep and then snapshot Application consistency
• Place the app in a backup state • Flush the file system and snapshot
Application specific APIs
Customized distribution and FS integration • SAN and/or NFS
Application specific APIs
Volume Shadow copy Service (VSS)
• Integrated NTFS and application backup snapshot • Remote VSS for SMB shares
Hypervisor PIT consistency
FC iSCSI Local DAS Remote NFS ESX vmdk files stored in NFS namespace Local DAS Remote FC iSCSI SMB Hyper-VClustered Shared Volume • Holds vhdx files
• Shared access across Hyper-V cluster
vhdx files stored in SMB namespace (WS2012)
Crash consistent
• Hypervisor domain snapshot of a naive guest
Application consistent
• workflow includes app integrated snapshot of vmdk/vhdx file(s)
Cluster File System VMFS • Holds vmdk files
• Shared access across ESX cluster
2012 Storage Developer Conference. © NetApp All Rights Reserved.
Primary affinity
Windows affinities and consistency
10
iSCSI Windows App Server
Virtual Local vmdk file Remote SMB FC iSCSI Local DAS Remote NFS Hypervisor sourced • Simple VM config. • Centralized app data
storage Hypervisor domain backups
• Application consistent with guest coordination
• Aggregation point for VM backups
Workload domain backups • Application consistent • VSS & R-VSS
Direct access
• Hypervisor independent backup/restore workflow • Distributed app data
Primary affinity
Linux affinities and consistency
Hypervisor domain backups • Application consistent with
guest coordination • Aggregation point for
VM backups
Linux App Server
Virtual Local vhdx file Remote iSCSI NFS Local DAS Remote FC iSCSI SMB Direct access • Hypervisor independent backup/restore workflow • Distributed app data
storage
• Strong acceptance of app data storage over NFS
Hypervisor sourced • simple VM config. • centralized app data
storage Workload domain backups
• Application consistent • Hypervisor independent • Guest specific integration
2012 Storage Developer Conference. © NetApp All Rights Reserved.
Storage Domain
12
Data ONTAP™ 8 Clustering
FlexVols
• Provisioned from underlying RAID storage by WAFL • Integrated snapshots and
replication Vservers
• Owns set of FlexVols
• Spans multiple physical nodes
• Logical interfaces (lifs) for end points
• Transparently migrate between nodes • Target for storage clients
• CIFS, NFS, FC, FCoE, and iSCSI • Management end point
Clone objects
• Encapsulated in FlexVol • Presented as LUN or file
Sample workflows
Create app consistent backup on guest
zapi
App integrated backup taken using VSS VSS LUN snapshot created on controller
iSCSI Remote
1. SCVMM layer sends request to Hyper-V
vhdx files stored in flat directory
R-VSS zapi
2. Create shadow copy set using file clone operations
\\vsa\sc_setA
3. SMB share rooted in sc directory Expose, modify, lock
\\vsa\vhd_shr
SMB share rooted in vhdx dir
Orchestration layer sends request to guest
Create shadow copies of a set of vhdx files using SMB
Remote SMB
2012 Storage Developer Conference. © NetApp All Rights Reserved.
NetApp – VMware Private Cloud
14
VASA Provider
Storage topology & capabilities
Events and alarms
SDRS guidance on capacity
Simplifies management
Enhances delivery of SLA guarantees
vCenter Plug-ins
Monitoring & host config
Provisioning & cloning
Backup & recovery
OnCommand Insight tools
OnCommand Chargeback
DR failover/failback w/ SRM 5
vShield
Secure resource & data isolation
VMware vCloud Director
VMware vCloud Director
vDC
vDC
vDC
vDC
VMware vCenter Server
VMware
vSphere
vCloud Director
Datastore provisioning (vCO plug-in for NetApp)
vCloud backup & recovery
vSphere VAAI
Full Copy
Block Zero
HW Assist Locking
Hole Punching
Thin Provisioning Suspend
vSphere
Storage I/O Control (SIOC)
Multi-pathing (ALUA)
Storage Array Type Plug-in (SATP)
2012 Storage Developer Conference. © NetApp All Rights Reserved.