Virtual Storage for Virtual Solutions
Kim Mortensen
© 2009 IBM Corporation
while IT budgets are growing less than 1% per year.
The demands placed on the data center have never been greater
32.6 millionservers worldwide
85% idle computer capacity
15% of servers run 24/7 without being actively used on a daily basis
Between 2000 and 2010 servers grew 6x (‘00-’10) storage grew 69x (‘00-’10) virtual machines grew 51%
CAGR (‘04-’10)
Internet connected devices growing 42% per year
1.2 Zetabytes (1.2 trillion gigabytes) exist in the “digital universe”
50% YTY growth
25% of data is unique; 75% is a copy
Data centers have doubledtheir energy use in the past five years 18%increase in data center
energy costs projected
Since 2000 security
time
time
Data continues to grow
So does Capex required
Capex available today/or
“Must be reduced by X%”
Operating costs keep rising
driven by more data to
manage
How can we manage this
growth and risk with less
Capex and Opex available?
Capex Budget
Understanding the business
issue
Do you buy cheaper storage
at the cost of compromised
service levels?
© 2009 IBM Corporation
Controlling storage cost
time
K
ro
n
e
r
Virtualised
Storage
De-duplication
Storage
Resource
Management
Archive
efficiency
IBM San Volume Controller (SVC)
Do you understand the benefits of
server virtualization ?
–higher utilization – less waste of capacity
–higher flexibility – right load on right hardware
–higher availability – real 24x7 environment
–independence of hardware – more choices
–...
Why not get the same benefits using
storage virtualization !
IBM SAN Volume Controller (SVC)
SAN
IBM
EMC
HDS
Sun
HP
Linux
UNIX
Windows
Virtual disks
With the SVC, hosts see one
type of disk
One device type
One multi-pathing driver
One management interface
Disks from different vendors
Different device types
Different multi-pathing drivers
In Band Storage Virtualization
Non-disruptive Data Migration with SAN Volume Controller
Traditional SAN
1. Stop applications
2. Move data
3. Re-establish host connections
4. Restart applications
SAN Volume Controller
1. Move data
Host systems and applications
are not affected.
SAN
SAN
Volume Controller
SAN
VirtualInfrastructure Simplification with SAN Volume Controller
Traditional SAN
Capacity is isolated in SAN islands
Multiple management points
Poor capacity utilization
Capacity is purchased for, and owned
by individual processors
SAN Volume Controller
Combines capacity into a single pool
Uses storage assets more efficiently
Single management point
Capacity purchases can be deferred until
the physical capacity of the SAN reaches a trigger point.
SAN
95% capacity
25%
capacity 50%capacity
SAN
SAN
Volume Controller
55% capacity
Business Continuity with SAN Volume Controller
Traditional SAN
Replication API’s differ by vendor
Replication destination must be the
same as the source
Different multipath drivers for each
array
Lower-cost disks offer primitive, or no
replication services
SAN Volume Controller
Common replication API, SAN-wide, that
does not change as storage hardware changes
Common multipath driver for all arrays
Replication targets can be on lower-cost
disks, reducing the overall cost of exploiting replication services
SAN
SAN
SAN Volume Controller IBM DSx IBM DSx EMC Sym EMC Sym FlashCopy PPRC TimeFinder SRDF IBM DSx IBM DS4x EMC Sym HP MA SVC IBM S-ATASpecifications
• Based on IBM System x3550 M3 server
• Intel® Xeon® 5600 2.53 GHz 4c processor
• 24GB of cache
• 8Gbps FC / 10Gbps iSCSI host adapters
Features
• Easy web based GUI
• Storage virtualization appliance
• Built in real-time performance monitoring
• VMware vStorage API for Array Integration (VAAI) and vCenter management support
• EasyTier and SSD support
• Thin Provisioning
• New engines may be intermixed in pairs with other engines in SVC clusters
• Mixing engine types in a cluster results in VDisk throughput characteristics of the
engine type in that I/O group
• Cluster non-disruptive upgrade capability for replacing older engines
IBM SVC node (2145-CG8)
Recovery from Storage failure (Advanced Setup)
Fully automated
Time needed
0 minutes
BOFM LUN1 LUN1' SVC 1 node A SVC 1 node B FC Long Wave Distance (10 km) E S X E S X E S X L in u x A IX W 2 k E S X E S X E S X L in u x A IX W 2 k VDisk Mirroring FilesystemsRecovery from SVC failure (Advanced Setup)
BOFM LUN1 LUN1' SVC 1 node A SVC 1 node B FC Long Wave Distance (10 km) E S X E S X E S X L in u x A IX W 2 k E S X E S X E S X L in u x A IX W 2 k VDisk Mirroring FilesystemsFully automated
Time needed
0 minutes
Recovery from Server failure (Advanced Setup)
BOFM LUN1 LUN1' SVC 1 node A SVC 1 node B FC Long Wave Distance(10 km) E S X E S X E S X L in u x A IX W 2 k E S X E S X E S X L in u x A IX W 2 k VDisk Mirroring FilesystemsBOFM
►Consistent
predefined tasks
independend of
Operating System
Time needed
2 – 5 minutes
Recovery from DataCenter failure (Advanced Setup)
BOFM LUN1 LUN1' SVC 1 node A SVC 1 node B FC Long Wave Distande (10 km) E S X E S X E S X L in u x A IX W 2 k E S X E S X E S X L in u x A IX W 2 k VDisk Mirroring FilesystemsBlade
►BOFM
►Consistent
predefined tasks
independend of
Operating System
►Time needed
2 – 5 minutes
Storage
►Fully automated
►Time needed
0 minutes
DataCenter (A)
DataCenter (B)
SAN
Volume Controller
SAN Volume Controller Version
Supported Environments
8Gbps SAN fabric
HP MA, EMA MSA 2000, XP EVA 6400, 8400 Hitachi Lightning Thunder TagmaStore AMS 2100, 2300, 2500 WMS, USP EMC CLARiiON CX4-960 Symmetrix Microsoft Windows Hyper-V IBM AIX IBM i 6.1 Sun Solaris HP-UX 11i Tru64 OpenVMS Linux (Intel/Power/zLinux) RHEL SUSE 11 IBM BladeCenterSAN
SAN Volume Controller Continuous Copy Metro/Global MirrorMultiple Cluster Mirror
VMware
vSphere 4
Point-in-time Copy
Full volume, Copy on write 256 targets,
Incremental, Cascaded, Reverse
Space-Efficient, FlashCopy Mgr Novell NetWare Sun StorageTek IBM DS DS3400 DS4000 DS5020, DS3950 DS6000 DS8000 IBM ESS, FAStT 1024 Hosts IBM N series NetApp FAS SGI IRIX IBM N series Gateway NetApp V-Series IBM TS7650G Bull StoreWay Fujitsu Eternus 3000 8000 Models 2000 & 1200 4000 models 600 & 400 NEC iStorage
For the most current, and more detailed, information please visit ibm.com/storage/svc and click on “Interoperability”.
Space-Efficient Virtual Disks
Entry Edition software
Apple Mac OS Pillar Axiom IBM XIV DCS9550 DCS9900 IBM z/VSE
SSD
Native iSCSI
Entry Edition SoftwareDistributed, Open Systems geneous Hetero-Mainframe, System i Enterprise Class Midrange
DS8000
• Solution for mainframe, I, & open systems platforms
• Disaster Recovery across 2 & 3 sites
• Secure encryption
• Continuous availability, no downtime for upgrades
• Extremely fast response times
DS5000
• Open systems • Cost efficient • Modular storageSVC
• Block level virtualization of multiple vendor environments, including IBM, EMC, Hitachi, Sun, NetApp, HP and othersXIV
• Next generation Storage
• Easy virtualized scalable
• Open systems support
• All inclusive software
• Build in migration Unified, NAS
SONAS
•Very large performance and TB demands •Integrated ILM •All inclusive softwareEntry
DS3500 / DCS3700
• Price • Flexible interface • Modular storageStorwize V7000
•Next generation Storage •Easy virtualized scalable
•Open systems environment support •Modular storage
•Build in migration
N series
• Combined NAS (file) and SAN
requirements • Simple two-site high
availability • Application affinity (Snap Manager) • Replication • Heterogeneous gateway
IBM System Storage™ DS3500 Express
6 Gbps SAS-based storage system
Featuring
Entry-level storage system featuring 6 Gbps SAS technology, midrange
performance, concurrent iSCSI/SAS or FC/SAS host connectivity, increased
scalability and enhanced features
Affordable entry-point with midrange performance, scalability and features
Green efficiencies reduce energy expenditures
Extensive suite of Microsoft and VMware solutions
Ease-of-use built into a powerful and intuitive management software
Multi-protocol connectivity support concurrent DAS / SAN
Enhanced security features provides relentless data protection
NEBs and ETSI support for ruggedized environments
IBM System Storage DCS3700
6Gb/s x4 SAS-based storage system
Introducing IBM’s Densest Storage Solution
Expandable performance, scalability and
density starting at entry-level prices
• New high density storage system designed for compute- and
bandwidth-intensive applications
• IBM’s densest disk system: 60 drives and dual controllers in 4U
• Scalability to 360TB per system (2TB drives) satisfies most capacity
requirements
• Modular design supports custom configurations to meet performance
or capacity requirements
• Superior serviceability and easy installation with front load drawers
• Bullet-proof reliability and availability designed to ensure continuous
high-speed data delivery
• IBM has combined highly available dense storage capabilities
and proven System Storage disk controllers in the DCS3700.
IBM Introduces a New Era in Midrange Disk Systems and Storage Efficiency
IBM Storwize V7000
"This announcement is most complete, most interesting, and
potentially most disruptive thing to come out of IBM's storage
group in the past twenty years. I can't wait to see the IBM
Storwize V7000 take shape in the market."
Steve Duplessie, Founder and Senior Analyst, ESG
"
Oct 2010
Modularity and Advanced Software Functions
2U
Proven
IBM software functionalities
Easy Tier (dynamic HDD/SSD management)
RAID 0, 1, 5, 6, 10 Storage virtualization
Non-disruptive data migration Global & Metro Mirror
FlashCopy up to 256 copies of each volume Thin provisioning
New
advanced software functions
New GUI (easy-to-use, web based)
RAS services and diagnostics
Built in real-time performance monitoring Integration with IBM Systems Director
VMware vStorage API for Array Integration (VAAI) and vCenter management support
Modular Hardware Building Blocks in 2U
Software inherited from prior offerings plus enhancements
2U Enclosures containing up to
twelve 3.5” or twenty-four 2.5” drives Dual active-active controllers
Up to nine expansion enclosures attach to one control enclosure
Mix drive sizes and HDD/SSD in enclosure Eight 8Gbps FC ports
Four 1Gbps iSCSI ports Four 10Gbps optional
Start Small and Grow Easily
Start small
One 24-bay control enclosure
G
ro
w
B
ig
Scale Up
Easily add up to 9 expansion enclosures Expand capacity up to 240TB Drive choices 2.5-inch (SFF) – 146GB 15K RPM SAS – 300GB 10K RPM SAS – 450GB 10K RPM SAS – 600GB 10K RPM SAS 3.5-inch (LFF) – 2TB 7,200 RPM NL-SAS Solid-State (SFF) – 300GB SAS
Scale Out
Cluster with another Storwize V7000
Expand capacity up to 480TB
Dynamically scale /
capacity
For high capacity applications such as archive, dynamically add capacity by adding disk enclosures.
or mix with additional performance
features
Many features are included.
Software is preinstalled in the system for easy setup.
Premium features are already installed.
Practice DR recovery
Automated failover / fail-back
Thin Provisioning Performance optimization Virtualization FlashCopy SAN Visualization Performance management Metro Mirror Global Mirror SCALABILITY
Virtualized Storage
All IBM Storwize V7000 storage is virtualized
– Enables rapid, flexible provisioning and simple configuration changes
– Enables non disruptive movement of data among tiers of storage, including Easy Tier – Enables data placement optimization to improve performance
Efficiently manage
technology upgrades and lease terminations by transparently moving application data from legacy disk arrays to the new system.
Reduce migration elapsed time from weeks or months to days MIGRATION
Transparent data
movement
Legacy Network Application serverFor Clients Who Need Migration and High Availability
Performance optimization
Analyze system performance and throughput.
Transparently rearrange the data to eliminate hot-spots and balance utilization of all components.
Hot-spots due to poor data layout. Optimized performance and throughput.
Transparent reorganization
Thin provisioning
Without thin provisioning, pre-allocated space is reserved whether the
application uses it or not.
With thin provisioning, applications can grow dynamically, but only consume space
they are actually using.
Dynamic growth
Busiest data extents are identified and automatically relocated to highest
performing Solid-state Disks
Remaining data extents can take advantage of higher capacity, price optimized disks
Hot-spots due to poor data layout. Optimized performance and throughput.
Automatic Relocation
EFFICIENCY
SSDs HDDs SSDs HDDs
IBM Easy Tier SSD Management
More productive use of available storage.
Across all supported host platforms.
Improve storage utilization by
Up to 256
FlashCopy
AVAILABILITY
Create instant application copies for backup or application testing.
Make better use of space with incremental (only changed blocks) or space-efficient (thin provisioned) snapshots.
Reduce space required for copies by 75% or more
Integrated, instant copy for critical applications
Virtually eliminate backup windows
Rapidly create clones for application testing
View inventory of application copies and instantly restore
FlashCopy Manager
Up to 256
Mirror data off-site
Synchronously over Metro distances.
Asynchronously over Global distances.
Application-level consistency groups.
Practice recovery procedures
For critical application consistency groups, freeze the Mirror and take a consistent FlashCopy.
Practice application recovery procedures from the FlashCopy.
Site-Switching Automation
Detect mirroring failure and automate failover to Recovery volume.
Execute practiced application recovery procedures.
Automate fail-back after repair.
BUSINESS CONTINUANCE Network Recovery practice volume Network Network Recovery volume
Visual task flow guidance Integrated video instruction System status always available System recommendations Link to more information if needed Getting Started Function Icons
New Easy-to-Use Graphical User Interface Hides Complexity
Virtualized Storage
All IBM Storwize V7000 storage is virtualized
– Enables rapid, flexible provisioning and simple configuration changes
– Enables non disruptive movement of data among tiers of storage, including Easy Tier – Enables data placement optimization to improve performance
External Virtualization
Storwize V7000 also virtualizes external Fibre Channel storage
– Capacity from existing storage systems becomes part of Storwize V7000 system – Single user interface to manage all storage, regardless of vendor: improves
productivity by up to double
– Virtualized storage inherits all Storwize V7000 rich function including FlashCopy, Easy Tier, and thin provisioning
– Helps improve existing storage utilization
– Improve availability by practically eliminating storage-related causes of application downtime
– Migrate data from external storage to Storwize V7000 storage or keep external storage as part of Storwize V7000 system long-term
– Extends life and enhances value of existing storage assets
– Supports storage systems from IBM, EMC, HP, Sun/Oracle, Hitachi, NetApp, Fujitsu, Bull, Compellent, NEC, Pillar, and more
Storwize V7000
Solutions at a Glance
External Virtualization
For smaller clients looking for
easy-to-use, scalable storage with intelligent
support for their business applications
IBM offers an integrated solution formed
from extraordinary building blocks
– Scalable storage
– Efficient utilization of space
– Application-integrated data protection
– Simple manageability
– Virtualization of external disks
Backup path Restore path Primary data Local FlashCopy Versions Instant Restore . . . SSD/SAS Disks Thin Provisioning, Easy Tier iSCSI/FC User interface FlashCopy Manager Application server
Storwize V7000
Solutions at a Glance
External Virtualization
For clients looking to expand
the intelligent support for
their business applications
across sites for disaster
recovery protection
IBM offers
– Fibre Channel Mirroring
– Enterprise SAN-wide
management
Backup path Restore path Primary data Local FlashCopy Versions Instant Restore . . . SSD/SAS Disks Thin Provisioning, Easy Tier iSCSI/FC User interface FlashCopy Manager Application server FC Mirroring (Sync or Async) (SAS/NL-SAS) Productivity Center FlashCopy Manager Or FastBack agentStorwize V7000
Solutions at a Glance
ProtecTIER deduplication gateway Storwize V7000 External Virtualization Productivity CenterFor clients looking
to integrate with
enterprise recovery
management or to
extend these
solutions to data not
currently stored on
Storwize V7000
IBM offers
–
Application-integrated software
snapshot for
external data
– Unified recovery
management with
Tivoli Storage
Manager
Backup path Restore path Primary data Local FlashCopy Versions Instant Restore . . . SSD/SAS Disks Thin Provisioning, Easy Tier iSCSI/FC Application server FC Mirroring (Sync or Async) FlashCopy Manager Or FastBack agent Application data FastBack agent TSM Admin CenterIncreased storage utilization
– Improve disk utilization by up to 30% with thin provisioning and virtualization – Reduce the amount of storage required for snapshots by 75% or more
Improved storage administrator productivity
– Improve administrator productivity up to 2 times with easy to use GUI and virtualization – Performance optimization automation improves administrator productivity
Increased application performance
– Application throughput improved up to 3 times, up to 60% improved response time with Easy Tier – Meet or exceed application performance levels with spot analytics
– Faster solution of performance issues with hot spot resolution recommendations
Increase application availability
– Minimize application downtime with online data migration
– Easy integration with applications: IBM DB2, Oracle, SAP, Microsoft Exchange and SQL Server – Reduces application downtime required for backup to seconds
– Reduces application downtime for data restores
– Improve data protection by 95% with hourly snapshots
Cut implementation time in half with little or no impact to storage administrator staff
– Little or no impact to storage administrator staff – Improve speed of return on investment
IBM Smarter Systems for a Smarter Planet
Extreme virtualization with massive scalability and advanced security
IBM System z™ IBM System Storage™ IBM Power™ Systems IBM BladeCenter® IBM System x™ Highly scalable storage virtualization for SAN and NAS environments
Highly integrated, fully redundant, energy efficient with advanced I/O Dynamic resource allocation with
advanced mobility for AIX, Linux & IBM i OS
More workloads consolidated on fewer servers with exceptional reliability IBM Systems Director
IBM Data Center Networking High performance links
connecting to virtual and converged networks
Manage your entire datacenter, physical and virtual,