What’s New in Storage and
Networked Storage
Enabling Next Generation and Virtual
Data Centers Today
What’s New in Storage and Networks
Enabling Next Generation and Virtual Data Centers
Presented by Greg Schulz Founder, Sr. Consulting Analyst
Author “Resilient Storage Networks” (Elsevier) The StorageIO Group
[email protected] www.storageio.com
What I Assume You Know
•
Storage, server and networking basics
•
Block vs. file (NAS) accessible storage
•
SAN, NAS and DAS storage
•
Performance – IOPs vs. bandwidth
•
Primary vs. secondary vs. tertiary
•
Trends and issues
•
What's the buzz
•
What to watch for
•
What you can do today
•
Closing comments
•
Q&A/Discussion
Agenda
Current Trends and Issues
Server to Storage Performance and Capacity I/O GapSee “Data Center I/O Performance Issues and Impacts” white paper at www.storageio.com
More data being generated and stored for longer periods of time!! Source: The StorageIO Group
Current Trends and Issues
•Threat risk challenges include:• Acts of man and acts of nature, human error • Aging infrastructures
– Hardware, software, networks, support personal
• Compliance, BC, DR and related requirements •Consolidation – Data centers, servers, storage
Current Trends and Issues
• Proliferation of:• Windows and NAS file servers • Servers, storage and SANs
• More data generated, copied and retained • Confusion regarding:
• Power, cooling and “Green wash” • Different forms of storage virtualization • Compliance is only for certain companies • SOHO vs. SMB vs. Enterprise vs. ROBO • Connectivity and data access options
IT Power & Cooling Fast Facts
• Data centers consumed 61 billion kWh in 2006• 2006 U.S. data centers used 1.5% of electricity
• IT power consumption about $4.5B USD in 2006
• On average 50% of IT electricity is for cooling
• 78% of CO2 tied to electricity generation
• Emissions will vary by type of fuel being used
(Western vs. eastern coal, petroleum and natural gas, hydro, nuclear, thermo, wind)
• 24 cubic foot refrigerator is 1.22 tons of CO2/year
• Gallon of gas generates about 20lbs of CO2
• Chevrolet Tahoe produces 7 to 10 tons of CO2/year
See free report “Analysis of EPA report to Congress (Law 109-431)” at www.greendatsstorage.com
•What are your power, cooling and energy concerns?
•Do you know your environment power consumption?
IT Power & Cooling Topics
Infrastructure Resource Management
Managing Resources For IT Service DeliveryInfrastructure Resource Management • Monitoring and reporting • Modeling and analysis • Resource usage and allocation • Performance and Capacity Plan • Provisioning and purposing • Diagnostic and resolution • Change & configuration validation • Data protection management • Facilities and asset management • Logical and physical security • Procurement and disposition
Data & Information Management
Device & Element Managers Cross Technology Domain
What's the buzz?
•PACE and data center footprint topics• Performance, availability, capacity and energy • Green IT initiative and “Green wash”
•Data footprint reduction
• Single instance storage (sis), de-duplication • Compression and compaction
• Archiving of files, email and database •Disk based data protection
• VTL / disk libraries, removable hard disk drives • Fireproof/waterproof disk drives for ROBO
What's the buzz?
•Networking (LANs, SANs, MANs, WANs, FANs) • 4GFC -> 8GFC and FCoE (FC on Ethernet) • IP storage including iSCSI & NAS (NFS / CIFS) • WiFi and WiMax being used for storage access • Network based managed backup services • Growing awareness of latency vs. bandwidth • InfiniBand gaining some ground
• I/O virtualization and virtual I/O • SAS/SATA continue to grow in adoption
Transport Encapsulate
Protocol SCSI Commands ECKD
iSCSI
Ethernet (802.x MAC & PHY)
FC-SB2
SRP
Fibre Channel InfiniBand
TCP IP iFCP TCP IP TCP IP FCIP FCP FCoE FC-4 FC-3 FC-2 FC-1 FC-0 FC-4 FC-3 FC-2 Applications FICON zOS Mainframe Open Systems
iSCSI vs. FCoE vs. Fibre Channel
iSCSI FCoE FC & FICON
FC Frames FCP FCP FICON FCP FCP FICON
FCoE has a data center focus Full-duplex lossless Ethernet Non routable - WAN via FCIP Physical Cable (Copper or Optical) 802.x Ethernet Fibre Channel TCP/IP IP Packets CIFS HTTP NFS FTP HTTP NFS Physical Cable (Copper or Optical) 802.x
Ethernet TCP/IP Physical Cable (Copper or Optical)
Fibre Channel FICONFCP
IP Based Network Fibre Channel SAN
FCoE = Unified Data Center Network
IP and Fibre Channel Co-existence
Separate Physical Networks
What's the buzz?
Hard Disk Drive (HDD) Storage TrendsWhat's the buzz?
•Storage devices and media• Improved reliability, lower cost and power • Larger capacity disk drives (3.5” 1TB SATA) • Smaller footprint -- enterprise 2.5” • Removable hard disk drives (RHDD) • High performance SAS (2.5” & 3.5”) disks • Tape and optical are alive with enhancements • Holographic storage is becoming available • FLASH & RAM SSD gaining momentum • Hybrid disks = Disk + FASH and/or RAM
What's the buzz?
•Storage virtualization (file, block and I/O) • Many different faces and locations
• Device emulation including virtual tape • Transparent data migration or movement
–Enable technology replacement and upgrade –Enable policy based automated data tiering • Heterogeneous data replication for BC/DR • Aggregation or pooling file systems or volumes
–Global name spaces, LUN pooling –Heterogeneous storage and file systems
Storage and File Virtualization
• Many difference faces of virtualization• Servers, storage, networks and I/O • Resource pooling vs. emulation • Plenty of myths and realities
• Abstraction, Emulation, Aggregation • Heterogeneous functionality
Storage (Block & File) Virtualization
Confusion, Miss-alignment, DisappointmentThe Good The Bad The Ugly
9Enable IT services
9Maximize IT resources
by balancing (PACE) performance, availability, capacity and energy resources
9Does not impede IT
service delivery
9No added complexity
or management cost
9Addresses various
functions and IRM related tasks
9Miss-alignment of
technology to tasks
9Using the wrong tool or technique for given task and function
9Miss-perception of what, where, when and how to deploy various forms of virtualization
9Can increase lock-in
9Increased complexity
9Management costs
9Limit interoperability
9Un-balanced resource
usage, poor service delivery, performance or scaling issues
9Disappointment from
improper expectations
9Confusion and FUD in
the market place
The Real Opportunity: Transparent Data Migration for block & file data!!!
What's the buzz?
• Data footprint = Your data + backup copies etc…
• Data footprint reduction
• Archiving (email, files, databases)
– Requires knowledge of data business value – Time consuming, requires technology and people
• Compression or compaction
– Host software, appliance or device based – Works across most applications and data types
• Single instance storage (aka de-duplication)
– Remove duplicate, repeating, recurring data or files – Stores a single copy or occurrence of data or file See free report “Business Benefits of Data Footprint Reduction”
at www.storageio.com/xreports.htm
What's the buzz?
Tape & Optical
SSD, FLASH, RAM, CACHE GB /k W h
IOPS or Bandwidth (Performance)/kWh
Tier-0
Tier-2 IPM & MAID1
Best
Balancing IT Resources Performance, Availability, Capacity & Energy (PACE)
$ / GB
$ / IOPS
1Some may impose performance penalty greater than tape
Tier-1 Worse Be st Wo rse Tier-3
What's the buzz?
• Security and data protection• Application and transactional aware
• Snapshots & CDP (continuous data protection) • Disk based backup instead of tape or optical • Storage for archiving or compliance • Data protection management (DPM) • Cross technology aware event correlation • Authorization and digital shredding
•Zombie technologies -- They still are practical
• Tape and the mainframe have been on the list • Fibre Channel & FICON declared dead long ago • Disk added to Zombie list (it has a future!!!) •Virtualization is where RAID was 15 years
ago
• Server, storage and I/O virtualization
• Stability and scalability issues being addressed • Business cases can be made around migration! • Align right technology to task at hand
What's the buzz?
WAN Local PIT Snapshots Switch 10Gb -> 40Gb & 100Gb Ethernet 4GFC -> 8GFC & FCoE Block based iSCSI LUNs \\Shared Vol001 Vol002 CIFS Windows NAS Share Servers Storage Tape Rotation
VMware ESX & VI3 Web Linux VM Email Windows VM File Windows VM SQL Windows VM \\Shared Vol001 Vol002
VMotion ESX Enabled Blade Servers
The Virtual Data Center Today
Replicate
What You Can Do Today
•Windows file servers and other NAS• Address proliferation of file servers • Deploy file discovery and analysis tools • Data footprint reduction and consolidation • Leverage global name spaces if applicable •Remote office branch offices (ROBO)
• Enable data protection, consolidation, DR/BC • Support remote “virtual” offices and laptops • Leverage remote backup, replication or WAFS
What You Can Do Today
• Data protection and retention (BC, DR, Archive) • Disk based data protection and archive
– Disk is a good fit for on-line and near-line – VTLs help bridge the gap for tape based processing – Tape still viable for longer term backup or archive
• Employ data protection management tools
– Look for business aware and cross domain tools – Leverage tools with event correlation analysis
• Enhance VMware with 3rdparty tools
– VCB with application aware snapshots
– Compliment VMotion with remote data replication
What You Can Do Today
• Data Security -- Logical and PhysicalWhat You Can Do Today
• Infrastructure resource management• Data protection and accessibility • Data migration for technology upgrades • Gain insight in to how resources are used • Virtual to consolidate, cluster to scale
• Maximize your power, cooling and green topics • Reduce your data footprint
– Single instance, compression, archive, de-dupe – Do more with what you have, data management
• Look at performance effective solutions
– Do more work with same or less watts (IOP/watt)
Closing Comments
•Continued shift from DAS to networked storage
•Storage and storage interfaces continue to evolve
•There are many facets to storage virtualizations
•VMware needs external storage for HA / BC / DR
•Reduce your data footprint and enhance security
•Several approaches exist to address power issues
•Futures are great, however, what exists today is what you can use today to address current issues!
For More Information
•
Resilient Storage Networks - Elsevier
•
www.storageio.com/portfolio.htm
• Free articles, tips, pod casts, reports, faqs
•
Various TechTarget venues
• SearchDataCenter, SearchStorage
•
I’ll be at the Ask-the-Expert booth
today at 12:30PM and via
QUESTIONS?
• Presented by: Greg Schulz, [email protected]
Author “Resilient Storage Networks” (Elsevier)
Founder , Sr. Analyst The StorageIO Group www.storageio.com +1 651-275-1563