• No results found

Power-Managed Storage:

N/A
N/A
Protected

Academic year: 2021

Share "Power-Managed Storage:"

Copied!
34
0
0

Loading.... (view fulltext now)

Full text

(1)Power-Managed Storage: Gain Control of Your Growing Data (Longer Data Life and Lower Energy Consumption). Aloke Guha CTO, COPAN Systems LISA’06 December 8, 2006 Washington DC.

(2) Data Explosion More new information over the next 2 years than in all previous history. 100B - 2005. 93% of NEW content is born digital. Cave painting – 40,000 Writing - 3500 Paper - 105. 200. 50B - 2004. Printing - 1450 Electricity, telephone - 1870 Transistor - 1947 Computing - 1950. 12B - 2002. Gigabytes. 25B - 2003. BILLION GIGABYTES OF INFO. Internet – late 1960s The web 1993 6G 2001 COPAN Systems. 2.

(3) Waves of Power The Dynamics of Global Technology Leadership*. Numbers of Users (millions). 3,000. NETWORK CENTRIC. CONTENT CENTRIC. 1,000. PC CENTRIC 100. SYSTEM CENTRIC 10. 0 1970. 1980. 1990. 2000. 2010. 2020. 2030. *David C. Moschella “Waves of Power: Dynamics of Global Technology Leadership 1964-2010,” 1997 COPAN Systems. 3.

(4) Waves of Storage Architecture Monolithic Direct Attached Subsystems. Modular Network Attached Storage Environment. Dynamic Tiered Storage • Transactional • Persistent. Numbers of Users (millions). 3,000. NETWORK CENTRIC. CONTENT CENTRIC. 1,000. PC CENTRIC 100. SYSTEM CENTRIC 10. 0 1970. 1980. 1990. 2000. COPAN Systems. 2010. 2020. 2030 4.

(5) Data Center Storage Growth: Persistent Data ƒ Persistent Data: data that lives on long after it was first created Š Information captured or has aged to the point that it probably won’t be changed or modified Š Needs to be retained for future reference/access. ƒ Persistent Data (vs. Transaction Data) Š Š Š Š Š Š Š Š. Long-term Retention (vs. Short Shelf Life) Immutable (vs. Dynamic and Changing) Usually High Data Rates (vs. IOPs) Business Vital (vs. Business Critical) Event-Driven (vs. Random Read/Write) Data Integrity Reference Content Data Accumulation COPAN Systems. 5.

(6) Different Data–Different Needs 1.0. Transactional. Persistent Vaulted. DIFFERENT DATA DIFFERENT NEEDS. bab. Probability of Re-Use. Pro. Too Costly To Scale. f yo ilit - Us Re. A. m. nt u o. of. D. a. Poor Access. ta. e. Average Days Since Creation. 0 Days. 30 Days. 90 Days. 1+ Year. Recovery Time Required. Milliseconds. Seconds. Minutes. Hours. COPAN Systems. Forever Days. 6.

(7) Transactional & Persistent Data Transactional Data. Persistent data Characteristics. Characteristics ƒ ƒ ƒ ƒ ƒ ƒ ƒ. Highly Dynamic Short Shelf Life High IOPs Random Read/Write Information Capture & Creation Structured Data (mostly) Consistency Restrictions. Origin of Data ƒ ƒ ƒ ƒ. OLTP Data Base Apps ERP Email (current). ƒ ƒ ƒ ƒ ƒ ƒ ƒ. Immutable Long-term Retention Data Integrity Bandwidth Centric Event-Driven Reference Content Data Accumulation. ƒ. Origin of Data. ƒ ƒ ƒ. Backup/Recovery Aged Transactional Data Unstructured Data Applications (mostly) Image Capture/Store Record/Document Management Archive. { ƒƒ Data Migration { ƒ. Data Protection. Archive Data. {. Business Critical. Business Vital COPAN Systems. 7.

(8) Challenges of Persistent Data ƒ ƒ ƒ ƒ. Large Volumes: typically consumes 80% or more of all storage in the data center Growth: more data is being retained on disk – tape is used for vaulting Cost: CAPEX Infrastructure Strain: OPEX Š Energy: power and cooling – beyond servers and growing Š Reliability of long-term data – on traditional disk systems ⇒ Longevity – data migration/salvage/regeneration . . . ⇒ Footprint – data center floor space. COPAN Systems. 8.

(9) Growing Energy Concerns ƒ. Data center energy consumption growing out of control Š Š. ƒ. “. . . in 5 years, energy costs will consume up to 40% of IT budgets” Gartner, Nov 2006 “33% of data centers expect to be out of power and cooling capacity by end of ’07; 96% would be out of capacity by ‘11”. Data storage energy demands growing higher than that of servers Š Today costs are 20%-30% vs. over 30% for servers Š Expect storage energy costs to be at parity with server energy costs in few years Š Disk storage consumption growing exponentially Š Power consumption growing linearly. ƒ. Challenges in storage energy. Š Data storage growth (esp. for persistent data) much higher than server growth Š More data is persistent and is retained longer. Heat Density Trends “15% annual increase for servers, DASD (disk systems) and workstations.” (through 2010) “7% annual increase for tape storage (through 2005) The Uptime Institute Inc.: 2005-2010 Heat Density Trends in Data Processing, Computer Systems and Telecommunications Equipment (2006). ƒ 80% or more data retained for long-term: existing disk still consumes power ƒ More data needs to accessed online: regulatory, compliance, corporate governance. COPAN Systems. 9.

(10) Long-Term Data Reliability Concerns ƒ. More persistent data kept online for accessibility, protection, integrity, Š Backup/DR, Archive, etc.. ƒ. Most of the data are moved to lower-cost high capacity SATA drives Š SATA drives shipments to grow from 12.5% share in ‘04 to 52% of all TBs shipped in ‘09 (IDC June ‘05). ƒ. Retention period of data: 3 years to 7 years to 80 years to forever! Š Typ. warranty of disk systems < 3 yrs Š Failure rates of SATA lower than Fibre Channel that has lower shelf life. ƒ. MTBF (hrs) 8,000,000 5,000,000 3,000,000 2,400,000 2,000,000 1,200,000 1,000,000 800,000 600,000 400,000 200,000 100,000. AFR (%) 0.11% 0.18% 0.29% 0.36% 0.44% 0.73% 0.87% 1.09% 1.45% 2.17% 4.29% 8.39%. Disk Specification. Fibre Channel Fibre Channel SATA SATA. Limited published or empirical data on SATA drive failure rates COPAN Systems. 10.

(11) Current Tiered Storage Concept Tier I. Tier II. Tier III. Tier IV. Tier V. Enterprise Disk. Modular Array. ObjectBased File. Backup/ Recovery Online Recovery. Off-Site DR Vaulting. Mission Critical Business Critical Transactional High Cost Storage Transactional Support Storage. Low Cost SATA. COPAN Systems. Disaster Recovery, Off-Site Data. 11.

(12) Power-Managed Storage: MAID ƒ What is MAID? Š Š Š Š. Large number of power-managed disks More than 50% of drives powered off Power cycling by policy Lower management and environmental costs, and longer drive life. Powered ON Disk. ƒ Enhanced MAID for Long-Term Data Š Š Š. Š. Optimized: density and power – max 25% drives spinning Three-Tier Architecture ƒ Scales performance with capacity POWER MANAGED RAID® software ƒ RAID protection for powermanaged disks ƒ 1/3 cost of traditional disk DISK AEROBICS® software ƒ Disk reliability and data integrity. Powered OFF Disk. SNIA Definition “A storage system comprising an array of disk drives that are powered down individually or in groups when not required. MAID storage systems reduce the power consumed by a storage array.”. COPAN Systems. 12.

(13) New Tiering Using Enhanced MAID Tier I. Tier II. Enterprise Disk. Modular Array. Critical and Replicated Data. Lower Priority, NonReplicated Data. Tier III-IV MAID (Massive Array of Idle Disks) File Reference Information Regulatory Data. COPAN Systems. Online Recovery. Tier V Off-Site DR Vaulting Disaster Recovery, Off-Site Data. 13.

(14) The New Data Center Tiering. • Document Management. Transactional Data Protection. • E-mail. Primary • Tier 1 • Tier 2. - B/R: TSM - B/R: NBU - CDP. Data Replication - IPStor. • Database - ERP - CRM - MRP. Persistent. Email Archiving. Disaster Recovery. Vaulted. - Symc EV. Database Migration. - Oracle ILM. File Migration. - VxFS, SAM-FS. Doc Mgmt/ECM. • PACS • CAD/CAM. COPAN Systems. 14.

(15) Example:. COPAN Enhanced MAID Revolution 220A. Revolution 220T/220TX. Raw Storage Capacity. 28 TB to 448 TB. Raw Storage Capacity. 28 TB - 448 TB. Number of Shelves. 1 to 8. 1 to 8. Performance. Up to 5.2 TB per hour. Number of Shelves Performance. Up to 5.2 TB per hour. Host Interface. Up to 8 2Gbps FC. Number of Emulated Tape Libraries. Up to 56. Number of Virtual Tape Cartridges. Up to 8192. Power (448 TB). 4.9 KW. Host Interface. Up to 4x 1-GigE. File Protocol supported. CIFS/NFS Access. Features. Automated Archiving, WORM, Retention, Versioning. Number of Files Stored. 1 Billion. Power (448 TB). 4.9 KW. http://www.copansys.com *: COPAN’s MAID platform provides multiple personalities: Virtual Tape Library, File and Disk Block COPAN Systems. 15.

(16) Reducing Storage Energy.

(17) Growing Energy Concerns ƒ. Data center energy consumption is growing out of control Š Š. ƒ. “. . . in 5 years, energy costs will consume up to 40% of IT budgets” Gartner, Nov 2006 “33% of data centers expect to be out of power and cooling capacity by end of ’07; 96% would be out of capacity by ‘11”. Data storage energy demands growing higher than that of servers Š Today costs are 20%-30% vs. over 30% for servers Š Expect storage energy costs to be at parity with server energy costs in few years Š Disk storage consumption growing exponentially Š Power consumption growing linearly (areal density increase). ƒ. Challenges in storage energy. Š Data storage growth esp. for persistent data is much higher than server Š More data is persistent and is retained longer. Heat Density Trends “15% annual increase for servers, DASD (disk systems) and workstations.” (through 2010) “7% annual increase for tape storage (through 2005) The Uptime Institute Inc.: 2005-2010 Heat Density Trends in Data Processing, Computer Systems and Telecommunications Equipment (2006). ƒ 80% or more data retained for long-term: existing disk still consumes power ƒ More data needs to accessed online: regulatory, compliance, corporate governance COPAN Systems. 17.

(18) Power Density and Storage Density Comparison. Based on vendors’ currently published specifications. COPAN Systems. 18.

(19) Average Fortune 1000 Data Center • Ave. F1000 data center has 680 TB disk • 75% of this data is persistent. Typical F1000 Enterprise SAN Storage Growth (TB) 1600. • Typical mix of F1000 disk storage. Disk Storage (TB). 1400. • 60% Fibre Channel. 1200 1000. • 40% SATA. 800. • Ave. disk capacity growth rate: 230%. 600 400. • Stored data is doubling every 10 months since ‘05. 200 0 1H 2004. 2H 2004. 1H 2005. 2H 2005. 1H 2006. 2H 2006. 1H 2H 2007E 2007E. • At this rate, storage for average F1000 company will grow from 680TB in ‘06 to over 8PB by ‘09. Year. • 1 year of power + cooling costs for 8 PB = $10,000,000 • Cost for traditional disk systems • 60%/40% FC to SATA mix COPAN Systems. 19.

(20) Enhanced MAID vs. Traditional FC and SATA Storage Products Tier 1 storage (typ. Fibre Channel) and Tier 2 storage (typ. SATA) have low storage density and high power consumption compared to COPAN’s enhanced MAID. Power Density. COPAN. Tier 1. Tier 2. Percentage Improvement. 91.40. 4.08. 17.44. 2140% / 424%. 44.80. 3.62. 13.68. 1138% / 228%. (TB / KW). Storage Density (TB / sq. ft.). COPAN enhanced MAID platform: 4x to 30x better in power density than traditional Tier 1 / 2 storage 4x to 20x better in storage density than traditional Tier 1 / 2 storage. • The power consumption advantage of enhanced MAID systems is in its power density and can be measured in terms of capacity per unit of power, or TB/KW. • Enhanced MAID products maintain extremely low power requirements combined with massive density, which brings its power density to over 90 TB/KW. Ref.: A. Guha, Solving the Energy Crisis in the Data Center Using COPAN Systems’ Enhanced MAID Storage, COPAN Systems White Paper, November 2006. COPAN Systems. 20.

(21) Migrate Your Persistent Data to COPAN’s Enhanced MAID Scenario 1: 73 GB Fibre Channel drives and 500 GB SATA Before Migrating Data. 50% Migration to MAID. 75% Migration to MAID. Fibre Channel. 60%. 25%. 12.5%. SATA. 40%. 25%. 12.5%. 0%. 50%. 75%. Storage Mix. Enhanced MAID. Annual Savings with Migration to Enhanced MAID Migration From 73 GB Fibre Channel and SATA Disk. $8,000,000 $7,000,000. Savings ($). $6,000,000. Assuming that 50% to 75% of all data currently residing on Fibre Channel and SATA disk arrays is persistent and can be migrated to enhanced MAID*: If 50% of the data were migrated to enhanced MAID. $5,000,000 $4,000,000 $3,000,000 $2,000,000 $1,000,000 $0. •First year annual savings = $470,000 •Fourth year annual savings = $5,700,000 Year 1. Year 2. 75% on MAID 50% on MAID Year 3. Year 4. If 75% of the data were migrated to enhanced MAID •First year annual savings = $640,000. Year. •Fourth year annual savings = $7,800,000. *Based on average F1000 SAN-attached disk and $0.11 per KW-hour COPAN Systems. 21.

(22) Migrate Your Persistent Data to COPAN’s Enhanced MAID Scenario 2: 146 GB Fibre Channel drives and 500 GB SATA Before Migrating Data. 50% Migration to MAID. 75% Migration to MAID. Fibre Channel. 60%. 25%. 12.5%. SATA. 40%. 25%. 12.5%. 0%. 50%. 75%. Storage Mix. Enhanced MAID. Annual Savings w ith Migration to Enhance d MAID M i gra ti on From 146 GB Fi bre Cha nnel and SATA Di sk. Savings ($). $4,000,000 $3,500,000 $3,000,000 $2,500,000 $2,000,000 $1,500,000 $1,000,000 $500,000 $0. Assuming that 50% to 75% of all data currently residing on Fibre Channel and SATA disk arrays is persistent and can be migrated to enhanced MAID*: If 50% of the data were migrated to enhanced MAID •First year annual savings = $235,000 •Fourth year annual savings = $2,800,000. Year 1 Year 2 Year 3. 75% on MAID 50% on MAID Year 4. Year. If 75% of the data were migrated to enhanced MAID •First year annual savings = $322,000 •Fourth year annual savings = $3,900,000. *Based on average F1000 SAN-attached disk and $0.11 per KW-hour COPAN Systems. 22.

(23) Improving Long-Term Storage Reliability.

(24) Disk Failure Modes ƒ Multiple factors affect disk failure rates Factor Controlling Entity Effect on Annual Failure Rate (AFR) Disk Technology: HDD Drive Vendor: Recording Lower AFR expected with more mature platform maturity, etc. Technology, etc. quality HDD Platform Number of Platters per Drive Power Duty Cycle (POH) Ambient Temperature Vibration and Drive Handling I/O Workload. Drive Vendor: Areal Density, HDD Platform Storage System Vendor: Target Applications Storage System Vendor: Packaging, Cooling Storage System Vendor: Drive Packaging, Shi i Application/User. More platters/drive increases AFR at higher POH Increased POH and Power Duty Cycle increases AFR Higher ambient and operating temperatures increase AFR Increased Vibration and Shocks to Drive increases AFR Increased random I/O Access increases AFR. Ref.: A. Guha and S. Ouderkirk, “Disk Failure Rates and Implications of Enhanced MAID Storage Systems, COPAN Systems White Paper, April 2006. COPAN Systems. 24.

(25) Enhanced MAID Reliability POWER-MANAGED RAID® Software • Maximum of 25% of all drives are powered ON • All data is RAID protected independent of their power state • Contributes to increasing the service life of the drives. Powered ON Disk. Powered Powered ON Disk OFF Disk. Powered OFF Disk. Benefits ƒ Increased drive service life ƒ Reduced disk failures/time ƒ Power and cooling per TB ƒ The less the data is accessed, higher the service life and lower the power needs POWER-MANAGED RAID Software is a registered COPAN Systems trademark COPAN Systems. 25.

(26) Enhanced MAID Benefits: Longevity DISK AEROBICS® Software Provides continuous data verification by exercising and testing idle drives at least once every 30 days to ensure data integrity and drive health. Benefits ƒ Assures drive health and data integrity ƒ Predictive drive maintenance ƒ Avoids lengthy RAID rebuilds ƒ COPAN Enhanced MAID platform designed for 10+ years: reduces painful data migration and downtime. Standard SATA drives are designed to be powered on and off 50,000 times over the life of the drive. www.seagate.com/support/service/ - Reliability section - start-stop cycles specs at 50,000 DISK AEROBICS Software is a registered COPAN Systems trademark COPAN Systems. 26.

(27) DISK AEROBICS Software Features ƒ Designed to disk failures and improve data integrity DISK AEROBICS™ Feature. Benefit. Mechanism. Proactive monitoring and management of drives. Predictive Drive Maintenance. Monitors SMART parameters and environmental data. Periodic Exercise of Idle Drives. Assures Drive Health. Every idle drive powered-on and tested at least once every 30 days. Power Management. Extends Drive Life. Drives spin only when necessary to meet application requirements. Disk Scrubbing. Assures Data Integrity. Background task that identifies any bad sectors on disk and copies data to new sector on drive. Data Migration. Avoids lengthy RAID rebuilds and data loss for long-term data.. Proactive failing of suspect drives – copies all data to spare drive and “fails-out” suspect drive. Inserts new drive into RAID set.. COPAN Systems. 27.

(28) Drive Reliability Field Data The MAID Advantage in Terms of Hard Disk Drive (HDD) Reliability Field HDD MTBF Growth 4,000,000. 3,388,207. 82.185%. 3,500,000. Less HDD Failures 3,000,000. MTBF (hours). 2,500,000. 2,000,000. 1,500,000. 1,000,000. 500,000. 0 04/23/2004. 08/01/2004. 11/09/2004. 02/17/2005. 05/28/2005. 09/05/2005. 12/14/2005. 03/24/2006. 07/02/2006. 10/10/2006. Date COPAN Systems. 28.

(29) Drive Life and Reliability ƒ. POWER MANAGED RAID® software and DISK AEROBICS® software increase drive and data reliability Š Compared to standard SATA disk, enhanced MAID has < 1/5th failure rate Š Field MTBF: more than 5X SATA disks, almost 3X FC disks Š Service Life: expect almost 5X. ƒ. Disk Reliability and TCO benefits Š Per 1000 drives, expect only 3 drives to fail/yr vs. 15 drives with std disk systems ƒ Enhanced MAID: 0.26% failures/yr ƒ SATA: 1.45% failures/yr. Š Competitors have ƒ ~5X drive replacements ƒ 17 touches versus 1 touch for COPAN. ƒ. Significantly higher data reliability. COPAN Systems. MTBF (hrs). AFR (%). 8,000,000 5,000,000. 0.11% 0.18%. 3,388,207 3,000,000 2,400,000 2,000,000 1,200,000 1,000,000 800,000 600,000 400,000 200,000 100,000. 0.26% 0.29% 0.36% 0.44% 0.73% 0.87% 1.09% 1.45% 2.17% 4.29% 8.39%. Disk Specification. COPAN - Aug 2006. Fibre Channel Fibre Channel SATA SATA. 600K hrs = 68 yrs 3.39M hrs = 387 yrs. 29.

(30) Enhanced MAID Reliability: Summary ƒ Failure Rate: Enhanced MAID has less than 1/5th failure rate of traditional storage systems and improves and drive service life by more than 5X ƒ Data Reliability: Enhanced MAID platform provides significantly greater data reliability – 32X standard SATA and 8X over Fibre Channel ƒ Lower TCO: traditional disk storage will have 17 system touches vs 1 scheduled touch for drive replacement ƒ Longevity: derive longer data life as required for persistent data. COPAN Systems. 30.

(31) MAID for Persistent Data ƒ ƒ ƒ. Enhanced MAID: ideal Persistent Data Storage Platform Architecture and MAID OS tuned for Persistent Data Integrated storage services for Persistent Data application needs. Data Management. • Document Management • E-mail. Transactional. • Performance > 20%. Primary • Tier 1 • Tier 2. • Reliability > 5X • Footprint Svgs > 72%. • Database - ERP - CRM - MRP. • PACS • CAD/CAM. Vaulted. • Power Svgs >75% • TCO Svgs > 50%. Data Management COPAN Systems. 31.

(32) Enhanced MAID Impact Transactional. Persistent CREATING INCREMENTAL VALUE. Pro. A. m. nt u o. of. D. a at. Vaulted. bab. Probability of Re-Use. 1.0. s e-U fR yo ilit e. Affordable Storage Platform Direct Access Fast Retrieval Random Search Average Days Since Creation. 0 Days. 30 Days. Recovery Time Required. Milliseconds. Seconds. COPAN Systems. 90 Days. 1+ Year. Forever Days. 32.

(33) Conclusions ƒ Growth of retained data creating many challenges: energy, reliability, footprint . . . ƒ Persistent Data has different access needs not met by traditional disk systems ƒ Potential benefits of Enhanced MAID in F1000 data center Š Š Š Š. Energy Cost savings: > $500K/1st yr to $Ms later years Reliability Improvement: Disks by 5X, Data by 32X Footprint Savings: more than 80% Other benefits: Performance, Longevity, Cost . . .. ƒ What can you do? Š Be proactive: identify your persistent data and move it to MAID COPAN Systems. 33.

(34) COPAN Systems provides intelligent storage solutions that unlock the value of your longterm persistent data.. Thank You aloke.guha@copansys.com COPAN Systems. 34.

(35)

References

Related documents

In the earliest month of 2020 the international public health agency named World Health Organization announced sixth outbreak emergency of disease COVID-19 all

This act of nepotism contributes to the high rate of illiteracy by causing people not to go to school because they believe that even if they get educated, they

bankruptcy code, in which firms are not allowed to commit themselves ex-ante in their lending agreements either to (Chapter 7) liquidation or to (Chapter 11) reorganization in case

Quoting Jeyifo in Research in African Literature, Maduakor observes that Soyinka’s works have “an elaborate sub-structure of myth, ritual and symbolism which

Therefore, the Prince William County School Board supports legislation that would provide continued, ongoing annual funding to PWCS to coordinate the statewide management and

4:1 DSO report hourly metered data per metering point on production &amp; consumption.

This paper provides trends analysis and content analysis of studies in the field of WebQuest that were published in seven major journals: TOJET, Educational Technology &amp;

If the land possession is limited to local residents, cross-border commuting will increase the problem of an undersupply of the public activity, as an additional indirect