Addressing Key Storage
Objectives
LTO Ultrium 5 Technology
and
3
Agenda
Storage Issues
Best Practices – Unveiling the Facts
–
Addressing performance, data protection and
retention objectives
Overview - LTO-5 Technology
4
Storage Issues……Objectives
Data is growing faster than I can manage
Not all data is alike
Costs are out of control
Data is vulnerable to corruption threats
My backup repository is growing
Must protect and preserve
data assets
5
2.5 billion RFID tags sold in 2009
900 million GPS devices sold
annually by 2013
76 million smart electric meters in
2009. 200M by 2014
Text messages generate 400TB
of data daily in the U.S.
MRIs will generate a petabyte of
data globally this year
2000 2005 2010 2015 Terabytes Petabytes Exabytes Zettabytes Gigabytes Storage budgets up 1%-5% in 2010
The information explosion meets budget reality
Storage requirements growing 20-40% per year Backup and Archive requirements
growing 40-50% per year
7
Storage Hierarchy Balanced Diet
DRAM Cache Solid-State Drives (SSD) Phase Change Memory
FC and SAS disks SAN
Tape
SATA disks Virtual Tape NAS/iSCSI
Build out automated
tiered storage
architecture to
optimize
performance,
protect data
and reduce
costs
Rec o v e ry T ime Ob je c ti v e (gu ide lin e s o n ly) S ec on ds Mi nu tes Mi nu tes Hours . Hours Day s Mission Critical Dynamic Data
Active Online Data
Nearline-Arcchive Data
Not All Data Should Be Treated the Same Way
Disk and DB Mirroring
Electronic Vaulting / Replication
Tape Storage
Value of Data / Financial Investment
Time Value of Data Determines RTO
And Storage Hierarchy Tiers
9
Most Network Data Sits Untouched
90% Never Accessed Accessed <5 Times Accessed >5 Times Accessed Once 90% Never Accessed Accessed Once Accessed <5 Times Accessed >5 Times
Source: Government Computer News, July 1, 2008. “Most network data sits untouched” by Joab Jackson
Three month study of a businesses 22TB disk data access Conducted by University of California, Santa Cruz
90% of the data was COLD - never accessed after being stored on disk Another 6.5% of the data was COOL - accessed only once
U of C recommendation: move data to less expensive and less energy consuming storage units ….. Use Tape!
Numerous Threats Can Corrupt and Destroy Data
ACCIDENTAL
•Natural Disaster
•System Error
•Operation Error
INTENTIONAL
•Virus
•Theft
•Hacker
•Sabotage
•Disgruntled
employee
Risks of downtimeLost revenue and market share Lost productivity
Non-compliance
Loss of reputation and customer trust Loss of the business
• More than a quarter of the companies in
a Forrester Research study declared a
disaster in the past five years1
• 76% of companies have experienced a
disaster or major business disruptions1
11
Tape Saves the Day…Provides Offline Protection
Ben Treynor, VP Engineering and Site Reliability Czar for
Google Gmail, used the official Gmail blog to explain the
situation where some users lost access to their email
accounts during a software update that was buggy.
“I know what some of you are thinking:
how could this
happen if we have multiple copies of your data,
in
multiple data centers...well, in
some rare instances
software bugs can affect several copies of the data.
That’s what happened here. Some copies of mail were
deleted...
To protect your information from these unusual
bugs, we also back it up to tape
.
Since the
tapes are
offline, they’re protected
from such software bugs”.
13
Flood – Brisbane, Australia - January 2011
March 2011: Japan is Devastated
Protect Data - Out of Region
Agenda
Storage Issues
Best Practices – Unveiling the Facts
–
Addressing performance, data protection and
retention objectives
Overview - LTO-5 Technology
15
Best Practices in Data Protection
Have multiple copies or layers of protection:
depending upon value
of data, keep at least 3 copies, keep in different locations; one out of
region – Use disk and tape
Isolate one copy:
at least one copy offline for logical system isolation to
avoid intentional or unintentional corruption that can occur with online
storage - Use tape; Keep offline
Have technology diversification:
copies on different forms of media to
avoid a media or system process disaster - Use disk and tape
Protect access to data:
at rest and in transit –
Use encryption & WORM
Manage backup differently than archive:
–
Backup multiple, point in time consistent copies for operational and
DR recovery consistent with application specific RTO/RPO - Use disk
and tape
–
Archive single instanced data for long term retention: combination of
disk & tape
Large Truck Express Line Survives Hurricane Flood
Business Challenge:
• Hurricane Gastone flooded Data Center with 5 ft. of water • Total loss of hardware, networks, phone systems,
generator, and utility power
• Good news: a tape backup of 100% of the data was made the night before – stored off site!
Solution:
• Protect assets and business resilience with comprehensive best practice strategy • Create nightly disk flash copy for fast retrieval and window-less backup to tape • Backup 100% production data to LTO tape library nightly: tapes moved offsite • Global Mirror DR site and backup to LTO tape library – Lights out!
• Creates 5 copies of data (2 offline on tape in different remote locations)
Benefits:
•Able to control TCO, access data and protect data with tiered storage strategy •No production system interruption
•No save window-Set it & forget it
•No production cycles, no operators, lights out operations •Logical data protection and out of region protection
Dick Crosby Systems Manager, Estes
"You are out of your mind if you think you can live
without tape" Implements Best Practice Data Protection and Retention Systems
17
“The reports of
tapes
demise are
grossly exaggerated,
”
(borrowing a phrase from Mark Twain)
“Tape is cheap, safe and reliable and there is no
substitute….the archive data backstop.
It is the data centre's lifebelt and lifeboat.
Without it, when the data loss/data corruption
storm strikes, you are sunk. It's that simple.”
0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 P e ta b y te s LTO 5 DAT 320 DAT 160 VS 160 SDLT S4 SDLT II SDLT I LTO 4 LTO 3 LTO 2 LTO 1 DLT IV DDS-4 DDS-3 Dat 72
Tape Storage Continues Phenomenal Growth
•A total of 6.6M cartridges shipped in Q4 2011, nearly 90% LTO
•8% YtY Tape Growth
•LTO-5 tape continues to be the rising star of the tape market
-Q4 2011 Shipments up 19% quarter on quarter
-LTO-5 shipments up over 93% YtY Quarterly
82.6% of respondents are still using tape as their
final destination for backups
19
It’s reliable high speed and capacity
–
Streams very fast and stores high capacity
–
Read after write verification for reliable writes
–
Servo tracking to help ensure precision tracking
–
Better bit error rate than disk!
1x10E17 bits vs. 1x10E15 bits
It’s Cost-effective and Green
–
Lowest storage cost for the foreseeable future
–
Most energy efficient method of storing digital data
–
Cartridges on a shelf consume no energy
It’s scalable
–
Easy to add additional storage (i.e. add cartridges)
–
Tape provides “infinite capacity” on demand
It’s removable / transportable / shareable
–
Off-line and off-sight storage for data protection-archive
–
Cartridges are easy to ship (XX PetaBytes / Day)
But tape is difficult to use!
–
Tape automation has simplified the process
–
LTFS makes tape easier to use than ever before
Why is LTO Tape on the Storage Hot List?
Tape Reliability Soars
Both disk and tape have made significant reliability
improvements in recent years.
For tape, reliability progress
has been even better than disk
comparing the BER (Bit Error
Rate), which is quickly becoming a more popular means of
measuring reliability.
BER is the percentage of bits that have errors relative to the total number of bits received in a data transfer
21 21
Costs Comparison Studies
ESG Backup/DR TCO Study:
Dedupe VTL vs. LTO-5 Library System1
The Clipper Group Archive TCO Study:
SATA Disk System vs. LTO-5 Tape Library System2
•12 Year TCO Archiving Study: costs covering hardware, maintenance, floor space and energy
•Disk storage was 15x Tape TCO
•The cost of energy alone for the average disk-based solution exceeded the entire TCO for the average tape-based solution
1A Comparative TCO Study: VTLs and Physical Tape, By
Mark Peters, ESG, Feb. 2011.
2Clipper Notes report “In Search of the Long-Term Archiving Solution -
Tape Delivers Significant TCO Advantage over Disk”, The Clipper Group, Dec.23, 2010. This was a general TCO study and did not specifically focus on LTFS or video storage.
•5 Year TCO Backup/DR Study; VTL with 15:1 Deduplication reduction ratio vs. LTO-5 Library •Costs included hardware,
maintenance, floor space, software, people and energy
•Scenarios included various DR methods (i.e. replication, PTAM) •Dedupe VTL was from about 2-4 times more costly than tape system
3Cartridge price as of internet search Feb 2012.
0 2 4 6 8 10 12 14 16 TCO Disk Tape 15X
Archive Capability
23
Tape and Disk are Complementary for Optimal Performance, Archive, Data Protection and TCO
Virtual Tape Library Tape Library
Application Servers
Backup Server
VTL
Tape Library
*Source: Fleishman-Hillard Research
Blended Tiered Storage Example - Layers of Protection
“There is no other medium that offers what tape does for archiving.”
LTO tape technology continues to evolve with LTO-5, Curtis Preston,
techtarget.com Feb 18, 2010
Storage Manager Survey Results*
• 61% of current disk-only users plan to start using tape
Replication
Agenda
Storage Issues
Best Practices – Unveiling the Facts
–
Addressing performance, data protection and
retention objectives
Overview - LTO-5 Technology
25
LTO-5 Tape Can Preserve Large Backups and Archives
• LTO-5 Tape is Huge and Reliable
– 1.5 TB / cartridge native: 3 TB / cartridge (2:1)
– That’s about 30 DVD movies per cartridge
– Automation offerings from 20-1,000s of cartridge slots
– Highly Reliable: Servo Tracking, Read after Write
Verification, 250K MTBF Hours, up to 30 year shelf life
• LTO-5 Drives are Fast
– Up to 140 MB / sec. native
– Up to 280 MB / sec. (2:1 compressed)
– That’s > 1TB of saved data per drive / hr
(2:1 compressed)
LTO
26
LTO Data Security
WORM (Write Once Read Many)
–
LTO 3, 4 and 5 drives and WORM cartridges
–
Unalterable tape data storage
–
Can append data to cartridge
Tape Drive Encryption
–
LTO 4 and 5 Tape Drive Hardware Encryption
–
AES 256 bit encryption data key provided to tape drive
–
Data is compressed then written to tape cartridge in
encrypted form to maximize capacity and protect
sensitive information
–
Virtually no impact to drive performance
–
Helps eliminate need for encryption SW or appliance
–
Get encryption key management software from tape
vendors
–
Straight forward implementation process
27
Providence Health & Services Encrypts with LTO Tape
Six data centers in five states all encrypting
off-site media
Daily backups are between 1 – 8 TB per site
Centralized, automated data protection system
eliminated manual management of backups
Effectively established a disk to disk to tape
strategy
Assured data is protected – LTO-4 addresses
security and compliance requirements
*See white paper: Securing Sensitive Information -- with LTO tape drive encryption. by Silverton Consulting at www.ultrium.com/whitepaper
“…it took only 1 to 2 days to implement
encryption.” Mack Kigada, Data Storage
Manager, Providence Health and Services
Agenda
Storage Issues
Best Practices – Unveiling the Facts
–
Addressing performance, data protection and
retention objectives
Overview - LTO-5 Technology
29
■
A open software specification that allows simple and new
ways of accessing data on tape
(LTFS spec doc available at: www.ultrium.com/ltfs )
■
Self-describing tape format to address data archive
requirements
■
Implemented on dual-partition LTO-5 tape
■
First partition holds the tape index / metadata
■
Second partition holds the content
■
It presents a tape as an extension of the operating system:
appears as another drive letter, icon or folder like a disk or
memory stick
What is the Linear Tape File System?
LTFS: What are the potential benefits?
•Improved archive storage
-“Memory stick like” self describing file system
-Tape can tell you what’s on it now and in the future
-Up to 30 year shelf life
•Easy to use
-View contents in OS browser directory tree
-Simple “Drag & Drop” movement of data
•Increased data mobility-portability
-Compatibility across OS environments
-No backup/archive software needed to view content
-A single storage media standard
-File, HW, SW and camera agnostic
•Reduced costs and energy consumption
-LTO tape is less expensive than other storage formats
"I am shocked! This is exactly what we need!" "LTO-5 technology gives tape-less work-flow....with tape!""Now I can offer an LTO-5 archiving service to my movie
LTFS: How does it work?
•
LTFS utilizes media partitioning (new to LTO Gen 5)
•
Tape is logically divided “lengthwise” into two partitions
-
Index partition: File system info, index, metadata (37.5 GB)
-
Content partition: Contains the files / content bodies (1425 GB)
When mounting the tape, the Index is copied to the workstation/server
memory for fast access and updates
Periodically the index is backed up to the content partition
B O T E O T
Content Partition
File File File File
Index Partition
Guard Wraps
Tape browsing on Linux
Files can be accessed on tape directly from any application
Device Directory
Tape Contents
"We think that LTFS could be one of
the most significant developments in
the tape drive space since the
introduction of LTO itself.“
George Crump, Analyst, Storage Switzerland, May 2010
How it Works: LTFS in Action with File Browser
33
LTFS – Easily Exchange, Archive and Share Files
Easy to Use - Archive - Share
Thought Equity Motion:
Video Archiving in the Cloud•
Business Need• Needed a low cost delivery platform for enterprise scale Video Supply Chain as a Service
• Information growth of ~100 TB per month • Easy self-serve access required by clients
•
Solution• Linear Tape File System at several global locations, including some client facilities • Tape Libraries and LTO-5 tape drives
•
Benefits• Opened up new business opportunities • Enabled more predictable and transparent
pricing for clients
• Portable, interoperable, scalable, cost-effective data protection and long-term storage
“LTO 5 and LTFS
significantly reduce the ancillary costs around storage. This is a real game-changer!”
Mark Lemmons CTO, Thought Equity Motion
35 35