Contents
Growth with Customers
Huawei Video Storage Solution
2
3
Trends in Video Surveillance Storage
Trends in Video Surveillance Storage
DVR local storage
DAS storage
Network storage system NVR storage system
Applicable to
small-scale surveillance
systems with a
modest data amount,
most sophisticated
technology, in use
for a long time, and
remaining sales
opportunities
Applicable to
small-scale
environment that
does not require
scalability or high
performance
Applicable to
medium-sized and
large surveillance
systems requiring
modest performance
Applicable to various
surveillance systems,
highly adaptive, yet
unreliable
Storage device divided into
storage pools, on-demand
capacity allocation, smooth
upgrade, easy management,
and applicable to municipal
security system construction
and video surveillance over
a large network
Early 21st century 2004 2006 2008 After 2010Platform server monitoring system
LAN/WAN
Client
Media server IP SAN
TV wall
Image capturing
Primary surveillance center
Remote surveillance DVR/CVS DVR/CVS NVR stack External video access platform Public security video access platform Gov. video resource access and sharing platform Video surveillance administration Intelligent analysis server cluster Storage server cluster Gov. user/resource District or county public security user Video network Video application server cluster Secure peripheral platform (video channel)
Surveillance Challenges Facing Traditional Storage
Fast growing camera market and HD videos
generate a huge number of video files,
complicating storage planning.
Multi-service systems require multiple storage
platforms with a high building cost and upkeep.
As a large number of videos are restored, data
recovery and file retrieval both take a long time.
Big data analysis and intelligent video analysis
demand high bandwidth and performance.
9:45
12:00
Huawei Video Surveillance Cloud Storage
Brilliant performance
High concurrence and data sharing among
different systems and departments
Massive storage space
Able to store a huge number of videos
Intelligent storage
Distributed parallel architecture for fast
retrieval and intelligent analysis
Robust security and reliability
Guaranteed service continuity of diverse
Intelligent
Convergence
Contents
Growth with Customers
Huawei Video Storage Solution
2
3
Trends in Video Surveillance Storage
Video Surveillance for "Safe City" Project
Video management platform Intelligent storage Primary surveillance center Surveillance spots Cloud storageClient Cloud storage
Client Cloud storage Branch surveillance center Branch surveillance center
Media server
Cloud storage
Branch surveillance center 2 TV wall Media server
Cloud storage
Branch surveillance center 1 TV wall
General surveillance center
Intelligent analysis server
Media server Cloud storage Client TV wall Uplo a ds v id e os . Stores Videos. Fo rw a rds to s urv e il la nc e c e nte r. Forwards to TV wall. Stores videos.
Video Data Streams on Surveillance Platforms
The storage systems in branch
surveillance centers provide
short-term storage and of partial
camera-recorded data.
The storage system in the general
surveillance center provides
long-term storage and archiving of all
camera-recorded data.
Client viewing
Client
Real-time viewing
Management server
Intelligent analysis and retrieval
History viewing Forwards to TV wall.
Huawei Cloud Storage Features
Robust reliability
Excellent scalability
Outstanding
performance
Simplified
management
SafeVideo
Global view
Free from
instant maintenance
Global data redundancy for
automated restore
Disk failure rate down by 70%
1 TB/h reconstruction speed
40 PB single namespace
Single node added in 60s
Smooth upgrade to 288 nodes
High disk density high
utilization
6400 Mbit/s bandwidth/node
Parallel architecture
No instant maintenance needed
No data planning needed
9
Storage Nodes
OceanStor
9000
HDFS Mode
NFS/CIFS mode
Multi Protocol Support
File system protocol : NFS/CIFS/HDFS
Management: SNMP/NTP/SSH
Distributed Architecture
The OceanStor 9000 employs a distributed architecture, where many storage nodes are stacked to meet the needs for high concurrency and bandwidth of video surveillance..
Ethernet
Switches
Storage
Nodes
Huawei Cloud Storage System Summary:OceanStor 9000
Cloud Storage Advantage: Architecture Advancement
Storage Nodes
GE
Ethernet Switch
…...
Distributed architecture: All nodes participate I/O, eliminating performance bottleneck. Scale-out expansion improves performance with volume. Max capacity of 40PB meets the requirement of video surveillance such as large volume, high band and concurrency.
Hardware of X86 simplifies O&M. Surveillance manage software can be installed on the hardware platform, saving the cost of servers.
Cloud Storage
SAN Storage
Architecture of 1 drives N: One controller drives
N disk units. Only controller is responsible for I/O which often becomes the performance bottleneck. Scale-up expansion can’t improve performance when capacity expanded.
Only the controller adopts X86 architecture.
Controller Enclosure
The total video data SAN Storage : after 2 disk breakdown all data are lost.
SafeVideo : make fault-free disk space readable
With SafeVideo patent technology , no matter
how many disks breakdown, if there is one
fault-free disk video data can be read from the
normal disk.
Cloud Storage
In the SAN storage ,if two or more disks of one
RAID5 set breakdown at same time, all the
video data stored in this RAID set will be lost.
SAN Storage
Cloud Storage Advantage: Reliability Comparison
Cloud Storage has higher reliability ,fault data recovery rate up to
1TB/hour.
Cloud Storage
SAN Storage
Cross-node RAID is super set of RAID,more reliable and flexible than RAID.
Multi node participate parallel recovery of failed node , improving recovery speed to 1TB per hour. Cloud storage can endure multi disk failure
without immediate replacement. m 2 m4 m 1 m3 m 3 m 2 m4 n1 n2 m 1 n2 n1
In case of node failure, damaged data can be restore through algorithm with data in other normal node.
②
File is devided into M pieces, N pieces of parity produced then. All the pieces are written into M+N nodes
①
…… P4 A3 A2 A1 A0 B4 P3 B2 B1 B0 C4 C3 P2 C1 C0 D4 D3 D2 P1 D0 E4 E3 E2 E1 P0 XOR calculation A0 B0 C0 D0 A1 B1 C1 E1 A2 B2 D2 dataData protection usually adopts RAID5 : N+1(parity)+1(hot backup)
After one disk failed , the data is recovered to hot backup disk, which will take about 22 hours for 4T data recovery and make performance decline more than 50%.
Failure disk must be replaced immediately. So maintenance is heavy.
Cloud Storage
SAN Storage
Rapid deployment by Plug and Play, unnecessary to plan RAID and LUN;
Capacity can be expanded in 3 levels: disk, node and domain. It take only one minute to expand one node;
Capacity expansion has no impact on surveillance service system.
When deployment, LUNs must be planned and
formatted. It will take more than 20 hours to format a LUN and more than 100 hours to format all LUNs of a SAN storage;
Capacity is increased by adding disk units. When number
of disk units exceeds a limit, a new controller should be added which means a new storage system.
After storage expansion, new volume should be configured to surveillance management system.
GE
Ethernet Switch
…...
Controller Enclosure
Disk units
Scale up with complex configuration
Scale out with simple configuration
Cloud Storage
SAN Storage
Cloud storage manages cross-region resources and presents global unified view to service servers. Storage load can be balanced within cloud storage system.
Physical resources are shielded to surveillance management and run as a storage pool to upper system.
Every IPSAN is managed respectively, no
load balance.
Storage systems couple closely with surveillance management system. Two parts impact each other when configuring and managing, improving management cost.
Storage Node A
/root
/root/D1 /root/D2 /root/D3
NFS NFS NFS POSIX interface Service servers Global view Storage infrastructure Service servers IP SAN
Cloud Storage Advantage: Management Convenience(2)
Storage
SAN Storage
Add 5 controller enclosure ,35 disk
enclosure ,up to
14 storage system
;
Add
15xGE
ethernet link;
Add 7 media server, assign LUN for each
server and spend 30 day / person to format
the LUN.
Scalability Comparison(1000 lines)
Add 2 storage domain, still be
one storage
system
;
Add
2x10GE
ethernet link;
Add 7 media server,assign new work
directory for new add server.
Original storage Node
POSIX Interface Media Server Global Namespace Cloud Storage Platform /root /root/D6 /root/D1 /root/D2
Add storage Node /root/D5 /root/D4 /root/D3 Added Server Media Server
…
Original disk array(9)…
Add Disk array(5) Added Server…
Cloud Storage
Cloud Storage is easier to expand, need less time and less network interface,
no need to interupt the application.
Contents
Growth with Customers
Huawei Video Storage Solution
2
3
Trends in Video Surveillance Storage
Over a Decade of Sustained Investment and Accumulation
3000+
Developers
5
Research centers
Sharing core technologies and
platforms of Huawei chips,
networks, hardware and software
•Storage research
•Cloud storage were deployed in some Tele operators •SAN products were widely deployed in Tele systems •SAN and NAS were widely used in ISP industry
2002 2003 2004 2005 2006 2007 2008 2009
•The first generation DAS product: D100
•Commercial launched the first FC SAN product F800.
•Commercial launched the 4Gb SAN product. • Full series NAS/SAN/VIS Product
launched
• Joint Venture from Huawei and Symantec
•High end and Middle range SAN, NAS
•Industry leading performance of SPC-1 and SPEC 2012
• New generation SAN series commercial launched • Cloud storage solutions
• New T Series unified storage launched • Dorado5100 solid state storage launched • 18500/18800 high-end Storage, UDS Cloud
Storage, Oceanstor 9000 big data storage launched
2011 2010 • New T series SAN published
• Full SSD SAN Dorado 2100 commercial launched • Media & Entertainment, data protection, Cloud solutions
Constant Innovation, Contribution to Storage Standards and
Patents
Over 600 storage-related patents authorized and accepted
Joined standardization organization
International
China
SNIA INCITS SPC SPEC PCI SIG NVMe CNITS SOA CCSAAdministration role in standardization organization
Post
Standards documents
SNIA TC member
Joint chairman of SMI Core TWG Deputy leader of SOA cloud computing
(including storage) group, CNITS
Over ten proposals to SNIA
Two proposals to INCITS Seven CCSA standards
documents
Six proposals to IETF
600+
30+
10+
Responsible for formulating standards in over 10 Chinese and
international storage standardization organizations
Committed to Customer Success Through Partnership
Committed to Customer Success
Industry Partners Consulting / Design Partner
Nigeria Mozambique Pakistan Russia Belarus Tajikistan Turkey UAE Indonesia Laos Kazakhstan Malaysia China Egypt Algeria Morocco Senegal Chad Kenya Tanzania Djibouti South Africa Angola Ethiopia Zambia Mali Niger Ghana Mexico Venezuela Ecuador Brazil Argentina Mongolia Hungary PNG
Middle East KC "Safe City" Project
Customer Requirements
The city needs 1980 cameras and 6.8 PB storage capacity. The storage system needs to provide central storage and management.
The system implements multi-level reliability protection to
prevent data loss.
Storage capacity can be flexibly expanded without affecting services.
Huawei Solution
The large-scale distributed clustered system, integrating
computing and storage capabilities of massive nodes, provide parallel processing and up to 6.8 PB video storage by horizontal expansion.
The unified management platform enables automated
deployment and capacity allocation of a thousand storage nodes
Powerful real-time remote backup ensures data reliability.
Customer Benefits
Unified storage resource pool: automated restore, inexpensive
and simplified maintenance, and guaranteed maintenance personnel safety
Reliable cloud storage design: failure rate down by 30%, integral monitored data, and reduced maintenance cost
Front-end device
DVR/DVS
Surveillance LAN
Surveillance client Surveillance platform
Storage domain
Management node
Recorded videos
Storage domain Storage domain
Middle East XX "Safe City" Video Surveillance Project
Customer Requirements
XX district government invests $20 million in building a video surveillance system to cope with political tension, collect civil information, and improve public security.
A total of 1200 cameras are needed to cover the entire city. The system capacity is around 1.5 PB and meets 6-month storage needs.
Huawei Solution
The solution, combining LTE, IVS, and cloud storage products,
delivers storage system competence.
The large-scale distributed clustered system, integrating
computing and storage capabilities of massive nodes, provide parallel processing and 1.5 PB video storage by horizontal expansion.
Customer Benefits
The end-to-end solution improves overall delivery efficiency.
The cloud storage architecture meets subsequent requirements
for large capacity expansion, saving expansion investment. Media server
Management server
16 x 10GE
Why Huawei Storage?
Unified hardware platform ensuring maximum ROI
Over 10 years' innovation and expertise in Storage
technologies
Vendor neutral or integrated without platform lock-in
Constant pursuit of best performance and
Copyright©2012 Huawei Technologies Co., Ltd. All Rights Reserved.
The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product
HUAWEI ENTERPRISE ICT SOLUTIONS
A BETTER WAY
10GE IPMI
OceanStor9000
Front-end network
OceanStor 9000 Networking Recommendations
Back-end and front-end 10GE networking
Flexible internal and external
networking choices
Redundant switch
configuration
IPMI independent network
10GE switch 10GE switch (provided by the customer) GE switch Management server
Intelligent Load Balancing
•
Intelligent load balancing among
all
nodes
•
Automatic
capacity and
performance
balancing
•
Free from
manual intervention or
configuration modification
•
Transparent to
applications
Elastic Space Management Simplicity
Linear Scalability High Reliability
node
node
node
node
OceanStor 9000
WiseLink WiseLink WiseLink WiseLink
Dynamic Storage Tiering, Improving Resource Utilization
Automatic migration of non-hotspot data, improving
utilization
File-level fine granularity, accurate hotspot locating based
on
I/O access frequency
.
The migration process is
fully transparent
to users,
without affecting applications.
Hot data Cold data
P node
B node
WiseTierWiseTier
WushanFS
Elastic Space Management Simplicity
Efficient Global Cache, Improving Access Efficiency
Storage
CPU
Memory
Storage
CPU
Memory
Storage
CPU
Memory
Global cache
Global cache
A
B
C
Increasing the cache hit ratio by
50%
Improving
cache space utilization
Up to
55 TB
cache pool
Application server
Node
Node
Node
WushanFS
Elastic Space Management Simplicity
WushanFS: Largest Single File System in the Industry
Separate
expansion of performance
and capacity
Symmetric distributed
architecture
without individual metadata
nodes
Up to
40 PB
of single file system
Even distribution
of metadata
for eliminating performance bottleneck
of metadata
Application server
WushanFS
Elastic Space Management Simplicity
On-Demand Expansion, Decreasing Procurement Costs
Scalable
from
3 to
288
nodes linearly
Expansion of a single node
completed within 60 seconds
Free from manual intervention or any
modification
Application server
Elastic Space Management Simplicity Linear Scalability High Reliability
Switch
Disk utilization up to
95%
N+1
to
N+4
data protection
File-level
data protection
1 TB/hour
data recovery
Distributed RAID, Providing Highly Reliable Data Protection
Elastic Space Management Simplicity
Linear Scalability Elastic Space High Reliability Linear Scalability +1 ECC +3 ECC +2 ECC +4 ECC
Comprehensive Visualization, Unified Resource
Management
100 TB20 TB
User
30 TB
User group
40 TB
User group
10 TB
User
20 TB
10 TB
Elastic Space Management Simplicity
Linear Scalability High Reliability
Centralized management of
Unified topology display
Comprehensive
performance monitoring
Fast automatic
deployment
WiseQuota:
sets quotas for nested directories
SafeVideo: Proprietary Technology for Video Data Protection
Simplified Management
Robust Reliability
Outstanding Performance Excellent Scalability
A complete video sequence
Tradition data protection:
All data is lost if two
member disks of the
RAID 5 group fail.
SafeVideo: Data in normal
space can be read in the event
of a RAID failure.
The failure or damage of any number of disks does
not affect the video streaming. Only data on the
failed or damaged disks is lost.