• No results found

Huawei Video Cloud Storage Solution

N/A
N/A
Protected

Academic year: 2021

Share "Huawei Video Cloud Storage Solution"

Copied!
34
0
0

Loading.... (view fulltext now)

Full text

(1)
(2)

Contents

Growth with Customers

Huawei Video Storage Solution

2

3

Trends in Video Surveillance Storage

(3)

Trends in Video Surveillance Storage

DVR local storage

DAS storage

Network storage system NVR storage system

Applicable to

small-scale surveillance

systems with a

modest data amount,

most sophisticated

technology, in use

for a long time, and

remaining sales

opportunities

Applicable to

small-scale

environment that

does not require

scalability or high

performance

Applicable to

medium-sized and

large surveillance

systems requiring

modest performance

Applicable to various

surveillance systems,

highly adaptive, yet

unreliable

Storage device divided into

storage pools, on-demand

capacity allocation, smooth

upgrade, easy management,

and applicable to municipal

security system construction

and video surveillance over

a large network

Early 21st century 2004 2006 2008 After 2010

Platform server monitoring system

LAN/WAN

Client

Media server IP SAN

TV wall

Image capturing

Primary surveillance center

Remote surveillance DVR/CVS DVR/CVS NVR stack External video access platform Public security video access platform Gov. video resource access and sharing platform Video surveillance administration Intelligent analysis server cluster Storage server cluster Gov. user/resource District or county public security user Video network Video application server cluster Secure peripheral platform (video channel)

(4)

Surveillance Challenges Facing Traditional Storage

Fast growing camera market and HD videos

generate a huge number of video files,

complicating storage planning.

Multi-service systems require multiple storage

platforms with a high building cost and upkeep.

As a large number of videos are restored, data

recovery and file retrieval both take a long time.

Big data analysis and intelligent video analysis

demand high bandwidth and performance.

9:45

12:00

(5)

Huawei Video Surveillance Cloud Storage

Brilliant performance

High concurrence and data sharing among

different systems and departments

Massive storage space

Able to store a huge number of videos

Intelligent storage

Distributed parallel architecture for fast

retrieval and intelligent analysis

Robust security and reliability

Guaranteed service continuity of diverse

Intelligent

Convergence

(6)

Contents

Growth with Customers

Huawei Video Storage Solution

2

3

Trends in Video Surveillance Storage

(7)

Video Surveillance for "Safe City" Project

Video management platform Intelligent storage Primary surveillance center Surveillance spots Cloud storage

Client Cloud storage

Client Cloud storage Branch surveillance center Branch surveillance center

(8)

Media server

Cloud storage

Branch surveillance center 2 TV wall Media server

Cloud storage

Branch surveillance center 1 TV wall

General surveillance center

Intelligent analysis server

Media server Cloud storage Client TV wall Uplo a ds v id e os . Stores Videos. Fo rw a rds to s urv e il la nc e c e nte r. Forwards to TV wall. Stores videos.

Video Data Streams on Surveillance Platforms

The storage systems in branch

surveillance centers provide

short-term storage and of partial

camera-recorded data.

The storage system in the general

surveillance center provides

long-term storage and archiving of all

camera-recorded data.

Client viewing

Client

Real-time viewing

Management server

Intelligent analysis and retrieval

History viewing Forwards to TV wall.

(9)

Huawei Cloud Storage Features

Robust reliability

Excellent scalability

Outstanding

performance

Simplified

management

SafeVideo

Global view

Free from

instant maintenance

Global data redundancy for

automated restore

Disk failure rate down by 70%

1 TB/h reconstruction speed

40 PB single namespace

Single node added in 60s

Smooth upgrade to 288 nodes

High disk density high

utilization

6400 Mbit/s bandwidth/node

Parallel architecture

No instant maintenance needed

No data planning needed

(10)

9

Storage Nodes

OceanStor

9000

HDFS Mode

NFS/CIFS mode

Multi Protocol Support

File system protocol : NFS/CIFS/HDFS

Management: SNMP/NTP/SSH

Distributed Architecture

The OceanStor 9000 employs a distributed architecture, where many storage nodes are stacked to meet the needs for high concurrency and bandwidth of video surveillance.

.

Ethernet

Switches

Storage

Nodes

Huawei Cloud Storage System Summary:OceanStor 9000

(11)

Cloud Storage Advantage: Architecture Advancement

Storage Nodes

GE

Ethernet Switch

…...

Distributed architecture: All nodes participate I/O, eliminating performance bottleneck. Scale-out expansion improves performance with volume. Max capacity of 40PB meets the requirement of video surveillance such as large volume, high band and concurrency.

Hardware of X86 simplifies O&M. Surveillance manage software can be installed on the hardware platform, saving the cost of servers.

Cloud Storage

SAN Storage

Architecture of 1 drives N: One controller drives

N disk units. Only controller is responsible for I/O which often becomes the performance bottleneck. Scale-up expansion can’t improve performance when capacity expanded.

Only the controller adopts X86 architecture.

Controller Enclosure

(12)

The total video data SAN Storage : after 2 disk breakdown all data are lost.

SafeVideo : make fault-free disk space readable

With SafeVideo patent technology , no matter

how many disks breakdown, if there is one

fault-free disk video data can be read from the

normal disk.

Cloud Storage

In the SAN storage ,if two or more disks of one

RAID5 set breakdown at same time, all the

video data stored in this RAID set will be lost.

SAN Storage

Cloud Storage Advantage: Reliability Comparison

Cloud Storage has higher reliability ,fault data recovery rate up to

1TB/hour.

(13)

Cloud Storage

SAN Storage

Cross-node RAID is super set of RAID,more reliable and flexible than RAID.

Multi node participate parallel recovery of failed node , improving recovery speed to 1TB per hour. Cloud storage can endure multi disk failure

without immediate replacement. m 2 m4 m 1 m3 m 3 m 2 m4 n1 n2 m 1 n2 n1

In case of node failure, damaged data can be restore through algorithm with data in other normal node.

File is devided into M pieces, N pieces of parity produced then. All the pieces are written into M+N nodes

…… P4 A3 A2 A1 A0 B4 P3 B2 B1 B0 C4 C3 P2 C1 C0 D4 D3 D2 P1 D0 E4 E3 E2 E1 P0 XOR calculation A0 B0 C0 D0 A1 B1 C1 E1 A2 B2 D2 data

Data protection usually adopts RAID5 : N+1(parity)+1(hot backup)

After one disk failed , the data is recovered to hot backup disk, which will take about 22 hours for 4T data recovery and make performance decline more than 50%.

Failure disk must be replaced immediately. So maintenance is heavy.

(14)

Cloud Storage

SAN Storage

Rapid deployment by Plug and Play, unnecessary to plan RAID and LUN;

Capacity can be expanded in 3 levels: disk, node and domain. It take only one minute to expand one node;

Capacity expansion has no impact on surveillance service system.

When deployment, LUNs must be planned and

formatted. It will take more than 20 hours to format a LUN and more than 100 hours to format all LUNs of a SAN storage;

Capacity is increased by adding disk units. When number

of disk units exceeds a limit, a new controller should be added which means a new storage system.

After storage expansion, new volume should be configured to surveillance management system.

GE

Ethernet Switch

…...

Controller Enclosure

Disk units

Scale up with complex configuration

Scale out with simple configuration

(15)

Cloud Storage

SAN Storage

Cloud storage manages cross-region resources and presents global unified view to service servers. Storage load can be balanced within cloud storage system.

Physical resources are shielded to surveillance management and run as a storage pool to upper system.

Every IPSAN is managed respectively, no

load balance.

Storage systems couple closely with surveillance management system. Two parts impact each other when configuring and managing, improving management cost.

Storage Node A

/root

/root/D1 /root/D2 /root/D3

NFS NFS NFS POSIX interface Service servers Global view Storage infrastructure Service servers IP SAN

Cloud Storage Advantage: Management Convenience(2)

Storage

(16)

SAN Storage

Add 5 controller enclosure ,35 disk

enclosure ,up to

14 storage system

Add

15xGE

ethernet link;

Add 7 media server, assign LUN for each

server and spend 30 day / person to format

the LUN.

Scalability Comparison(1000 lines)

Add 2 storage domain, still be

one storage

system

Add

2x10GE

ethernet link;

Add 7 media server,assign new work

directory for new add server.

Original storage Node

POSIX Interface Media Server Global Namespace Cloud Storage Platform /root /root/D6 /root/D1 /root/D2

Add storage Node /root/D5 /root/D4 /root/D3 Added Server Media Server

Original disk array(9)

Add Disk array(5) Added Server

Cloud Storage

Cloud Storage is easier to expand, need less time and less network interface,

no need to interupt the application.

(17)

Contents

Growth with Customers

Huawei Video Storage Solution

2

3

Trends in Video Surveillance Storage

(18)

Over a Decade of Sustained Investment and Accumulation

3000+

Developers

5

Research centers

Sharing core technologies and

platforms of Huawei chips,

networks, hardware and software

•Storage research

•Cloud storage were deployed in some Tele operators •SAN products were widely deployed in Tele systems •SAN and NAS were widely used in ISP industry

2002 2003 2004 2005 2006 2007 2008 2009

•The first generation DAS product: D100

•Commercial launched the first FC SAN product F800.

•Commercial launched the 4Gb SAN product. • Full series NAS/SAN/VIS Product

launched

• Joint Venture from Huawei and Symantec

•High end and Middle range SAN, NAS

•Industry leading performance of SPC-1 and SPEC 2012

• New generation SAN series commercial launched • Cloud storage solutions

• New T Series unified storage launched • Dorado5100 solid state storage launched • 18500/18800 high-end Storage, UDS Cloud

Storage, Oceanstor 9000 big data storage launched

2011 2010 • New T series SAN published

• Full SSD SAN Dorado 2100 commercial launched • Media & Entertainment, data protection, Cloud solutions

(19)

Constant Innovation, Contribution to Storage Standards and

Patents

Over 600 storage-related patents authorized and accepted

Joined standardization organization

International

China

 SNIA  INCITS  SPC  SPEC  PCI SIG  NVMe  CNITS SOA  CCSA

Administration role in standardization organization

Post

Standards documents

 SNIA TC member

 Joint chairman of SMI Core TWG  Deputy leader of SOA cloud computing

(including storage) group, CNITS

 Over ten proposals to SNIA

 Two proposals to INCITS  Seven CCSA standards

documents

 Six proposals to IETF

600+

30+

10+

Responsible for formulating standards in over 10 Chinese and

international storage standardization organizations

(20)

Committed to Customer Success Through Partnership

Committed to Customer Success

Industry Partners Consulting / Design Partner

(21)

Nigeria Mozambique Pakistan Russia Belarus Tajikistan Turkey UAE Indonesia Laos Kazakhstan Malaysia China Egypt Algeria Morocco Senegal Chad Kenya Tanzania Djibouti South Africa Angola Ethiopia Zambia Mali Niger Ghana Mexico Venezuela Ecuador Brazil Argentina Mongolia Hungary PNG

(22)

Middle East KC "Safe City" Project

Customer Requirements

 The city needs 1980 cameras and 6.8 PB storage capacity. The storage system needs to provide central storage and management.

The system implements multi-level reliability protection to

prevent data loss.

 Storage capacity can be flexibly expanded without affecting services.

Huawei Solution

 The large-scale distributed clustered system, integrating

computing and storage capabilities of massive nodes, provide parallel processing and up to 6.8 PB video storage by horizontal expansion.

 The unified management platform enables automated

deployment and capacity allocation of a thousand storage nodes

 Powerful real-time remote backup ensures data reliability.

Customer Benefits

 Unified storage resource pool: automated restore, inexpensive

and simplified maintenance, and guaranteed maintenance personnel safety

 Reliable cloud storage design: failure rate down by 30%, integral monitored data, and reduced maintenance cost

Front-end device

DVR/DVS

Surveillance LAN

Surveillance client Surveillance platform

Storage domain

Management node

Recorded videos

Storage domain Storage domain

(23)

Middle East XX "Safe City" Video Surveillance Project

Customer Requirements

 XX district government invests $20 million in building a video surveillance system to cope with political tension, collect civil information, and improve public security.

 A total of 1200 cameras are needed to cover the entire city. The system capacity is around 1.5 PB and meets 6-month storage needs.

Huawei Solution

 The solution, combining LTE, IVS, and cloud storage products,

delivers storage system competence.

 The large-scale distributed clustered system, integrating

computing and storage capabilities of massive nodes, provide parallel processing and 1.5 PB video storage by horizontal expansion.

Customer Benefits

 The end-to-end solution improves overall delivery efficiency.

 The cloud storage architecture meets subsequent requirements

for large capacity expansion, saving expansion investment. Media server

Management server

16 x 10GE

(24)

Why Huawei Storage?

Unified hardware platform ensuring maximum ROI

Over 10 years' innovation and expertise in Storage

technologies

Vendor neutral or integrated without platform lock-in

Constant pursuit of best performance and

(25)

Copyright©2012 Huawei Technologies Co., Ltd. All Rights Reserved.

The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product

HUAWEI ENTERPRISE ICT SOLUTIONS

A BETTER WAY

(26)

10GE IPMI

OceanStor9000

Front-end network

OceanStor 9000 Networking Recommendations

Back-end and front-end 10GE networking

Flexible internal and external

networking choices

Redundant switch

configuration

IPMI independent network

10GE switch 10GE switch (provided by the customer) GE switch Management server

(27)

Intelligent Load Balancing

Intelligent load balancing among

all

nodes

Automatic

capacity and

performance

balancing

Free from

manual intervention or

configuration modification

Transparent to

applications

Elastic Space Management Simplicity

Linear Scalability High Reliability

node

node

node

node

OceanStor 9000

WiseLink WiseLink WiseLink WiseLink

(28)

Dynamic Storage Tiering, Improving Resource Utilization

Automatic migration of non-hotspot data, improving

utilization

File-level fine granularity, accurate hotspot locating based

on

I/O access frequency

.

The migration process is

fully transparent

to users,

without affecting applications.

Hot data Cold data

P node

B node

WiseTier

WiseTier

WushanFS

Elastic Space Management Simplicity

(29)

Efficient Global Cache, Improving Access Efficiency

Storage

CPU

Memory

Storage

CPU

Memory

Storage

CPU

Memory

Global cache

Global cache

A

B

C

Increasing the cache hit ratio by

50%

Improving

cache space utilization

Up to

55 TB

cache pool

Application server

Node

Node

Node

WushanFS

Elastic Space Management Simplicity

(30)

WushanFS: Largest Single File System in the Industry

Separate

expansion of performance

and capacity

Symmetric distributed

architecture

without individual metadata

nodes

Up to

40 PB

of single file system

Even distribution

of metadata

for eliminating performance bottleneck

of metadata

Application server

WushanFS

Elastic Space Management Simplicity

(31)

On-Demand Expansion, Decreasing Procurement Costs

Scalable

from

3 to

288

nodes linearly

Expansion of a single node

completed within 60 seconds

Free from manual intervention or any

modification

Application server

Elastic Space Management Simplicity Linear Scalability High Reliability

(32)

Switch

Disk utilization up to

95%

N+1

to

N+4

data protection

File-level

data protection

1 TB/hour

data recovery

Distributed RAID, Providing Highly Reliable Data Protection

Elastic Space Management Simplicity

Linear Scalability Elastic Space High Reliability Linear Scalability +1 ECC +3 ECC +2 ECC +4 ECC

(33)

Comprehensive Visualization, Unified Resource

Management

100 TB

20 TB

User

30 TB

User group

40 TB

User group

10 TB

User

20 TB

10 TB

Elastic Space Management Simplicity

Linear Scalability High Reliability

Centralized management of

Unified topology display

Comprehensive

performance monitoring

Fast automatic

deployment

WiseQuota:

sets quotas for nested directories

(34)

SafeVideo: Proprietary Technology for Video Data Protection

Simplified Management

Robust Reliability

Outstanding Performance Excellent Scalability

A complete video sequence

Tradition data protection:

All data is lost if two

member disks of the

RAID 5 group fail.

SafeVideo: Data in normal

space can be read in the event

of a RAID failure.

The failure or damage of any number of disks does

not affect the video streaming. Only data on the

failed or damaged disks is lost.

The risk of all data loss caused by disk failures is

greatly reduced.

References

Related documents

Making the best choice in video surveillance storage systems and configuring them optimally may make the difference in capturing needed (or mandatory) video or discovering the

context that contribute to the reduction of social inequities and promote healthy community environments. This is the central goal of planning for social sustainability. Case

In section four, regime-dependent impulse response functions are calculated showing remarkable differences in the response of European interest rate differentials to shocks in the

What I find great about this is that you don’t really run in to the danger of the people refusing to come up and join you (there are ways of dealing with that and a great resource

Life Sciences & Systems 2% Missile Systems 11% Space Operations & Support 8% Microgravity & Space Processes 1% Space Systems 21% Space Transportation 15%

In this work our main contributions are as follows: (a) we show how a class of concurrent mean-payoff games, namely ergodic games, can model various attacks that arise naturally

Los gabinetes de Comunicación de las organizaciones, por tanto, trascienden el mero papel de fuentes de información para los medios que se le ha atribuido durante mucho

purchasers as per se unlawful under the name of patent exhaustion, an alternative approach would be to evaluate the specific restriction in a separate inquiry to de-