Data Centre of the Future

(1)

Data Centre of the Future

Vblock Infrastructure Packages:

Accelerating Deployment of the Private

Cloud

Andrew Smallridge

DC Technology Solutions Architect

[email protected]

(2)

IT is undergoing a transformation…

The need for a new IT model has never been more clear…

• Today’s IT architecture increases procurement, management

costs, and complexity

• IT is now moving towards a service based consumption model

(Private Cloud)

• This new model requires a new way of thinking about both the

underlying technology and the way IT is delivered for customer

success

…navigating the path to that model has never been more complicated

(3)

Vblock Infrastructure Packages

A New Way of Delivering IT

y Rapid deployment model

for virtualized infrastructure

P i d d lid d

Vblock Infrastructure

Packages Information

y Pre-integrated and validated

solutions reduce total cost

of ownership

Operating Systems Applications

y Service-level driven through

predictable performance

and operational

h t i ti

^Compute

Virtualization

characteristics

y Improved compliance/security

and reduced risk

Compute

Network

Storag e

Accelerate Time to Results—Reduce TCO

(4)

Simplified Physical DC Architecture

MAN / WAN MAN / WAN

MAN Access and MAN Access and

Virtual Device Contexts

• DC Core (outside)

• DC Aggregation

MAN Access and DC Access Firewalls MAN Access and

DC Access Firewalls

(inside)

Management Network Management Network

x86 Compute X X

x86 Compute

X X SAN

Unified A Computing

System Unified

Computing System

EMC VMAX

Data Domain Data Domain

Data Protection

SAN Vblock Type 2 SAN

Vblock Type 2

Production Mission Critical

Non Production Dev / Test Non Production

Dev / Test

SAN B

Tiered Storage Tiered Storage

Data Domain Avatar Data Domain

Avatar

(5)

Vblock Infrastructure

Packages:

Architecture & Design

(6)

Vblock Infrastructure Packages Architecture

Applications & Operating Systems

Systems Management

& Monitoring

Multi-Tenancy High- Availability

Security Management &

Orchestration Service-Tiering Performance

& o to g

VMware vSphere 4 Cisco Unified Computing EMC Unified Storage

Vblock Foundation

System

(7)

Architectural Principles

• ‘Units’ of IT infrastructure with 'matched' performance operational characteristics and

• Units of IT infrastructure with matched performance, operational characteristics and discrete of power, space and cooling

• Repeatable design patterns facilitate rapid deployment, integration and scalability

• Built to contain, manage and mitigate failure scenarios in hardware and software environments

• Designed from the 'Facilities to the Workload' to be scaled for the highest efficiencies inDesigned from the Facilities to the Workload to be scaled for the highest efficiencies in virtualization and workload re-platforming

• Extensible security, management and orchestration frameworks based on industry standard tools, APIs and methods,

Design Selection Assembly Result

(8)

Predictable Performance, Capacity & Capability

y Predictable and granular SLA

measurement and assurance

y Deterministic space and weight: p g

floor tiles become unit of

capacity planning

y Consistent power and cooling

(KWh/BTU ) it

(KWh/BTUs) per unit

y Pre-determined capacity and

scalability

y Uniform workload distribution

and mobility

y Deterministic fault and security

isolation

P di bl ‘F ili i W kl d’ I

Predictable ‘Facilities to Workload’ Impact

(9)

Vblock Infrastructure Packages

Scalable Platform for Building Solutions

y Vblock 2:

– Extensible to meet the most

d di IT d

demanding IT needs

y Vblock 1:

– Broad range of IT capabilities for Broad range of IT capabilities for

organizations of all sizes

y Vblock 0:

“P i t Cl d i R k”

– “Private Cloud in a Rack”

– Test/development platform for

Partners and customers

D i d f B d f U C

Designed for a Broad range of Use Cases

(10)

Vblock Infrastructure Packages

Scalable IT capability and performance

Vblock 2: Very Large Virtualized Compute and Storage Array Vblock 2: Very Large Virtualized Compute and Storage Array

Vblock 1: Virtualized Workload Environment Vblock 1: Virtualized Workload Environment

Vblock 0: Virtualized Workload Environment Vblock 0: Virtualized Workload Environment

Aggregation Layer Aggregation Layer Vblock Unified

Infrastructure Management Vblock Unified

Infrastructure Management

gg g y

Application and Network Services

gg g y

Application and Network Services

(11)

Vblock 2: Large-scale Cloud Infrastructure

L l P i t P bli d H b id

y Large-scale Private, Public and Hybrid

Cloud infrastructure

y Standardized hardware, IT capabilities , p

and process simplifies operations,

reduces TCO

y Performance Capability and Capacity Performance, Capability and Capacity

– Scale-up architecture: 20K+ VMs, 1PB+

storage

– Industry leading virtualization capabilities

y Accelerates ROI & Reduces TCO

(12)

Vblock 1: Scalable Private Cloud infrastructure

y Broad range of IT capabilities for

i ti f ll i

organizations of all sizes

y Standardized hardware, IT capabilities

and process simplifies operations

and process simplifies operations,

reduces TCO

y Performance Capability and Capacity

y Performance, Capability and Capacity

– 800 – 3,000+ VMs

– 58TB to 99TB+ Storage

– Industry leading virtualization capabilities

y Accelerates ROI & Reduces TCO

(13)

Vblock 0: Extending the Vblock Family

^New

y “Private Cloud in a Rack” extends Vblock

id d l t d l f i t li d

rapid deployment model for virtualized

infrastructure & Private Cloud

y Standardized hardware IT capabilities and

y Standardized hardware, IT capabilities and

process simplifies operations, reduces TCO

y Performance Capability and Capacity

y Performance, Capability and Capacity

– 30 to 500+ VMs

– 12TB to 42TB+ Storage

– Industry leading virtualization capabilites

y Accelerates ROI & Reduces TCO

(14)

Vblock 1: Consolidation Use Case

Projected Performance and Capacity

Note: 5,000 users can be supported at IOPS utilization of 107%

Balanced Systems design

(15)

Vblock Scaling

Isolated Aggregated Federated

LAN LAN LAN LAN LAN LAN

OR OR

SAN SAN SAN SAN SAN SAN

“Brains”

“Brains” “Brains” “Brains” “Brains”

Storage Array Storage Array

Vblock 0, 1 & 2 Vblock 2

Storage Array Storage Array Storage ArrayStorage Array

(16)

Vblock 0: What's in the Architecture?

y Compute Compute

– 4-16 Cisco UCS B-series blades

8-16 Sockets

192-768 GB Memory

y Network

– Cisco Nexus 1000V – Nexus 5010

y Storage

– EMC Celerra NS-120 (Single or Dual)

y Virtual Data Center OS

– VMware vSphere 4

y Management Software

– EMC Ionix Unified Infrastructure Manager (UIM) - optional – VMware vCenter

– EMC Navisphere EMC P P th – EMC PowerPath – Cisco UCS Manager

(17)

Vblock 1U: What's in the Architecture?

y Compute

– 16-32 Cisco UCS B-series blades

32-64 Sockets

960-1920 GB Memory

y Network

– Cisco Nexus 1000V – Nexus 5010

y Storage g

– EMC Celerra NS 960

62-105 TB capacity

EFD, FC and SATA Drives

IP, Fibre Channel & iSCSIIP, Fibre Channel & iSCSI

y Virtual Data Center OS

y Management Software Management Software

– EMC Ionix Unified Infrastructure Manager (UIM) – VMware vCenter

– EMC Navisphere EMC PowerPath – EMC PowerPath

– Cisco UCS Manager and Fabric Manager

(18)

Vblock 1: What's in the Architecture?

y Compute

16 32 Cisco UCS B series blades – 16-32 Cisco UCS B-series blades

32-64 Sockets

960-1920 GB Memory

y Network

– Cisco Nexus 1000V

– Cisco MDS 9506 (9221i)

y Storage

– EMC CLARiiON CX4 480 or

53-91 TB capacity

Fibre Channel & iSCSI

– Celerra NAS Gateway

y Virtual Data Center OS

y Management Software

– EMC NavisphereEMC Navisphere – EMC PowerPath

(19)

Vblock 2: What's in the Architecture?

y Compute

32 64 Cisco UCS B series blades – 32-64 Cisco UCS B-series blades

64-128 Sockets

3072 - 6144 GB Memory

y Network

– Cisco Nexus 1000V – Cisco MDS 9506

y Storage

– EMC Symmetrix V-Max (2 Engines)

140 - 211 TB Capacity

Fibre Channel & iSCSI

– Celerra NAS Gateway

y Virtual Data Center OS

y Management Software

– Symmetrix Management Console (SMC)Symmetrix Management Console (SMC) – EMC PowerPath

(20)

What’s in the Vblock?

y Unified Computing System (UCS)

– Cisco UCS 6100 Series Fabric Interconnects

Cisco UCS 5100 Series Blade Ser er Chassis

– Cisco UCS 5100 Series Blade Server Chassis

Cisco UCS B-200 Blade Server

• 48-96 GB Memory

• Converged Network Adapter (Unified Network)

y EMC Storage

– CLARiiON CX4

Symmetrix V Max

– Symmetrix V-Max

– Celerra NS-120

– Celerra NAS Gateway

y VMware vSphere

(21)

Unified Computing System (UCS)

y Single, scalable integrated system

SAN A

y Network + compute virtualization

SAN B

Mgmt LAN SAN A

(22)

Traditional Blade Enclosures

IPC LAN SAN

Chassis

Today’s Approach

• All fabric types have switches in each

h i

Blade C de de

chassis

• Repackaged switches

• Complex to manage

de de

Blad Blad

• Blade-chassis configuration dependency

• Costly

Blad Blad

• Costly

• Small network domain

(23)

Cisco Unified Computing System

SAN LAN SAN

Two Failure Domains

• Separate fabrics

Infrastructure Management

• Centralize chassis Separate fabrics

• Central supervisor,

forwarding logic

• Distributed Fabric

Centralize chassis

management

• Intrinsic system management

• Distributed Fabric

Extenders

• Traffic isolation

• Oversubscription

g

• Single management

domain

• Scalable architecture

10GE/FCoE

hassis hassis hassis hassis

• Oversubscription

Scalable architecture

Blade Ch Blade Ch Blade Ch Blade Ch

Chassis Management

Chassis Management Chassis

Management

Chassis Management

(24)

UCS Manager

Embedded– manages entire system

UCS Building Blocks

Embedded manages entire system

UCS 6100 Series Fabric Interconnect 20 Port 10Gb FCoE – UCS-6120

40 Port 10Gb FCoE – UCS-6140

UCS Fabric Extender – UCS 2100 Series Remote line card

UCS 5100 Series Blade Server Chassis UCS 5100 Series Blade Server Chassis Flexible bay configurations

UCS Blade Server UCS Blade Server

Industry-standard architecture

UCS Adaptersp

Choice of multiple Converged Network Adapters and Virtual Adapters

(25)

U ifi d C ti S t

Unified Computing System

System Interconnect Components

MGMT

S S

G G

SAN A

G G

SAN B LAN

UCS System Configuration

A

G G G

A G G G Fabric Switch Fabric Switch Fabric

Switch Fabric Switch

Compute Chassis Compute Chassis

Fabric Fabric Fabric

Fabric Compute ChassisCompute Chassis

• 2 UCS 61xx Fabric

Interconnects

• Up to 40 Chassis per System

I I

x8 x8 x8

x8

C

R C R Fabric

Extender Fabric Extender Fabric

Extender Fabric Extender

p p

I I

x8 x8 x8

x8

C C

R R Fabric

I I

x8 x8 x8

x8

C C

R R Fabric

I I

x8 x8 x8

x8

C C

R R Fabric

Up to 40 Chassis per System

• Max 8 Chassis Vblock 2

• 40G per Fabric Extender

X B B

X X X X X

P

M P

Adapter

Adapter AdapterAdapter AdapterAdapter

X B B

X X X X X

P

M P

Adapter

Adapter AdapterAdapter AdapterAdapter B B

P

M P

Adapter

Adapter AdapterAdapter AdapterAdapter B B

P

M P

Adapter

p

• 80G per Chassis

• Up to 8 half widths blades per

x86 Computer x86 Computer

Compute Blade (Half slot) Compute Blade

(Half slot)

Compute Blade (Full slot) Compute Blade

(Full slot)

(Half slot)

(Full slot)

X

X X X X X

(Half slot)

(Full slot)

X

X X X X X

Compute Blade (H lf l t) Compute Blade

(H lf l t)

(Full slot)

chassis

• Up to 4 full width blades per

chassis

Unified Computing System Unified Computing System

(Half slot)

(Half slot) (Full slot)(Full slot)

(26)

Unified Computing System (UCS)

y Cisco UCS 6100 Series Fabric Interconnects

– Unified network connectivity to blades and chassis

10 Gigabit Ethernet

Fibre Channel over Ethernet (FCoE)

IP and Fibre Channel to the aggregation layer and SAN

– IP and Fibre Channel to the aggregation layer and SAN

– Management

UCS Manager embedded

y Vblock Configuration

– Always configured in pairs

Availability

Performance and load balancingPerformance and load balancing

– Vblock 0 - 6120 Fabric Interconnect

(20) 10 Gb fixed ports to blade chassis/aggregation layer

– Vblock 1 - 6120 Fabric Interconnect

(4) 4 Gb Ports to SAN fabric

– Vblock 2 – 6140 Fabric Interconnect

(40) 10 Gb fi d t t bl d h i / ti l

(8) 4 Gb Ports to SAN fabric

(27)

Unified Computing System (UCS)

Vblock Fabric Interconnects Design Considerations

y Availability

– Always installed in pairs

– Redundant power and cooling p g

y Predictable performance

– Maximum of 4:1 oversubscription (downstream vs upstream)

B l d fi ti

– Balanced configuration

y Scalability and flexibility

Fabric Interconnects Fabric Interconnects

(28)

Unified Computing System (UCS)

Vblock Chassis Configuration

y Cisco UCS 5100 Series Blade Server Chassis

– (8) Blades per chassis (8) Blades per chassis

– (2) 2104XP Fabric Extenders

– Redundant Power and Cooling

y Vblock Configuration

– Vblock 0

2 Blade Chassis

– Vblock 1 & Vblock 1U

2 to 4 Blade Chassis

– Vblock 2

4 to 8 Blade Chassis

(29)

U ifi d C ti S t (UCS)

Unified Computing System (UCS)

Vblock Blade Configuration

y Cisco UCS B-200 Blade Server Cisco UCS B 200 Blade Server

– 8 Blades per Chassis

2 Intel® Xeon® 5500, 5600 Series processors

Converged Network Adapter (Unified Network)

• vNIC

• vHBA

Internal connections to both Fabric Extenders

– Vblock 0 Vblock 0

4 - 16 blades

192 - 768 GB memory (48 GB per blade)

(2) 73 GB internal HDD

– Vblock 1 and Vblock 1U

16 - 32 blades

960 - 1920 GB memory

• 6 blades/chassis = 48 GB6 blades/chassis 48 GB

• 2 blades/chassis = 96 GB

– Vblock 2

32 - 64 blades

3072 - 6144 GB memory (96 GB per blade)

(2) 73 GB internal HDD

(30)

Unified Computing System (UCS)

Vblock Chassis Configuration Design Considerations

y Availability

– Two Fabric Extenders (FEX) per Chassis

– Each blade as two connections (one to each FEX)

– N+1 cooling and power

y Predictable Performance

– 2:1 Over-subscription – But still full 10 Gb to each blade p

– Balanced configuration

– Distribute vHBA and vNIC between fabrics

Slots statically pinned to a link Compute ChassisCompute Chassis

Fabric Fabric Fabric

Fabric

– QoS

BB credits for FC traffic

Non-FC traffic can be assigned different weights

I I

x8 x8 x8

x8

C C

R R Fabric

86 C t

86 C t 86 C t

X B B

X X X X X

P

M P

Adapter

x86 Computer

(Half slot)

(Full slot)

(31)

Unified Computing System (UCS)

Vblock Chassis / Blade Configuration

y Availability

– N+1 blades per chassis

– vNIC routing between fabrics vNIC routing between fabrics

– OS (Powerpath) vHBA failover

y Predictable performance

Dual quad core Xeon® 5500 or dual hex core Xeon® 5600 processors

– Dual quad core Xeon® 5500, or dual hex core Xeon® 5600 processors

– Balanced configuration

Network

MemoryMemory

Compute

y Scalability and flexibility

– Virtualize everything

– VLAN, trunks and port groups

(32)

What’s in the Vblock?

y Unified Computing System (UCS)

– Cisco UCS 6100 Series Fabric Interconnects

Cisco UCS 5100 Series Blade Ser er Chassis

– Cisco UCS 5100 Series Blade Server Chassis

Cisco UCS B-200 Blade Server

• 48-96 GB Memory

• Converged Network Adapter (Unified Network)

– Unified Network

y Storage

EMC CLARiiON CX4

– EMC CLARiiON CX4

– EMC Symmetrix V-Max

– EMC Celerra NS-120

EMC C l NAS t

– EMC Celerra NAS gateway

– Cisco MDS Fibre Channel switch

(Not required for Vblock 0 & Vblock 1U)

y VMware vSphere p

(33)

Storage: Vblock 0

Vblock 0

CELERRA NS-120 Minimum Maximum

Enterprise Flash Drives (EFD) 400GB 0 0

15K Fibre Channel 600 GB 11 22

SATA 1TB 6 30

Total Drive 17 52

Total Capacity* 12 TB 42 TB

(34)

Storage: Vblock 1, Vblock 1U

Vblock 1U

CELERRA NS-960 Minimum Maximum

SATA 1TB 26 47

Total Drive 115 193

Vbl k 1 Vblock 1

CLARiiON CX4 480 Minimum Maximum

1 K Fib Ch l 4 0 GB 9 140

SATA 1TB 17 23

Total Drive 105 180

* 70% of raw capacity

(35)

Storage: Vblock 2

Vblock 2 Vblock 2

Symmetrix V-Max (1 or 2 Engine) Minimum Maximum

15K Fib Ch l 450 GB 125 230

SATA 1TB 78 100

Total Drive 220 355

(36)

Storage: Configuration

y Storage configuration are application specific

y Logical device considerations*

– LUN size

Consistent size based on application requirements

– RAID Protection

RAID 1

RAID 5 RAID 6

RAID 6

– LUN aggregation using meta devices

Size

Performance

Virtual Provisioning – Virtual Provisioning

Thin Pool

Thin Devices/Fully allocated

y Simplifies storage provisioning

St Ti b d d i d t ti

– Storage Tiers based on drive and protection – Storage Templates

– Storage Policies

y Local and remote replication requirements Local and remote replication requirements

* Existing Best Practices Apply

(37)

Storage: Optional File Services

y File Server for Vblock 1 and Vblock 2

– Gateway configuration sharing CLARiiON or

Symmetrix storage

– Vblock 1 NS-G2

2 Datamovers

– Vblock 2 NS-G8

2 – 8 Datamovers

– May be shared across multiple Vblocks May be shared across multiple Vblocks

(38)

Storage Area Network

y Vblock 0 and Vblock 1U

– (2) Cisco Nexus 5010

Optional (8) 4 Gb N-ports to each Fabric Interconnect

y Vblock 1

– (2) Cisco MDS 9222i or 9506

(8) 4 Gb N-ports to each Fabric Interconnect

(4-8) 4 Gb N-ports to each CLARiiON Storage Processor

Recommend MDS 9506 if >3 Vblock 1

y Vblock 2

– (2) Cisco MDS 9506

(8) 4 GB N-ports to each Fabric Interconnect

(8-16) 4 GB N-ports to each Symmetrix V-Max ( ) p y engine

y Zoning and VSAN

– Based on application requirements and existing best practices

(39)

Storage Design Consideration

y Balanced configuration

– Capacity, connectivity, workload (IOPs / MBs)

y Availability

– Enterprise class storage

– RAID protection

– Extensive remote replication capabilities using MirrorView and SRDF

y Predictable Performance

– Large cache

– Tiered storage including FC, SATA and Enterprise Flash Drives (EFD)

y Ease of deployment and management

– Template based provisioning

– Wizards

S ( S )

– Fully Automate Storage Tiering (FAST)

– Virtual Provisioning

– Local replication capability using SnapView and TimeFinder

(40)

Vblock Infrastructure

Packages:

O M t

Open Management

Framework

(41)

Vbl k O M t F k

Vblock Open Management Framework

Single Point of Management, Extensible Integration Framework

y Unified Vblock Management

Interface

Consolidated view into all

Enterprise Systems Management Platforms

C fi ti d A il bilit d

Enterprise Monitoring Platforms

Vblock infrastructure Single integration point

y IT self-service portal

Configuration and Compliance Events

Availability and Performance Events

p

Mini service catalog and dashboard for self-

provisioning

Unified Vblock Element Management

Provides Vblock Self-Service Portal, Service Profile

C l P li B d M U ifi d

Example: EMC Ionix UIM

y Policy-based management

Fine-grained tracking, traceability, reproducibility

Catalog, Policy Based Management, Unified Provisioning, Config and Change, Configuration Compliance Analysis, Infrastructure Recovery (DR)

System-wide compliance and remediation

y Automated discovery and

Vblock

vCenter UCS Manager

Symmetrix Management Console

or

Vblock

C UCS M

Symmetrix Management Console

Vblock

y

deployment

UCS Manager Management Console ^Navisphere ^vCenter or

Navisphere vCenter

UCS Manager

Symmetrix Management Console or

Navisphere

(42)

Policy Driven IT Infrastructure…

IT Requirements

# VMs

Disk Capacity (MB) Synchronous Replication

Storage Template Compute Template

Fabric Template Application Template p

Fault Tolerant?

Security Policy Etc…

y Templates ensure repeatable, compliant IT processes

Define Map Deploy

p p p p

– IT defines storage, server, fabric and application and OS configuration

policies to meet the business SLAs

y Resources rapidly assigned according to IT policies and SLA reducing Resources rapidly assigned according to IT policies and SLA reducing

time to application availability

y Reduces configuration error and non-compliance

Reduce downtime and risk, Improve compliance

(43)

Vblock Infrastructure

P k

Packages:

High Availability

Framework

(44)

Hi h A il bilit i th Vbl k

High Availability in the Vblock

Physical redundancy

9 Stateless compute, storage,

hypervisor

9 Redundant Storage Processors

9 R d d t SAN S it h

9 Redundant SAN Switches

9 Redundant Fabric Interconnects

9 Redundant Fabric Extender

9 Dual-port Mezzanine Cards

9 Redundant fan trays

9 Grid Redundant PSUs

(45)

Vbl k I f t t P k

Vblock Infrastructure Packages

Accelerating the Journey to Pervasive Virtualization and Private Cloud

Benefits:

y Improve business responsiveness

R d i k d ti

y Reduce risk and operating expenses

y Support and manage Service-Level

Agreements

– Resource allocation & utilization

– Security & Compliance

• Seamless integration with existing

Management & Security frameworks

y Ensure security and minimize risk

with certification paths

Secure, Extensible, SLA-driven, Infrastructure

(46)

Th k Y

Thank You

(47)

High Availability in the Vblock

Failure Recovery Mechanism

vNIC/vHBA Path Failure • Redundant Unified I/O Fabrics

• Automatic Fabric Failover for vNIC Automatic Fabric Failover for vNIC

• EMC PowerPath for vHBA

Blade Failure / Mezz Card Failure • HA Clustering across blades

Interconnect Failure • Redundant Interconnect modules

Server/Chassis Failure • VMware HA & FT

Storage Component Failure • EMC PowerPath

• HA Storage Architecture

• RAID Protection

ESX Failure VMware HA & FT

ESX Failure • VMware HA & FT

Fibre Channel Uplink Failure • UCS Fabric Interconnect Pinning

• EMC PowerPath

(48)

Vblock Disaster Recovery

Granular, Service-Aware Recovery options

Vblock

^A

Vblock

^B

Vblock

^DR

VM F

VM F¹

VM

Geo- F

Cluster

SRM

OTV

Vblock Vblock Vblock

Local Cluster

VM VM C1

C1

VM C3

VM VM C5

C4

VM C6

VM VM

VM A¹ VM

FT A ^VM_A

SRM

VM

SRM A

HA

PP/ve

VM B

vSphere vSphere vSphere

OTV OTV

VM B

DRS

VMFS

A-F A, F

Synchronous

Replication Asynchronous

Replication

VMFS A-F

RAID PP/ve

FC, FCIP FCIP

Remote

Local Geographically

p Replication

RAID