IBM System Networking

© 2011 IBM Corporation

IBM System Networking

Marco Modonesi

Sales Specialist Networking – System X - STG [email protected]

IBM/BNT Industry Leading Innovation

Management Innovation

RackSwitch Innovation

Virtualization Innovation

Blade Innovation

Network intelligent blades enable workload optimized systems

Enables virtualization within the network at the rack level

Provides Virtual Machine-aware networking

Multi-vendor virtual machine network configuration Experienced Data Center

Networking Team

System Perspective

Skills, Resources and Technology

Proven and Sustainable Industry Leading Technologies

IBM market leader in Data Center Networking/

Premium Product

IBM Acquisition of BLADE Network Technologies



#1 embedded blade switch over past 7 years



#3 overall for 10Gb fixed Ethernet ports

1



In 350 of the Fortune 500 Companies



First to deliver CEE blade switch & 40Gb Switch

1 _{Ethernet Switch Report, 1Q10, Dell’Oro Group, May 2010}

2 _{http://networkworld.com/news/2010/092710-ibm-acquires-blade-network-technologies.htm}

Ability to meet existing and future requirement

“BLADE Network Technologies, An IBM Company, a leading network company with worldwide presence, is focused solely on the datacenter. BLADE offers customers the ability to meet existing and future network edge and unified fabric requirements.”

BLADE #2 Data Center Fabric Vendor/

Ability to execute

10 millions ports in productions!

Worldwide Data Center Switch Shipments

Source: Competitve Landscape Data Center Ethernet Switches, Worldwide, Gartner july 2009

Gartner Magic Quadrant for Enterprise LAN

IBM

IBM re-entered the LAN switching Magic Quadrant with its purchase of BNT in late 2010. BNT was founded to provide switch technologies for the emerging blade server market. With growing success with partners such as IBM and HP, BNT broadened the portfolio to include ToR switching for a more complete server access portfolio. An increasing amount of BNT business was with IBM, so the acquisition made sense for both parties.

Strengths

IBM has a comprehensive line of blade server switches, as well as ToR switch options running at 1/10/40G. The offering

provides strong capabilities to deal with virtual environments through BNT's VMready software, which allows visibility and control down to the individual virtual machine (VM) level.

IBM has extensive experience designing and operating complex data center networks. Owning part of the technical solution will allow it to expand capabilities for server access.

Cautions

While the BNT solution is a strong one, it only represents part of a data center networking solution.

IBM has been absent from the networking hardware market for more than a decade (it sold off its hardware business to Cisco in 1999), and therefore lacked networking expertise within the IBM hardware organization.

It is not completely clear what IBM's complete networking strategy is at this stage, and sorting out various IBM-owned products, OEM products from the likes of Brocade and Juniper and long-standing integration partnerships with Cisco and others will not be easy for IBM or its channels until it provides a more complete strategic direction.

Source: Gartner, August 2011

―… we are also seeing vendor specialization to provide

differentiation in specific segments, including the emergence of data-center-focused vendors — the most obvious and successful to date has been Blade Network Technologies (BNT; evaluated in this research after its acquisition by IBM), which has expanded its portfolio to include top-of-rack (ToR) switches.‖

Where do we Fit?

STORAGE NETWORKING

•Financial & Insurance Sector: Proximity trading, HFT, Colo, Risk Analysis

•High-Performance Computing: University, research sector, Automobile

•Telco & Cloud Provider: IPTV, Streaming content, hosting services

•Server Virtualization projects: General IT, 20+ servers

•vNIC: General IT, reducing cabling, 50+ servers

•IP NAS: iSCSI, NFS 1/10GE connections

•FCoE: Switching fabric convergence

IT Concerns



Today clients have separate networks for

each type of Traffic

– Ethernet for the LAN

– Fiber Channel for the SAN

– Infiniband in some cases for the HPC



These Networks are Extremely expensive

– Hardware costs

• Separate Server adapters

• Separate Fabric switches

• Separate Cabling

– Large power draw

– Complex to Manage

Fabrics _Targets LAN SAN HPC Servers

Traffic pattern is the KEY

Campus

Data Center

5%

95%

up to 75%

>25%

In Data Centers there is a huge amount of transfers between servers because of multi tier architecture and VM Motion

Typically about 95% of traffic from the PC’s are directed outside the Campus Network. Only a small amount is going peer to peer.

Five IT trends reshaping Data Center Networks

GW FC SAN North/ South East/ West #3 Distributed Apps -» low-latency switching #2 VM mobility

-» flatter, VM-aware, networks

#1 Sys Virtualization

-» network congestion

#5 Energy constraints

-» Energy Efficiency (“Green”)

#4 Convergence

-» lossless Ethernet

IBM: Up to 11.5 times lower latency

IBM: VMready™

IBM: 1, 10, and 40Gb switches *Up to 84% better Price/Performance IBM: Up to 71% less power

consumption, and choice of air flow

IBM: All 10Gb switches support lossless Ethernet

Ethernet Storage High level view

iSCSI CIFS NAS FC Arrays Fibre Channel

Lossless

Ethernet

Gateways NFS NAS FCoE

The Trend is Clearly Toward Converging Storage over Ethernet (by 2014 ~70% of all non-DAS Server Ports will be Ethernet). SourceIDC Oct 2010

IBM/BNT Virtual Fabric - supporting FCoE



Servers are connected with a unique switching fabric: 10GE



Storage traffic (Fiber Channel, iSCSI, NFS, etc.) is carried over

the lossless Ethernet capabilities of the G8124/G8264



Ethernet traffic is sent to the LAN, Fiber Channel storage traffic

is send to the SAN

SAN

LAN

Fibre Channel Ethernet Fibre Channel Traffic

Ethernet _RackSwitch IBM BNT



A surprising number of enterprises today have “Ethernet only data centers”.



iSCSI storage is one of the fastest grow areas in the storage Market.



“FCoE will be the primary alternative to FC as a storage network fabric.”

IBM/BNT Virtual Fabric - virtualizing NIC

Traditional Networking

Production Network DMZ VM Network Console Network Vmotion Network

VFA Topology

 Divide a 10G adapter port into 2, 3 or 4 adjustable virtual pipes

− Reduce cost and complexity

− Less switch ports, cable and overhead

− Meet the need for more bandwidth and flexibility



For 100 Servers

–

35% less CAPEX

–

4x less cables & space

–

6x better energy

efficiency

 Flexibility to control Bandwidth

VMready switch VM 1



VMready works with any server hypervisors.



Automatically detect and move Network configuration when the Virtual Machine

(VM) moves.



VM can move across switches and datacenter, even through third party switches.



VMready will comply to IEEE 802.1Qbg once ratified.

VM 2 VM X

Virtual Switch Virtual Switch

Virtual port

VLAN 100 ACL filters TX/RX limits

VMready switch

 Enterprise Data Center Network Virtualization

 VM Detection: automatically discovers and identifies the Virtual Machines

 VM groups – Grouping of similar Virtual Machines to simplify management tasks

 NMotion™ - Automatically track migrating VMs to maintain network configuration

 Vendor Neutral

 VMready works with all major virtualization offerings

 Integration with VMware vCenter

 Single pane of management for both VMready switches and ESX vSwitches

 Rich display of VM info such as IP addresses, VM name and ESX server location

 Low cost – Software license included with RackSwitch

 Software runs on switch, not the servers

 Accounting and Auditing

 VM Migration is detected by VMready and reported

 Traffic per VM can be audited

IBM BNT Cisco Nexus 1000v License w/ Switch $695 per CPU

Open VMware only Enterprise +

Runs on switch Runs on server

Simplify VM mgmt tasks Limited

Dell/HP nothing

Network Virtualization - VMready™ benefits

The OpenFlow Networking Revolution

OpenFlow enables network logic to move into the application stack,

decoupling network software from hardware

ハードウェア パケット転送機能 ソフトウェア 通信経路制御機能 OpenFlow Controller Communication Path Control ProgrammableFlow Switch Packet Forwarding Existing network Autonomous and distribution control Isolation

OpenFlow based Network

Central

control

Integration IT&NW integration Software Communication path controlling function Hardware Packet transferring function

Black box Network OSPF/

BGP

Board Members

Deutsche Telekom

Facebook

Google

Microsoft

Comcast

Verizon

Yahoo!

Members

IBM* Infoblox Intel IP Infusion Ixia Juniper Networks Marvell Mellanox Technologies Metaswitch Networks Midokura NEC* Netgear* Netronome Nicira Networks

Nokia Siemens Networks

OpenFlow Lab

* = Demonstrated at

NTT Plexxi Inc. Pronto Systems Riverbed Technology Vello Systems VMware Big Switch Networks*

Broadcom Brocade* Ciena Cisco Citrix Comcast CompTIA Dell* Ericsson Extreme Networks* Force10 Networks Fujitsu HP* Huawei Technologies

IBM’s BNT Switches for IBM BladeCenter

BNT L2/3 Copper Gigabit Ethernet Switch Module BNT L2/3 Fiber Gigabit Ethernet Switch Module BNT Layer 2-7 Ethernet Switch Module 32R1860 32R1861 32R1859 BNT 1/10Gb Uplink Ethernet Switch 44W4404

•Cost sensitive customers

• More upstream bandwidth

• Better Load-sharing

•Choice of Copper or Fibre

• Advanced Layer 3 Support

• Support for larger networks

• Better Latency

• Better Security

• Better Traffic Control

• Want Load Balancing

• Apps needing Layer 4-7

• Advance Security

•Denial Service

•SYN attacks

•Better scalability

•Servers and Apps

•Great for web servers, VOIP, firewall, VPN, Microsoft Terminal Server

•Same benefits as L2/3

• Investment Protection

•1G today 10G tomorrow

• Great for Virtualization

• No IBM Cisco offering

• SmartConnect SW •Stacking •Simple GUI •Grouping •VMready Major Advantages BNT Virtual Fabric 10G Switch 46C7191 • Choice 1G, 10G or mix • CEE/FCoE • Low Latency • Max. bandwidth

• Virtual Fabric - vNIC

• VMReady (Nmotion)

• Target – Virtualization, HPC, Clusters, Financial Analytics, Medical imaging, Surveillance, rendering, telcom, iSCSI, VOD, etc…

IBM RackSwitch Portfolio

IBM BNT RackSwitch G8000

IBM BNT RackSwitch G8052

R, F & DC models R & F models

• 44 ports 1G, RJ-45

• 4 ports 1G, SFP

• 4 ports 10G, CX4 or SFP+ uplinks optional

• Redundant fans and power supplies IBM BNT RackSwitch G8124 R, F & DC models IBM BNT RackSwitch G8264 R & F models • 48 ports 1G, RJ-45 • 4 ports 10G, SFP+ uplinks standard • Hot-swap redundant fans & power supplies

• 24 ports 10G SFP+

• Low Latency – 680ns

• Redundant fans and power supplies

• 48 ports 10G SFP+

• 4 ports 40G QSFP+ (option: 16x10Gb ports)

• Low Latency - 1.1us

• Hot-swap redundant fans & power supplies

VMready: The industry’s 1st _{automated Virtual Machine-aware networking}

Energy Efficient, Choice of Front-to-Rear or Rear-to-Front Airflow

Lossless Ethernet (CEE/DCB) IBM Virtual Fabric

Tolly’s Report Key Findings

 Up to 11.5 times lower latency

 Up to 100 times more buffer capacity

 Up to 71% less power consumption

 Up to 84% better price performance

 40 Gbps ports

Lowest latency

Best packet buffering – no packet loss

View Full BENCHMARK report at:

G8264 – perfect building block

for Data Center networks

Distributed Switching compared to large “core switch”:



Higher Bandwidth



Lower latency



Access to latest technology



Lower cost



Less rack space, power & cooling

Spine Switches connect racks

Top of Rack switches connect servers

Emerging Data Center Architecture - TRILL

Key enabling technology: TRILL

New IETF standard – “Transparent

Interconnection of Lots of Links”



G8264 aggregating 1GE switch with 10GE uplinks



Full L2 & L3 capabilities



Small foot-print, non-blocking performances & low latency



Easily scalable to several thousands server ports

G8264

G8052

10GE 1 GE 1 GE 1 GE 1 GE

Emerging Data Center Architecture – G8264 backbone



Stack G8264 as you grow



Network “intelligence” is at the

rack level



Control deployment costs



Adjust over-subscription or not

depending on the applications

requirements



Minimal & incremental footprint

10 GE 10 GE 10 GE 10 GE



Ports

– 16 QSFP+ 40GbE ports

 Up to 64 10GbE ports via breakout cables



Very similar to RackSwitch G8264

– Same switch ASIC – Same software

– Same power supplies – Same Fans



Faster MP than G8264

– Quad Core for increased scalability



Single ASIC design

– Predictable line rate performance – Low power consumption



BLADE OS 6.8



Full Layer 2/3



GA: Q1 2012

1U

16x QSFP+ ports

 Active/Active uplinks

– Traffic load balanced across all uplinks using proven Layer 3 ECMP

– No blocked links

 768 10GbE Server ports

– 16 RackSwitch G8264 leaf switches

– 4 RackSwitch G8316 spine switches

– 48x SFP+ 10GbE server-facing ports each

4x 40GBASE-SR4 fiber or QSFP+ DAC Uplinks each

4 RackSwitch G8316“spine” switches

16 RackSwitch G8264 “leaf” switches



Ports

– 48 10GBase-T ports (All 10G / 1G) – 4 QSFP+ ports (All 40G / 10G )



Very similar to RackSwitch G8316

– Same switch ASIC – Same MP & memory – Same software



Needed for 10GBASE-T

– New PHYs

– New power supplies – New fans



Stacking

**

(up to 8 switches)



BLADE OS 6.8 at GA



Full Layer 2/3



GA: Q2 2012

48x 10GBase-T ports 4x QSFP+ ports 1U **Post GA

Roadmap – RackSwitch G8264-T

4x QSFP+ ports



Ports

– 12 Dual Pers. Ports (1G/ 2G / 4G / 8G / 10G – 36 SFP+ Ports (All 10G / 1G)

– 4 QSFP+ ports (All 40G / 10G )



Same switch ASIC as G8264-T

– Broadcom Trident+, no PHY



Same processor as G8264-T

– Quad Core for scalability



Same system memory as G8264



Stacking

**

(up to 8 switches)



FCoE FF-BB-5 Compliant – FCF

Gateway



Full Fabric Support



NPIV Transparent gateway mode



BLADE OS 6.8 at GA



Full Layer 2/3



GA: Q2 2012

Breaking free of the Single Vendor Network

Interoperability

Tolly Group actually does Interoperability certifications Layer2/3

−Support Cisco Proprietary protocols:

Giga/Fast/EtherChannel, PVST+, MIST, PortFast, UplinkFast, TACACS+, etc.

Easing the transition for administrators

All IBM BNT products offer a “Cisco-like”

Command Line Interface (CLI)

Web GUI, BLADEOS CLI, BLADE Harmony Manager, IBM Director, etc.

Morgan Stanley: “BNT’s products to be the most effective for our purposes”

• “We have found IBM BNT’s products to be the most effective for our purposes with a

combination of performance and cost that are hard to match. For our company, this is the first use of a multi- vendor strategy, and we have been able to build out infrastructure in a more cost-efficient manner. Robert VanCaneghem – Morgan Stanley Executive Director

Gartner Group “Debunk the Myth of the single vendor network”

• Introducing a 2nd _{networking vendor will reduce TCO for most organization}

by at least 15-25% over 5 years

• Equipment cost premium that Cisco generally charges does not tend

Thank You!

IBM System Networking : Q&A

Marco Modonesi

Networking Sales Specialist – System X – STG

[email protected]