Brocade VCS Fabric Technology with the EMC Isilon NAS Storage Array

(1)

53-1003929-02

October 2015

Brocade VCS Fabric

Technology with the EMC

Isilon NAS Storage Array

Validation Test Report

(2)

ADX, Brocade, Brocade Assurance, the B-wing symbol, DCX, Fabric OS, HyperEdge, ICX, MLX, MyBrocade, OpenScript, The Effortless Network, VCS, VDX, Vplane, and Vyatta are registered trademarks, and Fabric Vision and vADX are trademarks of Brocade

Communications Systems, Inc., in the United States and/or in other countries. Other brands, products, or service names mentioned may be trademarks of others.

Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to this document at any time, without notice, and assumes no responsibility for its use. This informational document describes features that may not be currently available. Contact a Brocade sales office for information on feature and product availability. Export of technical data contained in this document may require an export license from the United States government.

The authors and Brocade Communications Systems, Inc. assume no liability or responsibility to any person or entity with respect to the accuracy of this document or any loss, cost, liability, or damages arising from the information contained herein or the computer programs that accompany it.

The product described by this document may contain open source software covered by the GNU General Public License or other open source license agreements. To find out which open source software is included in Brocade products, view the licensing terms applicable to the open source software, and obtain a copy of the programming source code, please visit http://www.brocade.com/support/oscd.

(3)

Preface...5

Overview... 5

Purpose of This Document...5

Audience... 5

Objectives... 5

Document History...6

About Brocade... 6

About EMC...6

Configure DUT and Test Equipment...7

Task 1. Brocade VDX Switch Configuration—Logical Chassis Mode...7

Task 2. EMC Isilon Configuration...7

Task 3. Windows Host Configuration... 10

Task 4. Red Hat Linux Host Configuration...15

Task 5. Medusa I/O Generation Configuration...15

Network OS 6.0.1 Test Report... 17

Test Plan... 17 Scope... 17 Test Configuration...18 DUT Descriptions... 19 DUT Specifications...20 DUT Configuration... 21 Related Documents...24 Test Cases... 24 1.1 Base Functionality...25 1.2 Advanced Functionality... 26

1.3 Stress and Error Recovery...30

1.4 Brocade Network Advisor...34

Test Conclusions...36

(4)

(5)

Preface

● Overview... 5

● Purpose of This Document...5

● Audience... 5 ● Objectives... 5 ● Document History...6 ● About Brocade... 6 ● About EMC...6

Overview

Many data centers use network attached storage (NAS) for a variety of applications and workloads. As more data is stored on NAS, efficient network designs are under evaluation to minimize latency, to maximize the use of interswitch links between switches, and to automate network configuration changes. For these reasons, Brocade VCS Fabric technology with Brocade VDX switches is increasingly being deployed when new NAS arrays are added to the storage pool.

Purpose of This Document

The goal of this document is to validate Brocade VCS Fabric technology with the EMC Isilon NAS storage array. The testing includes cases that demonstrate VCS Fabric feature support, high availability and resiliency, and automatic network reconfiguration when links are added or removed. This document provides validation test results for typical use cases of NAS with Brocade VCS Fabric technology and EMC Isilon NAS storage arrays.

Audience

This document is written for a technical audience, including solution architects, system engineers, and technical development representatives.

Objectives

1. Validate interoperability with redundant and nonredundant network topologies with Brocade VCS Fabric technology and EMC Isilon.

2. Identify any unique configuration details necessary to establish end-to-end connectivity. 3. Simulate real-world customer environment perturbation and validate end-to-end behavior and

(6)

Document History

Date Version Description

06-29-2015 1.0 Initial version.

10-20-2015 2.0 Updated the initial configuration in

the "Configure DUT and Test Equipment" section. Added "Full Network Operating System Configuration" section.

About Brocade

Brocade networking solutions empower the world's leading organizations to transition smoothly to a world where applications and information reside anywhere. By delivering agility and innovation for cloud-based environments, Brocade helps organizations modernize their networks and accelerate their journey to the New IP.

In particular, Brocade solutions for storage networking, data center routing, software-defined

networking (SDN), and network functions virtualization (NFV) empower organizations to capitalize on the unique business opportunities driven by virtualization and the cloud.

To deliver a best-in-class solution, Brocade partners with world-class IT companies around the globe

www.brocade.com

About EMC

EMC offers data storage, information security, virtualization, analytics, cloud computing, and other products and services that enable businesses to store, manage, protect, and analyze data.

(7)

Configure DUT and Test Equipment

● Task 1. Brocade VDX Switch Configuration—Logical Chassis Mode...7

● Task 2. EMC Isilon Configuration...7

● Task 3. Windows Host Configuration... 10

● Task 4. Red Hat Linux Host Configuration...15

● Task 5. Medusa I/O Generation Configuration...15

This section describes the initial configuration of devices under test (DUTs)and test equipment. In some test cases, additional configuration changes are made.

Task 1. Brocade VDX Switch Configuration—Logical Chassis Mode

On the VCS cluster, configure VLAN 979 interfaces on all cluster members. Configure the VLAG interfaces connecting to Windows and Red Hat hosts as well as the NAS storage array.

NOTE

See the "DUT Configuration" section of each validation test report for applicable configuration commands.

Task 2. EMC Isilon Configuration

This section describes the EMC Isilon and share configurations.

NOTE

Screen captures are from OneFS 7.0.1.10 and are also applicable to OneFS 7.1.1.4. 1. Physical Interface Configuration

(8)

FIGURE 1 EMC Isilon Physical Interface Configuration

2. SMB Share Configuration

Configure an EMC Isilon Windows share (SMB) and allow full access.

(9)

FIGURE 2 EMC Isilon SMB Share Configuration

3. NFS Share Configuration

Configure an EMC Isilon UNIX share (NFS) and allow full access.

(10)

FIGURE 3 EMC Isilon NFS Share Configuration

Task 3. Windows Host Configuration

Configuring and mapping windows hosts for the VCS cluster. 1. Configure Windows 2012 Server Hosts for Ethernet Teaming

Configure the Windows 2012 Server NIC teaming interface for connectivity to the VCS cluster.

(11)

FIGURE 4 Windows 2012 NIC Teaming

2. Configure Windows 2008 Server Hosts for Ethernet Teaming

Configure the Windows 2008 Server NIC teaming interface for connectivity to the VCS cluster using the Brocade Host Connectivity Manager.

(12)

FIGURE 5 Windows 2008 NIC Team Using the Brocade Host Connectivity Manager

3. Map EMC Isilon Network Shares on Windows 2012 Server Map network drives on Windows 2012 Server hosts.

(13)

FIGURE 6 Windows 2012 NIC Team Configuration—Screen 1

FIGURE 7 Windows 2012 NIC Team Configuration—Screen 2

4. Map Network Drives on the Windows 2008 Server

(14)

Map network drives on Windows 2008 Server hosts.

FIGURE 8 Windows 2008 Network Drive Mapping—Screen 1

FIGURE 9 Windows 2008 Network Drive Mapping—Screen 2

(15)

Task 4. Red Hat Linux Host Configuration

This task describes configuring NIC bonding and mounting shares on Red Hat Linux. 1. Configure NIC Bonding

The following are the entries within /etc/sysconfig/network-scripts/ on Red Hat hosts to enable Ethernet bonding, or NIC bonding.

< =========== > ifcfg-eth4 DEVICE=eth4 BOOTPROTO=none ONBOOT=yes MASTER=bond0 SLAVE=yes USERCTL=no NM_CONTROLLED=no ifcfg-eth5 DEVICE=eth4 BOOTPROTO=none ONBOOT=yes MASTER=bond0 SLAVE=yes USERCTL=no NM_CONTROLLED=no ifcfg-bond0 DEVICE=bond0 IPADDR=9.79.100.21 NETMASK=255.255.0.0 ONBOOT=yes BOOTPROTO=none USERCTL=no NM_CONTROLLED=no

BONDING_OPTS="mode=802.3ad miimon=100 downdelay=5000 updelay=5000" < =========== >

2. Mount NFS Disk Shares

The following commands mount EMC VNX VG2 NFS shares on hosts that are running Red Hat 6.5 or 6.3.

< =========== >

mount -t nfs 9.79.10.1:/ifs/data/NFS_ROBERT/REDHAT_66.109 /mnt/isilon mount -t nfs 9.79.10.1:/ifs/data/NFS_ROBERT/REDHAT_79.141 /mnt/isilon < =========== >

Task 5. Medusa I/O Generation Configuration

The following shows the configuration of the Medusa I/O data patterns used in the test cases. 1. Standard I/O with 64KB Blocks

For test scenarios using standard I/O (64-KB testing size), configure Medusa for the following command line result:

< =========== >

pain 1600MB -b64KB -v180 -H1 -l35 -Y1 -M180 < =========== >

2. Maximum I/O with 1-MB Blocks

(16)

For test scenarios using maximum bandwidth I/O (1-MB testing size), configure Medusa for the following command line result:

< =========== >

maim 1600MB -b1MB -Q8 -n -u -q5 -w -o -Y1 -M180 --perf-mode < =========== >

3. Microsoft Exchange Server I/O

For test scenarios using Microsoft Exchange Server Simulation (Medusa preconfigured Storage Simulation test), configure Medusa for the following command line result:

< =========== >

maim 1600MB -%r50@4KB -%w25@64KB -%w25@4KB -Q1 -n -u -q5 -o -l69 -Y1 -M180 < =========== >

4. File Server I/O

For test scenarios using File Server Simulation (Medusa preconfigured Storage Simulation test), configure Medusa for the following command line result:

< =========== >

maim 1600MB %10:r80@512B,w20@512B %5:r80@1KB,w20@1KB %5:r80@2KB,w20@2KB %60:r80@4KB,w20@4KB %2:r50@8KB,w50@8KB %4:r75@16KB,w25@16KB

-%4:r75@32KB,w25@32KB -%10:r80@64KB,w20@64KB -Q1 -n -u -o -l69 -Y1 -M180 < =========== >

(17)

Network OS 6.0.1 Test Report

● Test Plan... 17 ● Related Documents...24 ● Test Cases... 24 ● Test Conclusions...36

Test Plan

Scope

The storage array is connected to one Brocade VDX Ethernet fabric with multiple server hosts to drive I/O. Testing is performed with the Brocade Network OS in a heterogeneous environment. Test beds include Brocade switches configured in routed and nonrouted fabric configurations.

Testing is centered on interoperability and optimal configuration. Performance is observed within the context of best-practice fabric configuration; however, absolute maximum benchmark reporting of storage performance is beyond the scope of this test.

(18)

Test Configuration

FIGURE 10 Test Topology

The following figure shows VCS Fabric switch port connections and vLAG (port-channel) ports for each server and the EMC Isilon NAS Storage Array. For example, “1/0/1” means that the device port connects to RBridge# = 1, Card# = 0, and Port# = 1. For fixed top-of-rack switches such as the Brocade VDX 6720, 6730, and 6740, there are no port cards, which is indicated by “0” for the Card#.

(19)

FIGURE 11 Device to VCS Fabric Switch Port Connections

DUT Descriptions

The following tables provide details about the devices under test (DUTs). Storage Array

TABLE 1

Model Vendor Description

Isilon X200 EMC Network attached storage (NAS) array

Switches

TABLE 2

Model Vendor Description

(20)

Switches (Continued)

TABLE 2

BR-VDX6740 Brocade The Brocade VDX 6740 and 6740T are Ethernet fabric top-of-rack (ToR) switches featuring 10-GbE ports with 40-GbE uplinks. The Brocade VDX 6740T-1G Switch offers dual-speed functionality. It can be deployed with 1000BASE-T for existing 1-GbE server connectivity and can be upgraded via software to 10GBASE-T for future bandwidth growth. Together with Brocade VCS Fabric technology, these switches deliver the high

performance and low latency needed to support demanding virtualized data center environments.

DUT Specifications

NAS Array Version

EMC Isilon OneFS 7.1.1.4

Brocade Switches Device ID Version

VDX 6740 CASTOR-VCS20-1 Network OS 6.0.1

Adapters Version

Brocade 1020 3.2.5.1 (Red Hat Enterprise Linux 6.6) Brocade 1860 3.2.5.0 (Windows Server 2008) Brocade 1860 3.2.3.0 (ESXi 5.5u2)

Emulex OCe14102 10.4.255.25 (Windows Server 2012)

Servers Memory Processor

IBM x3650 M3 8 GB E5506 @ 2.13 GHz

IBM x3650 M3 32 GB E5506 @ 2.13 GHz

HP ProLiant DL380 G7 8 GB E5506 @ 2.13 GHz

Cisco UCS B200 M3 (x4) 64 GB E5-2600 @ 2.10 GHz (x2)

(21)

Operating Systems Version

ESXi 5.5u2 (x2)

ESXi Guests Windows Server 2012 R2 (x2), Red Hat Enterprise Linux 6.6, Red Hat Enterprise Linux 7.0, SUSE Linux Enterprise Server 11.3

Red Hat Enterprise Linux Server 6.6, 7.0 SUSE Linux Enterprise Server 11.3

Windows Server 2008 R2, 2012 R2 (x2)

Test Equipment Version

Medusa Labs Test Tools 7.0.0.157942

Device Interface IP Address

EMC Isilon node3, 10gige-1 9.79.10.1

EMC Isilon node2, 10gige-agg-1 9.79.10.2

Windows 2012 Server NIC Team 9.79.100.1

Windows 2008 Server NIC Team 9.79.100.11

Red Hat 6.6 Server bond0 9.79.100.21

Windows 2012 Server Cisco VIC Ethernet 2 9.79.100.61

Red Hat 7.0 Server Cisco VIC enp8s0 9.79.100.62

SUSE Linux Server Cisco VIC eth2 9.79.100.63

ESXi 5.5u2 Server Cisco VIC vSwitch2 9.79.100.64

ESXi 5.5u2 Server vSwitch1 9.79.100.74

DUT Configuration

< ========== > interface Vlan 979 ! rbridge-id 1 interface Ve 979 ip address 9.79.1.1/16 no shutdown ! ! rbridge-id 2 interface Ve 979 ip address 9.79.1.2/16 no shutdown

DUT Configuration

(22)

! ! rbridge-id 11 interface Ve 979 ip address 9.79.1.11/16 no shutdown ! ! rbridge-id 12 interface Ve 979 ip address 9.79.1.12/16 no shutdown ! ! interface TenGigabitEthernet 1/0/1 no fabric isl enable

no fabric trunk enable

channel-group 101 mode active type standard lacp timeout long

no shutdown !

interface TenGigabitEthernet 1/0/2 no fabric isl enable

no shutdown !

interface TenGigabitEthernet 1/0/5

channel-group 105 mode active type standard no fabric isl enable

no fabric trunk enable lacp timeout long no shutdown !

interface TenGigabitEthernet 1/0/7 channel-group 107 mode on type standard no fabric isl enable

no fabric trunk enable no shutdown

!

no shutdown !

channel-group 105 mode active type standard

(23)

no fabric isl enable no fabric trunk enable lacp timeout long no shutdown !

!

no shutdown !

no fabric trunk enable switchport

switchport mode access switchport access vlan 979 spanning-tree shutdown no shutdown

!

no shutdown !

interface Port-channel 11 vlag ignore-split switchport

switchport mode access switchport access vlan 979 spanning-tree shutdown no shutdown ! interface Port-channel 101 vlag ignore-split switchport

switchport mode trunk

switchport trunk allowed vlan add 979

(24)

switchport trunk tag native-vlan spanning-tree shutdown no shutdown ! interface Port-channel 106 vlag ignore-split switchport

switchport trunk allowed vlan add 979 switchport trunk tag native-vlan spanning-tree shutdown no shutdown ! interface Port-channel 107 no vlag ignore-split switchport

switchport trunk allowed vlan add 979 switchport trunk tag native-vlan spanning-tree shutdown

no shutdown !

< ========== >

Test Cases

The following test cases are designed to verify both basic and advanced functionality features between the Brocade VCS cluster and both host and storage devices; to stress all devices; and to confirm successful error recovery.

1.1 Base Functionality

1.1.1 Physical Connection and Speed Negotiation

1.1.2 Storage Connectivity

1.1.3 Virtual LAG Connectivity

1.2 Advanced Functionality

1.2.1 MTU Jumbo Frame

1.2.2 Maximum Bandwidth

1.2.3 Congested Fabric with Auto-NAS 1.2.4 Jammer CRC Corruption on an ISL Port

(25)

1.2.5 Jammer Packet Corruption on an ISL Port 1.2.6 Jammer Packet Loss on an ISL Port 1.2.7 Jammer CRC Corruption on a Storage Port 1.2.8 Jammer Packet Corruption on a Storage Port 1.2.9 Jammer Packet Loss on a Storage Port

1.2.10 ISL Congestion and Interface Buffer Queue Depth

1.3 Stress and Error Recovery

1.3.1 Congested Fabric with Auto-NAS Extended Run

1.3.2 Manual Cable Pull

1.3.3 ISL Port Relocation

1.3.4 Device Port Toggle Extended Run 1.3.5 ISL Port Toggle Extended Run

1.3.6 Split Brain Recovery

1.3.7 Brocade VDX 8770 Line Card Maintenance Extended Run

1.3.8 Switch Offline

1.3.9 Workload Simulation—Microsoft Exchange Server 1.3.10 Workload Simulation—File Server

1.3.11 Host-side Interface Port Toggle 1.3.12 Storage-side Interface Port Toggle

1.3.13 Storage Failover

1.4 Brocade Network Advisor

1.4.1 Ethernet Fabric Discovery

1.4.2 Ethernet Fabric Addition and Removal

1.4.3 Ethernet Fabric Configuration Backup and Restoration 1.4.4 Ethernet Fabric Firmware Download

1.1 Base Functionality

(26)

1.1.1 Physical Connection and Speed Negotiation

Test Objective

Test storage device connectivity to a Brocade VDX switch with supported speed and duplex settings.

Validation

Verify that Brocade VDX console output shows expected speed and duplex settings for all connected physical interfaces. Verify that the storage device console or GUI output shows expected speed and duplex settings for all connected physical interfaces.

Results

PASS. All interfaces are up and operational at expected speed settings. Brocade VDX show interface

commands reflect the expected interface speed.

1.1.2 Storage Connectivity

Test Objective

Test end-to-end connectivity between hosts and the storage device.

Validation

Verify that hosts can mount shares on the storage device.

Results

PASS. All NAS targets on Windows, Red Hat, and ESXi hosts are successfully connected.

1.1.3 Virtual LAG Connectivity

Test Objective

Test whether Brocade VCS vLAG connectivity can be established with both hosts and storage devices.

Validation

All host and storage link aggregation ports sync with Brocade VCS vLAG ports.

Results

PASS. All port-channel interfaces are operational and in sync.

1.2 Advanced Functionality

(27)

1.2.1 MTU Jumbo Frame

Test Objective

Test the largest MTU supported by all devices in the I/O path.

Validation

All I/O runs error-free at the maximum frame size for a minimum of 15 minutes.

Results

PASS. All nonfragmented ping packets are successfully responded to, and all jumbo frame storage

traffic completes error-free.

1.2.2 Maximum Bandwidth

Test Objective

Test host-to-storage traffic using an I/O generator configured for maximum throughput.

Validation

All I/O runs error-free at the maximum throughput for a minimum of 15 minutes.

Results

PASS. All I/O completes error-free. All host and storage ports show bandwidth under maximum

capacity.

1.2.3 Congested Fabric with Auto-NAS

Test Objective

Test host-to-storage traffic using an I/O generator configured for maximum throughput while configured with Brocade VCS Auto-NAS enabled and additional Layer 3 FCoE and Layer 2 Ethernet traffic to congest the ISL links.

Validation

All storage I/O runs error-free at the maximum throughput for a minimum of 15 minutes. Background traffic can experience congestion errors.

Results

PASS. NAS I/O completes error-free during bandwidth congestion.

(28)

1.2.4 Jammer CRC Corruption on an ISL Port

Test Objective

Verify whether end-to-end storage traffic can be maintained during a short burst of CRC packet corruptions on an ISL port.

Validation

All I/O runs error-free throughout the packet jammer trigger.

Results

PASS. All I/O completes error-free during Ethernet jammer CRC corruption on the ISL port.

1.2.5 Jammer Packet Corruption on an ISL Port

Test Objective

Verify that end-to-end storage traffic can be maintained during a short burst of packet corruptions on an ISL port.

Validation

Results

PASS. All I/O completes error-free during Ethernet jammer packet corruption on the ISL port.

1.2.6 Jammer Packet Loss on an ISL Port

Test Objective

Verify that end-to-end storage traffic can be maintained during a short burst of packet loss on an ISL port.

Validation

Results

PASS. All I/O completes error-free during Ethernet jammer packet loss on the ISL port.

(29)

1.2.7 Jammer CRC Corruption on a Storage Port

Test Objective

Verify that end-to-end storage traffic can be maintained during a short burst of CRC packet corruptions on a storage port.

Validation

Results

PASS. All I/O completes error-free during Ethernet jammer packet corruption on the storage port.

1.2.8 Jammer Packet Corruption on a Storage Port

Test Objective

Verify that end-to-end storage traffic can be maintained during a short burst of packet corruptions on a storage port.

Validation

Results

PASS. All I/O completes error-free during Ethernet jammer packet corruption on the storage port.

1.2.9 Jammer Packet Loss on a Storage Port

Test Objective

Verify that end-to-end storage traffic can be maintained during a short burst of packet loss on a storage port.

Validation

Results

PASS. All I/O completes error-free during Ethernet jammer packet loss on the storage port.

(30)

1.2.10 ISL Congestion and Interface Buffer Queue Depth

Test Objective

Verify increasing ISL interface buffer queues in an ISL congestion scenario, eliminating tail-end packet drops and improving throughput.

Validation

1. Disable as many ISLs as necessary to force end-to-end IP storage traffic through a single ISL. 2. Initiate multiple host read I/O traffic streams that produce consistent TX packet drops, and observe

packet drops on the many-to-one ISL interface queue and average throughput over a 30-minute period.

3. Increase ISL interface buffer queue depth above default values, and repeat multiple host read I/O traffic steams.

Results

PASS. Average I/O throughput increases when transmit queue buffers are increased, and packet

drops are reduced.

1.3 Stress and Error Recovery

1.3.1 Congested Fabric with Auto-NAS Extended Run

Test Objective

Test host-to-storage traffic using an I/O generator configured for maximum throughput while configured with Brocade VCS Auto-NAS enabled and additional Layer 3 FCoE and Layer 2 Ethernet traffic to congest the ISL links over a 12-hour period.

Validation

All storage I/O runs error-free at the maximum throughput for a minimum of 12 hours. Background traffic can experience congestion errors.

Results

PASS. All I/O completes error-free during VCS Fabric congestion.

1.3.2 Manual Cable Pull

Test Objective

Test that host-to-storage traffic can maintain I/O during a quick port toggle on every storage and host port.

(31)

Validation

All storage I/O runs error-free during each rapid port toggle.

Results

PASS. All I/O recovers during port disconnections and reconnections.

1.3.3 ISL Port Relocation

Test Objective

Test that host-to-storage traffic can maintain I/O during ISL relocation within the same switch on all VCS nodes.

Validation

All storage I/O runs error-free during each ISL port relocation.

Results

PASS. The VCS Fabric reforms properly, and all I/O recovers during ISL port disconnections and

reconnections.

1.3.4 Device Port Toggle Extended Run

Test Objective

Test that host-to-storage traffic can maintain I/O during sequential host and storage port disabling and enabling over a 12-hour period.

Validation

All storage I/O runs error-free during host and storage port disable and enable actions for a minimum of 12 hours.

Results

PASS. All I/O recovers during all initiator and target port disabling and enabling.

1.3.5 ISL Port Toggle Extended Run

Test Objective

Test that host-to-storage traffic can maintain I/O during ISL port disabling and enabling over a 12-hour period.

(32)

Validation

All storage I/O runs error-free during ISL port disable and enable actions for a minimum of 12 hours.

Results

PASS. All I/O completes error-free after ISL port disable and enable commands.

1.3.6 Split Brain Recovery

Test Objective

Test that host-to-storage traffic can recover while disabling and enabling all ISL ports sequentially on each switch in the VCS cluster.

Validation

1. Disable all ISL ports on a single switch, and wait for the VCS cluster to segment. 2. Enable all ISL ports on the same switch, and wait for the VCS cluster to reform. 3. Repeat for each switch in the VCS cluster.

Results

PASS. All I/O recovers after ISL port disable and enable commands.

1.3.7 Brocade VDX 8770 Line Card Maintenance Extended Run

Test Objective

Test that host-to-storage traffic can be maintained during line-card power-off and power-on commands sequentially on each Brocade VDX 8770 line card in the VCS cluster.

Validation

All storage I/O runs error-free during power-off and power-on actions for a minimum of 12 hours.

Results

N/A. The Brocade VDX 8770 is not present in the network configuration.

1.3.8 Switch Offline

Test Objective

Test that host-to-storage traffic can be maintained during chassis disable and enable commands, switch reloads, and chassis power cycles sequentially on each VDX in the VCS cluster.

(33)

Validation

All storage I/O runs error-free during chassis disable and enable commands, switch reloads, and chassis power cycles.

Results

Chassis Disable/Enable: PASS. I/O successfully resumes after the chassis is enabled. Reboot: PASS. I/O successfully resumes after the chassis is rebooted.

Power Cycle: PASS. I/O successfully resumes after the chassis is power-cycled.

1.3.9 Workload Simulation—Microsoft Exchange Server

Test Objective

Test host-to-storage traffic using the Medusa Microsoft Exchange Server workload simulation suite.

Validation

All storage I/O runs error-free for a minimum of 30 minutes.

Results

PASS. All I/O completes error-free.

1.3.10 Workload Simulation—File Server

Test Objective

Test host-to-storage traffic using the Medusa File Server workload simulation suite.

Validation

All storage I/O runs error-free for a minimum of 30 minutes.

Results

PASS. All I/O completes error-free.

1.3.11 Host-side Interface Port Toggle

Test Objective

Test that host-to-storage traffic can be maintained while sequentially disabling and enabling connections to the VCS cluster from the host side.

(34)

Validation

All storage I/O runs error-free during host-side interface disable and enable actions.

Results

PASS. All I/O completes error-free during host-side interface disable and enable actions.

1.3.12 Storage-side Interface Port Toggle

Test Objective

Test that host-to-storage traffic can be maintained while sequentially disabling and enabling connections to the VCS cluster from the storage side.

Validation

All storage I/O runs error-free during storage-side interface disable and enable actions.

Results

PASS. All I/O completes error-free during storage-side interface disable and enable actions.

1.3.13 Storage Failover

Test Objective

Test that storage node redundancy failover occurs within the expected storage node feature set.

Validation

All storage I/O runs error-free during storage failover (if lossless failover is supported) or traffic successfully resumes after storage failover is complete (if lossless failover is not supported).

Results

PASS. I/O successfully resumes after node reboot.

1.4 Brocade Network Advisor

1.4.1 Ethernet Fabric Discovery

Test Objective

Test that the Brocade Network Advisor discovers the Ethernet fabric.

(35)

Validation

Brocade Network Advisor successfully discovers the VCS cluster.

Results

PASS. The VCS cluster is successfully discovered.

1.4.2 Ethernet Fabric Addition and Removal

Test Objective

Test the addition and removal of Brocade Network Advisor Ethernet fabric nodes.

Validation

Brocade Network Advisor successfully tracks VCS node addition and removal.

Results

PASS. Brocade Network Advisor accurately reports the VCS cluster changes during removal and

addition.

1.4.3 Ethernet Fabric Configuration Backup and Restoration

Test Objective

Test that Brocade Network Advisor backs up and restores the Ethernet fabric configuration.

Validation

Brocade Network Advisor successfully performs configuration backup and restoration.

Results

PASS. Brocade Network Advisor successfully performs configuration backup and restoration.

1.4.4 Ethernet Fabric Firmware Download

Test Objective

Test downloading the Brocade Network Advisor Ethernet fabric firmware.

Validation

Brocade Network Advisor successfully downloads firmware to all VCS cluster nodes.

(36)

Results

PASS. Brocade Network Advisor successfully performs firmware download to Network OS 6.0.1.

Test Conclusions

1. Brocade VCS Fabric technology and the EMC Isilon NAS array smoothly interoperate with both redundant and nonredundant configurations. No exceptions were noted.

2. The configuration procedures followed Brocade VCS Fabric technology and EMC Isilon standard documentation guides and found no issues with these procedures.

3. All simulated changes in network and storage (add, remove, fail over) resulted in expected behavior and I/O recovery.

(37)

Full Brocade Network OS Configuration

This section contains the Network Operating System test environment configuration.

NOTE

The following configuration is from a test environment and includes additional configuration beyond the scope of this test report. Please see the "Test Configuration" and "DUT Configuration" sections of each test report to identify applicable configurations.

< =========== >

diag post rbridge-id 1 enable diag post rbridge-id 2 enable diag post rbridge-id 11 enable diag post rbridge-id 12 enable hardware flexport 2/0/17 type fibre-channel ! flexport 2/0/18 type fibre-channel ! flexport 2/0/19 type fibre-channel ! flexport 2/0/21 type fibre-channel ! flexport 2/0/22 type fibre-channel ! flexport 2/0/23 type fibre-channel ! flexport 12/0/17 type fibre-channel ! flexport 12/0/18 type fibre-channel ! flexport 12/0/19 type fibre-channel ! flexport 12/0/21 type fibre-channel ! flexport 12/0/22 type fibre-channel ! flexport 12/0/23 type fibre-channel ! connector-group 1/0/1 speed LowMixed ! connector-group 1/0/3 speed LowMixed ! connector-group 1/0/5 speed LowMixed ! connector-group 1/0/6 speed LowMixed ! connector-group 11/0/1 speed LowMixed ! connector-group 11/0/3 speed LowMixed ! connector-group 11/0/5

(38)

speed LowMixed ! connector-group 11/0/6 speed LowMixed ! connector-group 12/0/1 speed LowMixed ! connector-group 12/0/3 speed LowMixed ! connector-group 12/0/5 speed LowMixed ! connector-group 12/0/6 speed LowMixed ! connector-group 2/0/1 speed LowMixed ! connector-group 2/0/3 speed LowMixed ! connector-group 2/0/5 speed LowMixed ! connector-group 2/0/6 speed LowMixed ! ! dpod 1/0/1 reserve ! dpod 1/0/2 reserve ! dpod 1/0/3 reserve ! dpod 1/0/4 reserve ! dpod 1/0/5 reserve ! dpod 1/0/6 reserve ! dpod 1/0/7 reserve ! dpod 1/0/8 ! dpod 1/0/9 ! dpod 1/0/10 ! dpod 1/0/11 ! dpod 1/0/12 ! dpod 1/0/13 ! dpod 1/0/14 ! dpod 1/0/15 ! dpod 1/0/16 ! dpod 1/0/17 ! dpod 1/0/18 ! dpod 1/0/19 ! dpod 1/0/20 ! dpod 1/0/21

(39)

! dpod 1/0/22 ! dpod 1/0/23 ! dpod 1/0/24 ! dpod 1/0/25 ! dpod 1/0/26 ! dpod 1/0/27 ! dpod 1/0/28 ! dpod 1/0/29 ! dpod 1/0/30 ! dpod 1/0/31 reserve ! dpod 1/0/32 ! dpod 1/0/33 reserve ! dpod 1/0/34 ! dpod 1/0/35 ! dpod 1/0/36 ! dpod 1/0/37 reserve ! dpod 1/0/38 reserve ! dpod 1/0/39 reserve ! dpod 1/0/40 reserve ! dpod 1/0/41 reserve ! dpod 1/0/42 reserve ! dpod 1/0/43 reserve ! dpod 1/0/44 reserve ! dpod 1/0/45 reserve ! dpod 1/0/46 reserve ! dpod 1/0/47 reserve ! dpod 1/0/48 reserve ! dpod 1/0/49 reserve ! dpod 1/0/50 reserve ! dpod 1/0/51 ! dpod 1/0/52

(40)

! dpod 2/0/1 reserve ! dpod 2/0/2 reserve ! dpod 2/0/3 reserve ! dpod 2/0/4 reserve ! dpod 2/0/5 reserve ! dpod 2/0/6 reserve ! dpod 2/0/7 reserve ! dpod 2/0/8 ! dpod 2/0/9 ! dpod 2/0/10 ! dpod 2/0/11 ! dpod 2/0/12 ! dpod 2/0/13 ! dpod 2/0/14 ! dpod 2/0/15 ! dpod 2/0/16 ! dpod 2/0/17 ! dpod 2/0/18 ! dpod 2/0/19 ! dpod 2/0/20 ! dpod 2/0/21 ! dpod 2/0/22 ! dpod 2/0/23 ! dpod 2/0/24 ! dpod 2/0/25 ! dpod 2/0/26 ! dpod 2/0/27 ! dpod 2/0/28 ! dpod 2/0/29 ! dpod 2/0/30 ! dpod 2/0/31 ! dpod 2/0/32 ! dpod 2/0/33 reserve ! dpod 2/0/34 reserve !

(41)

dpod 2/0/35 reserve ! dpod 2/0/36 reserve ! dpod 2/0/37 reserve ! dpod 2/0/38 reserve ! dpod 2/0/39 ! dpod 2/0/40 ! dpod 2/0/41 ! dpod 2/0/42 ! dpod 2/0/43 reserve ! dpod 2/0/44 reserve ! dpod 2/0/45 reserve ! dpod 2/0/46 reserve ! dpod 2/0/47 reserve ! dpod 2/0/48 reserve ! dpod 2/0/49 reserve ! dpod 2/0/50 reserve ! dpod 2/0/51 ! dpod 2/0/52 ! dpod 11/0/1 reserve ! dpod 11/0/2 ! dpod 11/0/3 reserve ! dpod 11/0/4 reserve ! dpod 11/0/5 reserve ! dpod 11/0/6 reserve ! dpod 11/0/7 reserve ! dpod 11/0/8 ! dpod 11/0/9 reserve ! dpod 11/0/10 reserve ! dpod 11/0/11 reserve

(42)

! dpod 11/0/12 ! dpod 11/0/13 reserve ! dpod 11/0/14 ! dpod 11/0/15 reserve ! dpod 11/0/16 reserve ! dpod 11/0/17 ! dpod 11/0/18 ! dpod 11/0/19 ! dpod 11/0/20 ! dpod 11/0/21 ! dpod 11/0/22 ! dpod 11/0/23 reserve ! dpod 11/0/24 reserve ! dpod 11/0/25 reserve ! dpod 11/0/26 reserve ! dpod 11/0/27 reserve ! dpod 11/0/28 reserve ! dpod 11/0/29 reserve ! dpod 11/0/30 reserve ! dpod 11/0/31 reserve ! dpod 11/0/32 reserve ! dpod 11/0/33 reserve ! dpod 11/0/34 ! dpod 11/0/35 ! dpod 11/0/36 ! dpod 11/0/37 reserve ! dpod 11/0/38 ! dpod 11/0/39 ! dpod 11/0/40 ! dpod 11/0/41 ! dpod 11/0/42 !

(43)

dpod 11/0/43 ! dpod 11/0/44 ! dpod 11/0/45 ! dpod 11/0/46 ! dpod 11/0/47 reserve ! dpod 11/0/48 reserve ! dpod 11/0/49 reserve ! dpod 11/0/50 ! dpod 11/0/51 ! dpod 11/0/52 ! dpod 12/0/1 reserve ! dpod 12/0/2 reserve ! dpod 12/0/3 reserve ! dpod 12/0/4 ! dpod 12/0/5 reserve ! dpod 12/0/6 reserve ! dpod 12/0/7 reserve ! dpod 12/0/8 ! dpod 12/0/9 reserve ! dpod 12/0/10 ! dpod 12/0/11 reserve ! dpod 12/0/12 ! dpod 12/0/13 reserve ! dpod 12/0/14 ! dpod 12/0/15 reserve ! dpod 12/0/16 reserve ! dpod 12/0/17 ! dpod 12/0/18 ! dpod 12/0/19 ! dpod 12/0/20 ! dpod 12/0/21 ! dpod 12/0/22 !

(44)

dpod 12/0/23 ! dpod 12/0/24 ! dpod 12/0/25 ! dpod 12/0/26 ! dpod 12/0/27 ! dpod 12/0/28 ! dpod 12/0/29 ! dpod 12/0/30 ! dpod 12/0/31 reserve ! dpod 12/0/32 reserve ! dpod 12/0/33 reserve ! dpod 12/0/34 reserve ! dpod 12/0/35 reserve ! dpod 12/0/36 reserve ! dpod 12/0/37 reserve ! dpod 12/0/38 reserve ! dpod 12/0/39 reserve ! dpod 12/0/40 reserve ! dpod 12/0/41 ! dpod 12/0/42 ! dpod 12/0/43 reserve ! dpod 12/0/44 reserve ! dpod 12/0/45 reserve ! dpod 12/0/46 reserve ! dpod 12/0/47 reserve ! dpod 12/0/48 reserve ! dpod 12/0/49 reserve ! dpod 12/0/50 reserve ! dpod 12/0/51 ! dpod 12/0/52 !

(45)

ntp server 10.38.2.80 ntp server 10.38.2.81 logging raslog console INFO

logging syslog-server 10.38.53.12 use-vrf mgmt-vrf !

logging auditlog class SECURITY logging auditlog class CONFIGURATION logging auditlog class FIRMWARE

logging syslog-facility local LOG_LOCAL7 logging syslog-client localip MM_IP switch-attributes 1 chassis-name VDX6740 host-name CASTOR-VCS20-1 ! switch-attributes 11 chassis-name VDX6740 host-name CASTOR-VCS20-11 ! switch-attributes 12 chassis-name VDX6740 host-name CASTOR-VCS20-12 ! switch-attributes 2 chassis-name VDX6740 host-name CASTOR-VCS20-2 !

no support autoupload enable support ffdc

snmp-server contact "Field Support." snmp-server location "End User Premise." snmp-server sys-descr "Brocade VDX Switch." snmp-server enable trap

snmp-server community ConvergedNetwork groupname user snmp-server community OrigEquipMfr groupname admin snmp-server community "Secret C0de" groupname admin snmp-server community common groupname user

snmp-server community private groupname admin snmp-server community public groupname user snmp-server host 10.38.53.12 public

severity-level Info use-vrf mgmt-vrf !

snmp-server host 10.38.53.12 private severity-level Info

use-vrf mgmt-vrf !

snmp-server user snmpadmin1 groupname snmpadmin snmp-server user snmpadmin2 groupname snmpadmin snmp-server user snmpadmin3 groupname snmpadmin snmp-server user snmpuser1 groupname snmpuser snmp-server user snmpuser2 groupname snmpuser snmp-server user snmpuser3 groupname snmpuser snmp-server view All 1 included

snmp-server group admin v1 read All write All notify All snmp-server group admin v2c read All write All notify All snmp-server group user v1 read All notify All

snmp-server group user v2c read All notify All line vty

exec-timeout 10 !

zoning defined-configuration cfg nos member-zone EMC_VG2_n1fc1 member-zone EMC_VG2_n2fc1 member-zone Hitachi_HNAS_n1fc1 member-zone Hitachi_HNAS_n2fc1 member-zone Hitachi_HNAS_n1fc3 member-zone Hitachi_HNAS_n2fc3 member-zone IXIA_FCoE !

zoning defined-configuration zone EMC_VG2_n1fc1 member-entry 50:06:01:61:3e:e0:22:af

member-entry 50:06:01:68:3e:e0:22:af member-entry 50:06:01:61:47:60:30:c2 !

zoning defined-configuration zone EMC_VG2_n2fc1 member-entry 50:06:01:60:47:60:30:c2

member-entry 50:06:01:60:3e:e0:22:af member-entry 50:06:01:69:3e:e0:22:af

(46)

!

zoning defined-configuration zone Hitachi_HNAS_n1fc1 member-entry 50:03:01:70:00:06:45:c1

member-entry 50:06:0e:80:13:27:3d:11 !

zoning defined-configuration zone Hitachi_HNAS_n1fc3 member-entry 50:03:01:70:00:06:45:c3

member-entry 50:06:0e:80:13:27:3d:21 !

zoning defined-configuration zone Hitachi_HNAS_n2fc1 member-entry 50:06:0e:80:13:27:3d:11

member-entry 50:03:01:70:00:05:2f:e1 !

zoning defined-configuration zone Hitachi_HNAS_n2fc3 member-entry 50:06:0e:80:13:27:3d:21

member-entry 50:03:01:70:00:05:2f:e3 !

zoning defined-configuration zone IXIA_FCoE member-entry 31:00:0e:fc:00:00:00:0a member-entry 32:00:0e:fc:00:00:00:aa !

zoning enabled-configuration cfg-name nos

zoning enabled-configuration default-zone-access allaccess zoning enabled-configuration cfg-action cfg-save

role name admin desc Administrator role name user desc User

aaa authentication login local

aaa accounting exec default start-stop none aaa accounting commands default start-stop none service password-encryption

username admin password "BwrsDbB+tABWGWpINOVKoQ==\n" encryption-level 7 role admin desc Administrator

username user password "BwrsDbB+tABWGWpINOVKoQ==\n" encryption-level 7 role user desc User cee-map default precedence 1 priority-group-table 1 weight 40 pfc on priority-group-table 15.0 pfc off priority-group-table 15.1 pfc off priority-group-table 15.2 pfc off priority-group-table 15.3 pfc off priority-group-table 15.4 pfc off priority-group-table 15.5 pfc off priority-group-table 15.6 pfc off priority-group-table 15.7 pfc off priority-group-table 2 weight 40 pfc off priority-group-table 3 weight 20 pfc off priority-table 2 2 3 1 2 2 2 15.0 remap fabric-priority priority 0 remap lossless-priority priority 0 !

nas server-ip 9.78.50.1/32 vlan 978 nas server-ip 9.78.60.1/32 vlan 978 nas server-ip 9.79.10.1/32 vlan 979 nas server-ip 9.79.10.2/32 vlan 979 nas server-ip 9.79.20.1/32 vlan 979 nas server-ip 9.79.20.2/32 vlan 979 nas server-ip 9.79.30.1/32 vlan 979 nas server-ip 9.79.30.2/32 vlan 979 nas server-ip 9.79.40.1/32 vlan 979 nas server-ip 9.79.40.2/32 vlan 979 nas server-ip 9.79.50.2/32 vlan 979 nas server-ip 9.79.60.2/32 vlan 979 fcoe fabric-map default vlan 1002 san-mode local priority 3 virtual-fabric 128 fcmap 0E:FC:00 advertisement interval 8000 keep-alive timeout ! ! interface Vlan 1 ! interface Vlan 864 !

(47)

interface Vlan 978 ! interface Vlan 979 ! interface Ve 978 no shutdown ! interface Ve 979 no shutdown !

fabric route mcast rbridge-id 1 !

fabric route mcast rbridge-id 12 ! protocol lldp advertise dcbx-fcoe-app-tlv advertise dcbx-fcoe-logical-link-tlv advertise dcbx-iscsi-app-tlv advertise dcbx-tlv

advertise optional-tlv system-name system-description Brocade-VDX-VCS 20 !

vlan dot1q tag native

port-profile UpgradedVlanProfile vlan-profile

switchport

switchport trunk allowed vlan all !

!

port-profile default vlan-profile switchport

switchport trunk native-vlan 1 ! ! port-profile-domain default port-profile UpgradedVlanProfile ! class-map cee ! class-map default ! rbridge-id 1 ip route 0.0.0.0/0 10.38.64.1 ip route 13.19.0.0/16 9.79.62.103 ip route 192.168.200.0/24 9.79.62.196 switch-attributes chassis-name VDX6740 switch-attributes host-name CASTOR-VCS20-1 vrf mgmt-vrf

address-family ipv4 unicast ip route 0.0.0.0/0 10.38.64.1 !

address-family ipv6 unicast !

!

system-monitor fan threshold marginal-threshold 1 down-threshold 2 system-monitor fan alert state removed action raslog

system-monitor power threshold marginal-threshold 1 down-threshold 2 system-monitor power alert state removed action raslog

system-monitor temp threshold marginal-threshold 1 down-threshold 2 system-monitor cid-card threshold marginal-threshold 1 down-threshold 2 system-monitor cid-card alert state none action none

system-monitor sfp alert state none action none

system-monitor compact-flash threshold marginal-threshold 1 down-threshold 0 system-monitor MM threshold marginal-threshold 1 down-threshold 2

system-monitor LineCard threshold marginal-threshold 1 down-threshold 2 system-monitor LineCard alert state none action none

system-monitor SFM threshold marginal-threshold 1 down-threshold 2 no protocol vrrp

no protocol vrrp-extended hardware-profile tcam default

hardware-profile route-table default maximum_paths 8 openflow off

(48)

hardware-profile kap default clock timezone America/Boise ag

no enable !

root enable

ssh server key rsa 2048 ssh server key ecdsa 256 ssh server key dsa fcoe fcoe-enodes 64 ! interface Ve 978 ip proxy-arp ip address 9.78.1.1/16 no shutdown ! interface Ve 979 ip mtu 9018 ip proxy-arp ip address 9.79.1.1/16 no shutdown ! ! rbridge-id 2 ip route 0.0.0.0/0 10.38.64.1 ip route 192.168.200.0/24 9.79.62.196 switch-attributes chassis-name VDX6740 switch-attributes host-name CASTOR-VCS20-2 vrf mgmt-vrf

!

hardware-profile route-table default maximum_paths 8 openflow off hardware-profile kap default

clock timezone America/Boise ag

no enable !

root enable

ssh server key rsa 2048 ssh server key ecdsa 256 ssh server key dsa fcoe fcoe-enodes 64 ! interface Ve 978 ip proxy-arp ip address 9.78.1.2/16 no shutdown ! interface Ve 979 ip mtu 9018 ip proxy-arp ip address 9.79.1.2/16 no shutdown ! ! rbridge-id 11

(49)

ip route 0.0.0.0/0 10.38.64.1

ip route 192.168.200.0/24 9.79.62.196 switch-attributes chassis-name VDX6740 switch-attributes host-name CASTOR-VCS20-11 vrf mgmt-vrf

!

no enable !

root enable

ssh server key rsa 2048 ssh server key ecdsa 256 ssh server key dsa fcoe fcoe-enodes 64 ! interface Ve 978 ip proxy-arp ip address 9.78.1.11/16 no shutdown ! interface Ve 979 ip mtu 9018 ip proxy-arp ip address 9.79.1.11/16 no shutdown ! ! rbridge-id 12 ip route 0.0.0.0/0 10.38.64.1 ip route 192.168.200.0/24 9.79.62.196 switch-attributes chassis-name VDX6740 switch-attributes host-name CASTOR-VCS20-12 vrf mgmt-vrf

!

(50)

no enable !

root enable

ssh server key rsa 2048 ssh server key ecdsa 256 ssh server key dsa fcoe fcoe-enodes 64 ! interface Ve 978 ip proxy-arp ip address 9.78.1.12/16 no shutdown ! interface Ve 979 ip mtu 9018 ip proxy-arp ip address 9.79.1.12/16 no shutdown ! ! interface Management 1/0 no tcp burstrate ip icmp echo-reply no ip address dhcp ip address 10.38.66.160/20 ipv6 icmpv6 echo-reply no ipv6 address autoconfig no ipv6 address dhcp vrf forwarding mgmt-vrf no shutdown ! interface Management 2/0 no tcp burstrate ip icmp echo-reply no ip address dhcp ip address 10.38.66.161/20 ipv6 icmpv6 echo-reply no ipv6 address autoconfig no ipv6 address dhcp vrf forwarding mgmt-vrf no shutdown ! interface Management 11/0 no tcp burstrate ip icmp echo-reply no ip address dhcp ip address 10.38.66.122/20 ipv6 icmpv6 echo-reply no ipv6 address autoconfig no ipv6 address dhcp vrf forwarding mgmt-vrf no shutdown ! interface Management 12/0 no tcp burstrate ip icmp echo-reply no ip address dhcp ip address 10.38.66.123/20 ipv6 icmpv6 echo-reply no ipv6 address autoconfig no ipv6 address dhcp vrf forwarding mgmt-vrf no shutdown

!

(51)

!

interface TenGigabitEthernet 1/0/8 fabric isl enable

fabric trunk enable no shutdown

!

(52)

!

(53)

interface TenGigabitEthernet 1/0/31 switchport

switchport mode access switchport access vlan 979 spanning-tree shutdown no fabric isl enable no fabric trunk enable no shutdown

!

interface TenGigabitEthernet 1/0/33 description VLAN_864_uplink switchport

switchport mode access switchport access vlan 864 spanning-tree shutdown fabric isl enable fabric trunk enable no shutdown

!

(54)

!

fabric trunk enable shutdown

!

(55)

!

(56)

!

(57)

!

channel-group 11 mode active type standard fabric isl enable

fabric trunk enable lacp timeout long no shutdown !

!

interface TenGigabitEthernet 11/0/4 cee default

switchport

!

(58)

!

interface TenGigabitEthernet 11/0/13 cee default

switchport

!

Brocade VCS Fabric Technology with the EMC Isilon NAS Storage Array

53-1003929-02

October 2015