Implementation instructions and best practices may vary because of the storage network protocol selected for the solution. There are three steps in each case:
1. Configure the VNX.
2. Provision storage to the hosts. 3. Configure FAST VP.
4. Optionally configure FAST Cache.
The following sections explain the options for each step separately, depending on whether one of the block protocols (FC, FCoE, iSCSI), or the file protocol (NFS) is selected:
For FC, FCoE, or iSCSI, refer to the instructions marked for block protocols. For NFS, refer to the instructions marked for file protocols.
This section describes how to configure the VNX storage array for host access with block protocols such FC, FCoE, and iSCSI. In this solution, the VNX provides data storage for VMware hosts.
Table 22. Tasks for VNX configuration
Task Description reference
Prepare the VNX Physically install the VNX hardware with the procedures in the product documentation. VNX5200 Unified Installation Guide VNX5400 Unified Installation Guide VNX5600 Unified Installation Guide VNX5800 Unified Installation Guide Unisphere System
Getting Started Guide Your vendor’s switch
configuration guide Set up the initial
VNX configuration
Configure the IP addresses and other key parameters on the VNX. Provision storage
for VMware hosts Create the storage areas required for the solution. Complete network
cabling
VNX configuration for block protocols
119 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide Prepare the VNX
The VNX5200, VNX5400, VNX5600 or VNX5800 Unified Installation Guide provides instructions to assemble, rack, cable, and power up the VNX. There are no specific setup steps for this solution.
Set up the initial VNX configuration
After completing the initial VNX setup, configure key information about the existing environment so that the storage array can communicate. Configure the following common items in accordance with your IT data center policies and existing infrastructure information:
DNS
NTP
Storage network interfaces
For data connection using the FC or FCoE protocols:
Ensure that one or more servers are connected to the VNX storage system, either directly or through qualified FC or FCoE switches. Refer to the EMC Host Connectivity Guide for VMware ESX Server for more detailed instructions.
For data connection using iSCSI protocol:
Connect one or more servers to the VNX storage system, either directly or through qualified IP switches. Refer to EMC Host Connectivity Guide for VMware ESX Server for more detailed instructions.
Additionally, configure the following items in accordance with your IT data center policies and existing infrastructure information:
1. Set up a storage network IP address.
Logically isolate the other networks in the solution as described, in Chapter 3. This ensures that other network traffic does not impact traffic between hosts and storage.
2. Enable jumbo frames on the VNX iSCSI ports.
Use jumbo frames for iSCSI networks to permit greater network bandwidth. Apply the MTU size specified below across all network interfaces in the environment:
a. In Unisphere, select Settings > Network > Settings for Block. b. Select the appropriate iSCSI network interface.
c. Click Properties.
d. Set the MTU size to 9,000. e. Click OK to apply the changes.
The reference documents listed in Table 22 provide more information on how to configure the VNX platform. Storage configuration guidelines provide more information on the disk layout.
120 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide
Provision storage for VMware hosts
This section describes provisioning block storage for VMware hosts. To provision file storage, refer to VNX configuration for file protocols.
Complete the following steps in Unisphere to configure LUNs on the VNX array to store virtual servers:
1. Create the number of storage pools required for the environment based on the sizing information in Error! Reference source not found. This example uses the array recommended maximums described in Chapter 4.
a. Log in to Unisphere.
b. Select the array for in this solution.
c. Select Storage > Storage Configuration > Storage Pools. d. Click the Pools tab.
f. Click Create.
Note: The pool does not use system drives for additional storage.
Table 23. Storage allocation table for block data
Configuration Number of
pools
Number of 15 K SAS drives per pool
Number of flash drives per pool
Number of
LUNs per pool LUN size (TB)
200 virtual machines 1 45 2 2 7 1 30 2 2 4 Total 2 75 4 4 2 x 7 TB LUNs 2 x 4 TB LUNs 300 virtual machines 2 45 2 2 7 1 20 2 2 3
Total 3 110 6 6 4 x 7 TB LUNs 2 x 3 TB LUNs
600 virtual machines
4 45 2 2 7
1 40 2 2 6
Total 5 220 10 10 8 x 7 TB LUNs 2 x 6 TB LUNs
1000 virtual
machines 8 45 2 2 7
Total 8 360 16 16 16 x 7 TB LUNs
Note:: Each virtual machine occupies 102 GB in this solution, with 100 GB for the OS and user space, and a 2 GB swap file.
121 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide Create the hot spare disks at this point. Refer to the appropriate installation guide for additional information.
Figure 26 depicts the target storage layout for 200 virtual machines. Figure 27 depicts the target storage layout for 300 virtual machines. Figure 28 depicts the target storage layout for 600 virtual machines. Figure 29 depicts the target storage layout for 1,000 virtual machines. 3. Use the pool created in Step 1 to provision thin LUNs:
a. Click Storage > LUNs. b. Click Create.
c. Select the pool created in Step 1. Always create two thin LUNs in one physical storage pool. User Capacity depends on the specific number of virtual machines. Refer to Table 23 for more information.
4. Create storage group and add LUNs and VMware servers: a. Click Hosts > Storage Groups.
b. Click Create and enter a name for it. c. Select the created storage group.
d. Click LUNs. In the Available LUNs panel, select all the LUNs created in the previous steps. The Selected LUNs dialog appears.
e. Configure and add the VMware hosts to the storage pool. This section describes file storage provisioning for VMware.
Table 24. Tasks for storage configuration
Task Description Reference
Prepare the VNX Physically install the VNX hardware with the procedures in the product documentation. VNX5200 Unified Installation Guide VNX5400 Unified Installation Guide VNX5600 Unified Installation Guide VNX5800 Unified Installation Guide
Unisphere System Getting Started Guide
Your vendor’s switch configuration guide Set up the initial
VNX configuration Configure the IP address information and other key parameters on the VNX. Create a network
interface
Configure the IP address and network interface information for the NFS server.
Create a storage pool for file
Create the pool structure and LUNs to contain the file system.
Create file systems Establish the file system that will be shared with the NFS protocol and export it to the VMware hosts. VNX configuration
122 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide
Prepare the VNX
TheVNX5200, VNX5400, VNX5600, or VNX5800 Unified Installation Guide provides instructions on assemble, rack, cable, and power up the VNX. There are no specific setup steps for this solution.
Set up the initial VNX configuration
After the initial VNX setup, configure key information about the existing environment to allow the storage array to communicate with other devices in the environment. Ensure one or more servers connect to the VNX storage system, either directly or through qualified IP switches. Configure the following items in accordance with your IT data center policies and existing infrastructure information:
DNS
NTP
Storage network interfaces Storage network IP address
CIFS services and Active Directory Domain membership
Refer to EMC Host Connectivity Guide for Windows for more detailed instructions.
Enable jumbo frames on the VNX storage network interfaces
Use jumbo frames for storage networks to permit greater network bandwidth. Apply the MTU size specified below across all network interfaces in the environment:
1. In Unisphere, click Settings > Network > Settings for File.
2. Select the appropriate network interface from the Interfaces tab. 3. Click Properties.
4. Set the MTU size to 9,000. 5. Click OK to apply the changes.
The reference documents listed in Table 22 provide more information on how to configure the VNX platform. Storage configuration guidelines provide more information on the disk layout.
Create a network interface
A network interface maps to a NFS export. File shares provide access through this interface.
Complete the following steps to create a network interface: 6. Log in to the VNX.
7. From the dashboard of the VNX, click Settings > Network > Settings For File. 8. On the Interfaces tab, click Create.
123 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide
Figure 47. Network settings For file dialog box
In the Create Network Interface wizard, complete the following steps: 9. Select the Data Mover which will provide the file share.
10. Select the device name where the network interface will reside.
Note: Run the following command as nasadmin from the Control Station to ensure the selected device has a link connected.
> server_sysconfig <datamovername> -pci
This command lists the link status (UP or DOWN) for all devices on the specified Data Mover.
3. Type an IP address for the interface. 4. Type a Name for the interface. 5. Type the netmask for the interface.
6. The Broadcast Address field populates automatically after you provide the IP address and netmask.
7. Enter the MTU size for the interface to 9,000.
Note: Ensure that all devices on the (switch, servers) have the same MTU size.
8. If required, specify the VLAN ID. 9. Click OK.
124 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide
Figure 48. Create Interface dialog box
Create storage pool for file
Complete the following steps in Unisphere to configure LUNs on the VNX array to store virtual servers:
1. Create the number of storage pools required for the environment based on the sizing information in Chapter 4. This example uses the array
recommended maximums as described in Chapter 4. a. Log in to Unisphere.
b. Select the array for this solution.
c. Click Storage > Storage Configuration > Storage Pools > Pools. d. Click Create.
Note: The pool does not use system drives for additional storage.
Table 25. Storage allocation table for file
Configuration Number of pools
Number of 15K SAS drives per pool Number of Flash drives per pool Number of LUNs per pool Number of FS per storage pool for file LUN size (GB) FS size (TB) 200 virtual machines 1 45 2 20 2 800 5 1 30 2 20 2 600 4 Total 2 75 4 40 4 20 X 800GB LUNs 20 X 600GB LUNs 2 x 5TB FS 2 x 4 TB FS
125 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide 300 virtual machines 2 45 2 20 2 800 7 1 20 2 20 2 400 3 Total 3 110 6 60 6 40 X 800GB LUNs 20 X 400GB LUNs 4 x 7 TB FS 2 x 3 TB FS 600 virtual machines 4 45 2 20 2 800 7 1 40 2 20 2 700 6 Total 5 220 10 100 10 80 X 800GB LUNs 20 X 700GB LUNs 8 x 7 TB FS 2 x 6 TB FS 1000 virtual machines 8 45 2 20 2 800 7 Total 8 360 16 160 16 160 X 800GB LUNs 16 x 7 TB FS
Create the hot spare disks. Refer to the EMC VNX5400 Unified Installation Guide for additional information.
Figure 26depicts the target storage layout for 200 virtual machines. Figure 27 depicts the target storage layout for 300 virtual machines. Figure 28 depicts the target storage layout for 600 virtual machines. Figure 29 depicts the target storage layout for 1,000 virtual machines. 2. Use the pool created in step 1, and provision LUNs:
a. Select Storage > LUNs. b. Click Create.
c. Select the pool created in step1. . Under LUN Properties, uncheck the Thin checkbox. For User Capacity, refer to Table 25 for detail on the size of LUNs. The Number of LUNs to create depends on the disk number in the pool. Refer to Table 25 for detail on the number of LUNs needed in each pool.
Note: For FAST VP implementations, assign no more than 95% of the available storage pool capacity for File.
3. Connect the Provisioned LUNs to the Data Mover for file access: a. Click Hosts > Storage Groups.
b. Select filestorage. c. Click Connect LUNs.
126 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide
d. In the Available LUNs panel, expand SP A and SP B and select all the LUNs created in the previous steps. The Selected LUNs panel appears. Click OK.
4. Rescan storage systems to detect newly-available storage. a. Click Storage tab.
b. Under File Storage pane, click Rescan Storage Systems. c. Click OK to proceed in the window that opens.
Use a new Storage Pool for File to create multiple file systems. Create file systems
A file system exports an NFS file share. Create a file system before creating the NFS file share.
VNX requires a storage pool and a network interface to create a file system.
If no storage pools or interfaces exist, follow the steps in Create a network interface and Create storage pool for file to create a storage pool and a network interface. Create two thin file systems from each Storage Pool for File. Refer to Table 25 for details on the number of file systems. Complete the following steps to create file systems on the VNX for NFS File shares:
5. Log in to Unisphere.
6. Select Storage > Storage Configuration > File Systems. 7. Click Create. The File System Creation Wizard appears. 8. Specify the file system details:
a. Select Storage Pool. b. Type a File System Name.
c. Select a Storage Pool to contain the file system from.
d. Select the Storage Capacity of the file system. Refer to Table 25for detail storage capacity.
e. Select Thin Enabled.
f. Multiply the number of terabytes specified for the file system in table 25 by 1048575 to get the file size in megabytes. Enter this figure in the Maximum Capacity (MB) field.
g. Select Data Mover (R/W) to own the file system.
Note: The selected Data Mover must have an interface defined on it.
127 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide
Figure 49. Create file system dialog box
The newly created file system appears on the File Systems tab. 9. Click Mounts.
10. Select the created file system and then click Properties. 11. Select Set Advanced Options.
12. Select Direct Writes Enabled. 13. Select CIFS Sync Writes Enabled.
128 EMC VSPEX Private Cloud: VMware vSphere 5.5 for up to 1,000 Virtual Machines Enabled by Mircosoft Windows Server 2012 R2, EMc VNX Series, and EMc Powered Backup-Proven Infrastructure Guide
Figure 50. Direct Writes Enabled checkbox
14.Click OK.
15.Export the file systems using NFS, and give root access to ESXi servers.