UCS Network Configuration for Unified CCE
(→Network Requirements for UCS C Series Servers: Major update to address field issues with old design - new design added along with new diagrams)
m (1 revision)
Revision as of 19:20, 13 February 2012
UCCE on UCS B-Series Network Configuration
The following sections provide instructions on performing the network configuration needed to deploy Cisco Unified Contact Center Enterprise (UCCE) on UCS B-Series servers.
Design Considerations for High Availability
The High Availability (HA) deployment provides redundancy from a component failure in the Unified Computing System (UCS) architecture.
For deploying Cisco Unified Contact Center Enterprise (UCCE) on UCS B-Series servers, it is mandatory that HA must be used. Please follow the best practices and guidelines described in the Cisco white paper Design Consideration for High Availability and Scalability in Blade Server Environment for guidelines on implementing HA. Pay particular attention to the following information in this white paper:
- The guidelines described in the section “Server I/O High Availability Architecture” with redundant infrastructure and paths.
- The diagrams of HA design shown in Figure 2, Figure 4, and Figure 6 in the above white paper. For an additional example of Cisco UCS 6100 Series Fabric Interconnects HA, refer to Figure 5 in this document.
This HA design requires redundant Cisco UCS 6100 Series Fabric Interconnects on a Cisco UCS and redundant Cisco UCS 2104XP Fabric Extenders.
For an introduction to UCS architecture, see the Cisco white paper http://www.cisco.com/en/US/prod/collateral/ps10265/ps10281/solution_overview_c22-522771.pdf.
Setting up the Cisco UCS Fabric and the Ethernet Network
Figure 1 below shows the cable connections between the following UCS Fabric components with redundant configuration for a Unified CCE on UCS B-series deployment:
- Two Cisco MDS multilayer fabric switches
- Two Cisco UCS 6100 Series Fabric Interconnects
- Two Cisco UCS 2104 Series Fabric Extenders
- Dual redundant Ethernet Uplinks that will be connected to redundant Network Routers.
Please note that the B200 blade is configured with the Cisco UCS M71KR-Q QLogic network adapter that provides 10 Gigabit Ethernet and Fibre Channel connectivity for the server. However, when deploying Clustering Over the WAN with B-Series hardware, the Cisco UCS M81KR Virtual Interface Card is used instead of the Cisco UCS M71KR-Q.
UCS B-Series General Network Configuration for Unified CCE Deployment
Figure 1 illustrates UCS B-Series network configuration for Unified CCE deployment.
UCS Fabric Ethernet switching mode must be set to End-Host Mode. Switching Mode is not supported.
Redundant chassis is not required, but recommended.
Unified CCE Public and Private Network Configuration (for deployments other than Clustering Over the WAN)
Figure 2 illustrates the Unified CCE Public and Private network connections set up in the UCS B-Series system.
Unified CCE Public and Private Network Configuration for Clustering Over the WAN
Figure 3 illustrates Unified CCE Public and Private network connections set up in the UCS B-Series system with split fabric (i.e., a deployment containing redundant interfaces for each network alternating Fabric side (A/B)) and Clustering Over the WAN deployments.
Creating the UCS Profile
Understanding the service profile is key to understanding the blade management in the UCS. The service profile represents a logical view of a single blade server, without needing to know exactly which blade you are talking about. The profile object contains the server personality (identity and network information). The profile can then be associated with a single blade at a time. The following link provides a step by step guide on how to provision service profiles.
Every server that is provisioned in the Cisco UCS is specified by a service profile. A service profile is a software definition of a server and its LAN and SAN network connectivity. In other words, a service profile defines a single server and its storage and networking characteristics. The UCS Manager software is embedded in the Cisco UCS 6100 Series Fabric Interconnects, which is also where the service profiles are stored. When a service profile is deployed to a server, UCS Manager automatically configures the server, adapters, fabric extenders, and fabric interconnects to match the configuration specified in the service profile. Automating the device configuration reduces the number of manual steps required to configure servers, network interface cards (NICs), host bus adapters (HBAs), and LAN and SAN switches.
This page does not provide a step by step guide on how to use UCS manager. However, it provides the necessary information to configure a service profile for Unified CCE.
VLAN Configuration for Unified CCE Public and Private Traffic
The service profile must have the complete and correct VLANs configured for Unified CCE Public and Private traffic.
The following shows an example of the VLANs needed for a Unified CCE deployment.
- One VLAN is needed for the Public Ethernet traffic
- One VLAN is needed for the Private Ethernet traffic.
Public and Private Traffic Deployment
The following figure illustrates the VLANs needed on the SideA blade for most Unified CCE deployments. In these deployments, a similar VLAN configuration would be needed on the SideB blade.
Public and Private Traffic for Split Fabric and Clustering Over the WAN Deployment
For split fabric and Clustering Over the WAN deployments, the Public and Private networks must be configured to use their own redundant interfaces, with redundant interfaces for each network alternating Fabric side (A/B). It is also best practice to configure separate redundant interfaces for the management networks. These interfaces will be used in configuration of the vSwitches for networks in the HyperVisor.
Note MAC addresses in UCS Manager for all vNICs, as the vNIC numbers do not map to same number vmnic in the HyperVisor.
Note that in order to provision more than two interfaces per blade, the M81KR “Palo” Cisco Converged Network Adapter (CNA) must be used. The M71KR is only capable of provisioning two interfaces and is limited to the configuration shown in Figure 4.
The figure below illustrates redundant interfaces for Public, Private and management networks (where two pairs of Public interfaces are shown due to the example configuration having the management network on the same VLAN).
The service profile must have a vSAN configured for Unified CCE. The following shows an example of the vSAN needed for a UCCE deployment. The vSAN network ID must match the vSAN ID configured on the SAN devices for connectivity.
Configuring the VLAN on the Network Router
The following is an example of the port configuration for the network router. For redundancy there must be at least two TenGigabitEthernet ports configured per UCS 6100 Series Fabric Interconnect.
interface TenGigabitEthernet2/1 description Fabric-Connect-A switchport switchport trunk encapsulation dot1q switchport trunk allowed vlan 1,10,11 switchport mode trunk no ip address mls qos trust cos spanning-tree portfast trunk
Where VLAN trunking is used to uplink to VMware, it is essential that the network configuration be implemented correctly. Testing has shown that improper configuration of VLAN trunking directly and negatively impacts performance of the system.
As with all previous Unified CCE deployments, there must be dedicated public and private links between routers following supported models as defined in the Cisco Unified Contact Center Enterprise Solution Reference Network Design (SRND).
Configuring the Virtual Switch and vmnic Adapters
For deploying Cisco Unified CCE on UCS B-Series servers, configure the vSwitches and vmnic adapters as follows:
vSwitch and vmnic Adapter Configuration
In most deployments, you create one ESXi virtual switch and connect both VM virtual Ethernet adapters to the virtual switch, as shown in the following figure. See Configuring the ESXi Host Network for the Virtual Machines for instructions.
NOTE: The Nexus 1000 virtual switch is not supported as a VMware switch.
vSwitch and vmnic Adapter Configuration for Split Fabric and Clustering Over the WAN Deployment
For split fabric and UCS Clustering Over the WAN deployments that use the M81KR Virtual Interface Card, create ESXi virtual switches and connect VM virtual Ethernet adapters as shown in the following figure.
Assign physical adapters (vmnics) to vSwitches by MAC address to ensure that the correct interfaces created by the UCS profile are being assigned. Make sure that the Public and Private networks use alternate Fabrics (A/B) on their Active vmnic.
Unified CCE on UCS C-Series Network Configuration
The following section provides instructions on performing the network configuration needed to deploy Cisco Unified Contact Center Enterprise (Unified CCE) on UCS C-Series servers.
Network Requirements for UCS C Series Servers
The below design is the default and recommended for all Unified CCE deployments on UCS C series servers. Exampled in Figures 10 and 11 are two possible network side implementations of the same vSphere Hypervisor vSwitch design. This design calls for using the VMware NIC Teaming (without load balancing) of vmnic interfaces in an Active/Standby configuration through alternate and redundant hardware paths to the network, thereby preventing any single point of failure from affecting the Visible or Private network communications.
The network side implementation does not have to exactly match either of those illustrated below, but it must allow for redundancy and not allow for single points of failure affecting both Visible and Private network communications. There are more possible ways that this could be implemented in a supportable design than can be covered here.
- Ethernet interfaces must be Gigabit speed, and connected to Gigabit Ethernet switches. 10/100 Ethernet is not supported.
- No single point of failure is allowed for visible and private networks.
- Network switch infrastructure cannot use Cisco Stacking technology to combine all switches the UCS C series server is connected to into a single virtual switch.
- Network switches must be configured properly for connection to VMware Hypervisor. Please refer to the below for details on ensuring proper switch configuration to prevent STP delay in failover/fallback scenarios.
Figure 9 illustrates how to configure the vSwitches and vmnic adapters on a C-Series server using the redundant Active/Standby vSwitch NIC Teaming design.
Note: vmnic numbers in figure 9 do not match those illustrated in figures 10 and 11 below.
Figure 10 illustrates a sample UCS C-Series server network configuration for UCCE components that require both Public and Private network connections, and how that can work using the Active/Standby design with two network switches.
Figure 11 illustrates a sample UCS C-Series server network configuration for UCCE components that require both Public and Private network connections, and how that can be deployed using the Active/Standby design with three network switches.
Note: The Management VLAN and design is not fully illustrated as we do not have specific requirements for it to be deployed in any specific manner other than separate from the Visible and Private vSwitch & network interfaces. Please refer to VMware for best practices in deploying vSphere VMKernel/management interfaces to network.
Configuring the ESXi Host Network for the Virtual Machines
To configure the network for VMs, you create a virtual switch connected to an Ethernet port on the server, and then associate the virtual machine's network adapter to this virtual switch.
To Add a vSwitch
- Login to the ESXi host using VMware Infrastructure Client
- Select the ESXi host
- Click on the Configuration tab
- Click on Hardware/Networking
- Click on Add Networking...
- Select Connection Types: Virtual Machine. Click Next.
- Select "Create a virtual switch" and select an associated VM NIC.
- Enter Port Group Properties/Network label: VM Network n, where n is an integer.(Example: "VM Network 1")
- Click on Finish.
To Associate a VM Network Adapter to Network Connection
- Edit virtual machine settings.
- Select the Network Adapter.
- Select a virtual switch from the Network Connection/network label. (Example: "VM Network 1")
- Click OK.