2013 Anz PDF BRKCOM-1001 - UCS Fabric Fundamentals

UCS Fabric Fundamentals
BRKCOM-1001
BRKCOM-1001
2013 Cisco and/or its affiliates. All rights reserved.
Cisco Public
Hardware State Abstraction
MAC Address
NIC Firmware
NIC Settings
LAN Connectivity
BRKCOM-1001
UUID
BIOS Firmware
BIOS Settings
State
Boot Order
BMC Firmware
Drive Controller F/W

Drive Firmware
abstracted from hardware
OS & Application
WWN Address
HBA Firmware
HBA Settings
Storage Connectivity
Cisco Public
Agenda
Introduction
UCS Key Features

Hardware Overview
Ethernet Connectivity
Demo
BRKCOM-1001
Cisco Public
More UCS sessions

Date
Session
Wednesday
BRKCOM-1005
Thursday
BRKCOM-1004
BRKCOM-2002
BRKCOM-2003
BRKCOM-2008
Friday
BRKCOM-2001
BRKCOM-3001
BRKCOM-1001
Title
UCS Architecture Overview
Automating UCS for Systems Administrators
UCS Supported Storage Architectures
UCS Networking - Deep Dive including VM-FEX
UCS Firmware Management Architecture
UCS Management Architecture - Deep Dive
Troubleshooting the Cisco UCS Compute Deployment
Cisco Public
Introduction
Building Blocks of Cisco UCS

UCS Manager
Embedded manages entire UCS
UCS Fabric Interconnect
10GE unified fabric switch
UCS Fabric Extender (I/O Module)

Remote line card
UCS Blade Server Chassis

Flexible bay configurations
UCS Blade and Rack Servers

x86 industry standard
Patented extended memory
UCS I/O Adapters
Choice of multiple adapters
BRKCOM-1001
Cisco Public
Logical Architecture
SAN A
ETH 1
ETH 2
SAN B
MGMT
MGMT
Uplink Ports
OOB Mgmt
Fabric Switch
Server Ports
Fabric
Extenders
FI A
Cluster
IO
M
A
Virtualised Adapters
Compute Blades
Half / Full width
BRKCOM-1001
FI B
Chassis 1
CNA1
IO
M
IO
M
Half blade
Chassis 20
CNA1
CNA2
Full blade
Cisco Public
IO
M
B
Software Architecture
UCS Manager (UCSM or SAM)
External Interface Layer
Data Management Engine

(DME)
Application / EP Gateways
(AG)
Managed End Points (EP)
BRKCOM-1001
Cisco Public
Service Profiles
Server Name
Server Name
UUID
UUID
MAC
MAC
WWN
WWN
Boot
info
Boot
info
LAN
Config
LAN
Config
SAN
Config
SAN Config
UUID, MAC,WWN
Boot info
LAN, SAN Config
Run-time
association
Firmware
Logical container of server state

information
User-defined
Each profile can be individually created
Profiles can be generated from a template
Applied to physical blades at run time

Without profiles, blades are just anonymous
hardware components
BRKCOM-1001
Cisco Public
UCS Key Features
Cisco Unified Computing System
BRKCOM-1001
Stateless Computing
Hardware Abstraction
Service Profiles
Just-in-time Provisioning
Unified Fabric
Consolidated I/O
UCS Manager
Single Management Domain
Virtual Adapters
Virtualised I/O
Cisco Public
Stateless Computing
Hardware State Abstraction: Enhanced server availability

LAN
SAN
UUID: 56 4dcd3f 59 5b
MAC : 08:00:69:02:01:FC
WWN: 5080020000075740
Boot Order: SAN, LAN
Chassis1/Blade-2
Chassis8/Blade-5
BRKCOM-1001
LAN
SAN
Same identity
moved
Chassis1/Blade-2 UUID: 56 4dcd3f 59 5b
MAC : 08:00:69:02:01:FC
WWN: 5080020000075740
Boot Order: SAN, LAN
Cisco Public
Chassis8/Blade-5
Service Profiles
Benefits
Server Name
Server Name
UUID
UUID
MAC
MAC
WWN
WWN
Boot
info
Boot
info
LAN Config
LAN
Config
SAN
Config
SAN Config
UUID, MAC,WWN
Boot info
LAN, SAN Config
Firmware
Consistent and simplified server

deployment
Pre provisioning
Repurposing
Disaster Recovery
Run-time association
BRKCOM-1001
Cisco Public
Unified Fabric
Consolidated I/O
LAN
LAN
SAN A
LAN
SAN B
SAN B
SAN A
MGMT
MGMT
160 blades
160 blades
Chassis
1
Chassis
2
Chassis
4
Chassis
3
Chassis
10
Chassis
1/2
Chassis
3/4
Chassis
5/6
Chassis
7/8
Chassis
19/20
Chassis
10
Chassis
10
Network Devices
20
Network Devices
Chassis Management
Devices
20
Chassis Management
Devices
Convergence inside each chassis
True FCoE of LAN/SAN & MGMT
Legacy Blade Vendors

BRKCOM-1001
UCS
Cisco Confidential Internal Use Only
Cisco Public
UCS Manager: Single Management Domain

Multi-Chassis Server Identity Manager (VCEM)
Fabric Interconnect A
Fabric Interconnect B
Server Health Monitoring (SIM)

Multi-chassis Server Identity Manager
Enet Switch
FC Switch
CMC/OA
Enet Switch
FC Switch
Enet Switch
FC Switch
CMC/OA
LegacyCMC/OA
Blade Architecture
Enclosure 1: Servers 1-16
Enet Switch
FC Switch
Ethernet
Ethernet
Fiber Channel
Fiber Channel
Enet Switch
FC Switch
Enet Switch
FC Switch
Enet Switch
FC Switch
CMC/OA
CMC/OA
CMC/OA
CMC/OA
Enet Switch
FC Switch
Enet Switch
FC Switch
Enet Switch
FC Switch
Enet Switch
FC Switch
CMC/OA
CMC/OA
CMC/OA
CMC/OA
Blade & Chassis Management
CMC/OA
Enet Switch
FC Switch
Server Health Monitoring
Servers 1-8
Servers 9-16
Servers 17-24
Servers 25-32
Servers 33-40
Servers 41-48
Servers 49-56
Servers 57-64
Servers 65-72
Servers 73-80
Enet Switch
FC Switch
Enet Switch
FC Switch
Enet Switch
FC Switch
Enet Switch
FC Switch
Servers 81-88
Servers 89-96
CMC/OA
CMC/OA
CMC/OA
CMC/OA
Servers 97-104
Servers 105-112
Servers 113-120
Servers 121-128
Enet Switch
FC Switch
Enet Switch
FC Switch
Enet Switch
FC Switch
Enet Switch
FC Switch
Servers 129-136
Servers 137-144
CMC/OA
CMC/OA
CMC/OA
CMC/OA
Servers 145-152
Servers 153-160

BRKCOM-1001

Logical Chassis 1
Cisco Public
UCS Manager: Single Management Domain

SAN A
(Rack) Mgmt
LAN
SAN B
All of the benefits of blades applied to rack servers

Single point of management
Firmware management
Service profiles stateless agility
BRKCOM-1001
Cisco Public
UCS Manager: Multi-Domain Management

Do It Yourself
SDK & Emulator
Open Source
Cisco Product
ISV Partners
UCS Central
System Centre plug-in
GoUCS
Cisco CIAC
BMC Integration
PowerShell & .NET
Cisco NSM
CA integration etc
Most flexible
Flexible
Multi-vendor support
Most powerful
Leverage power
of community
Cisco support and

roadmap
Incumbency
Broadest use cases
UCS Dashboard
Multi-UCS Management Solutions

UCS XML API
UCS XML API
UCS XML API
BRKCOM-1004 Automating UCS for Systems Administrators

BRKCOM-1001
Cisco Public
UCS XML API
Cisco UCS Virtual Interface Card

Creates multiple x16 PCIe Ethernet and FC
interface adapters
UCS 2208 IOM
UCS 2208 IOM
Fabric Failover
Centralised management of virtual interfaces from

UCS Manager
Side B
Side A
Offers Virtualisation aware networking with best

performance (VM-FEX)
vNICs
/vHBAs
BRKCOM-1001
Eth UCS 1280 VIC / 1240 + Exp

FC
FC
Eth
Cisco Public
256
VM-FEX (Vmware ESX, RHEL KVM and

Hyper-V )
Emulated Mode
Each VM gets a dedicated PCIe

device
12%-15% CPU performance
improvement
Appears as distributed virtual
switch to hypervisor
vMotion supported
PCIe Pass-Thru or
VMDirectPath
Co-exists with Standard mode
Bypasses Hypervisor layer
30% improvement in I/O
performance
Appears as distributed virtual

switch to hypervisor
Currently supported with ESX
5.0+ Hyper-V 2012, RHEL KVM
6.3
vMotion supported
BRKCOM-1001
Cisco Public
Hardware Overview
Unified Ports
Customer benefits
Simplify fabric purchase by removing port ratio
estimates
Increase design flexibility
Unified Port
Feature details
Flexibility to configure any port at Ethernet (1/10
Gigabit with SFP+) or FCoE or Native FC Ports
(8/4/2/1G with FC Optics)
All ports on UCS 6200 Series
16-port expansion module (E16UP)
Uses existing Ethernet / Fibre Channel SFP and
SFP+ transceiver
Compared to 6100 Series, Fibre Channel is
standard. No requirement to buy FC module
BRKCOM-1001
Native Fibre Channel
Cisco Public
Lossless Ethernet:
1/10GbE, FCoE, iSCSI,
NAS
UCS 6248 Fabric Interconnect
32 x Fixed ports: 1/10 GE or 1/2/4/8

FC
Fabric Interconnect
Cluster Connectivity
Console
Expansion Module (GEM)
Out of Band Mgmt

10/100/1000
Fan Module
Fan Module
N + N Redundant Fans
BRKCOM-1001
Rear Panel
Front Panel
Power Entry
Power Entry
N + N Power Supplies
Cisco Public
UCS FI 6296 Rear Panel

Expansion Module
Expansion Module
Expansion Module
48 x Fixed ports 1/10 GE or 1/2/4/8 FC

BRKCOM-1001
Cisco Public
UCS FI 6296 Front Panel

Fabric Interconnect
Power Entry
Power Entry
Out of Band Mgmt

10/100/1000
Fan Module
Console
Fan Module
Fan Module
N + 1 Redundant Fans
N + N Power Supplies
BRKCOM-1001
USB Flash
Cisco Public
Fan Module
UCS 5108 Blade Chassis

Up to 8 half slot blades
Up to 4 full slot blades
4x power supplies, N+N grid
redundant
8x fans included
2x UCS Fabric Extender
All items hot-pluggable
AC / DC
BRKCOM-1001
Cisco Public
UCS 5108 Blade Chassis Parts

Rear
6U, 19 Rack
2 Fabric Extenders
(I/O modules)
8 Fan Modules
4 Power
Connectors
Front
6U, 19 Rack
4 to 8 Blades
4 Power
Supplies
BRKCOM-1001
Cisco Public
UCS 5108 Blade Chassis Backplane

Blade Connectors
I/O Modules
PSU Connectors
Redundant data ( 40 G) and management

paths.
BRKCOM-1001
Cisco Public
UCS 2204/2208 Fabric Extender (I/O Module)

Connects UCS blade chassis to the Fabric Interconnect
10 Gigabit Ethernet, FCoE capable, SFP+ ports
Up to 2 Fabric Extenders per chassis for redundancy
Up to 160 Gbps of bandwidth per chassis

Built-in chassis management functionality
Fully managed by UCS Manager through Fabric Interconnect

No local switching
BRKCOM-1001
Cisco Public
Compute Serves : B series

RAS and Performance
Optimised
UCS B440 M2
UCS B230 M2
Database
Consolidation
Virtualisation
UCS B420 M3
Database and
Virtualisation
Mission Critical
Scale-Out
UCS B22 M3
UCS B200 M3
Virtualisation, VDI,
database, ERP and
CRM
Performance
Optimised
IT/Web Infrastructure,
distributed database, ERP and
CRM
Enterprise Class
Web/IT Infrastructure
Proxy/Caching
BRKCOM-1001
Price / Performance Optimised
Cisco Public
Compute Servers : C-Series

UCS C460 M2
RAS and Performance

Optimised
UCS C260 M2
UCS C420 M3
UCS C240 M3
Scale-Out
UCS C220 M3
Virtualisation,
Database and highend HPC
UCS C24 M3
UCS C22 M3
Distributed DB
Middleware
Collaboration
Big Data
Storage Server
Web/IT Infrastructure
Proxy/Caching
BRKCOM-1001
Mission Critical
Performance
Optimised
Data Warehouse
Middleware
Collaboration
Big Data
Enterprise Class
Price / Performance Optimised
Database
Consolidation
Virtualisation
Cisco Public
Database
Consolidation
Virtualisation
Virtualisation Interface Card 1200

B series:1280,1240
C series:1225,P81E
Host connectivity PCIe Gen2 x16
HW Capable of 256 PCIe devices
OS restriction apply
PCIe virtualisation OS independent (same

as M81KR)
Fabric Failover supported
B series Upto Dual 4x10 GE port-channels
to a single server slot
BRKCOM-1005 UCS Architecture Overview
BRKCOM-1001
Cisco Public
Ethernet Connectivity
Block Diagram: Upstream

UCS 6248
UCS 6248
Fabric
Interconnects
IO Modules
16x SFP+
16x SFP+
Expansion Module
2208XP
16x SFP+
16x SFP+
2208XP
Midplane
Mezzanine
1280 VIC
x16 Gen 2
x16 Gen 2
Server Blade
IOH
CPU
CPU
UCS Blade Chassis
BRKCOM-1001
Cisco Public
Expansion Module
Switching Modes: End Host

LAN
Spanning
Tree
FI A
vEth 3
vEth 1
VLAN 10
Fabric A
MAC
Learning
MAC
Learning
L2
Switching
VNIC 0
VNIC 0
Server 1
Server 2
BRKCOM-1001
UCS connects to the LAN like a server, not like a switch

Server vNIC pinned to an uplink port
No Spanning Tree Protocol
Reduces control plane load on FI
Simplified upstream connectivity
Maintains MAC table for servers only
Eases MAC table sizing in the access layer

Allows multiple active uplinks per VLAN
Doubles effective bandwidth vs STP
Prevents loops by preventing uplink-to-uplink switching
Completely transparent to upstream LAN
Traffic on same VLAN switched locally
Cisco Public
End Host Mode : Pinning

Dynamic pinning
Server ports pinned to an uplink
port/port-channel automatically
Static pinning
FI A
Specific ping groups created and

associated with adapters
vEth 3
vEth 1
VNIC 0
VNIC 0
Server X
Oracle
Pinning
Switching
Fabric A
Static pinning allows traffic

management, if required for
certain applications/servers
BRKCOM-1001
DEFINED:
PinGroup
Oracle
Cisco Public
APPLIED:
PinGroup
Oracle
End Host Mode: Upstream Connectivity

With vPC
Without vPC
7K/5K1
7K/5K 2
keep alive
vPC peer-link
PO
EHM
PO
FI A
VNIC 0
EHM
VNIC 0
Server 1
BRKCOM-1001
PO
PO
vPC
FI B
EHM
FI A
VNIC 0
Server 2
Server 1
vPC
EHM
VNIC 0
Server 2
Cisco Public
FI B
End Host Mode: Disjoint Layer 2 Networks

Customer benefits
Ability to support multiple layer 2 disjoint networks
upstream to UCS in End Host Mode
Feature details
Static or dynamic vNIC pinning based on VLAN
membership of the uplink
A VLAN can exist only in one L2 disjoint network,
i.e. no overlap
A vNIC is mutually exclusive to a L2 network
upstream, i.e. a L2 network per vNIC
More than two L2 disjoint networks supported per
host with virtual interface card
BRKCOM-1001
Production
Vlan 10,20
Public
Vlan 31,32
End
Host
Cisco Public
End
Host
Backup
Vlan 40,41
Switch Mode
Fabric Interconnect behaves like a normal Layer 2 switch
Spanning tree protocol is run on the uplink ports per VLAN
MAC learning/aging happens on both the server and uplink ports like in
a typical Layer 2 switch
Was required for certain Application Specific Scenarios

Disjoint VLAN
Direct connect Appliance
Microsoft Load Balancing Clusters
BRKCOM-1001
Cisco Public
Block Diagram: FEX 2204

UCS 6248
UCS 6248
Fabric
Interconnects
16x SFP+
16x SFP+
Expansion Module
16x SFP+
16x SFP+
Expansion Module
4 X Network Interface (NIF)

IOM A to FI A
IOM B to FI B
Equal Number of uplinks
IO Modules
2204XP
2204XP
16 X Host Interface (HIF)

16Downlinks
Midplane
Mezzanine
Mezz Card
x16 Gen 2
x16 Gen 2
Server Blade
IOH
CPU
CPU
UCS Blade Chassis
BRKCOM-1001
Cisco Public
Block Diagram: FEX 2208

UCS 6248
UCS 6248
Fabric
Interconnects
16x SFP+
16x SFP+
Expansion Module
16x SFP+
16x SFP+
Expansion Module
8 x Network Interface (NIF)

IO Modules
2208XP
2208XP
Host Interface (HIF)

32 Downlinks
Midplane
Mezzanine
Mezz Card
x16 Gen 2
x16 Gen 2
Server Blade
IOH
CPU
CPU
UCS Blade Chassis
BRKCOM-1001
Cisco Public
Block Diagram: FEX

UCS 6200
UCS 6200
Fabric
Interconnects
16x SFP+
16x SFP+
Expansion Module
16x SFP+
16x SFP+
Expansion Module
Network Interfaces (NIF) to FI

IO Modules
220X XP
220X XP
Host Interface (HIF) to blades
Midplane
Mezzanine
Server Blade
UCS Blade Chassis
BRKCOM-1001
Cisco Public
UCS 2200 : Discrete Mode (Pinning)

Server slots pinned to uplink
slot 1
slot 2
slot 3
slot 4
slot 5
slot 6
slot 7
slot 8
slot 1
slot 2
slot 3
slot 4
slot 5
slot 6
slot 7
slot 8
slot 1
slot 2
slot 3
slot 4
slot 5
slot 6
slot 7
slot 8
F
E
X
F
E
X
F
E
X
BRKCOM-1001
1 link
NIF
2 links
Fabric Interconnect
Uplink: slots 1,2,3,4,5,6,7,8
Fabric Interconnect
Uplink 1: slots 1,3,5,7

Uplink 2: slots 2,4,6,8
NIF
4 links
Fabric Interconnect
NIF
Uplink 1: slots 1,5

Uplink 2: slots 2,6
Uplink 3: slots 3,7
Uplink 4: slots 4,8
Cisco Public
UCS 2208 : Discrete Mode (Pinning)

Server slots pinned to uplink
slot 1
slot 2
slot 3
slot 4
slot 5
slot 6
slot 7
slot 8
8 links
F
E
X
Fabric Interconnect
NIF
Uplink 1: slot 1
Uplink 2: slot 2
Uplink 3: slot 3
Uplink 4: slot 4
Uplink 5: slot 5
Uplink 6: slot 6
Uplink 7: slot 7
Uplink 8: slot 8
No discrete mode support with 3,5,6,7 uplinks
Adding more links was disruptive
BRKCOM-1001
Cisco Public
UCS 2200 :Port Channel
FI 6200
FI 6200
Customer benefits
Resilience and flexibility
80 Gb
80 Gb
Port-Channel
Feature details
Up to 8 * 10 Gb aggregated bandwidth to each
fabric in a chassis
Port-channel is a user configurable choice,
default mode discrete
Addition of links does not require chassis reacknowledge
Supported number of links in a port-channel:
1,2,3,4,5,6,7 or 8
Load balancing
2208
FI 6200
FI 6200
40 Gb
40 Gb
Port-Channel
2204
BRKCOM-1001
Cisco Public
UCS 2200 :Port Channel

Server slots channelled across
all uplinks
slot 1
slot 2
slot 3
slot 4
slot 5
slot 6
slot 7
slot 8
slot 1
slot 2
slot 3
slot 4
slot 5
slot 6
slot 7
slot 8
4 links
F
E
X
Fabric Interconnect
NIF
8 links
F
E
X
BRKCOM-1001
Fabric Interconnect
NIF
Uplink 1: slots 1-8

Uplink 2: slots 1-8
Uplink 3: slots 1-8
Uplink 4: slots 1-8
Server slots channelled across

all uplinks
Uplink 1: slots 1-8
Uplink 2: slots 1-8
Uplink 3: slots 1-8
Uplink 4: slots 1-8
Uplink 5: slots 1-8
Uplink 6: slots 1-8
Uplink 7: slots 1-8
Uplink 8: slots 1-8
Cisco Public
UCSM C-series Integration (Nexus 2232)

UCS 2.1 and CIMC release
1.4(6) Required for VIC 1225
UCS 6100 or 6200
Default CIMC Settings
Nexus 2232
Shared-LOM-EXT
Dual Wire Mode still supported
Multiple VIC 1225 supported
GE LOM
PCIe Adapter
CIMC
OS or Hypervisor
C240, C260, C420, C460

NO Direct FI SUPPORT
Mgmt Traffic
Data Traffic
(LAN and FCoE)
BRKCOM-1001
Cisco Public
Block Diagram: Fabric Failover

UCS 6248
UCS 6248
Fabric
Interconnects
IO Modules
16x SFP+
16x SFP+
Expansion Module
2208XP
16x SFP+
16x SFP+
2208XP
Midplane
Mezzanine
1280 VIC
Fabric Failover
Server Blade
vNIC
UCS Blade Chassis
BRKCOM-1001
Cisco Public
Expansion Module
End Host Mode: Fabric Failover for Ethernet

Fabric provides NIC failover capabilities
when defining a service profile
Traditionally done using NIC bonding
driver in the OS
Provides failover for both unicast and

multicast traffic
UCS 6248
UCS 6248
16x
SFP+
16x
SFP+
2208XP
Expansion
Module
16x
SFP+
16x
SFP+
2208XP
Works for any OS on bare metal
Recommended in case of bare metal OS

Hyper - V
1280 VIC
vNIC
UCS Blade Chassis
BRKCOM-1001
Cisco Public
Expansion
Module
Block Diagram: VIC Adapter Port Channel

UCS 6200
UCS 6200
Fabric
Interconnects
16x SFP+
IO Modules
16x SFP+
Expansion Module
16x SFP+
2200
16x SFP+
Expansion Module
2200
Midplane
Mezzanine
1200 VIC
Server Blade
4x10 Gbps Ether channel from VIC 1200 to 2208 IO Modules

2 x 10 Gbps Ether channel from VIC 1200 to 2204 IO Modules
No user configuration required
vNIC flows are Load Balanced across links
Each individual flow limited to 10Gb
Fabric Failover available
1. 10 Gb FTP traffic
2. 10 Gb UDP traffic
BRKCOM-1001
UCS Blade Chassis
Cisco Public
Block Diagram: VM-FEX

UCS 6200
UCS 6200
Fabric
Interconnects
IO Modules
16x SFP+
16x SFP+
Expansion Module
16x SFP+
2200XP
16x SFP+
Expansion Module
2200XP
Midplane
Mezzanine
1280 VIC
x16 Gen 2
VM-FEX
x16 Gen 2
Server Blade
UCS Blade Chassis
BRKCOM-2003
UCS Networking
- Deep
Dive includingCiscoVM-FEX
Public
BRKCOM-1001
2013 Cisco and/or its affiliates.
All rights reserved.
SAN End Host NPV Mode

N-Port Virtualisation Forwarding
SAN A
Fabric Interconnect operates in N_Port Proxy mode
Simplifies multi-vendor interoperation
SAN B
Simplifies management
FLOGI
FDISC
NPIV
SAN switch sees Fabric Interconnect as an FC End

Host with many N_Ports and many FC IDs assigned
NPIV
F_Port
F_Port
VSAN 101
N_Proxy
FI-A
Server facing ports function as F-proxy ports
VSAN 201
N_Proxy
FI-B
vFC 1
vFC 2
F_Proxy
vFC 1
vFC 2
F_Proxy
Server vHBA pinned to an FC uplink in the same

VSAN. Round Robin selection
Provides multiple FC end nodes to one F_Port off an
FC Switch
Eliminates the FC domain on UCS Fabric Interconnect
N_Port
vHBA 0
N_Port
vHBA 1
vHBA 0
One VSAN per F_port (multi-vendor)

vHBA 1
Server 1
Server 2
VSAN 1
VSAN 1
BRKCOM-1001
F_Port Trunking and Channelling with MDS, 5K
Cisco Public
SAN End Host NPV Mode

N-Port Virtualisation Forwarding with MDS, Nexus 5000
F_ Port
Channel & Trunk
SAN A
SAN B
NPIV
NPIV
F_Port Channelling and Trunking from MDS or Nexus

5000 to UCS
FC Port Channel behaves as one logical uplink
F_Port
FC Port Channel can carry all VSANs (Trunk)
VSAN
201,202
VSAN
101,102
UCS Fabric Interconnects remains in NPV end host

mode
N_Proxy
FI-A
FI-B
vFC 1
vFC 2
vFC 1
vFC 2
Server vHBA has access to bandwidth on any link

member of the FC Port Channel
F_Proxy
Load balancing based on FC Exchange_ID per flow
N_Port
vHBA 0
Server vHBA pinned to an FC Port Channel
vHBA 1
vHBA 0
vHBA 1
Server 1
Server 2
VSAN 1
VSAN 2
BRKCOM-1001
Cisco Public
SAN FC Switch Mode
FC
UCS Fabric Interconnect behaves like an FC fabric

switch
Storage ports can be FC or FCoE
N_Port
SAN
FCoE
MDS
VSAN 2
VSAN 1
TE_Port
Ethernet and FC switching modes are independent

Local Zoning OR Upstream Zoning
Parallel Local and Upstream Zoning Currently
NOT Supported
Upstream Zoning Provided by MDS/N5k
Fabric Interconnect uses a FC Domain ID
Supported FC/FCoE Direct Connect Arrays
MDS
F_Port
FI-A FC Switch
FI-B FC Switch
vFC 1
vFC 2
vFC 1
vFC 2
F_Port
N_Port
vHBA 0
vHBA 1
vHBA 0
vHBA 1
Check Note 5 on HCL for Updated List
Lower cost point for small deployments (no

access layer FC/FCoE switches required)
BRKCOM-1001
Server 1
Server 2
VSAN 1
VSAN 2
Cisco Public
Multi-Hop FCoE
FCoE STORAGE
End-to-End FCoE
MDS, N5K, N7K FCoE Capable

Switches Supported Upstream
New Port Type Unified Uplink
FCoE
FCoE
MDS/N5K/N7K
MDS/N5K/N7K
FCoE/Ethernet
Carries FCoE and Normal Ethernet

Traffic
Unified Uplinks
NPV/EHM
UCS FI
UCS FI
Fabric Interconnect in End Host Mode

or Switch Mode
UCS B-Series
BRKCOM-1001
Cisco Public
FCoE/Ethernet
NAS Direct Attach (Appliance Port)

LAN
NAS
Default (recommended) - End Host

Mode
Volume
A
Volume
B
C1
C2
Superior traffic engineering

Easier integration into network
Appliance
Port
1.4 Introduced Appliance Ports which

allow direct connect NAS filers
FI_A
vEth 1
A
vEth 2
FI-B
vEth 1
U
vEth 2
Options - Ethernet Switching Mode

As of 1.4, no need to use this mode for
NAS direct connect
Previous releases required switching
mode for direct connect NAS
BRKCOM-1001
vNIC
0
vNIC
1
vNIC
0
vNIC
1
Server 1
Server 2
Accessing
Volume A
Accessing
Volume B
Cisco Public
Unified Appliance Support

Storage
File and block data over a single

port/cable
FCoE, iSCSI, NFS, CIFS
FCoE
iSCSI
NFS
CIFS
Unified Appliance Port
Port and cable consolidation
New port type: Unified Appliance Port
UCS FI
UCS FI
Appliance port of today + FCoE
Initial support for NetApp storage and

their Unified Target Adapter
UCS B-Series
BRKCOM-1001
Cisco Public
58
iSCSI Boot
An alternative boot option for stateless servers
iSCSI Boot Support

Cisco UCS Virtual Interface Card (M81KR )
Cisco UCS M51KR-B Broadcom BCM5771
Option ROM uses iSCSI Boot Firmware Table (iBFT)

iSCSI Hardware Offload is not a requirement to support booting, only
supporting in the option ROM
BRKCOM-2002 UCS Supported Storage Architectures

BRKCOM-1001
Cisco Public
Demo / Basic Configuration Steps
UCS Configuration Workflow

Physical
Base Configuration
Network Configuration
Storage Configuration
Server Configuration
BRKCOM-1001
Cisco Public
Topology
ETH 1
SAN A
ETH 2
SAN B
VLAN 10
VLAN 1000
VSAN
101, 102
32
VSAN
201, 202
31
30
29
FI A
1
I
O
M
L1 L1
29
30
I
O
M
I
O
M
Chassis 2
CNA1
I
O
M
Server-01
BRKCOM-1001
32
FI B
L2 L2
Chassis 1
31
Cisco Public
Console setup : Fabric Interconnect A

You have chosen to setup a new Fabric interconnect. Continue? (y/n): y
Enforce strong password? (y/n) [y]:
Enter the password for "admin": <password>
Confirm the password for "admin": <password>
Is this Fabric interconnect part of a cluster(select 'no' for standalone)? (yes/no) [n]: y
Enter the switch fabric (A/B) []: a
Enter the system name: <UCS Domain name>
Physical Switch Mgmt0 IPv4 address : <FI A IP>
Physical Switch Mgmt0 IPv4 netmask : <MASK>
IPv4 address of the default gateway : <Gateway>
Cluster IPv4 address : <CLUSTER IP>
Configure the DNS Server IPv4 address? (yes/no) [n]:
Configure the default domain name? (yes/no) [n]:
Following configurations will be applied:

Switch Fabric=A
System Name= UCS Domain name
Enforced Strong Password= no
Physical Switch Mgmt0 IP Address= FI A IP
Physical Switch Mgmt0 IP Netmask= MASK
Default Gateway= GATEWAY
Cluster Enabled= yes
Cluster IP Address= IP
NOTE: Cluster IP will be configured only after both Fabric Interconnects are initialized
Apply and save the configuration (select 'no' if you want to re-enter)? (yes/no):
Applying configuration. Please wait.
Configuration file Ok
Cisco UCS 6200 Series Fabric Interconnect
<UCS Domain name>-A login:
BRKCOM-1001
Cisco Public
Console setup : Fabric Interconnect B

Enter the configuration method. (console/gui) ? console
Installer has detected the presence of a peer Fabric interconnect. This Fabric interconnect will be added
to the cluster. Continue (y/n) ? y
Enter the admin password of the peer Fabric interconnect:
Connecting to peer Fabric interconnect... done
Retrieving config from peer Fabric interconnect... done
Peer Fabric interconnect Mgmt0 IP Address: <FI A IP >
Peer Fabric interconnect Mgmt0 IP Netmask: <FI A MASK>
Cluster IP address
: <CLUSTER IP>
Physical Switch Mgmt0 IPv4 address : <FI B IP>
Apply and save the configuration (select 'no' if you want to re-enter)? (yes/no): yes
Applying configuration. Please wait.
Configuration file - Ok
Cisco UCS 6200 Series Fabric Interconnect

<UCS Domain name>-B login:
BRKCOM-1001
Cisco Public
Configuration overview
Basic Configuration
1. Configure Chassis Discovery and Power Policy
2. Configure Unified Ports

3. Configure Server ports for Chassis Discovery
4. Configure Management IP (KVM)
BRKCOM-1001
Cisco Public
Network Configuration
1. Configure network uplink ports
2. Configure Port Channel

3. Configure VLAN (Dev 10, Dev-Clu-1000 )
BRKCOM-1001
Cisco Public
Storage Configuration
1. Enable FC trunking
2. Configure VSAN (A:101,102 B:201,202)

FCOE VLAN id not used as a data vlan
3. Configure storage uplink ports
4. Configure Port Channel
BRKCOM-1001
Cisco Public
Service Profile
1. Service Profile Experts Wizard
2. UUID settings
3. vNIC settings
4. vHBA settings
5. Boot settings
6. Associate blade
7. Install OS
BRKCOM-2001 UCS Management Architecture - Deep Dive

BRKCOM-1001
Cisco Public
More UCS sessions

Date
Session
Wednesday
BRKCOM-1005
Thursday
BRKCOM-1004
BRKCOM-2002
BRKCOM-2003
BRKCOM-2008
Friday
BRKCOM-2001
BRKCOM-3001
BRKCOM-1001
Title
UCS Architecture Overview
Automating UCS for Systems Administrators
UCS Supported Storage Architectures
UCS Networking - Deep Dive including VM-FEX
UCS Firmware Management Architecture
UCS Management Architecture - Deep Dive
Troubleshooting the Cisco UCS Compute Deployment
Cisco Public
Q&A
Complete Your Online Session

Evaluation
Complete your session evaluation:
Directly from your mobile device by
visiting
www.ciscoliveaustralia.com/mobile and
login by entering your username and
password
Visit one of the Cisco Live internet
stations located throughout the venue
Open a browser on your own computer

to access the Cisco Live onsite portal Dont forget to activate your Cisco Live 365 account
for access to all session material, communities, and

on-demand and live activities throughout the year.
Activate your account by visiting
www.ciscolive365.com
BRKCOM-1001
Cisco Public
71
BRKCOM-1001
Cisco Public

2013 Anz PDF BRKCOM-1001 - UCS Fabric Fundamentals

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

2013 Anz PDF BRKCOM-1001 - UCS Fabric Fundamentals

Uploaded by

Copyright:

Available Formats

UCS Fabric Fundamentals

2013 Cisco and/or its affiliates. All rights reserved.

Hardware State Abstraction

Drive Controller F/W

abstracted from hardware

UCS Key Features

2013 Cisco and/or its affiliates. All rights reserved.

More UCS sessions

2013 Cisco and/or its affiliates. All rights reserved.

Building Blocks of Cisco UCS

UCS Fabric Extender (I/O Module)

UCS Blade Server Chassis

UCS Blade and Rack Servers

2013 Cisco and/or its affiliates. All rights reserved.

Data Management Engine

Managed End Points (EP)

2013 Cisco and/or its affiliates. All rights reserved.

Logical container of server state

Applied to physical blades at run time

2013 Cisco and/or its affiliates. All rights reserved.

UCS Key Features

Cisco Unified Computing System

Single Management Domain

2013 Cisco and/or its affiliates. All rights reserved.

Hardware State Abstraction: Enhanced server availability

2013 Cisco and/or its affiliates. All rights reserved.

Consistent and simplified server

2013 Cisco and/or its affiliates. All rights reserved.

Convergence inside each chassis

True FCoE of LAN/SAN & MGMT

Legacy Blade Vendors

2013 Cisco and/or its affiliates. All rights reserved.

UCS Manager: Single Management Domain

Server Health Monitoring (SIM)

Enclosure 1: Servers 1-16

Enclosure 2: Servers 17-32

Enclosure 4: Servers 49-64

Enclosure 5: Servers 65-80

Blade & Chassis Management

Enclosure 3: Servers 33-48

Server Health Monitoring

Enclosure 6: Servers 81-96

Enclosure 7: Servers 97-112

Enclosure 8: Servers 113-128

Enclosure 9: Servers 129-144

Enclosure 10: Servers 145-160

UCS Manager: Single Management Domain

All of the benefits of blades applied to rack servers

Service profiles stateless agility

2013 Cisco and/or its affiliates. All rights reserved.

UCS Manager: Multi-Domain Management

SDK & Emulator

System Centre plug-in

PowerShell & .NET

Cisco support and

Broadest use cases

Multi-UCS Management Solutions

UCS XML API

UCS XML API

BRKCOM-1004 Automating UCS for Systems Administrators

2013 Cisco and/or its affiliates. All rights reserved.

UCS XML API

Cisco UCS Virtual Interface Card

UCS 2208 IOM