UMMT 3.0 Implementation Guide - Large Network Multi-Area IGP Design With IPMPLS Access Design and Implementation Guide

CISCO CONFIDENTIAL
UMMT 3.0 Implementation Guide - Large Network, Multi-Area IGP Design with IP/MPLS Access Design and Implementation Guide
SDU-6516 Version 1 Sept. 11, 2012
Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883
CISCO CONFIDENTIAL
Cisco Validated Design

The Cisco Validated Design Program consists of systems and solutions designed, tested, and documented to facilitate faster, more reliable, and more predictable customer deployments. For more information visit www.cisco.com/go/validateddesigns. THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS. THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY. The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB's public domain version of the UNIX operating system. All rights reserved. Copyright 1981, Regents of the University of California. NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED "AS IS" WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE. IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com/go/trademarks. Third party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (1110R) Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental. UMMT 3.0 Implementation Guide - Large Network, Multi-Area IGP Design with IP/MPLS Access Design and Implementation Guide 1992-2012 Cisco Systems, Inc. All rights reserved.
CISCO CONFIDENTIAL
CONTENTS
Preface
ix
Document Version and System Release ix Document Organization x Obtaining Documentation, Obtaining Support, and Security Guidelines
CHAPTER
Introduction
1-1
CHAPTER
Reference Topology
2-1
CHAPTER
Unified MPLS Transport 3.1
3-1
3.2
Multi-Area IGP Design with Labeled BGP Access 3 - 1 3.1.1 Core Route Reflector Configuration 3 - 2 3.1.2 Mobile Transport Gateway Configuration 3 - 5 3.1.3 Core Area Border Router Configuration 3 - 8 3.1.4 Pre-Aggregation Node Configuration 3 - 12 3.1.5 Cell Site Gateway Configuration 3 - 16 Multi-Area IGP Design with IGP/LDP Access 3 - 18 3.2.1 Pre-Aggregation Node Configuration 3 - 20 3.2.2 Cell Site Gateway Configuration 3 - 25
CHAPTER
Services 4.1
4-1
4.2
4.3
L3 MPLS VPN Service Model for LTE 4 - 1 4.1.1 MPLS VPN Transport for LTE S1 and X2 Interfaces 4 - 1 4.1.2 MPLS VPN Control Plane 4 - 5 L2 MPLS VPN Service Model for 2G and 3G 4 - 9 4.2.1 CESoPSN VPWS Service from CSG to MTG 4-9 4.2.2 SAToP VPWS Service from PAN to MTG 4 - 12 4.2.3 ATM Clear-channel VPWS Service from PAN to MTG 4 - 15 4.2.4 ATM IMA VPWS Service from PAN to MTG 4 - 18 Fixed-Mobile Convergence Use Case 4 - 20
UMMT 3.0 Implementation Guide - Large Network, Multi-Area IGP Design with IP/MPLS Access DIG, v.1
SDU-6516
iii
Contents
CISCO CONFIDENTIAL
CHAPTER
Synchronization Distribution 5.1
5-1
5-1
Hybrid Model Configuration
CHAPTER
High Availability 6.1
6-1
6.2
Transport Network High Availability 6 - 1 6.1.1 Loop-Free Alternate Fast Reroute with BFD 6-1 6.1.2 BGP Fast Reroute 6-5 6.1.3 Multihop BFD for BGP 6-6 Service High Availability 6 - 8 6.2.1 MPLS VPN- BGP FRR Edge Protection and VRRP 6-8 6.2.2 Pseudowire Redundancy for ATM and TDM services
6 - 10
CHAPTER
Quality of Service
7-1
CHAPTER
Operations, Administration, and Maintenance 8.1 IP SLA Implementation

8-3
8-1
CHAPTER
Related Documents
9-1
iv
SDU-6516
CISCO CONFIDENTIAL
FIGURES
Figure 1-1 Figure 2-1 Figure 3-1 Figure 3-2 Figure 3-3 Figure 3-4 Figure 3-5 Figure 3-6 Figure 3-7 Figure 3-8 Figure 3-9 Figure 4-1 Figure 4-2 Figure 4-3 Figure 4-4 Figure 4-5 Figure 4-6 Figure 5-1 Figure 6-1 Figure 6-2 Figure 6-3 Figure 7-1 Figure 8-1
UMMT Transport Models 1 - 1 Reference Topology - Large Network, Multi-Area IGP-based Design 2-1 Unified MPLS Transport for Multi-Area IGP Design with Labeled BGP Access 3 - 1 Centralized Core Route Reflector (CN-RR) 3 - 3 Mobile Transport Gateway (MTG) 3 - 6 Core Area Border Router (CN-ABR) 3 - 9 Pre-Aggregation Node (PAN) 3 - 12 Cell Site Gateway (CSG) 3 - 16 Unified MPLS Transport for Multi-Area IGP Design with IGP/LDP Access 3 - 19 Pre-Aggregation Node (PAN) 3 - 20 Cell Site Gateway (CSG) 3 - 25 MPLS VPN Service Implementation for LTE Backhaul 4 - 1 BGP Control Plane for MPLS VPN Service 4 - 5 CESoPSN Service Implementation for 2G and 3G Backhaul 4 - 9 SAToP VPWS Service Implementation for 2G Backhaul 4 - 12 ATM VPWS Service Implementation for 3G Backhaul 4 - 15 ATM VPWS Service Implementation for 3G Backhaul 4 - 18 Test Topology 5-2 Multihop BFD Topology 6-7 CESoPSN/SAToP Service Implementation for 2G and 3G Backhaul 6 - 11 ATM VPWS Service Implementation for 3G Backhaul 6 - 13 QoS Enforcement Points 7-1 OAM implementation for Mobile RAN Service Transport 8-1
SDU-6516
CISCO CONFIDENTIAL
vi
SDU-6516
CISCO CONFIDENTIAL
TABLES
Table i-1 Table i-2 Table 1-1 Table 5-1
Document Version i - ix Document Organization i - x Approaches for Extending the Unified MPLS LSP Connectivity Table 5-2
1-2
SDU-6516
vii
CISCO CONFIDENTIAL
viii
SDU-6516
CISCO CONFIDENTIAL
Preface
This implementation guide is for Large Network, Multi-Area IGP Design with IP/MPLS Access for UMMT 3.0. The huge growth in mobile data traffic is challenging legacy network infrastructure capabilities and forcing transformation of mobile transport networks. Until now, mobile backhaul networks have been composed of a mixture of many legacy technologies that are operationally complex and have reached the end of their useful life. The market inflection point for mobile backhaul is introduction of 4G/ LTE. The majority of deployments require concurrent legacy (2G/3G radio) backhaul support while gracefully introducing long term evolution (LTE) to the service mix, along with virtualization of the packet transport to deliver multiple services. The Unified MPLS Mobile Transport (UMMT) System is a comprehensive RAN backhaul solution that forms the foundation for LTE backhaul, while integrating components necessary for continued support of legacy 2G GSM and existing 3G UMTS transport services. The UMMT System enables a comprehensive and flexible framework that integrates key technologies from Cisco's Unified MPLS suite of technologies to deliver a highly scalable and simple-to-operate MPLS-based RAN backhaul network. This preface includes the following major topics: Document Version and System Release Document Organization Obtaining Documentation, Obtaining Support, and Security Guidelines
Document Version and System Release

This is the UMMT System Release 3.0 Large Network, Multi-Area IGP Design with IP/MPLS Access Implementation Guide.
Document Version
Table i-1 lists document version information.
Table i-1.
Document Version
Document Version
Date
Notes
1
System Release
9/11/2012
Initial release.
SDU-6516
ix
Preface Document Organization
CISCO CONFIDENTIAL
UMMT System Release 3.0 covers Unified MPLS for Mobile Transport supporting LTE and the introduction of ASR 901.
Document Organization
The chapters in this document are described in Table i-2.
Table i-2. Document Organization
Chapter
Major Topics
Chapter 1, Introduction Chapter 2, Reference Topology Chapter 3, Unified MPLS Transport Chapter 4, Services Chapter 5, Synchronization Distribution Chapter 6, High Availability Chapter 7, Quality of Service Chapter 8, Operations, Administration, and Maintenance Chapter 9, Related Documents
Introduction to Large Network, Multi-Area IGP Design with IP/ MPLS Access in the UMMT System. Describes the UMMT 3.0 reference topology for the Large Network, Multi-Area IGP Design with IP/MPLS Access transport model. Includes Multi-Area IGP Design with Labeled BGP Access and Multi-Area IGP Design with IGP-LDP Access configurations for the UMMT System. Describes the services associated with the Large Network, MultiArea IGP Design with IP/MPLS Access transport model. Includes configurations for the hybrid model (SyncE and IEEE 1588v2) in the UMMT System. Describes high availability for this transport model at the transport network level and the service level. Includes QoS configurations for the UMMT System. Describes the IP SLA implementation in the UMMT System.
Describes and provides links for all UMMT 3.0-related collateral.
Obtaining Documentation, Obtaining Support, and Security Guidelines

Specific information about UMMT can be obtained at the following locations: Cisco ASR 901 Series Aggregation Services Routers: http://www.cisco.com/en/US/products/ ps12077/index.html Cisco ASR 903 Series Aggregation Services Routers: http://www.cisco.com/en/US/products/ ps11610/index.html Cisco ME 3800X Series Carrier Ethernet Switch Routers: http://www.cisco.com/en/US/products/ ps10965/index.html Cisco ASR 9000 Series Aggregation Services Routers: http://www.cisco.com/en/US/products/ ps9853/index.html Cisco Carrier Routing System: http://www.cisco.com/en/US/products/ps5763/index.html
SDU-6516
Preface
CISCO CONFIDENTIAL
For information on obtaining documentation, submitting a service request, and gathering additional information, see the monthly What's New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at: http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html Subscribe to the What's New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service and Cisco currently supports RSS version 2.0.
SDU-6516
xi
Preface
CISCO CONFIDENTIAL
xii
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Introduction
The UMMT System provides the architectural baseline for creating a scalable, resilient, and manageable mobile backhaul infrastructure that is optimized to seamlessly interwork with the MPC. The system is designed to concurrently support multiple generations (2G/3G/4G) of mobile services on a single converged network infrastructure. The system supports graceful introduction of LTE with existing 2G/3G services with support for pseudowire emulation (PWE) for 2G GSM and 3G UMTS/ ATM transport, L2VPNs for 3G UMTS/IP, and L3VPNs for 3G UMTS/IP and 4G LTE transport. It supports essential features like network synchronization (physical layer and packet based), H-QoS, OAM, performance management, and fast convergence. It is optimized to cater to: Advanced 4G requirements like IPSec and authentication. Direct eNodeB communication through the X2 interface. Multicast for optimized video transport. Virtualization for RAN sharing. Capability of distributing the EPC gateways. Traffic offload.
Figure 1-1.
UMMT Transport Models
As described in the UMMT 3.0 Design Guide, the transport architecture structuring based on access type and network size leads to five architecture models that fit various customer deployments and operator preferences. This implementation guide of the UMMT System covers the transport model for a Large Network, Multi-Area IGP-based design with an IP/MPLS Access Network, and presents two approaches for extending the unified MPLS LSP into the mobile RAN access domain.
SDU-6516
1-1
Chapter 1
Introduction
CISCO CONFIDENTIAL
Table 1-1.
Approaches for Extending the Unified MPLS LSP
Option
Description
Option-1: Multi-Area IGP Design with Labeled BGP Access Option-2: Multi-Area IGP Design with IGP/LDP Access
Utilizes a separate IGP area or level for the access domain, and extends the labeled BGP control plane to the Cell Site Gateway (CSG). This model is developed for operators that wish to employ a single control plane end-to-end for mobile service transport. Utilizes a separate IGP process for the access domain, and redistributes selected prefixes between this IGP and BGP at the preaggregation node (PAN). The labeled BGP control plane extends only to the PAN. This model is developed for operators that, due to operational factors, wish to deploy a transport network in this fashion for mobile service transport.
1-2
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Reference Topology
The network design follows a Unified MPLS Transport implementation where the organization between the core and aggregation domains is based on a single autonomous system, multi-area IGP design. Figure 2-1 shows a detailed view of Metro-1 with access and aggregation domains interfacing with the core network.
Figure 2-1.
Reference Topology - Large Network, Multi-Area IGP-based Design
In the core network, the mobile transport gateways (MTG) are provider edge (PE) devices terminating MPLS VPNs and/or AToM pseudowires to provide connectivity to the EPC gateways (SGW, PGW, MME) in the MPC. At each core PoP, the core nodes (CN-ABR) are area border routers (ABR)
SDU-6516
2-1
Chapter 2
Reference Topology
CISCO CONFIDENTIAL
between the core and aggregation domains. The multi-area IGP organization between the core and aggregation is based on segmenting the core network in IS-IS Level 2 and the aggregation networks in IS-IS Level 1. The default IS-IS behavior of Level 1 to Level 2 route distribution is prevented to keep the aggregation and core domains isolated and contain the route scale within the respective domains. The PANs are ABRs between the aggregation and RAN access domains. Each mobile access network subtending from a pair of PANs is based on a different IGP process. As shown in Figure 2-1, in addition to the "core-agg IGP" IS-IS process at Level-1, the PANs run another independent "ran IGP" IS-IS process at Level-1. All CSG access rings (or hub-and-spokes) subtending from the same pair of PANs are part of this RAN IGP IS-IS process.
Note
IS-IS is shown as RAN IGP in Figure 2-1, but OSPF can also be used. Partitioning these network layers into such independent and isolated IGP domains helps reduce the size of routing and forwarding tables on individual routers in these domains, which, in turn, leads to better stability and faster convergence within each of these domains. LDP is used for label distribution to build intra-domain LSPs within each independent access, aggregation, and core IGP domain. Interdomain LSPs across the core, aggregation, and access domains is based on BGP-labeled unicast as described in the next section.
2-2
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Unified MPLS Transport

This chapter includes the following major topics: Section 3.1 Multi-Area IGP Design with Labeled BGP Access Section 3.2 Multi-Area IGP Design with IGP/LDP Access
3.1 Multi-Area IGP Design with Labeled BGP Access

This option assumes an end-to-end labeled BGP transport where the access, aggregation, and core networks are integrated with unified MPLS LSPs by extending labeled BGP from the core all the way to the CSGs in the RAN access. Any node in the network that requires inter-domain LSPs to reach nodes in remote domain acts as a labeled BGP PE and runs iBGP IPv4 unicast+label with its corresponding local route reflectors (RR).
Figure 3-1.
Unified MPLS Transport for Multi-Area IGP Design with Labeled BGP Access
The CN-ABRs are labeled BGP ABRs between the core and aggregation domains. They peer with iBGP labeled-unicast sessions with the centralized core route reflector (CN-RR) in the core network, and act as inline-RRs for their local aggregation network PAN clients. The CN-ABRs insert themselves into the data path to enable inter-domain LSPs by setting next-hop-self (NHS) on all iBGP updates towards the CN-ABR in core network and their local aggregation network PAN clients. The MTGs residing in the core network are labeled BGP PEs. They peer with iBGP labeled-unicast
SDU-6516
3-1
Chapter 3 3.1.1 Core Route Reflector Configuration
CISCO CONFIDENTIAL
sessions with the CN-RR, and advertise their loopbacks into iBGP labeled-unicast with a common BGP community (MPC BGP community) representing the MPC. The PANs are labeled BGP ABRs between the aggregation and RAN access domains. They peer with iBGP labeled-unicast sessions with the higher level CN-ABR inline-RRs in the aggregation network, and act as inline-RRs for their local RAN access network CSG clients. All the PANs in the aggregation network that require inter-domain LSPs to reach remote PANs in another aggregation network, or the core network (to reach the MTGs, for example), also act as labeled BGP PEs and advertise their loopbacks into BGP labeled-unicast with a common BGP community that represents the aggregation community. The PANs learn labeled BGP prefixes marked with the aggregation BGP community and the MPC BGP community. The PANs insert themselves into the data path to enable inter-domain LSPs by setting NHS on all iBGP updates towards the higher level CN-ABR inline-RRs and their local RAN access CSG clients. The CSGs in the RAN access networks are labeled BGP PEs. They peer with iBGP-labeled unicast sessions with their local PAN inline-RRs. The CSGs advertise their loopbacks into BGP-labeled unicast with a common BGP community that represents the RAN access community. They learn labeled BGP prefixes marked with the MPC BGP community for reachability to the MPC, and the adjacent RAN access BGP community if inter-access X2 connectivity is desired. The MTGs in the core network are capable of handling large scale and will learn all BGP-labeled unicast prefixes since they need connectivity to all the CGSs in the entire network. As described above, since all prefixes are colored with BGP Communities, prefix filtering is performed on the CN-RRs for constraining IPv4+label routes from remote RAN access regions from proliferating into neighboring aggregation domains where they are not needed. The PANs only learn labeled BGP prefixes marked with the aggregation BGP community and the MPC BGP community. This allows the PANs to enable inter-metro wireline services across the core, and also reflect the MPC prefix to their local access networks. Isolating the aggregation and RAN access domain by preventing the default redistribution enables the mobile access network to have limited route scale, since the CSGs only learn local IGP routes and labeled BGP prefixes marked with the MPC BGP community. This section includes the following topics: Section 3.1.1 Core Route Reflector Configuration Section 3.1.2 Mobile Transport Gateway Configuration Section 3.1.3 Core Area Border Router Configuration Section 3.1.4 Pre-Aggregation Node Configuration Section 3.1.5 Cell Site Gateway Configuration
3.1.1 Core Route Reflector Configuration

This section shows the IGP/LDP configuration required to build intra-domain LSPs and the BGP configuration required to build the inter-domain LSPs on the centralized CN-RR.
3-2
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
Figure 3-2.
Centralized Core Route Reflector (CN-RR)
Interface Configuration
interface Loopback0 description Global Loopback ipv4 address 100.111.4.3 255.255.255.255 ! interface GigabitEthernet0/1/0/0 <<< Core interface description To CN-K0201 Gig0/2/0/0 cdp ipv4 address 10.2.1.3 255.255.255.254 negotiation auto load-interval 30 ! interface GigabitEthernet0/1/0/1 <<< Core interface description To CN-K0401 Gig0/1/0/1 cdp ipv4 address 10.4.1.1 255.255.255.254 negotiation auto load-interval 30 !
IGP/LDP Configuration
router isis core set-overload-bit on-startup 360 net 49.0100.1001.1100.4003.00 log adjacency changes lsp-gen-interval maximum-wait 5000 initial-wait 50 secondary-wait 200 lsp-refresh-interval 65000 max-lsp-lifetime 65535 address-family ipv4 unicast metric-style wide
SDU-6516
3-3
Chapter 3
CISCO CONFIDENTIAL
ispf spf-interval maximum-wait 5000 initial-wait 50 secondary-wait 200 ! interface Loopback0 passive address-family ipv4 unicast ! ! interface GigabitEthernet0/1/0/0 <<< Core interface circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point address-family ipv4 unicast ! ! interface GigabitEthernet0/1/0/1 <<< Core interface circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point address-family ipv4 unicast ! ! ! mpls ldp router-id 100.111.4.3 graceful-restart log neighbor graceful-restart ! interface GigabitEthernet0/1/0/0 ! interface GigabitEthernet0/1/0/1 !
BGP Configuration
! router bgp 100 nsr bgp router-id 100.111.4.3 address-family ipv4 unicast additional-paths receive <<< BGP add-path additional-paths send additional-paths selection route-policy add-path-to-ibgp network 100.111.4.3/32 allocate-label all ! address-family vpnv4 unicast <SNIP> ! session-group infra <<< session group for iBGP clients (CN-ABRs and MTGs) remote-as 100 password encrypted 082D4D4C update-source Loopback0 ! neighbor-group mtg <<< MTG neighbor group use session-group infra address-family ipv4 labeled-unicast route-reflector-client maximum-prefix 150000 85 warning-only !
3-4
SDU-6516
Chapter 3
Unified MPLS Transport 3.1.2 Mobile Transport Gateway Configuration
CISCO CONFIDENTIAL
address-family vpnv4 unicast <SNIP> ! ! neighbor-group cn-abr <<< neighbor group for CN-ABRs in PoP-1,2,3... etc. use session-group infra address-family ipv4 labeled-unicast route-reflector-client route-policy BGP_Egress_Transport_Filter out <<< Egress filter to drop unwanted RAN loopbacks towards neighboring aggregation regions. ! ! neighbor 100.111.2.1 use neighbor-group cn-abr ! neighbor 100.111.4.1 use neighbor-group cn-abr ! neighbor 100.111.10.1 use neighbor-group cn-abr ! neighbor 100.111.10.2 use neighbor-group cn-abr ! neighbor 100.111.15.1 use neighbor-group mtg ! neighbor 100.111.15.2 use neighbor-group mtg ! ! route-policy BGP_Egress_Transport_Filter if community matches-any Deny_Transport_Community then drop else pass endif end-policy
community-set Deny_Transport_Community 10:10 end-set
Note
Please refer to the "Prefix Filtering" section in the UMMT 3.0 Design Guide for a detailed explanation of how egress filtering is done at the CN-RR for constraining IPv4+label routes from remote RAN access regions.
3.1.2 Mobile Transport Gateway Configuration

This section shows the IGP/LDP configuration required to build the intra-domain LSPs, and the BGP configuration required to build the inter-domain LSPs from the MPC to the aggregation and access domains.
SDU-6516
3-5
Chapter 3
CISCO CONFIDENTIAL
Figure 3-3.
Mobile Transport Gateway (MTG)
interface Loopback0 description Global Loopback ipv4 address 100.111.15.1 255.255.255.255 ! interface TenGigE0/0/0/0 description To CN-K0201 Ten0/0/0/0 <<< Core facing interface cdp service-policy output PMAP-NNI-E ipv4 address 10.2.1.9 255.255.255.254 carrier-delay up 2000 down 0 load-interval 30 transceiver permit pid all ! interface TenGigE0/0/0/1 <<< Core facing interface description To CN-K0401 Ten0/0/0/1 cdp service-policy output PMAP-NNI-E ipv4 address 10.4.1.5 255.255.255.254 carrier-delay up 2000 down 0 load-interval 30 transceiver permit pid all !
IGP Configuration
router isis core set-overload-bit on-startup 400 net 49.0100.1001.1101.5001.00 nsf cisco log adjacency changes lsp-gen-interval maximum-wait 5000 initial-wait 50 secondary-wait 200 lsp-refresh-interval 65000 max-lsp-lifetime 600 address-family ipv4 unicast metric-style wide
3-6
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
ispf spf-interval maximum-wait 5000 initial-wait 50 secondary-wait 200 ! interface Loopback0 passive point-to-point address-family ipv4 unicast ! ! interface TenGigE0/0/0/0 circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point address-family ipv4 unicast fast-reroute per-prefix mpls ldp sync ! ! interface TenGigE0/0/0/1 circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point address-family ipv4 unicast mpls ldp sync ! ! mpls ldp router-id 100.111.15.1 discovery targeted-hello accept nsr graceful-restart session protection log neighbor graceful-restart session-protection nsr ! interface TenGigE0/0/0/0 ! interface TenGigE0/0/0/1 ! !
BGP Configuration
router bgp 100 nsr bgp router-id 100.111.15.1 bgp redistribute-internal bgp graceful-restart ibgp policy out enforce-modifications address-family ipv4 unicast additional-paths receive receive multiple paths from CN-RR additional-paths selection route-policy add-path-to-ibgp network 100.111.15.1/32 route-policy MTG_Community in BGP with MPC_Community allocate-label all ! address-family vpnv4 unicast !
<<< BGP add-path to
<<< Color loopback prefix
SDU-6516
3-7
Chapter 3 3.1.3 Core Area Border Router Configuration
CISCO CONFIDENTIAL
session-group infra remote-as 100 password encrypted 011F0706 update-source Loopback0 ! neighbor-group cn-rr use session-group infra address-family ipv4 labeled-unicast maximum-prefix 150000 85 warning-only next-hop-self ! address-family vpnv4 unicast ! ! neighbor 100.111.4.3 <<< CN-RR use neighbor-group cn-rr ! <SNIP> ! route-policy MTG_Community set community MTG_Community end-policy ! community-set MTG_Community 1001:1001 end-set !
route-policy add-path-to-ibgp set path-selection backup 1 install end-policy
3.1.3 Core Area Border Router Configuration

This section shows the IGP/LDP configuration required to build intra-domain LSPs and the BGP configuration required to build the inter-domain LSPs on the core ABRs. The multi-level IGP organization between the core and aggregation is based on segmenting the core network in IS-IS Level 2 and the aggregation networks in IS-IS Level 1. The CN-ABR is a ISIS L1-L2 node, where corefacing interfaces are IS-IS L2 links, local aggregation network-facing interfaces are IS-IS L1 links, and interface connecting the redundant ABR is a IS-IS L1/L2 link.
3-8
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
Figure 3-4.
Core Area Border Router (CN-ABR)
! interface Loopback0 ipv4 address 100.111.10.1 255.255.255.255 ! interface TenGigE0/0/0/0 <<< Interface connecting the redundant ABR cdp service-policy output PMAP-NNI-E ipv4 address 10.10.1.0 255.255.255.254 load-interval 30 frequency synchronization ! ! interface TenGigE0/0/0/1 <<< Core facing interface cdp service-policy output PMAP-NNI-E ipv4 address 10.6.1.1 255.255.255.254 load-interval 30 ! interface TenGigE0/0/0/2 <<< Aggregation facing interface cdp service-policy output PMAP-NNI-E ipv4 address 10.5.1.5 255.255.255.254 carrier-delay up 2000 down 0 load-interval 30 frequency synchronization ! !
IGP/LDP Configuration
router isis core-agg net 49.0100.1001.1101.0001.00 nsf cisco log adjacency changes lsp-gen-interval maximum-wait 5000 initial-wait 50 secondary-wait 200 lsp-refresh-interval 65000 max-lsp-lifetime 65535 address-family ipv4 unicast metric-style wide spf-interval maximum-wait 5000 initial-wait 50 secondary-wait 200
SDU-6516
3-9
Chapter 3
CISCO CONFIDENTIAL
propagate level 1 into level 2 route-policy drop-all default IS-IS L1 to L2 redistribution ! interface Loopback0 passive point-to-point address-family ipv4 unicast tag 1000 ! ! interface TenGigE0/0/0/0 link bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point link-down fast-detect address-family ipv4 unicast mpls ldp sync ! ! interface TenGigE0/0/0/1 circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point link-down fast-detect address-family ipv4 unicast mpls ldp sync ! ! interface TenGigE0/0/0/2 circuit-type level-1 bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point link-down fast-detect address-family ipv4 unicast mpls ldp sync ! <SNIP> ! ! route-policy drop-all redistribution drop end-policy <<< Route policy to disable IS-IS L1 to L2 <<< Disable
<<< L1/L2
<<< L2 link
<<< L1 link
mpls ldp router-id 100.111.10.1 nsr graceful-restart session protection ! interface TenGigE0/0/0/0 ! interface TenGigE0/0/0/1 ! interface TenGigE0/0/0/2
BGP Configuration
3-10
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
router bgp 100 nsr bgp router-id 100.111.10.1 bgp cluster-id 1001 <<< Redundant ABRs K1001 and K1002 have a cluster ID 1001 to prevent loops. bgp graceful-restart ibgp policy out enforce-modifications address-family ipv4 unicast additional-paths receive <<< BGP add-path to receive multiple paths from CN-RR additional-paths selection route-policy add-path-to-ibgp network 100.111.10.1/32 route-policy CN_ABR_Community <<< Color loopback prefix in BGP with CN_ABR_Community allocate-label all ! address-family vpnv4 unicast ! session-group infra remote-as 100 password encrypted 03085A09 cluster-id 1001 update-source Loopback0 graceful-restart ! neighbor-group cn-rr <<< iBGP neighbor group for CN-RR use session-group infra address-family ipv4 labeled-unicast <<< Address family for RFC 3107 based transport maximum-prefix 150000 85 warning-only next-hop-self <<< next-hop-self to insert into data path ! neighbor-group pan <<< iBGP neighbor group for PANs in local Aggregation network use session-group infra address-family ipv4 labeled-unicast <<< Address family for RFC 3107 based transport route-reflector-client <<< PANs are RR Clients next-hop-self <<< next-hop-self to insert into data path ! address-family vpnv4 unicast <SNIP> ... ! ! neighbor 100.111.4.3 <<< CN-RR use neighbor-group cn-rr ! neighbor 100.111.9.7 << PAN K0907 use neighbor-group agg ! neighbor 100.111.9.8 << PAN K0908 use neighbor-group agg ! neighbor 100.111.9.9 << PAN K0909 use neighbor-group agg ! neighbor 100.111.9.10 << PAN K0910 use neighbor-group agg ! !
! route-policy add-path-to-ibgp set path-selection backup 1 install end-policy
SDU-6516
3-11
Chapter 3 3.1.4 Pre-Aggregation Node Configuration
CISCO CONFIDENTIAL
! ! route-policy CN_ABR_Community set community CN_ABR_Community end-policy ! community-set CN_ABR_Community 1000:1000 end-set !
3.1.4 Pre-Aggregation Node Configuration

This section shows the IGP/LDP configuration required to build the intra-domain LSPs, and the BGP configuration required to build the inter-domain LSPs in the aggregation network. The PANs are ABRs between the aggregation and RAN access domains. The segmentation between the two domains is achieved by enabling two different IGP processes on the PANs. The first process is the core/aggregation IGP process, and the second process is another independent RAN IGP process. All CSGs subtending from the same pair of PANs are part of this RAN IGP process.
Figure 3-5.
Pre-Aggregation Node (PAN)
! interface Loopback0 ip address 100.111.9.7 255.255.255.255 ! interface Loopback100 ip address 100.111.99.7 255.255.255.255 !
<<< Loopback for core-agg IGP process
<<< Loopback for RAN IGP process
mpls ldp router-id Loopback0 force
! interface TenGigabitEthernet0/1 description To AG2-K0501 no switchport ip address 10.5.1.3 255.255.255.254
<<< Interface facing Core network
3-12
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
ip router isis core-agg mpls ip synchronous mode bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point ! interface TenGigabitEthernet0/2 <<< Interface connecting redundant PAN. VLANed to close Aggregation and RAN IGP processes. description To AG1-K0908 switchport trunk allowed vlan 10,20 switchport mode trunk synchronous mode ! interface Vlan10 <<< VLAN 10 used for Core-Aggregation IGP process ip address 10.9.7.0 255.255.255.254 ip router isis core-agg mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point ! interface Vlan20 <<< VLAN 20 used for for RAN IS-IS IGP process ip address 10.9.7.4 255.255.255.254 ip router isis ran <<< Ignore if OSFP is used as RAN IGP Process mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point <<< Ignore if OSFP is used as RAN IGP Process ! interface GigabitEthernet0/1 <<< RAN Access Ring facing interface description To CSN-K1317 no switchport ip address 10.9.7.2 255.255.255.254 ip router isis ran <<< Ignore if OSFP is used as RAN IGP Process mpls ip mpls ldp discovery transport-address 100.111.99.7 <<< LDP discovery transport address changed to Loopback100 synchronous mode bfd interval 500 min_rx 500 multiplier 3 isis circuit-type level-2-only <<< Ignore if OSFP is used as RAN IGP Process isis network point-to-point <<< Ignore if OSFP is used as RAN IGP Process !
Note
Interface TenGigabitEthernet0/2 is the link that connects to the redundant PAN. Since we are running two independent IGP processes on the PANs, we need to make sure we provide a closed path for both processes. This is enabled by VLAN'ing the common link between the two PANs. Here VLAN 10 is used to close the core-agg IGP process and VLAN 20 to close the RAN IGP process.
Note
PAN K0907's LDP ID Loopback0 is in the core-aggregation IS-IS process and not in the RAN IS-IS IGP process. The command mpls ldp discovery transport-address 100.111.99.7, changes the transport address to Loopback100 for LDP discovery out of the RAN access ring-facing interface G0/1.
Core-Aggregation LDP/IGP Process Configuration
router isis core-agg
SDU-6516
3-13
Chapter 3
CISCO CONFIDENTIAL
net 49.0100.1001.1100.9007.00 is-type level-1 ispf level-1 metric-style wide fast-flood max-lsp-lifetime 65535 lsp-refresh-interval 65000 spf-interval 5 50 200 prc-interval 5 50 200 lsp-gen-interval 5 50 200 no hello padding log-adjacency-changes passive-interface Loopback0 bfd all-interfaces !
<<< IS-IS Level-1
Note
Depending on the choice of the operator, the RAN IGP process could either be a IS-IS process at Level 2, or a OSPF process in Area 0. The following sections describe configurations for both options.
Option-1: OSPF as RAN IGP Process
This shows the configurations if OSPF is used as the choice of RAN IGP process.
router ospf 1 router-id 100.111.99.7 ispf timers throttle spf 50 50 5000 timers throttle lsa 10 20 5000 timers lsa arrival 10 timers pacing flood 5 network 100.111.99.7 0.0.0.0 area 0 Loopback100 interface for RAN IGP network 10.9.7.2 0.0.0.1 area 0 Access facing interface network 10.9.7.4 0.0.0.1 area 0 Interface VLAN 20. Trunked on redundant PAN facing link. bfd all-interfaces !
<<< <<< RAN <<<
Option-2: IS-IS as RAN IGP Process
This shows the configurations if IS-IS is used as the choice of RAN IGP process.
router isis ran net 49.1100.1011.1100.9007.00 is-type level-1 ispf level-1 metric-style wide fast-flood max-lsp-lifetime 65535 lsp-refresh-interval 65000 spf-interval 5 50 200 prc-interval 5 50 200 lsp-gen-interval 5 50 200 no hello padding log-adjacency-changes passive-interface Loopback100 interface for RAN IGP bfd all-interfaces !
<<< IS-IS Level-1
<<< Loopback100
BGP Configuration
3-14
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
! router bgp 100 bgp router-id 100.111.9.7 bgp cluster-id 907 bgp log-neighbor-changes bgp graceful-restart restart-time 120 bgp graceful-restart stalepath-time 360 bgp graceful-restart no bgp default ipv4-unicast neighbor csg peer-group group for CSGs in local RAN network neighbor csg remote-as 100 neighbor csg password lab neighbor csg update-source Loopback100 Loopback100 used as source neighbor abr peer-group group for CN-ABRs neighbor abr remote-as 100 neighbor abr password lab neighbor abr update-source Loopback0 Aggregation IGP Loopback0 used as source neighbor 100.111.10.1 peer-group abr neighbor 100.111.10.2 peer-group abr neighbor 100.111.13.17 peer-group csg neighbor 100.111.13.18 peer-group csg neighbor 100.111.13.19 peer-group csg ! address-family ipv4 family for RFC 3107 based transport bgp redistribute-internal network 100.111.9.7 mask 255.255.255.255 route-map AGG_Community Loopback-0 with Aggregation Community neighbor abr send-community neighbor abr next-hop-self all to insert into data path neighbor abr send-label labels with BGP routes neighbor csg send-community neighbor csg route-map BGP_Egress_Transport_Filter out PAN COMMUNITY TOWARDS CSGS ****************** neighbor csg route-reflector-client neighbor csg next-hop-self all neighbor csg send-label neighbor 100.111.10.1 activate K1001 neighbor 100.111.10.2 activate K1002 neighbor 100.111.13.17 activate in local RAN neighbor 100.111.13.18 activate in local RAN neighbor 100.111.13.19 activate in local RAN exit-address-family ! address-family vpnv4 <SNIP> ! address-family rtfilter unicast <SNIP> !
<<< Peer
<<< RAN IGP <<< Peer
<<< Core-
<<< Address
<<< Advertise
<<< Set NHS <<< send
***************** FILTER
<<< CN-ABR <<< CN-ABR <<< CSG K1317 <<< CSG K1318 <<< CSG K1318
! route-map AGG_Community permit 10
SDU-6516
3-15
Chapter 3 3.1.5 Cell Site Gateway Configuration
CISCO CONFIDENTIAL
set community 100:100 100:101 <<< 100:100 is the common aggregation community. 100:101 is the community identifying this PAN as being in metro-1, location-1.
3.1.5 Cell Site Gateway Configuration

The IGP organization between the aggregation and RAN access networks is based on running two different IGP processes on the PANs as discussed in the previous section. The first process is the coreaggregation IGP process, and the second process is an independent RAN IGP process for the mobile RAN network. The CSGs in all access rings/hub-spokes subtending from the same pair of PANs are part of this RAN IGP process. Depending on the operator, the RAN IGP process could either be an IS-IS process at Level 2, or an OSPF process in Area 0. Configurations for both options are shown below.
Figure 3-6.
Cell Site Gateway (CSG)
! interface Loopback0 ip address 100.111.13.18 255.255.255.255 isis tag 10 <<< Ignore if OSFP is used as RAN IGP Process ! interface GigabitEthernet0/10 <<< NNI: Ring Facing Interface description To CSG-K1317 synchronous mode service instance 10 ethernet encapsulation untagged
3-16
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
bridge-domain 10 ! interface GigabitEthernet0/11 <<< NNI: Ring Facing description To CSG-K1319 synchronous mode service instance 20 ethernet encapsulation untagged bridge-domain 20 ! interface Vlan10 ip address 10.9.7.3 255.255.255.254 ip router isis ran <<< Ignore if OSFP is mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point <<< Ignore if OSFP is ! interface Vlan20 ip address 10.13.18.0 255.255.255.254 ip router isis ran <<< Ignore if OSFP is mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point <<< Ignore if OSFP is
Interface
used as RAN IGP Process
This section shows the CSG configuration if OSPF is used as the RAN IGP.
router ospf 1 router-id 100.111.13.18 ispf timers throttle spf 50 50 5000 timers throttle lsa 10 20 5000 timers lsa arrival 10 timers pacing flood 5 passive-interface Vlan200 passive-interface Loopback0 network 10.9.0.0 0.0.255.255 area 0 network 10.13.0.0 0.0.255.255 area 0 network 100.111.0.0 0.0.255.255 area 0 bfd all-interfaces
This section shows the CSG configuration if IS-IS is used as the RAN IGP.
router isis ran net 49.1100.1011.1101.3018.00 is-type level-1 ispf level-1 metric-style wide fast-flood max-lsp-lifetime 65535 lsp-refresh-interval 65000 spf-interval 5 50 200 prc-interval 5 50 200 lsp-gen-interval 5 50 200 no hello padding log-adjacency-changes passive-interface Loopback0 bfd all-interfaces
<<< IS-IS Level-1
BGP Configuration
! router bgp 100
SDU-6516
3-17
Chapter 3 3.2 Multi-Area IGP Design with IGP/LDP Access
CISCO CONFIDENTIAL
bgp router-id 100.111.13.18 bgp log-neighbor-changes no bgp default ipv4-unicast neighbor pan peer-group neighbor pan remote-as 100 neighbor pan password lab neighbor pan update-source Loopback0 neighbor 100.111.9.7 peer-group pan neighbor 100.111.9.8 peer-group pan ! address-family ipv4 network 100.111.13.18 mask 255.255.255.255 route-map CSG_Community Loopback-0 with CSG Community redistribute connected neighbor pan send-community neighbor pan next-hop-self neighbor pan send-label neighbor 100.111.9.7 activate neighbor 100.111.9.8 activate exit-address-family ! address-family vpnv4 <SNIP> ! address-family rtfilter unicast <SNIP> exit-address-family !
<<< Advertise
! route-map CSG_Community permit 10 set community 10:10 10:101 <<< 10:10 is the common CSG community. 10:101 is the community identifying this CSG as being in metro-1, location-1. !
3.2 Multi-Area IGP Design with IGP/LDP Access

This option follows the approach of enabling labeled BGP across the core and aggregation networks and extends the unified MPLS LSP to the access by redistribution between labeled BGP and the RAN access domain IGP. Any node in the core and aggregation network that requires inter-domain LSPs to reach nodes in remote domains acts as a labeled BGP PE and runs iBGP IPv4 unicast+label with its corresponding local RR.
3-18
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
Figure 3-7.
Unified MPLS Transport for Multi-Area IGP Design with IGP/LDP Access
The CN-ABRs are labeled BGP ABRs between the core and aggregation domains. They peer with iBGP labeled-unicast sessions with the CN-RR in the core network, and act as inline-RRs for their local aggregation network PAN clients. The CN-ABRs insert themselves into the data path to enable inter-domain LSPs by setting next-hop-self on all iBGP updates towards the CN-ABR in core network and their local aggregation network PAN clients. The MTGs residing in the core network are labeled BGP PEs. They peer with iBGP labeled-unicast sessions with the CN-RR, and advertise their loopbacks into iBGP labeled-unicast with a common BGP community (MPC BGP community) representing the mobile packet core. All the PANs in the aggregation network that require inter-domain LSPs to reach remote PANs in another aggregation network, or the core network (to reach the MTGs, for example), act as labeled BGP PEs and peer with iBGP labeled-unicast sessions with the higher level CN-ABR inline-RRs. The PANs advertise their loopbacks into BGP labeled-unicast with a common BGP community that represents the aggregation community. They learn labeled BGP prefixes marked with the aggregation BGP community and the MPC BGP community. The inter-domain LSPs are extended to the MPLS/IP RAN access with a controlled redistribution based on IGP tags and BGP communities. Each mobile access network subtending from a pair of PANs is based on a different IGP process. At the PANs, the inter-domain core and aggregation LSPs are extended to the RAN access by redistributing between iBGP and RAN IGP. In one direction, the RAN access node loopbacks (filtered based on IGP tags) are redistributed into iBGP labeledunicast and tagged with RAN access BGP community that is unique to that RAN access region. In the other direction, the MPC prefixes filtered based on MPC-marked BGP communities, and optionally, adjacent RAN access prefixes filtered based on RAN-region-marked BGP communities (if inter-access X2 connectivity is desired), are redistributed into the RAN access IGP process. The MTGs in the core network are capable of handling large scale and will learn all BGP-labeled unicast prefixes since they need connectivity to all the CGSs in the entire network. Simple prefix filtering based on BGP communities is performed on the CN-RRs for constraining IPv4+label routes from remote RAN access regions from proliferating into neighboring aggregation domains, where they are not needed. The PANs only learn labeled BGP prefixes marked with the aggregation BGP community and the MPC BGP community. This allows the PANs to enable inter metro Wireline services across the core, and also redistribute the mobile packet core prefix to their local access networks. Using a separate IGP process for the RAN access enables the mobile access network to have limited control plane scale, since the CSGs only learn local IGP routes and labeled BGP prefixes marked with the MPC BGP community.
SDU-6516
3-19
Chapter 3 3.2.1 Pre-Aggregation Node Configuration
CISCO CONFIDENTIAL
Note
The network infrastructure organization of this model at the top layers of network (namely, the core and aggregation domains) is identical to that defined in Section 3.1 Multi-Area IGP Design with Labeled BGP Access. The difference here is that labeled BGP spans only the core and aggregation networks and does not extend to the RAN access. Instead, the end-to-end unified MPLS LSP is extended into the RAN access with selective redistribution between labeled BGP and the RAN access domain IGP at the PAN. Please refer to the Multi-Area IGP Design with Labeled BGP Access section for configuration details on the Core Route Reflector, Mobile Transport Gateway, and Core Area Border Router since the same configuration is also applied to this model. This section includes the following major topics: Section 3.2.1 Pre-Aggregation Node Configuration Section 3.2.2 Cell Site Gateway Configuration
3.2.1 Pre-Aggregation Node Configuration

This section shows the IGP/LDP configuration required to build the intra-domain LSPs, and the BGP configuration required to build the inter-domain LSPs in the aggregation network. The segmentation between the aggregation and RAN access domains is achieved by enabling two different IGP processes on the PANs. The first process is the core/aggregation IGP process, and the second process is another independent RAN IGP process. All CSGs subtending from the same pair of PANs are part of this RAN IGP process.
Figure 3-8.
Pre-Aggregation Node (PAN)
! interface Loopback0 ip address 100.111.9.7 255.255.255.255 ! interface Loopback100 ip address 100.111.99.7 255.255.255.255 !
<<< Loopback for core-agg IGP process
<<< Loopback for RAN IGP process
3-20
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
mpls ldp router-id Loopback0 force
! interface TenGigabitEthernet0/1 <<< Interface facing Core network description To AG2-K0501 no switchport ip address 10.5.1.3 255.255.255.254 ip router isis core-agg mpls ip synchronous mode bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point ! interface TenGigabitEthernet0/2 <<< Interface connecting redundant PAN. VLANed to close Aggregation and RAN IGP processes. description To AG1-K0908 switchport trunk allowed vlan 10,20 switchport mode trunk synchronous mode ! interface Vlan10 <<< VLAN 10 used for Core-Aggregation IGP process ip address 10.9.7.0 255.255.255.254 ip router isis core-agg mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point ! interface Vlan20 <<< VLAN 20 used for for RAN IS-IS IGP process ip address 10.9.7.4 255.255.255.254 ip router isis ran <<< Ignore if OSFP is used as RAN IGP Process mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point <<< Ignore if OSFP is used as RAN IGP Process ! interface GigabitEthernet0/1 <<< RAN Access Ring facing interface description To CSN-K1317 no switchport ip address 10.9.7.2 255.255.255.254 ip router isis ran <<< Ignore if OSFP is used as RAN IGP Process mpls ip mpls ldp discovery transport-address 100.111.99.7 <<< LDP discovery transport address changed to Loopback100 synchronous mode bfd interval 500 min_rx 500 multiplier 3 isis circuit-type level-2-only <<< Ignore if OSFP is used as RAN IGP Process isis network point-to-point <<< Ignore if OSFP is used as RAN IGP Process !
Note
Interface TenGigabitEthernet0/2 is the link that connects to the redundant PAN. Since we are running two independent IGP processes on the PANs, we need to make sure we provide a closed path for both processes. This is enabled by VLAN'ing the common link between the two PANs. Here, VLAN 10 is used to close the core-agg IGP process and VLAN 20 to close the RAN IGP process.
SDU-6516
3-21
Chapter 3
CISCO CONFIDENTIAL
Note
PAN K0907's LDP ID Loopback0 is in the core-aggregation IS-IS process and not in the RAN IS-IS IGP process. The command mpls ldp discovery transport-address 100.111.99.7, changes the transport address to Loopback100 for LDP discovery out of the RAN access ring-facing interface G0/1.
Core-Aggregation LDP/IGP Process Configuration
router isis core-agg net 49.0100.1001.1100.9007.00 is-type level-1 ispf level-1 metric-style wide fast-flood max-lsp-lifetime 65535 lsp-refresh-interval 65000 spf-interval 5 50 200 prc-interval 5 50 200 lsp-gen-interval 5 50 200 no hello padding log-adjacency-changes passive-interface Loopback0 bfd all-interfaces !
<<< IS-IS Level-1
Note
Depending on the operator, the RAN IGP process could either be a IS-IS process at Level 2 or a OSPF process in Area 0. The following sections describe configurations for both options.
This shows the configurations if OSPF is used as the choice of RAN IGP process.
router ospf 1 router-id 100.111.99.7 ispf timers throttle spf 50 50 5000 timers throttle lsa 10 20 5000 timers lsa arrival 10 timers pacing flood 5 redistribute isis core-agg level-1 subnets route-map Local_ABR_Loopback <<< Redistribute Core ABR loopback for Primary Reference Clock (PRC) source reachability redistribute bgp 100 subnets route-map BGP_TO_RAN_ACCESS <<< Redistribute MPC/EPC prefixes based on BGP community filtering network 100.111.99.7 0.0.0.0 area 0 <<< Loopback100 interface for RAN IGP network 10.9.7.2 0.0.0.1 area 0 <<< RAN Access facing interface network 10.9.7.4 0.0.0.1 area 0 <<< Interface VLAN 20. Trunked on redundant PAN facing link. distribute-list route-map BGP_redistributed_prefixes in <<< Ensure BGP label unicast learnt prefixes are preferred due to dual-redistribution bfd all-interfaces !
route-map BGP_TO_RAN_ACCESS permit 10 to RAN IGP redistribution match community EPC_Community MPC/EPC PE BGP Community set tag 1000 tag 1000 !
<<< BGP community based filtering for iBGP <<< Only redistribute prefixes marked with <<< Mark redistributed prefixes with IGP
3-22
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
ip community-list standard EPC_Community permit 1001:1001 BGP Community assigned to the MPC/EPC PEs ! <<< 1001:1001 is the
route-map BGP_redistributed_prefixes deny 10 Inbound Filtering based on IGP tags match tag 1000 prefixes marked with IGP tag 1000 during iBGP to RAN IGP redistribution ! route-map BGP_redistributed_prefixes permit 20
<<< OSPF <<< Drop
Note
Since we are dealing with a ring access network, we have a dual redistribution scenario between the aggregation network iBGP and the RAN IGP. In such a situation, even though the MPC prefixes are learned via iBGP on the PANs, the lower admin distance leads to the IGP routes being preferred over iBGP routes. The solution is to tag the routes during iBGP to RAN OSPF redistribution on one side of the access ring, and use OSPF inbound filtering using route maps with a distribute list to filter out these routes when they are learnt from the other side of the access ring.
This shows the configurations if IS-IS is used as the choice of RAN IGP process.
router isis ran net 49.1100.1011.1100.9007.00 is-type level-1 <<< IS-IS Level-1 ispf level-1 metric-style wide fast-flood max-lsp-lifetime 65535 lsp-refresh-interval 65000 spf-interval 5 50 200 prc-interval 5 50 200 lsp-gen-interval 5 50 200 no hello padding log-adjacency-changes redistribute isis core-agg ip route-map Local_ABR_Loopback <<< Redistribute Core ABR loopback for Primary Reference Clock (PRC) source reachability redistribute bgp 100 route-map BGP_TO_RAN_ACCESS level-1 <<< Redistribute MPC/EPC prefixes based on BGP community filtering passive-interface Loopback100 <<< Loopback100 interface for RAN IGP distance 201 100.111.99.8 0.0.0.0 BGP_redistributed_prefixes <<< Change admin distance so that BGP label unicast learnt prefixes are preferred due to dualredistribution bfd all-interfaces !
route-map BGP_TO_RAN_ACCESS permit 10 <<< to RAN IGP redistribution match community EPC_Community <<< MPC/EPC PE BGP Community set tag 1000 <<< tag 1000 ! ip community-list standard EPC_Community permit BGP Community assigned to the MPC/EPC PEs !
BGP community based filtering for iBGP Only redistribute prefixes marked with Mark redistributed prefixes with IGP
1001:1001
<<< 1001:1001 is the
ip access-list standard BGP_redistributed_prefixes <<< Ensure BGP label unicast learnt prefixes are preferred due to dual-redistribution
SDU-6516
3-23
Chapter 3
CISCO CONFIDENTIAL
deny 100.111.13.0 0.0.0.255 deny 10.0.0.0 0.255.255.255 permit any
Note
Since we are dealing with a ring access network, we have a dual redistribution scenario between the aggregation network iBGP and the RAN IGP. In such a situation, even though the MPC prefixes are learned via iBGP on the PANs, the lower admin distance leads to the IGP routes being preferred over iBGP routes. Unlike OSPF, IS-IS does not support inbound filtering using route maps with a distribute list. The solution is to bump up the IGP admin distance based on the IGP originator address for the IBGP to RAN IGP-redistributed prefixes.
BGP Configuration
! router bgp 100 bgp router-id 100.111.9.7 bgp cluster-id 907 bgp log-neighbor-changes bgp graceful-restart restart-time 120 bgp graceful-restart stalepath-time 360 bgp graceful-restart no bgp default ipv4-unicast neighbor csg peer-group <<< Peer group for CSGs in local RAN network - Only used for VPNv4 address-family neighbor csg remote-as 100 neighbor csg password lab neighbor csg update-source Loopback100 <<< RAN IGP Loopback100 used as source neighbor abr peer-group <<< Peer group for CN-ABRs neighbor abr remote-as 100 neighbor abr password lab neighbor abr update-source Loopback0 <<< Core-Aggregation IGP Loopback0 used as source neighbor 100.111.10.1 peer-group abr neighbor 100.111.10.2 peer-group abr neighbor 100.111.13.17 peer-group csg neighbor 100.111.13.18 peer-group csg neighbor 100.111.13.19 peer-group csg ! address-family ipv4 <<< Address family for RFC 3107 based transport bgp redistribute-internal network 100.111.9.7 mask 255.255.255.255 route-map AGG_Community <<< Advertise Loopback-0 with Aggregation Community redistribute ospf 1 <<< Option-1 (If OSPF used as RAN IGP) or redistribute isis ran level-1 route-map RAN_ACCESS_TO_BGP <<< Option-2 (If IS-IS used as RAN IGP) neighbor abr send-community neighbor abr next-hop-self <<< Set NHS to assign local labels for RAN redistributed prefixes neighbor abr send-label <<< send labels with BGP routes neighbor 100.111.10.1 activate <<< CN-ABR K1001 neighbor 100.111.10.2 activate <<< CN-ABR K1002 exit-address-family ! address-family vpnv4 <SNIP> ! address-family rtfilter unicast
3-24
SDU-6516
Chapter 3
Unified MPLS Transport 3.2.2 Cell Site Gateway Configuration
CISCO CONFIDENTIAL
<SNIP> ! route-map AGG_Community permit 10 Community set community 100:100 Nodes ! <<< Advertise Loopback-0 with Aggregation <<< Community assigned to all Aggregation
route-map RAN_ACCESS_TO_BGP permit 10 tags match tag 10 Access tagged with IGP tag 10. !
<<< Redistribute prefixes based on IGP <<< Only redistribute prefixes from RAN
3.2.2 Cell Site Gateway Configuration

The IGP organization between the aggregation and RAN access networks is based on running two different IGP processes on the PANs, as discussed in the previous section. The first process is the coreaggregation IGP process and the second process is an independent RAN IGP process for the mobile RAN network. The CSGs in all access rings/hub-spokes subtending from the same pair of PANs are part of this RAN IGP process. Depending on the operator, the RAN IGP process could either be an IS-IS process at Level 2 or an OSPF process in Area 0. Configurations for both options are shown below.
Figure 3-9.
Cell Site Gateway (CSG)
SDU-6516
3-25
Chapter 3
CISCO CONFIDENTIAL
! interface Loopback0 ip address 100.111.13.18 255.255.255.255 isis tag 10 <<< Ignore if OSFP is used as RAN IGP Process ! interface GigabitEthernet0/10 <<< NNI: Ring Facing Interface description To CSG-K1317 synchronous mode service instance 10 ethernet encapsulation untagged bridge-domain 10 ! interface GigabitEthernet0/11 <<< NNI: Ring Facing Interface description To CSG-K1319 synchronous mode service instance 20 ethernet encapsulation untagged bridge-domain 20 ! interface Vlan10 ip address 10.9.7.3 255.255.255.254 ip router isis ran <<< Ignore if OSFP is used as RAN IGP Process mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point <<< Ignore if OSFP is used as RAN IGP Process ! interface Vlan20 ip address 10.13.18.0 255.255.255.254 ip router isis ran <<< Ignore if OSFP is used as RAN IGP Process mpls ip bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point <<< Ignore if OSFP is used as RAN IGP Process
This section shows the CSG configuration if OSPF is used as the RAN IGP.
router ospf 1 router-id 100.111.13.18 ispf timers throttle spf 50 50 5000 timers throttle lsa 10 20 5000 timers lsa arrival 10 timers pacing flood 5 passive-interface Vlan200 passive-interface Loopback0 network 10.9.0.0 0.0.255.255 area 0 network 10.13.0.0 0.0.255.255 area 0 network 100.111.0.0 0.0.255.255 area 0 bfd all-interfaces
This section shows the CSG configuration if IS-IS is used as the RAN IGP.
router isis ran net 49.1100.1011.1101.3018.00 is-type level-1 ispf level-1 metric-style wide fast-flood max-lsp-lifetime 65535 lsp-refresh-interval 65000 spf-interval 5 50 200 prc-interval 5 50 200 lsp-gen-interval 5 50 200
<<< IS-IS Level-1
3-26
SDU-6516
Chapter 3
CISCO CONFIDENTIAL
no hello padding log-adjacency-changes passive-interface Loopback0 bfd all-interfaces
SDU-6516
3-27
Chapter 3
CISCO CONFIDENTIAL
3-28
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Services
This chapter includes the following major topics: Section 4.1 L3 MPLS VPN Service Model for LTE Section 4.2 L2 MPLS VPN Service Model for 2G and 3G Section 4.3 Fixed-Mobile Convergence Use Case
4.1 L3 MPLS VPN Service Model for LTE

This section includes the following topics: Section 4.1.1 MPLS VPN Transport for LTE S1 and X2 Interfaces Section 4.1.2 MPLS VPN Control Plane
4.1.1 MPLS VPN Transport for LTE S1 and X2 Interfaces

This section describes the L3VPN configuration aspects on the CSGs in the RAN access, and the MTGs in the core network required for implementing the LTE backhaul service for X2 and S1 interfaces.
Figure 4-1.
MPLS VPN Service Implementation for LTE Backhaul
CSG MPLS VPN Configuration
SDU-6516
4-1
Chapter 4
Services
CISCO CONFIDENTIAL
The MPLS VPN configuration on the CSGs, which is minimal, is the same on all CSGs in a given RAN region. The configuration shown includes the required commands to enable BGP PIC protection support for MPLS VPNs. eNodeB UNI Interface
interface GigabitEthernet0/1 description Connected to eNodeB service-policy output PMAP-eNB-UNI-P-E service instance 100 ethernet encapsulation untagged service-policy input PMAP-eNB-UNI-I bridge-domain 100 ! ! interface Vlan100 vrf forwarding LTE2 ip address 113.26.23.1 255.255.255.0 ! <<< eNodeB UNI
VRF Definition
vrf definition LTE2 rd 1111:1111 ! address-family ipv4 export map ADDITIVE route-target export 10:101 <<< Local RAN RT. Same RT on all CSGs in a given RAN region. route-target import 10:101 <<< Imported by the CSGs in the same RAN region to enable X2 communication. route-target import 1001:1001 <<< MPC RT. Imported by every CSG in the entire network. route-target import 10:103 <<< Optional import of adjacent RAN region RT. Only required to enable inter-RAN-region X2 communication. exit-address-family
Route map to export common RT 1111:1111 in addition to Local RAN RT 10:101

route-map ADDITIVE permit 10 set extcommunity rt 1111:1111 additive the entire network.
<<< Common RAN RT. Exported by every CSG in
VPNv4 BGP Configuration

router bgp 100 ! address-family ipv4 vrf LTE2 bgp additional-paths install bgp nexthop trigger delay 0 redistribute connected exit-address-family ! address-family vpnv4 bgp additional-paths install bgp nexthop trigger delay 1
4-2
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
Note
The above route target 10:101 implies that this is a CSG in metro-1, RAN access region-1. Similarly, the route target 10:103 implies that this is a CSG in metro-1, RAN access region-3. Please refer to the "L3 MPLS VPN Service Model for LTE" section in the UMMT 3.0 Design Guide for a detailed explanation of how inter-access X2 communication is enabled with labeled BGP using BGP communities.
PAN BGP Configuration
The following BGP configuration is required on the PANs to facilitate BGP PIC resiliency for MPLS VPNs.
router bgp 1000 ! address-family ipv4 bgp additional-paths receive bgp additional-paths install bgp nexthop trigger delay 0 ! address-family vpnv4 bgp additional-paths install bgp nexthop trigger delay 1
(Optional) PAN MPLS VPN Configuration
The following MPLS VPN configuration on the PANs is optional, and is only required in deployments where there are cell sites close to the pre-aggregation network with eNBs directly connected to the PANs at the CO. eNodeB UNI Interface
interface GigabitEthernet0/3/6 vrf forwarding LTE2 ip address 114.1.23.1 255.255.255.0 load-interval 30 negotiation auto ipv6 address 2001:114:1:23::1/64 end
VRF Definition
vrf definition LTE2 rd 1111:1111 ! address-family ipv4 export map ADDITIVE route-target export route-target import route-target import exit-address-family ! address-family ipv6 export map ADDITIVE route-target export route-target import route-target import exit-address-family
10:101 10:101 1001:1001
10:101 10:101 1001:1001
Route map to export common RT 1111:1111 in addition to Local RAN RT 10:101

!
SDU-6516
4-3
Chapter 4
Services
CISCO CONFIDENTIAL
route-map ADDITIVE permit 10 set extcommunity rt 1111:1111 additive !
VPNv4/v6 BGP Configuration

! router bgp 100 bgp router-id 100.111.14.1 <SNIP> ! address-family ipv4 vrf LTE2 redistribute connected exit-address-family ! address-family ipv6 vrf LTE2 redistribute connected exit-address-family
Mobile Transport Gateway MPLS VPN Configuration
This is a one-time MPLS VPN configuration done on the MTGs. No modifications are made when additional CSGs in any RAN access or other MTGs are added to the network. SAE GW UNI Interface
interface TenGigE0/0/0/2.1100 description Connected to SAE Gateway. vrf LTE2 ipv4 address 115.1.23.3 255.255.255.0 ipv6 nd dad attempts 0 ipv6 address 2001:115:1:23::3/64 encapsulation dot1q 1100
VRF Definition
vrf LTE2 address-family ipv4 unicast import route-target 1111:1111 <<< Common CSG RT imported by MTG 1001:1001 <<< Import MPC RT ! export route-target 1001:1001 <<< Export MPC RT. This is imported by every CSG in the entire network. ! ! address-family ipv6 unicast import route-target 1111:1111 <<< Common CSG RT imported by MTG 1001:1001 <<< Import MPC RT ! export route-target 1001:1001 <<< Export MPC RT. This is imported by every CSG in the entire network.
MTG 1 VPNv4/v6 BGP Configuration

router bgp 100 bgp router-id 100.111.15.1 bgp update-delay 120 <SNIP> !
4-4
SDU-6516
Chapter 4
Services 4.1.2 MPLS VPN Control Plane
CISCO CONFIDENTIAL
vrf LTE2 address-family ipv4 unicast redistribute connected ! address-family ipv6 unicast redistribute connected !
MTG 2 VPNv4/v6 BGP Configuration

router bgp 100 bgp router-id 100.111.15.2 <SNIP> ! vrf LTE2 address-family ipv4 unicast redistribute connected ! address-family ipv6 unicast redistribute connected !
Note
This version of the UMMT System release supports v6 MPLS VPNs using 6VPE functionality as defined in RFC 4659 only on the ASR 903 PAN and ASR 9000 MTG. 6VPE will be supported on the ASR 901, ME3800X and ME3600X-24CX platforms in the next system release.
4.1.2 MPLS VPN Control Plane

This section describes the BGP control plane aspects for the VPNv4 LTE backhaul service.
Figure 4-2.
BGP Control Plane for MPLS VPN Service
CSG LTE VPNv4 PE Configuration

router bgp 100 bgp router-id 100.111.13.18 <SNIP> neighbor 100.111.14.1 peer-group pan neighbor 100.111.14.2 peer-group pan ! address-family vpnv4
<< Inline-RR PAN K1401 << Inline-RR PAN K1402
SDU-6516
4-5
Chapter 4
Services
CISCO CONFIDENTIAL
neighbor pan send-community extended neighbor 100.111.14.1 activate neighbor 100.111.14.2 activate exit-address-family ! address-family rtfilter unicast neighbor pan send-community extended neighbor 100.111.14.1 activate neighbor 100.111.14.2 activate exit-address-family !
<< RT Constrained Route Distribution
Note
Please refer to the "Prefix Filtering" section in the UMMT 3.0 Design Guide for a detailed explanation of how RT-constrained RD is used for constraining VPNv4 routes from remote RAN access regions.
PAN Inline-RR Configuration
The BGP configuration for the inline-RR function on the PAN shown below requires the small change of activating the neighborship when new CSG is added to local access network.
router bgp 100 bgp router-id 100.111.14.1 <SNIP> neighbor 100.111.10.1 peer-group abr neighbor 100.111.10.2 peer-group abr neighbor 100.111.13.17 peer-group csg neighbor 100.111.13.18 peer-group csg neighbor 100.111.13.19 peer-group csg ! address-family ipv4 bgp nexthop trigger delay 2 <SNIP> exit-address-family ! address-family vpnv4 bgp nexthop trigger delay 3 neighbor csg send-community extended neighbor csg route-reflector-client neighbor abr send-community both neighbor 100.111.10.1 activate neighbor 100.111.10.2 activate neighbor 100.111.13.17 activate neighbor 100.111.13.18 activate neighbor 100.111.13.19 activate exit-address-family ! address-family vpnv6 bgp nexthop trigger delay 3 neighbor abr send-community both neighbor 100.111.10.1 activate neighbor 100.111.10.2 activate exit-address-family ! address-family rtfilter unicast towards CSGs neighbor csg send-community extended neighbor 100.111.13.17 activate neighbor 100.111.13.18 activate neighbor 100.111.13.19 activate exit-address-family !
<< CN-ABR K1001 << CN-ABR K1002 <<< RR-Client CSG K1317 <<< RR-Client CSG K1318 <<< RR-Client CSG K1319
<< VPNv4 AF
<<< CSGs are RR clients <<< CN-RR is next level RR
<< VPNv6 AF for 6VPE
<< RT Constrained Route Distribution
CN-ABR Inline-RR Configuration
4-6
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
router bgp 100 bgp router-id 100.111.10.1 <SNIP> ! neighbor-group cn-rr use session-group infra <SNIP> ... ! address-family vpnv4 unicast ! address-family vpnv6 unicast ! ! neighbor-group pan local Aggregation network use session-group infra <SNIP> ... ! address-family vpnv4 unicast route-reflector-client ! address-family vpnv6 unicast route-reflector-client ! ! neighbor 100.111.4.3 use neighbor-group cn-rr ! neighbor 100.111.9.7 use neighbor-group agg ! neighbor 100.111.9.8 use neighbor-group agg ! neighbor 100.111.9.9 use neighbor-group agg ! neighbor 100.111.9.10 use neighbor-group agg ! !
<<< iBGP neighbor group for CN-RR
<<< iBGP neighbor group for PANs in
<<< CN-RR
<< PAN K0907
<< PAN K0908
<< PAN K0909
<< PAN K0910
CN-RR Configuration
router bgp 100 bgp router-id 100.111.4.3 <SNIP> ! address-family vpnv4 unicast nexthop trigger-delay critical 2000 ! address-family vpnv6 unicast nexthop trigger-delay critical 2000 ! neighbor-group mtg use session-group intra-as <SNIP> ... ! address-family vpnv4 unicast route-reflector-client ! address-family vpnv6 unicast route-reflector-client ! ! neighbor-group cn-abr use session-group intra-as
<< neighbor-group for MTGs
<< neighbor-group for CN-ABRs
SDU-6516
4-7
Chapter 4
Services
CISCO CONFIDENTIAL
<SNIP> ... ! address-family vpnv4 unicast route-reflector-client route-policy BGP_Egress_RAN_Filter out ! address-family vpnv6 unicast route-reflector-client route-policy BGP_Egress_RAN_Filter out ! ! neighbor 100.111.2.1 use neighbor-group cn-abr ! neighbor 100.111.4.1 use neighbor-group cn-abr ! neighbor 100.111.10.1 use neighbor-group cn-abr ! neighbor 100.111.10.2 use neighbor-group cn-abr ! neighbor 100.111.15.1 use neighbor-group mtg ! neighbor 100.111.15.2 use neighbor-group mtg route-policy BGP_Egress_RAN_Filter if extcommunity rt matches-any Deny_RAN_Community then drop else pass endif end-policy
extcommunity-set rt Deny_RAN_Community 1111:1111 end-set
Note
Please refer to the "Prefix Filtering" section in the UMMT 3.0 Design Guide for a detailed explanation of how egress filtering is done at the CN-RR for constraining VPN routes from remote RAN access regions.
MTG LTE VPNv4/v6 PE Configuration
router bgp 100 bgp router-id 100.111.15.1 <SNIP> ! neighbor-group cn-rr use session-group intra-as <SNIP> ... ! address-family vpnv4 unicast ! address-family vpnv6 unicast ! ! neighbor 100.111.4.3 use neighbor-group cn-rr
4-8
SDU-6516
Chapter 4
Services 4.2 L2 MPLS VPN Service Model for 2G and 3G
CISCO CONFIDENTIAL
!
Note
This version of the UMMT System release supports v6 MPLS VPNs using 6VPE functionality, as defined in RFC 4659 only on the ASR 903 PAN and ASR 9000 MTG. 6VPE will be supported on the ASR 901, ME3800X and ME3600X-24CX platforms in the next system release.
4.2 L2 MPLS VPN Service Model for 2G and 3G

Layer 2 MPLS VPN service models provide TDM Circuit Emulation Services (CES) for 2G backhaul and ATM CES for 3G backhaul. The following services were validated as part of UMMT 3.0: TDM backhaul from the CSG to the MTG, utilizing the structured CESoPSN mechanism TDM backhaul from the PAN to the MTG, utilizing the unstructured SAToP mechanism ATM backhaul from the PAN to the MTG, supporting both ATM clear-channel and ATM IMA circuits. This section includes the following topics: Section 4.2.1 CESoPSN VPWS Service from CSG to MTG Section 4.2.2 SAToP VPWS Service from PAN to MTG Section 4.2.3 ATM Clear-channel VPWS Service from PAN to MTG Section 4.2.4 ATM IMA VPWS Service from PAN to MTG
4.2.1 CESoPSN VPWS Service from CSG to MTG

Circuit Emulation Services over Packet Switched Network (CESoPSN) provides structured transport of TDM circuits down to the DS0 level across an MPLS-based backhaul architecture. The configurations for the CSG and MTGs are outlined in this section, including an illustration of basic backup pseudowire configuration on the CSG to enable transport to redundant MTGs. Complete high availability configurations are available in the Service High Availability section.
Figure 4-3.
CESoPSN Service Implementation for 2G and 3G Backhaul
SDU-6516
4-9
Chapter 4
Services
CISCO CONFIDENTIAL
Note
Regarding the example shown: ASR 901 Motherboard with built-in 12GE, 1FE, 16T1E1 (A901-12C-FT-D) is used to create CEM interface for TDM pseudowire. Both ASR 9000 MTGs utilize 1-port channelized OC3/STM-1 ATM and circuit emulation SPA (SPA-1CHOC3-CE-ATM) in a SIP-700 card for the TDM interfaces. CESoPSN encapsulates T1/E1 structured (channelized) services. Structured mode (CESoPSN) identifies framing and sends only payload, which can be channelized T1s within DS3 and DS0s within T1. DS0s can be bundled to the same packet. This mode is based on IETF RFC 5086. "MPLS LDP discovery targeted-hello accept" is required because of its LDP session via PW tunnel between PEs are not directly connected and targeted-hello response is not configured so both sessions will be showing as passive, which is normal. ASR 901 Cell Site Gateway Configuration
card type t1 0 0 ! controller T1 0/0 framing esf linecode b8zs cablelength short 133 cem-group 0 timeslots 1-24 ! pseudowire-class CESoPSN encapsulation mpls control-word ! ! interface CEM0/0 no ip address load-interval 30 cem 0 xconnect 100.111.15.1 13261501 encapsulation mpls pw-class CESoPSN backup peer 100.111.15.2 13261502 pw-class CESoPSN ! hold-queue 4096 in hold-queue 4096 out ! interface Loopback0 ip address 100.111.13.26 255.255.255.255 isis tag 10 ! router isis agg-acc passive-interface Loopback0 ! ! mpls ldp discovery targeted-hello accept !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
ASR 9000 Mobile Transport Gateway Configuration The other MTG configuration is identical, except with a Loopback 0 IP address of 100.111.15.2, and an pw-id of 13261502.
hw-module subslot 0/2/1 cardtype sonet !
4-10
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
controller SONET0/2/1/0 description To ONS15454-K1410 OC3 port 4/1 ais-shut report lais report lrdi sts 1 mode vt15-t1 delay trigger 250 ! clock source line ! controller T1 0/2/1/0/1/1/3 cem-group framed 0 timeslots 1-24 forward-alarm AIS forward-alarm RAI clock source line ! interface CEM0/2/1/0/1/1/3:0 load-interval 30 l2transport ! ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.1 255.255.255.255 ! l2vpn ! pw-class CESoPSN encapsulation mpls control-word ! ! xconnect group TDM-K1326 p2p T1-CESoPSN-01 interface CEM0/2/1/0/1/1/3:0 neighbor 100.111.13.26 pw-id 13261501 pw-class CESoPSN ! ! ! ! router isis core ! interface Loopback0 passive point-to-point address-family ipv4 unicast ! ! router bgp 1000 bgp router-id 100.111.15.1 address-family ipv4 unicast network 100.111.15.1/32 route-policy MTG_Community ! mpls ldp router-id 100.111.15.1 discovery targeted-hello accept ! !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
SDU-6516
4-11
Chapter 4 4.2.2 SAToP VPWS Service from PAN to MTG
Services
CISCO CONFIDENTIAL
4.2.2 SAToP VPWS Service from PAN to MTG

Structure-Agnostic Time Division Multiplexing over Packet (SAToP) provides unstructured transport of TDM circuits across an MPLS-based backhaul architecture. The configurations for the PAN and MTGs are outlined in this section, including an illustration of backup pseudowire configuration on the PAN to enable transport to redundant MTGs.
Figure 4-4.
SAToP VPWS Service Implementation for 2G Backhaul
Note
Regarding the example shown: ASR 903 utilizes a 16 port T1/E1 Interface Module (A900-IMA16D) for TDM interfaces. ME 3600X 24CX utilizes on-board T1/E1 interfaces. Both ASR 9000 MTGs utilize 1-port channelized OC3/STM-1 ATM and circuit emulation SPA (SPA-1CHOC3-CE-ATM) in a SIP-700 card for the TDM interfaces. SAToP encapsulates T1/E1 services, disregarding any structure that may be imposed on these streams, in particular the structure imposed by the standard TDM framing. This mode is based on IETF RFC 4553. "MPLS LDP discovery targeted-hello accept" is required because of its LDP session via PW tunnel between PEs are not directly connected and targeted-hello response is not configured, so both sessions will be showing as passive, which is normal. ASR 903 Pre-Aggregation Node Configuration
card type t1 0 5 ! controller T1 0/5/0 framing unframed clock source internal linecode b8zs cablelength short 110 cem-group 0 unframed ! pseudowire-class SAToP encapsulation mpls control-word ! ! interface CEM0/5/0 no ip address load-interval 30 cem 0 xconnect 100.111.15.1 14011501 encapsulation mpls pw-class SAToP backup peer 100.111.15.2 14011502 pw-class SAToP ! hold-queue 4096 in hold-queue 4096 out !
4-12
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
interface Loopback0 ip address 100.111.14.1 255.255.255.255 ! ! router isis agg-acc passive-interface Loopback0 ! ! mpls ldp discovery targeted-hello accept !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
ME 3600X 24CX Pre-Aggregation Node Configuration

card type t1 0 1 ! controller T1 0/1 framing unframed clock source internal linecode b8zs cablelength short 110 cem-group 0 unframed ! pseudowire-class SAToP encapsulation mpls control-word ! ! interface CEM0/1 no ip address load-interval 30 cem 0 xconnect 100.111.15.1 9171501 encapsulation mpls pw-class SAToP backup peer 100.111.15.2 9171502 pw-class SAToP ! ! interface Loopback0 ip address 100.111.9.17 255.255.255.255 ! ! router isis agg-acc passive-interface Loopback0 ! ! mpls ldp discovery targeted-hello accept !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
ASR 9000 Mobile Transport Gateway Configuration The other MTG configuration is identical, except with a Loopback 0 IP address of 100.111.15.2, and pw-ids ending in 1502 instead of 1501.
hw-module subslot 0/2/1 cardtype sonet ! controller SONET0/2/1/0 description To ONS15454-K1410 OC3 port 4/1 ais-shut report lais report lrdi sts 1 mode vt15-t1
SDU-6516
4-13
Chapter 4
Services
CISCO CONFIDENTIAL
delay trigger 250 ! clock source line ! controller T1 0/2/1/0/1/1/1 cem-group unframed forward-alarm AIS forward-alarm RAI clock source line ! controller T1 0/2/1/0/1/1/2 cem-group unframed forward-alarm AIS forward-alarm RAI clock source line ! interface CEM0/2/1/0/1/1/1 load-interval 30 l2transport ! ! interface CEM0/2/1/0/1/1/2 load-interval 30 l2transport ! ! ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.1 255.255.255.255 ! l2vpn pw-class SAToP encapsulation mpls control-word ! ! xconnect group TDM-K0917 p2p T1-SAToP-01 interface CEM0/2/1/0/1/5/1 neighbor 100.111.9.17 pw-id 9171501 pw-class SAToP ! ! ! xconnect group TDM-K1401 p2p T1-SAToP-01 interface CEM0/2/1/0/1/1/2 neighbor 100.111.14.1 pw-id 14011501 pw-class SAToP ! ! ! router isis core interface Loopback0 passive point-to-point address-family ipv4 unicast ! ! ! router bgp 1000 bgp router-id 100.111.15.1 address-family ipv4 unicast network 100.111.15.1/32 route-policy MTG_Community ! mpls ldp router-id 100.111.15.1 discovery targeted-hello accept
4-14
SDU-6516
Chapter 4
Services 4.2.3 ATM Clear-channel VPWS Service from PAN to MTG
CISCO CONFIDENTIAL
! !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
4.2.3 ATM Clear-channel VPWS Service from PAN to MTG

Any Transport over MPLS (AToM) pseudowire circuits are utilized to provide ATM circuit transport across an MPLS-based backhaul architecture. The ATM interface is configured for AAL0 to allow for transparent transport of the entire PVC across the transport network. The configurations for the PAN and MTGs are outlined in this section. QoS implementation for ATM circuits is covered in the Quality of Service section, and resiliency via pseudowire redundancy and MR-APS is covered in the High Availability section.
Figure 4-5.
ATM VPWS Service Implementation for 3G Backhaul
Regarding the example shown:
Note
ASR 903 utilizes a 16 port T1/E1 Interface Module (A900-IMA16D) for ATM interfaces. Both ASR 9000 MTGs utilize 1-port OC3/STM-1 ATM SPA (SPA-1XOC3-ATM-V2) in a SIP-700 card for the TDM interfaces. ATM transport via Pseudowire over an MPLS infrastructure is detailed in IETF RFC 4447. The PE side of the ATM interface uses aal0 encapsulation, and the CE side uses aal5snap encapsulation "MPLS LDP discovery targeted-hello accept" is required because of its LDP session via PW tunnel between PEs are not directly connected and targeted-hello response is not configured, so both sessions will be showing as passive, which is normal. CE node connected to PAN
! card type t1 0 0 ! controller T1 0/3 framing esf clock source line linecode b8zs cablelength long 0db mode atm ! interface ATM0/3 ip address 100.14.15.26 255.255.255.252 load-interval 30 no scrambling-payload no atm enable-ilmi-trap pvc 100/4011
SDU-6516
4-15
Chapter 4
Services
CISCO CONFIDENTIAL
protocol ip 100.14.15.25 broadcast encapsulation aal5snap ! ! interface Vlan201 ip address 214.14.6.17 255.255.255.252 load-interval 30 no ptp enable ! interface GigabitEthernet0/2 description Traffic Generator with IP 214.14.6.18 switchport access vlan 201 switchport mode access load-interval 30 ! ip route 214.15.3.16 255.255.255.252 100.14.15.25 !
ASR 903 Pre-Aggregation Node Configuration

card type t1 0 5 license feature atm controller T1 0/5/2 framing esf clock source internal linecode b8zs cablelength long 0db atm ! interface ATM0/5/2 no ip address no atm enable-ilmi-trap ! interface ATM0/5/2.100 point-to-point no atm enable-ilmi-trap pvc 100/4011 l2transport encapsulation aal0 xconnect 100.111.15.1 1401150115 encapsulation mpls ! ! interface Loopback0 ip address 100.111.14.1 255.255.255.255 ! ! router isis agg-acc passive-interface Loopback0 ! ! mpls ldp discovery targeted-hello accept !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
interface ATM0/2/3/0 load-interval 30 ! interface ATM0/2/3/0.100 l2transport pvc 100/4011 encapsulation aal0
4-16
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
shape vbr-rt 20000 14000 7000 ! ! ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.1 255.255.255.255 ! l2vpn pw-class ATM encapsulation mpls ! ! xconnect group ATM-K1401 p2p T1-ATM-01 interface ATM0/2/3/0.100 neighbor 100.111.14.1 pw-id 1401150115 pw-class ATM ! ! ! router isis core interface Loopback0 passive point-to-point address-family ipv4 unicast ! ! ! router bgp 1000 bgp router-id 100.111.15.1 address-family ipv4 unicast network 100.111.15.1/32 route-policy MTG_Community ! mpls ldp router-id 100.111.15.1 discovery targeted-hello accept ! !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
CE device connected to MTGs

interface ATM3/1/0 no ip address no atm ilmi-keepalive no atm enable-ilmi-trap ! interface ATM3/1/0.100 point-to-point ip address 100.14.15.25 255.255.255.252 no atm enable-ilmi-trap pvc 100/4011 protocol ip 100.14.15.26 broadcast encapsulation aal5snap ! ! interface GigabitEthernet2/3/0 description Traffic Generator with IP 214.15.3.18 ip address 214.15.3.17 255.255.255.252 load-interval 30 speed 1000 no negotiation auto cdp enable ! ip route 214.14.6.16 255.255.255.252 ATM3/1/0.100
SDU-6516
4-17
Chapter 4 4.2.4 ATM IMA VPWS Service from PAN to MTG
Services
CISCO CONFIDENTIAL
!
4.2.4 ATM IMA VPWS Service from PAN to MTG

Any Transport over MPLS (AToM) pseudowire circuits are utilized to provide ATM circuit transport across an MPLS-based backhaul architecture. The ATM interface in this example is configured for IMA. The configurations for the PAN and MTGs are outlined in this section. QoS implementation for ATM circuits is covered in the Quality of Service section, and resiliency via pseudowire redundancy and MR-APS is covered in the High Availability section.
Figure 4-6.
Regarding the example shown:
Note
ASR 903 utilizes a 16 port T1/E1 Interface Module (A900-IMA16D) for ATM interfaces. Both ASR 9000 MTGs utilize 1-port OC3/STM-1 ATM SPA (SPA-1XOC3-ATM-V2) in a SIP-700 card for the TDM interfaces. ATM transport via Pseudowire over an MPLS infrastructure is detailed in IETF RFC 4447. The PE side of the ATM interface uses aal0 encapsulation, and the CE side uses aal5snap encapsulation "MPLS LDP discovery targeted-hello accept" is required because of its LDP session via PW tunnel between PEs are not directly connected and targeted-hello response is not configured, so both sessions will be showing as passive, which is normal. CE node connected to PAN
! card type t1 0 0 ! controller T1 0/3 framing esf clock source internal linecode b8zs cablelength short 110 ima-group 0 no-scrambling-payload ! ! interface ATM0/IMA0 ip address 100.14.15.30 255.255.255.252 ima group-id 0 no atm ilmi-keepalive no atm enable-ilmi-trap pvc 200/4021 protocol ip 100.14.15.29 broadcast encapsulation aal5snap ! !
4-18
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
interface Vlan201 ip address 214.7.1.1 255.255.255.0 no ptp enable ! interface GigabitEthernet0/3 switchport access vlan 201 switchport mode access ! ip route 215.3.1.0 255.255.255.0 100.14.15.29 !
ASR 903 Pre-Aggregation Node Configuration

card type t1 0 5 license feature atm controller T1 0/5/3 framing esf clock source internal linecode b8zs cablelength short 110 ima-group 1 ! interface ATM0/5/ima0 no ip address atm bandwidth dynamic no atm enable-ilmi-trap no atm ilmi-keepalive pvc 200/4021 l2transport encapsulation aal0 xconnect 100.111.15.1 1402150116 encapsulation mpls backup peer 100.111.15.2 1402150216 ! interface Loopback0 ip address 100.111.14.1 255.255.255.255 ! ! router isis agg-acc passive-interface Loopback0 ! ! mpls ldp discovery targeted-hello accept !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
interface ATM0/2/3/0 load-interval 30 ! interface ATM0/2/3/0.200 l2transport pvc 200/4021 encapsulation aal0 ! ! ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.1 255.255.255.255 ! l2vpn
SDU-6516
4-19
Chapter 4 4.3 Fixed-Mobile Convergence Use Case
Services
CISCO CONFIDENTIAL
pw-class ATM encapsulation mpls ! ! xconnect group ATM-K1402 p2p T1-ATM-IMA-01 interface ATM0/2/3/0.200 neighbor 100.111.14.2 pw-id 1402150116 pw-class ATM ! ! ! router isis core interface Loopback0 passive point-to-point address-family ipv4 unicast ! ! ! router bgp 1000 bgp router-id 100.111.15.1 address-family ipv4 unicast network 100.111.15.1/32 route-policy MTG_Community ! mpls ldp router-id 100.111.15.1 discovery targeted-hello accept ! !# !# ISIS and BGP related configuration needed to ensure MPLS LDP binding with remote PE so as to establish AToM PW !#
CE device connected to MTGs

interface ATM3/1/0 no ip address no atm ilmi-keepalive no atm enable-ilmi-trap ! interface ATM3/1/0.200 point-to-point ip address 100.14.15.29 255.255.255.252 no atm enable-ilmi-trap pvc 200/4021 protocol ip 100.14.15.30 broadcast encapsulation aal5snap ! ! interface GigabitEthernet2/1/0 ip address 215.3.1.1 255.255.255.0 ! ip route 214.7.1.0 255.255.255.0 100.14.15.30 !
4.3 Fixed-Mobile Convergence Use Case

The following example illustrates how an E-Line wireline service is transported end-to-end via an EoMPLS pseudowire between CSGs, passing through the respective aggregation networks and core network. Unlike the case of mobile services, where the remote end of the service is either an MTG (S1 or ATM/TDM PW) or a CSG in the same access domain (X2), an E-Line wireline service will typically span the entire transport network and terminate in an arbitrary access-domain. To account for all possible remote destinations, this would require significantly larger routing tables in the access domains, far exceeding the capacities of the CSGs. To avoid this, an on-demand mechanism
4-20
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
is implemented in the CSGs to dynamically update the routing prefix-lists at the time of service activation and deactivation, adding only the specific routes of the remote nodes necessary to support the currently configured services. This mechanism is detailed at the end of this section. CSG-901-K1323
route-map CSG_Community permit 10 set community 10:10 10:203 20:20 ! router bgp 1000 address-family ipv4 network 100.111.13.23 mask 255.255.255.255 route-map CSG_Community ! ! interface GigabitEthernet0/3 service instance 500 ethernet encapsulation dot1q 500 rewrite ingress tag pop 1 symmetric xconnect 100.111.13.26 500 encapsulation mpls !
Core ABR K0601

route-policy BGP_Egress_Transport_Filter if community matches-any (20:*) then if community matches-any (20:*) then pass elseif community matches-any (10:*) then drop else pass endif endif end-policy
Core Route Reflector K0403

community-set Pass_WireLine_Community 20:20 end-set ! community-set Deny_Transport_Community 10:10 end-set ! route-policy pass-all pass end-policy ! ! route-policy BGP_Egress_Transport_Filter if community matches-any Pass_WireLine_Community then pass elseif community matches-any Deny_Transport_Community then drop else pass endif end-policy !
For brevity, only one aggregation network configuration is shown.
SDU-6516
4-21
Chapter 4
Services
CISCO CONFIDENTIAL
Pre-Aggregation Node K0917
router bgp 101 address-family ipv4 neighbor csg route-map BGP_Egress_Transport_Filter out ip ip ip ip ! bgp-community new-format community-list standard MTG_Community permit 1001:1001 community-list standard Inter-Access-X2 permit 10:101 community-list standard WL_Community permit 20:20
route-map L1intoL2 permit 10 match ip address Pre-Agg set level level-2 ! route-map PRE_AGG_Community permit 10 set community 100:100 100:104 ! route-map BGP_Egress_Transport_Filter permit 10 match community MTG_Community set mpls-label ! route-map BGP_Egress_Transport_Filter permit 20 match community WL_Community set mpls-label
CSG-K901-K1326
router bgp 101 address-family ipv4 network 100.111.13.26 mask 255.255.255.255 route-map CSG_Community network 213.26.22.0 mask 255.255.255.252 neighbor 100.111.9.17 activate neighbor 100.111.9.17 route-map Inbound_Filter in neighbor 100.111.9.18 activate neighbor 100.111.9.18 route-map Inbound_Filter in
ip bgp-community new-format ip community-list standard Allowed_Communities permit 1001:1001 ! ip ip ip ip prefix-list prefix-list prefix-list prefix-list WL-Service-Destinations WL-Service-Destinations WL-Service-Destinations WL-Service-Destinations seq seq seq seq 10 15 20 25 permit permit permit permit 100.111.13.24/32 100.111.13.26/32 100.111.13.66/32 100.111.13.23/32
route-map Inbound_Filter permit 10 match community Allowed_Communities ! route-map Inbound_Filter permit 20 match ip address prefix-list WL-Service-Destinations ! route-map CSG_Community permit 10 set community 10:10 10:104 20:20 ! interface GigabitEthernet0/3 service instance 500 ethernet encapsulation dot1q 500 rewrite ingress tag pop 1 symmetric xconnect 100.111.13.23 500 encapsulation mpls !
4-22
SDU-6516
Chapter 4
Services
CISCO CONFIDENTIAL
Each time a new wireline service is enabled on the CSG, the route-map for the inbound filter on the CSG needs to be updated to allow the remote destination loopback of wireline service to be accepted. This process can be easily automated using a simple Embedded Event Manager (EEM) script shown below. With this EEM script in place on the CSG, when the operator configures a new VPWS service on the device using the "xconnect destination vc-id encapsulation mpls" command, the remote T-PE loopback corresponding to the destination argument will automatically be added to the "WL-ServiceDestinations" prefix-list of allowed wireline destinations. The script will also trigger a dynamic inbound soft reset using the "clear ip bgp destination soft in" command to initiate a nondisruptive dynamic route refresh.
event manager applet UpdateInboundFilter event cli pattern ".*xconnect.*encapsulation.*mpls" sync no skip no action 10 regexp " [0-9.]+" "$_cli_msg" result action 20 cli command "enable" action 21 cli command "conf t" action 30 cli command "ip prefix-list WL-Service-Destinations permit $result/32" action 31 puts "Inbound Filter updated for $result/32" action 40 cli command "end" action 50 cli command "enable" action 60 cli command "clear ip bgp 100.111.9.17 soft in" action 61 cli command "clear ip bgp 100.111.9.18 soft in" action 80 puts "Triggered Dynamic Inbound Soft Reset towards PANs"
Similarly, when a wireline service is removed from the CSG, the route-map for the inbound filter on the CSG needs to be updated to remove the remote destination loopback of the deleted wireline service. The following two EEM scripts will automate this process on the CSG through the following logic:
1. The operator removes the XConnect by the "no xconnect" command. There is no IP address
which is required to remove a correct line from a prefix-list.

2. To obtain the IP address, the "tovariable" applet was used with an environmental variable $_int.
This applet is triggered by the "interface" command which informs the variable that there can be a potential change in the configuration.
3. The second applet "UpdateInboundFilter2" is triggered by the "no xconnect" command, and uses
the interface derived from the "tovariable" applet to obtain the IP address and remove it from the prefix-list.
event manager applet tovariable event cli pattern "interface" sync no skip no action 10 cli command "enable" action 20 cli command "conf t" action 30 cli command "event manager environment _int $_cli_msg" event manager applet UpdateInboundFilter2 event cli pattern "no xconnect" sync no skip yes action 10 cli command "enable" action 20 cli command "show run $_int" action 30 regexp "xconnect.*" "$_cli_result" line action 40 regexp " [0-9.]+" "$line" result action 50 cli command "enable" action 60 cli command "conf t" action 70 cli command "no ip prefix-list WL-Service-Destinations permit $result/32" action 80 cli command "$_int" action 90 cli command "no xc" action 100 cli command "clear ip bgp 100.111.9.17 soft in" action 110 cli command "clear ip bgp 100.111.9.18 soft in" action 120 puts "Triggered Dynamic Inbound Soft Reset towards PANs"
SDU-6516
4-23
Chapter 4
Services
CISCO CONFIDENTIAL
Note
Future system releases will include feature enhancements to the Unified MPLS toolbox to fully automate the scale control in the RAN access while enabling wireline deployments without needing manual prefix filtering and EEM scripting.
4-24
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Synchronization Distribution
Unified MPLS for Mobile Transport Release 3.0 implements a comprehensive hybrid synchronization distribution model, utilizing a combination of both Synchronous Ethernet (SyncE) and IEEE 1588v2 Precision Time Protocol (PTP) to deliver Frequency, Phase, and Time of Day (ToD) distribution across the transport network. This model implements a hybrid PTP Boundary Clock (BC) function, which use frequency from SyncE and phase from PTP to recover clock locally, and regenerates clock to deliver frequency, phase and ToD to downstream devices. This hybrid model provides the most accurate method of synchronization distribution: SyncE is utilized for Frequency Distribution, and each hop in the transport network is configured to support SyncE. SyncE is implemented per the ITU-T G.8264 specification, which outlines the use of Synchronization Status Message (SSM) protocol carried via Ethernet synchronization messaging channel for passing Quality Level (QL) information between nodes. This method enables ring architectures to allow for redundant SyncE sources and prevent any synchronization loops. 1588v2 PTP is utilized for Phase and ToD Distribution. Hybrid BC functionality is implemented in the aggregation nodes, PANs, and CSGs to distribute synchronization to all end points without requiring an individual PTP stream from the PRC/PRTC to each end point. A Best Master Clock Algorithm (BMCA) implemented in a node allows for redundant upstream PTP sources to be configured. This model can be modified to suit certain deployment scenarios or limitations. For example, if the services delivered over the transport network require only frequency synchronization, then only SyncE need be deployed. If the end-to-end transport network contains devices that do not support SyncE, then 1588 may be utilized for frequency distribution in that portion of the network. The following section includes the configuration for the hybrid synchronization model: Section 5.1 Hybrid Model Configuration The configurations for each node are divided into SyncE and 1588v2 sections, so that one or the other can be configured separately if the particular deployment scenario only requires or permits one technology to be deployed.
5.1 Hybrid Model Configuration

This section shows the end-to-end configurations to implement the hybrid clocking model in the UMMT 3.0 System architecture. Note that while the topology reflects an Inter-AS deployment, the configurations are identical for a single AS deployment.
SDU-6516
5-1
Chapter 5
CISCO CONFIDENTIAL
Figure 5-1.
Test Topology
Notes on Figure 5-1: TP-5000 has two ethernet connections to MTG-K1501 and MTG-K1502, which provide PTP PRC source redundancy marked with green and blue (green with priority 100/105, blue with priority 110/115). TP-5000 has two E1 output connects to ASBR-AGG-K1001 and ASBR-AGG-K1002 RSP BITS front panel ports. For redundancy under RSP switchover or node failure, it's recommended to use two IOC modules to provide a total of four E1 outputs to connect to both RSP of ASBR-AGG nodes. ASBR-AGG node with 1588 PTPv2 hybrid BC getting frequency from SyncE and phase from 1588. Green PTP source has higher priority so both ASBR-AGG nodes synchronize with green PRC source. Recovered PTP clock is regenerated from ASBR-AGG WAN interface PTP master port and provides 1588 clock to PAN Pre-AGG nodes. PAN with 1588 PTPv2 hybrid BC getting frequency from SyncE and phase from 1588. Each PAN, based on its metric, will choose the closest ASBR-AGG as primary PRC source and the other as backup. Access CSG nodes with 1588 BC only and without BMCA will pick up one of the PANs as PRC source and provide clock for the downstream eNodeB from the recovered clock regenerated from the BC master port. Full Hybrid BC functionality on the ASR 901 will be covered in an update.
Table 5-1.
Connectivity Table
Role
Device
Interface
VLAN-ID
IP Address
Note
Master PTP Clock
TP5000
ioc1-1 (eth1) ioc1-2 (eth2)
300 400 NA NA
200.10.1.9 In global of MTG-9006-K1501 GigabitEthernet0/1/0/0.300 200.10.2.9 In global MTG-9006-K1502 GigabitEthernet0/1/0/0.400 NA NA In ABR-K1001 BITS port In ABR-K1002 BITS port
Master SyncE Clock Backup SyncE Clock
TP5000 TP5000
Port1 (E1 output) Port2 (E1 output)
Master Clock (TP5000)
5-2
SDU-6516
Chapter 5
CISCO CONFIDENTIAL
*** TP5000 sync to lab GPS *** tp5000> show gps GPS Information
GPS Mode GPS Mask GPS Antenna Delay
- auto - 10 - 240
GPS Latitude GPS Longitude GPS Height
- N35:51:18.886 - W78:52:31.209 - 125.6
---------------------------------------------------------|Index |No. |SNR |Health |Azimuth |Elevation| |------|---------|---------|---------|---------|---------| |1 |3 |34 |healthy |128 |69 | |......|.........|.........|.........|.........|.........| |2 |6 |33 |healthy |84 |60 | |......|.........|.........|.........|.........|.........| |3 |7 |33 |healthy |306 |25 | |......|.........|.........|.........|.........|.........| |4 |13 |35 |healthy |299 |54 | |......|.........|.........|.........|.........|.........| |5 |16 |33 |healthy |35 |52 | |......|.........|.........|.........|.........|.........| |6 |19 |31 |healthy |169 |43 | |......|.........|.........|.........|.........|.........| |7 |23 |35 |healthy |222 |65 | ---------------------------------------------------------tp5000> *** TP5000 PTP Status per IO Controller / Interface *** tp5000> show ptp-status ioc-1 Grandmaster status information: Port Enabled Clock Id Profile Clock Class Clock Accuracy Timescale Num clients Client load Packet load : : : : : : : : : yes 00:B0:AE:FF:FE:01:90:86 unicast locked to reference within 100ns PTP 5 1% 1%
tp5000> show ptp-status ioc-2 Grandmaster status information: Port Enabled Clock Id Profile Clock Class Clock Accuracy Timescale Num clients Client load Packet load : : : : : : : : : yes 00:B0:AE:FF:FE:01:90:87 unicast locked to reference within 100ns PTP 2 0% 0%
SDU-6516
5-3
Chapter 5
CISCO CONFIDENTIAL
tp5000> *** TP5000 VLAN onfiguration towards clients *** tp5000> show vlan-config ioc1-1 Index 1 2 VLAN-ID 100 300 Pri 5 5 State enable enable Address 20.10.1.9 200.10.1.9 Netmask 255.255.255.254 255.255.255.254 Gateway 20.10.1.8 200.10.1.8
tp5000> show vlan-config ioc1-2 Index 1 2 VLAN-ID 200 400 Pri 5 5 State enable enable Address 20.10.2.9 200.10.2.9 Netmask 255.255.255.254 255.255.255.254 Gateway 20.10.2.8 200.10.2.8
tp5000> show ptp-config common ioc1-1
PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP
Timescale State Max Number Clients Profile ClockId Priority 1 Priority 2 Domain DSCP DSCP State Sync Limit Announce Limit Delay Limit Unicast Negotiation Unicast Lease Duration Dither
AUTO enabled 500 unicast 00:B0:AE:FF:FE:01:90:86 100 105 0 46 enabled -7 -3 -7 enabled 300 disabled
tp5000> show ptp-config common ioc1-2
PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP PTP
Timescale State Max Number Clients Profile ClockId Priority 1 Priority 2 Domain DSCP DSCP State Sync Limit Announce Limit Delay Limit Unicast Negotiation Unicast Lease Duration Dither
AUTO enabled 500 unicast 00:B0:AE:FF:FE:01:90:87 110 115 0 46 enabled -7 -3 -7 enabled 300 disabled
tp5000>
MTG Connections to PTP Grandmaster Clock TP-5000 (This provides BMCA source for downstream devices (MTG-K1501
*** Interface To TP5000 Eth IOC-1 on MTG-K1501*** !
5-4
SDU-6516
Chapter 5
CISCO CONFIDENTIAL
interface GigabitEthernet0/0/1/0.300 service-policy output PMAP-NNI-E_PTP-Test ipv4 address 200.10.1.8 255.255.255.254 load-interval 30 encapsulation dot1q 300 ! *** Interface To TP5000 Eth IOC-1 on MTG-K1502*** ! interface GigabitEthernet0/0/1/0.400 service-policy output PMAP-NNI-E_PTP-Test ipv4 address 200.10.2.8 255.255.255.254 encapsulation dot1q 400 !
Aggregation Node Configurations (SyncE and 1588 PTPv2 hybrid BC with BMCA (AGN-ASBR-K1001
BITS Clock-Interface for SyncE frequency source. Same for both nodes
*** Clock Interface Configuration - BITS link to MasterClock TP5000 *** ! clock-interface sync 0 location 0/RSP0/CPU0 port-parameters bits-input e1 non-crc-4 hdb3 ! frequency synchronization selection input priority 1 wait-to-restore 0 quality receive exact itu-t option 1 PRC ! ! clock-interface sync 0 location 0/RSP1/CPU0 port-parameters bits-input e1 non-crc-4 hdb3 ! frequency synchronization selection input priority 1 wait-to-restore 0 quality receive exact itu-t option 1 PRC ! !
AGN-ASBR K1001 SyncE Configuration

*** Global Configuration *** ! frequency synchronization quality itu-t option 1 log selection changes ! *** Interface Configuration *** RP/0/RSP0/CPU0:ASBR-9006-K1001#show run int ten0/0/0/0 interface TenGigE0/0/0/0 description To AGN-ASBR-K1002 T0/0/0/2 frequency synchronization selection input priority 1 ! ! RP/0/RSP0/CPU0:ASBR-9006-K1001#show run int ten0/0/0/1 interface TenGigE0/0/0/1 description To AGN-K0502::T0/0/0/1 frequency synchronization
SDU-6516
5-5
Chapter 5
CISCO CONFIDENTIAL
selection input priority 2 ! !
AGN-ASBR K1001 1588 Configuration

*** PTP profile *** RP/0/RSP0/CPU0:ASBR-9006-K1001#show run ptp ptp clock domain 0 identity mac-address router ! profile AGN-ASBR-BC-Slave dscp 46 transport ipv4 port state slave-only master ipv4 200.10.1.9 priority 120 ! master ipv4 200.10.2.9 priority 125 ! sync frequency 64 clock operation one-step source ipv4 address 100.100.10.1 delay-request frequency 64 ! profile AGN-ASBR-BC-Master dscp 46 transport ipv4 sync frequency 64 clock operation one-step announce timeout 2 source ipv4 address 10.5.2.1 delay-request frequency 64 ! *** PTP hybrid BC slave port *** RP/0/RSP0/CPU0:ASBR-9006-K1001#show run int ten0/0/0/2 interface TenGigE0/0/0/2 description To CN-ASBR-K0601::T0/0/0/2 ptp profile AGN-ASBR-BC-Slave sync frequency 64 delay-request frequency 64 ! *** PTP hybrid BC master port *** RP/0/RSP0/CPU0:ASBR-9006-K1001#show run int ten0/0/0/1 interface TenGigE0/0/0/1 description To AGN-K0502::T0/0/0/1 ptp profile AGN-ASBR-BC-Master sync frequency 64 delay-request frequency 64 ! !
AGN-ASBR K1002 SyncE Configuration

*** Global Config *** frequency synchronization quality itu-t option 1
5-6
SDU-6516
Chapter 5
CISCO CONFIDENTIAL
log selection changes *** Interface Config *** RP/0/RSP0/CPU0:ASBR-9006-K1002#show run int ten0/0/0/0 Mon Aug 27 10:35:14.629 EDT interface TenGigE0/0/0/0 description To ASBR-K1001 T0/0/0/0 frequency synchronization selection input priority 1 ! ! RP/0/RSP0/CPU0:ASBR-9006-K1002#show run int ten0/0/0/1 Mon Aug 27 10:35:16.282 EDT interface TenGigE0/0/0/1 description To AGN-K0302::T0/0/0/1 frequency synchronization selection input priority 2 ! !
AGN-ASBR K1002 1588 Configuration

*** PTP profile *** RP/0/RSP0/CPU0:ASBR-9006-K1002#show run ptp ptp clock domain 0 identity mac-address router timescale PTP ! profile AGN-ASBR-BC-Slave dscp 46 transport ipv4 port state slave-only master ipv4 200.10.1.9 ! master ipv4 200.10.2.9 ! sync frequency 64 clock operation one-step source ipv4 address 100.100.10.2 delay-request frequency 64 ! profile AGN-ASBR-BC-Master dscp 46 transport ipv4 sync frequency 64 clock operation one-step announce timeout 2 source ipv4 address 10.3.2.3 delay-request frequency 64 ! ! *** PTP hybrid BC slave port *** RP/0/RSP0/CPU0:ASBR-9006-K1002#show run int ten0/0/0/2 interface TenGigE0/0/0/2 description To CN-ASBR-K1201::Te0/0/0/2 ptp profile AGN-ASBR-BC-Slave sync frequency 64 delay-request frequency 64 ! *** PTP hybrid BC master port *** RP/0/RSP0/CPU0:ASBR-9006-K1002#show run int ten0/0/0/1
SDU-6516
5-7
Chapter 5
CISCO CONFIDENTIAL
interface TenGigE0/0/0/1 description To AGN-K0302::T0/0/0/1 ptp profile AGN-ASBR-BC-Master sync frequency 64 delay-request frequency 64 !
ASR 903 PAN Nodes (SyncE and 1588 PTPv2 hybrid BC with BMCA (PAN-K1401
PAN-K1401 SyncE Configuration

*** Global Config *** network-clock revertive network-clock synchronization automatic network-clock synchronization mode QL-enabled network-clock input-source 2 interface TenGigabitEthernet0/0/0 network-clock input-source 1 interface TenGigabitEthernet0/1/0 esmc process *** Interface Config *** interface TenGigabitEthernet0/0/0 description To PAN-903-K1402::TenGigabitEthernet0/0/0 synchronous mode interface TenGigabitEthernet0/1/0 description To AGN-K0301::T0/0/0/2 synchronous mode
PAN-K1401 1588v2 Configuration

*** PTP configuration *** ! interface Loopback1 description PTP BC Slave to PRC transport intf ip address 100.100.14.1 255.255.255.255 ! interface Loopback2 description PTP BC master to CSG transport intf ip address 100.101.14.1 255.255.255.255 ! ptp clock boundary domain 0 hybrid output 1pps R0 clock-port BC_Slave_K1401 slave delay-req interval -6 transport ipv4 unicast interface Lo1 negotiation clock source 10.3.2.3 clock source 10.5.2.1 1 clock-port BC_Master_K1401 master sync interval -6 transport ipv4 unicast interface Lo2 negotiation ! router isis agg-acc passive-interface Loopback1 passive-interface Loopback2 !
PAN-K1401 SyncE Configuration

*** Global Config *** network-clock revertive network-clock synchronization automatic network-clock synchronization mode QL-enabled network-clock input-source 1 interface TenGigabitEthernet0/0/0 network-clock input-source 2 interface TenGigabitEthernet0/1/0
5-8
SDU-6516
Chapter 5
CISCO CONFIDENTIAL
esmc process *** Interface Config *** interface TenGigabitEthernet0/0/0 description To PAN-903-K1401::TenGigabitEthernet0/0/0 synchronous mode interface TenGigabitEthernet0/1/0 description to PAN-901-K0912::Ten0/1 synchronous mode
PAN-K1401 1588v2 Configuration

*** PTP configuration *** ! interface Loopback1 description PTP BC Slave to PRC transport intf ip address 100.100.14.2 255.255.255.255 ! interface Loopback2 description PTP BC master to CSG transport intf ip address 100.101.14.2 255.255.255.255 ! ptp clock boundary domain 0 hybrid clock-port BC_Slave_K1402 slave delay-req interval -6 transport ipv4 unicast interface Lo1 negotiation clock source 10.5.2.1 clock source 10.3.2.3 1 clock-port BC_Master_K1402 master sync interval -6 transport ipv4 unicast interface Lo2 negotiation ! router isis agg-acc net 49.0100.1001.1101.4002.00 ispf level-1-2 passive-interface Loopback1 passive-interface Loopback2 !
Access Nodes (SyncE and 1588 BC (ASR901-K1330 shown as reference))
CSG-K1330 SyncE Configuration

interface GigabitEthernet0/10 description To CSG-901-K1329::GigabitEthernet0/11 synchronous mode ! interface GigabitEthernet0/11 description To CSG-901-K1331::GigabitEthernet0/10 synchronous mode !
CSG-K1330 1588v2 Configuration

*** PTP Configuration *** ! interface Loopback1 description PTP BC Slave to PAN transport intf ip address 100.100.13.30 255.255.255.255 ! interface Loopback2 description PTP BC master to eNB transport intf ip address 100.101.13.30 255.255.255.255 !
SDU-6516
5-9
Chapter 5
CISCO CONFIDENTIAL
ptp clock boundary domain 0 1pps-out 1 4096 ns clock-port BC_Slave_K1330 slave transport ipv4 unicast interface Lo1 negotiation clock source 100.101.14.1 clock-port BC_Master_K1330 master transport ipv4 unicast interface Lo2 negotiation ! router isis agg-acc advertise passive-only passive-interface Loopback1 passive-interface Loopback2 ! ! interface Vlan400 description To K1407 1588 PTPv2 client ! interface GigabitEthernet0/6 description To K1407 1588 PTPv2 client service instance 400 ethernet encapsulation untagged bridge-domain 400 !
Simulated IP-NodeB (CSG-2941-K1407)
Simulated IP-NodeB 1588v2 Client

*** PTP Configuration *** ! interface Vlan400 description UMMT3.0 1588v2 client ptp announce interval 3 ptp announce timeout 2 ptp sync interval -4 ptp slave unicast negotiation ptp clock-source 100.101.13.30 ptp enable ! interface GigabitEthernet0/0 description UMMT3.0 1588v2 client (K1330 model 2.3) switchport access vlan 400 ! network-clock-select hold-timeout infinite network-clock-select mode nonrevert network-clock-select 1 PACKET-TIMING ptp mode ordinary ptp priority1 128 ptp priority2 128 ptp domain 0 ! ip route 100.101.13.0 255.255.255.0 114.10.7.2 !
5-10
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
High Availability
As highlighted in the UMMT 3.0 Design Guide chapter on Redundancy and High Availability, the UMMT 3.0 System architecture implements high availability at the transport network level and the service level. By utilizing these various technologies throughout the network, the UMMT design is capable of meeting the stringent NGMN requirements of 200ms recovery times for LTE realtime services. Implementation of the high availability technologies at both levels is covered in this chapter. Synchronization resiliency implementation is covered in the Synchronization Distribution chapter. This chapter includes the following major topics: Section 6.1 Transport Network High Availability Section 6.2 Service High Availability
6.1 Transport Network High Availability

High availability at the transport network layer is provided through the combination of three technologies: Loop-Free Alternate Fast Reroute BGP Core and Edge Fast Reroute and Edge Protection Bi-directional Failure Detection (BFD) at the IGP The configuration for each of these technologies is illustrated in the corresponding section: Section 6.1.1 Loop-Free Alternate Fast Reroute with BFD Section 6.1.2 BGP Fast Reroute Section 6.1.3 Multihop BFD for BGP
6.1.1 Loop-Free Alternate Fast Reroute with BFD

Loop-Free Alternate Fast Reroute (LFA FRR) was introduced in UMMT 1.0. For UMMT 3.0, remote LFA FRR functionality has now been integrated into the network design, extending LFA FRR functionality to ring networks and other topologies. LFA FRR pre-calculates a backup path for every prefix in the IGP routing table, allowing the node to rapidly switch to the backup path when a failure is encountered, with recovery times on the order of 50 msec. More information regarding LFA FRR can be found in IETF RFC 5286, 5714, and 6571.
SDU-6516
6-1
Chapter 6
High Availability
CISCO CONFIDENTIAL
Also integrated are BFD rapid failure detection and ISIS/OSPF extensions for incremental SPF and LSA/SPF throttling. Configurations to enable BFD are shown below as well. Currently, remote LFA FRR is supported on the ASR 901 and ASR 903 platforms. The following configuration illustrates how to enable remote LFA FRR on the ASR 901 with BFD enabled in the IGP: ASR 901 Example
interface Vlan10 !<<<Interface towards upstream ASR 903 ip router isis agg-acc mpls ldp igp sync delay 10 bfd interval 50 min_rx 50 multiplier 3 no bfd echo isis network point-to-point ! interface Vlan11 !<<<Interface towards adjacent ASR 901 ip router isis agg-acc mpls ldp igp sync delay 10 bfd interval 50 min_rx 50 multiplier 3 isis network point-to-point ! router isis agg-acc fast-reroute per-prefix level-1 all fast-reroute remote-lfa level-1 mpls-ldp bfd all-interfaces ! remotelfa-frr enable no l3-over-l2 flush buffers ! mpls ldp discovery targeted-hello accept ! !
ASR 903 Example

cef table output-chain build favor memory-utilization FRR interface TenGigabitEthernet0/0/0 ASR 903 description To PAN-903-K1402::TenGigabitEthernet0/0/0 ip router isis agg-acc mpls ldp igp sync delay 10 bfd interval 50 min_rx 50 multiplier 3 no bfd echo isis network point-to-point ! interface TenGigabitEthernet0/1/0 ASR 9000 description To AGN-K0301::T0/0/0/2 ip router isis agg-acc mpls ldp igp sync delay 10 bfd interval 50 min_rx 50 multiplier 3 no bfd echo isis circuit-type level-2-only isis network point-to-point ! interface BDI10 downstream ASR 901 description To K1314::Gi0/10 ip router isis agg-acc mpls ldp igp sync delay 10 bfd interval 50 min_rx 50 multiplier 3 no bfd echo isis network point-to-point !<<<Optimizes ASR 903 for LFA
!<<<Interface towards adjacent
!<<<Interface towards upstream
!<<<Interface towards
6-2
SDU-6516
Chapter 6
High Availability
CISCO CONFIDENTIAL
! router isis agg-acc fast-reroute per-prefix level-1 all fast-reroute remote-lfa level-1 mpls-ldp bfd all-interfaces ! remotelfa-frr enable no l3-over-l2 flush buffers ! mpls ldp discovery targeted-hello accept ! !
The ASR 9000 and CRS-3 currently support LFA FRR, with remote LFA FRR support expected in XR 4.3.1. A workaround for ring support, involving a statically-configured MPLS-TE FRR tunnel implemented between routers, is shown below. The example illustrates the tunnel between core ABR routers, but the same configuration could be utilized between ASR 9000 aggregation nodes as well. MTG K1501
router isis core interface TenGigE0/0/0/0 circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point link-down fast-detect address-family ipv4 unicast fast-reroute per-prefix mpls ldp sync ! ! mpls ldp router-id 100.111.15.1 discovery targeted-hello accept ! interface TenGigE0/0/0/0 ! !
!<<<Interface to K0201 Ten0/0/0/0
Core Node K0201

explicit-path name TAKETHISPATH index 1 next-address strict ipv4 unicast 100.111.4.1 index 2 next-address strict ipv4 unicast 100.111.12.1 ! interface Loopback0 ipv4 address 100.111.2.1 255.255.255.255 ! interface tunnel-te212 ipv4 unnumbered Loopback0 autoroute announce destination 100.111.12.1 path-option 1 explicit name TAKETHISPATH logging events link-status ! router isis core address-family ipv4 unicast mpls traffic-eng level-1-2 mpls traffic-eng router-id Loopback0 interface TenGigE0/0/0/0 circuit-type level-2-only bfd minimum-interval 15
SDU-6516
6-3
Chapter 6
High Availability
CISCO CONFIDENTIAL
bfd multiplier 3 bfd fast-detect ipv4 point-to-point link-down fast-detect address-family ipv4 unicast fast-reroute per-prefix mpls ldp sync interface HundredGigE0/1/0/0 circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point link-down fast-detect address-family ipv4 unicast fast-reroute per-prefix level 2 fast-reroute per-prefix exclude interface TenGigE0/0/0/0 fast-reroute per-prefix exclude interface TenGigE0/0/0/1 fast-reroute per-prefix exclude interface TenGigE0/0/0/3 fast-reroute per-prefix lfa-candidate interface tunnel-te212 mpls ldp sync ! ! ! mpls traffic-eng interface TenGigE0/0/0/3 bfd fast-detect ! interface HundredGigE0/1/0/0 bfd fast-detect ! ! mpls ldp router-id 100.111.2.1 igp sync delay 10 ! interface tunnel-te212 ! interface TenGigE0/0/0/0 ! interface TenGigE0/0/0/1 ! interface TenGigE0/0/0/3 ! interface HundredGigE0/1/0/0 igp sync delay 5
Core ABR K1201

router isis core address-family ipv4 unicast mpls traffic-eng level-1-2 mpls traffic-eng router-id Loopback0 ! interface TenGigE0/0/0/0 circuit-type level-2-only bfd minimum-interval 15 bfd multiplier 3 bfd fast-detect ipv4 point-to-point link-down fast-detect address-family ipv4 unicast mpls ldp sync ! ! ! mpls traffic-eng
6-4
SDU-6516
Chapter 6
High Availability 6.1.2 BGP Fast Reroute
CISCO CONFIDENTIAL
interface TenGigE0/0/0/0 bfd fast-detect ! interface TenGigE0/0/0/5 bfd fast-detect ! ! mpls ldp router-id discovery ! interface ! interface !
100.111.12.1 targeted-hello accept TenGigE0/0/0/0 TenGigE0/0/0/5
Note
A ring with an odd number of nodes would require two MPLS TE-FRR tunnels to implement this workaround. Again, the need for any statically-defined tunnels will be eliminated with XR 4.3.1.
6.1.2 BGP Fast Reroute

BGP Fast Reroute (FRR) provides deterministic network reconvergence, even with the BGP prefix scale encountered in UMMT 3.0. BGP FRR is similar to remote LFA FRR in that it pre-calculates a backup path for every prefix in the BGP forwarding table, relying on a hierarchical Kabeled-FIB (LFIB) structure to allow for multiple paths to be installed for a single BGP next hop. BGP FRR consists of two different functions: core and edge. Each function handles different failure scenarios within the transport network: FRR core protection is used when the BGP next-hop is still active, but there is a failure in the path to that next hop. As soon as the IGP has reconverged, the pointer in BGP is updated to use the new IGP next hop and forwarding resumes. Thus, the reconvergence time for BGP is the same as the IGP reconvergence, regardless of the number of BGP prefixes in the RIB. Edge protection and FRR edge protection is used for redundant BGP next-hop nodes, as in the case with redundant ABRs. BGP additional-paths functionality is configured on the PE routers and RRs to install both ABR nodes' paths in the RIB and LFIB instead of just the best path. When there is a failure of the primary ABR, BGP forwarding simply switches to the path of the backup ABR instead of having to wait for BGP to reconverge at the time of the failure. The following example illustrates how to configure BGP FRR Core and Edge Protection from the MTG to the CSG across the reference topology: Mobile Transport Gateway K1501
router bgp 1000 address-family ipv4 unicast additional-paths receive additional-paths selection route-policy add-path-to-ibgp ! address-family vpnv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! route-policy add-path-to-ibgp set path-selection backup 1 install end-policy
SDU-6516
6-5
Chapter 6 6.1.3 Multihop BFD for BGP
High Availability
CISCO CONFIDENTIAL
router bgp 1000 address-family ipv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! address-family vpnv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! route-policy add-path-to-ibgp set path-selection backup 1 advertise install end-policy
Core ABR K0601

router bgp 1000 address-family ipv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! route-policy add-path-to-ibgp set path-selection backup 1 advertise install end-policy
Core ABR K1001

router bgp 1000 address-family ipv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! route-policy add-path-to-ibgp set path-selection backup 1 advertise install end-policy
PAN 903 K1401

cef table output-chain build favor convergence-speed 903 for BGP FRR router bgp 1000 address-family ipv4 bgp redistribute-internal bgp additional-paths receive !<<< This command optimizes ASR
CSG 901 K1314

router bgp 101 address-family ipv4 bgp additional-paths install
6.1.3 Multihop BFD for BGP

BFD multihop (BFD-MH) is a BFD session between two addresses that are not on the same interface. An example of BFD-MH is a BFD session between routers that are several TTL hops away. The first
6-6
SDU-6516
Chapter 6
High Availability
CISCO CONFIDENTIAL
application that makes use of BFD multihop is BGP. BFD multihop supports BFD on arbitrary paths, which can span multiple network hops. The BFD-MH feature provides sub-second forwarding failure detection for a destination more than one hop, and up to 255 hops, away.
Note
For IOS-XR based devices, the following command is needed to enable at least one linecard for the underlying mechanism used to send and receive multihop packets:
bfd multipath include location 0/0/CPU0
For IOS-based devices, this is not needed. In the example below, BFD session is created between CSG-K1323 and PAN-K1403/K1404.
Figure 6-1.
Multihop BFD Topology
CSG-901-K1323#
key chain mhop-key key 0 key-string cisco123 key 1 key-string cisco456 key chain mhop-key-xyz key 0 key-string cisco key 1 key-string lab key 2
SDU-6516
6-7
Chapter 6 6.2 Service High Availability
High Availability
CISCO CONFIDENTIAL
key-string lab1 ! ! bfd map ipv4 100.111.14.3/32 100.111.13.23/32 MBFD1 bfd map ipv4 100.111.14.4/32 100.111.13.23/32 MBFD1 bfd-template multi-hop MBFD1 interval min-tx 50 min-rx 50 multiplier 3 authentication sha-1 keychain mhop-key router bgp 1000 neighbor 100.111.14.3 fall-over bfd neighbor 100.111.14.4 fall-over bfd !
PAN-903-K1403#
key chain mhop-key key 0 key-string cisco123 key 1 key-string cisco456 key chain mhop-key-xyz key 0 key-string cisco key 1 key-string lab key 2 key-string lab1 ! bfd map ipv4 100.111.13.23/32 100.111.14.3/32 MBFD1 bfd-template multi-hop MBFD1 interval min-tx 50 min-rx 50 multiplier 3 authentication sha-1 keychain mhop-key router bgp 1000 neighbor 100.111.13.23 fall-over bfd !
6.2 Service High Availability

In addition to the technologies implemented at the Transport Network layer to provide High Availability functionality, there are technologies implemented at the Service layer as well. For MPLS VPN services, BGP Edge protection and BGP FRR Edge protection mechanisms are supported, and VRRP is enabled on the MTGs for redundant connectivity to the MPC. For ATM and TDM pseudowire-based services, pseudowire redundancy is supported, and Multi-Router Automatic Protection Services (MR-APS) is enabled for redundant connectivity to the BSC or RNC. The protection mechanisms for each service are described in the corresponding section below.
6.2.1 MPLS VPN- BGP FRR Edge Protection and VRRP

As described in the Transport Network High Availability section, BGP Fast Reroute (FRR) provides deterministic network reconvergence, even with the BGP prefix scale encountered in UMMT 3.0. BGP FRR Edge functionality is supported at the MPLS VPN service level as well as the transport network level. The following example illustrates how to configure BGP FRR Edge from the MTG to the CSG across the reference topology:
6-8
SDU-6516
Chapter 6
High Availability
CISCO CONFIDENTIAL
Note
Note that the the VRF configuration under the BGP process uses a unique route-descriptor per MTG. This unique route descriptor (RD) configuration in each MTG, combined with the BGP and VRRP timer adjustments in MTG 1, enables the ability for the rest of the transport infrastructure to optimize MPLS VPN protection via BGP FRR. This RD does not have to match the route-target defined for the MPLS VPN VRF. The need for this unique RD will be eliminated once support for "bgp additionalpaths receive" is implemented for BGP vpnv4 address-family configuration, thus allowing for multiple MTG information to be propagated for the MPLS VPN. Mobile Transport Gateway 1 VRRP Configuration
router vrrp interface TenGigE0/0/0/2.1100 delay minimum 1 reload 240 address-family ipv4 vrrp 110 priority 254 preempt delay 900 timer msec 100 force address 115.1.23.1 ! ! address-family ipv6 vrrp 100 priority 254 preempt delay 900 timer msec 100 force address global 2001:115:1:23::1 address linklocal autoconfig ! !
BGP FRR Edge Configuration

router bgp 1000 address-family vpnv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! vrf LTE2 rd 1111:1111 ! route-policy add-path-to-ibgp set path-selection backup 1 install end-policy
Mobile Transport Gateway 2 VRRP Configuration

router vrrp interface TenGigE0/0/0/2.1100 delay minimum 1 reload 240 address-family ipv4 vrrp 110 priority 253 timer msec 100 force address 115.1.23.1
SDU-6516
6-9
Chapter 6 6.2.2 Pseudowire Redundancy for ATM and TDM services
High Availability
CISCO CONFIDENTIAL
! ! address-family ipv6 vrrp 100 priority 253 timer msec 100 force address global 2001:115:1:23::1 address linklocal autoconfig ! !
BGP FRR Edge Configuration

router bgp 1000 address-family vpnv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! vrf LTE2 rd 1111:2222 ! route-policy add-path-to-ibgp set path-selection backup 1 install end-policy

router bgp 1000 address-family vpnv4 unicast additional-paths receive additional-paths send additional-paths selection route-policy add-path-to-ibgp ! route-policy add-path-to-ibgp set path-selection backup 1 advertise install end-policy
CSG 901 K1314

router bgp 101 address-family vpnv4 bgp additional-paths install
6.2.2 Pseudowire Redundancy for ATM and TDM services

High availability for ATM and TDM services transported via Circuit Emulation over Packet pseudowires is achieved through pseudowire redundancy over the transport network, where a backup pseudowire pointing to an alternate MTG is configured for each primary pseudowire. Corresponding to these redundant pseudowires is MR-APS functionality on the ATM/TDM side of the MTGs, which provides redundant ATM/TDM connectivity to the Mobile Packet Core equipment. Configuration of both technologies are illustrated below.
TDM Services
6-10
SDU-6516
Chapter 6
High Availability
CISCO CONFIDENTIAL
Figure 6-2.
CESoPSN/SAToP Service Implementation for 2G and 3G Backhaul
ASR 901 Cell Site Gateway Configuration Note that the only difference between CESoPSN and SAToP configuration is the lack of "controlword" in the pseudowire-class for SAToP configs.
pseudowire-class CESoPSN encapsulation mpls control-word ! ! interface CEM0/0 cem 0 xconnect 100.111.15.1 13261501 encapsulation mpls pw-class CESoPSN backup peer 100.111.15.2 13261502 pw-class CESoPSN ! interface Loopback0 ip address 100.111.13.26 255.255.255.255 isis tag 10 !
ASR 9000 Mobile Transport Gateway 1 Configuration

aps group 1 timers 10 15 channel 0 remote 100.111.15.2 channel 1 local SONET0/2/1/0 ! ! controller SONET0/2/1/0 description To BSC ais-shut report lais report lrdi sts 1 mode vt15-t1 delay trigger 250 ! clock source line ! controller T1 0/2/1/0/1/1/3 cem-group framed 0 timeslots 1-24 forward-alarm AIS forward-alarm RAI ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.1 255.255.255.255 ! l2vpn ! pw-class CESoPSN encapsulation mpls control-word
SDU-6516
6-11
Chapter 6
High Availability
CISCO CONFIDENTIAL
! ! xconnect group TDM-K1326 p2p T1-CESoPSN-01 interface CEM0/2/1/0/1/1/3:0 neighbor 100.111.13.26 pw-id 13261501 pw-class CESoPSN ! ! ! !

aps group 1 revert 8 timers 10 15 channel 0 local SONET0/2/1/0 channel 1 remote 100.111.15.1 signaling sonet ! ! controller SONET0/2/1/0 description To ONS15454-K1410 OC3 port 4/1 ais-shut report lais report lrdi sts 1 mode vt15-t1 delay trigger 250 ! clock source line ! controller T1 0/2/1/0/1/1/3 cem-group framed 0 timeslots 1-24 forward-alarm AIS forward-alarm RAI ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.2 255.255.255.255 ! l2vpn ! pw-class CESoPSN encapsulation mpls control-word ! ! xconnect group TDM-K1326 p2p T1-CESoPSN-01 interface CEM0/2/1/0/1/1/3:0 neighbor 100.111.13.26 pw-id 13261502 pw-class CESoPSN ! ! ! !
ATM Services
This example illustrates ATM PW redundancy for a clear-channel implementation. The same configurations would be used for an IMA implementation as well, just using ATM IMA interfaces instead.
6-12
SDU-6516
Chapter 6
High Availability
CISCO CONFIDENTIAL
Figure 6-3.
ASR 903 Pre Aggregation Node Configuration

interface ATM0/5/2.100 point-to-point pvc 100/4011 l2transport encapsulation aal0 xconnect 100.111.15.1 1401150115 encapsulation mpls backup peer 100.111.15.2 1401150215 ! ! interface Loopback0 ip address 100.111.14.1 255.255.255.255 ! !

aps group 2 channel 0 remote 100.111.15.2 channel 1 local SONET0/2/3/0 ! controller SONET0/2/3/0 path delay trigger 250 ! interface ATM0/2/3/0.100 l2transport pvc 100/4011 encapsulation aal0 ! ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.1 255.255.255.255 ! l2vpn pw-class ATM encapsulation mpls ! ! xconnect group ATM-K1401 p2p T1-ATM-01 interface ATM0/2/3/0.100 neighbor 100.111.14.1 pw-id 1401150115 pw-class ATM ! ! !

aps group 2 revert 8 channel 0 local SONET0/2/3/0 channel 1 remote 100.111.15.1
SDU-6516
6-13
Chapter 6
High Availability
CISCO CONFIDENTIAL
signaling sonet ! controller SONET0/2/3/0 path delay trigger 250 ! ! interface Loopback0 description Global Loopback ipv4 address 100.111.15.2 255.255.255.255 ! l2vpn pw-class ATM encapsulation mpls ! ! xconnect group ATM-K1401 p2p T1-ATM-01 interface ATM0/2/3/0.100 neighbor 100.111.14.1 pw-id 1401150215 pw-class ATM ! ! !
6-14
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Quality of Service
The UMMT System uses a DiffServ QoS model across across all network layers of the transport network to guarantee proper treatment of all services being transported. This QoS model guarantees the SLA requirements of TDM circuits, ATM Classes of Service, and various LTE QCI values that correspond to different traffic types (voice, video, etc.) with varying resource types (CBR, VBR-RT, VBR-NRT, and UBR for ATM; GBR or non-GBR for LTE). Note that IEEE 1588v2 PTP traffic is marked with DSCP of 46 by the grandmaster, and thus receives EF PHB treatment across the transport network. QoS policy enforcement is accomplished with flat QoS policies with DiffServ queuing on all NNIs, and H-QoS policies with parent shaping and child queuing on the UNIs and interfaces connecting to microwave access links. The classification criteria used to implement the DiffServ PHBs is covered in the UMMT 3.0 Design Guide.
Figure 7-1.
QoS Enforcement Points
Note
In Figure 7-1, the following elements are called out: (a) H-QoS policy map on CSG UNIs. (b) H-QoS policy map on pre-aggregation NNI connecting microwave access network. (1), (2) Flat QoS policy map on CSG and pre-aggregation NNIs in fiber access network. (3) Flat QoS policy map on aggregation and core network NNIs. (4) Flat QoS policy map on ingress for ATM and TDM UNIs
Note
QoS for ATM circuits is currently supported only on the ASR 9000. All ATM traffic on the ASR 901 and ASR 903 is currently receives default markings of EXP 0. QoS for ATM circuits on the ASR 901 and ASR 903 will be covered in a future release.
SDU-6516
7-1
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
Note
QoS service policies for TDM circuits is currently supported on the ASR 9000 and ASR 901. The ASR 903 currently implements a workaround which tags all TDM PW traffic with an EXP of 5. The ASR 901 currently has no workaround, and all traffic is marked with EXP of 0. Coverage for QoS service policies for TDM circuits on the ASR 901 and ASR 903 will be covered in a future release.
CSG QoS Configuration
Class Maps QoS classification at the UNI in the ingress direction for upstream traffic is based on IP DSCP with the marking done by the connected basestation.
class-map match-any CMAP-NMgmt-DSCP << Network management traffic match dscp cs7 ! class-map match-all CMAP-RT-DSCP << Voice/Real-Time traffic match dscp ef ! class-map match-any CMAP-HVideo-DSCP << Video traffic match dscp cs3
QoS classification at the UNI in the egress direction for downstream traffic is based on QoS groups with the QoS group mapping being done at the ingress NNI. QoS classification at the NNI in the egress direction is based on QoS groups, with: QoS group mapping for upstream traffic being done at the ingress UNI. QoS group mapping for traffic transiting the access ring being done at the ingress NNI.
class-map match-any match qos-group 7 ! class-map match-any match qos-group 6 ! class-map match-all match qos-group 5 ! class-map match-any match qos-group 3 CMAP-NMgmt-GRP << Network management traffic
CMAP-CTRL-GRP << Network Control traffic
CMAP-RT-GRP << Voice/Real-Time traffic
CMAP-HVideo-GRP << Video traffic
QoS classification at the NNI in the ingress direction is based on MPLS EXP.
class-map match-any CMAP-NMgmt-EXP << Network management traffic match mpls experimental topmost 7 ! class-map match-any CMAP-CTRL-EXP << Network Control traffic match mpls experimental topmost 6 ! class-map match-all CMAP-RT-EXP << Voice/Real-Time traffic match mpls experimental topmost 5 ! class-map match-any CMAP-HVideo-EXP << Video traffic match mpls experimental topmost 3
eNodeB UNI QoS Policy Map Upstream traffic: Flat QoS policy map with policing applied in the ingress direction.
7-2
SDU-6516
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
Downstream traffic: H-QoS policy map with parent shaper and child queuing applied in the egress direction.
interface GigabitEthernet0/2 << QoS enforcement point (a). Interface connecting eNodeB. service-policy output PMAP-eNB-UNI-P-E service-policy input PMAP-eNB-UNI-I ! ! policy-map PMAP-eNB-UNI-I class CMAP-RT-DSCP police cir 20000000 set qos-group 5 class CMAP-NMgmt-DSCP police 5000000 set qos-group 7 class CMAP-HVideo-DSCP police 100000000 set qos-group 3 class class-default police 200000000 ! ! policy-map PMAP-eNB-UNI-P-E class class-default shape average 425000000 service-policy PMAP-eNB-UNI-C-E ! policy-map PMAP-eNB-UNI-C-E class CMAP-RT-GRP priority percent 5 class CMAP-NMgmt-GRP bandwidth percent 1 class CMAP-HVideo-GRP bandwidth percent 25 class class-default
TDM CEM UNI QoS Policy Map

policy-map PMAP-TDM-UNI-I class class-default set qos-group 5 interface CEM0/0 service-policy input PMAP-TDM-UNI-I
Fiber Ring NNI QoS Policy Maps The model assume microwave system has ability to do DiffServ QoS that matches with CSG NNI EF and AF DiffServ classes. Downstream and transit traffic: Flat QoS policy map with group mapping applied in the ingress direction. Upstream and transit traffic: Flat QoS policy map with DiffServ queuing applied in the egress direction.
! interface GigabitEthernet0/10 << QoS enforcement point (1). Interface connecting Fiber Access Ring. service-policy input PMAP-NNI-I service-policy output PMAP-NNI-E hold-queue 1500 in
SDU-6516
7-3
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
hold-queue 1500 out ! ! policy-map PMAP-NNI-I class CMAP-RT-EXP set qos-group 5 class CMAP-NMgmt-EXP set qos-group 7 class CMAP-CTRL-EXP set qos-group 6 class CMAP-HVideo-EXP set qos-group 3 class class-default ! ! policy-map PMAP-NNI-E class CMAP-RT-GRP priority percent 20 class CMAP-NMgmt-GRP bandwidth percent 5 class CMAP-CTRL-GRP bandwidth percent 2 class CMAP-HVideo-GRP bandwidth percent 50 class class-default
Note
The RT traffic mapped to LLQ is implicitly policed at rate configured. Microwave Ring NNI QoS Policy Maps The model assume microwave system has ability to do DiffServ QoS that matches with CSG NNI EF and AF DiffServ classes. Downstream and transit traffic: H-QoS policy map with parent shaper and child queuing applied in the UNI egress direction. MPLS EXP classification for CSN ring local traffic need MPLS explicit-null (mpls ldp explicit-null) over all CSN routers. MPLS EXP must be marked indirectly by marking qosgroup on ingress. QoS classification at the UNI in the egress direction for downstream traffic is based on QoS groups with the QoS group mapping being done at the ingress NNI. Upstream and transit traffic: QoS policy map with DiffServ queuing based on QoS groups, with: QoS group mapping for upstream traffic being done at the ingress UNI. QoS group mapping for traffic transiting the access ring being done at the ingress NNI.
policy-map PMAP-eNB-UNI-I class CMAP-RT-DSCP police cir 20000000 set qos-group 5 class CMAP-NMgmt-DSCP police 5000000 set qos-group 7 class CMAP-HVideo-DSCP police 100000000 set qos-group 3 class class-default police 200000000 !
7-4
SDU-6516
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
! policy-map PMAP-eNB-UNI-C-E class CMAP-RT-GRP priority percent 5 class CMAP-NMgmt-GRP bandwidth percent 1 class CMAP-HVideo-GRP bandwidth percent 25 class class-default ! policy-map PMAP-eNB-UNI-P-E class class-default shape average 350000000 service-policy PMAP-eNB-UNI-C-E ! ! policy-map PMAP-NNI-I class CMAP-RT-EXP set qos-group 5 class CMAP-NMgmt-EXP set qos-group 7 class CMAP-CTRL-EXP set qos-group 6 class CMAP-HVideo-EXP set qos-group 3 class class-default ! ! policy-map PMAP-NNI-E class CMAP-RT-GRP priority percent 20 class CMAP-NMgmt-GRP bandwidth percent 5 class CMAP-CTRL-GRP bandwidth percent 2 class CMAP-HVideo-GRP bandwidth percent 50 class class-default
Pre-Aggregation Node QoS Configuration
Class Maps QoS classification at the UNI in the ingress direction for upstream traffic is based on IP DSCP with the marking done by the connected basestation.
class-map match-any CMAP-NMgmt-DSCP << Network management traffic match dscp cs7 ! class-map match-all CMAP-RT-DSCP << Voice/Real-Time traffic match dscp ef ! class-map match-any CMAP-HVideo-DSCP << Video traffic match dscp cs3
QoS classification at the NNIs is based on MPLS EXP.

class-map match-any CMAP-NMgmt-EXP << Network management traffic match mpls experimental topmost 7 ! class-map match-any CMAP-CTRL-EXP << Network Control traffic match mpls experimental topmost 6 ! class-map match-all CMAP-RT-EXP << Voice/Real-Time traffic match mpls experimental topmost 5 !
SDU-6516
7-5
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
class-map match-any CMAP-HVideo-EXP << Video traffic match mpls experimental topmost 3
Microwave Access NNI QoS Policy Map Downstream traffic: H-QoS policy map with parent shaper and child queuing applied in the egress direction to 1G interface connecting microwave access. The 1G interface is shaped to 400Mbps microwave link capacity. ASR 903-based Pre-Aggregation Node
interface GigabitEthernet0/22 << QoS enforcement point (b). Interface connecting uWave Access Network. service-policy output PMAP-uW-NNI-P-E
policy-map PMAP-NNI-uw-C-E class CMAP-RT-EXP priority class CMAP-CTRL-EXP bandwidth remaining ratio 1 class CMAP-NMgmt-EXP bandwidth remaining ratio 2 class CMAP-HVideo-EXP bandwidth remaining ratio 3 class class-default ! policy-map PMAP-NNI-uw-P-E class class-default shape average 400M service-policy PMAP-NNI-uw-C-E
ME3800X-based Pre-Aggregation Node

interface GigabitEthernet0/22 << QoS enforcement point (b). Interface connecting uWave Access Network. service-policy output PMAP-uW-NNI-P-E ! policy-map PMAP-NNI-uw-C-E class CMAP-RT-EXP priority police 80m class CMAP-NMgmt-EXP bandwidth 10000 class CMAP-HVideo-EXP bandwidth 80000 class class-default ! policy-map PMAP-NNI-uw-P-E class class-default shape average 400M service-policy PMAP-NNI-uw-C-E
Fiber Access NNI QoS Policy Map Downstream traffic: Flat QoS policy map with DiffServ queuing applied in the egress direction on the pre-aggregation NNI facing the 1G fiber access network. ME3800X-based Pre-Aggregation Node
! interface GigabitEthernet0/1 << QoS enforcement point (2). Interface connecting Fiber Access Node.
7-6
SDU-6516
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
service-policy output PMAP-PreAG-NNI-E end ! policy-map PMAP-PreAG-NNI-E class CMAP-RT-EXP priority police cir 200000000 class CMAP-CTRL-EXP bandwidth 15000 class CMAP-NMgmt-EXP bandwidth 50000 class CMAP-HVideo-EXP bandwidth 200000 class class-default
ASR 903-based Pre-Aggregation Node All other configuration details not detailed below are the same as the ME3800X example shown above.
policy-map PMAP-NNI-E class CMAP-RT-EXP priority class CMAP-CTRL-EXP bandwidth remaining ratio 1 class CMAP-NMgmt-EXP bandwidth remaining ratio 2 class CMAP-HVideo-EXP bandwidth remaining ratio 3 class class-default
Aggregation NNI QoS Policy Map Upstream and transit traffic: Flat QoS policy map with DiffServ queuing applied in the egress direction on the pre-aggregation NNI facing the 10G aggregation network.
! interface TenGigabitEthernet0/1 << QoS enforcement point (3). Interface connecting Aggregation Network. service-policy output PMAP-NNI-E end ! policy-map PMAP-NNI-E class CMAP-RT-EXP police cir 1000000000 priority class CMAP-CTRL-EXP bandwidth 150000 class CMAP-NMgmt-EXP bandwidth 500000 class CMAP-HVideo-EXP bandwidth 2000000 class class-default
Aggregation and Core Network QoS Configuration
Class Maps QoS classification at the NNIs is based on MPLS EXP.

class-map match-any CMAP-RT-EXP match mpls experimental topmost 5
SDU-6516
7-7
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
end-class-map ! class-map match-any CMAP-CTRL-EXP match mpls experimental topmost 6 end-class-map ! class-map match-any CMAP-NMgmt-EXP match mpls experimental topmost 7 end-class-map ! class-map match-any CMAP-HVideo-EXP match mpls experimental topmost 3 end-class-map
NNI QoS Policy Maps (3) Flat QoS policy map with DiffServ queuing applied at all NNIs.
policy-map PMAP-NNI-E class CMAP-RT-EXP priority level 1 police rate 1000000000 bps ! ! class CMAP-CTRL-EXP bandwidth 150000 kbps ! class CMAP-NMgmt-EXP bandwidth 500000 kbps ! class CMAP-HVideo-EXP bandwidth 2000000 kbps ! class class-default ! end-policy-map
MTG Configuration for ATM and TDM UNIs
Class Maps The only ingress marking to match is the ATM Cell Loss Priority (CLP) bit on ATM UNIs, which indicates a discard preference for marked cells within a particular ATM Class of Service (CoS). This can be utilized to offer a bursting capability in a particular ATM CoS.
class-map match-any CMAP-ATM-CLP0-UNI-I match atm clp 0 end-class-map ! class-map match-any CMAP-ATM-CLP1-UNI-I match atm clp 1 end-class-map
ATM UNI QoS Policy Maps Shown are two ATM policy maps. The first corresponds to an ATM VBR-RT service, where cells are marked with a CLP of 1 above a certain cell rate. The second corresponds to an ATM UBR service, again where cells are marked with a CLP of 1 above a certain cell rate. The proper map is applied to an ATM PVC which corresponds to the ATM CoS carried on that PVC.
policy-map PMAP-ATM-UNI-I class CMAP-ATM-CLP0-UNI-I set mpls experimental imposition 5
7-8
SDU-6516
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
! class CMAP-ATM-CLP1-UNI-I set mpls experimental imposition 4 ! class class-default ! end-policy-map ! policy-map PMAP-ATM-UNI-DATA-I class CMAP-ATM-CLP0-UNI-I set mpls experimental imposition 4 ! class CMAP-ATM-CLP1-UNI-I set mpls experimental imposition 0 ! class class-default ! end-policy-map ! interface ATM0/2/3/0 load-interval 30 ! interface ATM0/2/3/0.100 l2transport pvc 100/4011 service-policy input PMAP-ATM-UNI-I encapsulation aal0 shape vbr-rt 20000 14000 7000 ! ! interface ATM0/2/3/0.101 l2transport pvc 100/4012 service-policy input PMAP-ATM-UNI-DATA-I shape ubr 40000 ! !
TDM UNI QoS Policy Map The TDM UNI policy map simply marks all traffic on a CEM interface with an MPLS EXP of 5, to ensure that all traffic associated with the CEM interface is given EF treatment. This ensures that the emulated TDM circuit is transported with minimum Packet Delay Variation (PDV) to guarantee the quality of the TDM circuit.
policy-map PMAP-TDM-UNI-I class class-default set mpls experimental imposition 5 ! end-policy-map ! interface CEM0/2/1/0/1/4/4 service-policy input PMAP-TDM-UNI-I load-interval 30 l2transport ! !
SDU-6516
7-9
Chapter 7
Quality of Service
CISCO CONFIDENTIAL
7-10
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Operations, Administration, and Maintenance

This chapter includes the following major topic: Section 8.1 IP SLA Implementation This section describes the Operations, Administration, and Maintenance (OAM) and Performance Management (PM) implementation for mobile RAN service transport in the UMMT System.
Figure 8-1.
OAM implementation for Mobile RAN Service Transport
Service OAM Implementation for LTE and 3G IP UMTS RAN Transport with MPLS Access
OAM and PM functions were validated between the following pairs of devices (initiator listed first, responder listed second): CSG to CSG, to monitor the performance of the microwave link connecting the two CSGs in the access network ring. PAN to CSG, to monitor the performance of the access network.
SDU-6516
8-1
Chapter 8
CISCO CONFIDENTIAL
MTG to PAN, to monitor the performance of the aggregation and core networks.
Note
CSG to MTG OAM and PM functions were validated in UMMT 1.0, and may be found in the documentation for that release. The following OAM and PM functions are enabled on the initiator and responder in each case: IP ping and traceroute operations for LTE deployment with native IP/MPLS support. VRF-aware IP ping operations for connectivity check for LTE deployment with MPLS VPNs. IP SLA responder enabled on responder only for both native IP/MPLS and MPLS VPN deployments. IP SLA UDP Echo Probes configured on initiator for round trip time (RTT) measurement. IP SLA UDP Jitter Probe configured on initiator for one-way latency, packet loss, and packet delay variation measurement.
Service OAM Implementation for ATM and TDM Circuit Emulation Pseudowires for 2G and 3G RAN Transport
OAM and PM functions were validated between the following pairs of devices (initiator listed first, responder listed second): MTG to PAN, to monitor the performance of the aggregation and core networks for ATM and TDM PWs. MTG to CSG, to monitor the performance of the access, aggregation, and core networks for TDM PWs. The following OAM and PM functions are enabled on the initiator and responder in each case: MPLS Pseudowire ping and traceroute operations for connectivity check for ATM and TDM PWs. IP SLA responder enabled on responder for both ATM and TDM PW deployments. Loopback address of node is used for IP SLA measurements. IP SLA UDP Echo Probes configured on initiator for round trip time (RTT) measurement. IP SLA UDP Jitter Probe configured on initiator for one-way latency, packet loss, and packet delay variation measurement.
Transport OAM
The MPLS transport for mobile backhaul is based on the unified MPLS approach. The unified MPLS deployment approach allows for end-to-end LSPs to be built between the RAN access domain or PAN and the centralized MTG in the MPC: IP ping and traceroute operations for verifying data plane against control plane, and isolating faults within the inter-domain LSP in the MPLS/IP network between the CSGs or PANs and the MTG. MPLS LSP ping and traceroute operations for verifying data plane against control plane, and isolating faults within the intra-domain LSPs in the access, aggregation, and core domains. MPLS LSP ping and traceroute operations for inter-domain LSPs will be supported in a future release.
8-2
SDU-6516
Chapter 8
Operations, Administration, and Maintenance 8.1 IP SLA Implementation
CISCO CONFIDENTIAL
8.1 IP SLA Implementation

IP SLA Responder Configuration
The CSG and PAN act as IP SLA responders for different measurement scenarios. Minimal configuration is required for enabling the responder function.
ip sla responder
Cell Site Gateway Initiator Configuration for IP SLA
The CSG is configured with IP SLA probes for initiating measurement of packet loss, packet delay, and packet delay variation (i.e., jitter) towards the PAN.
ip sla 1 udp-jitter 100.111.13.16 59000 num-packets 100 request-data-size 160 tos 96 verify-data frequency 30 ip sla schedule 1 life forever start-time now ip sla reaction-configuration 1 react rtt threshold-value 1 1 threshold-type immediate action-type trapOnly ip sla reaction-configuration 1 react jitterDSAvg threshold-value 1 1 threshold-type immediate action-type trapOnly ip sla logging traps ip sla enable reaction-alerts
Pre-Aggregation Node Initiator Configuration for IP SLA
The PAN is configured with IP SLA probes for initiating measurement of packet loss, packet delay, and packet delay variation (i.e., jitter) towards the CSG. It acts as a responder only to the MTG.
ip sla 1 udp-jitter 100.111.13.26 59000 num-packets 100 request-data-size 160 verify-data frequency 30 ip sla schedule 1 life forever start-time now ip sla 2 udp-jitter 113.31.23.1 13031 num-packets 100 request-data-size 160 tos 192 verify-data vrf LTE2 <<<< with vpn frequency 30 ip sla schedule 2 life forever start-time now ip sla reaction-configuration 1 react rtt threshold-value 1 1 threshold-type immediate action-type trapOnly ip sla reaction-configuration 1 react jitterDSAvg threshold-value 1 1 threshold-type immediate action-type trapOnly ip sla logging traps ip sla enable reaction-alerts
Mobile Transport Gateway Initiator Configuration for IP SLA
The MTG is configured with IP SLA probes for initiating measurement of packet loss, packet delay, and packet delay variation (i.e., jitter) towards the PAN.
SDU-6516
8-3
Chapter 8
CISCO CONFIDENTIAL
Note
The ToS values in IOS-XR are equal to 4x the desired DSCP value. Please refer to Chapter 7, Quality of Service for LTE QCI to DSCP mapping. VPN: Jitter Probes
operation 11 type udp jitter vrf CSN packet count 100 tos 184 << Real-Time (EF) Class destination address 113.2.1.1 destination port 58100 frequency 30 ! ! operation 12 type udp jitter vrf CSN packet count 100 tos 224 << Network Management Class destination address 113.2.1.1 destination port 58110 frequency 30 ! ! operation 13 type udp jitter vrf CSN packet count 100 tos 192 << Network Control Class destination address 113.2.1.1 destination port 58120 frequency 30 ! ! operation 14 type udp jitter vrf CSN packet count 100 tos 96 << Video Class destination address 113.2.1.1 destination port 58130 frequency 30 ! ! operation 15 type udp jitter vrf CSN packet count 100 tos 0 << Best Effort Class destination address 113.2.1.1 destination port 58140 frequency 30 ! ! schedule operation 11 start-time now life forever ! schedule operation 12 start-time now life forever ! schedule operation 13 start-time now
8-4
SDU-6516
Chapter 8
CISCO CONFIDENTIAL
life forever ! schedule operation 14 start-time now life forever ! schedule operation 15 start-time now life forever !
VPN: Echo Probes

operation 16 type udp echo vrf CSN tos 184 destination address 113.2.1.1 destination port 58150 frequency 30 ! ! operation 17 type udp echo vrf CSN tos 224 destination address 113.2.1.1 destination port 58160 frequency 30 ! ! operation 18 type udp echo vrf CSN destination address 113.2.1.1 destination port 58170 frequency 30 ! ! operation 19 type udp echo vrf CSN tos 96 destination address 113.2.1.1 destination port 58180 frequency 30 ! ! operation 20 type udp echo vrf CSN tos 0 destination address 113.2.1.1 destination port 58190 frequency 30 ! ! schedule operation 16 start-time now life forever ! schedule operation 17 start-time now life forever ! schedule operation 18 start-time now life forever
SDU-6516
8-5
Chapter 8
CISCO CONFIDENTIAL
! schedule operation 19 start-time now life forever ! schedule operation 20 start-time now life forever
Global: Jitter Probes

! operation 21 type udp jitter packet count 100 tos 184 source address 100.111.11.1 source port 58201 destination address 100.111.13.19 destination port 58200 frequency 30 ! ! operation 22 type udp jitter packet count 100 tos 224 source address 100.111.11.1 source port 58211 destination address 100.111.13.19 destination port 58210 frequency 30 ! ! operation 23 type udp jitter packet count 100 tos 192 source address 100.111.11.1 source port 58221 destination address 100.111.13.19 destination port 58220 frequency 30 ! ! operation 24 type udp jitter packet count 100 tos 96 source address 100.111.11.1 source port 58231 destination address 100.111.13.19 destination port 58230 frequency 30 ! ! operation 25 type udp jitter packet count 100 tos 0 source address 100.111.11.1 source port 58241 destination address 100.111.13.19 destination port 58240 frequency 30 ! ! schedule operation 21
8-6
SDU-6516
Chapter 8
CISCO CONFIDENTIAL
start-time now life forever ! schedule operation start-time now life forever ! schedule operation start-time now life forever ! schedule operation start-time now life forever ! schedule operation start-time now life forever
22
23
24
25
Global: Echo Probes

! operation 26 type udp echo tos 184 source address 100.111.11.1 source port 56251 destination address 100.111.13.19 destination port 56250 frequency 30 ! ! operation 27 type udp echo tos 224 source address 100.111.11.1 source port 56261 destination address 100.111.13.19 destination port 56260 frequency 30 ! ! operation 28 type udp echo tos 192 source address 100.111.11.1 source port 56271 destination address 100.111.13.19 destination port 56270 frequency 30 ! ! operation 29 type udp echo tos 96 source address 100.111.11.1 source port 56281 destination address 100.111.13.19 destination port 56280 frequency 30 ! ! operation 30 type udp echo tos 0 source address 100.111.11.1 source port 56291 destination address 100.111.13.19
SDU-6516
8-7
Chapter 8
CISCO CONFIDENTIAL
destination port 56290 frequency 30 ! ! schedule operation 26 start-time now life forever ! schedule operation 27 start-time now life forever ! schedule operation 28 start-time now life forever ! schedule operation 29 start-time now life forever ! schedule operation 30 start-time now life forever ! end
Reaction Configuration The reaction configuration defines the thresholds for the previously configured probes, and the corresponding actions to be taken when those thresholds are exceeded. The following configuration shows a single example of a jitter probe reaction and an echo probe reaction.
reaction operation 11 << Jitter Probe react connection-loss action logging action trigger threshold type immediate ! react jitter-average dest-to-source action logging action trigger threshold type immediate threshold lower-limit 10 upper-limit 15 ! react jitter-average source-to-dest action logging action trigger threshold type immediate threshold lower-limit 10 upper-limit 15 ! react packet-loss dest-to-source action logging action trigger threshold type immediate threshold lower-limit 3 upper-limit 5 ! react packet-loss source-to-dest action logging action trigger threshold type immediate threshold lower-limit 3 upper-limit 5 ! react rtt action logging action trigger threshold type immediate threshold lower-limit 5 upper-limit 15
8-8
SDU-6516
Chapter 8
CISCO CONFIDENTIAL
! reaction operation 16 << Echo Probe react connection-loss action logging action trigger threshold type immediate ! react rtt action logging action trigger threshold type immediate threshold lower-limit 5 upper-limit 15
SDU-6516
8-9
Chapter 8
CISCO CONFIDENTIAL
8-10
SDU-6516
CISCO CONFIDENTIAL
CHAPTER
Related Documents
The UMMT Implementation Guide - Large Network, Multi-Area IGP Design with IP/MPLS Access is part of a set of resources that comprise the UMMT System documentation suite. The resources include: UMMT 3.0 System Brochure: At a Glance brochure of the Unified MPLS for Mobile Transport System (http://sdu.cisco.com/publications/viewdoc.php?docid=6472) UMMT 3.0 Design Guide: Provides detailed information about Cisco's UMMT 3.0 system architecture, components, service models, and implementation details. (http://sdu.cisco.com/ publications/viewdoc.php?docid=6432 UMMT Implementation Guide - Large Network, Multi-Area IGP Design with IP/MPLS Access: Implementation guide with configurations for a transport model where the network organization between the core and aggregation domains is based on a single autonomous system, multi-area IGP design. The model follows the approach of enabling Unified MPLS LSPs using hierarchical-labeled BGP LSPs across the core and aggregation network, and presents two approaches for extending the unified MPLS LSPs into the mobile RAN access domain. (http:// sdu.cisco.com/publications/viewdoc.php?docid=6516) UMMT Implementation Guide - Large Network, Inter-AS Design with IP/MPLS Access: This document. Implementation guide with configurations for a transport model where the core and aggregation networks are organized as different autonomous systems. The model follows the approach of enabling Unified MPLS LSPs using hierarchical labeled BGP LSPs based on iBGP labeled unicast within each AS, and eBGP labeled unicast to extend the LSP across AS boundaries. Two approaches are presented for extending the unified MPLS LSPs into the mobile RAN access domain. (http://sdu.cisco.com/publications/viewdoc.php?docid=6517) UMMT Implementation Guide - Large Network, Inter-AS Design with non-IP/MPLS Access: Implementation guide with configurations for a transport model where the core and aggregation networks are organized as different autonomous systems. The model follows the approach of enabling Unified MPLS LSPs using hierarchical labeled BGP LSPs based on iBGP labeled unicast within each AS, and eBGP labeled unicast to extend the LSP across AS boundaries. The model assumes a non-MPLS IP/Ethernet or TDM access where all mobile and potentially wireline services are enabled by the aggregation nodes. (http://sdu.cisco.com/ publications/viewdoc.php?docid=6518) UMMT Implementation Guide - Small Network, Integrated Core and Aggregation with IP/MPLS Access: Implementation guide with configurations for a transport model in a small network where the core and aggregation networks are integrated into a single IGP/LDP domain. The aggregation nodes have subtending mobile RAN access networks that are MPLS enabled,
SDU-6516
9-1
Chapter 9
Related Documents
CISCO CONFIDENTIAL
and the unified MPLS LSPs are extended into the access network using hierarchical-labeled BGP LSPs. (http://sdu.cisco.com/publications/viewdoc.php?docid=6519) UMMT Implementation Guide - NMS Testing: Implementation guide with integration of Cisco Prime to the UMMT 3.0 system. (http://sdu.cisco.com/publications/viewdoc.php?docid=6520)
9-2
SDU-6516

UMMT 3.0 Implementation Guide - Large Network Multi-Area IGP Design With IPMPLS Access Design and Implementation Guide

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

UMMT 3.0 Implementation Guide - Large Network Multi-Area IGP Design With IPMPLS Access Design and Implementation Guide

Uploaded by

Copyright:

Available Formats

CISCO CONFIDENTIAL

Cisco Validated Design

Unified MPLS Transport 3.1

Synchronization Distribution 5.1

Hybrid Model Configuration

High Availability 6.1

Operations, Administration, and Maintenance 8.1 IP SLA Implementation

Table i-1 Table i-2 Table 1-1 Table 5-1

Document Version and System Release

Table i-1 lists document version information.

Preface Document Organization

Describes and provides links for all UMMT 3.0-related collateral.

Obtaining Documentation, Obtaining Support, and Security Guidelines

UMMT Transport Models

Approaches for Extending the Unified MPLS LSP

Reference Topology - Large Network, Multi-Area IGP-based Design

Unified MPLS Transport

3.1 Multi-Area IGP Design with Labeled BGP Access

Chapter 3 3.1.1 Core Route Reflector Configuration

Unified MPLS Transport

3.1.1 Core Route Reflector Configuration

Unified MPLS Transport

Centralized Core Route Reflector (CN-RR)

Unified MPLS Transport

Unified MPLS Transport 3.1.2 Mobile Transport Gateway Configuration

community-set Deny_Transport_Community 10:10 end-set

3.1.2 Mobile Transport Gateway Configuration

Unified MPLS Transport

Mobile Transport Gateway (MTG)

Unified MPLS Transport

<<< BGP add-path to

<<< Color loopback prefix

Chapter 3 3.1.3 Core Area Border Router Configuration

Unified MPLS Transport

route-policy add-path-to-ibgp set path-selection backup 1 install end-policy

3.1.3 Core Area Border Router Configuration

Unified MPLS Transport

Core Area Border Router (CN-ABR)

Unified MPLS Transport

Unified MPLS Transport

! route-policy add-path-to-ibgp set path-selection backup 1 install end-policy

Chapter 3 3.1.4 Pre-Aggregation Node Configuration

Unified MPLS Transport

3.1.4 Pre-Aggregation Node Configuration

Pre-Aggregation Node (PAN)

<<< Loopback for core-agg IGP process

<<< Loopback for RAN IGP process

mpls ldp router-id Loopback0 force

! interface TenGigabitEthernet0/1 description To AG2-K0501 no switchport ip address 10.5.1.3 255.255.255.254

<<< Interface facing Core network

Unified MPLS Transport

Unified MPLS Transport

<<< IS-IS Level-1

<<< <<< RAN <<<

Option-2: IS-IS as RAN IGP Process

<<< IS-IS Level-1

Unified MPLS Transport

<<< RAN IGP <<< Peer

<<< Set NHS <<< send

! route-map AGG_Community permit 10

Chapter 3 3.1.5 Cell Site Gateway Configuration

Unified MPLS Transport

3.1.5 Cell Site Gateway Configuration

Cell Site Gateway (CSG)