KNOM Tutorial 2001

MPLS Traffic Engineering &

Management Issues
Taesang Choi
2001. 12. 7.
Internet Architecture Team
Electronics Telecommunications Research Institute
2
KNOM Tutorial 2001
Topics
MPLS-TE Basics
MPLS-TE Operational Issues
MPLS Management Issues
MPLS-TE Management Solutions
KNOM Tutorial 2001
MPLS-TE Basics
4
KNOM Tutorial 2001
What is Traffic Engineering?
The task of mapping traffic flows onto an existing
physical topology to facilitate efficient and reliable
network operations
Check mpls & tewg working group documents for more
well-versed definitions
Requirements for Traffic Engineering Over MPLS (RFC 2702)
A Framework for Internet Traffic Engineering (draft- ietf- tewg-
framework- 05.txt)
5
KNOM Tutorial 2001
Legacy Internet TE Efforts
IGP Metric-Based TE
Remember fish problem?
Drawbacks
>Blame Shifting: only serves to move problem around
>Lacks granularity
>Instability
Overlay Network Approach
ATM core ringed by routers & overlaid PVCs on top of it
Drawbacks
>Full mesh overhead
>Not well integrated
>Cell Tax
>ATM SAR speed
6
KNOM Tutorial 2001
MPLS-TE Advantages
The physical path of the traffic-engineered path is not
limited to what the IGP would choose as the shortest
path to reach the destination
Variously divisible traffic aggregation and
disaggregation
Maneuvering load distribution
Stand-by secondary paths and precomputed detouring
paths
Strongly unified measurement and control for each
traffic-engineered path
7
KNOM Tutorial 2001
Vocabulary
LSP (Label Switched Path)
the traffic-engineered path
Primary and Secondary Paths
an LSP can contain a primary path & zero or more secondary paths
Named Path
a sequence of explicit hops
LSP A
Pr i mar y Pat h
Secondar y Pat h
LSP B
Pr i mar y Pat h Secondar y Pat h
Named Pat h 1
Named Pat h 2
8
KNOM Tutorial 2001
Vocabulary contd
Traffic Trunk (TT)
an aggregation of traffic flows going from an ingress to an
egress
forwarded through a common path with common TE
requirements
characterized by
>its ingress and egress
>FEC which is mapped to it
>a set of attributes that determines its behavioral
characteristics
9
KNOM Tutorial 2001
Vocabulary contd
Types of LSPs
Static LSPs
>no relevance to TE
LDP signaled LSPs
>no relevance to TE
RSVP/CR-LDP signaled LSPs
>Explicit-path LSPs
>Constrained-path LSPs
>Note: both of the two above are not mutually exclusive!
10
KNOM Tutorial 2001
Components of MPLS-TE
Packet Forwarding Component
MPLS, label switching itself
Information Distribution Component
IGP (OSPF/IS-IS) extension
Path Selection Component
Constrained Shortest Path First (CSPF) algorithm
Signaling Component
LDP, CR-LDP, and RSVP-TE
Not all of these required!
11
KNOM Tutorial 2001
How everything fits into?
Li nk at t r i but es
Li nk at t r i but es
modi f i cat i on
RSVP si gnal i ng TED
LSP pat h s CSPF LSP at t r i but es
Rout i ng t abl e
advert ised by
I GP- ext ension
oper at or
i nput
comput es
st r uct ur ed as
r eser vat ion
LSP
est ablishment
t opology &
r esour ces
advert ised by
I GP- ext ension
12
KNOM Tutorial 2001
MPLS-TE Mechanisms
LSP Routing
with TE attributes (LSP & Link attributes)
dynamic vs. explicit
Traffic Protection (Resilience)
secondary paths and fast reroute
Path Reoptimization (Adaptivity)
Load Sharing and Balancing
LSP-level traffic bifurcation
LSP Hierarchy
forwarding adjacency LSPs, unnumbered links
KNOM Tutorial 2001
MPLS-TE Deployment and
Operational Issues
14
KNOM Tutorial 2001
MPLS-TE Deployment Issues
MPLS is proposed as a standard TE solution by IETF,
BUT
Vendor Interoperability problem
Limitation in online path calculation
Problems on Traffic Trunks
Measurement and Control Issues
15
KNOM Tutorial 2001
Interoperability
Vendor specific implementation details diverge!
Almost everything but signaling standard might be different
Using more than two heterogeneous families in a domain may
cause unpredictable operational problems
Need a unified abstraction system to hide, moderate,
and arbitrate the differences
16
KNOM Tutorial 2001
Limitation in Online Path Calc.
Online path calc. considers one LSP at a time
undeterministic
The order in which an LSP is calculated plays a critical role!
Global optimization required
Optimization tools that simultaneously examine each links
resource constraints and the requirements of each LSPs all
together are necessary
17
KNOM Tutorial 2001
Problems regarding to TT
How to define traffic trunks?
No standard
Manual classification
>requires TE policies
>granularity and scalability concern
>practically, only dest. prefix based classification supported
>requires, so called, policy routing
BGP-based classification
>Transit traffic whose route updates next_hop is identical to the
egress of an LSP are routed over the LSP
Implicit classification by IGP
18
KNOM Tutorial 2001
Problems regarding to TT contd
How to map a traffic trunks attributes onto LSPs
constraints?
need a global view
must be able to anticipate the effect, to some extent
must be able to rationalize
>by simulations
>by measurements
>by policies
>by intuition?
>by experience?
19
KNOM Tutorial 2001
Measurement and Control
Measurement
provides rationale and fundamental bases to induce proper TE
constraints for TTs and LSPs
>such as, traffic (demand) matrices, congestion indication,
LSP statistics, etc.
methods
>SNMP (various MIBs), CLI, Cisco Netflow and TMS, and/or
JUNOS MPLS Statistics, RTFM probes, etc.
Control
manages TE policies
>policy editing, conflict check, enforcement, withdrawal, etc.
>customized to service specific policies, such as VPN
policies
20
KNOM Tutorial 2001
MPLS-TE Operational Issues
Prohibitive costs for manual provisioning for multi-node
and multi-vendor environment
Longer educational curve
Single highly skilled operator or multiple vendor specific many
operators
Tighter and precise communications among them
Error-prone manual configuration and hard to detect the
semantic configuration errors (e.g., typos in path name)
LSP operations diagnosis (e.g., when LSP setup fails, it
is very difficult to pin point the exact reasons. The
system doesnt tell much useful info.)
21
KNOM Tutorial 2001
Configurable LSP Attributes
Can specify the following attributes either for each LSP or for each
path belonging to the LSP
bandwidth (traffic profile in CR-LDP)
constrained (dynamic) vs. explicit path
affinity
adaptivity
>reoptimize-timer, reoptimize-event
resilience
>(stand by) secondary paths, fast reroute
priority & preemption
>setup, hold
route record
hop-limit, cos, etc.
KNOM Tutorial 2001
Juniper Example
23
KNOM Tutorial 2001
Minimum MPLS Configuration
Required of transit routers, as well as the ingress and egress
[ edit ]
int erfaces {
int erface- name {
logical- unit - number {
family mpls; # r equi r ed t o enabl e MPLS on t hi s i nt f .
}
}
}
prot ocols {
mpls {
int erface ( int erface- name | all) ; # r equi r ed t o enabl e MPLS on t hi s i nt f .
}
r svp {
int erface int erface- name; # r equi r ed f or RSVP si gnal ed MPLS onl y
}
}
24
KNOM Tutorial 2001
Create a Named Path
Named Path
means a physical path from the ingress to the egress
Named Path and LSP
Configuring an LSP may require multiple named paths
>primary and secondaries
can specify the same named path on any number of LSPs
Syntax
[ edit pr ot ocols mpls]
pat h pat h- name {
addr ess | host name < st rict | loose> ;
}
25
KNOM Tutorial 2001
Create an LSP
Rough Syntax
[ edit prot ocols mpls]
label -swit ched- pat h lsp-pat h- name {
t o address; # egr ess addr ess
f r om address; # i ngr ess addr ess
# l ot s of st at ement s f or set t i ng v ar i ous LSP at t r i but es;
pr i mar y pat h -name {
# l ot s of st at ement s f or set t i ng v ar i ous pat h at t r i but es;
}
secondar y pat h -name {
# l ot s of st at ement s f or set t i ng v ar i ous pat h at t r i but es;
}
}
KNOM Tutorial 2001
Cisco Example
27
KNOM Tutorial 2001
Minimum MPLS Configuration
Required of transit routers, as well as the ingress and
egress
Turn on MPLS tunnels
Turn on CEF
Turn on IS-IS or OSPF
Syntax
>
>
>
>
>
>
>
28
KNOM Tutorial 2001
Create a Named Path
Named Path
means a physical path from the ingress to the egress
Named Path and LSP
Configuring an LSP may require multiple named paths
>primary and secondaries
can specify the same named path on any number of LSPs
Syntax
Router(config )# ipexplicit - path name path - c7204- m5 enable
Router(config )# next - address 10.2.0.29
Router(config )# next - address 10.2.0.34
Router(config )# next - address 10.2.0.33
29
KNOM Tutorial 2001
Create an LSP
Rough Syntax
Router(config)# interface tunnel 2003
Router(config- if)# description c7204- m402
Router(config- if)# ip unnumbered Loopback0
Router(config- if)# tunnel mode mpls traffic- engineering
Router(config- if)# tunnel destination 203.255.255.234
Router(config- if)# tunnel mpls traffic- eng autorouteannounce
Router(config- if)# tunnel mpls traffic- eng priority 7 7
Router(config- if)# tunnel mpls traffic- eng bandwidth 10000
Router(config- if)# tunnel mpls traffic- eng path- option 1 explicit name path - c7204- m5
Router(config- if)# tunnel mpls traffic- eng record- route
Router(config- if)# exit
Router(config)# router traffic- engineering
Router(config)# traffic- engineering filter 1 egress 10.14.0.111 255.255.255.255
Router(config)# router traffic- engineering
Router(config)# traffic- engineering route 1 tunnel 2003
30
KNOM Tutorial 2001
MPLS FCAPS
MPLS Configuration Management
Automating complex MPLS configuration rules (including TE
rules)
MPLS Fault Management
MPLS LSP status monitoring
MPLS Traffic Trunks/LSP fault analysis
Link/Node failure diagnosis
MPLS Performance Management
LSP traffic measurement and analysis
MPLS network global optimization
MPLS Accounting Management
Mapping measured traffic data into billing purpose
Mapping accounting data into admission control information
MPLS Security Management
31
KNOM Tutorial 2001
MPLS Service Management
SLA Provisioning & Monitoring management
General MPLS service (e.g., traffic trunk lease) SLA
Service specific MPLS service (e.g., MPLS VPN) SLA
Inter-domain MPLS Management
Protocol level distributed solution (e.g. inter-domain signaling
such as GMPLS) is one thing
and management of this mechanism from network
administrator viewpoint is another
Many issues are still left open
KNOM Tutorial 2001
MPLS TE Management Solutions
33
KNOM Tutorial 2001
TE Servers: Products Introduction
WANDL, Inc. - MPLSView
Automated data collection, layout, event collection and filtering
(mainly focused on pre-configured LSPs)
A quasi real-time view on the configuration of the network,
including LSP set-up & state and per-LSP traffic flow
Partnership with Cisco and Juniper
Makesystems, Inc. - NetMaker
Network engineering and simulation tool for IP and MPLS
Merged to OPNET Technologies, Inc.
Alcatel GRATE
ETRI - Wise<TE>
34
KNOM Tutorial 2001
VPN Servers: Products Introduction
Orchaestream
Ciscos VPN Solution Center
Dorado
ETRI - Wise<TE/VPN>
KNOM Tutorial 2001
Wise<TE/VPN>
36
KNOM Tutorial 2001
Wise<TE> addresses Questions
How are packets routed in our network, and how are routing
protocols configured ?
Why is this link so congested, while others are underutilized ?
Which path is the best fit for an LSP to serve a new VPN flow
without QoS degradation ?
Why is this LSPs operational / signaling state down?
How much would it be worse if this node (link) fails?
How much would it be better if our MPLS network is globally
optimized by recomputing all LSPs together?
Can we achieve some traffic engineering goals by global LSP
reoptimization, routing metric optimization, or a totally new capacity
planning process?
37
KNOM Tutorial 2001
How!
subnet
subnet
subnet
subnet
Area 1
Backbone Area
Area 2
TE/VPN Policies
Wise<TE>
MIB Values
IP, LSP & VPN Traffic
Measurement Results
Visualizing
Network, Routing &
VPN Topology
and Behavior
Enforcing
Routing, TE and
VPN Policies
Routing Protocol Info.
(TED)
Simulation
Logics
(CSPF, etc.)
TE Pat h ( LSP)
I GP Pat h
Operational Status
38
KNOM Tutorial 2001
Main Functionality
LSP / VPN Conf i gur at i on Management and Quasi - r eal t i me
Moni t or i ng
Ver sat i l e Vi ews of IP, MPLS, Rout i ng (OSPF and BGP), and VPN
Topol ogy
TE and VPN Pol i cy Management
IP Tr af f i c Measur ement and Anal ysi s f or MPLS- TE and VPN
Management
Int el l i gent Pat h Comput at i on, Recommendat i on, and Var i ous
Si mul at i ons
39
KNOM Tutorial 2001
Wise<TE> Architecture
Configur at ion
Package
Measur ement
Package
Gl obal
Conf i g
Package
Misc
Package
GUI
TMS
RMS
PS
RATE
CSI ( Common Ser vi ce I nt er f aces)
Pr ox y Agent
ACE2000
Ju n i p er
Rou t er
CI SCO
Rou t er
TMS
Agent
RMS
Agent
COPS
Agent
Junoscr i pt
Cl i ent
Ci sco
CLI
ACE
CLI
Measur ed
Tr af f i c Dat a
CORBA
OSPF/ BGP
CORBA CORBA
Tr af f i c
Measu r emen t
Resul t s
SNMP
Pol l i ng
Resul t s
TMS DB
RMS DB
PS DB PI B
CORBA
SNMP
CORBA
COPS
40
KNOM Tutorial 2001
Easy Steps to create LSP Tunnels and Easy Steps to create LSP Tunnels and VPNs VPNs
Configur at ion
Package
Measur ement
Package
Gl obal
Conf i g
Package
Misc
Package
PS
COPS
TMS
Agent
RMS
Agent
COPS
Agent
JunOS
CLI
Ci sco
CLI
Pr ox y Agent
ACE
CLI
ACE2000
Ju n i p er
Rou t er
CI SCO
Rou t er
CORBA
GUI
CLI / Tel n et
CORBA
41
KNOM Tutorial 2001
Versatile Topology Views: IP Versatile Topology Views: IP
IP Topology View
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
20 ~ 40
0 ~ 20
40 ~ 60
60 ~ 80
80 ~ 100
Link Utilization: %
L
V
42
KNOM Tutorial 2001
Versatile Topology Views: Versatile Topology Views:
MPLS View - LSP Tunnel Statistics
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
20 ~ 40
0 ~ 20
40 ~ 60
60 ~ 80
80 ~ 100
LSP Statistics: %
L
V
LSP Tunnel Intf: Tae-Suw-Seo,
600Mbps
MPLS LSP Traffic MPLS LSP Traffic
Per LSP Statistics
m10-to-m5 203.255.255.232
c7204-to-m10
m201-to-m5
m10-to-c7204
m5-to-m202
203.255.255.233
203.255.255.232
203.255.255.235
203.255.255.235
203.255.255.232
203.255.255.235
203.255.255.236
203.255.255.234
2344556
24980
47837593759
57843578
478593
BPS Egress Ingress LSP Name
203.255.255.236
Show Path OK
Help
43
KNOM Tutorial 2001
Versatile Topology Views: Versatile Topology Views:
MPLS Reserved MPLS Reserved Bw Bw
MPLS View - Reserved Bandwidth
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
20 ~ 40
0 ~ 20
40 ~ 60
60 ~ 80
80 ~ 100
Reserved Bw: %
L
V
44
KNOM Tutorial 2001
Versatile Topology Views: Versatile Topology Views:
MPLS Affinity MPLS Affinity
MPLS View - Affinity
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
2
1
3
4
5
Affinity: Colors
L
V
45
KNOM Tutorial 2001
Versatile Topology Views: Versatile Topology Views:
MPLS Link & Tunnels MPLS Link & Tunnels
MPLS View - Links and Tunnels
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
L
V
46
KNOM Tutorial 2001
Versatile Topology Views: Versatile Topology Views:
Routing Protocols Routing Protocols
Routing Protocol View - OSPF
+
-
A
V
P
V
L
V
AS64514: Area0
ABR
IGP: OSPF
Routing Protocol View - BGP
+
-
A
V
P
V
L
V
AS64514
AS9270
AS64513
AS64512
AS64515
47
KNOM Tutorial 2001
Routing Protocol View - BGP
+
-
A
V
P
V
L
V
VPN#1
VPN#1
VPN#2
VPN#2
PE1:
203.255.255.232
PE2:
203.255.255.233
PE5:
203.255.255.236
PE4:
203.255.255.235
PE3:
203.255.255.234
VPN Tunnels
L2 Links
VPN#1
VPN#2
Cisco
Juniper
Versatile Topology Views: Versatile Topology Views:
MPLS/BGP VPN MPLS/BGP VPN
48
KNOM Tutorial 2001
Various Simulations: Various Simulations:
Path Availability Check Path Availability Check
Simulation - Path Availablity Check: Step 2
Available Path was found. Do you
want to see it?
OK Cancel
MPLS View - Reserved Bandwidth
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
20 ~ 40
0 ~ 20
40 ~ 60
60 ~ 80
80 ~ 100
Reserved Bw: %
L
V
49
KNOM Tutorial 2001
Various Simulations: Various Simulations:
Link/Node Failure Link/Node Failure
Simulation - Link/Node Failure: Step 1
Cancel
2001/10/23 17:30
Duration
17 2001
This simulation is to see what happens when a link fails Description:
Simulation date:
Tunnel Link Failure Simulation Simulation name:
From: year hour 30 min. 23 day Oct month
18 2001 To: year hour 00 min. 23 day Oct month
Next >>
MPLS View - Reserved Bandwidth
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
20 ~ 40
0 ~ 20
40 ~ 60
60 ~ 80
80 ~ 100
Reserved Bw: %
L
V
Simulation - Link/Node Failure: Step 2
Select failed links or nodes from the
map. Then, click the OK button.
OK
MPLS View - Reserved Bandwidth
+
-
A
V
P
V
Seoul
Suwon
Taejon
Kwangju
Pusan
Taegu
20 ~ 40
0 ~ 20
40 ~ 60
60 ~ 80
80 ~ 100
Reserved Bw: %
L
V
Traffic Flows
thru Standby
Secondary
LSP
50
KNOM Tutorial 2001
LSP/Network Traffic Measurement and Analysis LSP/Network Traffic Measurement and Analysis
LSP tunnel statistics
Name: LSP3 1000
Reserved
Bandwidth:
kbps
SaveClose Print
Daily Weekly Monthly Yearly
bps
current : 343 bps
maximum: 543 bps
minimum : 132 bps
pps
current : 343 pps
maximum: 543 pps
minimum : 132 pps
0 1 2 3 4 5 6 7 8 9 1 0 1 1 1 2 1 3 1 4 1 5 1 6 1 7 1 8 1 9 2 0 2 1 2 2 2 3 2 4
500
1000
0 1 2 3 4 5 6 7 8 9 1 0 1 1 1 2 1 3 1 4 1 5 1 6 1 7 1 8 1 9 2 0 2 1 2 2 2 3 2 4
500
1000
2001 10 23 - -
Graph
Tunnel Statistics Tunnel Statistics
Traffic Matrix
File(F) Statstics(S) View(V) Tool(T) Help(H)
Graphics Matrix Color
20~40 %
0 ~ 20 %
40~60 %
60~80 %
80 ~100 %
In.Out Bound Prefix Transit
AS 4323
AS 32
AS 432
AS 5654
AS 61232
AS 41
AS 865
AS 232
AS 12
AS 24
AS 4
AS 2352
AS 845
src dest
AS 4
AS 12
AS 24
AS 2352
AS 4
700
700
700
AS 12
300
400
400
AS 24
200
700
400
AS 2352
700
700
700
AS 845
700
700
700
700
AS 845 700 400 400 400
max : 2343
avg : 1234
min : 234
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
500
1000
2001-10-23 2001-10-23 ~ Daily
bps pps
AS Matrix Table & Graph View AS Matrix Table & Graph View
Traffic Matrix
File(F) Statstics(S) View(V) Tool(T) Help(H)
Graphics Matrix Color
20~40 %
0 ~ 20 %
40~60 %
60~80 %
80 ~100 %
In.Out Bound Prefix Transit
AS 4323
AS 32
AS 432
AS 5654
AS 61232
AS 41
AS 865
AS 232
AS 12
AS 24
AS 4
AS 2352
AS 845
AS 4
AS 2352
AS 845
AS 12
AS 24
2001-10-23 2001-10-23 ~ Daily
Weekly
Monthly
Yearly
bps pps
756 bps
AS Matrix Relationship View AS Matrix Relationship View
Traffic Matrix
File(F) Statstics(S) View(V) Tool(T) Help(H)
Graphics Matrix Color
20~40 %
0 ~ 20 %
40~60 %
60~80 %
80 ~100 %
In.Out Bound Prefix Transit
129.254/16
129.254.191/24
203.255.254.130/27
63.43.62/24
13.53/16
54.33.53/24
211.75.163/24
5/8
129.254.75/24
211.13.232.192/26
32.23/16
234.23.123/24
10/8
234.23.123/24
10/8
32.23/16
211.13.232.192/26
129.254.75/24
2001-10-23 2001-10-23 ~ Daily
Weekly
Monthly
Yearly
bps pps
Prefix Matrix Relationship View Prefix Matrix Relationship View