You are on page 1of 34

Introduction to

Load Balancing

BRKAPP-1001

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

Agenda
Introduction
Load Balancing and Health Monitoring
Flow Management
Server Offload
High Availability
Deployments
Geographic Load Balancing
Whats Next ?

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

Cisco Application Delivery Networks


Network Classification

Application Scalability

Application Networking

Quality of service
Network-based app recognition
Queuing, policing, shaping
Visibility, monitoring, control

Server load-balancing
Site selection
SSL termination and offload
Video delivery

Message transformation
Protocol transformation
Message-based security
Application visibility

WAN

Application Acceleration

WAN Acceleration

Application Optimization

Latency mitigation
Application data cache
Meta data cache
Local services

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Data redundancy elimination


Window scaling
LZ compression
Adaptive congestion avoidance
Cisco Public

Delta encoding
FlashForward optimization
Application security
Server offload
4

Other Cisco Live Breakout Sessions


that You May Want to Attend
Relevancy
GSS

ISR

WAAS

ACNS

ACE

AXG

Applications

BRKAPP-2002 Server Load Balancing Design


BRKAPP-3003 Troubleshooting ACE
BRKAPP-1004 Introduction WAAS
BRKAPP-2005 Deploying WAAS
BRKAPP-3006 Troubleshooting WAAS
BRKAPP-1008 What can Cisco IOS do for my application?
BRKAPP-1009 Introduction to Web Application Security
BRKAPP-2010 How to build and deploy a scalable video
communication solution for your organization
BRKAPP-2011 Scaling Applications in a Clustered
Environment
BRKAPP-2013 Best Practices for Application Optimization
illustrated with SAP, Seibel and Exchange
BRKAPP-2014 Deploying AXG
BRKAPP-1015 Web 2.0, AJAX, XML, Web Services for
Network Engineers
BRKAPP-1016 Running Applications on the Branch Router
BRKAPP-2017 Optimizing Application Delivery
BRKAPP-2018 Optimizing Oracle Deployments in
Distributed Data Centers
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

The Application Delivery Journey

Application
Trends

Client/Server

Web Enabled

SOA/Web 2.0

Centralized

Decentralized

Distributed

Few Connections

1000s of Connections

Exponential Increase in
Connections

Early
Technologies

Application
Aware Networks
L4-7 Switching

Cisco
Solution

Load Balancing

Web
Acceleration

QoS
WAN
Optimization

19952000

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

20002006

Cisco Public

End-to-End Application
Delivery Networks
Message Visibility
Virtualization
Deep Packet
Inspection
Multi-Gigabit
Performance

2006 and Beyond

How It All Started


Direct Communication Clients/Servers

IP TCP http Data

X
Web Server
Benefit
Simple solution

Issue
No fault tolerance
Limited performance and scalability
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

Scaling to a Few Servers


The Software Approach

S/W Load Balancer


Clustering Technologies

Benefit
Addresses some of the fault tolerant and performance issues

Issue
Still limited in scale/performance.
Leverages server resources for LB and HA
Proprietary clustering technologies
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

Scale and High Availability for Larger


Deployments
The Hardware-Based Solution

Benefit
Addresses fault tolerant, performance and scalability issues
Future proof: architecture includes hardware co-processors to
support resource-intensive features (i.e., SSL, compression)

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

The Main Functions of a Load Balancer


Clients

Load
Balancer/
Content
Switch

Web

Servers

Database

Represents multiple server farms with


public IP addresses Virtual IPs or VIPs
(which clients resolve via DNS)

Streaming

Monitors the health of servers


Intelligently distributes incoming
requests according to configurable rules
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

10

Terminology

Load Balancing
Algorithm
(Predictor)

Content
Switch
Load
Balancer

Clients

Round Robin

Serverfarm
Servers

Keepalive (Probe)

Client-Side
Gateway

Class-Map
Virtual IP Address (VIP)

URL = /news
User-Agent = WindowsCE
Client = 192.0.0.0/8

172.16.2.100
TCP port 80

BRKAPP-1001
14503_04_2008_c2

Policy-Map

XML
Gateways

If match class-map X
then use serverfarm X
else use serverfarm y
2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

11

Devices Being Load Balanced


Server
Proxies
Accelerators (compression engines, SSL offloaders)
Caches (reverse and transparent)
Firewalls (Layer 3 and Layer 2)
VPN concentrators
Routers
Generic IP device requiring load distribution and/or
redundancy
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

12

Traffic Being Load Balanced


Generic IP traffic (i.e. IPSec tunnels)
Generic UDP and TCP (i.e. proprietary protocols)
Network services (i.e. LDAP, DNS, Radius)
HTTP (i.e. Web Presentation Layer, Web Services, SOAP/XML)
Voice and Video (i.e. RTSP, SIP, H.323)
Remote terminals (i.e. Windows Terminal Services)
Multi-connection protocols (i.e. FTP, RTSP)
Multi-tier packaged applications (i.e. SAP, Oracle, Microsoft, BEA)
Vertical specific applications (i.e. medical, finance, education)
Ethernet
Header

IP
Header

TCP
Header

Layer 2

Layer 3

Layer 4

HTTP
Header

Payload

Ethernet
Trailer

Layer 5-7
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

13

HTTP
The Most Common Load Balanced Protocol
RFC 2616,HTTP 1.1 IETF draft standard:
The hypertext transfer protocol (HTTP) is an
application-level protocol for distributed,
collaborative, hypermedia information systems
Three important elements of an HTTP request:
Method (GET, POST, )
URI
Headers (include cookies)

Carried over TCP


Multiple HTTP requests can be tunneled over the same
TCP connection
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

14

HTTP 1.0Single Request


Web
Server

Client

SYN
SYN_ACK
ACK
GET / HTTP 1.0
ACK
HTTP/1.0 200 OK
Continuation
ACK
FIN
FIN_ACK
ACK
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

15

Cisco Public

HTTP 1.1Two Requests, No Pipelining


Web
Server

Client

SYN
SYN_ACK
ACK
GET /a.gif HTTP 1.1

ACK
HTTP/1.1 200 OK

ACK
GET /b.jpg HTTP 1.1

ACK
HTTP/1.1 200 OK

Continuation
ACK
FIN
FIN_ACK
ACK
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

16

HTTP 1.1Building an Entire Page

TCP 3101 > 80


index.html

TCP 3102 > 80


logo1.gif

globe.gif footpage.jpg

TCP 3103 > 80


/cgi-bin/count
The behaviour
depends
on the browser

TCP 3104 > 80


bannertop.jpg

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

menu.jpg
17

Cisco Public

FTPFile Transfer Protocol


A Multi-Connection Protocol
Active FTP
Client

C:>ftp
test.cisco.com
FTP server test
User: abc
Password: xxx
230 User abc

FTP
Server

3016

21

1
2
3017

20

3
4
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

18

FTPFile Transfer Protocol


A Multi-Connection Protocol
Passive FTP
Client

C:>ftp
test.cisco.com
FTP server test
User: abc
Password: xxx
230 User abc

FTP
Server

3018

21

1
2
3019

2036

3
4
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

19

Load Balancing and


Health Monitoring

How Connections Are Distributed to the Best Available Servers

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

20

10

Load Balancing Algorithms

Client

Serverfarm

How to Distribute Requests Across Servers?


Enhanced Predictors Improve Serverfarm Efficiency
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

21

Load Balancing Algorithms


(Weighted) Round Robin
Very simple, servers receive equal (or proportional) amount of requests

(Weighted) Least Connections


Dynamic, based on open connections, optimizes load across servers

Hash on IP (source/destination, with mask)


No state required for persistence

Hash on URL or portion of URL


Useful for transparent cache redirection

Based on Load
Server load retrieved via SNMP or feedback protocols

Fastest
Based on response time: fastest servers receive newer connections

Least Bandwidth
Real-time amount of traffic considered to select less active server
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

22

11

Session PersistenceStickiness
The Shopping Cart Problem
Browse
Ill Never
Shop Here
Again!

1
Select

2
3

Buy

Empty?!?
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

23

Session PersistenceStickiness
Session: logical aggregation of multiple simultaneous or
subsequent connections
Sessions are limited in time (timeout)
Servers might keep session state locally
Load distribution across multiple servers introduces the problem

The content switch needs to identify a session and send


connections belonging to the same session (i.e. from the
same client) to the same server

Methods to identify the session or client:


Source IP address, HTTP session cookie, SIP session ID,
SSL ID, generic protocol session data,
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

24

12

Health Checking
The content switch needs to continuously monitor the
back-end servers
Failed servers have to be identified and removed from rotation:
the load balancing algorithms adapt to the change
Server failures should be transparent to clients
Servers recovering from failures should be checked and put back in
the available pool, avoiding flapping
Any failure affecting client-server interaction should be detected:
connectivity, application or back-end servers malfunctions

Serverfarm

Clients

X
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

25

Active ProbingKeepalives

Intended to run periodically


Generated by the load balancer: a correct reply is expected
Either predefined health checks or user-configurable scripts
Examples: ICMP (L3 connectivity), TCP (stack), HTTP (application)
For each probe:
Interval, retry times
Maximum TCP open time
Maximum receive time (max response time)
Failed retry time, successful retries before back in service

Serverfarm

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

26

13

In-Band Health Monitoring


The load balancer monitors server-to-client inband traffic and
keep counters for consecutive errors
Can catch basic errors:
No replies from server
RSTs from server

For HTTP traffic, can perform return error code checking (i.e. 500type errors should remove servers from rotation)

Serverfarm

Clients

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

27

Flow Management

Layer 4 and Layer 7 Processing

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

28

14

Flows, Connections, Sessions


A Load Balancer Maintains
Much More State than a Router
on a Per-Flow Basis
Three main types of flows
TCP: IP protocol, src/dst IP, src/dst L4 port, TCP state
UDP: IP protocol, src/dst IP, src/dst L4 port
Generic IP: source/destination IP

TCP flows (connections) require setup


Multiple flows between the same client and server might be
logically grouped into a session
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

29

Layer 4 Switching
L2L4 information is always present in the first packet
of the flow (unless it is a fragment!)
IP protocol
Source/destination IP addresses
Source/destination L4 ports (for TCP/UDP)
Source VLAN, MAC address

The load balancing decision can be made on the first packet

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

30

15

Layer 4 Flow SetupBasic Load Balancing


Decisions Made on First Packet

Matches VIP
Selects Server
Rewrites
L2/L3/L4

SYN
Matches Existing
Flow
Rewrites L2/L3/L4

SYN_ACK

Shortcut
ACK
Data

Shortcut

GET/HTTP 1.1

Shortcut
HTTP/1.1 200

OK

Data

Shortcut
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

31

Layer 7 Switching
L5L7 information is only received after the TCP setup and might
span multiple packets
HTTP URLs, cookies, header fields
SSL session ID
FTP data channel port
Generic application data

Requires TCP termination and buffering!

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

32

16

Layer 7 Flow Setup for HTTP (1/3)


Load Balancing Decisions Require More Data

SYN
SYN_ACK

Matches VIP w/L7


rule
Chooses SEQ #
Replies w/SYN_ACK
Starts
Buffering

ACK

Data

GET/HTTP 1.1
ACK

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

ACKs Client Packets


Keeps Buffering
33

Cisco Public

Layer 7 Flow Setup for HTTP (2/3)


Load Balancing Decisions Require More Data

Data

Parses the Data


Selects Server
Initiates TCP

GET Continuatio
n

ACK

SYN
SYN_ACK

Acts as Client
Does Not Forward
SYN_ACK
Empties Buffer
Sends Data to Server
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

ACK
DataGET
DataGET Cont
inuation
34

17

Layer 7 Flow Setup for HTTP (3/3)


Load Balancing Decisions Require More Data

Does Not Forward ACK


Ready to
Splice the Flows

ACK

Matches Existing Flow


Rewrites L2/L3/L4
and SEQ/ACK
Shortcut

OK
HTTP/1.1 200

Data

Continuation

Data

ACK
Shortcut

Shortcut
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

35

Cisco Public

Layer 7 Flow SetupFull Proxy


The Most Flexible Approach

SYN
ACK
Data

SYN_ACK
GET/HTTP 1.1
ACK

ACK

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

SYN_ACK

ACK
DataGET

ACK
HTTP/1.1 200 OK

Client connection
2008 Cisco Systems, Inc. All rights reserved.

Full Proxy

Independent client &


server connections

HTTP/1.1 200 OK

BRKAPP-1001
14503_04_2008_c2

SYN

Cisco Public

Data
Data

Server connection
36

18

Content Switching Metrics


Connections per Second (CPS)
L4 vs. L7

HTTP requests per Second (CPS)


HTTP 1.1 vs. 1.0

Concurrent Connections (CC)


Bandwidth (in Gbps) and Packets per Second
Latency
Keepalives per second
Number of virtual servers/real servers
Number of policies/rules
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

37

Server Offload

Freeing Up Server CPU and Resources

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

38

19

Server Offload Overview


What is it ?
Perform resource intensive functions on application traffic in the content switch
on behalf of the server. Often hardware accelerated.

Why ?
Servers can dedicate more resources to processing and serving client requests:
faster application response!

What can be offloaded ?


SSL processing, TCP setup/close, HTTP compression, XML processing,

Application
Switch
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Servers

39

Cisco Public

Offloading SSL
Offload CPU-intensive SSL processing
Servers resources are dedicated to serving requests and running applications,
rather than encrypting data

Centralized key/certificate storage/management


Allows advanced content switching (URL-based, cookie-sticky,
payload parsing) and inspection of SSL traffic
Scalability: easy to add more SSL performance

Content
Switch

Encrypted to
VIP:443
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

Clear Text to
Servers:80

Web
Servers
40

20

SSLHandshake
Full

Abbreviated
Re-use same SSL session ID
Less latency - Faster applications

Client Hello
Server Hello
Certificate *
Server Key Exchange *
Certificate Request *
Server Hello Done

Client Hello
Server Hello
Change Cipher Spec
Finished

* Certificate
Client Key Exchange
* Certificate Verify
Change Cipher Spec
Finished

Change Cipher Spec


Finished

Change Cipher Spec


Finished

Application Data

Application Data
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

41

Cisco Public

Building an Encrypted Web Page

TCP 3101 > 443

SSL ID
123

index.html

TCP 3102 > 443

SSL ID
123

logo1.gif

globe.gif

footpage.jpg

TCP 3103 > 443

SSL ID
123
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

bannertop.jpg

Cisco Public

menu.jpg

42

21

SSL Offload Metrics


New transactions per second (TPS)
Full SSL setup (asymmetric)
Depends on key size
Different from chipset RSA operations

Raw throughput (in Mbps or Gbps)


Symmetric

Concurrent connections (CC)


Number of SSL ID cached entries (for SSL ID re-use)
Number of services
Number of certificates
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

43

Cisco Public

Offloading TCP
TCP Reuse (Multiplex)
Offload TCP (HTTP) setup processing from servers
Servers resources are dedicated to serving requests and running
applications, rather than opening and closing TCP connections

TCP connections to the server are kept open


(HTTP 1.1 Connection Keepalive)
Client requests multiplexed to existing server connections
TCP1

TCP1 Pool1
TCP2

TCP2 Pool2

TCP3

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

44

22

High Availability

Protecting Against Single Points of Failure

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

45

Cisco Public

Redundancy
Heartbeat and State
Synchronization link
BACKUP

Internet

VIP Active
192.1.1.100

IP Interface
10.1.1.254

ACTIVE

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

46

23

Terminology
Box-to-Box Redundancy
Granularity

An Entire Load Balancer Is


Either Active or Standby
All VIPs Are
in the Same State

Per-VIP Redundancy
Each VIP Can
Independently Be Active or
Standby

Active-Active

State

BRKAPP-1001
14503_04_2008_c2

Active-Standby

Only One Entity Can


Process Traffic at Any Given
Multiple Entities Can
Time
Process Traffic at the Same
Time
(The Other Is
Standby/Monitoring)

2008 Cisco Systems, Inc. All rights reserved.

47

Cisco Public

RedundancyStatefulness

Stateless

Sticky Stateful

Full Stateful

Sync/Monitor

Sticky Tables

Full Flow Tables

Stateless Content

Session Stateful

Long Living Flows

Low

Medium

High

LB Communication

Ideal For

LB Resources

Adaptive Redundancy
Stateful Level Configurable
Independently on Each Policy
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

48

24

Deployments

Network Integration Options and Examples

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

49

Cisco Public

Router Mode
Servers Default Gateway:
Content Switch IP

Content Switch Routing

Subnet A

Subnet B

Servers in private IP subnet


VIPs usually in different, routable subnet from servers
Requires two IP subnets
Easy to deploy with many server IP subnets
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

50

25

Bridge Mode
Servers Default Gateway:
Upstream Router

Content Switch Bridging

Subnet A
Servers in routable IP subnet
VIPs can be in the same or different subnet
Requires one IP subnets for each farm
Easy deploy for firewall or cache load balancing
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

51

Cisco Public

Subnet B

L3 One-Arm Mode
Servers Default Gateway:
Upstream Router

L2-rewrite not possible


Content switch not inline

Subnet B

Does not see unnecessary traffic

Requires PBR, server default gateway pointing


to load balancer or client source NAT
The return traffic is needed!

Not as common as bridge or routed mode due to problems


with forcing traffic back to CSM in return direction
PBRPolicy Based Routing, NATNetwork Address Translation
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

52

26

L3 One-Arm ModeFlows
VIP
1

Server
IP
3

1 Just Routing Traffic to the VIP


2 Just Routing Traffic to the Server IP
3 L2 to the Server Default Gateway
3 Routing Would Break; Need to Use Either PBR, SNAT,
or Server Default Gateway
4 Just Routing to the Client IP
PBRPolicy Based Routing, sNATSource Network Address Translation
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

53

Cisco Public

L2 One-Arm Mode
Return Traffic Bypassing Load Balancer
Servers
Default Gateway:
Upstream Router

Same IP Subnet

Bypass for return traffic: high throughput!


Requires MAC rewrite, L2 adjacency
Servers need identical loopback addresses (one per VIP)
TCP termination not possible: no L7 features!
Load balancer blind to return traffic (inband, accounting)
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

54

27

A Multi-Tier Example of Deployment


Application Server Suite 10g
3 serverfarm in 3 distinct
IP subnets configured in
bridge mode

APPHosts
Application Servers
(portal, Java,
caching)

IDMHosts
Identity Management
(login functions)

DBHosts

OIDHosts
Separate Data-Base
farm not requiring
load balancing

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Internet Directory
(LDAP)

55

Cisco Public

Firewall Load Balancing


FWLB + SLB
Internal Load Balancer
distributes traffic to servers
and stores source MAC address
for return traffic to firewalls

Inside
Network

1
3

Firewall
farm
2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

6
4

External
Load Balancer

BRKAPP-1001
14503_04_2008_c2

Internal
Load Balancer

Cisco Public

Serverfarm
56

28

Geographic
Load Balancing

Disaster Recovery and Load Distribution Across Data Centers

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

57

Cisco Public

Distributed Data Center Topology


Internal
Network

Internet

Service
Provider A

Service
Provider B

Internal
Network

Front-End Tier
(Web)
Application
Tier
Database
Tier
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

58

29

Site Selection Mechanisms


Site selection mechanisms depend on the technology
or mix of technologies adopted
for request routing:
1. HTTP Redirect
2. DNS Based
3. Route Health Injection and L3 Routing

Health of servers and applications need to


be taken into account
Optionally, also other metrics (like load and distance)
can be measured and utilized for a better selection

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

59

Cisco Public

DNS-Based Site Selection


Root DNS for/
DNS Proxy

Root DNS for .com

2
3

Authoritative DNS
cisco.com

5
6

1
10

Authoritative
DNS
www.cisco.com

Client

Data Center 1
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Ke
epa
live

e
paliv
Kee

http://www.cisco.com/

Data Center 2
Cisco Public

60

30

DNS-Based Site Selection


Root DNS for/
DNS Proxy

Root DNS for .com

2
3

Authoritative DNS
cisco.com

5
6

1
10

Client

8
TCP:80

Authoritative
DNS
www.cisco.com

Data Center 1
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Ke
epa
live

e
paliv
Kee

http://www.cisco.com/

Data Center 2
Cisco Public

61

Whats Next ?

Load Balancing, Content Switching, Application Delivery


and Cisco Products

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

62

31

Advanced Requirements: From Load


Balancing to Application Delivery
Server Offload
Free up server CPU and resources
Application Acceleration
Better user experience, faster transactions
Bandwidth Reduction
Efficient WAN resources utilization
Application and Protocol Inspection
Protection against sophisticated application-specific attacks
Virtualization
One physical device behaves as many: maximum deployment
flexibility and separation of resources
Flexible Network Management
Allows multiple users, with different responsibilities, to
simultaneously manage the device
BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

63

Cisco Public

Cisco Application Control Engine Family


Application Switching

XML Switching and PCI

Multi-Module
(64 Gbps)

ACE XML Gateway


30,000 TPS

Module

(4-16 Gbps)

ACE Web
Application
Firewall

ACE
Module
16 Gbps
ACE
Module
8 Gbps

Appliance
(1-2 Gbps)
ACE
Module
4 Gbps

ACE 4710
2 Gbps

ANM

ACE 4710
1 Gbps

ACE XML
Gateway
Manager

One-Click
Migration
Tools

ACE GSS
CSS 11501
Up to 1 Gbps

BRKAPP-1001
14503_04_2008_c2

20K DNS RPS

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Global Products and Tools

Cisco Public

64

32

Q and A

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

65

Recommended Reading
Continue your Cisco Live
learning experience with further
reading from Cisco Press
Check the Recommended
Reading flyer for suggested
books

Available Onsite at the Cisco Company Store


BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

Cisco Public

66

33

Complete Your Online


Session Evaluation
Give us your feedback and you could win
fabulous prizes. Winners announced daily.
Receive 20 Passport points for each session
evaluation you complete.
Complete your session evaluation online now
(open a browser through our wireless network
to access our portal) or visit one of the Internet
stations throughout the Convention Center.

Dont forget to activate


your Cisco Live virtual
account for access to
all session material
on-demand and return
for our live virtual event
in October 2008.
Go to the Collaboration
Zone in World of
Solutions or visit
www.cisco-live.com.

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

67

BRKAPP-1001
14503_04_2008_c2

2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

68

2006, Cisco Systems, Inc. All rights reserved.


14503_04_2008_c2.scr

34

You might also like