x-Wizard Advanced Training

DAY TWO Model and Clutter Optimization

March 2006

Class Agenda
Model Optimization
A description of how to use x-Wizards model
optimization routines

Clutter Optimization
A description of how to use x-Wizards model
optimization routines

Optimization Processes A description of how to use x-Wizards model

optimization routines

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results

Evaluating Results
Grouping Sites
Method of averaging
Applying average models

Class Agenda Model Optimization

This section of the class is offered . . .
To explain the model optimization routine
To illustrate the differences between single mode and
batch mode optimization
To demonstrate how to create an average Propagation
Model for use at sites that were not driven

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results

Evaluating Results
Grouping Sites
Method of averaging
Applying average models

Model Optimization - Overview

Goal of the PMO
Create the most accurate model
with a minimal amount of effort
Drive a limited number of sites that
represent an area
10% - 15% of the sites in a
given morphology
Derive optimized parameters for
each site that can be averaged
You should not have a high
variability in results
Apply average parameters to sites
that were not driven

Yellow sites were driven and Optimized

Average Model applies at Blue sites
Is it worth the effort to squeeze an
additional dB of accuracy?

Model Optimization - Overview

Unoptimized Prop. ModelO
Histogram
Mr-Pr

Optimized Prop. Model

p
t
i
m

Prediction

Mean Error0
St.Devlarge

z
a
t
i
o
Scatter Plot
Mr-Pr

Prediction

Mean Error 0
St.Devminimized

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results

Evaluating Results
Grouping Sites
Method of averaging
Applying average models

Model Optimization Basic Routine

Least-Squares Linear Regression

RSL can be modeled as a straight line vs Log (Dist.)
The routine finds the straight line that minimizes the
error between measured and predicted data points
by
Driving the Mean Error to zero (Measured-Predicted)
Driving the Standard Deviation as low as possible

Industry accepted standard deviation is 6 to 10 dB

Remember - The routine always optimizes model

parameters and KED correction factors (Foose
Factor or Polynomial)

Model Optimization Basic Routine

Note that the routine is a numerical analysis and may

produce results that do not make physical sense
Slopes better than free space, for example

Unreasonable results are always traced back to:

Bad drive data
Peculiar drive test conditions

10

RSL increases far from site!

Data indicates interference

Rx is looking down on Tx;

Can cause RSL to increase
far from the site.

Model Optimization Basic Inputs

Propagation Model Optimization
Analysis Requires
1. Site to be optimized
2. Drive data for the site
Associated data used if
available

1
2
3
4

3. Reference Grid
Read from site

4. Model to be optimized &

Method
5. Filtering parameters
11

Model Optimization Basic Inputs

Notes on Optimization Method
Hata Model will only allow 2-parameter optimization

Effective Antenna Height Multiplier

Area Correction Factor

The routine will also optimize the KED correction if

Obstructed points are included

12

Foose Factor
OR
Polynomial Correction

Model Optimization Basic Inputs

Notes on Optimization Method (cont.)

Lee Model will allow 2- or 3-parameter optimization

3-parameter optimization will provide better fit to data BUT . . .

13

Intercept (always optimized)

Slope (always optimized)
Tx Height Correction Multiplier (only 3-parameter Opt.)

Can lead to un-intuitive Slope & Intercept

Can make it hard to average due to differences in optimized models

Use 3-parameter optimization sparingly

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results

14

Evaluating Results
Grouping Sites
Method of averaging
Applying average models

Model Optimization Single Site

Single Site Optimization Analysis
1.

Does not require associated

measured data

2.

4.
5.
15

Will optimize the model assigned

to the site

3.

Associated data will be used if

available

Must set model prior to entering

the dialog (cant change in dialog)

Allows filtering by user defined

angle
Must collect multiple site results to
derive average model outside of xWizard
Used to refine optimizations
performed with Batch Mode

Model Optimization Single Site

Single Site Optimization Analysis - Output
User can save Excel file before hitting Okay

The routine provides:

16

Optimized parameters
Statistics on quality of optimization

Model Optimization Single Site

Notes on Statistical Output
1.
2.
3.

Obstructed Stats allow you to determine the accuracy of the KED

correction
Non-Obstructed Stats allow you to determine the accuracy of the
Model parameters
Total Stats allow you to determine the accuracy of the entire
optimization
1
2

Each group has:

17

# of Points compared
Mean Delta between Measured Data and Optd Predictions
Std. Dev. of Delta between Measured Data and Optd Predictions

Model Optimization Single Site

Notes on Controls at the Bottom

18

Next, Previous are used in Batch mode

Save to File allows you to save the data to an Excel file
Apply to all TXs will assign the optimized model directly to the Sector
that was optimized
Apply to all Cells will assign the Sectors model directly to the Cell
site that was optimized

Model Optimization Batch Mode

Batch Mode Optimization Analysis
1.

Select Mode

2.

Requires associated measured

data

3.

Available sites represents the sites

with associated data

Selected Sites will be optimized

19

Tx Specific model optimizes

different models at different sites
Selected Model optimizes one
model using all sites regardless of
what is assigned at site/sector

Double click Available site to add

to the Selected sites

Dbl.
Click

Model Optimization Batch Mode

Batch Mode Output Average Stats Dialog
1. Save Avg. Model can save the average parameters to
Common Folder

The Avg. model can be used at sites not driven

2. Only sites with Use box checked are included in Avg.

3. Average based on # of data points used at each site (more
later)
1
3
2

20

Avg. model
written to . . .

Model Optimization Batch Mode

Batch Mode Output Average Stats Dialog (cont)
Use the built-in Stats Tool to analyze site optimization

21

Model Optimization Batch Mode

Notes on Controls at the Bottom

Next, Previous are used to view each sites results separately

Save to File allows you to save the data to an Excel file
Apply to all TXs will assign the optimized models directly to the
Sectors that are checked use
Apply to all Cells will assign the model from the FIRST Sector directly
to the Cell site that was optimized

22

This does not assign a 3-Sector average model to the Cell Level

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results

23

Evaluating Results
Grouping Sites
Method of averaging
Applying average models

Model Optimization Evaluating

Results

Not all Optimization tests will result in data that can be used.
Before creating an Average Model, look at:
Number of Data Points
total should be > 350 pts.

Standard Deviation
should be < 8 to 10 dB (depending on morphology)

Mean Error
should be zero or close to it

Check for same on Obstructed and Non-Obstructed

If Obstructed points provide the most error, you may want to change the
KED correction method

24

Model Optimization Evaluating

Results
Before creating an Average Model, check the KED Correction
parameters:
Foose Method
Foose Factor should be < 6 dB/obs
Depending on conditions (very rugged), you may use Foose
Factors between 6 & 9 dB (rarely)

Polynomial Method
A should be between 0 and 1
B should be between + 10 dB

25

Model Optimization Evaluating

Results
Before creating an Average Model, check the model
parameters:
Lee Model
Slope should be between -25 and -45 dBm/dec
Intercept should be between -60 and -80 dBm

Hata Model
Effective Ant. Ht. Multiplier between -5 dB to 10 dB
Area Correction Factor
negative for urban: -15 dB to 0 dB
positive for suburban/rural: 0 dB to 30 dB

26

Model Optimization Evaluating

Results
Use the built-in Evaluation Tool for problem sites. Look for:
1. Changes in slope

May indicate that data strayed into different morphology

2. Areas of consistent Error

May indicate a tree, in the near field, blocking the Tx at certain

angles
1

Drive Test data seems to show

multiple slopes. Why?
27

Optimized model consistently

Under-predicts signal. Why?

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results

28

Evaluating Results
Grouping Sites
Method of averaging
Applying average models

Model Optimization Grouping Sites

An Average Model must be applied to sites that were not
driven, BUT it is important that the groupings point to the
appropriate model
There are several techniques:
Group by Area
This could be a geographic area or morphological type

Group by ERP
It may work out that test sites with similar ERP optimized to
approximately same model parameters

Group by Tower Height

Clutter may affect sites with similar heights in the same way

29

Model Optimization Grouping Sites

Grouping by Area
Typical morphologies are hard to define
Suburb in one area may not work for Suburb in a different area

Using Geographic areas can make it easier

If data defines models that fit geo-areas, draw regions on the
map and name regions according to model

30

Model Optimization Grouping Sites

Grouping by ERP
It is not often effective, but some optimizations show a
pattern between model parameters and ERP

Grouping by Tower Height

The idea is that model parameters are affected by clutter
The lower the antenna, the more dramatic the affect on
slope

31

 Grouping Sites Common Questions

Morphology
Do all the models in a given area match each other?

ERP
Is there a clear pattern that would allow you to assign an average
model to site with ERP between X watts and Y watts?

Tower Height (RCL)

Can you see a similarity in propagation parameters for sites
where antennas are mounted at about X feet?

Slopes
Is there a break in the slopes where it is clear one group of sites
belongs together?

32

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results

33

Evaluating Results
Grouping Sites
Method of averaging
Applying average models

Model Optimization Wtd Avg.

Parameters to average:

One-mile intercept, P1mi

Slope, m
Foose Factor, Ff

LL

XX NN

XX i i 11L
L

ii

ii

NN
i i
11

Standard deviation,

X P1mi , m, Ff

ii

LL

22

i iNNi i
i i
11

LL

NN
i i
11

ii

Area Averaging is done using

Number of samples (LAMs) per site, Ni
Number of test sites within a given morphology type, L

34

Model Optimization Wtd Avg.

Two sites in suburban morphology
Optimized prop.parameters:
Site
Site
Intercept
Intercept
Slope
Slope
Foose
Foose f.f.

NN

35

Magnolia
Hibiscus
Magnolia
Hibiscus
-30.42dBm
-30.16dBm
-30.42dBm
-30.16dBm
-62.96dB/dec
-62.96dB/dec -62.19dB/dec
-62.19dB/dec
7.15dB
6.32dB
7.15dB
6.32dB
6.87dB
6.87dB
457
457

6.81dB
6.81dB
898
898

Model Optimization Wtd Avg.

Weighted average method:
P1mi

62.96 457 62.19 898

62.45 dBm
457 898

30.42 457 30.16 898

m
30.25 dB/dec
457 898

7.15 457 6.32 898

Ff
6.60 dB
457 898

6.87 2 457 6.812 898

6.83 dB
457 898
36

Class Agenda Model Optimization

Propagation Model Optimization
Overview
The Basic Routine
Numeric Analysis
Basic Inputs

Batch vs Single model optimization

Optimization Results
Rules for accepting/rejecting data
Methods of averaging
Weighted average
Group by Morphology/Tower Height/ERP

Applying average models

37

Model Optimization Applying Avg

Model
Assign Avg. Model to sites not driven (manual assignments
illustrated)
Make Cell Level assignment for most cases

Make Tx Level assignments in special cases

38

This level is preferred because x-Wizard runs faster and takes

up less disk space.

One sector covers suburbs while the other two cover urban

Model Optimization Applying Avg

Model
The model can also be assigned using the Query/Edit
Function

39

Query on a common parameter (active state, for example)

Select Propagation Model under Data Fields and avg. model
<name> under Value
Select Use Cell Parameters under Data Fields and True under
Value

Class Agenda Clutter Optimization

Review of Clutter
Overview
The Basic Routine
Analyzing the output

Optimization Process
Overview
Area Tuning

40

Class Agenda Clutter Optimization

This section of the class is offered . . .
To explain the Clutter optimization routine
To illustrate techniques used to optimize clutter
To demonstrate how to create an average clutter
adjustment file for use at sites that were not driven

41

Class Agenda Clutter Optimization

Review of Clutter
Overview
The Basic Routine
Analyzing the output

Optimization Process
Overview
Area Tuning

42

Clutter Optimization - Example

M

CA[dB] ai li bi log d i ci d i
i 1

ai

Local clutter adjustment (dB),

bi

Pass through log distance multiplier (dB/decade),

ci

Pass through linear distance muliplier (dB/adj. distance),

Number of clutter types,

di

Aggregate distance through clutter i,

li

1 when receiver in clutter type i,0 otherwise.

TX

d4
d3
d2
RX

C lu tte r
Type 1

43

C lu tte r
Type 2

C lu tte r
Type 3

C lu tte r
Type 4

C lu tte r
Type 5

Clutter Optimization - Example

Calculate the total RSL for the receiver that resides in a clutter type #5.
Assume that RSLPM=-75dBm, DL=-5dBm, and a clutter adjustment file is
given in a following table:

Step#1
Find a clutter adjustment using the equation:
M

CA[dB ] ai li bi log d i ci d i
i 1

44

Clutter Optimization - Example

0
50
0
50
CA dB 2 * 0 (3) * log
0.2 * 4 * 0 (3) * log
0.4 *
10
20
10
20

25
50
25
50

6
*
0

2
)
*
log

0
.
6
*

10
*
0

4
)
*
log

0
.
1
*

15
15
10
10

0
0

4
.
5
*
1

3
)
*
log

0
.
4
*

0 2.19 1.44 3.29 4.5 11.42 dB

10
10

Step #2
Calculate the total RSL as:

RSL dBm RSLPM DL CA

75dBm 5dB 11.42dB 91.42dB
45

Clutter Optimization - Overview

The example in previous slide is
performed for each bin in a prediction
When optimizing, the routine
compares the measurements to the
predictions without clutter, then
Solves for the correct variables that will
bring the predictions and measurements
as close as possible, then
Repeats this for each measured data
point

46

c Tx

c
c

c
c

c
c

Clutter Optimization - Overview

How do you Optimize Clutter?
Optimize Clutter using the same drive test data you used for model
optimization.
Optimize Clutter by itself (i.e. use default, un-optimized model) OR
Optimize Clutter after Model Optimization

Which variables should you Optimize?

Recommend that Local and at least one Pass Through variable be
optimized for best results

Why Optimize Clutter?

Clutter optimization, in conjunction with Model Optimization, brings
out detail in the prediction
Even if you have old 7-class clutter, the affect on predictions can be
significant (especially for Permat)
47

Class Agenda Clutter Optimization

Review of Clutter
Overview
The Basic Routine
Analyzing the output

Optimization Process
Overview
Area Tuning

48

Clutter Optimization Basics

Before you start the clutter optimization:
1.
2.

Make sure you have assigned appropriate Clutter height if you are
optimizing a Pass-Through variable
Make sure Clutter Adj. file is zerod out before you start clutter
optimization the analysis gives you the difference from current

Edit > Clutter Adjustment File OR Edit > Project under Basic Project Data

1
49

Clutter Optimization Basics

1. Requires associated
measured data

Available sites represents the

sites with associated data

2. Selected Sites will be used

to optimize clutter variables

Double click Available site to

add to the Selected sites

3. Optimize Local and/or Pass

Through variables

50

It is recommended that you

include at least one Pass
Through variables

Analysis > Clutter Optimization

Dbl.
Click

Clutter Optimization Basics

Notes on Pass-Through Clutter:
1.
2.

It is wise to include Local and Pass-through Log for all clutter

optimizations
Optimize Pass-through Linear adjustments in urban or dense urban
settings

51

Linear pass-through variable can be problematic in trees or residential

areas.

Class Agenda Clutter Optimization

Review of Clutter
Overview
The Basic Routine
Analyzing the output

Optimization Process
Overview
Area Tuning

52

Clutter Optimization Output

The output of the routine comes in two forms:
1.
2.

53

Tabular list of optimized variables and statistics

Map Plot the Delta between measured and predicted data AFTER the
optimized clutter is applied

Clutter Optimization Output

Tabular Variables and Statistics
1.

Save will save the Clutter Adj. to Common Folder

The new, optimized Clutter Adj. can be used at sites not driven
2. The routine will zero-out any positive pass-through variables and then
re-adjust matrix.

Positive pass-through variables will cause signal re-birth

54

Clutter Optimization Output

Note on Signal Re-Birth

If x-Wizard allowed the routine to keep positive pass through variables, there is a chance that
the signal would INCREASE as you went farther from the site.
The distance traveled through a clutter type will increase
If the variable is positive, it can become quite large.

Example:

linear pass-through variable, C = +0.02 dB/ft;

distance passed through = .75 miles (3,960 ft)
With a positive pass-through variable, the signal regains
+0.02 dB/ft * 3,960 ft =

55

79.2 dB!

Clutter Optimization - Output

Make note of the overall Mean and Std. Dev.
Only # of Local Points are reported, BUT
Total points used in optimization will include pass through points

Local Adjustments may be positive

Do not over analyze the results
The variables are the result of a matrix operation
The ultimate test is how well the adjustments predict certain areas

56

Clutter Optimization Output

Mapped Delta Plot
1.

Look for areas where the Delta is consistently high

This may indicate a problem area (i.e. Open area clutter optimized
from urban data)
2. It is helpful to Format > Band Colors so that the colors indicate an
absolute value (i.e. Green has range of +/- 5dB)
Area a
Mostly greens and yellows
indicate that the optimization
worked well in this area

57

Area b
Mostly reds and oranges
indicates that the optimization
did not perform well in this
area.

Class Agenda Clutter Optimization

Review of Clutter
Overview
The Basic Routine
Analyzing the output

Optimization Process
Overview
Area Tuning

58

Clutter Optimization - Overview

The goal of any optimization is to balance accuracy
with the effort/time required
Things to consider:
How many sites will have to be driven?
How much data post-processing and analysis is
required?
How much money and time will it take?
What will be the resulting accuracy?
How easy will it be to assign model/clutter to a new site?

59

Clutter Optimization - Overview

Easiest methods produce mediocre accuracy
1. Model Only Use no clutter and tune only the model

Requires about 10% to 15% of sites be driven

One step post-processing using the Batch Mode
Expect 6 to 10 dB Std. Dev. but not much detail
Depending on area, you can easily assign models to new sites

2. Clutter Only Use a default model and tune only the

clutter adjustments

60

Requires about 10% to 15% of sites be driven

One step post-processing
Expect 7 to 10 dB Std. Dev. but no one clutter adjust fits all
areas well
Depending on area, you can easily assign adjustments to new
sites

Clutter Optimization - Overview

Hardest methods produce superior accuracy
1. Hyper-tuning create site specific models and clutter

Requires you to drive test each and every site

Must develop both tuned model and tuned clutter for each site
Expect 3 to 6 dB Std. Dev.
Strictly speaking, new sites must be driven.
Prior to being built, you would have to derive an average from the
surrounding sites.

61

Clutter Optimization - Overview

Area method represents a happy medium effort and
accuracy
Network is divided into regions that represent a different RF
environments
Requires about 10% to 15% of sites be driven per region
Three step post-processing using the Batch Mode to tune the
model, optimize clutter and then re-optimize the model.
Expect 4 to 8 dB Std. Dev. with some good detail
Areas must be well defined so that you can easily assign models
clutter to new sites

62

Class Agenda Clutter Optimization

Review of Clutter
Overview
The Basic Routine
Analyzing the output

Optimization Process
Overview
Area Tuning

63

Clutter Optimization Area Method

x-Wizard handles Transition Areas through the Area
Tuning Optimization technique
Model Tuning provides overall accuracy
Clutter Optimization provides detail accuracy

Un-optimized predictions
show large area of strong
coverage and interfering
signal in DT Philly
DT Philly
64

Transition NJ Suburb

Clutter Optimization Area Method

Step One: Tune the Model w/o Clutter
Using Batch mode, optimize all sites that belong to a particular
morphology
Use the results to derive an average
Assign the exact optimized models to the sites that were driven
Provides better clutter tuning in the next step

Band radii generally round

No shadowing from clutter
Note broad area of
interfering signal in DT Philly
65

Clutter Optimization Area Method

Step Two: Clutter Optimization
Using the same sites and same data, tune the clutter using sites
with tuned models
Note that the avg. std. dev. may not improve much and may even
get slightly worse.
You are looking to bring out detail in the predictions caused by clutter

This example used an

Avg. Opt. Model &
Opt. Clutter for Suburbs
on a site that was not
used in the optimization

66

Clutter Optimization Area Method

Step Three: Re-Optimize Model with tuned Clutter
This step is required to normalize the model to the tuned
clutter
The average model derived at this stage is rarely much
different than the average model derived from Step One
The avg. std. dev. may improve slightly at this stage,
however

67

Questions???