Professional Documents
Culture Documents
Experiments
Outline
Introduction
Classification of Outputs
DIDO vs. RIRO Simulation
Analysis of One System
Terminating vs. Steady-State Simulations
Analysis of Terminating Simulations
Obtaining a Specified Precision
Analysis of Steady-State Simulations
Method of Moving Average for Removing the
Initial Bias
Method of Batch Means
Multiple Measures of Performance
Analysis of Several Systems
Comparison of Two Alternative Systems
Comparison of More than Two Systems
Ranking and Selection
Introduction
What Outputs to
Watch?
Classification of
Outputs
Wi
..................................
i
Classification of
Outputs
Wi
W(N ) i 1
N
Classification of
Outputs
2
Q(t )
1
0
Classification of
Outputs
Q(t )dt
0
Q( T )
(T )
B(T )dt
0
1
B(t )
0
t
8
Classification of
Outputs
Other continuous-time performance
measures:
Inputs:
Cycle
times
Interarrival
times
Batch
sizes
Simulation
Model
Outputs:
Hourly
production
Machine
utilization
10
DIDO
Cycle
times
Interarrival
times
Batch
sizes
Simulation
Model
Outputs:
Hourly
production
Machine
utilization
11
RIRO
S
e
rv
e
ru
tiliz
a
tio
n
A
v
e
ra
g
en
u
m
b
e
r inq
u
e
u
A
ev
e
ra
g
ed
e
la
y inq
u
e
u
e
10
10
10
Replication
8
6
4
2
0
Replication
1.0
0.9
0.8
0.7
0.6
0.5
Replication
12
Y ( n)
Y
i 1
13
[Y Y (n)]
S ( n)
i 1
n(n 1)
( n )]
n
Examples of Terminating
Simulations
A retail/commercial establishment (a
bank) that operates from 9 to 5 daily and
starts empty and idle at the beginning of
each day. The output of interest may be
the average wait time of first 50 customers
in the system.
16
17
18
19
Y ( n)
Y
i 1
unbiased estimator of
n
n
S 2 ( n)
2
[
Y
Y
(
n
)]
i
i 1
n 1
Y ( n) t n 1,1
S ( n)
n
(n, ) t n 1,1 2
S ( n)
n
20
Example
Consider a single-server (M/M/1) queue. The
objective is to calculate a confidence interval
for the delay of customers in the queue.
n = 10 replications of a single-server queue
Yi = average delay in queue from ith replication
Yis: 2.02, 0.73, 3.20, 6.23, 1.76, 0.47, 3.89,
5.45, 1.44, 1.23
21
( unknown)
22
Issue 1
23
Issue 2
Absolute precision
Relative precision
24
Obtaining a Specified
Precision
Absolute Precision:
Assuming that
the estimate of the
2
variance, S (n) , does not change
appreciably, an approximate expression
for the required number of replications to
achieve an absolute error of is
25
S 2 ( n)
i
Obtaining a Specified
Precision
Relative Precision:
,
n
)
Y
(
n
)
0 1
( , estimates
n)
Assuming thatthe
of both population
mean,
, and population variance,
, do
not change appreciably, an approximate
expression for the required
Y (n) number of
replications to
an absolute error of is
S 2 achieve
(n)
n ( ) min
*
r
S 2(n)
ti 1,1 a 2
i
i n:
Y ( n)
26
limi E (Yi )
Basic question: Should you do many short
runs or one long run ?????
Many short
runs
One long
run
X1
X1
X2
X3
X4
X5
27
Advantages:
Disadvantages
Sample of size 1
Difficult to get a good estimate of the
variance
28
i l 1
nl
29
is
s w
Y i ( w)
if i w 1, ..., m w
2w 1
i 1
is
s ( i 1)
if i 1, ..., m
2i 1
30
31
32
Yi
Y1
Y2
Y3
Y4
Y5
i
m nk
Y
j 1
33
Y
i 1
S ( n)
2
Y
(Y
Y )2
j 1
n 1
Y t n 1,1 2
34
SY (n)
n
35
36
Multiple Measures of
Performance
Throughput
Average length of queue
Utilization
Average time in system
37
Multiple Measures of
Performance
P
1 s
respective performance measure
s 1
38
Multiple Measure of
Performance
s1
39
Multiple Measures of
Performance
40
Analysis of Several
Systems
build
confidence
for
H0 :simultaneous
1 2
H0 : 1 intervals
2
various combinations of
1 2
select the best of the k alternatives
select a subset of size m < k that contains the
best alternative
select the m best (unranked)
of the
alternatives
i i
1
41
Analysis of Several
Systems
42
Analysis of Several
Systems
1 4.13 3.70 2
Therefore, system 2 is better
43
Analysis of Several
Systems
Solution:
Y
j 1
Yi
ij
Yi .
P(wrong Answer)
1
5
10
20
0.52
0.43
0.38
0.34
44
Comparison of Two
Alternative Systems
Paired-t
Two-Sample-t.
45
Let
(i = 1, 2).
Pair
define
Y1 jwith Y2and
j
Z j Y1 j for
Y2 j
j = 1, 2, , n.
Then, the
Z 's
j
, the
quantity for which we want to construct
( Z j ) interval.
aEconfidence
Let
n
Z
j 1
Z ( n)
and
Z
n
j 1
Z ( n)
Var Z (n)
Then, the approximate 100(1C.I. is
n(n) percent
1)
Two-Sample-t Confidence
Interval
Y
j 1
Yi (ni )
and
ni
Y
ni
Si2 ( ni )
Yi (ni )
ij
ni
j 1
ij
2
1
(n1 ) n1
(n1 1) S (n2 ) n2
2
2
(n2 1)
Y1 (n1 ) Y 2 (n2 ) t f ,1 2
47
n1
n2
48
49
Comparison with a
Standard
2 1 , 3 1 , ..., k 1
50
All Pairwise
Comparisons
2 1
3 1
3 2
...
...
k 1
k 2
..
.
k k1
Again,
1 we can use paired-t or two-sample-t
methods to make the individual confidence
intervals.
51
52
53
54
55