EXPONENTIAL DISTRIBUTION:
THEORY AND METHODS
No part of this digital document may be reproduced, stored in a retrieval system or transmitted in any form or
by any means. The publisher has taken reasonable care in the preparation of this digital document, but makes no
expressed or implied warranty of any kind and assumes no responsibility for any errors or omissions. No
liability is assumed for incidental or consequential damages in connection with or arising out of information
contained herein. This digital document is sold with the clear understanding that the publisher is not engaged in
rendering legal, medical or any other professional services.
MATHEMATICS RESEARCH
DEVELOPMENTS
Additional books in this series can be found on Novas website
under the Series tab.
Additional Ebooks in this series can be found on Novas website
under the Ebook tab.
MATHEMATICS RESEARCH DEVELOPMENTS
EXPONENTIAL DISTRIBUTION:
THEORY AND METHODS
M. AHSANULLAH
AND
G. G. HAMEDANI
Nova Science Publishers, Inc.
New York
Copyright 2010 by Nova Science Publishers, Inc.
All rights reserved. No part of this book may be reproduced, stored in a retrieval system or
transmitted in any form or by any means: electronic, electrostatic, magnetic, tape, mechanical
photocopying, recording or otherwise without the written permission of the Publisher.
For permission to use material from this book please contact us:
Telephone 6312317269; Fax 6312318175
Web Site: http://www.novapublishers.com
NOTICE TO THE READER
The Publisher has taken reasonable care in the preparation of this book, but makes no expressed
or implied warranty of any kind and assumes no responsibility for any errors or omissions. No
liability is assumed for incidental or consequential damages in connection with or arising out of
information contained in this book. The Publisher shall not be liable for any special,
consequential, or exemplary damages resulting, in whole or in part, from the readers use of, or
reliance upon, this material. Any parts of this book based on government reports are so indicated
and copyright is claimed for those parts to the extent applicable to compilations of such works.
Independent verification should be sought for any data, advice or recommendations contained in
this book. In addition, no responsibility is assumed by the publisher for any injury and/or damage
to persons or property arising from any methods, products, instructions, ideas or otherwise
contained in this publication.
This publication is designed to provide accurate and authoritative information with regard to the
subject matter covered herein. It is sold with the clear understanding that the Publisher is not
engaged in rendering legal or any other professional services. If legal or any other expert
assistance is required, the services of a competent person should be sought. FROM A
DECLARATION OF PARTICIPANTS JOINTLY ADOPTED BY A COMMITTEE OF THE
AMERICAN BAR ASSOCIATION AND A COMMITTEE OF PUBLISHERS.
LIBRARY OF CONGRESS CATALOGINGINPUBLICATION DATA
Ahsanullah, M. (Mohammad)
Exponential distribution : theory and methods / Mohammad Ahsanullah, G.G.
Hamedani.
p. cm.
Includes bibliographical references and index.
ISBN 9781613245668 (eBook)
1. Distribution (Probability theory) 2. Exponential families (Statistics)
3. Order statistics. I. Hamedani, G. G. (Gholamhossein G.) II. Title.
QA273.6.A434 2009
519.2'4dc22
2010016733
Published by Nova Science Publishers, Inc. New York
To Masuda, Nisar, Tabassum, Faruk,
Angela, Sami, Amil and Julian
MA
To Azam , Azita , Hooman , Peter ,
Holly , Zadan and Azara
GGH
Contents
Preface ix
1. Introduction 1
1.1 Preliminaries 3
2. Order Statistics 11
2.1 Preliminaries and Definitions 11
2.2 Minimum Variance Linear Unbiased Estimators Based
on Order Statistics
18
2.3 Minimum Variance Linear Unbiased Predictors
(MVLUPs)
24
2.4 Limiting Distributions 27
3. Record Values 31
3.1 Definitions of Record Values and Record Times 31
3.2 The Exact Distribution of Record Values 31
3.3 Moments of Record Values 38
3.4 Estimation of Parameters 44
3.5 Prediction of Record Values 46
3.5 Limiting Distribution of Record Values 48
4. Generalized Order Statistics 51
4.1 Definition 51
4.2 Generalized Order Statistics of Exponential Distribution 52
vi Contents
5. Characterizations of Exponential Distribution I 65
5.1 Introduction 65
5.2 Characterizations Based on Order Statistics 66
5.3 Characterizations Based on Generalized Order Statistics 86
6. Characterizations of Exponential Distribution II 99
6.1 Characterizations Based on Record Values 99
6.2 Characterizations Based on Generalized Order Statistics 120
References 121
Index 143
Preface
The univariate exponential distribution is the most commonly used
distribution in modeling reliability and life testing analysis. The exponential
distribution is often used to model the failure time of manufactured items in
production. If X denotes the time to failure of a light bulb of a particular make,
with exponential distribution, then P(X>x) represent the survival of the light
bulb. The larger the average rate of failure, the bigger will be the failure time.
One of the most important properties of the exponential distribution is the
memoryless property; P(X>x+yX>x) = P(X>y). Given that a lightbulb has
survived x units of time, the chances that it survives a further y units of time is
the same as that of a fresh lightbulb surviving y units of time. In other words
past history has no effect on the lightbulbs performance. The exponential
distribution is used to model Poisson process, in situations in which an object
actually in state A can change to state B with constant probability per unit.
The aim of this book is to present various properties of the exponential
distribution and inferences about them. The book is written on a lower
technical level and requires elementary knowledge of algebra and statistics.
This book will be a unique resource that brings together general as well as
special results for the exponential family. Because of the central role that the
exponential family of distributions plays in probability and statistics, this book
will be a rich and useful resource for Probabilists, Statisticians and researchers
in the related theoretical as well as applied fields. The book consists of six
chapters. The first chapter describes some basic properties of exponential
distribution. The second chapter describes order statistics and inferences based
on order statistics. Chapter three deals with record values and chapter 4
presents generalized order statistics. Chapters 5 and 6 deal with the
characterizations of exponential distribution based on order statistics, record
values and generalized order statistics.
Summer research grant and sabbatical leave from Rider University
enabled the first author to complete part of the book. The first author expresses
his sincere thanks to his wife Masuda for the longstanding support and
x M.Ahsanullah and G.G.Hamedani
encouragement for the preparation of this manuscript. The second author
thanks his family for their encouragement during the preparation of this work.
He is grateful to Marquette University for partial support during preparation of
part of this book.
The authors wish to thank Nova Science Publishers for their willingness
to publish this manuscript.
M. Ahsanullah
G. G.Hamedani
About the Authors
Dr. M.Ahsanullah is a Professor of Statistics at Rider University. He earned his
Ph.D. from North Carolina State University ,Raleigh, North Carolina. He is a
Fellow of American Statistical Association and Royal Statistical Society. He is
an elected member of the International Statistical Institute. He is editorinChief
of Journal of Applied Statistical Science and Coeditor of Journal of Statistical
Theory and Applications. He has authored and coauthored more than twenty
books and published more than 200 research articles in reputable journals. His
research areas are Record Values, Order Statistics, Statistical Inferences, Char
acterizations of Distributions etc.
Dr. Hamedani is a Professor of Mathematics and Statistics at Marquette
University in Milwaukee Wisconsin. He received his doctoral degree from
Michigan State University, East Lansing, Michigan in 1971. He is CoEditor of
Journal of Statistical Theory and Applications and Member of Editorial Board
of Journal of Applied Statistical Science and Journal of Applied Mathematics,
Statistics and Informatics. Dr. Hamedani has authored or coauthored over 110
research papers in mathematics and statistics journals. His main research areas
are characterizations of continuous distributions and differential equations
Chapter 1
Introduction
The exponential family of distributions is a very rich class of distributions with
extensive domain of applicability. The structure of the exponential family al
lows for the development of important theory as it is shown via a body of work
related to this family in the literature.
We will be using some terminologies in the next few paragraphs which will
formally be dened later in the chapter. To give the reader some ideas about
the nature of the univariate exponential distribution, let us start with a basic
random experiment, a corresponding sample space and a probability measure.
We follow the usual notational convention: X, Y, Z, . . . stand for realvalued
random variables; boldface XXX, YYY, ZZZ, . . . denote vectorvalued random variables.
Suppose that X is a realvalued continuous randomvariable for the basic experi
ment with cumulative distributionfunction F and the corresponding probability
density function f . We perform n independent replications of the basic exper
iment to generate a random sample of size n from X: (X
1
, X
2
, . . ., X
n
). These
are independent random variables, each with the same distribution as that of X.
If X
i
s are exponential random variables with cumulative distribution function
F (x) = 1 e
x
, x 0, where > 0 is a parameter, then
n
i=1
X
i
is distributed
as Gamma with parameters n and . The random variable 2
n
i=1
X
i
has a Chi
square distribution with 2n degrees of freedom. Consider a series system (a
system which works only if all the components work) with independent com
ponents with common cumulative distribution function F (x) = 1e
x
, x 0,
and let T be the life of the system. Then P(T >t) = P(min
1in
X
i
>t) =
2 M. Ahsanullah and G.G. Hamedani
P(X
1
>t, X
2
>t, . . . , X
n
>t) =
n
i=1
P(X
i
>t) =e
nt
, which is an exponential
random variable with parameter n.
Let N be a geometric random variable with probability mass function
P(N = k) = p q
k1
, k = 1, 2, . . . where p +q = 1. Now if X
i
s are indepen
dent and identically distributed with cumulative distribution function F(x) =
1 e
x
, x 0 and if V =
N
i=1
X
i
is the geometrically compounded random
variable, then pV
d
= X
i
_
d
= means equal in distribution
_
. To see this, let L(t)
be the Laplace transform of V, then
L(t) = E
_
E
_
e
tV
N
_
=
k=1
_
1+
t
_
k
pq
k1
=
_
1+
t
p
_
1
.
Thus, p V
d
= X
i
.
Suppose the random variable X has cumulative distributionfunction F (x) =
1 e
x
, x 0, and Y = [X], the integral part of X, then Y has the geometric
distribution with probability mass function P(Y = k) = pq
k
, k = 0, 1, . . . and
p = 1e
,
P(Y = y) = P(y X < y+1) = F(y+1) F (y)
= e
y
e
(y+1)
=
_
1e
_
e
y
.
Let X
k,n
denote the k
th
smallest of (X
1
, X
2
, . . ., X
n
). Note that X
k,n
is a func
tion of the sample variables, and hence is a statistic, called the k
th
order statistic.
Our goal in Chapter 2 is to study the distribution of the order statistics, their
properties and their applications. Note that the extreme order statistics are the
minimum and maximum values:
X
1,n
= min{X
1
, X
2
, . . ., X
n
}, andX
n,n
= max{X
1
, X
2
, . . ., X
n
}.
If X has cumulative distribution function F (x) = 1 e
x
, x 0, then 1
F
1,n
(x) = P(X
1,n
x) = e
nx
and F
n,n
(x) = P(X
n,n
x) =
_
1e
x
_
n
.
Record values arise naturally in many real life applications such as in sports,
environment, economics, business, to name a few. Let X be a random variable.
We keep drawing observations from X and, from time to time, an observation
will be larger than all the previously drawn observations: this observation is
Introduction 3
then called a record, and its value a record value, or, more precisely, an upper
record value. The rst observation is obviously a record. We call it the rst
record. The second upper record is the rst observation whose value is larger
than that of the rst one. We can dene the lower records similarly by consider
ing lower values. In Chapter 3 we will study record values, in particular when
the underlying random variable X has an exponential distribution.
Order statistics and record values are special cases of generalized order
statistics. Many of their properties can be obtained from the generalized or
der statistics. In chapter 4, we have presented generalized order statistics of
exponential distribution.
The problem of characterizing a distribution is an important problem which
has attracted the attention of many researchers in recent years. Consequently,
various characterization results have been reported in the literature. These char
acterizations have been established in many different directions. The goal of
Chapters 5 and 6 is to present characterizations of the exponential distribution
based on order statistics and based on generalized order statistics (Chapter 5) as
well as based on record values (Chapter 6).
For the sake of selfcontainment, we mention here some elementary deni
tions, which most of the readers may very well be familiar with them. The read
ers with knowledge of introduction to probability theory may skip this chapter
all together and go straight to the next chapter.
1.1. Preliminaries
Denition 1.1.1. A random or chance experiment is an operation whose
outcome cannot be predicted with certainty.
We denote a random experiment with E. Throughout this book experi
ment means random experiment.
4 M. Ahsanullah and G.G. Hamedani
Examples 1.1.2.
(a) Flipping a coin once.
(b) Rolling a die once.
Denition 1.1.3. The set of all possible outcomes of an experiment E is
called the sample space for E and is denoted by S.
Examples 1.1.4. Sample spaces corresponding to Examples (a) and (b)
above are:
S
a
={H, T}, H for heads and T for tails;
S
b
={1, 2, . . ., 6}.
Note that the set {even, odd} is also an acceptable sample space for E of
Example 1.1.2 (b), so sample space is not unique.
Event 1.1.5. An event is a collection of outcomes of an experiment. Hence
every subset of sample space is an event.
We denote events with capital letters A, B, C , . . . . We denote two events are
called mutually exclusive if they have no common elements.
Denition 1.1.6. A probabilityfunction is a realvalued set function dened
on the power set of S (P(S)), denoted by P, whose range is a subset of [0, 1],
i.e.
P : P(S) [0, 1] ,
satisfying the following Axioms of probability
(i) P(A) 0 for any A P(S).
(ii) P(S) = 1.
(iii) If A
1
, A
2
, . . . is a sequence (nite or innite) of mutually exclusive
events (subsets) of S ( or elements of P(S) ), then
P(A
1
A
2
) = P(A
1
) +P(A
2
) + .
Denition 1.1.7. A random variable (rv for short) is a realvalued function
dened on S, a sample space for an experiment E.
We denote rv
s with capital letters X,Y, Z, . . . (as mentioned before) and
their values with lower case letters x, y, z, . . .. Range of a rv X is the set of all
possible values of X and is denoted by R(X).
Denition 1.1.8. A rv X is called
(i) discrete if R(X) is countable;
(ii) continuous if R(X) is an interval and P(X = x) = 0, for all x R(X);
(iii) mixed if X is neither discrete nor continuous.
Denition 1.1.9. Let X be a rv. The cumulative distribution function (cd f )
of X denoted by F
X
is a realvalued function dened on R whose range is a
subset of [0, 1]. F
X
is dened by
F
X
(t) = P(X t), t R.
Properties of cd f F
X
:
(i) lim
t+
F
X
(t) =
0
1
;
(ii) F
X
is nondecreasing on R;
(iii) F
X
is rightcontinuous on R.
Proposition 1.1.10. The set of discontinuitypoints of a distributionfunction
is at most countable.
Remark 1.1.11. A point x is said to belong to the support of the cd f F if
and only if for every
> 0, F(x+) F (x) > 0. The set of all such points
is called the support of F and is denoted by Supp F.
We will restrict our attention, throughout this book, to continuous rv
s, in
particular exponential rv.
Denition 1.1.12. Let X be a continuous rv with cd f F
X
. Then the proba
bility density function (pd f ) of X (or pd f corresponding to cd f F
X
) is denoted
by f
X
and is dened by
f
X
(t) =
_
d
dt
F
X
(t), if derivative exists,
0, otherwise.
Remark 1.1.13. Since F
X
is continuous and nondecreasing, its derivative
exists for all t, except possibly for at most a countable number of points in R.
We dene f
X
(t) = 0 at those points.
6 M. Ahsanullah and G.G. Hamedani
Properties of pd f f
X
:
(i) f
X
(t) 0 for all t R;
(ii)
R
f
X
(t)dt = 1.
Denition 1.1.14. The rv X has an exponential distribution with location
parameter ( < < ) and scale parameter ( > 0) if its cd f is given by
F
X
(t) =
_
0, t < ,
1e
(t)
, t ,
where =
1
.
Graph of F
X
for = 0 and different values of
It is clear that
d
dt
F
X
(t) exists everywhere except at t = , so the corresponding
pd f of F
X
is given by
f
X
(t) =
_
e
(t)
, t > ,
0, otherwise,
Figure 1.1. Graph o f F
X
f or = 0 and di f f erent values o f .
Introduction 7
Graph of f
X
for = 0 and different values of
We use the notation X E (, ) for such a rv. The rv X E(0, ) will be de
noted by X E(). We use the notation X E(1) for the standard exponential
random variable.
Figure 1.2. Graph o f f
X
f or = 0 and di f f erent values o f .
We observe that the condition P(X > s +tX > s) = P(X >t) is equivalent
to 1 F (s +t) = (1F (s))(1F (t)). Now, if X is a nonnegative and non
degenerate rv satisfying this condition, then cd f of X will be F(x) = 1 e
x
,
x 0. To see this, note that condition 1 F (s +t) = (1F (s))(1F (t)) will
lead to the condition
1F (nx) = (1F (x))
n
, for all n 1 and all x 0,
that is, 1 F (x) =
_
1F(
x
n
)
_
n
. The solution of this last equation with bound
ary conditions F (0) = 0 and F () = 1 is F (x) = 1e
x
.
The hazard rate ( f (x)/(1F (x))) is constant for E(, ). In fact E(, )
is the only family of continuous distributions with constant hazard rate. It can
easily be shown that the constant () hazard rate of a continuous cd f F together
with boundary conditions F (0) = 0 and F () = 1 imply that F (x) = 1e
x
.
8 M. Ahsanullah and G.G. Hamedani
The linear exponential distribution with increasing hazard rate has pd f of
the form
f (x) = (+x) e
(x+x
2
/2)
, , > 0, x 0,
and the corresponding cd f is F (x) = 1 e
(x+x
2
/2)
, , > 0, x 0. The
hazard rate is +x. If = 0, then it is the exponential with cd f F (x) =
1e
x
.
If X E(), then P(X > s +tX > s) = P(X >t) for all s, t 0.
This property is known as memoryless property of the standard exponential
random variable (or distribution).
The p
th
quantile of a rv X is dened by F
1
(p). For X E(), we have
F
1
(p) =
ln(1p)
ln
_
4
3
_
,
ln2
and
ln4
respectively.
Denition 1.1.15. Let X be a continuous rv with pd f f
X
, then the r
th
mo
ment of X about the origin is dened by
r
= E[X
r
] =
R
x
r
f
X
(x)dx, r = 0, 1, . . . ,
provided the integral is absolutely convergent.
Note that throughout this book we will use the notation E[h(X)] =
R
h(x)dF
X
(x) for the expected value of the rv h(X).
Remarks 1.1.16.
(a)
0
= 1,
1
= E [X] is expected value or mean of X .
2
X
=
2
1
is
variance of X and
X
is standard deviation of X.
(b) The r
th
moment of X about
X
=
1
is dened by
r
= E[(X
X
)
r
] =
R
(x
X
)
r
f
X
(x) dx, r = 1, 2, . . . ,
provided the right hand side (RHS) exists. Note that
2
=
2
X
.
(c) It is easy to show that from
r
s one can calculate
r
s and vice versa.
In fact if the moments about any real number a are known, then moments about
Introduction 9
any other real number b can be calculated from those about a. Moments about
zero,
r
s , are the most common moments used.
Example 1.1.17. Let X E(). Find all the moments of X which exist.
Solution:
r
=
0
x
r
e
x
dx =
(r +1)
r
, r = 1, 2, . . . .
Denition 1.1.18. Let X be a continuous rv with pd f f
X
. The MGF (Mo
ment Generating Function) of X denoted by M
X
(t) is dened by
M
X
(t) = E
_
e
tX
R
e
tx
f
X
(x)dx,
for those t
s for which the RHS exists.
Properties of MGF :
(i) M
X
(0) = 1;
(ii) M
(r)
X
(0) =
r
, r = 1, 2, . . ., where M
(r)
X
(0) is the r
th
derivative of the
MGF evaluated at 0.
Example 1.1.19. For X E(, ), the MGF is
M
X
(t) =
e
tx
e
(x)
dx = e
t
0
e
(t)x
dx =e
t
(t)
1
, if t <,
from which we obtain
1
= M
(1)
X
(0) = +
1
2
= M
(2)
X
(0) =
2
+
2
+
2
2
.
So,
X
= +
1
,
2
X
=
2
+
2
+
2
2
(+
1
)
2
=
1
2
and
X
=
1
.
For X E(), M
X
(t) = (t)
1
, i f t < and
M
(r)
X
(t) = (r!)(t)
(r+1)
, for r = 1, 2, . . . ,
10 M. Ahsanullah and G.G. Hamedani
Then
r
=
r!
r
=
r
r1
, which is a recurrence relation for the moments of E().
The n
th
cumulant of a rv X is dened by K
n
=
d
n
dt
n
ln M
X
(t) 
t=0
. Here
ln
n
i=1
X
i
;
(ii) maximum likelihood estimator of is also
=
1
X
;
(iii) entropy of is 1ln .
For E(, ), the maximum likelihood estimators of and
are given by
= X
1,n
and
= 1/
_
X X
1,n
_
respec
tively, where, as mentioned before, X
1,n
= min{X
1
, X
2
, . . .,
X
n
}. The entropy of E(, ) denoted by EEE
X
is
EEE
X
=
_
ln
_
e
(x)
__
e
(x)
dx = 1ln,
which does not depend on location parameter . It is the same as the entropy of
the exponential distribution E().
Chapter 2
Order Statistics
2.1. Preliminaries and Denitions
Let X
1
, X
2
, . . . , X
n
be n independent and identically distributed (i.i.d.) rv
s with
common cd f F and pd f f . Let X
1,n
X
2,n
X
n,n
denote the order
statistics corresponding to
1
, X
2
, . . . , X
n
. We call X
k,n
, 1 k n, the k
th
or
der statistic based on a sample X
1
, X
2
, . . ., X
n
. The joint pd f of order statistics
X
1,n
, X
2,n
, . . ., X
n,n
has the form
f
1,2,...,n:n
(x
1
, x
2
, . . . , x
n
)
=
_
n!
n
k=1
f (x
k
), < x
1
< x
2
< < x
n
< ,
0, otherwise.
(2.1.1)
Let f
k:n
denote the pd f of X
k,n
. From (2.1.1) we have
f
k:n
(x)
=
. . .
f
1,2,...,n:n
(x
1
, . . ., x
k1
, x, x
k+1
, . . . , x
n
)dx
1
dx
k1
dx
k+1
dx
n
= n! f (x)
. . .
k1
j=1
f (x
j
)
n
j=k+1
f (x
j
)dx
1
dx
k1
dx
k+1
dx
n
, (2.1.2)
where the integration is over the domain
< x
1
< < x
k1
< x
k+1
< < x
n
<.
12 M. Ahsanullah and G.G. Hamedani
The symmetry of
k1
j=1
f (x
j
) with respect to x
1
, . . ., x
k1
and that of
n
j=k+1
f
(x
j
) with respect to x
k+1
, . . ., x
n
help us to evaluate the integral on the RHS of
(2.1.2) as follows:
. . .
k1
j=1
f (x
j
)
n
j=k+1
f (x
j
)dx
1
dx
k1
dx
k+1
dx
n
=
1
(k 1)!
k1
j=1
f (x
j
)dx
j
1
(nk)!
n
j=k+1
x
f (x
j
)dx
j
= (F(x))
k1
(1F (x))
nk
/(k 1)! (nk)!. (2.1.3)
Combining (2.1.2) and (2.1.3), we arrive at
f
k:n
(x) =
n!
(k 1)! (nk)!
(F(x))
k1
(1F (x))
nk
f (x). (2.1.4)
Clearly, equality (2.1.3) immediately follows from the corresponding formula
for cd f
r+1
j=1
(k( j)k( j 1) 1)!
r+1
j=1
(F (x
j
) F (x
j1
))
k( j)k(j1)1
r
j=1
f (x
j
),
if x
1
< x
2
< < x
r
,
and = 0, otherwise.
In particular, if r = 2, 1 i < j n, and x
1
< x
2
, then
f
i, j:n
(x
1
, x
2
) =
n!
(i 1)! ( j i 1)! (n j)!
(F(x
1
))
i1
[F (x
2
) F (x
1
)]
ji1
[1F (x
2
)]
nj
f (x
1
) f (x
2
).
Order Statistics 13
The conditional pd f of X
j,n
given X
i,n
= x
1
is
f
ji,n
(x
2
x
1
)
=
(ni)!
( j i 1)! (n j)!
_
F(x
2
) F (x
1
)
1F (x
1
)
_
ji1
_
1F (x
2
)
1F (x
1
)
_
nj
f (x
2
)
1F (x
1
)
.
Thus, X
j,n
given X
i,n
= x
1
is the ( j i)
th
order statistic in a sample of ni from
truncated distribution with cd f F
c
(x
2
x
1
) =
F(x
2
)F(x
1
)
1F(x
1
)
. For F (x) = 1 e
x
,
x 0, we will have F
c
(x
2
x
1
) = 1e
(x
2
x
1
)
, x
2
x
1
.
If X E(1) and Z
1,n
Z
2,n
Z
n,n
are the n order statistics corre
sponding to a sample of size n from X, then it can be shown that the joint pd f
of Z
1,n
, Z
2,n
, . . . , Z
n,n
is
f
1,2,...,n
(z
1
, z
2
, . . ., z
n
) =
_
n!e
(
n
i=1
z
i
)
, 0 z
1
z
2
z
n
<,
0, otherwise.
Using the transformation W
i
= (ni +1) (Z
i,n
Z
i1,n
), i = 1, 2, . . ., n with
Z
0,n
= 0, we obtain the joint pd f of W
1
, W
2
, . . . ,W
n
as
f
1,2,...,n
(w
1
, w
2
, . . . , w
n
) =
_
e
(
n
i=1
w
i
)
, 0 w
i
< , i = 1, 2, . . ., n,
0, otherwise.
Thus, W
1
, W
2
, . . . ,W
n
are i.i.d. exponential with cd f F (w) = 1e
w
, w 0.
Hence we can write
Z
k,n
d
=
W
1
n
+
W
2
n1
+ +
W
k
nk +1
, k = 1, 2, . . ., n, (2.1.5)
where W
i
s are i.i.d. with cd f F (x) = 1e
x
, x 0.
Clearly, nX
1,n
d
= X E(1). Since E[W
i
] = 1, Var [W
i
] = 1, from (2.1.5) it
follows that
E[Z
k,n
] =
k
i=1
E
_
W
i
ni +1
_
=
k
i=1
1
ni +1
,
Var [Z
k,n
] =
k
i=1
Var
_
W
i
ni +1
_
=
k
i=1
1
(ni +1)
2
, 1 k n,
14 M. Ahsanullah and G.G. Hamedani
and
Cov(Z
k,n
, Z
s,n
) =
k
i=1
Var
_
W
i
ni +1
_
=
k
i=1
1
(ni +1)
2
, k s.
Furthermore, letting
k
i,n
=E
_
X
k
i,n
_
, k 1, n 1, then we have the following
theorems (see, Joshi, (1978)).
Theorem 2.1.1.
k
1,n
=
k
n
k1
1,n
, k 1, n 1.
Proof.
k
1,n
=
0
x
k
ne
nx
dx = x
k
e
nx

0
+
0
kx
k1
e
nx
dx =
k
n
k1
1,n
.
Theorem 2.1.2.
k
i,n
=
k
i1,n1
+
k
n
k1
i,n
, k 1, 2 i n.
Proof. For k 1 and 2 i n,
k1
i,n
=
n!
(i 1)! (ni)!
0
x
k1
_
1e
x
_
i1
e
(ni+1)x
dx.
Integrating by parts, we obtain
k1
i,n
=
n!
(i 1)! (ni)!k
[
0
(ni +1) x
k
_
1e
x
_
i1
e
(ni+1)x
dx
0
(i 1)x
k
_
1e
x
_
i2
e
(ni+2)x
dx]
=
n!
(i 1)! (ni)!k
[n
0
x
k
_
1e
x
_
i1
e
(ni+1)x
dx
(i 1)
0
x
k
_
1e
x
_
i2
e
(ni+1)x
dx]
=
n
k
k
i,n
n
k
k
i1,n1
.
Thus,
k
i,n
=
k
i1,n1
+
k
n
k1
i,n
.
Order Statistics 15
Theorem 2.1.3. Let
i, j,n
= E[X
i,n
X
j,n
], 1 i < j n, then
i,i+1,n
=
2
i,n
+
1
ni
i,n
, 1 i n1,
and
i, j,n
=
i1, j,n
+
1
n j +1
i, j1,n
, 1 i < j n, j i 2.
Proof.
i,n
= E
_
X
i,n
X
0
i+1,n
=
n!
(i 1)! (ni +1)!
x
i
x
i
_
1e
x
i
_
i1
e
x
i
e
(ni)x
i+1
dx
i+1
dx
i
=
n!
(i 1)! (ni +1)!
0
x
i
_
1e
x
i
_
i1
e
x
i
I
x
i
dx
i
,
where
I
x
i
=
x
i
e
(ni)x
i+1
dx
i+1
= x
i+1
e
(ni)x
i+1

x
i
+(ni)
x
i
x
i+1
e
(ni)x
i+1
dx
i+1
.
Thus,
i,n
=
n! (ni)
(i 1)! (ni +1)!
x
i
x
i
x
i+1
_
1e
x
i
_
i1
e
x
i
e
(ni)x
i+1
dx
i+1
dx
i
n!
(i 1)! (ni +1)!
0
x
2
i
_
1e
x
i
_
i1
e
(ni+1)x
i
dx
i
= (ni)
i,i+1,n
(ni)
2
i,n
.
Upon simplication, we obtain
i,i+1,n
=
2
i,n
+
1
ni
i,n
, 1 i n1.
For j > i +1,
i, j1,n
= E
_
X
i,n
X
0
j1,n
n!
(i 1)! ( j i 1)! (ni +1)!
16 M. Ahsanullah and G.G. Hamedani
x
i
x
i
_
1e
x
i
_
i1
(e
x
i
e
x
j
)
ji1
e
x
i
e
(nj+1)x
j
dx
j
dx
i
=
n!
(i 1)! (ni 1)! (n j)!
0
x
i
_
1e
x
i
_
i1
e
x
i
J
x
i
dx
i
,
where
J
x
i
=
x
i
(e
x
i
e
x
j
)
ji1
e
(nj+1)x
j
dx
j
= (n j +1)
x
i
x
j
(e
x
i
e
x
j
)
ji1
e
(nj+1)x
j
dx
j
( j i 1)
x
i
(e
x
i
e
x
j
)
ji2
e
(nj+2)x
j
dx
j
.
Thus,
i, j1,n
=
n!
(i 1)! ( j i 1)! (n j)!
0
x
i
_
1e
x
i
_
i1
e
x
i
[(n j +1)
x
i
x
j
(e
x
i
e
x
j
)
ji1
e
(nj+1)x
j
dx
j
( j i 1)
x
i
(e
x
i
e
x
j
)
ji2
e
(nj+2)x
j
dx
j
]dx
i
= (n j +1)
i, j,n
(n j +1)
i1, j,n
.
Upon simplication, we arrive at
i, j,n
=
i1, j,n
+
1
n j +1
i, j1,n
, 1 i < j n, j i 2.
The relation, in this case, to uniform rv is interesting. If we let U be a
uniformly distributed rv on (0, 1) and U
i,n
is the i
th
order statistic from U, then
it can be shown that
X
i,n
d
=lnU
ni+1,n
or equivalently X
i,n
d
=ln(1U
i,n
).
Let
f
1,...,r1,r+1,...,nr
(x
1
, . . ., x
r1
, x
r+1
, . . . , x
n
v)
denote the joint conditional pd f of order statistics X
1,n
, . . ., X
r1,n
,
X
r+1,n
, . . ., X
n,n
given that X
r,n
= v. We suppose that f
r:n
(v) > 0 for this value of
Order Statistics 17
v, where f
r:n
,as usual, denotes the pd f of X
r,n
. The standard procedure gives us
the required pd f :
f
1,...,r1,r+1,...,nr
(x
1
, . . . , x
r1
, x
r+1
, . . ., x
n
v)
= f
1,2,...,n:n
(x
1
, . . . , x
r1
, v, x
r+1
, . . . , x
n
)/ f
r:n
(v). (2.1.6)
Upon substituting (2.1.1) and (2.1.4) in (2.1.6), we obtain
f
1,...,r1,r+1,...,nr
(x
1
, . . . , x
r1
, x
r+1
, . . ., x
n
v)
= (r 1)!
r1
j=1
f (x
j
)
F(v)
(n j)!
n
j=r+1
f (x
j
)
1F (v)
,
x
1
< < x
r1
< x
r+1
< < x
n
, (2.1.7)
and equal zero otherwise.
Finally, we would like to present Fishers Information, I, for the order statis
tics from E(). Fishers Information for a continuous random variable X with
pd f f (x, ) and parameter , under certain regularity conditions, is given by
I =E
_
2
2
ln( f (X, ))
_
.
The exponential distribution E () satises the regularity conditions and the
Fishers Information for order statistics from this distribution are as follows:
For X
1,n
,
I
1
= E
_
2
2
ln
_
ne
nX
_
_
=
1
2
.
For X
2,n
,
I
2
= E
_
2
2
ln{n(n1)(1e
X
)e
(n1)X
}
_
= E
_
1
2
+
X
2
e
X
(1e
X
)
2
_
18 M. Ahsanullah and G.G. Hamedani
=
0
_
1
2
+
x
2
e
x
(1e
x
)
2
_
n(n1)(1e
x
)e
(n1)x
dx
=
1
2
+
0
n(n1)
x
2
1e
x
e
nx
dx
=
1
2
+
2n(n1)
k=0
1
(n+k)
3
.
For X
r,n
, r > 2,
I
r
= E
_
2
2
ln
_
n!
(r 1)!(nr)!
(1e
X
)
r1
e
(nr+1)X
__
= E
_
1
2
+
(r 1)X
2
e
X
(1e
X
)
2
_
=
0
_
1
2
+
(r 1)X
2
e
X
(1e
X
)
2
_
n!
(r 1)!(nr)!
(1e
x
)
r1
e
(nr+1)x
dx
=
1
2
+
n!
(r 2)!(nr)!
0
x
2
(1e
x
)
r3
e
(nr+2)x
dx
=
1
2
+
n(nr +1)
(r 2)
(n1)!
(r 3)!(nr +1)!
0
x
2
(1e
x
)
r3
e
(nr+2)x
dx
=
1
2
+
n(nr +1)
(r 2)
2
E[X
2
r2,n
]
=
1
2
_
1+
n(nr +1)
(r 2)
_
r3
k=0
1
(nk)
2
+(
r3
k=0
1
nk
)
2
__
.
2.2. Minimum Variance Linear Unbiased Estimators
Based on Order Statistics
We will use MVLUEs for minimum variance linear unbiased estimators. Let us
begin from MVLUEs of location and scale parameters. Suppose that X has an
absolutely continuous cd f F of the form
F
_
(x)
_
, < < , > 0.
Order Statistics 19
Further, assume that
E[X
r,n
] = +
r
, r = 1, 2, . . ., n,
Var [X
r,n
] = v
rr
2
, r = 1, 2, . . ., n,
Cov(X
r,n
, X
s,n
) =Cov(X
s,n
, X
r,n
) = v
rs
2
, 1 r < s n.
Let
XXX
= (X
1,n
, X
2,n
, . . ., X
n,n
).
We can write
E [XXX] = 111+++, (2.2.1)
where
111 = (1, 1, . . ., 1)
,
= (
1
,
2
, . . . ,
n
)
,
and
Var (XXX) =
2
,
where
1
(111
111
1
_
X, (2.2.2)
and
=
1
_
111
1
(111
1
_
X, (2.2.3)
where
=
_
_
_
111
111
_
1
111
_
2
.
The variances and covariance of these estimators are given by
Var ( ) =
2
_
, (2.2.4)
Var ( ) =
2
_
111
1
111
_
, (2.2.5)
20 M. Ahsanullah and G.G. Hamedani
and
Cov( , ) =
2
_
1
111
_
. (2.2.6)
The following lemma (see Garybill, 1983, p. 198) will be useful in nding
the inverse of the covariance matrix.
Lemma 2.2.1. Let
= (
rs
) be an nn matrix with elements, which satisfy
the relation
rs
=
sr
= c
r
d
s
, 1 r, s n,
for some positive numbers c
1
, c
2
, . . ., c
n
and d
1
, d
2
, . . ., d
n
. Then its inverse
1
= (
rs
) has elements given as follows:
11
= c
2
/c
1
(c
2
d
1
c
1
d
2
),
nn
= d
n1
/d
n
(c
n
d
n1
c
n1
d
n
),
k+1k
=
kk+1
= 1/(c
k+1
d
k
c
k
d
k+1
),
kk
= (c
k+1
d
k1
c
k1
d
k+1
)/(c
k
d
k1
c
k1
d
k
)(c
k+1
d
k
c
k
d
k+1
),
k = 2, 3, . . ., n1,
and
i j
= 0, if i j > 1.
Let
f (x) =
_
_
1
_
exp((x) /), < < x < , 0 < <,
0, otherwise.
We have seen that
E[X
r,n
] = +
r
j=1
1
n j +1
Var [X
r,n
] =
2
r
j=1
1
(n j +1)
2
, r = 1, 2, . . ., n,
and
Cov(X
r,n
, X
s,n
) =
2
r
j=1
1
(n j +1)
2
, 1 r s n.
Order Statistics 21
One can write that
Cov(X
r,n
, X
s,n
) =
2
c
r
d
s
, 1 r s n,
where
c
r
=
r
j=1
1
(n j +1)
2
, 1 r n,
and
d
s
= 1, 1 s n.
Using Lemma 2.2.1, we obtain
j j
= (n j)
2
+(n j +1)
2
, j = 1, 2, . . ., n,
j+1 j
=
j j+1
= (n j)
2
, j = 1, 2, . . ., n1,
and
i j
= 0, if i j > 1, i, j = 1, 2, . . ., n.
It can easily be shown that
111
1
=
_
n
2
, 0, 0, . . ., 0
_
,
1
= (1, 1, . . ., 1)
and
= n
2
(n1).
The MVLUEs of the location and scale parameters and are respectively
=
nX
1,n
X
n1
, (2.2.7)
and
=
n
_
X X
1,n
_
n1
, (2.2.8)
where X =
n
r=1
X
r,n
n
.
The corresponding variances and covariance of the estimators are
Var [ ] =
2
n(n1)
, (2.2.9)
22 M. Ahsanullah and G.G. Hamedani
Var [ ] =
2
n1
, (2.2.10)
and
Cov( , ) =
2
n(n1)
. (2.2.11)
The remainder of this section will be devoted to MVLUEs based on cen
sored samples. We consider the case, when some smallest and largest obser
vations are missing. In this situation we construct the MVLUEs for location
and scale parameters. Suppose now that the smallest r
1
and largest r
2
of these
observations are lost and we can deal with order statistics
X
r
1
+1,n
X
nr
2
,n
.
We will consider here the MVLUEs of the location and scale parameters
based on X
r
1
+1,n
, . . . , X
nr
2
,n
.
Suppose that X has an absolutely continuous cd f F of the form
F((x)/), < < , > 0.
Further, we assume that
E[X
r,n
] = +
r
,
Var [X
r,n
] = v
rr
2
, r
1
+1 r nr
2
,
Cov(X
r,n
, X
s,n
) = v
rs
2
, r
1
+1 r, s nr
2
.
Let XXX
= (X
r
1
+1,n
, . . . , X
nr
2
,n
), then we can write
E
_
XXX
= 111+++,
with 111 === (1, 1, . . ., 1)
, === (
r
1
+1
, . . .,
nr
2
)
, and
Var
_
XXX
=
2
,
where
is an (nr
2
r
1
) (nr
2
r
1
) matrix with elements v
rs
, r
1
< r, s
nr
2
.
The MVLUEs of the location and scale parameters and based on the
order statistics XXX
are
=
1
1
(111
111
1
_
X, (2.2.12)
Order Statistics 23
and
=
1
_
111
1
(111
1
_
X, (2.2.13)
where
=
_
__
111
1
111
_
1
111
_
2
.
The variances and covariance of these estimators are given as
Var
_
=
2
_
, (2.2.14)
Var
_
=
2
_
111
1
111
_
, (2.2.15)
and
Cov
_
_
=
2
_
1
111
_
. (2.2.16)
Now, we consider the exponential distribution with cd f F as
F(x) = 1exp{(x)/}, < < x < , 0 < <.
Assume that the smallest r
1
and the largest r
2
observations are missing. Then
the MVLUEs of and , based on the order statistics X
r
1
+1,n
, . . . , X
nr
2
,n
, are
=
1
nr
2
r
1
1
_
nr
2
j=r
1
+1
X
j,n
(nr
1
)X
r
1
+1,n
+r
2
X
nr
2
,n
_
, (2.2.17)
= X
r
1
+1,n
r
1
+1
, (2.2.18)
where
r
1
+1
=
1
E[X
r
1
+1,n
] =
r
1
+1
j=1
1
n j +1
.
If r
1
= r
2
= 0, then (2.2.17) and (2.2.18) coincide with (2.2.8) and (2.2.7)
respectively. The variances and covariance of the estimators are:
Var
_
=
2
_
2
r
1
+1
nr
2
r
1
1
+
r
1
+1
j=1
1
(n j +1)
2
_
,
Var
_
=
2
nr
2
r
1
1
,
24 M. Ahsanullah and G.G. Hamedani
and
Cov
_
_
=
r
1
+1
2
nr
2
r
1
1
.
Sarhan and Greenberg (1967) prepared tables of the coefcients, Best Linear
Unbiased Estimators (BLUEs), variances and covariances of these estimators
for n up to 10.
2.3. Minimum Variance Linear Unbiased Predictors
(MVLUPs)
Suppose that X
1,n
, X
2,n
, . . . , X
r,n
are r (r < n) order statistics from a distribution
with location and scale parameters and respectively. Then the best (in the
sense of minimum variance) linear predictor
X
s,n
of X
s,n
(r < s n) is given by
X
s,n
= +
s
+WWW
s
VVV
1
(XXX 111 ),
where and are MVLUEs of and respectively, based on
XXX
= (X
1,n
, X
2,n
, . . . , X
r,n
),
s
= E [(X
s,n
)/] ,
and
WWW
s
= (W
1s
,W
2s
, . . .,W
rs
),
where
W
js
=Cov(X
j,n
, X
s,n
), j = 1, 2, . . ., r.
Here VVV
1
is the inverse of the covariance matrix of XXX
.
Suppose that for the exponential distribution with cd f
F(x) = 1exp{(x)/}, < < x < , 0 < <,
all the observations were available. We recall that
E[X
r,n
] = +
r
j=1
1
n j +1
,
Var [X
r,n
] =
2
r
j=1
1
(n j +1)
2
, r = 1, 2, . . ., n,
Order Statistics 25
and
Cov(X
r,n
, X
s,n
) =
2
r
j=1
1
(n j +1)
2
, 1 r s n.
To obtain MVLUEs for the case, when r
1
+r
2
observations are lost, we
need to deal with the covariance matrix
of size (nr
1
r
2
) (nr
1
r
2
),
elements of which coincide with
Cov(X
r,n
, X
s,n
) =
2
c
r
d
s
, r
1
+1 r s nr
2
,
where
c
r
=
r
j=1
1
(n j +1)
2
,
and
d
s
= 1.
We can obtain the inverse matrix
1
using Lemma 2.2.1 as
1
=
_
_
(nr
1
1)
2
+1/c
r
1
+1
(nr
1
1)
2
. . . 0
(nr
1
1)
2
(nr
1
2)
2
+(nr
1
1)
2
. . . 0
0 (nr
1
2)
2
. . . 0
0 0 . . . 0
.
.
.
.
.
. . . . 0
0 0 . . . (r
2
+1)
2
0 0 . . . (r
2
+1)
2
_
_
,
where
11
= (nr
1
1)
2
+1/c
r
1
+1
,
nr
1
r
2
nr
1
r
2
= (r
2
+1)
2
,
j j
= (nr
1
j)
2
+(nr
1
j +1)
2
, j = 2, 3, . . ., nr
1
r
2
1,
j+1 j
=
j j+1
=(nr
1
j)
2
, j = 1, 2, . . ., nr
1
r
2
1,
and
i j
= 0, for i j > 1, i, j = 1, 2, . . ., nr
1
r
2
.
26 M. Ahsanullah and G.G. Hamedani
Note also that we have
=== (
r
1
+1
, . . .,
nr
2
)
,
where
r
= E[(X
r,n
)/] =
r
j=1
1
n j +1
.
Simple calculations show that
1
=
_
r
1
+1
c
r
1
+1
(nr
1
1), 1, 1, . . ., 1, r
2
+1
_
,
1
===
2
r
1
+1
c
r
1
+1
+(nr
1
r
2
1),
1
111 =
r
1
+1
/c
r
1
+1
,
111
1
111 = 1/c
r
1
+1
,
111
1
===
r
1
+1
/c
r
1
+1
,
111
1
111
1
=
1
c
r
1
+1
_
r
1
+1
c
r
1
+1
(nr
1
1), 1, 1, . . ., r
2
+1
_
,
111
1
111
1
=
1
c
r
1
+1
_
r
1
+1
c
r
1
+1
, 0, 0, . . ., 0
_
,
=
_
__
111
1
111
_
1
111
_
2
= (nr
1
r
2
1)/c
r
1
+1
.
Upon simplication, we obtain
=
1
_
111
1
111
1
111
1
111
1
_
X
=
1
nr
2
r
1
1
_
nr
2
j=r
1
+1
X
j,n
(nr
1
)X
r
1
+1,n
+r
2
X
nr
2
,n
_
.
Analogously, from (2.2.12) and (2.2.14)(2.2.16) we have the necessary ex
pressions for
, Var
_
_
, Var
_
, and Cov
_
_
.
Order Statistics 27
2.4. Limiting Distributions
Let X
1
, X
2
, . . . , X
n
be i.i.d. exponentially distributed rv
s with cd f F (x) = 1
e
x
, x 0. Then with a sequence of real numbers a
n
=lnn and b
n
= 1, we have
P(X
n,n
a
n
+b
n
x) = P(X
n,n
lnn+x) =
_
1e
(lnn+x)
_
n
=
_
1
e
x
n
_
n
e
e
x
as n .
Thus the limiting distribution of X
n,n
with the constant a
n
= lnn and b
n
= 1
when X
j
s are E(1) is type 1 extreme value distribution. The numbers a
n
and b
n
are known as normalizing constants.
Remark 2.4.1. We know that if Y has type 1 extreme value distribution,
then E[Y] = , the Euler constant. Thus E[X
n,n
] lnn , as n . But
E[X
n,n
] =
n
j=1
1
nj+1
, so we have the known result,
n
j=1
1
nj+1
lnn , as
n .
For the derivation of the limiting distribution of X
1,n
, we need the following
lemma.
Lemma 2.4.2. Let (X
n
)
n1
be a sequence of i.i.d. rv
s with cd f F. Consider
a sequence (e
n
)
n1
of real numbers. Then for any , 0 < , the following
two statements are equivalent:
(a) lim
n
(nF (e
n
)) =;
(b) lim
n
P(X
1,n
> e
n
) = e
.
Since lim
n
_
n
_
1e
x
n
__
= e
x
, if X
j
s are i.i.d. E(1), then
lim
n
P
_
X
1,n
>
x
n
_
= e
e
x
.
Thus, the limiting distribution of X
1,n
with constants c
n
= 0 and d
n
= 1/n
when X
j
s are i.i.d. E(1) is type 3 extreme value distribution. Here again the
numbers c
n
and d
n
are normalizing constants.
Let us now consider the asymptotic distribution of X
nk+1,n
for xed k as n
tends to . It is given in the following theorem.
28 M. Ahsanullah and G.G. Hamedani
Theorem 2.4.3. Let X
1
, X
2
, . . . , X
n
be n i.i.d. rv
s with cd f F and X
nk+1,n
be their (nk +1)
th
order statistic. If for some stabilizing constants a
n
and b
n
(a
n
+b
n
x as n ), F
n
(a
n
+b
n
x) T (x) as n , for all x, for some
distribution T (x), then
P(X
nk+1,n
a
n
+b
n
x)
k1
j=0
T (x)(lnT (x))
j
/ j! as n ,
for any xed k and all x.
Proof. Let us consider a sequence (c
n
)
n1
such that as n , c
n
c. Then
lim
n
_
1
c
n
n
_
n
=e
c
. Take c
n
(x) =n(1F (a
n
+b
n
x)). Now, for every xed
x,
P(X
nk+1,n
a
n
+b
n
x) =
n
j=nk+1
_
n
j
_
(F (a
n
+b
n
x))
j
(1F (a
n
+b
n
x))
nj
=
k1
j=0
_
n
j
_
(c
n
(x)/n)
j
(1c
n
(x)/n)
nj
.
Thus, for each xed x, the RHS of the above equality can be considered as
the value of a binomial cd f with parameters n and c
n
(x)/n at k 1. Since
F
n
(a
n
+b
n
x) T (x), as n , we have
nln[1(1F (a
n
+b
n
x))] T (x), as n .
Thus, for sufciently large n, we have
nln[1(1F (a
n
+b
n
x))]
=n(1F (a
n
+b
n
x))
=c
n
(x) T (x), as n ,
from which we obtain lim
n
c
n
(x) = T (x) uniformly in x. Now, using Pois
son approximation to binomial, we arrive at
P(X
nk+1,n
a
n
+b
n
x)
k1
j=0
T (x)(lnT (x))/ j!, as n , for all x.
Order Statistics 29
For the special case of i.i.d. E(1) rv
s with a
n
= lnn and b
n
= 1, we have
F
n
(a
n
+b
n
x) e
e
x
, as n , for all x 0. We will then have
P(X
nk+1,n
a
n
+b
n
x)
k1
j=0
e
jx
j!
e
e
x
, as n , for all x 0.
The asymptotic distribution of X
k,n
for xed k as n is given by the
following theorem whose proof is similar to that of Theorem 2.4.3 and hence
will be omitted.
Theorem 2.4.4. Let X
1
, X
2
, . . ., X
n
be n i.i.d. rv
s with cd f F and X
k,n
be their k
th
order statistic. If for some stabilizing constants a
n
and b
n
(a
n
+b
n
x 0 as n ), F
n
(a
n
+b
n
x) G(x), as n , for all x, for some
distribution G(x), then
P(X
k,n
> a
n
+b
n
x)
k1
j=0
G(x)
_
lnG(x)
_
j
j!
, as n , for any xed k and all x.
Again, for the special case of i.i.d. E(1) rv
s with a
n
= 0 and b
n
= 1/n,
we have F
n
(a
n
+b
n
x) e
x
as n . But, in this case F
n
_
0+
1
n
x
_
= e
x
for
all n, and hence we will have
P(X
k,n
> a
n
+b
n
x) =
k1
j=0
G(x)
_
lnG(x)
_
j
j!
=
k1
j=0
e
x
x
j
j!
, for all x and all n.
Chapter 3
Record Values
3.1. Denitions of Record Values and Record Times
Suppose that (X
n
)
n1
is a sequence of i.i.d. rv
s with cd f F. Let Y
n
=
max(min){X
j
1 j n} for n 1. We say X
j
is an upper (lower) record
value of {X
n
n 1}, if X
j
> (<)Y
j1
, j > 1. By denition X
1
is an upper
as well as a lower record value. One can transform the upper records to
lower records by replacing the original sequence of (X
n
)
n1
by (X
n
)
n1
or
(if P(X
n
> 0) = 1 for all n) by (1/X
n
)
n1
; the lower record values of this se
quence will correspond to the upper record values of the original sequence.
The indices at which the upper record values occur are
given by the record times {U (n), n 1}, where U (n) =
min
_
j j >U(n1), X
j
> X
U(n1)
, n > 1
_
and U (1) = 1. The record times
of the sequence (X
n
)
n1
are the same as those for the sequence (F (X
n
))
n1
.
Since F (X) has a uniform distribution for rv X, it follows that the distribution
of U (n), n 1 does not depend on F. We will denote L(n) as the indices
where the lower record values occur. By our assumption U (1) = L(1) = 1.
The distribution of L(n) also does not depend on F.
3.2. The Exact Distribution of Record Values
Many properties of the record value sequence can be expressed in terms of the
function R(x) =lnF (x), 0 <F (x) <1. If we dene F
n
(x) as the cd f of X
U(n)
32 M. Ahsanullah and G.G. Hamedani
for n 1, then we have
F
1
(x) = P
_
X
U(1)
x
_
= F (x),
F
2
(x) = P
_
X
U(2)
x
_
=
j=1
(F (u))
j1
dF (u)dF(y)
=
dF(u)
1F (u)
dF (y) =
R(y)dF (y),
(3.2.1)
where R(x) =ln(1F (x)), 0 < F (x) < 1.
If F has a pd f f , then the pd f of X
U(2)
is
f
2
(x) = R(x) f (x). (3.2.2)
The cd f
F
3
(x) = P
_
X
U(3)
x
_
=
j=0
(F (u))
j
R(u)dF(u)dF (y)
=
R(u)
1F (u)
dF (u)dF (y) =
(R(u))
2
2!
dF (u). (3.2.3)
The pd f f
3
of X
U(3)
is
f
3
(x) =
(R(x))
2
2!
f (x). (3.2.4)
It can similarly be shown that the cd f F
n
of X
U(n)
is
F
n
(x) =
(R(u))
n1
(n1)!
dF(u), < x < . (3.2.5)
This can be expressed as
F
n
(x) =
R(x)
u
n1
(n1)!
e
u
du, < x < ,
and
F
n
(x) = 1F
n
(x) = F (x)
n1
j=0
(R(x))
j
j!
= e
R(x)
n1
j=0
(R(x))
j
j!
.
Record Values 33
The pd f f
n
of X
U(n)
is
f
n
(x) =
(R(x))
n1
(n1)!
f (x), < x < . (3.2.6)
Note that F
n
(x) F
n1
(x) =
F(x)
f (x)
f
n
(x), and for E(), F
n
(x) F
n1
(x) =
n1
x
n1
(n)
e
x
.
A rv X is said to be symmetric about zero if X and X have the same
distribution function. If f is their pd f , then f (x) = f (x) for all x. Two
rv
s X and Y with cd f
s f and g exist,
then f (x) = g(x) for all x. If a sequence of i.i.d. rv
s, X
U(n)
and X
L(n)
are identically distributed.
The joint pd f f (x
1
, x
2
, . . . , x
n
) of the n record values X
U(1)
, X
U(2)
, . . . , X
U(n)
is given by
f (x
1
, x
2
, . . ., x
n
)
=
n1
j=1
r (x
j
) f (x
n
), < x
1
< x
2
< < x
n1
< x
n
< , (3.2.7)
where, as before,
r (x) =
d
dx
R(x) =
f (x)
1F (x)
, 0 < F(x) < 1.
The joint pd f of X
U(i)
and X
U( j)
is
f
i j
(x
i
, x
j
) =
(R(x
i
))
i1
(i 1)!
r (x
i
)
[R(x
j
) R(x
i
)]
ji1
( j i 1)!
f (x
j
),
for < x
i
< x
j
< . (3.2.8)
In particular, for i = 1 and j = n we have
f
1n
(x
1
, x
n
) = r (x
1
)
[R(x
n
) R(x
1
)]
n2
(n2)!
f (x
n
), for < x
1
< x
n
< .
34 M. Ahsanullah and G.G. Hamedani
The conditional pd f of X
U( j)
X
U(i)
= x
i
is
f (x
j
x
i
) =
f
i j
(x
i
, x
j
)
f
i
(x
i
)
=
[R(x
j
) R(x
i
)]
ji1
( j i 1)!
f (x
j
)
1F (x
i
)
, for < x
i
< x
j
< . (3.2.9)
For j = i +1
f (x
i+1
x
i
) =
f (x
i+1
)
1F (x
i
)
, for < x
i
< x
i+1
<. (3.2.10)
For i > 0, 1 k < m, the joint conditional pd f of X
U(i+k)
and X
U(i+m)
given
X
U(i)
is
f
(i+k)(i+m)
_
x, yX
U(i)
= z
_
=
1
(mk)
1
(k)
[R(y) R(x)]
mk1
[R(x) R(z)]
k1
f (y)r (x)
F (z)
,
for < z < x < y <.
The marginal pd f of the n
th
lower record value can be derived by using the
same procedure as that of the n
th
upper record value. Let H(u) = lnF (u),
0 < F (u) < 1 and h(u) =
d
du
H(u), then
P
_
X
L(n)
x
_
=
(H(u))
n1
(n1)!
dF(u), (3.2.11)
and corresponding pd f f
(n)
can be written as
f
(n)
(x) =
(H(x))
n1
(n1)!
f (x). (3.2.12)
The joint pd f of X
L(1)
, X
L(2)
, . . . , X
L(m)
can be written as
f
(1)(2)...(m)
(x
1
, x
2
, . . . , x
m
)
=
_
m1
j=1
h(x
j
) f (x
m
), < x
m
< x
m1
< < x
1
<,
0, otherwise.
(3.2.13)
Record Values 35
The joint pd f of X
L(i)
and X
L( j)
is
f
(i)( j)
(x, y) =
(H(x))
i1
(i 1)!
[H(y) H (x)]
ji1
( j i 1)!
h(x) f (y),
j > i and < y < x <. (3.2.14)
Using the transformation U = H(y) and V = H(x)/H(y) in (3.2.14), it
can easily be shown that V is distributed as B
i, ji
(x), where B
m,n
(x) =
B(m, n)x
m1
(1x)
n1
and B(m, n) is the Beta function.
Proceeding as in the case of upper record values, we can obtain the condi
tional pd f
1
exp
_
1
(x)
_
, x ,
0, otherwise,
(3.2.15)
where and ( > 0) are parameters.
The corresponding cd f F and the hazard rate r of the rv X with pd f (3.2.15)
are respectively
F (x) = 1exp
_
1
(x)
_
, x ,
and
r (x) = f (x)/(1F (x)) =
1
. (3.2.16)
Again, as before, we will denote the ex
ponential distribution with pd f (3.2.15) with
E(, ), the exponential distribution ( = 0, = 1/) with E(), and the
standard exponential distribution with E (1).
For E (, ),the joint pd f of X
U(m)
and X
U(n)
, m < n is
f
m,n
(x, y)
=
_
n
(m)
(x)
m1 (yx)
nm1
(nm)
exp
_
1
(y)
_
, x < y <,
0, otherwise.
(3.2.17)
It is easy to see that,in this case,
_
X
U(n)
X
U(n1)
_
and
_
X
U(m)
X
U(m1)
_
are
i.d. for 1 < m < n <.
36 M. Ahsanullah and G.G. Hamedani
It can be shown that X
U(m)
d
= X
U(m1)
+U, (m > 1) where U is independent
of X
U(m)
and X
U(m1)
and is identically distributed as X
1
if and only if X
1
E(). For E(1)with n 1,
P
_
X
U(n+1)
> wX
U(n)
_
=
wx
x
n1
(n)
e
y
dydx
=
0
x
n1
(n)
e
wx
dx = w
n
.
The conditional pd f of X
U(n)
given X
U(m)
= x is
f (yx) =
_
mn
(yx)
nm1
(nm)
exp
_
1
(yx)
_
, x < y <,
0, otherwise.
(3.2.18)
Thus, P
__
X
U(n)
X
U(m)
_
= yX
U(m)
= x
_
does not depend on x. It can be shown
that if = 0, then X
U(n)
X
U(m)
is identically distributed as X
U(nm)
, m < n.
We take = 0 and = 1 and let T
n
=
n
j=1
X
U( j)
. Since
T
n
= X
U(n)
X
U(n1)
+2
_
X
U(n1)
X
U(n2)
_
+
+(n1)
_
X
U(2)
X
U(1)
_
+nX
U(1)
=
n
j=1
jW
j
,
where W
j
s are i.i.d.E(1), the characteristic function of T
n
can be written as
n
(t) =
n
j=1
1
1 jt
. (3.2.19)
Inverting (3.2.19), we obtain the pd f f
T
n
of T
n
as
f
T
n
(u) =
n
j=1
1
( j)
(1)
nj
(n j +1)
e
u/ j
j
n2
. (3.2.20)
Theorem 3.2.1. Let (X
n
)
n1
be a sequence of i.i.d. rv
s are
independent.
Record Values 37
Proof. The joint pd f of X
U(1)
, X
U(2)
, . . . , X
U(m)
is
f (x
1
, x
2
, . . ., x
m
) =
_
m1
j=1
x
j
_
e
x
m
, 0 < x
1
< x
2
< < x
m
<.
Let us now use the transformation
0
= X
U(1)
and
j
=
X
U( j)
X
U( j+1)
, j = 1, 2, . . ., m1.
The Jacobian of the transformation is
J =
_
X
U(1)
, X
U(2)
, . . ., X
U(m)
_
(
0,
1
, . . .,
m1
)
=
m1
0
m
1
m1
2
. . .
2
m1
.
We can write the pd f of
j
, j = 0, 1, . . ., m1, as
f (e
0
, e
1
, . . . , e
m1
) =
m
e
m1
0
e
m
1
e
m1
2
e
2
m1
e
(e
0
/(e
1
e
2
e
m1
))
.
Now, integrating the above expression with respect to e
0
, we obtain the joint
pd f of
j
, j = 1, 2, . . ., m1, as
f (e
1
, e
2
, . . . , e
m1
) =(m)e
2
e
m2
m1
.
Thus
j
, j = 1, 2, . . ., m1 are independent and
P(
j
x) = x
j
, 1 j m.
Since R(x) = x for the standard exponential distribution, the pd f of
j
=
X
U( j)
/X
U( j+1)
, j = 1, 2, . . ., m1 can easily be obtained.
Corollary 3.2.2. Let W
j
= (
j
)
j
, j = 1, 2, . . ., m 1, then W
j
, j =
1, 2, . . ., m1 are i.i.d. U (0, 1) (uniform over the unit interval ) random vari
ables.
Finally, the Fishers Information for the n
th
record of E() is n/
2
.
38 M. Ahsanullah and G.G. Hamedani
3.3. Moments of Record Values
Without any loss of generality we will consider in this section the standard ex
ponential distribution E(1), with pd f f (x) = exp(x), x > 0, for which we
also have f (x) = 1 F(x). We already know that X
U(n)
,in this setting, can be
written as the sum of n i.d. rv
s V
1
,V
2
, ..,V
n
with common distribution E (1).
Further, we have also seen that
E
_
X
U(n)
= n,
Var
_
X
U(n)
= n,
and
Cov
_
X
U(n)
, X
U(m)
_
= m, m < n. (3.3.1)
For m < n,
E
_
X
p
U(n)
X
q
U(m)
_
=
u
0
1
(m)
1
(nm)
u
q
e
x
v
m+p1
(uv)
nm1
dvdu.
Substituting tu = v and simplifying we get
E
_
X
p
U(n)
X
q
U(m)
_
=
0
1
(m)
1
(nm)
u
n+p+q1
e
x
t
m+p1
(1t)
nm1
dtdu
=
(m+p) (n+p+q)
(m)(n+p)
.
Using (3.2.19), it can be shown that for T
n
=
n
j=1
X
U( j)
, we have
E[T
n
] = n(n+1)/2 and Var [T
n
] = n(n+1)(2n+1)/6.
Some simple recurrence relations satised by single and product moments
of record values are given by the following theorem.
Theorem 3.3.1. For n 1 and k = 0, 1, . . .
E
_
X
k+1
U(n)
_
= E
_
X
k+1
U(n1)
_
+(k +1)E
_
X
k
U(n)
_
, (3.3.2)
Record Values 39
and consequently, for 0 m n1 we can write
E
_
X
k+1
U(n)
_
= E
_
X
k+1
U(m)
_
+(k +1)
n
j=m+1
E
_
X
k
U( j)
_
, (3.3.3)
with E
_
X
k+1
U(0)
_
= 0 and E
_
X
0
U(n)
_
= 1.
Proof. For n 1 and k = 0, 1, . . ., we have
E
_
X
k
U(n)
_
=
1
(n)
0
x
r
(R(x))
n1
f (x)dx
=
1
(n)
0
x
k
(R(x))
n1
(1F (x))dx, ( f (x) = 1F (x)).
Upon integration by parts, treating x
k
for integration and the rest of the integrand
for differentiation, we obtain
E
_
X
k
U(n)
_
=
1
(k +1)(n)
_
0
x
k1
(R(x))
n1
f (x)dx(n1)
0
x
k+1
(R(x))
n2
f (x)dx
_
=
1
k +1
_
0
x
k+1
1
(n)
(R(x))
n1
f (x)dx
0
x
k+1
1
(n1)
(R(x))
n2
f (x)dx
_
=
1
k +1
_
E
_
X
k+1
U(n)
_
E
_
X
k+1
U(n1)
__
,
which, when rewritten, gives the recurrence relation (3.3.2). Then repeated
application of (3.3.2) will derive the recurrence relation (3.3.3).
Remark 3.3.2. The recurrence relation (3.3.2) can be used in a simple way
to compute all the simple moments of all the record values. Once again, using
property that f (x) = 1 F(x), we can derive some simple recurrence relations
for the product moments of record values.
Theorem 3.3.3. For m 1 and p, q = 0, 1, 2, . . .
E
_
X
p
U(m)
X
q+1
U(m+1)
_
= E
_
X
p+q+1
U(m)
_
+(q+1)E
_
X
p
U(m)
X
q
U(m+1)
_
, (3.3.4)
40 M. Ahsanullah and G.G. Hamedani
and for 1 m n2, p, q = 0, 1, 2, . . .
E
_
X
p
U(m)
X
q+1
U(n)
_
= E
_
X
p
U(m)
X
q+1
U(n1)
_
+(q+1)E
_
X
p
U(m)
X
q
U(n)
_
, (3.3.5)
Proof. Let us consider 1 m < n and p, q = 0, 1, 2, . . .
E
_
X
p
U(m)
X
q
U(n)
_
=
1
(m)(nm)
0
x
p
(R(x))
m1
r (x)I (x)dx, (3.3.6)
where
I (x) =
x
y
q
[R(y) R(x)]
nm1
f (y)dy
=
x
y
q
[R(y) R(x)]
nm1
(1F (y))dy, since f (y) = 1F (y).
Upon performing integration by parts, treating y
q
for integration and the rest of
the integrand for differentiation, we obtain, when n = m+1, that
I (x) =
1
q+1
_
x
y
q+1
f (y)dyx
q+1
(1F (x))
_
,
and when n m+2, that
I (x) =
1
q+1
_
x
y
q+1
{R(y) R(x)}
nm1
f (y)dy
(nm1)
x
y
q+1
{R(y) R(x)}
nm2
f (y)dy
_
.
Substituting the above expression of I (x) in equation (3.3.6) and simplifying,
we obtain, when n = m+1 that
E
_
X
p
U(m)
X
q
U(m+1)
_
=
1
q+1
_
E
_
X
p
U(m)
X
q+1
U(m+1)
_
E
_
X
p+q+1
U(m)
__
,
and when n m+2, that
E
_
X
p
U(m)
X
q
U(n)
_
=
1
q+1
_
E
_
X
p
U(m)
X
q+1
U(n)
_
E
_
X
p
U(m)
X
q+1
U(n1)
__
.
The recurrence relations (3.3.4) and (3.3.5) follow readily when the above two
equations are rewritten.
Record Values 41
Remark 3.3.4. By repeated application of the recurrence relation (3.3.5),
with the help of the relation (3.3.4), we obtain, for n m+1, that
E
_
X
p
U(m)
X
q+1
U(n)
_
= E
_
X
p+q+1
U(m)
_
+(q+1)
n
j=m+1
_
X
p
U(m)
X
q
U( j)
_
. (3.3.7)
Corollary 3.3.5. For n m+1,
Cov
_
X
U(m)
, X
U(n)
_
=Var
_
X
U(m)
.
Proof. By setting p = 1 and q = 0 in (3.3.7), we obtain
E
_
X
U(m)
X
U(n)
= E
_
X
2
U(m)
_
+(nm) E
_
X
U(m)
. (3.3.8)
Similarly, by setting p = 0 in (3.3.3), we obtain
E
_
X
U(n)
= E
_
X
U(m)
E
_
X
U(m)
E
_
X
U(n)
= E
_
X
2
U(m)
_
+(nm) E
_
X
U(m)
_
E
_
X
U(m)
_
2
(nm) E
_
X
U(m)
=Var
_
X
U(m)
.
Corollary 3.3.6. By repeated applicationof the recurrence relations (3.3.4)
and (3.3.5), we also obtain for m 1
E
_
X
p
U(m)
X
q+1
U(m+1)
_
=
q+1
j=0
(q+1)
( j)
E
_
X
p+q+1j
U(m)
_
,
and for 1 m n2
E
_
X
p
U(m)
X
q+1
U(n)
_
=
q+1
j=0
(q+1)
( j)
E
_
X
p
U(m)
X
q+1j
U(n1)
_
,
where
(q+1)
(0)
= 1 and (q+1)
( j)
= (q+1)q (q+1 j +1) , for j 1.
42 M. Ahsanullah and G.G. Hamedani
Remark 3.3.7. The recurrence relations (3.3.4) and (3.3.5) can be used in
a simple way to compute all the product moments of all record values.
Theorem 3.3.8. For m 2 and p, q = 0, 1, 2, . . .,
E
_
X
p+1
U(m1)
X
q
U(m)
_
= E
_
X
p+q+1
U(m)
_
(p+1)E
_
X
p
U(m)
X
q
U(m+1)
_
, (3.3.10)
and for 2 m n2 and p, q = 0, 1, 2, . . .,
E
_
X
p+1
U(m1)
X
q
U(n1)
_
= E
_
X
p+1
U(m)
X
q
U(n1)
_
(p+1) E
_
X
p
U(m)
X
q
U(m+1)
_
.
(3.3.11)
Proof. For 2 m n and p, q = 0, 1, 2, . . .,
E
_
X
p
U(m)
X
q
U(n)
_
=
0
x
p
y
q
f
mn
(x, y)dxdy
=
1
(m1)! (nm1)!
0
y
q
f (y)J (y)dy, (3.3.12)
where
J (y) =
y
0
x
p
{ln(1F (x))}
m1
{ln(1F (x)) +ln(1F (y))}
nm1
f (x)
1F (x)
dx
=
0
x
p
{ln(1F (x))}
m1
{ln(1F (x)) +ln(1F (y))}
nm1
dx,
since f (x) = 1 F (x). Upon integration by parts, treating x
p
for integration
and the rest of the integrand for differentiation, we obtain, for n = m+1, that
J (y) =
1
p+1
_
y
p+1
{ln(1F (y))}
m+1
_
(m1)
y
0
x
p+1
{ln(1F (x))}
m2
f (x)
1F (x)
dx,
Record Values 43
and when n m+2, that
J (y) =
1
p+1
[(nm1)
y
0
x
p+1
{ln(1F (x))}
m1
f (x)
1F (x)
{ln(1F (y)) +ln(1F (x))}
nm2
dx
(m1)
y
0
x
p+1
{ln(1F (x))}
m2
f (x)
1F (x)
{ln(1F (y)) +ln(1F (x))}
m2
dx].
Now, substituting the above expression of J (y) in equation (3.3.12) and simpli
fying, we obtain, for n = m+1, that
E
_
X
p
U(m)
X
q
U(n)
_
=
1
p+1
_
E
_
X
p+q+1
U(m)
_
E
_
X
p+1
U(m1)
X
q
U(m)
__
,
and for n m+2 that
E
_
X
p
U(m)
X
q
U(n)
_
=
1
p+1
_
E
_
X
p+1
U(m)
X
q
U(n)
_
E
_
X
p+1
U(m1)
X
q
U(n1)
__
.
The recurrence relations (3.3.10) and (3.3.11) follow readily when the above
two equations are rewritten.
Corollary 3.3.9. By repeated application of the recurrence relation
(3.3.11), with the help of (3.3.10), we obtain for 2 m n 1 and p,
q = 0, 1, 2, . . .
E
_
X
p+1
U(m1)
X
q
U(n1)
_
= E
_
X
p+q+1
U(n1)
_
(p+1)
n1
j=m
E
_
X
p
U( j)
X
q
U(n)
_
.
Corollary 3.3.10. By repeated application of the recurrence relations
(3.3.10) and (3.3.11), we also obtain for m 2 that
E
_
X
p+1
U(m1)
X
q
U(m)
_
=
p+1
j=0
(1)
j
(p+1)
( j)
E
_
X
p+q+1j
U(m+j)
_
,
and for 2 m n2 that
E
_
X
p+1
U(m1)
X
q
U(n1)
_
=
p+1
j=0
(1)
j
(p+1)
( j)
E
_
X
p+1j
U(mj)
X
q
U(n+1j)
_
,
44 M. Ahsanullah and G.G. Hamedani
where (1+p)
( j)
is as dened earlier.
It is also important to mention here that this approach can easily be adopted
to derive recurrence relations for product moments involving more than two
record values.
3.4. Estimation of Parameters
We shall consider here the linear estimations of and .
(a) Minimum Variance Linear Unbiased Estimator (MVLUE)
Suppose X
U(1)
, X
U(2)
, . . ., X
U(m)
are the m record values from an i.i.d. se
quence of rv
_
, i =
1, 2, . . ., m. Then
E[Y
i
] = i =Var [Y
i
] , i = 1, 2, . . ., m,
and
Cov(Y
i
,Y
j
) = min{i, j}.
Let
XXX =
_
X
U(1)
, X
U(2)
, . . . , X
U(m)
_
,
then
E[XXX] = LLL+,
Var [XXX] =
2
VVV,
where
LLL = (1, 1, . . ., 1)
, = (1, 2, . . ., m)
,
VVV = (V
i j
), V
i j
= min{i, j}, i, j = 1, 2, . . ., m.
The inverse VVV
1
=
_
V
i j
_
can be expressed as
V
i j
=
_
_
2 if i = j = 1, 2, . . ., m1,
1 if i = j = m,
1 if i j = 1, i, j = 1, 2, . . ., m,
0, otherwise.
Record Values 45
The MLVLUEs , of and respectively are
=
VVV
1
_
LLL
LLL
_
VVV
1
XXX///,
= LLL
VVV
1
_
LLL
LLL
_
VVV
1
XXX///,
where
=
_
L
VVV
1
L
__
VVV
1
_
LLL
VVV
1
_
2
,
and
Var [ ] =
2
LLL
VVV
1
///,
Var [ ] =
2
LLL
VVV
1
LLL///,
Cov( , ) =
2
LLL
VVV
1
///.
It can be shown that
LLL
VVV
1
= (1, 0, 0, . . ., 0),
VVV
1
= (0, 0, . . ., 0, 1),
VVV
1
= m and = m1.
Upon simplication we get
=
_
mX
U(1)
X
U(m)
_
/(m1),
=
_
X
U(m)
X
U(1)
_
/(m1),
(3.4.1)
with
Var [ ] = m
2
/(m1), Var [ ] =
2
/(m1) and
Cov( , ) =
2
/(m1). (3.4.2)
(b) Best Linear Invariant Estimator (BLIE)
The best linear invariant (in the sense of minimum mean squared error and
invariance with respect to the location parameter ) estimators, BLIEs, ,
of
and are
=
_
E
12
1+E
12
_
,
46 M. Ahsanullah and G.G. Hamedani
and
= /(1+E
12
),
where and are MVLUEs of and and
_
Var[ ] Cov( , )
Cov( , ) Var[ ]
_
=
2
_
E
11
E
12
E
21
E
22
_
.
The mean squared errors of these estimators are
MSE[] =
2
_
E
11
E
2
12
(1+E
22
)
1
_
,
and
MSE[
] =
2
E
22
(1+E
22
)
1
.
We have
E[()(
)] =
2
E
12
(1+E
22
)
1
.
Using the values of E
11
, E
12
and E
22
from (3.4.2), we obtain
=
_
(m+1)X
U(1)
X
U(m)
_
/m,
=
_
X
U(m)
X
U(1)
_
/m,
Var [] =
2
_
m
2
+m1
_
/m,
and
Var [
] =
2
(m1)/m
2
.
3.5. Prediction of Record Values
We will predict the s
th
upper value based on the rst m record values for s > m.
Let
WWW
= (W
1
,W
2
, . . . ,W
m
),
where
2
W
i
=Cov
_
X
U(i)
, X
U(s)
_
, i = 1, 2, . . ., m,
and
=
1
E
_
X
U(s)
.
Record Values 47
The best linear unbiased predictor of X
U(s)
is
X
U(s)
, where
X
U(s)
= +
+WWW
VVV
1
(XXX LLL ),
and are MVLUEs of and respectively. It can be shown that WWW
VVV
1
(XXX
LLL ) = 0, and hence
X
U(s)
=
_
(s 1)X
U(m)
+(ms)X
U(1)
_
/(m1), (3.5.1)
E[
X
U(s)
] = +s,
Var[
X
U(s)
] =
2
_
m+s
2
2s
_
/(m1),
MSE[
X
U(s)
] = E[(
X
U(s)
X
U(s)
)
2
] =
2
(s m)(s 1) /(m1).
Let
X
U(s)
be the best linear invariant predictor of X
U(s)
. Then it can be shown
that
X
U(s)
=
X
U(s)
C
12
(1+E
22
)
1
, (3.5.2)
where
C
12
2
=Cov
_
,
_
LLLWWW
VVV
1
LLL
_
+
_
WWW
VVV
1
_
_
and
2
E
22
=Var[ ].
Upon simplication, we get
X
U(s)
=
ms
m
X
U(1)
+
s
m
X
U(m)
,
E
_
X
U(s)
_
= +
_
ms +ms
m
_
,
Var
_
X
U(s)
_
=
2
_
m
2
+ms
2
s
2
_
/m,
MSE
_
X
U(s)
_
= MSE[
X
U(s)
] +
(s m)
2
m(m1)
2
=
s (s m)
m
2
.
It is wellknown that the best (unrestricted) least square predictor of X
U(s)
is
X
U(s)
= E
_
X
U(s)
X
U(1)
, . . . , X
U(m)
= X
U(m)
+(s m) . (3.5.3)
48 M. Ahsanullah and G.G. Hamedani
But
X
U(s)
depends on the unknown parameter . If we substitute the minimum
variance unbiased estimate for , then
X
U(s)
becomes equal to
X
U(s)
. Now
E[
X
U(s)
] = +s = E
_
X
U(s)
,Var[
X
U(s)
] = m
2
and
MSE[
X
U(s)
] = E[(
X
U(s)
X
U(s)
)
2
] = (s m)
2
.
We like to mention also that by considering the mean squared errors of
X
U(s)
,
X
U(s)
and
X
U(s)
, it can be shown that
MSE[
X
U(s)
] = E[(
X
U(s)
X
U(s)
)
2
] = (s m)
2
.
3.6. Limiting Distribution of Record Values
We have seen that for = 0 and = 1, E
_
X
U(n)
= n and Var
_
X
U(n)
= n.
Hence
P
_
X
U(n)
n
n
x
_
= P
_
X
U(n)
n+x
n
_
=
n+x
n
0
x
n1
e
x
(n)
dx, (3.6.1)
= p
n
(x), say.
Let
(x) =
1
e
t
2
/2
dt.
The following table gives values of p
n
(x) for various values of n and x
and values of (x) for comparison.
Record Values 49
Table 1. Values of p
n
(x)
_
_
n\x 2 1 0 1 2
5 0.0002 0.1468 0.5575 0.8475 0.9590
10 0.0046 0.1534 0.5421 0.8486 0.9601
15 0.0098 0.1554 0.5343 0.8436 0.9653
25 0.0122 0.1568 0.5243 0.8427 0.9684
45 0.0142 0.1575 0.5198 0.8423 0.9698
(x) 0.0226 0.1587 0.5000 0.8413 0.9774
_
_
Thus for large values of n, (x) is a good approximation of p
n
(x).
Finally, the entropy of n
th
upper record value X
U(n)
is
n+ln(n) ln(n1)(n),
where (n) is the digamma function, (n) =
n
(n)
e
x
(ln(n) nln+x(n1)lnx)dx
= ln(n) nln+n(n1){ln+(n)}
= n+ln(n)ln(n1)(n).
Chapter 4
Generalized Order Statistics
In this chapter we will consider some of the basic properties of the generalized
order statistics from exponential distribution. We shall present some inferences
based on the distributional properties of the generalized order statistics.
4.1. Denition
The concept of generalized order statistics (gos) was introduced by Kamps
(1995) in terms of their joint pd f . The order statistics, record val
ues and sequential order statistics are special cases of the gos. The rv
s
X (1, n, m, k), X(2, n, m, k), . . ., X (n, n, m, k), k > 0, m R, are n gos from
an absolutely continuous cd f F with corresponding pd f f if their joint pd f
f
1,2,...,n
(x
1
, x
2
, . . ., x
n
) can be written as
f
1,2,...,n
(x
1
, x
2
, . . . , x
n
)
= k
_
n1
j=1
j
__
n1
j=1
(1F (x
j
))
m
f (x
j
)
_
(1F (x
n
))
k1
f (x
n
),
F
1
(0+) < x
1
< < x
n
< F
1
(1), (4.1.1)
where
j
= k + (n j)(m+1) 1 for all j, 1 j n, kis a positive integer
and m 1. A more general form of (4.1.1), again due to Kamps, with a new
notation for the joint pd f will be given in Chapter 5.
52 M. Ahsanullah and G.G. Hamedani
If k =1 and m = 0, then X (s, n, m, k) reduces to the ordinary s
th
order statis
tic and (4.1.1) will be the joint pd f of the n order statistics X
1,n
X
2,n
X
n,n
. If k = 1 and m =1, then (4.1.1) will be the joint pd f of the rst n upper
record values of the i.i.d. rv
s with cd f F and pd f f .
Integrating out x
1
, x
2
, . . ., x
s1
, x
s+1
, .., x
n
from (4.1.1) we obtain the pd f
f
s,n,m,k
of X (s, n, m, k)
f
s,n,m,k
(x) =
c
s
(s 1)!
(1F (x))
s
1
f (x)g
s1
m
(F (x)), (4.1.2)
where c
s
=
s
j=1
j
and
g
m
(x) =
_
1
(m+1)
_
1(1x)
m+1
_
, m =1,
ln(1x) , m =1, x (0, 1).
Since lim
m1
1
m+1
_
1(1x)
m+1
_
= ln(1x) , we will write g
m
(x) =
1
m+1
_
1 (1x)
m+1
_
, for all x (0, 1) and for all m with g
1
(x) =
lim
m1
g
m
(x).
4.2. Generalized Order Statistics of Exponential
Distribution
Recall that pd f of X E(, ), is given by
f (x) =
_
1
exp
_
1
(x)
_
, x > , > 0,
0, otherwise.
(4.2.1)
Lemma 4.2.1. Let (X
i
)
i1
be a sequence of i.i.d. rv
s from E (, ), then
1
X (1, n, m, k) E (
1
, ) and X (s, n, m, k)
d
= +
s
j=1
W
j
j
, where
W
j
E(0, 1) = E(1) for all j
s.
Proof. From (4.1.2), pd f f
s,n,m,k
of X (s, n, m, k), in this case, is
f
s,n,m,k
(x) =
c
s
(s 1)!
1
_
e
1
(x)
s
_
g
s1
m
_
1e
1
(x)
_
. (4.2.2)
Generalized Order Statistics 53
For s = 1, we obtain pd f of X (1, n, m, k) via (4.2.2) as
f
1,n,m,k
(x) =
1
1
_
e
1
(x)
1
_
, x > .
Thus, X (1, n, m, k) E
_
,
1
1
_
and
1
X (1, n, m, k) E(
1
, ).
The moment generating function of X (s, n, m, k), denoted by M
s,n,m,k
is (us
ing
(4.2.2))
M
s,n,m,k
(t)
=
e
tx
c
s1
(s 1)!
1
_
e
1
(x)
s
_
g
s1
m
_
1e
1
(x)
_
dt
=
c
s1
(s 1)!
e
t
0
e
(
s
t)y
_
1
m+1
(1exp((m+1)y))
_
s1
dy. (4.2.3)
Using the following property (see, Gradsheyn and Ryzhik, (1980), p. 305)
0
e
ay
_
1e
by
_
s1
dy =
1
b
B
_
a
b
, s
_
,
where B(, ) is the Beta function, and the fact that
s
+ j (m+1) =
sj
, we
obtain from (4.2.3)
M
s,n,m,k
(t) =
c
s1
(s 1)!
e
t
(s 1)!
s
j=1
j
_
1
t
j
_
= e
t
s
j=1
_
1
t
j
_
1
. (4.2.4)
Thus
X (s, n, m, k)
d
= +
s
j=1
W
j
j
. (4.2.5)
Remarks 4.2.2. (a) For = 0, from Lemma 4.2.1, we have
1
X (1, n, m, k) E (0, ).
(b) For k = 1, m = 0, from (4.2.5), we obtain the following wellknown
result for order statistics for i.i.d. rv
s from E(, )
X
s,n
d
= +
s
j=1
W
j
/(n j +1). (4.2.6)
54 M. Ahsanullah and G.G. Hamedani
(c) From (4.2.6) it follows that
s
{X (s, n, m, k)X (s 1, n, m, k)}
E(0, ). This property can also be obtained by considering the joint pd f
of X (s, n, m, k) and X (s 1, n, m, k) and using the transformation U
1
=
X (s 1, n, m, k) and T
s
=
s
{X (s, n, m, k)X (s 1, n, m, k)}.
(d) For k = 1 and m =1, we obtain X
U(s)
= +
s
j=1
W
j
.
For X E(, ), we have from(4.2.5), E[X (s, n, m, k)] =+
s
j=1
1
j
and
the recurrence relation
E[X (s, n, m, k)] E [X (s 1, n, m, k)] =
s
.
Let
D(1, n, m, k) =
1
X (1, n, m, k),
D(s, n, m, k) =
s
X (s, n, m, k)X (s 1, n, m, k), 2 s n,
then for X E() all the D( j, n, m, k), j = 1, 2, . . ., n are i.i.d. E(). Thus, we
have the obvious recurrence relation
E[D(s, n, m, k)] = E[D(s 1, n, m, k)] .
For k = 1 and m = 0, it coincides with the known results corresponding to
order statistics. For k = 1 and m = 1, it coincides with the known results of
upper record values.
In the remainder of this section we would like to present two recurrence
relations for the moments (single moments and product moments) of gos from
the standard exponential distribution E(1).
The joint pd f of X (r, n, m, k) and X (s, n, m, k), denoted by f
r,s,n,m,k
(x, y) is
(see p. 68 of Kamps (1995))
f
r,s,n,m,k
(x, y) =
c
s
(r 1)! (s r 1)!
(1F (x))
m
f (x)
g
r1
m
(F (x))[h(F (y)) h(F (x))]
sr1
(1F (y))
s
f (y), (4.2.7)
where
h(x) =
_
1
m+1
(1x)
m+1
, m = 1,
ln(1x), m = 1.
Generalized Order Statistics 55
Theorem 4.2.3. For E (1) and s > 1
E
_
(X (s, n, m, k))
p+1
= E
_
(X (s 1, n, m, k))
p+1
_
+
p+1
s
E[(X (s, n, m, k))
p
] ,
and consequently for s > r
E
_
(X (s, n, m, k))
p+1
=E
_
(X (r, n, m, k))
p+1
_
+
s
j=r+1
p+1
j
E[(X ( j, n, m, k))
p
] .
Proof. We have
E[(X (s, n, m, k))
p
] =
0
x
p
c
s
(s 1)!
e
s
x
g
s1
m
_
1e
x
_
dx
=
s
c
s
(p+1) (s 1)!
x
p+1
e
s
x
g
s1
m
_
1e
x
_
dx
0
c
s
(s 1)
(p+1)(s 1)!
x
p+1
e
s
x
g
s2
m
_
1e
x
_
e
(m+1)
dx
=
s
(p+1)
_
E
_
(X (s, n, m, k))
p+1
E
_
(X (s 1, n, m, k))
p+1
__
,
from which the result follows.
For k = 1 and m = 1, Theorem 4.2.3 coincides with Theorem 3.3.1. For
k = 1 and m = 0, we obtain
E
_
(X
s,n
)
p+1
_
= E
_
(X
s1,n
)
p+1
_
+
p+1
ns +1
E[(X
s,n
)
p
]
and consequently
E
_
(X
s,n
)
p+1
_
= E
_
(X
s1,n
)
p+1
_
+
s
j=r+1
p+1
n j +1
E[(X
j,n
)
p
] .
Letting p = 0, in the last equation, we have
E[X
s,n
] = E [X
1,n
] +
s
j=2
1
n j +1
,
56 M. Ahsanullah and G.G. Hamedani
that is,
E [X
s,n
] =
s
j=1
1
n j +1
.
Theorem 4.2.4. For E (1), 1 r < s n and p, q = 0, 1, 2, . . . we have
E
_
(X(r, n, m, k))
p
(X (s, n, m, k))
q+1
_
= E
_
(X (r, n, m, k))
p
(X (s 1, n, m, k))
q+1
_
+
q+1
s
E[(X (r, n, m, k))
p
(X (s, n, m, k))
q
] .
Proof. We have
E[(X (r, n, m, k))
p
(X (s, n, m, k))
q
]
=
0
c
s
(r 1)! (s r 1)!
e
(m+1)x
g
r1
m
_
1e
x
_
I (x)dx, (4.2.8)
where
I (x) =
x
y
q
_
1
m+1
_
1e
(m+1)y
_
1
m+1
_
1e
(m+1)x
_
_
sr1
e
s
y
dy
=
s
q+1
x
y
q+1
_
1
m+1
_
1e
(m+1)y
_
1
m+1
_
1e
(m+1)x
_
_
sr1
e
s
y
dy
1
q+1
x
y
q+1
_
1
m+1
_
1e
(m+1)y
_
1
m+1
_
1e
(m+1)x
_
_
sr2
e
s1
y
dy.
Upon substituting for I (x) in (4.2.8), we obtain
E[(X (r, n, m, k))
p
(X (s, n, m, k))
q
]
=
s
q+1
E
_
(X (r, n, m, k))
p
(X (s, n, m, k))
q+1
_
E
_
(X (r, n, m, k))
p
(X (s 1, n, m, k))
q+1
_
.
Generalized Order Statistics 57
Thus,
E
_
(X(r, n, m, k))
p
(X (s, n, m, k))
q+1
_
= E
_
(X (r, n, m, k))
p
(X (s 1, n, m, k))
q+1
_
+
q+1
s
E[(X (r, n, m, k))
p
(X (s, n, m, k))
q
] .
For k = 1 and m = 1, Theorem 4.2.4 coincides with Theorem 3.3.3. For
k = 1 and m = 0, we obtain from Theorem 4.2.4
E
_
X
p
r,n
X
q+1
s,n
= E
_
X
p
r,n
X
q+1
s1,n
_
+
q
ns +1
E
_
X
p
r,n
X
q
s1,n
_
.
Estimation of and
Minimum Variance Linear Unbiased Estimators (MVLUEs)
Lemma 4.2.5. Let
and
be the MVLUEs of and respectively, based
on n gos X (1, n, m, k), X(2, n, m, k), . . ., X (n, n, m, k) from an absolutely contin
uous cd f F with pd f f . Then
= X (1, n, m, k)(
/
1
)
and
=
1
n1
_
n
j=1
(
j
j+1
)X ( j, n, m, k)
1
X (1, n, m, k)
_
, with
n+1
= 0,
Var
_
_
= n
2
/(n1)
2
1
,Var
_
_
=
2
/(n1),
Cov
_
_
=
2
/(n1)
1
.
Proof. It is not hard to show that
E[X (s, n, m, k)] = +
s
,
Var [X (s, n, m, k)] =
2
V
s
, for 1 s n,
58 M. Ahsanullah and G.G. Hamedani
where
s
=
s
j=1
1
j
, V
s
=
s
j=1
1
2
j
. Let
XXX = (X (1, n, m, k), X (2, n, m, k), . . . , X(n, n, m, k)),
then
E [XXX] = 1+,
Cov(X ( j, n, m, k), X (i, n, m, k)) =
2
V
i
, 1 i < j n,
Var [XXX] =
2
VVV,
where, as in Chapter 3, 111is an n 1vector of units, === (
1
,
2
, . . .,
n
), VVV ===
(V
i j
) and V
i j
=V
i
for 1 j n.
Let ===VVV
1
=
_
V
i j
_
, then
V
ii
=
2
i
+
2
i+1
, i = 1, 2, . . ., kn,
n+1
= 0,
V
i+1i
=V
ii+1
=
i+1
,
V
i j
= 0, for i j > 1.
The MVLUEs
and
respectively are (see, David, (1981))
VVV
1
(111
111
)VVV
1
XXX///,
= 111
VVV
1
(111
111
)VVV
1
XXX///,
where
= (111
VVV
1
111)))(
VVV
1
))) (111
VVV
1
)))
2
.
We also have
Var
_
_
=
2
VVV
1
, Var
_
_
=
2
111
VVV
1
111///,
and
Cov
_
_
=
2
111
VVV
1
///.
Generalized Order Statistics 59
It can easily be shown that
111
VVV
1
= (
1
, 0, 0, . . ., 0),
VVV
1
= (
1
2
,
2
3
, . . . ,
n1
n
,
n
),
VVV
1
= n, 111
VVV
1
111 =
2
1
, 111
VVV
1
=
1
and = (n1)
2
1
.
Now,
111
VVV
1
(111
111
)VVV
1
XXX/// =
1
(111
VVV
1
111
111
VVV
1
111
)VVV
1
XXX
=
1
(
2
1
VVV
1
XXX
1
111
VVV
1
XXX) =
1
n1
(
VVV
1
XXX
1
X (1, n, m, k)).
Hence
=
1
n1
_
n
j=1
(
j
j+1
)X ( j, n, m, k)
1
X (1, n, m, k)
_
.
We can write
=
1
1
111
+ccc
, where
ccc
=
_
0,
1
2
,
1
2
+
1
3
,
1
2
+
1
3
+
1
4
, . . . ,
n
j=2
1
j
_
.
Thus
=ccc
VVV
1
(111
111
)VVV
1
XXX///
1
.
We have
ccc
VVV
1
111 = 0, ccc
VVV
1
= n1 and hence
= X (1, n, m, k)
1
.
If k = 1 and m = 0, then
j
=n j +1 and
and
coincide with MVLUEs
given by order statistics (see, Arnold et al., (1992), p. 176). If k = 1 and
m = 0, then
j
= 1 and
and
coincide with MVLUEs given by Ahsanullah,
((1980), p.466).
60 M. Ahsanullah and G.G. Hamedani
The variances and covariance of
and
are
Var
_
_
=
2
VVV
1
) = n
2
/(n1)
2
1
,
Var
_
_
=
2
VVV
1
111) =
2
/(n1),
Cov
_
_
=
VVV
1
111) =
2
/(n1)
1
.
Best Linear Invariant Estimators (BLIEs)
The best linear invariant (in the sense of minimum mean squared error and in
variance with respect to the location parameter )
and
of and are
_
E
12
1+E
22
_
and
=
/(1+E
22
),
where
and
are MVLUEs of and and
_
_
Var[
] Cov
Cov
Var[
]
_
_
=
2
_
E
11
E
12
E
21
E
22
_
.
The mean squared errors of these estimators are
MSE
_
_
=
2
_
E
11
E
2
12
(1+E
22
)
1
_
and
MSE
_
_
=
2
E
22
(1+E
22
)
1
.
Substituting the values of E
12
and E
22
in the above equations, we have, on sim
plication, that
=
+
1
n
1
and
=
n1
n
,
MSE
_
_
=
n+1
n
2
1
and MSE
_
_
=
1
n
2
.
Generalized Order Statistics 61
Prediction of X (s, n, m, k)
We shall assume that s > n. Let = (
1
,
2
, . . .,
n
) where
j
= Cov(X(s, n, m, k), X( j, n, m, k)), j = 1, 2, . . ., n and
1
E[X (x, n, m, k)]. The best linear unbiased predictor (BLUP)
X (s, n, m, k) of X (s, n, m, k) is
X (x, n, m, k) =
+
+VVV
1
(XXX
111
),
where
and
are the MVLUEs of and respectively. But
=
s
and
= (V
1
,V
2
, . . . ,V
n
). It can be shown that
VVV
1
= (0, 0, . . ., 0, 1) and hence
X (s, n, m, k) =
+
s
+X (n, n, m, k)
= X (n, n, m, k)+(
s
n
)
. (4.2.9)
If k = 1 and m = 0, then
j
= n j +1 and
X (s, n, m, k) coincides with the
BLUP based on the order statistics (see, Arnold et al. (1992), p. 181). If k = 1
and m = 1, then
j
= 1 and
X (s, n, m, k) coincides with the BLUP based on
record values (see, Ahsanullah (1980), p. 467).
We have
E[
X (x, n, m, k)] = +(
s
n
),
Var[
X(x, n, m, k)] =
2
V
n
+(
s
n
)
2
2
n1
+2(
s
n
)Cov(
X(n, n, m, k),
)
=
2
__
1
2
1
+ +
1
2
n
_
+
1
n1
_
1
n+1
+
1
s
_
2
+
2
n1
_
1
n+1
+ +
1
s
__
1
2
+ +
1
n
__
,
MSE[
X(x, n, m, k)] = E[(
X (x, n, m, k)X (s, n, m, k))
2
]
= E[(X(n, n, m, k)X (x, n, m, k)+(
s
n
)
)
2
]
=
2
_
V
n
+V
s
2V
n
+(
s
n
)
2
1
n1
_
=
2
_
V
s
V
n
+(
s
n
)
2
(n1)
1
_
.
If k =1 and m=1, then the BLUP
X
U(s)
of the s
th
upper record value from
62 M. Ahsanullah and G.G. Hamedani
(4.2.9) is
X
U(s)
=
(x1) X
U(n)
(s n)X
U(1)
(n1)
, (4.2.10)
and
E[
X
U(n)
] =
2
_
m+s
2
2s
_
/(m1). (4.2.11)
Let
X (x, n, m, k) be the best linear invariant predictor of X (s, n, m, k). Then
X (s, n, m, k) =
X (s, n, m, k)
c
12
1+c
22
, (4.2.12)
where
c
12
2
=Cov(
,
_
1
VVV
1
111
_
+
_
VVV
1
) and c
22
2
=Var[
].
It can easily be shown that c
12
= (
s
n
)/(n1) and since c
22
= 1/(n1),
we have
c
12
1+c
22
=
s
n
n
. Thus
X (s, n, m, k) =
X (s, n, m, k)
n
n
= X (n, n, m, k)+
n1
n
(
s
n
)
(4.2.13)
E[
X (s, n, m, k)] = +
_
s
+
s
n
n
_
(4.2.14)
and
Var[
X(s, n, m, k)] =
2
_
V
n
+
_
n1
n
_
2
(
s
n
)
2
1
n1
_
=
2
_
n
+
n1
n
2
(
s
n
)
2
_
. (4.2.15)
The bias term is
E[
s
)+
n1
n
(
s
n
)
=
1
n
(
s
n
).
Generalized Order Statistics 63
Thus,
MSE[
n
+
n1
n
2
(
s
n
)
2
_
+
_
1
n
(
s
n
)
_
2
=
2
_
n
+
1
n
(
s
n
)
2
_
= MSE[
X (s, n, m, k)]
1
n(n1)
(
s
n
)
2
.
For k = 1 and m = 0, we obtain
E[
X
U(s)
] = +
_
s +
s n
n
_
,
Var[
X
U(s)
] =
2
_
n
2
+ns s
2
n
2
_
.
Chapter 5
Characterizations of
Exponential Distribution I
5.1. Introduction
The more serious work on characterizations of exponential distribution based
on the properties of order statistics, as far as we have gathered, started in early
sixties by Ferguson (1964,1965), Tanis (1964), Basu (1965), Crawford (1966)
and Govindarajulu (1966). Most of the results reported by these authors were
based on the independence of suitable functions of order statistics. Chan (1967)
reported a characterization result based on the expected values of extreme order
statistics. The goal of this chapter is rst to review characterization results re
lated to the exponential distribution based on order statistics (Section 5.2) and
then based on generalized order statistics (Section 5.3). We will discuss these
results in the chronological order rather than their importance. We apologize in
advance if we missed to report some of the existing pertinent results.
Let X
1
and X
2
be two i.i.d. random variables with common cd f F (x) and let
X
(1)
= min{X
1
, X
2
} and X
(2)
= max{X
1
, X
2
}. Basu (1965) showed that if F(x)
is absolutely continuous with F(0) = 0, then a necessary and sufcient condi
tion for F to be the cd f of an exponential random variable with parameter ,
is that the random variables X
(1)
and
_
X
(2)
X
(1)
_
are independent. Freguson
(1964) and Crawford (1966) also used the property of independence of X
(1)
and
(X
1
X
2
) to characterize the exponential distribution. Puri and Rubin (1970)
66 M. Ahsanullah and G.G. Hamedani
showed that X
(2)
X
(1)
X
1
( means having the same distribution) charac
terizes the exponential distribution among the class of absolutely continuous
distributions. Seshardi et al. (1969) reported a characterization of the expo
nential distributionbased on the identical distributionof an (n1)dimensional
random vector of random variables V
r
= S
r
/S
n
, r = 1, 2, . . ., n 1, where S
r
is
the r
th
partial sum of the random sample, and vector of order statistics of n 1
i.i.d. U (0, 1) random variables. Cs org o et al. (1975) and Menon and Seshardi
(1975) pointed out that the proof given in Seshardi et al. was incorrect and
presented a new proof. Puri and Rubin (1970) established a characterization
of the exponential distribution based on the identical distribution of X
s,n
X
r,n
and X
sr,nr
(these rv
j=1
Y
j
(n j +1)
,
for any k N (the set of all positive integers ) such that 1 k n, where the Y
j
s
( j = 1, 2, . . ., k) are i.i.d. with cd f F.
Galambos (1972) and Rossberg (1972) presented characterizations of the
exponential distributions by the independence of certain functions of order
statistics. Here we state Rossbergs result which has an interesting proof based
on complex analysis.
Theorem 5.2.4. Let (F) = inf{x : F (x) > 0} > . Suppose that for
some xed r, n N, 2 r n, the Laplace transform
e
sx
dF
r1
(x) is non
zero for all s C (the set of all complex numbers) with Re(s) > 0. Then
D
r,n
E(1) if and only if X
1
(F) E(1).
Rossberg pointed out that the assumption concerning the Laplace transform
cannot be dropped since D
r,n
E(1) is satised by underlying distributions
68 M. Ahsanullah and G.G. Hamedani
other than exponential. He then gave the following example to demonstrate this
point. Let
F (x) = 1e
x
_
1+
4
2
(1cos (x))
_
, 2
2, x 0,
then D
r,n
E(1), but the corresponding Laplace transformhas zeros in {s C:
Re(s) > 0}.
We would like to point out that Arnolds result (Theorem 5.2.2 above) re
quires kX
1,k
E () for two different values of k and Gupta (1973) requires
lim
x0
(F (x)/x) = for some 0 < < . Furthermore, Huang (1974)
showed that Desus (1971) result is readily improved by special cases of char
acterization theorems in Chan (1967) and Huang (1974) as follows:
Theorem 5.2.5. If F does not degenerate at the origin, and if
E[nX
1,n
] = E[X
1
] < , for n = 2, 3, . . .,
then F is an exponential distribution function.
Remark 5.2.6. Huang (1974) showed that despite his assumption of
E[X
1
] <, this assumption is less restrictive than Desus (Theorem 5.2.1) con
dition. He then presented two stronger versions of Theorem 5.2.5 as stated
below in Theorems 5.2.5
and 5.2.5
.
Theorem 5.2.5
s, then F is
exponential.
Theorem 5.2.5
j=1
(n j +1)
1
for n = n
1
, n
2
, . . ., where n
i
s are distinct positive integers with
i=1
n
1
i
= ,
then F is exponential.
Characterizations of Exponential Distribution I 69
Kotz (1974) and Galambos (1975) discussed rather extensively the charac
terizations of distributions including the exponential distributionby order statis
tics. Ahsanullah (1975) reported a characterization of the exponential distribu
tion based on identical distribution of nX
1,n
and the spacing X
n,n
X
n1,n
and
then generalized his result in his (1976) paper as follows.
Theorem 5.2.7. Let X be a nonnegative random variable with an abso
lutely continuous (with respect to the Lebesgue measure) strictly increasing
distribution F (x) for all x > 0, and F (x) < 1, for all x. Then the following
properties are equivalent:
(a) X has an exponential distribution;
(b) X has a monotone hazard rate and for one i and one n with 2 i n,
the random variables D
1,n
and D
i,n
are i.d.
Arnold and Ghosh (1976) presented characterizations of exponential distri
bution based on the conditional distributions of the spacings. These results were
later extended by Rao and Shanbhag (1994), which will be stated later in this
section.
Let F be the cd f of a nonnegative random variable and let, as before,
F (x) = 1 F (x),for x 0. We will call F new better than used (NBU), if
F (x+y) F (x)F (y), x, y 0, and F is new worse than used (NWU) if
F (x+y) F (x)F (y), x, y 0. We will say that F belongs to the class C, if F
is either NBU or NWU. Using these concepts, Ahsanullah (1977) established
the following characterization of the exponential distribution.
Theorem 5.2.8. Let X be a nonnegative random variable with an abso
lutely continuous (with respect to the Lebesgue measure) cd f F which is strictly
increasing on [0, ). Then the following properties are equivalent:
(a) X has an exponential distribution;
(b) for some i and n, 1 i < n, the random variables D
i+1,n
and X are i.d.
and F belongs to class C.
Gather (1989) pointed out that the weaker condition of NBU or NWU were
assumed in Theorem 5.2.8. However, there is a gap in the proof and the desired
result can be obtained for the special case r = n.
70 M. Ahsanullah and G.G. Hamedani
Let F be cd f of a nonnegative random variable X. Then F has increas
ing failure rate (IFR) (decreasing failure rate (DFR)) if
[1F(x+y)]
[1F(x)]
is decreasing
(increasing) on the support of Ffor all y 0. For the class of IFR(DFR) distribu
tions, Ahsanullah (1978a) showed that D
1,n
D
r+1,n
is sufcient to characterize
exponential distribution. If F is absolutely continuous with pd f f , then F is IFR
(DFR) if its failure rate
f (x)
F(x)
is increasing (decreasing) on the support of F. In
Ahsanullah (1978a), below, we nd that D
r,n
D
s,n
is a characteristic property
of the exponential distribution if F is absolutely continuous.
Theorem 5.2.9. Let F be absolutely continuous, strictly increasing on
(0, ), and IFR or DFR. Then F E() if and only if there exists a triple
(r, s, n), 2 r < s n, with D
r,n
D
s,n
.
Again let F be an absolutely continuous cd f of a nonnegative random vari
able with pd f f , and with hazard rate r (x) =
f (x)
F(x)
, for x 0, and F(x) > 0. We
will say that F has increasing hazard rate (IHR) if r (x) r (x+y), x, y 0 and
F has decreasing hazard rate (DHR) if r (x) r (x+y), x, y 0. We say that F
belongs to class D if F is either IHR or DHR. Using these concepts, Ahsanullah
(1978b) presented the following characterization of the exponential distribution.
Theorem 5.2.10. Let X be a nonnegative random variable with an abso
lutely continuous (with respect to the Lebesgue measure) cd f F which is strictly
increasing on [0, ). Then the following properties are equivalent:
(a) X has an exponential distribution;
(b) for some i, j and n, 1 i < j < n, the random variables D
i,n
and D
j,n
are i.d. and F belongs to class D.
Property nX
1,n
X
1
is studied in more general setting by Shimizu (1979) as
stated below.
Theorem 5.2.11. Let m, n
1
, . . . , n
m
N, c, a
1
, . . . , a
m
> 0 with
_
c > max
1km
a
k
, if m > 1,
c = a
1
, if m = 1
Characterizations of Exponential Distribution I 71
and let
_
be the uniquely determined positive real number with
m
k=1
a
k
= c
, if m > 1,
> 0 arbitrary, if m = 1.
Let the trivial case m = n
1
= a
1
= 1 be excluded. Let
_
X
(k)
j
_
1jn
k
, 1km
be i.i.d. random variables with distribution function F satisfying 0 = F (0) <
F (x) < 1 for some x > 0, and X
(k)
1,n
k
= min
1jn
k
X
(k)
j
. Then
min
1km
_
cn
1/
k
a
k
X
(k)
1,n
k
_
F
if and only if
F (x) =
_
1exp(x
H(lnx)), x 0,
0, x < 0,
where H is a positive, bounded function with periods A
k
=ln(cn
1/
k
/a), 1 k
m.
As pointed out by Gather et al. (1997), the above general setting reduces to
the case c = = 1 via the monotone transformation X
(k)
j
_
cX
(k)
j
_
. Davies
and Shanbhag (1987) pointed out that the proof can be simplied by applying
the integrated Cauchy functional equation. As corollaries to Theorem 5.2.11,
characterizations of exponential distribution result without assuming continuity
of F. One of these corollaries is due to Shimizu (1979) which is stated below.
Corollary 5.2.12. Let F be as in Theorem 5.2.11, a
1
, a
2
, . . . , a
n
> 0 with
n
k=1
a
k
= 1 and lna
i
/lna
j
irrational for some i , j {1, 2, . . ., n}. Then F
E() if and only if min
1kn
X
k
/a
k
F.
Huang et al. (1979) restated Seshardi et al. (1965) result as follows.
Theorem 5.2.13. Let F have mean 1/, 0 < < , and X
1
> 0, n 3. Let
S
n
=
n
i=1
X
i
and V
1
= X
1
/S
n
,V
2
= (X
1
+X
2
)/S
n
. Then F E() if and only
if (V
1
,V
2
) (U
1,n1
,U
2,n1
), where U
i,n1
, i = 1, 2 are order statistics from
U (0, 1).
72 M. Ahsanullah and G.G. Hamedani
Bell and Sarma (1980), presented a characterization of the exponential dis
tribution based on the properties of linear transformations of order statistics and
mentioned some statistical applications of their result, (see Theorems 5.2.14 and
5.2.15 below).
Let Y
1
,Y
2
, . . . ,Y
n
be i.i.d. with common exponential distribution E()
and let Y
1,n
,Y
2,n
, . . .,Y
n,n
be the associated order statistics, and YYY
=
(Y
1,n
,Y
2,n
, . . .,Y
n,n
). Let A denote the (nn) matrix with elements
s
i j
=
_
_
(n j +1) for i = j 1, i > 1,
(n j +1) for i = j, i = 1, 2, . . ., n,
0 otherwise.
Finally, P is called an elementary matrix if it is obtained by interchanging some
rows of the identity matrix.
Theorem 5.2.14. Let XXX =MYYY
= (X
1
, X
2
, . . ., X
n
)
where M = ((m
i, j
)) is an
(nn) nonsingular matrix. Then X
i
s are i.i.d. with common distribution as Y
1
if and only if M = PA for some elementary matrix P.
Theorem 5.2.15. Let Z
1
, Z
2
, . . . , Z
n
be nonnegative i.i.d. with cd f F. Let
F (z) be continuous and strictly increasing. Let XXX = AZZZ
= (X
1
, X
2
, . . . , X
n
)
.
Then X
i
s are i.i.d. with common cd f F for all n > 1 if and only if
F(x) =
_
1e
x
for x 0,
0 for x < 0
for some constant > 0.
Using failure rates, Ahsanullah (1981) presented the following two charac
terizations of exponential distribution.
Theorem 5.2.16. Let F be absolutely continuous, F (0) = 0 and strictly
increasing on (0, ). Let the failure rates r
X
1
and r
D
r,n
of X
1
and D
r,n
, respec
tively, be continuous from the right at zero. Moreover, assume that r
X
1
attains
its maximum or minimum at zero. Then F E() if and only if there exists a
pair (r, n), 2 r n, such that r
D
r,n
(0+) = r
X
1
(0+).
Characterizations of Exponential Distribution I 73
Theorem 5.2.17. Let F be absolutely continuous, supp(F) = (0, ), and
IFR or DFR. Moreover, let E [X
1
] <. Then F E() if and only if there exists
a pair (r, n), 2 r n, such that E [D
r,n
] = E[D
r1,n
] .
Galambos and Kotz (1983) pointed out that Theorem 5.2.1 is related to an
assertion for the integer part of a random variable as follows.
Theorem 5.2.18. Let F
1
(0+) 0, X
(t)
i
= [X
i
/t] +1, t > 0, i = 1, 2, where
[x] denotes the integer part of x R. If the distribution of
min
_
X
(t)
1
, X
(t)
2
_
X
(t)
1
+X
(t)
2
= 2m+1
is uniformon 1, 2, . . ., m for every m N, then F E() for some > 0.
For certain characterizations of exponential distribution by the properties
of order statistics associated with nonlinear statistics, we refer the reader to
Chapter 3.1 of the book by Kakosyan et al. (1984). Here is one of their results.
Theorem 5.2.19. Let (X
i
)
iN
be a sequence of i.i.d. random variables with
cd f F, X
1
> 0, F continuous for x 0, and let lim
x0
F (x)/x exist and be 
nite. Moreover, let N 2 be an integervalued random variable independent of
(X
i
)
iN
. Then F E() for some > 0 if and only if NX
1,N
X
1
.
The following characterization is based on a moment equation reported by
Iwi nska (1986).
Theorem 5.2.20. Let F be absolutely continuous, F
1
(0+) = 0, strictly
increasing on (0, ) and NBU or NWU. Then F E () if and only if there
exists a triple (r, s, n), 1 r < s n, with
E[X
s,n
] E [X
r,n
] = E[X
sr,nr
] .
Remark 5.2.21. It is worth mentioning that without additional assumption,
the moment equation given in the above theorem with s = r +1 for one pair
(r, n), 1 r n 1, does not characterize exponential distribution. For every
74 M. Ahsanullah and G.G. Hamedani
choice of r and n there is a distribution different from exponential which pos
sesses the above property (see, Kamps, 1991 and 1992a). For an example, the
cd f given by
F(x) =
_
1+e
cd
x
d
_
1
, c > 0, d =
n
n1
and x > 0
satises the moment relation for r = 2.
We would like to mention that under conditions of Theorem 5.2.20 and
based on stronger condition X
s,n
X
r,n
X
sr,nr
, Iwi nska (1985) characterized
exponential distribution. Ahsanullah (1984) proved result similar to Theorem
5.2.20 using stronger condition which we will mention in more detail later on
in this section (see Remarks 5.2.28).
The following characterization is due to Ahsanullah (1987) which is based
on the distributions of random sums.
Theorem 5.2.22. Let F be absolutely continuous with pd f f , strictly in
creasing on (0, ) and let f be continuous fromthe right at zero. Then F E()
if and only if there exists a pair (r, n), 2 r n1, such that
r
i=1
D
i,n
r
j=1
Y
j
with Y
1
,Y
2
, . . .,Y
r
i.i.d. F.
The following result which is in the spirit (and somewhat stronger than) of
that of Ahsanullah (1984) and of Iwinska (1985) is due to Gather (1988).
Theorem 5.2.23. Let F be continuous and strictly increasing on (0, ).
Then F E() if and only if there exists a quadruple (r, s
1
, s
2
, n), 1 r < s
1
<
s
2
n, such that
X
s
i
,n
X
r,n
X
s
i
r,ns
i
for i = 1, 2.
Gather (1988) pointed out that the above result was already stated in Ahsan
ullah (1975). However, in the proof the NBU/NWUproperty of F was implicitly
used.
Characterizations of Exponential Distribution I 75
Kakosyan et al. (1984) stated the following conjecture: The distributional
identity
(1p)
N
i=1
X
i
nX
1,n
for some xed n N where N has a geometric distribution with parameter p,
characterizes exponential distribution. Ahsanullah (1988a) discussed this con
jecture and pointed out that under additional assumption that F is IFR or DFR,
nX
1,n
can be replaced by NX
1,N
, see the next theorem.
Theorem 5.2.24. Let (X
i
)
iN
be a sequence of i.i.d. random variables with
cd f F, F
1
(0+) 0, F (x) < 1 for all x > 0, F IFR or DFR, E [X
1
] < , and
0 < lim
x0+
F(x)/x = < . Moreover, let N be a geometrically distributed
random variable independent of (X
i
)
iN
. Then F E() if and only if
(1p)
N
i=1
X
i
NX
1,N
.
The following more general result (with respect to r ) is given in Ahsanullah
(1988b).
Theorem 5.2.25. Under the assumptions of Theorem 5.2.24, F E() if
and only if there exists a pair (r, n), 1 r n, such that
(1p)
N
i=1
X
i
NX
1,N
.
Gajek and Gather (1989) improved Theorem 5.2.9 in the sense of not using
D
r,n
D
s,n
as a distributional identity, but only required the equality of the
corresponding pd f
x
F (y)dy decreases (increases) with respect to x on supp(F).
Clearly, the assumption F is IFRor DFR can be replaced by 1
_
F
_
nr+1
is IFR or DFR. Pudeg (1990) pointed out that this condition in Theorem 5.2.29
can be weakened to 1 (F)
nr+1
is DMRL or IMRL. She also showed that
Rossbergs (1972) example still serves as a counterexample. F
R
does not have
DMRL or IMRL property and hence is neither IFR nor DFR.
Riedel and Rossberg (1994) studied characterization of exponential distribu
tion via distributional property of a contrast X
r+s,n
X
r,n
. Their main assumption
is the asymmetric behavior of the survival function of the contrast. Here is their
result.
Theorem 5.2.30. Let F be absolutely continuous with a continuous and
bounded pd f f on [0, ), and let > 0. Then F E() if one of the following
conditions is satised.
a) There exists a triple (r, s, n), 1 s nr, such that
P(X
r+s,n
X
r,n
x) e
(nr)x
= o(x
s
), x 0,
and
_
f (x)/F (x)
_
does not change its sign for any x 0.
b) There exists a quadruple (r, s
1
, s
2
, n), 1 s
1
< s
2
nr, such that
P(X
r+s
i
,n
X
r,n
x) e
(nr)x
= o(x
s
i
), x 0, for i = 1, 2.
The following result is due to Rao and Shanbhag (1994) based on strong
memoryless property characterization of exponential and geometric distribu
tions, which is an extended version of FergusonCrawford result which is
stated as: If X and Y are independent nondegenerate random variables, then
min{X,Y} is independent of X Y if and only if for some >0 and R, we
have (X ) and (Y ) to be either both exponential or both geometric (in
usual sense).
Theorem 5.2.31. Let X and Y be as in FergusonCrawford result and y
0
be a point such that there are at least two support points of the distribution of
78 M. Ahsanullah and G.G. Hamedani
min{X,Y} in (, y
0
] . Let be a realvalued Borel measurable function on
R such that its restriction to (, y
0
] is nonvanishing and strictly monotonic.
Then X Y and (min{X,Y})I
{min{X,Y }y
0
}
are independent if and only if for
some (0, ) and R, (X ) and (Y ) are both exponential, or
geometric on N, in which case X Y and min{X,Y} are independent.
Rao and Shanbhag (1994), gave the following two corollaries of Theorem
5.2.31.
Corollary 5.2.32. If in Theorem 5.2.31, X and Y are additionally assumed
to be i.d., then the assertion of the theorem holds with X Y in place of X Y.
Corollary 5.2.33. Let X and Y be two i.i.d. nondegenerate positive random
variables and y
0
be as dened in Theorem 5.2.31. Then min{X,Y}/max{X,Y}
and min{X,Y}I
{min(X,Y )y
0
}
are independent if and only if for some > 0 and
R, (lnX ) is either exponential or geometric.
The following interesting remarks are given in Rao and Shanbhag (1998)
concerning Theorem 5.2.31 and Corollaries 5.2.32 and 5.2.33, which are copied
here from theirs.
Remarks 5.2.34. (i) If we replace in Corollary 5.2.33, the condition on the
existence of y
0
by that there exists a point y
0
such that there are at least two
support points of the distributionof max {X,Y} in
_
y
0
,
_
, then the assertion of
corollary with min {X,Y}I
{min{X,Y}y
0
}
replaced by max{X,Y}I
{
max{X,Y }y
0
}
and lnX replaced by lnX holds. This follows because min
_
X
1
,Y
1
_
=
(max{X,Y})
1
and max
_
X
1
,Y
1
_
= (min{X,Y})
1
. The result that is ob
served here is indeed a direct extension of Fiszs (1958) result, and it is yet
another result mentioned in Rao and Shanbhag (1994). (Fisz characterizes
the distribution in question via independence of max {X,Y}/min{X,Y} and
max{X,Y}.)
(ii) Under the assumptions in Theorem 5.2.31, the condition that X Y and
(min{X,Y})I
{min{X,Y}y
0
}
be independent is clearly equivalent to that for each
y (, y
0
] , X Y be independent of I
{min{X,Y }y}
. (The remark with X Y
replaced by X Y applies to Corollary 5.2.32, i.e. when we have the assump
tions as in the corollary.)
Characterizations of Exponential Distribution I 79
(iii) Theorem 5.2.31 remains valid if the independence condition appear
ing in the assertion is replaced by that conditional upon min {X,Y} (, y
0
],
X Y and min{X,Y} are independent. (The corresponding remark in the case
of Corollary 5.2.32 is now obvious.)
(iv) If the assumptions in Theorem 5.2.31 are not met with P{X Y} > 0,
then on modifying slightly, the RaoShanbhag argument that we have referred
to in the proof of the theorem proves that conditionally upon min {X,Y}
(, y
0
] ,
_
I
{X=Y}
, (X Y)
+
_
and min{X,Y} are independent only if l
(, y
0
), the conditional distribution of X l given that X l is exponential
if the conditional distribution of Y l given that Y y
0
is nonarithmetic, and
that
_
Xl
2
x
2
}, x R
+
,
80 M. Ahsanullah and G.G. Hamedani
with
1
,
2
0,
1
+
2
> 0 and
r
(r = 1, 2) as positive numbers such that
n
i=1
a
i
i
= m. (If
1
=
2
, the distribution on the above line is Weibull. )
Remark 5.2.36. Franco and Ruiz (1995) dened the order mean function
between the adjacent order statistics X
k,n
and X
k+1,n
by
(x) = E[h(X
k,n
)X
k+1,n
= x] =
1
(F (x))
k
h(y)d (F(y))
k
,
whose domain of denition is the set (, ), where may be , h is a given
real, continuous and strictly monotone function and F F , the set of contin
uous distributions for which the integral on the RHS of the above equation is
nite for all x R. They used this concept to characterize certain continuous
distributions of which, in the special case of h(x) = x and (x) = x +b ( (x)
corresponds to F(x) in the above equation) is the exponential distribution.
Set X
0,n
= 0 and dene
S
i,n
=
i
j=1
(n j +1)(X
j,n
X
j1,n
), i = 1, 2, . . ., n,
W
r,n
= (S
1,n
/S
r,n
, S
2,n
/S
r,n
, . . ., S
r1,n
/S
r,n
).
A conjecture stated by Dufour (1982) is that if W
r,n
U
()
(r 1) =
(U
1,r1
,U
2,r1
, . . . ,U
r1,r1
), where U
i,r1
, i =1, 2, . . ., r 1 are the order statis
tics of r 1 i.i.d. random variables with a uniformdistributionon (0, 1), then X
1
has an exponential distribution. This result, if true, is a characteristic property
of the exponential distribution.
Rao and Shanbhag (1995b), dealt, among other things, with Dufours con
jecture, mentioned above, in the following theorem. As pointed out by Rao and
Shanbhag (1995b) below, a special case of their result was established earlier
by Leslie and van Eeden (1993).
Theorem 5.2.37. Let r an n be positive integers greater than or equal to 3
such that either r, n {3, 4} with r =n, or r, n 5. Also let X
1
, X
2
, . . . , X
n
be i.i.d.
positive random variables. If W
r,n
U
()
(r 1), then X
1
has an exponential
distribution.
Characterizations of Exponential Distribution I 81
Rao and Shanbhag (1998) pointed out that they proved the above theorem
when r, n 5 in their (1995b) paper and the result for r = n = 3, 4 follows from
certain uniqueness theorem on the problem, established in their (1995b) paper.
They also mentioned that Theorem 5.2.37 for r, n 5 was proved independently
via a different argument by Xu and Young (1995). This will be pointed out
below.
Following Xu and Yang (1995)s Introduction, the characterization problem
for the case r = n, has been studied by Seshardi et al. (1969) and Dufour et
al. (1984). Dufours conjecture has been partially answered by Leslie and van
Eeden (1993), who showed that the conjecture is true for (2/3)n+1 r n1,
but the case r < (2/3)n = 1 has not been determined as of 1995. Xu and Yang
(1995) showed that the conjecture is true when r 5 indicating that their lower
bound is independent of the sample size n, whereas in Leslie and van Eeden
(1993) the lower bound increases with n. The cases r = 2, 3 and 4 are, as of
1995, still not determined. Menon and Seshardi (1975) have shown that for
r = n = 2 the conjecture is false. So, it is assumed that n 3. If, however, cd f
of X
1
belongs either to the class of NBU or NWU distributions, then Dufours
conjecture is true for r 2.
It seems that Xu and Young were not aware of Rao and Shanbhag (1995b)
paper which has dealt with the case r = n =3, 4. Here is Xu and Youngs result.
Theorem 5.2.38. Suppose that n r 5. Then X
1
has an exponential dis
tribution if and only if W
r,n
U
()
(r 1).
Remark 5.2.39. Xu and Yang (1995) mentioned an alternative statement
for Theorem 5.2.38: If n 5, X
1
has an exponential distribution if and only if
W
5,n
U
()
(4). Then the general case follows immediately. This alternative
statement indicates that a sample size of 5 is large enough to characterize the
exponential distribution.
Employing the concepts of NBU and NWU, Xu and Yang presented the
following characterization of the exponential distribution.
Theorem 5.2.40. Suppose that cd f F of X
1
is either NBU or NWU and that
{F
1
(u) : 0 < u < 1} = (0, ). Let r for 2 r n, n 3, be xed. Then X
1
is
exponentially distributed if and only if W
r,n
U
()
(r 1).
82 M. Ahsanullah and G.G. Hamedani
L opezBl aquez and MorenoRebollo (1997) start their Introduction section
by stating that Ferguson (1967) characterized distributions for which the regres
sion of an order statistic on an adjacent one is linear. Ferguson pointed out that
it is not known which distributions would be characterized if nonadjacent or
der statistics are considered. Nagaraja (1988) afrms that the problem remained
unsolved. Similar reference to this problem was given by Arnold et al. (1992).
L opezBl aquez and MorenoRebollo (1997) established the following two char
acterizations of the distributions when the regression of two order statistics, not
necessarily adjacent, is linear.
Theorem 5.2.41. Let X
1
have a cd f which is k times differentiable in D
F
=
{x R: 0 < F (x) < 1}, such that
E[X
i+k,n
X
i,n
] = bX
i,n
+a.
Then, except for location and scale parameters,
F(x) = 1x
, for x (, 1] , if c > 1,
Characterizations of Exponential Distribution I 83
where, = (r (i +k 1))
1
and r is the unique real root greater than k 1 of
the polynomial equation
P
k
(x) =
1
c
P
k
(i +k 1) .
Remark 5.2.43. Most of the characterizations mentioned so far have al
ready appeared in two excellent survey papers by Gather et al. (1998) and by
Rao and Shanbhag (1998). The latter contains new characterizations which had
not appear prior to 1998 of which some have been mentioned in this section
already and some will be given below.
Rao and Shanbhag (1998) pointed out that: There is an interesting variant
of Theorem 5.2.31; Rossberg (1972), Ramachandran (1980), Rao (1983), Lau
and Ramachandran (1991), and Rao and Shanbhag (1994) among others have
produced versions of Theorem 5.2.31. A special case of this result for n =2 was
given in a somewhat restricted form by Puri and Rubin (1970). Then Rao and
Shanbhag gave their variant (below) and showed that it is also linked with the
strong memoryless property characterization of the exponential and geometric
distributions.
Theorem 5.2.44. Let n 2 and X
1
, X
2
, . . . , X
n
be i.i.d. random variables
with cd f F that is not concentrated on {0}. Then, for some 1 i < n,
X
i+1,n
X
i,n
X
1,ni
,
where X
1,ni
= min{X
1
, X
2
, . . . , X
ni
}, if and only if one of the following two
conditions holds:
(i) F is exponential.
(ii) F is concentrated on some semilattice of the form {0, , 2, . . .} with
F (0) = and F ( j) F(( j 1)) = (1)(1)
j1
for j = 1, 2, . . . for
some
_
0,
_
n
i
_
1/i
_
and [0, 1) such that P{X
i+1,n
> X
i,n
} = (1)
ni
(which holds with =
_
n
i
_
1/i
or = 0 if and only if F (0) F(0) =
_
n
i
_
1/i
and F ()F () =1
_
n
i
_
1/i
for some >0). (The existence of cases >0
can easily be veried.)
84 M. Ahsanullah and G.G. Hamedani
The following two remarks ( Remarks 2 & 3, p. 240, 1998) are taken from
Rao and Shanbhag (1995a) which explain respectively as how the existence
of > 0 in Theorem 5.2.44 follows and how the result of Stadje (1994) is a
corollary to this theorem.
Remarks 5.2.45. (a) Suppose we consider a family of distributions of the
form in (ii) (of Theorem 5.2.44), but not necessarily satisfying the condition
that P{X
i+1,n
> X
i,n
} = (1)
ni
. Then, if we take a xed (0, 1) and al
low to vary, we get for a sufciently small , P{X
i+1,n
> X
i,n
} < (1)
ni
,
and for =
_
n
i
_
1/i
, we get P{X
i+1,n
> X
i,n
} > (1)
ni
; since we have
P{X
i+1,n
> X
i,n
} to be a continuous function of , we have the existence of an
value such that P{X
i+1,n
> X
i,n
} = (1)
ni
. This proves the last statement
(in the parentheses) of Theorem 5.2.44.
(b) If n = 2 and i = 1, we get
_
n
i
_
1/i
= 1/2. In this case, if nei
ther = 1/2 nor = 0, we get P{X
i+1,n
> X
i,n
} = 1 P{X
1
= X
2
} =
{2(1)(+)}/(1+) ; consequently we have here P{X
i+1,n
> X
i,n
} =
(1)
ni
, i.e. the probability to be equal to 1 , if and only if = 1 2.
One can hence see as to how Stadjes result follows as a corollary to Theorem
5.2.44.
The following theorem is due to Rao and Shanbhag (1998) special versions
of which have been dealt with by Arnold and Ghosh (1976) and Arnold (1980).
Zijlstra (1983) and Fosam et al. (1993) have reported further specialized ver
sions of Theorem 5.2.44.
Theorem 5.2.46. Let n 2 and X
1,
X
2
, . . . , X
n
be nondegenerate i.i.d. ran
dom variables with cd f F. Then, for some i 1, the conditional distribution of
X
i+1,n
X
i,n
given that X
i+1,n
X
i,n
> 0 is the same as the distribution of X
1,ni
,
where X
1,ni
is as dened in Theorem 5.2.44, if and only if F is either exponen
tial, for some > 0, or geometric on {, 2, . . .}.
The following characterization of exponential distributionis due to Rao and
Shanbhag (1998) which is in terms of certain function of spacings.
Theorem 5.2.47. Let X
1
, X
2
, . . ., X
n
(n 2) be i.i.d.with a continuous cd f F.
Further, let i be a xed positive integer less than n and be a nonarithmetic (or
Characterizations of Exponential Distribution I 85
nonlattice) real monotonic function on R
+
such that E [(X
i+1,n
X
i,n
)] < .
Then, for some constant c =(0+), E [(X
i+1,n
X
i,n
)X
i,n
] =c a.s. if and only
if F is exponential, within a shift.
The following characterization of the exponential distribution in terms of
the independence of spacing X
n,n
X
n1,n
and order statistic X
n1,n
is due to
Lee et al. (2002).
Theorem 5.2.48. X
n,n
X
n1,n
and X
n1,n
are independent if and only if F
is exponential.
Remark 5.2.49. Bairamov et al. (2002) showed that each of the following
two conditions is a characteristic property of the exponential distribution:
P(X
n,n
>t +xX
1,n
>t) = P(X
n,n
> x)
and
E[X
n,n
tX
1,n
>t] = E[X
n,n
] .
Bairamov and
Ozkal (2007) presented characterizations of certain distribu
tions based on the conditional expectations of order statistics. One of the distri
butions considered is Weibull. We shall state their result for the special case of
Weibull, namely exponential.
Proposition 5.2.50. The absolutely continuous nonnegative random vari
able X with strictly increasing cd f F has exponential distribution with parame
ter > 0, if and only if, the representation
1
k
k
p=1
E
_
X
j,n
X
jp,n
= x, X
j+k+1p,n
= y
=
exp(x)(x+1) exp(y)(y+1)
exp(x) exp(y)
,
holds for all 0 x < y <. Here k +1 j nk.
Hamedani et al. (2008) characterized various distributions based on trun
cated moment of the rst order statistic, one of which is Weibull. Here we state
the result for the special case of exponential distribution.
86 M. Ahsanullah and G.G. Hamedani
Proposition 5.2.51. Let X be a nonnegative continuous random variable
with cd f F such that lim
x
x(1F (x))
n
= 0. Then X has an exponential dis
tribution with parameter > 0 if and only if
E [X
1,n
X
1,n
>t] =
nt +1
n
, t > 0.
5.3. Characterizations Based on Generalized Order
Statistics
In this section we review characterizations of exponential distribution based on
generalized order statistics. Kamps (1995), introduced a concept of generalized
order statistics as a unied approach to order statistics and record values. Kamps
dened generalized order statistics as follows.
Let, for simplicity, F denote an absolutely continuous cd f with pd f f . The
random variables X (1, n, m, k), X (2, n, m, k), . . . , X (n, n, m, k) are called gener
alized order statistics based on F, if their joint pd f is given by
f
X(1,n,m,k),X(2,n,m,k),...,X(n,n,m,k)
(x
1
, x
2
, . . . , x
n
)
= k
_
n1
j=1
j
__
n1
i=1
_
F (x
i
)
_
m
f (x
i
)
_
_
F (x
n
)
_
k1
f (x
n
),
F
1
(0+) < x
1
x
2
x
n
< F
1
(1),
with n N, k >0, mRsuch that
j
=k+(n j)(m+1) >0 for all 1 j n.
As pointed out by Kamps, in the case m = 0 and k = 1 this model reduces
to the joint pd f of ordinary order statistics, and in the case m = 1 and k N
we obtain the joint pd f of the rst n k
th
record values based on a sequence
X
1
, X
2
, . . . of i.i.d. rv
r
1
f (x)g
r1
m
(F(x)),
(see Kamps 1995, p. 64) and the pd f of the spacings
W
r1,r,n
= X (r, n, m, k)X (r 1, n, m, k), 2 r n,
Characterizations of Exponential Distribution I 87
has the following representation:
f
W
r 1 , r , n
(y) =
c
r1
(r 2)!
_
F (x)
_
m
f (x)g
r2
m
(F(x))
_
F (x+y)
_
r
1
f (x+y) dx
with (see Kamps 1995, p. 69)
c
r1
=
r
j=1
j
, 1 r < n,
h
m
(x) =
(1x)
m
dx =
_
1
m+1
(1x)
m+1
, m = 1,
ln
_
1
1x
_
, m = 1,
g
m
(x) = h
m
(x) h
m
(0), x [0, 1).
Kamps (1995, p. 81) generalized Sukhatmes result that the normalized
spacings
D(1, n, m, k) =
1
X (1, n, m, k),
D(r, n, m, k) =
r
(X (r, n, m, k)X (r 1, n, m, k)), 2 r n,
based on exponential distribution with parameter are i.i.d. E ().
Again following Kamps (1995), W
r1,r,n
and X (1, nr +1, m, k) are i.d.,
since
W
r1,r,n
1
X (1, n, m, k) = Z
and
f
Z
(z) =
r
1
f
X(1,n,m,k)
_
1
z
_
=
r
_
F
_
1
z
__
1
1
f
_
1
z
_
=
r
exp{
r
z} = f
X(1,nr+1,m,k)
(z).
Hence, it remains to be seen that the above properties will indeed characterize
exponential distribution uniquely.
In the following theorem, Kamps and Gather (1997) show that, under cer
tain regularity conditions, a weaker assumption than D(r, n, m, k) D(s, n, m, k)
is sufcient to characterize exponential distribution within the class of distribu
tions with IFR or DFR property. A special case of this result is that of Gajek
and Gather (1989) established for ordinary order statistics.
88 M. Ahsanullah and G.G. Hamedani
As in Kamps and Gather (1997), let r
Y
(x) = g(x)/G(x) denote the failure
rate of a random variable Y with cd f G and pd f g. The failure rates as well
as the pd f f in Theorem 5.3.1 and Remark 5.3.2 below ( both due to Kamps
and Gather, 1997) are assumed to be continuous from the right. If r
Y
is mono
tone, then the limit r
Y
(0) = lim
x0
r
Y
(x) is assumed to be nite (cf. Gajek and
Gather, 1989).
Theorem 5.3.1. Let F be absolutely continuous with pd f f , F(0) = 0, and
suppose that F is strictly increasing on (0, ), and either IFR or DFR. Then
F E () for some > 0 if and only if there exist integers r, s and n, 1 r <
s n, such that r
D(r,n,m,k)
(0) = r
D(s,n,m,k)
(0).
Remark 5.3.2. Again, Kamps and Gather (1997) pointed out that it is easily
seen that the property r
D(s,n,m,k)
(0) = r (0)(r is failure rate of F) for some 2
s n is also a characteristic property of exponential distribution. This assertion
corresponds to Remark 2.1 in Gajek and Gather (1989) and generalizes Theorem
2.2 in Ahsanullah (1981b) for ordinary order statistics. As in the case r = 1 in
Theorem 5.3.1, it is obvious that the IFR or DFR assumption can be replaced
by the condition that zero is an extremal point of the failure rate of F.
Kamps and Gather (1997) presented the following theorem generalizing
Theorem 2.1 of Ahsanullah (1981b), which in the case of ordinary order statis
tics, characterizes exponential distribution based on the equality of the expecta
tions of successive (normalized) spacings.
Theorem 5.3.3. Let F be absolutely continuous with pd f f , F(0) =
0, F(x) < 1 for all x > 0, and suppose that F is IFR or DFR. Moreover, let
m 1. Then F E() for some > 0 if and only if there exist integers r and
n, 1 r n1, such that E [D(r, n, m, k)] = E[D(r +1, n, m, k)] .
In the following theorem, Kamps and Gather, (1997) show that under an
NBU or NWU assumption, characterizations of exponential distribution based
on the equality of the expectations of X
s,n
X
r,n
and X
sr,nr
established by
Iwi nska (1986) and Gajek and Gather (1989), can also be extended to general
ized order statistics in the special case of s = r +1.
Characterizations of Exponential Distribution I 89
Theorem 5.3.4. Let F be absolutely continuous with pd f f , F(0) = 0,
and suppose that F is strictly increasing on (0, ), and either NBU or NWU.
Moreover, let the expected values involved be nite. Then F E () for some
> 0 if and only if there exist integers r and n , 1 r n 1, such that
E[X (r +1, n, m, k)] E [X (r, n, m, k)] = E[X (1, nr, m, k)] .
The following remark is also due to Kamps and Gather (1997) involving a
counterexample of Kamps (1995, p. 128).
Remark 5.3.5. Without any further assumption, the equation
E[X (r +1, n, m, k)] E[X (r, n, m, k)] = E[X (1, nr, m, k)]
for just one pair (r, n), 1 r n1, does not characterize exponential distribu
tion. For every choice of r, n and m = 1 there are distributions different from
exponential with the above property. For example, the distributions given by
F (x) = 1
_
1+cx
d
_
1/(m+1)
_
c > 0, x (0, ), m > 1,
c < 0, x
_
0, (1/c)
1/d
_
, m <1,
with
d =
k +(n1)(m+1)
k +(n2)(m+1)
_
=
1
2
_
satisfying the moment condition for r = 1.
The denition of the generalized order statistics given by Kamps in (1995)
and in Kamps and Gather (1997) (also given before in this section) involved
a single real number m. Kamps and Cramer (1999) extended this denition
slightly by replacing m with a vector m = (m
1
, m
2
, . . . , m
n1
) in R
n1
as given
below. Then a characterization of exponential distribution based on this ex
tended version of the generalized order statistics was presented by Kamps and
Cramer, which is given in Theorem 5.3.6 below.
Again let, for simplicity, F denote an absolutely contin
uous cd f with corresponding pd f f . The random variables
90 M. Ahsanullah and G.G. Hamedani
X (1, n, m, k), X(2, n, m, k), . . ., X (n, n, m, k) are called generalized order
statistics based on F, if their joint pd f is given by
f
X(1,n, m,k),X(2,n, m,k),...,X(n,n, m,k)
(x
1
, x
2
, . . . , x
n
)
= k
_
n1
j=1
j
__
n1
i=1
_
F(x
i
)
_
m
i
f (x
i
)
_
_
F (x
n
)
_
k1
f (x
n
),
on the cone F
1
(0) < x
1
x
2
x
n
< F
1
(1) of R, with parameters
n N, n 2, k > 0, m = (m
1
, m
2
, . . ., m
n1
) R
n1
, M
r
=
n1
j=r
m
j
, such that
r
= k +n r +M
r
> 0 for all r {1, 2, . . ., m
n1
} (cf. Kamps, 1995, 1998a).
Moreover, let c
r1
=
r
j=1
j
, r = 1, 2, . . ., n1, and
n
= k.
Kamps and Cramer (1999) pointed out that in the context of ordinary or
der statistics X
1,n
, X
2,n
, . . ., X
n,n
based on F it is wellknown (cf. Ahsanullah
1984; Iwi nska 1986; Gajek and Gather 1989; Gather et al. 1998, p. 266/7,
Kamps 1998a; see also Gather 1988) that, under NBU or NWU assumption
X
s,n
X
r,n
X
sr,nr
, r <s as well as the equality E[X
s,n
] E [X
r,n
] =E[X
sr,nr
]
are characteristic properties of exponential distribution. We would like to men
tion that except Kamps (1998a) result, the rest of the results mentioned in the
parentheses above have already been mentioned in this chapter. In what follows
(Theorem 5.3.6), Kamps and Cramer (1999) extend the above mentioned re
sults to generalized order statistics restricting on pairwise different parameters
1
,
2
, . . . ,
n
. For the case m
1
= m
2
= = m
n1
see Theorems 5.3.1, 5.3.3 and
5.3.4 above and for more details see Kamps (1998b).
Theorem 5.3.6. Let the appearing generalized order statistics be well
dened and be based on an absolutely continuous cd f F. Let F be strictly in
creasing on (0, ) with F (0) = 0, and let F be NBU or NWB. Then F E()
for some > 0 if and only if there exist integers r, s and n, 1 r < s n, such
that
i) X (s, n, m, k) X (r, n, m, k) X (s r, nr, , k),
or
ii) E[X (s, n, m, k)] E[X (r, n, m, k)] = E[X (s r, nr, , k)] ,
assuming that the expected values are nite,
where = (
1
,
2
, . . . ,
nr1
) = (m
r+1
, m
r+2
, . . . , m
n1
).
Characterizations of Exponential Distribution I 91
Keseling (1999) considered, among other things, X (i, n, 0, 1), 1 i n,
based on a continuous cd f F and presented the following characterization of
the exponential distribution.
Theorem 5.3.7. F E(1) if and only if
E[X (r +1, n, 0, 1)X (r, n, 0, 1) = x] = x+b a.s.
Remark 5.3.8. As we mentioned in Section 5.2, Rao and Shanbhag (1994)
proved that exponential distributionis the only continuous distributionwith con
stant regression E [(X
r+1,n
X
r,n
)X
r,n
= x] with nonarithmetic and mono
tonic and E[(X
r+1,n
X
r,n
)] < . Rao and Shanbhag (1986) presented simi
lar result for record values. In the following corollary, Keseling (1999) showed
the same result for gos.
Corollary 5.3.9. Let X (1, n, m, k), . . . , X(n, n, m, k) be a sequence of
gos based on a continuous cd f F. Further, let r {1, 2, . . ., n1} be
xed and a nonarithmetic real monotonic function on R
+
such that
E[(X (r +1, n, m, k)X (r, n, m, k))] is nite. Then, for some constant c =
(0
+
),
E [(X (r +1, n, m, k) X (r, n, m, k))X(r, n, m, k) = x] = c a.s.
if and only if there exists >0 and R with F (x) =1exp((x)), x
.
Remark 5.3.10. It is known that within a suitable class of continuous
distributions, the exponential distribution is the only distribution for which
Var [X
i+1,n
X
i,n
= x] is constant. For gos Keseling (1999) presented the follow
ing corollary.
Corollary 5.3.11. Let X (1, n, m, k), . . . , X(n, n, m), n 2, be a sequence
of gos
> 0 on
supp(F) and for some r {1, 2, . . ., n1}, E
_
X
2
< for a rv X 1
(1F)
r+1
/(nr)
. Then
Var [X (r +1, n, m, k)X (r, n, m, k) = x] = c > 0 a.s.
92 M. Ahsanullah and G.G. Hamedani
if and only if there exists > 0 with F (x) = 1exp(x) , x 0.
Remark 5.3.12. In view of the results reported in this section, the similari
ties in some characterization results based on order statistics and based on record
values (which will be discussed in details in Chapter 6) are no longer astonish
ing. It clearly shows that the concept of generalized order statistics presents a
unied approach to characterizations of distributions and wellknown charac
terization results based on order statistics and record values can be deduced as
special cases of gos.
Bieniek and Szynal (2003) presented various characterizations of distribu
tions via linearity of regression of gos extending results of Dembi nska and
Wesolowski (1998, 2000). We state here their characterization of the expo
nential distribution. We need to dene l
F
= inf {x R : F (x) > 0} and r
F
=
sup{x R : F (x) < 1} for the following theorem.
Theorem 5.3.13. Let X (i, n, m, k), 1 i n, be gos based on an absolutely
continuous distribution function F, and let
i
=
j
, for all i = j, 1 i, j n.
Suppose that E[X (r +l, n, m, k)] < , where r +l n. If the following
linearity of regression holds
E [X (r +l, n, m, k)X(r, n, m, k) = x] = x+b, x (l
F
, r
F
),
for some b R, then F E(, ), where R and > 0 is determined by
=
1
b
r+l
i=r+1
.
For further studies regarding the characterizations of distributions (in par
ticular the exponential distribution) via linear regression of gos
s, we refer the
interested reader to an excellent paper by Cramer, Kamps and Keseling (2004).
Ahsanullah (2006) presented the following characterization of exponential
distribution based on the generalized order statistics, in different direction than
the ones mentioned earlier.
Theorem 5.3.14. Let X be a nonnegative random variable having an abso
lutely continuous (with respect to Lebesgue measure) cd f F with F (0) = 0 and
0 < F (x) < 1 for all x > 0. Then the following properties are equivalent:
Characterizations of Exponential Distribution I 93
a) X has an exponential distribution with pd f , f (x) =
1
e
1
x
;
b) X (r +1, n, m, d) X (r, n, m, k)+
W
r+1
, r > 1, where W E
_
1
_
is in
dependent of X (r +1, n, m, k) and X (r, n, m, k) and m 1.
For k = 1 and m = 0, a characterization of exponential distribution via rela
tion X
r+1,n
X
r,n
+
W
nr
is obtained.
We will now present some new characterizations of the exponential distri
bution based on generalized order statistics.
Theorem 5.3.15. Let X be a nonnegative rv with an absolutely continuous
(with respect to Lebesgue measure) and strictly increasing cd f F with F (0) = 0
and F (x) < 1 for all x > 0. Then the following properties are equivalent:
(a) X E();
(b) For 1 < r n, the rv
_
c
r2
(r2)!
(1F (u))
m
g
r2
m
(F(u))
[1F (u+v)]
r
1
f (u) f (u+v) , 0 < u, v < ,
0, otherwise.
(5.3.1)
If X E(), then 1F (x) = exp(x) and
g
m
(F (x)) =
_
1
m+1
_
1e
(m+1)x
_
, for m = 1,
x, for m = 1.
Upon simplication, we arrive at
f
U,V
(u, v) =
2
c
r2
(r 2)!
g
r2
m
_
1e
u
_
e
r1
u
e
r
v
(5.3.2)
Thus U and V are independent.
Now, let f
U
(u) be the pd f of U, then
f
U
(u) =
c
r2
(r 2)!
(1F (u))
1+
r1
g
r2
m
(F (u)) f (u). (5.3.3)
94 M. Ahsanullah and G.G. Hamedani
Using (5.3.2), (5.3.3) and the relation
r1
=
r
+m+1, we obtain the condi
tional pd f of V given U = u as
f
VU
(vu) =
_
F (u+v)
_
F(u)
_
1
_
r
1
f (u+v)
_
F(u)
_
1
, (5.3.4)
for all v, 0 < v < and all u.
Integrating the expression in (5.3.4) with respect to v from v
1
to , we
obtain
F
VU
(v
1
U = u) =
_
F (u+v
1
)
_
F(u)
_
1
_
r
, (5.3.5)
for all v
1
and u, 0 < u, v
1
< .
Since U and V are independent, we obtain from (5.3.5) for all u and v
_
F (u+v)
_
F (u)
_
1
_
r
= G(v),
where G(v) is clearly a function of v only. Now, upon taking limit as u 0, we
arrive at G(v) =
_
F(v)
_
r
. Hence for all u and v, 0 <u, v < and a xed
r
, we
have
F (u+v) = F (u)F (v). (5.3.6)
The solution of (5.3.6) is (see Acz el (1966)) F (x) = e
x
, where is arbitrary.
Since F (x) = 1 F(x) is a cd f , must be positive, which complete the proof
of the theorem.
Remarks 5.3.16. (i) If k = 1 and m = 0, then from Theorem 5.3.15 we ob
tain the result of Rossberg (1972). If k = 1 and m = 1, then we obtain, from
Theorem 5.3.15, the characterization of the exponential distributionof Ahsanul
lah (1978) based on the independence of
_
X
U(n)
X
U(n1)
_
and X
U(n1)
, where
X
U(k)
is dened in Chapter 3.
(ii) It is clear that for exponential distribution E(),
E[X ( j +1, n, m, k)X( j, n, n, k) = x] is a linear function of x. It can be
shown that this property characterizes the exponential distribution.
Proof of the following theorem is similar to that of Theorem 5.3.15 and
hence will be omitted.
Theorem 5.3.17. Let X be as in Theorem 5.3.15. Then the following prop
erties are equivalent.
Characterizations of Exponential Distribution I 95
(a) X E().
(b) For 1 < j n, the rv
s
j
(X( j, n, m, k) X ( j 1, n, m, k)) and
1
X (1, n, m, k) are identically distributed.
Remarks 5.3.18. (i) For k = 1, m = 0, Theorem 5.3.17 gives a charac
terization of the exponential distribution based on the identical distribution of
(n j +1)(X
j,n
X
j1,n
) and nX
1,n
(Ahsanullah, 1977). (ii) For k = 1, m =
1, Theorem 5.3.17 gives a characterization of the exponential distribution
based on the identical distributionof X
U( j)
X
U( j1)
and X (Ahsanullah, 1978).
(iii) For k = 1, m = 0, Theorem 5.3.17 gives a characterization of the exponen
tial distribution based on the identical distribution of (n j)(X
j+1,n
X
j,n
) and
X.
The following two theorems are based on the monotonicity of the hazard
rate.
Theorem 5.3.19. Let X be a nonnegative rv with an absolutely continuous
(with respect to Lebesgue measure) and strictly increasing cd f F for all x > 0
and F (x) < 1 for all x > 0. Then the following properties are equivalent.
(a) X E ().
(b) X has a monotone hazard rate and for one n , one j (1 < j n), one m
and one k, the rv
0
c
j2
( j 2)!
_
F (u)
_
1+
j1
g
j2
m
(F (u))H(u, v)du = 0,
for all v, one j, one m, and one
j1
,
where
H(u, v) = F (v)
_
_
F
_
u+
v
j
_
F(u)
_
_
j
,
then H(0, v) = 0 for all v > 0.
96 M. Ahsanullah and G.G. Hamedani
Proof. We have H(u, 0) = 0 = H (u, ) and
H(u, v)
u
= q(u, v)
_
r
_
u+
v
j
_
r (u)
_
,
where r (u) is the hazard rate and q(u, v) =
_
F
u+
v
F(u)
_
j
.
(i) If r (x) = constant for all x, then
H(u,v)
u
= 0, for all u and v.
(ii) If r (x) is strictly monotone increasing in x, then H(u, v) is strictly in
creasing in u for any xed v. Thus for all v, if H(u, v) is not identically zero,
then it must be negative in an interval containing zero. Let H(u, v) < 0 for
u I = [0, b] , where b is a real number. Then for u I,
H(u, v)
v
=f (v) +
_
_
F
_
u+
v
j
_
F (u)
_
_
j
r
_
u+
v
j
_
> f (v) +F (v)r
_
u+
v
j
_
, for u I, since H(u, v) < 0,
> F(v)
_
r
_
u+
v
j
_
r (v)
_
< 0, for all u I and all v >
j
j
1
u.
Thus for all u I, H (u, v) decreases to 0 as v . But for all u I, H(u, 0) =
0, H(u, v) < 0 and H(u, v) decreases to 0 as v . Therefore, by continuity of
H(u, v) we must have H(u, v) =0 for all v >0 and all u I. Hence H(0, v) =0
for all v > 0.
(iii) If r (x) is strictly monotone decreasing in x, similar argument can be
used.
Proof of Theorem 5.3.19 can now easily be completed, which we omit it.
Remarks 5.3.21. (i) The condition of monotonicity of hazard rate in The
orem 5.3.19 can be replaced by NBU/NWU property. (ii) Kamps and Gather
(1997) presented a proof of Theorem 5.3.19 under the equality of the expecta
tions instead of identical distribution.
The proof of the following theorem is similar to that of Theorem 5.3.19 and
hence will be omitted.
Characterizations of Exponential Distribution I 97
Theorem 5.3.22. Let X be as in Theorem 5.3.19. Then the following are
equivalent.
(a) X E().
(b) X has a monotone hazard rate and for one n , one
j (1 < j n), one m and one k (k 1, m is a real number) the
rv
is independent of X
U( j)
characterizes the
exponential distribution, Sirvastava (1978), Ahsanullah (1978) and Nagaraja
(1977).
(3). Var
_
(X
U(j+1)
X
U( j)
)X
U(j)
is independent of X
U( j)
characterizes the
exponential distribution, Ahsanullah (1981).
We will get back to Gupta (1984), but for now we would like to mention
that Ahsanullah (1979) presented two characterizations of exponential distri
bution based on record values generalizing Tatas (1969) result as well as other
characterizations reported in this direction. Here are Ahsanullahs (1979) results
stated in Theorems 6.1.2 and 6.1.4 below.
Theorem6.1.2. Let (X
n
)
n1
be a sequence of i.i.d. randomvariables having
an absolutely continuous (with respect to Lebesgue measure) cd f F such that
=inf{xF(x) >0} = 0 and f (x) >0 for = 0 <x <. Then for X
n
E(),
it is necessary and sufcient that X
U(n1)
and X
U(n)
X
U(n1)
are independent.
Remark 6.1.3. For n = 1, the above theorem reduces to Theorem 6.1.1.
Theorem 6.1.4. Under the assumptions of Theorem 6.1.2, the followingtwo
statements are equivalent:
(a) X
1
E().
(b) for 0 m < n 1, the conditional distributions of
_
X
U(n)
X
U(n1)
_
given X
U(m)
and
_
X
U(m+1)
X
U(m)
_
given X
U(m)
are i.d. and X
1
H
.
Characterizations of Exponential Distribution II 101
Nayak (1981) also presented a generalization of Tatas result by showing
that for an absolutely continuous distribution the independence of X
U(r)
and
X
U(n)
X
U(s)
for some 0 r < s < n is already sufcient to characterize the ex
ponential distribution. This result was independently proved by Dallas (1981)
whose method of proof can be used to characterize other distributions. Ah
sanullah (1981), which was referred to in (3) above, as well as Pfeifer (1982)
employed the independence of certain functions of record values (or record in
crements) to established further characterizations of the exponential distribu
tion.
The similarity between characterizations of exponential distribution based
on order statistics and based on record values motivated Gupta (1984) to in
vestigate the relationship between record values and order statistics. The same
problem was taken up by Deheuvels (1984) independently. Gupta showed that
the conditional distributions of X
i+1,i+1
X
i,i+1
given X
i,i+1
and X
U(i+1)
X
U(i)
given X
U(i)
are the same. Gupta also investigated a relation between conditional
distributions of X
j+1,n
given X
j,n
and X
U( j)
given X
U( j1)
. For different set of
conditions see Deheuvels (1984). The following two results are due to Gupta
(1984). He proved a general theorem from which all the results mentioned in
(1)(3) above follow as special cases.
Theorem 6.1.5. E
__
X
U( j+1)
X
U( j)
_
r
X
U(j)
= y
=c (independent of y) for
xed j, r 1 if and only if F is exponential.
Remarks 6.1.6. (a) Gupta (1984) pointed out that the proof of Theo
rem 6.1.5 requires only the continuity of F. (b) Theorem 6.1.5 was extended
by Rao and Shanbhag (1986), where they obtained the same characteriza
tion if, in Guptas condition, the expression
_
X
U( j+1)
X
U( j)
_
r
is replaced by
G
_
X
U( j+1)
X
U( j)
_
, where G is a monotone function satisfying certain condi
tions.
Theorem 6.1.7. E
_
X
U( j+1)
X
U( j)
=E [X
1
] , for one xed j, characterizes
the exponential distribution in the class of NBU or NWU distributions.
Remark 6.1.8. Gupta (1984) pointed out that the assertion given in the
above theorem cannot be replaced by E
_
X
U( j+1)
X
U( j)
z
g(z, x)dF (x) = cF (z).
Iwi nska (1985) presented a characterization of the exponential distribution
by a distributional property of the difference of two arbitrary record values. She
Characterizations of Exponential Distribution II 103
also characterized the exponential distributionbased on the conditional distribu
tions of the difference of two, not necessarily consecutive, record values. Then
in 1986, Iwi nska established a characterization of the exponential distribution
based on the expectation of spacings between two, not necessarily consecutive,
record values.
Nagaraja (1988) lets
_
Y
j
, j 1
_
be the sequence of (upper)
record values from a sequence of i.i.d. random variables (X
j
)
j1
having a continuous cd f F, for which E[Y
m+1
] is nite. He
pointed out that this (expectation) condition holds if E[X
1
] and
E
_
X
+
1
_
ln
_
X
+
1
__
m
= +m
1
,
Var
_
X
U(m)
= m
2
,
and
Cov
_
X
U(m)
, X
U(n)
= m
2
, m < n.
104 M. Ahsanullah and G.G. Hamedani
(b) Using Theorem 6.1.13, it can be shown that for the exponential distribu
tion
X
U(m)
U
1
+U
2
+ +U
m
,
where U
1
,U
2
, . . . are i.i.d. exponential. This property is also a characteristic
property of the exponential distribution.
The following theorem is a generalization of Ahsanullahs (1987) result.
Theorem 6.1.15. Let (X
j
)
j1
be a sequence of i.i.d. nonnegative random
variables with absolutely continuous (with respect to Lebesgue measure) cd f F
and the corresponding pd f f . If F is in the class of IHR or DHR, and for some
m, n with 1 m<n, E[X
U(n)
X
U(m)
] =E
_
X
U(nm)
, then X
1
E (), for some
> 0.
Theorem 6.1.16. Let (X
j
)
j1
be a sequence of i.i.d. nonnegative random
variables with an absolutely continuous (with respect to Lebesgue measure)
cd f F and corresponding pd f f . Let m be a geometric random variable with
parameter p, independent of X
j
s . Then the following two properties are equiv
alent:
(i) X
j
s are exponentially distributed.
(ii) p
m
j=1
X
j
X
U(n)
X
U(n1)
, for some xed n, n 1, F is in the class of
NBU or NWU and E [X
1
] < .
Haung and Li (1993) investigated some extensions of various results given
in Ahsanullah (1978,1979), Dallas (1981), Gupta (1984) characterizing the ex
ponential distribution based on record values. The following three theorems are
due to Haung and Li (1993).
Theorem 6.1.17. Assume F has pd f f . Let G be a nondecreasing function
such that for every x > 0, G has a point of increase in (0, x). Assume for some
xed integer j 1,
E
_
G
_
X
U( j)
X
U( j1)
_
X
U(j)
= x
= E
_
G
_
X
U(0)
_
X
U( j)
= x
= E
_
G
_
X
U(i1)
X
U(i2)
_
X
U(j)
= x
= c,
for every x > 0, where c > 0 is a constant, and if for some > 0,
c <
0
e
x
dG(x) <,
then c = E[G(X
1
)] and X
1
is exponentially distributed.
Remark 6.1.20. Considering a sequence of populations and sequences of
random variables
_
X
(n)
i
_
i1
(stemming from the n
th
population), Witte (1990,
1993) characterized the exponential distribution based on the equidistribution
of X
U(n)
X
U(n1)
and X
(m)
1
. Their results are very interesting, but they are not
in the same directions as the ones reported in this section so far.
Franco and Ruiz (1996) studied characterization of continuous distributions
by conditional expectation of record values including exponential distribution.
106 M. Ahsanullah and G.G. Hamedani
Grudzie n and Szynal (1996) characterized the exponential distribution in
terms of record statistics with random index. In their (1997) paper, they men
tioned that Lin and Too (1989) characterized the exponential distribution via
moments of record values. From Lin and Toos result it follows that the expo
nential distribution can be characterized by an equality involving two moments
of record values. Grudzie n and Szynal (1997) characterized the exponential
distributionby moments of the k
th
record values extending the above mentioned
result due to Lin and Too.
Grudzie n and Szynal (1997), for a xed integer k 1, dene the sequence
_
Y
(k)
n
_
n1
of the k
th
record values as follows:
Y
(k)
n
= X
U
k
(n),L
k
(n)+k1
, n = 1, 2, . . .,
where the sequence (U
k
(n))
n1
of the k
th
record times is given by
U
k
(1) = 1,
U
k
(n+1) = min
_
j j >U
k
(n), X
j, j+k1
> X
U
k
(n),L
k
(n)+k1
_
, n = 1, 2, . . .
Note that for k = 1 the sequence
_
Y
(1)
n
_
n1
is the sequence
_
X
U(n)
_
n1
of
record values dened in the beginning of this chapter. Here are their results
stated in Theorems 6.1.21 and 6.1.22 below.
Theorem 6.1.21. Assume E
_
min{X
1
, X
2
, . . . , X
k
}
2p
_
< for a xed inte
ger k 1 and some p > 1. Suppose that N is a positive integervalued random
variable independent of (X
n
)
n1
. Then F E(1) if and only if
E
_
_
Y
(k)
N
_
2
_
2k
1
E
_
NY
(k)
N+1
_
+k
2
E[N(N+1)] = 0,
provided that E
_
N
2
< .
Theorem 6.1.22. Assume E
_
min{X
1
, X
2
, . . . , X
k
}
2p
_
< for a xed inte
ger k 1 and some p > 1. Then F E(1) if and only if
E
_
_
Y
(k)
1
_
2
_
2
k
E
_
Y
(k)
2
_
+
2
k
2
= 0,
Characterizations of Exponential Distribution II 107
proving that each set
_
E
_
_
Y
(k)
1
_
2
_
, E
_
Y
(k)
2
_
_
, k 1, characterizes the expo
nential distribution.
For k = 1, Theorem 6.1.22 reduces to the following corollary.
Corollary 6.1.23. Assume E
_
X
1

2p
_
< for some p > 1. Then F E(1)
if and only if
E
_
_
X
L(n)
_
2
_
2n
(n1)!
E
_
X
L(n+1)
+n(n+1) = 0.
Remark 6.1.24. Theorems 6.1.21 and 6.1.22 as well as Corollary 6.1.23 are
special cases of the characterization results for more general distributions than
exponential distribution. We reduced the original theorems to the exponential
case to be consistent with the theme of this chapter and the book as a whole. The
interested readers can see the general results in Grudzie n and Szynal (1997).
L opezBl aquez and MorenoRebollo (1997) presented certain characteriza
tions of distributions based on linear regression of record values. One of these
distributions is exponential distribution given in Theorem 6.25 below. Their
result on exponential distribution extends Nagarajas (1988) result in this direc
tion.
Theorem 6.1.25. If F is k times differentiable, and for certain nonnegative
integer, i, the conditional expectations E
_
X
U(i+k)
X
U(i)
and E
_
X
U(i)
X
U(i+k)
are both linear, then, except for location and scale parameters, F is the cd f of
an exponential distribution.
The following results (Theorems 6.1.26, 6.1.27 and 6.1.30 and Corollary
6.1.29) due to Rao and Shanbhag (1998), extend the results in Dallas (1981),
Gupta (1984), Rao and Shanbahg (1986, 1994), Witte (1988) and Huang and Li
(1993) all of which, except Rao and Shanbhag (1994), were mentioned before
in this chapter.
Theorem 6.1.26. For some k 1, X
U(k+1)
X
U(k)
X
1
if and only if X
1
has
an exponential distribution.
108 M. Ahsanullah and G.G. Hamedani
As a corollary (see Corollary 6.1.29 below) to their following theorem, Rao
and Shanbhag (1998) establish a characterization of the exponential distribution.
Theorem 6.1.27. Let k be a positive integer and be a nonconstant real
monotonic left continuous function on R
+
such that E
_
_
X
U(k+1)
X
U(k)
_
<
and
F
k
(x+) = F
k
((y+)) a.e. [(+) (0+)]
whenever 0 < F
k
(x) = F
k
(y) < F
k
(y),
where F
k
is the cd f of X
U(k)
. Then, for some c =(0+),
E
_
_
X
U(k+1)
X
U(k)
_
X
U(k)
= c a.s.
if and only if the left extremity, l
k
, of F
k
is nite, and either is nonarithmetic
and conditional distribution of X
1
l
k
given that X
1
> l
k
is exponential, or for
some > 0, is arithmetic with span and for some (0, 1)
P{X
1
l
k
x+n} =
n
P{X
1
l
k
x}, x > 0; n = 0, 1, . . .,
where X
1
is a random variable with cd f F.
Remark 6.1.28. When F is continuous, Theorem 6.1.27 holds without the
left continuity assumption of .
Corollary 6.1.29 (Rao and Shanbhag, 1998). Let the assumptions in Theo
rem 6.1.27 be met. Then the following assertion holds:
If F is continuous or has its left extremity as one of its continuity points and
is nonarithmetic, then, for some c =(0+), E
_
_
X
U(k+1)
X
U(k)
_
X
U(k)
=c
a.s. holds if and only if F is exponential, with a shift.
Theorem 6.1.30. Let F be continuous and k
2
> k
1
1 be xed integers.
Then, on some interval of the type (, a), with a > the left extremity of
the distribution of X
U(k
1
)
, the conditional distribution of X
U(k
2
)
X
U(k
1
)
given
X
U(k
1
)
= x is independent of x for almost all x if and only if F is exponential,
with a shift.
Characterizations of Exponential Distribution II 109
For the next characterization of exponential distributionwe need a couple of
new notation. Dene two sequences of random variables (
n
)
n1
and (
n
)
n1
by
n
=
_
1 if X
n+1
<
n
i=1
X
i
, n = 1, 2, . . .,
0 otherwise
and
n
=
_
1 if X
L(n)+1
< X
L(n)
,
0 if X
L(n)+1
X
L(n)
,
n = 1, 2, . . . .
The following two Theorems are due to Bairamov (2000).
Theorem 6.1.31. Let X
1
be a nonnegative random variable having contin
uous cd f F satisfying inf {xF(x) > 0} = 0. Then the following statements are
equivalent:
(a) X
1
has an exponential distribution.
(b) For some n > 1
E[
n
] = E[
n
]
and F is either NBU or NWU.
Theorem 6.1.32. Let F be absolutely continuous satisfying
inf {xF (x) > 0} = 0. Then the following properties are equivalent:
(a) X
1
has an exponential distribution.
(b) For some n > 1
n
i=1
X
i
X
L(n)
,
and F is either NBU or NWU.
The following two characterizations of the exponential distribution, due to
Lee (2001), are given in terms of conditional expectations of record values im
proving similar characterizations mentioned before.
Theorem 6.1.33. If F is absolutely continuous with F (x) < 1 for all x, then
E
_
X
U(n+1)
X
U(n)
X
U(m)
= y
= c, c > 0, n m+1,
if and only if F is exponential.
110 M. Ahsanullah and G.G. Hamedani
Theorem 6.1.34. If F is absolutely continuous with F (x) <1 for all x, Then
E
_
X
U(n+2)
X
U(n)
X
U(m)
= y
= ic, c > 0.
The following eight characterizations of the exponential distribution have
appeared in Ahsanullahs book Record valuesTheory and Applications ; Uni
versity Press of America Inc. (2004). We present them here for the sake of
completeness. The rst theorem below is a generalization of Theorem 6.1.2.
Theorem 6.1.36. Let (X
n
)
n1
be i.i.d. rv
j=0
(1)
j
( j +1)
{q(u, v)}
r+1
u
q(u, v)
=
j=0
(1)
j
( j +1)
1
(r + j +1)
u
q(u, v).
Hence
j=0
(1)
j
( j +1)
{q(u, v)}
r+j+1
1
(r + j +1)
= c+
g(u)du =: g
1
(u), say.
(6.1.1)
Here g
1
(u) is a function of u only and c is independent of u but may depend on
v.
Now, letting u 0
+
, we see that q(u, v) 0 and hence from (6.1.1), we
have c as independent of v.
Therefore,
0 =
v
g
1
(v) =
j=0
(1)
j
( j +1)
{q(u, v)}
r+j
u
q(u, v)
= g(u)
v
q(u, v)
_
u
q(u, v)
_
1
.
Now, we have g(u) = h(u, v) = 0 and
u
q(u, v) = 0, then we must have
v
q(u, v)=0.
Now, we prove the sufciency condition of Theorem 6.1.36. The joint pd f
of Z
n,m
= X
U(n)
X
U(m)
and X
U(m)
is
f (z, u) =
R
m1
(x)r (x)
(m)(nm)
{R(z +x) R(x)}
nm1
f (z +x),
for 0 < z < , 0 < x <,
112 M. Ahsanullah and G.G. Hamedani
where R(x), r (x) and f (x) are ln
_
F (x)
_
, f (x)/F(x) and pd f corresponding
to cd f F, respectively.
The conditional pd f of Z
n,m
given X
U(m)
= x is
f
_
zX
U(m)
= x
_
=
1
(nm)
{R(z +x) R(x)}
nm1
f (z +x)
F(x)
,
for 0 < z <, 0 < x < . (6.1.2)
Since Z
n,m
and X
U(m)
are independent, we will have for all z > 0,
{R(z +x) R(x)}
nm1
f (z +x)
F (x)
, (6.1.3)
as independent of x.
Now, let R(z +x) R(x) = ln
F(z+x)
F(x)
= q(z, x), say. Writing (6.1.3) in
terms of q(z, x), we get
{q(z, x)}
nm1
exp{q(z, x)}
z
q(z, x), (6.1.4)
as independent of x. Hence, by Lemma 6.1.37, we have
ln
_
F(z +x)
_
F(x)
__
1
= q(z +x) = c(z), (6.1.5)
where c(z) is a function of z only. Thus
F (z +x)
_
F (x)
_
1
= c
1
(z), (6.1.6)
where c
1
(z) is a function of z only.
The relation (6.1.6) is true for all z 0 and any arbitrary xed positive num
ber x. The continuous solution of (6.1.6) with the boundary condition F(0) = 1
and F () = 0 is
F (x) = exp{x},
for x 0 and any arbitrary positive real number .
Characterizations of Exponential Distribution II 113
Remark 6.1.38. The assumption of absolute continuity of cd f F in The
orem 6.1.36 can be replaced by continuity of cd f F.
We have seen that if the sequence (X
n
)
n1
of i.i.d.rv
j=1
Z
j
,
where Z
j
s are i.i.d. E ().
The following theorem gives a characterization of the exponential distribu
tion using the above property.
Theorem 6.1.39. Let (X
n
)
n1
be a sequence of i.i.d. rv
s with an absolutely
continuous cd f F and corresponding pd f f and F (0) = 0, F (x) < 1, for all
x >0. If F NBUor NWUand Z
n+1,n
_
= X
U(n+1)
X
U(n)
_
X
1
, then X
1
E().
Proof. The pd f g
n
of Z
n+1,n
can be written as
g
n
(z) =
_
0
(R(u))
n1
(n)
r (u) f (u+z)du, z 0,
0, otherwise.
(6.1.7)
Since Z
n+1,n
X
1
, we must have
0
(R(u))
n1
r (u)
(n)
f (u+z)du = f (z), for all z > 0. (6.1.8)
Substituting
0
(R(u))
n1
f (u)du =(n), (6.1.9)
we have
0
(R(u))
n1
r (u) f (u+z)du
= f (z)
0
(R(u))
n1
f (u)du, for all z > 0. (6.1.10)
Thus
0
(R(u))
n1
f (u)
_
f (u+z)
_
F (u)
_
1
f (z)
_
du = 0, for all z > 0.
(6.1.11)
114 M. Ahsanullah and G.G. Hamedani
Integrating (6.1.11) with respect to z from z
1
to , we arrive at
0
(R(u))
n1
f (u)
_
F (u+z
1
)
_
F (u)
_
1
F (z
1
)
_
du = 0, for all z
1
>0.
(6.1.12)
If F is NBU, then (6.1.12) is true if
F(u+z
1
)
_
F (u)
_
1
= F (z
1
), for all z
1
> 0. (6.1.13)
The only continuous solution of (6.1.13) with boundary conditions F (0) = 1
and F () = 0, is F (x) = exp(x), where is an arbitrary real positive num
ber.
Similarly, if F is NWU then (6.1.12) is true if (6.1.13) is satised and hence
X
1
E().
The following theorem is proved under the assumption of monotone hazard
rate.
Theorem 6.1.40. Let (X
n
)
n1
be a sequence of i.i.d. rv
s with an absolutely
continuous cd f F with corresponding pd f f and F (0) = 0. If Z
n+1,n
and Z
n,n1
are i.d. and F belong to H
, then X
1
E().
Proof. We have
P(Z
n+1,n
> z) =
_
0
(R(u))
n1
r(u)
(n)
F (u+z) du, for all z > 0,
0, otherwise.
Since Z
n+1,n
and Z
n,n1
are i.d., using the above equation we have
0
(R(u))
n
r (u)F (u+z)du
= n
0
(R(u))
n1
r (u)F(u+z)du, for all z > 0. (6.1.14)
Substituting the identity
n
0
(R(u))
n1
r (u)F (u+z)du =
0
(R(u))
n
f (u+z)du
Characterizations of Exponential Distribution II 115
in (6.1.14), we get, on simplication, that
0
(R(u))
n1
r (u)F(u+z)
_
1
r (u+z)
r (u)
_
du = 0, for all z > 0. (6.1.15)
Thus if F H
s with
an absolutely continuous cd f F with the corresponding pd f f . If F H
and
for some xed n, m, 1 m<n <, Z
n,m
_
= X
U(n)
X
U(m)
_
X
U(nm)
, then X
1
E().
Proof. The pd f
s f
1
of X
U(nm)
and f
2
of Z
n,m
can be written as
f
1
(x) =
1
(nm)
(R(x))
nm1
f (x), for 0 < x < , (6.1.17)
and
f
2
(x) =
0
(R(u))
m1
[R(x+u) R(x)]
nm1
(n)(nm)
r (u) f (x+u) du (6.1.18)
for 0 < x <.
Integrating (6.1.17) and (6.1.18) with respect to x from 0 to x
0
, we get
F
1
(x
0
) = 1g
1
(x
0
), (6.1.19)
where
g
1
(x
0
) =
nm
j=1
(R(x
0
))
j1
( j)
e
R(x
0
)
,
and
F
2
(x
0
) = 1g
2
(x
0
, u), (6.1.20)
116 M. Ahsanullah and G.G. Hamedani
where
g
2
(x
0
, u) =
nm
j=1
[R(x
0
+u) R(u)]
j1
( j)
exp{R(x
0
+u) R(u)}.
Now equating (6.1.19) and (6.1.20), we get
0
(R(u))
m1
(m)
f (u)[g
2
(x
0
, u)g
1
(x
0
)] du = 0, for all x
0
0. (6.1.21)
Thus, if F H
s with an absolutely
continuous cd f F such that inf{xF (x) > 0} = 0 and E
_
X
2
n
<. Then X
1
has
exponential distributionif and only if Var
_
Z
n+1,n
X
U(n)
= x
0
z
2
_
F (x)
_
1
dF(z +x)
= 2
0
z
_
F (x)
_
1
dF (z +x) dz, (6.1.23)
and
E
_
Z
n+1,n
X
U(n)
= x
0
z
_
F (x)
_
1
dF (z +x)
=
0
_
F(x)
_
F (z +x) dz. (6.1.24)
Characterizations of Exponential Distribution II 117
Substituting G(x) =
0
zF(z +x)dz and denoting G
(r)
(x) as the r
th
derivative
of G(x) , we have on simplication
G
(1)
(x) =
0
F(z +x)dz, G
(2)
(x) = F(x) and G
(3)
(x) =f (x),
where f is pd f corresponding to F. Expressing (6.1.23) and (6.1.24) in terms
of G
(r)
(x), we have
Var
_
Z
n+1,n
X
U(n)
= x
= 2G(x)
_
G
(2)
(x)
_
1
_
G
(1)
(x)
_
G
(2)
(x)
_
1
_
2
= b, for all x > 0.
(6.1.25)
Differentiating (6.1.25) with respect to x and simplifying, we obtain
2G
(3)
(x)
_
G
(2)
(x)
_
3
_
_
G
(1)
(x)
_
2
G(x)G
(2)
(x)
_
= 0. (6.1.26)
Since G
(3)
(x) = 0 for all x > 0, we must have
_
G
(1)
(x)
_
2
G(x)G
(2)
(x) = 0, (6.1.27)
i.e.
d
dx
_
G(x)
_
G
(1)
(x)
_
1
_
= 0, for all x > 0. (6.1.28)
The solution of (6.1.28) is
G(x) = ae
cx
, x > 0, (6.1.29)
where a and c are arbitrary constants. Hence
F(x) = G
(2)
(x) = ac
2
e
cx
, x > 0.
Since F is a cd f with F (0) = 0, it follows that
F(x) = e
x
, x > 0 and > 0 is an arbitrary constant.
118 M. Ahsanullah and G.G. Hamedani
The following theorem gives a characterization of the exponential distribu
tion using the hazard rate.
Theorem 6.1.43. Let (X
n
)
n1
be a sequence of i.i.d. rv
s with an abso
lutely continuous cd f F and corresponding pd f f such that inf {xF(x) = 0} =
0, F(x) < 1 for all x > 0 and F H
. Then X
1
E() if and only if for some
xed n, n 1, the hazard rates r
1
of Z
n+1,n
and r of X
1
are equal.
Proof. We only need to prove the only if condition. Suppose r
1
=r. The joint
pd f of X
U(n+1)
and X
U(n)
is given by
f
n+1,n
(x, y) =
_
1
(n)
(R(x))
n1
r (x) f (y), 0 < x < y < ,
0, otherwise.
Substituting Z
n+1,n
= X
U(n+1)
X
U(n)
and V
n
= X
U(n)
, we have the joint pd f of
Z
n+1,n
and V
n
as
f
1
(z, v) =
_
1
(n)
(R(v))
n1
r (v) f (z +v) , for 0 < z, v <,
0, otherwise.
(6.1.30)
By (6.1.30), we can write
r
1
(z) =
0
(R(v))
n1
r (v) f (z +v)dv
0
(R(v))
n1
r (v)F (z +v)dv
, for all z 0. (6.1.31)
Since r
1
(z) = r (z) for all z, the RHS of (6.1.31) must be equal to
f (z)
F(z)
for all
z 0, from which, after simplication, we obtain
0
(R(v))
n1
r (v)F (z)F (z +v) [r (z +v) r (z)] dv = 0, for all z 0.
(6.1.32)
Since F H
s with cd f F
such that F (0) = 0 and lim
x0
+
F(x)
x
=, > 0. If (L(n, k) k +1) X
L(n,k)
and
X
1,n
, k 1, are identically distributed, then X E ().
The following theorem, due to Ahsanullah (2004), replaces the equality of
the distributions in Theorem 6.1.44 with the equality of the expectations. For
this we need to dene a special class of distributions. We say that a cd f F of
a rv X with F (0) = 0 and E[X] < , belongs to harmonic new better (worse)
than used in expectation ,HNBUE (HNWUE), if for t > 0,
t
F(x)dx ()e
.
Theorem 6.1.45. Let (X
n
)
n1
be a sequence of i.i.d. rv
s with a cd f F with
F (0) = 0. If F is HNBUE or HNWUE, then
E
_
(U(n, k)k +1)X
U(n,k)
= E[X
1,k
]
if and only if F is exponential.
Iwi nska (2005) presented characterizations of the exponential distribution
based on the distributional properties and the expected values of the record val
ues. It is assumed throughout the paper that the random variables are contin
uous and nonnegative and their cd f F has the property that lim
x0
+ F(x)/x
exists and is nite. It is also assumed that the index of the record values has a
geometric distribution.
Bairamov et al. (2005) characterized the exponential distributionin terms of
the regression of a function of a record value with its adjacent record values as
covariate. Some of the characterizations mentioned before in this chapter are of
similar nature. Yanev et al. (2007) extended Bairamov et al.s (2005) results to
truncated exponential distributions with support (l
F
, ) where, as in Chapter 5,
l
F
= inf{xF(x) > 0}. Clearly, in case l
F
= 0, their results reduce to Bairamov
et al.s (2005) for the exponential distribution. For more details of truncated
exponential distributions we refer the reader to Yanev et al. (2007).
120 M. Ahsanullah and G.G. Hamedani
6.2. Characterizations Based on Generalized Order
Statistics
So far, in Section 6.1, we have been considering characterizations of the ex
ponential distribution based on record values. As we mentioned in Chapter 5,
the concept of generalized order statistics was introduced by Kamps (1995) as
a unied approach to order statistics and record values. We presented vari
ous characterizations of the exponential distribution based on generalized order
statistics in Section 5.3. These characterizations can be included in this section
as well, however we will not repeat them here and instead refer the reader to
Section 5.3 one more time, for a review of the characterizations of the exponen
tial distribution in terms of generalized order statistics.
References
Abramowitz, M. and Stegan, I. (1972). Handbook of Mathematical Functions.
Dover, New York, NY.
Aczel, J. (1966). Lectures on Functional Equations and Their Applications.
Academic Press, New York, NY.
Ahsanullah, M. (1975). A characterization of the exponential distribution. In:
G. P. Patil, S. Kotz and J.O rd (eds.), Statistical Distributions in Scientic
Work, Vol. 3, 7188. DordrechtHolland, D. Reidel Publishing Company.
Ahsanullah, M. (1976). On a characterization of the exponential distribution
by order statistics. J. Appl. Prob., 13, 818822.
Ahsanullah, M. (1977). A Characteristic Property of the Exponential Distribu
tion. Ann. of Statist., 5, 580582.
Ahsanullah, M. (1978a). A characterization of the exponential distribution by
spacing. J. Appl. Prob., 15, 650653.
Ahsanullah, M. (1978b). On characterizations of exponential distribution by
spacings. Ann. Inst. Stat. Math., 30, A, 163166.
Ahsanullah, M. (1978c). Record Values and the Exponential Distribution.
Ann. Inst. Statist. Math., 30, A, 429433.
Ahsanullah, M. (1979). Characterization of the Exponential Distribution by
Record Values. Sankhy a, Ser. B, 41, 116121.
122 References
Ahsanullah, M. (1980). Linear Prediction of Record Values for the Two Pa
rameter Exponential Distribution. Ann. Inst. Stat. Math. 32, A, 363368.
Ahsanullah, M. (1981a). Record Values of the Exponentially Distributed Ran
dom Variables. Statistiche Hefte, 2, 121127.
Ahsanullah, M. (1981b). On a Characterization of the Exponential Distribution
by Weak Homoscedasticity of Record Values. Biom. J., 23, 715717.
Ahsanullah, M. (1981c). On characterizations of the exponential distribution
by spacings. Statische Hefte, 22, 316320.
Ahsanullah, M. (1982). Characterizations of the Exponential Distribution by
Some Properties of Record Values. Statistiche Hefte, 23, 326332.
M.Ahsanullah (1984). A characterization of the exponential distribution by
higher order gap. Metrika, 31, 323326.
Ahsanullah, M. (1987a). Two Characterizations of the Exponential Distribu
tion. Comm. Statist. TheoryMethods, 16(2), 375381.
Ahsanullah, M. (1987b). Record Statistics and the Exponential Distribution.
Pak. J. Statist., 3, A, 1740.
Ahsanullah,M. (1988a). On a conjecture of Kakosian, Klebanov and Melamed.
Statistiche Hefte, 29, 151157.
Ahsanullah, M. (1988b). Introduction to Record Statistics, Ginn Press, Need
ham Heights, MA.
Ahsanullah, M. (1988c). Characteristic properties of order statistics based on
a random sample size from an exponential distribution. Statistica Neer
landica, 42, 193197.
Ahsanullah, M. (1991). Some Characteristic Properties of the Record Values
from the Exponential Distribution. Sankhy a, Ser. B, 53, 403408.
Ahsanullah, M. (1992). Record Values of Independent and Identically Dis
tributed Continuous Random Variables. Pak. J. Statist., 8(2), A, 934.
References 123
Ahsanullah, M. (1994). Records of Univariate Distributions. Pak. J. Statist.,
9(3), 4972.
Ahsanullah, M. (1995). Record Statistics. Nova Science Publishers Inc., New
York, NY.
Ahsanullah, M. (2000). Generalized order statistics from exponential distribu
tion. J. Statist. Plan. and Inf., 25, 8591.
Ahsanullah, M. (2003). Some characteristic properties of the generalized order
statistics from exponential distribution. J. Statist. Research,Vol. 37, 2,
159166.
Ahsanullah, M. (2004). Record ValuesTheory and Applications. University
Press of America, Lanham, MD.
Ahsanullah, M. (2006). The generalized order statistics from exponential dis
tribution. Pak.J. Statist., Vol. 22, 2, 121128.
Ahsanullah, M. and Aliev, F. (2008). Some characterizations of exponential
distribution by record values. Journal of Statistical Research, Vol. 2,
No. 1, 1116.
Ahsanullah, M. and Kirmani, S.N.U.A. (1991). Characterizations of the Ex
ponential Distribution by Lower Record Values. Comm. Statist. Theory
Methods, 20(4), 12931299.
Ahsanullah, M. and Nevzorov, V.B. (2001a). Ordered Random Variables.
Nova Science Publishers Inc, New York, NY.
Ahsanullah, M. and Nevzorov, V.B. (2001b). Distribution between uniform
and exponential. In: M. Ahsanullah, J. Kenyon and S.K. Sarkar (eds.),
Applied Statistical Science IV, 920.
Ahsanullah, M. and Wesolowski, J. (1998). Linearity of Best Nonadjacent
Record Values. Sankhy a, Ser. B, 231237.
Arnold, B.C. (1971). Two characterizations of the exponential distribution.
Technical Report, Iowa State University.
124 References
Arnold, B.C. (1980). Two characterizations of the geometric distribution. J.
Appl. Prob. 17, 570573.
Arnold, B.C. and Balakrishnan, N. (1989). Relations, Bounds and Approxima
tions for Order Statistics. Lecture Notes in Statistics, No. 53, Springer
Verlag, New York, NY.
Arnold, B.C., Balakrishnan, N. and Nagaraja, H. N. (1998). Records. John
Wiley & Sons Inc., New York. NY.
Arnold,B.C. and Ghosh, M. (1976). A characterization of geometric distribu
tions by distributional properties of order statistics. Scan. Actuarial J.,
232234.
Azlarov, T. A. and Volodin, N. A. (1986). Characterization Problems As
sociated with the Exponential Distribution. SpringerVerlag, New York,
NY.
Bairamov, I.G. and Ahsanullah, M. (2000). Distributional Relations Between
Order Statistics and the Sample itself and Characterizations of Exponen
tial Distribution. J. Appl. Statist. Sci., Vol. 10(1), 116.
Bairamov, I.G., Ahsanullah,M. and Pakes, A.G. (2005). A characterization of
continuous distributions via regression on pairs of record values. Aus
tralian and New Zealand J. Statistics, Vol. 474, 243247.
Bairamov, M., Ahsanullah, M. and Akhundov, I. (2002). A Residual Life
Function of a System Having Parallel or Series Structure. J. of Statistical
Theory & Applications, 119132.
Bairamov, I. and Ozkal, T. (2007). On characterizations of distributions
through the properties of conditional expectations of order statistics.
Commun. in Statist. TheoryMethods, 36, 13191326.
Balakrishnan, N. and Ahsanullah, M. (1993a). Relations for Single and Prod
uct Moments of Record Values from Exponential Distribution. J. Appl.
Statist. Sci., 2(1), 7388.
References 125
Balakrishnan, N. and Ahsanullah, M. (1993b). Relations for Single and Prod
uct Moments of Record Values from Lomax Distribution. Sankhy a, B, 56,
140146..
Balakrishnan, N. and Balasubramanian, K. (1995). A Characterization of Ge
ometric Distribution Based on Record Values. J. Appl. Statist. Sci., 2,
277282.
Barton, D.E. and Mallows, C.L. (1965). Some Aspects of the Random Se
quence. Ann. Math. Statist. 36, 236260.
Basak, P. (1996). Lower Record Values and Characterization of Exponential
Distribution. Calcutta Statistical Association Bulletin, 46, 17.
Basu, A.P. (1965). On characterizing the exponential distribution by order
statistics. Ann. Inst. Statist. Math. 17, 0396.
Beg, M.I. and Ahsanullah, M. (2006). On characterizating distributions by
conditional expectations of functions of generalized order statistics. J.
Appl. Statist. Sci., Vol. 15(2), 229244.
Bieniek, M. and Szynal, D. (2003). Characterizations of Distributions via Lin
earity of Regression of Generalized Order Statistics. Metrika, 58, 259
271.
Blom, G. Thorburn, D. and Vessey, T. (1990). The Distribution of the Record
Position and its Applications. Amer. Statistician, 44, 152153.
Bruss, F.T. (1988). Invariant Record Processes and Applications to Best
Choice Modeling. Stoch. Proc. Appl. 17, 331338.
Bell, C.B. and Sarma, Y.R.K. (1980). A characterization of the exponential
distribution based on order statistics. Metrika, 27, 263269.
Chan, L.K. (1967). On a characterization of distributions by expected values
of extreme order statistics. Amer. Math. Monthly, 74, 950951.
Chandler, K.N. (1952). The Distribution and Frequency of Record Values. J.
Roy. Statist. Soc., B, 14, 220228.
126 References
Cinlar, E. (1975). Introduction to Stochastic Processes. PrenticeHall, New
Jersey.
Cramer, E., Kamps, U. and Keseling, C. (2004). Characterizations via Lin
earity of Ordered Random Variables: A Unifying Approach. Commun.
Statist. TheoryMethods, Vol. 33, No. 12, 28852911.
Crawford, G.B. (1966). Characterizations of geometric and exponential distri
butions. Ann. Math. Statist., 37, 17901794.
Csorgo, M. Seshadi, V. and Yalovsky, M. (1975). Applications of characteriza
tions in the area of goodness of t. In: G.P. Patil et al. (eds.), Statististical
distributions in Scientic Work, Vol. 2, Reidel Dordrecht, 7990.
Dallas, A.C. (1981). Record Values and the Exponential Distribution. J. Appl.
Prob., 18, 959951.
Dallas, A.C. (1981). A Characterization Using Conditional Variance. Metrika,
28, 151153.
Davies, P.L. and Shabbhag, D.N.(1987). A generalization of a theorem by
Deny with applications in characterization theory. Quart. J. Math. Ox
ford, 38(2), 1334.
David, H.A. (1981). Order Statistics. Second Edition, John Wiley & Sons,
Inc., New York, NY.
David, H.A. and Nagaraja, H.N. (2003). Order Statistics. Third Edition, Wiley
& Sons, Hoboken, New Jersey.
DeHaan, L. and Resnick, S.I. (1973). Almost Sure Limit Points of Record
Values. J. Appl. Prob., 10, 528542.
Deheuvels, P. (1983). The Complete Characterization of the Upper and
Lower Class of Record and InterRecord Times of i.i.d. Sequence. Zeit.
Wahrscheinlichkeits theorie Verw. Geb., 62, 16.
Deheuvels, P. (1984). The Characterization of Distributions by Order Statistics
and Record Values A Unied Approach. J. Appl. Prob., 21, 326334.
References 127
Deken, J.G. (1978). Record Values, Scheduled Maxima Sequences. J. Appl.
Prob., 15, 491496.
Dembi nska, A. and Wesolowski, J. (1998). Linearity of Regression for Non
Adjacent Order Statistics. Metrika, 48, 215222.
Dembi nska, A. and Wesolowski, J. (2000). Linearity of Regression for Non
Adjacent Record values. J. of Statistical Planningand Inference , 90, 195
205.
Dembi nska, A. and Wesolowski, J. (2003). Constancy of Regression for size
two Record Spacings. Pak. J. Statist., 19(1), 143149.
Dembi nska, A. and Wesolowski, J. (2000). Linearity of Prediction for Non
adjacent Record Values. J. Statist. Plan. Inf., 90, 195205.
Desu, M.M. (1971). A characterization of the exponential distributionby order
statistics. Ann. Math. Statist., 42, 837838.
Dufur, R. (1982). Tests dajustement pour des echantillon tonques ou cen
sures.Ph.D. Thesis, Universite de Montreal.
Dufur, R., Maag, V.R. and van Eeden, C. (1984). Correcting a proof of a
characterization of the exponential distribution. J. Roy. Statist. Soc., B,
46, 238241.
Dunsmore, J.R. (1983). The Future Occurrence of Records. Ann. Inst. Stat.
Math., 35, 267277.
Embrechts, P. and Omey, E. (1983). On Subordinated Distributions and Ran
dom Record Processes. Ma. P. Cam. Ph. 93, 339353.
Feller, W. (1957). An Introduction to Probability Theory and Its Applications,
Vol. I, 2nd Edition. Wiley & Sons, New York, NY.
Feller, W. (1966). An Introduction to Probability Theory and its Applications .
Vol. II, Wiley & Sons, New York, NY.
Ferguson, T.S. (1964). A characterization of the negative exponential distribu
tion. Ann. Math. Statist., 35, 11991207.
128 References
Ferguson, T.S. (1967). On characterizing distributions by properties of order
statistics. Sankhy a, Ser. A, 29, 265277.
Fisz, M. (1958). Characterizations of some probability distributions. Skand.
Aktirarict., 6567.
Fosam, E.B. Rao, C.R. and Shanbhag, D.N. (1993). Comments on some papers
involving Cauchy functional equation. Statist. Prob.Lett., 17, 299302.
Foster, F.G. and Stuart, A. (1954). DistributionFree Tests in Time Series Based
on the Breaking of Records. J. Roy. Statist. Soc., B, 16, 122.
Foster, F.G. and Teichroew, D. (1955). A Sampling Experiment on the Powers
of the Record Tests for a Trend in a Time Series. J. Roy. Statist. Soc., B,
17, 115121.
Franco, M. and Ruiz, J.M. (1995). On Characterization of Continuous Distri
butions with Adjacent Order Statistics. Statistics, 26, 275385.
Franco, M. and Ruiz, J.M. (1996). On Characterization of Continuous Dis
tributions by Conditional Expectation of Record Values. Sankhy a, 58,
Series A, Pt. 1, 135141.
Franco, M. and Ruiz, J.M. (1997). On Characterizations of Distributions
by Expected Values of Order Statistics and Record Values with Gap.
Metrika, 45, 107119.
Franco, M. and Ruiz, J.M. (2001). Characterization of Discrete distributions
based on conditional expectations of Record Values. Statistical Papers,
42, 101110.
Fr echet, M. (1927). Sur La loi probabilite de l?cart Maximum. Ann. de la oc.
Polonaise de Math., 6, 93116.
Freudenberg, W. and Szynal, D. (1976). Limit Laws for a Random Number
of Record Values. Bull. Acad. Polon. Sci. Ser. Math. Astr. Phys., 24,
195199.
Galambos, J. (1987). The Asymptotic Theory of Extreme Order Statistics .
Robert E. Krieger Publishing Co. Malabar, FL.
References 129
Galambos, J. (1975a). Characterizations of probability distributions by prop
erties of order statistics II. In: G.P. Patil et al. (eds.), Statistical Distribu
tions in Scientic Work, Vol. 3, Reidel Dordrecht, 89101.
Galambos, J. (1975b). Characterizations of probability distributions by prop
erties of order statistics I. In: G.P. Patil et al. (eds.), Statistical Distribu
tions in Scientic Work, Vol. 3, Reidel Dordrecht, 7186.
Galambos, J. and Kotz, S. (1978). Characterizations of Probability Distribu
tions. Lecture Notes in Mathematics, No. 675, SpringerVerlag, New
York, NY.
Galambos, J. and Kotz, S. (1983). Some characterizations of the exponential
distribution via properties of geometric distribution. In: P.K. Sen, ed.,
Essays in honor of Norman L. Johnson, North Holland, Amsterdam, 159
163.
Galambos, J. and Seneta, E. (1975). Record Times. Proc. Amer. Math. Soc.,
50, 383387.
Gajek, L. and Gather, U. (1989). Characterizations of the Exponential Distri
bution by Failure Rate and Moment Properties of Order Statistics. Lec
ture Notes in Statistics, 51. Extreme Value Theory, Proceeding, 114124.
J.Husler, R.D. Reiss (eds.), SpringerVerlag, Berlin, Germany.
Gather, U. (1989). On a characterization of the exponential distribution by
properties of order statistics, Statist. Prob. Lett., 7, 9396.
Gather, U., Kamps, U. and Schweitzer, N. (1998). Characterizations of dis
tributions via identically distributed functions of order statistics. In:
N.Balakrishnan and C.R. Rao (eds.), Handbook of Statistics, Vol. 16,
257290.
Gaver, D.P. (1976). Random Record Models. J. Appl. Prob., 13, 538547.
Gaver, D.P. and Jacobs, P.A. (1978). Non Homogeneously Paced Random
Records and Associated Extremal Processes. J. Appl. Prob., 15, 543
551.
130 References
Glick, N. (1978). Breaking Records and Breaking Boards. Amer. Math.
Monthly, 85(1), 226.
Gnedenko, B. (1943). Sur la Distribution Limite du Terme Maximum dune
Serie Aletoise. Ann. Math., 44, 423453.
Govindrarajulu, Z. (1966). Characterizations of the exponential and power
function distributions. Scand. Aktuarietdskr., 49, 132136.
Goldburger, A.S. (1962). Best Linear Unbiased Predictors in the Generalized
Linear Regression Model. J. Amer. Statist. Assoc., 57, 369375.
Goldie, C.M. (1989). Records, Permutations and Greatest Convex Minorants.
Math. Proc. Camb. Phil. Soc., 106, 169177.
Goldie, C.M. and Resnick, S.I. (1989). Records in Partially Ordered Set. Ann.
Prob., 17, 675689.
Goldie, C.M. and Resnick, S.I. (1995). Many Multivariate Records. Stoch.
Proc. And Their Appl., 59, 185216.
Goldie, C.M. and Rogers, L.C.G. (1984). The kRecord Processes are i.i.d. Z.
Wahr. Verw. Geb., 67, 197211.
Gradshteyn, I.S. and Ryzhik, I.M. (1980). Tables of Integrals, Series, and
Products, Corrected and Enlarged Edition. Academic Press, Inc.
Grosswald, E. and Kotz, S. (1981). An Integrated Lack of Memory Property of
the Exponential Distribution. Ann. Inst. Statist. Math., 33, A, 205214.
Grudzien, Z. and Szynal, D. (1985). On the Expected Values of kth Record
Values and Characterizations of Distributions. Probability and Statistical
Decision Theory, Vol A. F. Konecny, J. Mogyorodi and W. Wertz, (eds.),
Dordrecht Reidel, 1195214.
Grudzien, Z. and Szynal, D. (1996). Characterizations of distributions by order
statistics and record values, A Unied Approach. J. Appl. Prob., 21, 326
334..
References 131
Grudzien, Z. and Szynal, D. (1997). Characterizations of uniform and ex
ponential distributions via moments of the kth record values randomly
indexed. Applications Mathematicae, 24, 307314.
Gulati, S. and Padgett, W.J. (1994a). Nonparametric Quantitle Estimation from
Record Breaking Data. Aust. J. of Stat., 36, 211223.
Gulati, S. and Padgett, W.J. (1994b). Smooth Nonparametric Estimation of
Distribution and Density Function from Record Breaking Data. Comm.
In Statist. TheoryMethods, 23, 12591274.
Gulati, S. and Padgett, W.J. (1994c). Smooth Nonparametric Estimation of the
Hazard and Hazard Rate Functions fromRecord Breaking Data. J. Statist.
Plan. Inf., 42, 331341.
Gupta, R.C. (1973). A characteristic property of the exponential distribution.
Sankhy a, Ser. B, 35, 365366.
Gupta, R. C. (1984). Relationships between Order Statistic and Record Values
and Some characterization Results. J. Appl. Prob., 21, 425430.
Gupta, R.C. and Ahsanullah, M. (2004). Characterization results based on
the conditional expectation of a function of nonadjacent order statistic
(Record Value). Annals of Statistical Mathematics, Vol. 56(4), 721732.
Gut, A. (1990). Convergence Rates for Record Times and the Associated Cov
ering Processes. Stoch. Processes Appl., 36, 135152.
Hamedani, G,G,, Ahsanullah, M. and Sheng, R. (2008). Characterizations of
certain continuous univariate distributions based on the truncated moment
of the rst order statistic. Aligarh Journal of Statistics, 28, 7581.
Hill, B.M. (1975). A Simple General Approach to Inference about the Tail of
a Distribution. Ann. statist., 3, 11631174.
Holmes, P.T. and Strawderman, W. (1969). A Note on the Waiting Times
Between Record Observations. J. Appl. Prob., 6, 711714.
Huang, J.S. (1974). Characterizations of exponential distribution by order
statistics. J. Appl. Prob., 11, 605609.
132 References
Huang, J.S., Arnold, B.C. and Ghosh, M. (1979). On characterizations of the
uniform distribution based on identically distributed spacings. Sankhy a,
Ser B, 41, 109115.
Huang, WenJang and Li, ShunHwa (1993). Characterization Results Based
on Record Values. Statistica Sinica, 3, 583599.
Iwinska, M. (1985). On a characterization of the exponential distribution by
order statistics. In Numerical Methods and Their Applications. Proc. 8th
Sess Poznan Circle Zesz Nauk Ser 1. Akad. Ekad. Poznan, 132, 5154.
Iwinska, M. (1986). On the characterizations of the exponential distributionby
order statistics and record values. Fasciculi Mathematici, 16, 101107.
Iwinska, M. (2005). On characterization of the exponential distribution by
record values with a random index. Fasciculi Mathematici , 36, 3339..
Jenkinson, A.F. (1955). The Frequency Distribution of the Annual Maximum
(or Minimum) Values of Meteorological Elements. Quart. J. Meter. Soc.,
87, 158171.
Joshi, P.C. (1978). Recurrence relation between moments of order statistics
from exponential and truncated exponential distribution. Sankhy a, Ser B,
39, 362371.
Johnson, N.L. and Kotz, S. (1977). Distributions in statistics: Continuous
Multivariate Distributions. Wiley & Sons, New York, NY.
Kakosyan, A. V., Klebanov, L. B. and Melamed, J. A. (1984). Characteriza
tion of Distribution by the Method of Intensively Monotone Operators.
Lecture Notes in Math. 1088, Springer Verlag, New York, N.Y.
Kaminsky, K.S. (1972). Condence intervals for the exponential scale parame
ter using optimally selected order statistics. Technometrics, 14, 371383.
Kaminsky, K.S. and Nelson, P.L. (1975). Best linear unbiased prediction of
order statistics in location and scale families. J. Amer. Statist. Assoc., 70,
145150.
References 133
Kamps, U. (1991). A general recurrence relation for moments of order statis
tics in a class of probability distributions and characterizations. Metrika,
38, 215225.
Kamps, U. (1982a). Identities for the difference of moments of successive
order statistics and record values. Metron, 50, 179187.
Kamps, U. (1992 b). Characterizations of the exponential distributions by
equality of moments. Allg. Statist. Archiv., 78, 122127.
Kamps, U. (1995). A Concept of Generalized Order Statistics. Teubner,
Stuttgart.
Kamps, U. (1998a). Order Statistics. Generalized in Encyclopedia of Statisti
cal Sciences. Update Vol. 3 (S. KotzmRead, C.B. and Banks, D.L., eds.)
To appear (Wiley & Sons, New York, NY).
Kamps, U. (1998b). Subranges of generalized order statistics from exponential
distributions. Fasciculi Mathematici, 28, 6370.
Kamps, U. Cramer, E. (2001). On distribution of generalized order statistics.
Statistics, 35, 269280.
Kamps, U, and Gather, U. (1997). Characteristic properties of generalized or
der statistics from exponential distributions. Applications Mathematicae,
24, 383391.
Karlin, S. (1966). A First Course in Stochastic Processes. Academic Press,
New York, NY.
Keseling, C. (1999). Conditional Distributions of Generalized Order Statistics
and some Characterizations. Metrika, 49, 2740.
Kirmani, S.N.U.A. and Beg, M.I. (1983). On Characterization of Distributions
by Expected Records. Sankhy a, Ser. A, 48, 463465.
Klebanov, L.B. and Melamed, J. A. (1983). A Method Associated with Char
acterizations of the exponential distribution. Ann. Inst. Statist. Math., A,
35, 105114.
134 References
Korwar, R.M. (1984). On Characterizing Distributions for which the Second
Record has a Linear Regression on the First. Sankhya, Ser B, 46, 108
109.
Korwar, R.M. (1990). Some Partial Ordering Results on Record Values. Com
mun. Statist. TheroyMethods, 19(1), 299306.
Kotz, S. (1974). Characterizations of statistical distributions : a supplement in
recent surveys. Internal. Statist. Rev., 42, 3965.
Lau, Kasing and Rao, C. R. Integrated Cauchy Functional Equation and Char
acterization of the Exponential. Sankhy a, Ser A, 44, 7290.
Leadbetter, M.R., Lindgreen, G. and Rootzen, H. (1983). Extremes and Re
lated Properties of Random Sequences and Series , SpringerVerlag, New
York, N.Y.
Lee MinYoung (2001). On a characterization of the exponential distribution
by conditional expectations of record values. Commun. Korean Math.
Soc., 16, 287290.
Lee, MinYoung, Cheng, S.K and Jung, K.H. (2002). Characterizations of the
exponential distribution by order statistics and conditional expectations
of random variables. Commun. Korean Math. Soc., 17, 3965.
Leslie, J.R. and van Eeden,C. (1993). On a characterization of the exponential
distribution on a Type 2 right censored sample. Ann. Statist., 21, 1640
1647.
Lin, G.D. (1987). On Characterizations of Distributions Via Moments of
Record Values. Probab. Th. Rel. Fields, 74, 479483.
Lin, G.d. and Too, Y.H. (1989). Characterizations of uniform and exponential
distributions. Statist. Prob. Lett., 7, 357359..
Lloyd, E.H. (1952). Least Squares Estimation of Location and Scale Parame
ters Using Order Statistics. Biometrika, 39, 8895.
References 135
LopezBlaquez, F. and MorenoReboollo, J.L. (1997). A characterization of
distributions based on linear regression of order statistics and random
variables. Sankhy a, Ser A, 59, 311323.
Malov, S.V. (1997). Sequential ranks. J. Appl. Statist. Sci., 5, 211224.
Mann, N.R. (1969). Optimum Estimators for Linear Functions of Location
and Scale Parameters. Ann. Math. Statist., 40, 21492155.
Marsglia, G. and Tubilla, A. (1975). A Note on the Lack of Memory Property
of the Exponential Distribution. Ann. Prob., 3, 352354.
Mellon, B. (1988). The Olympic Record Book. Garland Publishing Inc., New
York, NY.
Menon, M.V. and Seshardi, V. (1975). A characterization theoremuseful in hy
pothesis testing in contributed papers. 40th session of the Inrtnal. Statist .
Inst. Voorburg, 566590.
Mohan, N.R. and Nayak, S.S. (1982). A Characterization Based on the
Equidistribution of the First Two Spacings of Record Values. Z. Wahr.
Verw. Geb., 60, 219221.
Maag, U., Dufour, R. and van Eeden, C. (1984). Correcting a proof of a char
acterization of the exponential distribution. J. Roy. Statist. Sco., B, 46,
238241.
Nagaraja, H. N. (1977). On a Characterization Based on Record Values. Aus
tral. J. Statist., 19, 7073.
Nagaraja, H. N. (1978). On the Expected Values of Record Values. Austral. J.
Statist., 20, 176182.
Nagaraja, H. N. (1988a) Record Values and Related Statistics a Review,
Commun. Statist. TheoryMethods, 17, 22232238.
Nagaraja, H.N. (1988b). Some characterizations of continuous distributions
based on regression of adjacent order statistics of random variables.
Sankhya, Ser A, 50, 7073.
136 References
Nagaraja, H.N. and Nevzorov, V.B. (1977). On characterizations Based on
Recod Values and Order Statistics. J. Statist. Plan. Inf., 61, 271284.
Nagaraja, H. N., Sen, P. and Srivastava, R.C. (1989). Some Characterizations
of Geometric Tail Distributions Based on Record Values. Statistical Pa
pers, 30, 147155.
Nayak, S.S. (1981). Characterizations Based on Record Values. J. Indian
Statist. Assn., 19, 123127.
Nayak, S.S. (1985). Record Values for and Partial Maxima of a Dependent
Sequence. J. Indian Statist. Assn. , 23, 109125.
Neuts, M.F. (1967). Waiting Times Between Record Observations. J. Appl.
Prob., 4, 206208.
Nevzorov, V.B. (1988). Records. Theo. Prob. Appl., 32, 201228.
Nevzorov, V. B. (1992). A Characterization of Exponential Distributions by
Correlation between Records. Mathematical Methods of Statistics , 1, 49
54.
Nevzorov, V.B. (1995). Asymptotic distributions of Records in Non
Stationary Schemes. J. Statist.. Plan. Inf., 45, 261273.
Nevzorova, L.N.,Nevzorov, V. B. and Balakrishnan, N. ( 1997). Character
izations of distributions by extreme and records in Archimedian copula
processes. In Advances in the Theory and Practice of Statistics A vol
ume in Honor of Samuel Kotz (N.L. Johnson and N. Balakrishnan, eds.),
469478. John Wiley & Sons, New York, NY.
Nevzorov, V. B. (2001). Records: Mathematical Theory. Translation of Math
ematical Monographs, Vol. 194. American Mathematical Society. Provi
dence, RI.
Nevzorov, V.B. and Ahsanullah, M. (2001a). Some Distributions of Induced
Records. Biometrical Journal , 42(8), 10691081.
References 137
Nevzorov, V.B. and Ahsanullah, M. (2001b). Extremes and Records for Con
comitants of Order Statistics and Record Values. J.Appl. Statist. Sci.,
10(3), 181190.
Oncei, S.Y., Ahsanullah, M., Gebizlioglu, O.I. and Aliev, F.A. (2001). Char
acterization of Geometric Distribuion through Normal and Weak Record
Values. Stochastc Modelling and Applications, 4(1), 5358
Pawlas, P. and Szynal, D. (1999). Recurrence Relations for Single and Product
Moments of Kth Record Values From Pareto, Generalized Pareo and
Burr Distributions. Commun. Statist. TheoryMethods, 28(7), 1699
1701.
Pfeifer, D. (1981). Asymptotic Expansions for the Mean and Variance of Log
arithmic InterRecord Times. Meth. Operat. Res., 39, 113121.
Pfeifer, D. (1982). Characterizations of exponential distributions by indepen
dent nonstationary record increments. J. Appl. Prob., 19, 127135 (Cor
rections 19, p. 906).
Pudeg, A. (1990). Charakterisierung von wahrseinlichkeitsverteilungen
durch ver teilungseigenschaften der ordnungesstatistiken und rekorde.
Dissertation Aachen University of Technology.
Puri, P.S. and Rubin, H. (1970). A characterization based on the absolute
difference of two i.i.d. random variables. Ann. Math. Statist., 41, 2113
2122.
Rahimov, I. and Ahsanullah, M. (2001). M. Records Generated by the total
Progeny of Branching Processes. Far East J. Theo. Statist, 5(10), 8184.
Rahimov, I. and Ahsanullah, M. (2003). Records Related to Sequence of
Branching Stochastic Process. Pak. J. Statist., 19, 7398.
Ramachandran, B. (1979). On the strong memoryless property of the expo
nential and geometric laws. Sankhy a, Ser A, 41, 244251.
Ramachandran, B. and Lau, R.S. (1991). Functional Equations in Probability
Theory. Academic Press, Boston, MA.
138 References
Rao. C.R. (1983). An extension of Denys theorem and its application to
characterizations of probability distributions . In: P.J. Bickel et al. (eds.),
A festschrift for Erich L. Lehman, Wordsworth, Belmont, 348366.
Rao, C.R. and Shanbhag, D.N. (1986). Recent results on characterizations
of probability distributions. A unied approach through extensions of
Denys theorem. Adv. Appl. Prob., 18, 660678.
Rao, C.R. and Shanbhag, D.N. (1994). Choquet Deny Type Functional Equa
tions with Applications to stochastic models. Wiley & Sons, Chichestere.
Rao, C.R. and Shanbhag, D.N. (1995a). Characterizations of the exponential
distribution by equality of moments. Allg. Statist. Archiv, 76, 122127.
Rao, C.R. and Shanbhag, D.N. (1995b). A conjecture of Dufur on a character
ization of the exponential distributions. Center for Multivariate Analysis.
Penn State University Technical Report, 95105.
Rao, C.R. and Shanbhag, D.N. (1998). Recent Approaches for Characteriza
tions Based on Order Statistics and Record Values. Handbook of Statis
tics, (N. Balakrishnan and C.R. Rao, eds.) Vol. 10, 231257.
Raqab, M.Z. (1997). Bounds Based on Greatest Convex Minorants for Mo
ments of Record Values. Statist. Prob. Lett., 36, 3541.
Raqab, M.Z. (2002). Characterizations of Distributions Based on Conditional
Expectations of Record Values. Statistics and Decisions, 20, 309319.
Raqab, M.Z. and Ahsanullah, M. (2000). Relations for Marginal and Joint
Moment Generating Functions of Record Values From Power Function
Distribution. J. Appl. Statist. Sci., Vol. 10(1), 2736.
Raqab, M.Z. and Ahsanullah, M. (2001). Estimation of the location and scale
parameters of generalized exponential distribution based on order statis
tics. Journal of Statistical Computing and Simulation , Vol. 69(2), 109
124.
Raqab, M.Z. and Ahsanullah, M. ( 2003). On Moment Generating Functions
of Records from Extreme Value Distributions. Pak. J. Statist., 19(1), 1
13.
References 139
Raqab, M.Z. and Amin, W.A. (1997). A Note on Reliability Properties of k
Record Statistics. Metrika, 46, 245251.
Reidel, M. and Rossberg, H.J. (1994). Characterizations of the exponential
distribution function by properties of the difference X
k+s,n
X
k,n
of order
statistics. Metrika, 41, 119.
Reiss, R.D. (1989). Approximate Distributions of Order Statistics . Springer
Verlag, New York, NY.
Renyi, A. (1962). Theorie des Elements Saillants dune Suit dobservations
Collq. Combinatorial Meth. Prob. Theory, Aarhus University, 104115.
Resnick, S. (1987). Extreme Values, Regular Variation and Point Processes.
SpringerVerlag, New York, NY.
Resnick, S.I. (1973). Record Values and Maxima. Ann. Probab., 1, 650662.
Roberts, E.M. (1979). Reviewof Statistics of Extreme Values with Application
to Air Quality Data. Part II: Application. J. Air Polution Control Assoc.,
29, 733740.
Rossberg, H.J. (1972). Characterization of the exponential and Pareto distri
butions by means of some properties of the distributions which the differ
ences and quotients of order statistics subject to. Math Operationsforsch
Statist., 3, 207216.
Salamingo, F.J. and Whitaker, L.D. (1986). On Estimating Population Char
acteristics from Record Breaking Observations. I. Parametric Results.
Naval Res. Log. Quart., 25, 531543.
Sen, P.K. (1959). On the Moments of the Sample Quantiles. Calcutta Statist.
Assoc. Bull., 9, 119.
Sen, P.K. and Salama, I.A. (eds.). (1992). Order Statistics and Nonparametric
Theory and Applications. Elsevier, Amsterdam.
Seshardi, V., Csorgo, N.M. and Stephens, M.A. (1969). Tests for the exponen
tial distribution using Kolmogrovtype statistics. J. Roy Statist. Soc., B,
31, 499509.
140 References
Shah, B.K. (1970). Note on Moments of a Logistic Order Statistics. Ann.
Math. Statist., 41, 21512152.
Shah, S.M. and Jani, P.N. (1988). UMVUE of reliability and its variance in
two parameter exponential life testing model. Calcutta. Statist. Assoc.
Bull.,37, 209214.
Shimizu, R. (1979). A characterization of exponential distribution involving
absolute difference of i.i.d. random variables. Proc. Amer. Math. Soc.,
121, 237243.
Shorrock, S. (1972). Record Values and Record Times. J. Appl. Prob., 9,
316326.
Shorrock, S. (1973). Record Values and InterRecord Times. J. Appl. Prob.,
10, 543555.
Siddiqui, M.M. and Biondini, R.W. (1975). The Joint Distribution of Record
Values and InterRecord Times. Ann. Prob., 3, 10121013.
Singpurwala, N.D. (1972). Extreme Values from a Lognormal Law with Ap
plications to Air Population Problems. Technometrics, 14, 703711.
Smith, R.L. (1986). Extreme Value Theory Based on the r Largest Annual
Events. J. Hydrology, 86, 2743.
Smith, R.L. and Weissman, I. (1987). Large Deviations of Tail Estimators
based on the Pareto Approximations. J. Appl. Prob., 24, 619630.
Srivastava, R.C. (1978). Two Characterizations of the Geometric Distribution
by Record Values. Sankhy a, Ser B, 40, 276278.
Stepanov, A. V (1992). Limit Theorems for Weak Records. Theory of Probab.
and Appl., 37, 579574 ( English Translation).
Sukhatme, P.V.(1937). Tests of signicance of the population with two de
grees of freedom. Ann. Eugenics, 8, 5256.
References 141
Tallie, C. (1981). A Note on Srivastavas Characterization of the Exponen
tial Distribution Based on Record Values. In: C. Tallie, G.P. Patil and
B. Boldessari (eds.), Statistical Distributions in Scientic Work. Reidel
Dordrecht., 4, 417418.
Tanis, E.A. (1964). Linear forms in the order statistics from an exponential
distribution. Ann. Math. Statist., 35, 270276.
Tata, M.N. (1969). On Outstanding Values in a Sequence of Random Vari
ables. Z. Wehrscheinlichkeitsth., 12, 920.
Teugels, J.L. (1984). On Successive Record Values in a Sequence of Indepen
dent and Identically Distributed Random Variables. Statistical Extremes
and Applications. (Tiago de Oliveira, ed.). ReidelDordrecht, 639650.
Tiago de Oliveira, J. (1958). Extremal Distributions. Rev. Fac. Cienc. Univ.
Lisboa, A, 7, 215227.
Tippett, L.H.C. (1925). On the Extreme Individuals and the Range of Samples
Taken from a Normal Population. Biometrika, 17, 364387.
Vervaat, W. (1973). Limit Theorems for Records from Discrete Distributions.
Stoch. Proc. Appl., 1, 317334.
Weissman, I. (1978). Estimations of Parameters and Large Quantiles Based on
the k Largest Observations. J. Amer. Statist. Assoc., 73, 812815.
Wesolowski, J, and Ahsanullah, M. (2000). Linearity of Regresion for Non
adjacent weak Records. Statistica Sinica, 11, 3052.
Westcott, M. (1977). The Random Record Model. Proc. Roy. Soc. Lon., A,
356,529547.
Westcott, M. (1979). On the Tail Behavior of Record Time Distributions in a
Random Record Process. Ann. Prob., 7, 868237.
White, H.J. (1988). Some characterizations of distributions based on the inte
grated Cauchy functional equations. Sankhy a, Ser A, 50, 5963.
Index
B
Best Linear Invariant Estimator, 45, 60
C
Cauchy Functional Equation, 134
Characterization, 121, 122, 124, 125,
126, 128, 131, 132, 133, 135, 136,
139, 141, 142
Conditional Distribution, 133
D
Discrete, 128, 141
E
Exponential Distribution, 65, 67, 69, 71,
73, 75, 77, 79, 81, 83, 85, 87, 89, 91,
93, 95, 97, 99, 101, 103, 105, 107,
109, 111, 113, 115, 117, 119, 121,
122, 124, 126, 130, 135, 136, 142
Extreme Value Distribution, 138
G
Generalized Order Statistics, 51, 52, 53,
55, 57, 59, 61, 63, 125, 133
Geometric, 136, 137, 140, 142
H
Hazard Rate, 131
L
Limiting Distribution, 27, 48
M
Minimum Variance Linear Unbiased
Predictor, 24
Moments, 9, 38, 124, 125, 134, 137,
139, 140
144 Index
O
Order Statistics, 11, 13, 15, 17, 18, 19,
21, 23, 25, 27, 29, 66, 124, 126, 127,
128, 129, 133, 134, 136, 137, 138,
139, 140
P
Prediction, 46, 61, 122, 127
R
Record Times, 31, 126, 129, 131, 137,
140, 142
Record Values, 31, 33, 35, 37, 38, 39,
41, 43, 45, 46, 47, 48, 49, 99, 121,
122, 123, 124, 125, 126, 127, 128,
131, 132, 134, 135, 136, 137, 138,
139, 140, 141, 142
Recurrence Relations, 137