Professional Documents
Culture Documents
www.elsevier.com/locate/chemolab
Abstract
The limitations of the Guide to the expression of Uncertainty Measurement (GUM) for evaluating the uncertainty of indirect
measurements are presented. The propagation of distributions is introduced as the best way to evaluate the measurement uncertainty. The use
of Monte-Carlo method for performing the propagation of distributions is outlined and discussed. A case study is selected to illustrate the
application of Monte-Carlo method for evaluating the uncertainty of an analytical assay.
D 2005 Elsevier B.V. All rights reserved.
Keywords: GUM approach; Propagation of distributions; Uncertainty; Monte-Carlo method
1. Introduction
The current edition of the Guide to the expression of
Uncertainty Measurement (GUM) [1,2] is based on sound
theoretical principles and supports a fully consistent and
transferable estimation of measurement uncertainty and
traceability to the SI units. However, this approach exhibits
some important limitations mainly derived from the use of
the law of propagation of uncertainty and the application of
Central Limit Theorem.
Consider the model Eq. (1) corresponding to the GUM
specification step, where the measurand output Z is
indirectly obtained from the input quantities X 1, X 2, . . . ,
X n by an algebraic relationship:
Z F X1 ; X2 ; . . . ; Xn :
i Z
u Xi r Xi E Xi li
2
V
xi li 2 pxi xi dxi :
3
Z,F l
n
X
BF
i1
Bxi
xi li :
M.A Herrador et al. / Chemometrics and Intelligent Laboratory Systems 79 (2005) 115 122
116
u X i
Bxi l
Bxi l Bxj l
i1
i1 ji1
cov Xi ; Xj
6
Thus, in the GUM combination step, the combined
standard uncertainty u(Z) is evaluated, following the law of
propagation of uncertainty, from the standard uncertainty of
the input quantities, u(X i ) and the covariances between
correlated ones, cov(X i , X j ). If all the input measurements
are independent, cov(X i , X j ) = 0.
Once the standard uncertainty is calculated, how is
evaluated the expanded uncertainty U(Z) according to GUM
approach? Commonly, it is assumed that the conditions of
the Central Limit Theorem are met and consequently, the
normality on Z. Accordingly, the expanded uncertainty
U(Z) is calculated by multiplying u(Z) by a coverage factor
k, which is assimilated to the normal Laplace Gauss variate
(z-score). Thus, it is very usual to report expanded
uncertainties using a coverage factor of k = 2, which gives
a confidence level of approximately 95%. Sometimes, k is
assimilated to to the tabulated Students t-value for a given
significance level and the effective degrees of freedom (v eff)
computed according to the Welch Satterthwaite expression
[3 6] including correlation terms [7]:
BF 4 4
u Xi
n
X
u4 Z
BXi
mi
meff
i1
2
n1 X
n
X
i1 ji1
BF
BXi
2
2
BF
cov2 Xi ; Xj
BXj
p
mi mj
...
F x1 ; x2 ; . . . ; xn
V
V
V
9
And hence,
Z V Z
E Z
V
n
Y
i1
F x1 ; x2 ; . . . ; xn
...
V
pXi xi
V
n
Y
i1
dxi :
10
M.A Herrador et al. / Chemometrics and Intelligent Laboratory Systems 79 (2005) 115 122
117
V
V V
n
Y
V
pXi xi
i1
n
Y
17
dxi dz:
i1
V
V
V
V
V i1
d z F x1 ; x2 ; . . . ; xn
n
Y
#
dxi dz: 19
i1
V
fN Z1 Z2 . . . ZM
21
d z F x 1 ; x 2 ; . . . ; x n
dxi
S 2 Z
V i1
n
Y
By rearrangement, we get:
3r
fN
3r
< lZ p , 0:997
23
P lZ p <
M
M
M
PM
;
f
ji zj
, Eq. (23)
and taking the sample mean Z N
M
M
can be rewritten as:
3r
;
P Z lZ < p ,0:997:
24
M
V
V
20
i1
j1
M 1
25
M.A Herrador et al. / Chemometrics and Intelligent Laboratory Systems 79 (2005) 115 122
118
1
:
c 0:5 dc
12
2
27
xik li ri
!
ck 24
32
33
pxi xi dxi 1
a
29
34
Thus, from Eqs. (33) and (34) the random numbers c k are
obtained for simulating any other random variable. This
procedure is implemented as a routine for different code
M.A Herrador et al. / Chemometrics and Intelligent Laboratory Systems 79 (2005) 115 122
35
k 1 to M
36
119
Z1pM =2 Z1pM =2
2
38
5. Discussion
(a) Establishment of the model Eq. (1) for the measurement process
(b) Selection of the input variables X i that contribute to
the uncertainty of Z
(c) Identification of the PDF corresponding to the input
variables previously selected
(d) Selection of the number M of Monte-Carlo trials
(e) Simulation of M series of random numbers {x i1,
x i2, . . . , x ik, . . . , x iM } for each selected input variable
X i from i = 1 to n.
(f) Computation of the M samples of Z{z 1, z 2, . . . ,
z k , . . . , z M } by applying the model equation zk F
x1k ; x2k ; . . . ; xnk from k = 1 to M.
Owing to the high speed of modern computers, a large
number of trials can be processed without time limitation.
Thus, a value of M = 100,000 trials is enough for any case.
This large number of trials ensures that the Central Limit
Theorem conditions met and so, the sample mean and
sample variance of the Z distribution are good estimations
of the population mean and variance. Thus, the uncertainty u(Z) can be assimilated to the sample standard
deviation:
v
!2
u
M
M
uX
1 X
u
2
z
zk
u
t k1 k M k1
u Z
37
M 1
Once the coverage significance level probability p is
chosen, the confidence interval for the measurand can be
evaluated as [Z (1 + p)M / 2, Z (1 p)M / 2] whose extremes correspond to the 2.5% and 97.5% percentiles of the sorted z k
values. If the skewness of the sample frequency distribution
As it was emphasized above, the JCGM-EG1 recognized the Monte-Carlo method as the most efficient
numerical implementation for the propagation of distributions, and accordingly, we expect in a near future a
wide application of the method to assess the uncertainty
estimation of routine analytical procedures for accreditation purposes. The appearance of Excel add-ins
software packages such as Crystal-Ball, enables the use
of spread sheets for uncertainty estimation in a very
user-friendly way. . .and without the need to evaluate
partial derivatives!
Thus, summarizing, the main advantages of Monte-Carlo
simulation respect the GUM approach are:
& No limitation regarding the non-linear nature of the
specification function
& There is no assumptions about the distribution of
measurand
& There is no need to compute the effective number of
degrees of freedom (coming from the assumption of a tdistribution of the measurand)
& There is no need to compute partial derivatives.
Monte-Carlo method presents also some limitations: the
runtime could be long in some complex cases when using
old computers; the selection of the proper PDF of input
parameters might be difficult because of inaccurate data or
lack of understanding the underlying physical/chemical
process. The accuracy of Monte-Carlo method depends on
the quality of the random number generator, but most
commercial packages support this item.
The assignment of PDF of input variables can be done
according to the Shannons principle of maximum informa-
M.A Herrador et al. / Chemometrics and Intelligent Laboratory Systems 79 (2005) 115 122
120
rb0 ; b1
Xi
u b1
:
u b0
39
6. A working example
In order to illustrate the application of Monte-Carlo
method for estimating the uncertainty measurement we have
prepared an example adapted from a paper describing the
determination of clenbuterol in pig liver by HPLC with a
coulometric electrode array system [27]. Clenbuterol is
analysed by reversed-phase HPLC using ODS (150 4 mm
i.d. and 5 Am particle size). The mobile phase has two
components. Component A is 50 mM phosphoric acid 30
mM triethylamine and pH adjusted to 4.0 with 2 M sodium
hydroxide solution. Component B is acetonitrile and
methanol in the proportion 45 : 30 (V / V).
An 80 : 20 (V / V) mixture of mobile phase component
A and B is used with a constant flow rate of 0.8 mL/min.
The injection volume is 20 AL . Column effluent is
monitored using a CoulArray electrochemical detector
with porous graphite electrodes operated in the oxidative
screen mode. The electrodes potential are set at 450, 600,
650 and 680 mV, respectively. Typical retention time
cHPLC Vext
Y b0 Vext
Fhom
Fhom
Rm
b1 Rm
40
41
M.A Herrador et al. / Chemometrics and Intelligent Laboratory Systems 79 (2005) 115 122
wP
V1
42
vi
wPvi
V2
V1 V2
43
121
Table 1
Input variables and their assigned PDF
Input variable
Features
Y
b0
b1
F hom
R
m
Vext
Normal
Normal
Normal
Normal
Normal
Normal
Triangular
The normal distribution is featured by its mean and standard deviation, and
the triangular distribution by its mean and semi width.
References
[1] Guide to the Expression of Uncertainty in Measurements, ISO,
Geneva, Switzerland, 1993, (corrected and reprinted in 1995).
[2] EURACHEM/CITAC Guide, Quantifying Uncertainty in Analytical
Measurement, 2nd edition, 2000, (http://www.vtt.fi/kct/eurachem/
quam2000-pl.pdf).
[3] B.L. Welch, Biometrika 29 (1937) 350 362.
[4] B.L. Welch, Biometrika 34 (1949) 28 35.
[5] F.E. Satterthwaite, Psicometrica 6 (1941) 309 316.
[6] F.E. Satterthwaite, Biom. Bull. 2 (1946) 110 114.
[7] A. Lepek, Accredit. Qual. Assur. 8 (2003) 296 299.
[8] M.G. Cox, M.P. Dainton, P.M. Harris, Software Specifications for
Uncertainty Evaluation and Associated Statistic Analysis. Technical
122
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
M.A Herrador et al. / Chemometrics and Intelligent Laboratory Systems 79 (2005) 115 122
report CMSC 10/01, National Physical Laboratory, Teddington, UK,
2000.
M.G. Cox, M.P. Dainton, P.M. Harris, Software Support for Metrology
Best Practice Guide n- 6. Uncertainty and Statistical Modelling.
Technical Report, National Physical Laboratory, Teddington, UK,
2001.
B.R.L. Siebert, K.-D. Sommer, Tecnisches Messen 71 (2004) 67 80.
B.R.L. Siebert, Assessment of uncertainties and their role in quality
assurance, Workshop Proceedings Intercomparison on the Usage
of Computational Codes in Radiation DosimetryBologna (Italy),
14 and 16 July, 2003,
(http://www.nea.fr/download/quados/,
Presentation%20Web/TUTORIALS/T1_BRLS.pdf).
N. Metropolis, S. Ulam, J. Am. Stat. Assoc. 44 (1949) 335 341.
B.R.L. Siebert, Berechnung der Messungsicherheit mit der MonteCarlo Methode, PTB Mitteilungen 111 (2001) 323 337.
R.Y. Rubinstein, Simulation and the Monte-Carlo Method, 1st edition,
Wiley, New York, 1981.
W.L. Martinez, A.R. Martinez, Computational Statistics Handbook
with MATLAB, Chapman & Hall/CRCnetBase, Boca Raton, 2002,
pp. 59 60.
F. Scheid, Theory and Problems of Numerical Analysis, Schaums
Outline Series, McGraw-Hill, New York, 1968, pp. 401 403.
M.A. Herrador, A.G. Gonzalez, Talanta 64 (2004) 415 422.
[18] W.H. Press, S.A. Teulolsky, W.T. Vetterling, B.P. Flannery, Numerical
Recipes in FORTRAN: the Art of Scientific Computing, Cambridge
University Press, 1992.
[19] W.H. Press, S.A. Teulolsky, W.T. Vetterling, B.P. Flannery, Numerical
Recipes in C: the Art of Scientific Computing, Cambridge University
Press, 1992.
[20] Crystal Ball 2002.2.2 Professional edition, Decisioneering Inc.,
http://www.crystalball.com.
[21] LabVIEW, National Instruments, http://www.ni.com/labview/.
[22] @Risk 4.5, Pallisade, http://www.palisade-europe.com/html/risk.html.
[23] Analytica, Lumina, http://www.lumina.com/ana/whatisanalytica.htm.
[24] Stella II, High Performance Systems, http://www.hps-inc.com/
STELLAVPSR.htm.
[25] WINCERT, Implex, http://www.implex.fr/wincert.htm.
[26] Evaluator, Newton Metrology Inc., http://metrologyforum.tm.agilent.
com/download8.shtml, http://personal.zahav.net.il/PersonalSite/nm/
nmetro/evaluator.htm.
[27] X.Z. Zhang, Y.R. Gan, F.N. Zhao, Anal. Chim. Acta 489 (2003)
95 101.
[28] A.G. Gonzalez, A. Marquez, J.F. Sanz, Comput. Chem. 16 (1992)
25 27.
[29] A.G. Gonzalez, A.G. Asuero, Fresenius J. Anal. Chem. 346 (1993)
665 887.