Professional Documents
Culture Documents
11/02/21 1
Table of Contents
Definitions
EFD Philosophy
Types of Experiments
EFD Phases
Measurement Systems
EFD Validation
Reporting EFD
A pretty experiment is in
Definitions
itself often more valuable
than twenty formulae
extracted from our
minds."
- Albert Einstein
EFD Philosophy S E L E C T U N C E R T A IN T Y M E T H O D
D E S IG N T H E T E S T
- D E S IR E D P A R A M E T E R S ( C D , C R , ... .)
- M O D E L C O N F IG U R A T IO N S (S )
- T E S T T E C H N IQ U E (S )
- M E A S U R E M E N T S R E Q U IR E D
- S P E C IF IC IN S T R U M E N T A T IO N
- C O R R E C T IO N S T O B E A P P L IE D
D E T E R M IN E E R R O R S O U R C E S
UA involved in YES
A F F E C T IN G R E S U L T S
multiple stages E S T IM A T E E F F E C T O F
T H E E R R O R S O N R E S U LT S
of the
experiment IM P R O V E M E N T
N O U N C E R T A IN T Y N O
A C C E P TA B LE ?
P O S S IB L E ?
N O YES
N O TEST IM P L E M E N T T E S T
S TAR T T E ST
M EASU R E-
R E S U LT S N O M EN T
A C C E P TA BLE ? SYSTEM
PRO BLEM ?
YES YES
N O C O N T IN U E T E S T S O LV E P R O B LE M
D O CU M EN T R E S U LT S
YES E S T IM A T E - REFER ENC E C O N D IT IO N
PU RPO SE
A C TU A L D ATA - P R E C IS IO N L IM IT
A C H IE V E D ?
U N C E R T A IN T Y - B IA S L IM IT
- TO TA L U N C E R T A IN T Y
EFD Philosophy
Use UA in all experimental phases to ensure maximum
efficiency (time, effort, and financial resources)
Types of Experiments
Grouped by field/purpose:
Science & Technology: understand and investigate a
phenomenon/process, substantiate and validate a theory
(hypothesis)
Teaching: Instruction/demonstration
Types of Experiments
Grouped by methodology:
Timewise (data collected over a period of time)
Sample-to-sample (data analyzed over several realizations/samples)
Grouped from UA perspective:
Repeated
Replicated (repetition carried over in a very specific manner)
Replication levels:
P re p a re C o m p a re R e s u lts
F a c ility & S ta tis tic a l E s tim a te B ia s w ith B e n c h m a rk
C o n d itio n s E x p e rim e n ta l A n a ly s is L im its D a ta , C F D ,
P ro c e d u re s a n d /o r A F D
E s tim a te
R u n T e sts & P re p a re
C a lib r a tio n T o ta l
A c q u ire D a ta R ep o rt
U n c e r ta in ty
P re p a re
M e asu re m en t S to re D a ta
S y ste m s
Measurement Systems
MS components: facilities, instrumentation, operational
environment, data acquisition, data reduction
Measurement Systems
MS behavior:
Initial condition
y(0)
Measurement
system
Input signal Output signal
F(t) y(t)
Zero-order systems: y (t ) KF t
(no inertia or damping)
First-order systems: y t y t KF t
(inertia)
1 2
Second-order systems: y
t y t y t KF t
n2
n
(inertia and damping)
Measurement Systems
Facilities
Scales: small-, model-, and full-scale (in-situ experiments)
Procedures:
Adoption of international standard EFD procedures (e.g., wind-
tunnel AIAA standard S-071-1995)
Use concomitant methods for measurement of the main variables
Adopt a comprehensive scheme for controlling the MS operation and
environmental conditions
Establish chronological sequence for MS operation (data acquisition,
reduction, storage)
Establish appropriate number of test replications and density for
measured data points to fulfill EFD and UA requirements
Adopt a random sequence for the data acquisition
Set appropriate test scheme to counteract MS noise (e.g., time
between replications longer than the period of variation in the
extraneous variables), interference, drift in facility and instrument
operation
Measurement Systems
0.10
F ilte re d P I V da ta
4 th - ord e r re gre ssio n cu rve fit
F S o f cu rve fit
T h e ory
0.05
c
U
- 0.00
U
-0.05
z= -2 5 mm, (i,j) = (1 ,1 )
-0.10
0.0 1.0 2.0 3.0 4.0
x (m)
Data Reduction
Components: data-reduction equations, curve fitting,
interpolations, data visualization
Special considerations:
Eliminate conceptual bias errors: verify data-reduction
equations and algorithms for parameter estimation
Use spectral analysis (discrete Fourier transform) to reconstruct
the amplitude and frequency of the measured signals; check for
appropriateness of the selection of the instrument
characteristics
Check for stability of the statistics (first and second order) and
establish the appropriate sample size for reporting the data
Use least-square method for curvefitting and determine
regression uncertainty
Measurement Systems
LabVIEW
assembled objects
Block
diagram
Front panel
EFD Validation
Uncertainty Analysis (UA)= Data Quality= Confidence in the reported results
Standardized UA: rigorous methodology for uncertainty assessment using statistical
and engineering concepts
E LE M EN TA L
ERRO R SO UR CES
IN D IV ID U A L
1 2 J M EASUREM ENT
SYSTEM S
X X X M EASUREM ENT
1 2 J O F I N D IV ID U A L
B , P B , P B , P V A R IA B L E S
1 1 2 2 J J
D A T A R E D U C T IO N
r = r ( X , X ,......, X ) E Q U A T IO N
1 2 J
r E X P E R IM E N T A L
B , P R E S U LT
r r
EFD Validation
Conduct uncertainty analysis for the results:
Identify and estimate errors considering all the steps of the
measurement process and the environmental factors
Use 95% confidence large-sample (multiple tests) uncertainty
methodology
EFD result: A ±UA 2.1
Experimental Result (UA= 3%)
data: B ± UB 1.9
Define Result R
1.8
1.7
E = B- A
1.6
Validation: 1.4
1.3
Validated data Data not validated
|E| < UE 20 25 30 35 40 45
Independent variable X i
Reporting Results
Report types: oral, written, exec summary, lab report, formal report,
journal articles, tutorial reports
Report format: tabular, graphic, text, mathematical expression
Report general outline:
Abstract
Introduction (purpose, background, theoretical considerations)
Experimental program (test design, measurement systems – facilities,
instrumentation, operational environment, data acquisition, data
reduction- experimental procedure)
Analysis (results, uncertainty analysis, comparison, interpretation)
Discussion (conclusions, recommendations)
Acknowledgements
References
Appendix materials
Reporting Results