Professional Documents
Culture Documents
experimental research
the researcher selects participants
and divides them into two or more
groups having similar characteristics
and, then, applies the treatment(s) to
the groups and measures the effects
upon the groups
where:
A experimental (treatment) group
B control (no treatment,
nonmanipulated) group
Variable...
a concept (e.g., intelligence, height,
aptitude) that can assume any one of
a range of values
Research variables...
Independent
an activity of characteristic believed
to make a difference with respect to
some behavior
(syn.) experimental variable, active
variable, cause, treatment
Dependent
the change or difference occurring a
a result of the independent variable
(syn.) criterion variable, assigned
variable, effect, outcome, posttest
Confounding
the fact that the effects of the
independent variable may intertwine
with extraneous variables, such that
it is difficult to determine the unique
effects of each variable
(syn.) criterion variable, assigned
variable, effect, outcome, posttest
single-variable designs
involve one manipulated independent
variable
pre-experimental
quasi-experimental
true experimental
time-series design
O O O O X O O O O
a single group is pretested ( O )
repeatedly until pretest scores are
stable, exposed to a treatment ( X )
and, then, is repeatedly posttested
(O)
counterbalanced design
X1 O X2 O X3 O
X3 O X1 O X2 O
X2 O X3 O X1 O
all of the groups receive all
treatments but in a different order;
the number of groups and
treatments must be equal
factorial designs
involve two or more independent
variables with at least one
independent variable being
manipulated by the researcher
A 2 X 2 factorial design
Dependent Variable
manipulated
Independent Variable
A
B
Group #1
Group #2
Group #3
Group #4
not manipulated
Cells
A 2 X 2 factorial design
A
No interaction
between factors
A 2 X 2 factorial design
No interaction
between factors
A 2 X 2 factorial design
A
Interacting
factors
A 2 X 2 factorial design
B
Interacting
factors
simple A B design
baseline measurements ( O ) are
repeatedly made until stability is
established, then the treatment ( X ) is
introduced and an appropriate number
of measurements ( O ) are made during
treatment implementation
simple A B design
O O O
X O X O X
baseline
phase
treatment
phase
A B A withdrawal designs
baseline measurements ( O ) are repeatedly
made until stability is established, then the
treatment ( X ) is introduced and an
appropriate number of measurements ( O )
are made during treatment implementation,
followed by an appropriate number of
baseline measurements ( O ) to determine
stability of treatment ( X )
A B A withdrawal designs
O O O
X O X O X
O O O
baseline
phase
treatment
phase
baseline
phase
multiple-baseline designs
used when a return to baseline
conditions is difficult or impossible
since treatment effects oftentimes do
not disappear when a treatment is
removed
A
behavior 1
behavior 2
behavior 3
O O OXOXOXOXOXOXOXOXOXOXOXO
O O O O O
OXOXOXOXOXOXOXO
O O O O O
O O O
OXOXOXO
setting #1
setting #2
setting #3
Threats to validity
internal: factors other than the
independent variable that affect the
dependent variable
external: factors that affect the
generalizability of the study to groups
and settings beyond those of the
experiment
history
the occurrence of events that are not
part of the experimental treatment
but that occur during the study and
affect the dependent variable
maturation
the physical, intellectual, and
emotional changes that occur
naturally in a studys participants
over a period of time
testing
refers to improved scores on a
posttest as a result of having taken a
pretest
instrumentation
the unreliability or lack of
consistency in measuring
instruments that can result in an
invalid assessment of performance
statistical regression
the tendency of participants who
score highest on a test to score
lower on a second, similar test and
vice versa
mortality
the case in which participants drop
out of a study which changes the
characteristics of the groups and
may significantly affect the studys
results
selection-maturation interaction
if already-formed groups are used in
a study, one group may profit more
(or less) from a treatment or have an
initial advantage because of
maturation, history, or testing factors
pretest-treatment interaction
the situation when participants
respond or react differently to a
treatment because they have been
pretested
multiple-treatment interference
the situation when the same
participants receive more than one
treatment in succession
selection-treatment interference
the situation when participants are
not randomly selected for treatments
specificity of variables
the situation when a study is
conducted with (1) a specific kind of
participant; (2) is based on a
particular operational definition of
the independent variable; (3) uses
specific dependent variables; (4)
transpires at a specific time; and, (5)
under a specific set of circumstances
treatment diffusion
the situation when different treatment
groups communicate with and learn
from each other
experimenter effects
the situation when the researchers
present potential threats to the
external validity of their own studies
reactive arrangements
the situation when a number of
factors associated with the way in
which a study is conducted interacts
with or shapes the feelings and
attitudes of the participants involved
randomization
the process of selecting and
assigning participants in such a way
that all individuals in the defined
population have an equal and
independent chance of being
selected for the sample
matching
a technique for equating groups on
one or more variables, usually the
ones highly related to performance
on the dependent variable (e.g.,
pairwise matching)
Mini-Quiz