SRM II: Analyze a research design

Being able to deconstruct a research design is important towards understanding whether the
conclusions are valid or not.

Read the methods section of the assigned articles. You may of course choose to read other sections
because they may help you understand the methods section better.

While reading the articles, use the following table as a guide (modify the table if necessary) to
understand their methods and results. Discuss your understanding in class.

Participant Participant Experimental Experimental Treatment Results

Recruitment Assignment Procedures or Manipulation
Sample Group A Procedure Treatment  Outcome
Group B Procedure Control  Outcome
How Are the IVs Consistency and Independent & How strong or
representative is categorical or quality of procedures? Dependent variables? meaningful were the
the sample? continuous? Confounds? differences between
Were there any groups?
Did the authors How were groups biases?
overextend their assigned? What was
conclusions How did they ensure the independent Did the groups "really"
beyond the How were equality of procedures differ - was the
variable? Dependent
sample? participants assigned across groups -- what
variable? difference statistically
experimental controls
to groups?...random significant?
were present?
assignment? Were there any confounds
matching? What should have of the independent What would it have
been present? variable? meant if the groups were
Did they ensure the How did they different, but: a) only by
groups started out (or should they have...) a very small amount,
exactly the avoided confounds, so or; b) there was a
same? Was there that the treatment was confound?
any self-selection or the only variable that
other bias? differed between groups?

If there was bias,

how should the
groups have been
assigned?
Think of at least one alternate hypothesis. What else may be going on in the procedures, the setting, the participants etc.
that may really account for the results. Is there a confound?