Psych 2005: Statistical Analysis IANOVA

Instructor:
Office:
E-mail:
Phone:
Office Hours:

Prof. Scott Fraundorf

608 LRDC
sfraundo@pitt.edu
(412) 624-7029
W 1:00-3:00 or by appointment

TA: Jesse Drummond

Office: 3319 Sennott Square
E-mail: jkd19@pitt.edu
Phone: (412) 624-1387
Office Hours: By appointment

Class time: 1:00-4:00 PM Monday, 4125 Sennott Square

Required Materials:
Copies of the textbook (Keppel & Wickens, 2004; Design and analysis: A researcher's
handbook, 4th ed.) can be purchased online.
The other readings can be found through CourseWeb. Free access to CourseWeb can be
obtained automatically on the Pitt network. If you are off the Pitt network, you can still get
access by following the instructions under the connecting from off-campus link on the digital
library page.
We will use SPSS for our computer exercises. Thus, please ensure that you have access
to SPSS, either through your lab or on your own personal computer or laptop. SPSS is licensed to
the university. At a minimum, it is available at a highly discounted price.
A.

Course Objective
This course is the first of a two-semester sequence on data analysis techniques that are
widely used in social sciences. This first course will cover basic concepts in statistical reasoning
and analysis, with special focus on analysis of variance (ANOVA), the most commonly used
analytic method for experimental data in the social sciences. We will discuss the theoretical
rationale and methods to conduct analysis of variance in various design settings including
between-subjects designs, within-subjects designs, mixed designs.
In addition, we will discuss broader issues in inferential statistical analysis, including the
strengths and weaknesses of null hypothesis statistical testing, publication bias, and ethical data
analysis and reporting.
B. Course Outline
WEEK DATE
1
Aug. 31

TOPIC
Introduction & Research Design

2
3

Sep. 7
Sep. 14

NO CLASS LABOR DAY

Sums of Squares and The F Ratio

Sep. 21

Hypothesis Testing

Sep. 28

Oct. 5

Oct. 12

HOMEWORK #1 DUE
Planned Comparisons
Simultaneous Comparisons
Effect Size, Power, and Sample Size
Assumptions & Their Violation

Oct. 20
(TUESDAY)

HOMEWORK #2 DUE
p-hacking, Research Ethics, and Replicability

READING
Keppel & Wickens
ch. 1
Keppel & Wickens
ch. 2, 3.1
Keppel & Wickens
ch. 2.1, 3.2-3.5
Keppel & Wickens
ch. 4, 5
Keppel & Wickens
ch. 6, 8
Keppel & Wickens
ch. 7
Cumming (2013)
Ioannidis (2013)

Oct. 26

MIDTERM PAPER DUE

2-way Factorial Designs: Interactions and
Main Effects

10
11

Nov. 2
Nov. 9

12

Nov. 16

13

Nov. 23

No class--midterm meetings
2-way Factorial Designs: Simple Main Effects
and Unbalanced Designs
HOMEWORK #3 DUE
Repeated Measures: Introduction
Repeated Measures: Extensions

14

Nov. 30

15

Dec. 7

HOMEWORK #4 DUE
Mixed Designs
FINAL PAPER DUE
3-way Designs

Simmons, Nelson, &

Simonsohn (2011)
Keppel & Wickens
ch. 10-11

Keppel & Wickens

ch. 12-13,14.2-14.3
Keppel & Wickens
ch. 16
Keppel & Wickens
ch. 17-18
Keppel & Wickens
ch. 19-20
Keppel & Wickens
ch. 21

B.
Readings
The main text for this course will be:
1. Keppel, G., & Wickens, T. D. (2004). Design and analysis: A researcher's handbook (4th
ed.). Upper Saddle River, NJ: Pearson Prentice-Hall, Inc.
In addition, we will read and discuss the following papers:
2. Cumming, G. (2013). The new statistics: Why and how. Psychological Science, 25, 7-29.
doi: 10.1177/0956797613504966
3. Ioannidis, J.P.A. (2005). Why most published research findings are false. Chance, 18, 4047. doi: 10.1080/09332480.2005.10722754
4. Simmons, J.P., & Nelson, L.D., & Simonsohn, U. (2012). False-positive psychology:
Undisclosed flexibility in data collection and analysis allows presenting anything as
significant. Psychological Science, 22, 1359-1366. doi: 10.1177/0956797611417632
You will get the most out of the course if you complete the readings before class; although you
may not understand all of the details of the models at first, the reading will lay the groundwork
for our in-class discussions
C.

Requirements

Homework: There will be four homework assignments designed to give you practice applying
the various ANOVA models we discuss in class. These assignments are designed to both help
you understand the computations involved in the models and practice interpreting the results.
Each homework assignment will be made available one week before it is due and will be
collected in class.
Papers: Two papers will be required in this course. Each paper will consist of conducting
analyses on a data set given by the instructor. You will be required to write up a methods and
results section in APA format and present relevant Tables and Figures for the analyses required.
Data and detailed instructions will be provided 2 weeks prior to the paper due date.
Papers are due in class on the day assigned. Papers can be submitted over CourseWeb.

D.

Grading Policy: Your grade will be determined as follows:

40% Homework (10% each)
30% Paper 1
30% Paper 2
Late work: For each day (including weekends) an assignment is late, 10% will be deducted from
its grade. The paper will not be accepted if it is turned in later than one week past the due date.
E.
Students with Disabilities: If you have a disability for which you may need to request
accommodation, you are encouraged to contact both your instructor and the Office of Disability
Resources and Services, 216 William Pitt Union (412-648-7890/412-383-7355 TTY) as early as
possible in the semester. DRS will verify your disability and determine reasonable
accommodations for the course.
F.
Academic Integrity Policy: All students are expected to adhere to the standards of
academic honesty. Any student engaged in cheating, plagiarism, or other acts of academic
dishonesty would be subject to disciplinary action. Any student suspected of violating this
obligation for any reason during the semester will be required to participate in the procedural
process, initiated at the instructor level, as outlined in the University Guidelines on Academic
Integrity http://www.provost.pitt.edu/info/ai1.html. This may include, but is not limited to the
confiscation of the examination of any individual suspected of violating the University Policy.
G.
University Email Policy: Each student is issued a University e-mail address
(username@pitt.edu) upon admittance. This e-mail address may be used by the University for
official communication with students. Students are expected to read e-mail sent to this account
on a regular basis. Failure to read and react to University communications in a timely manner
does not absolve the student from knowing and complying with the content of the
communications. The University provides an e-mail forwarding service that allows students to
read their e-mail via other service providers (e.g., Hotmail, AOL, Yahoo). Students that choose
to forward their e-mail from their pitt.edu address to another address do so at their own risk. If email is lost as a result of forwarding, it does not absolve the student from responding to official
communications sent to their University e-mail address.
H.
Statement on Classroom Recording: To ensure the free and open discussion of ideas,
students may not record classroom lectures, discussion and/or activities without the advance
written permission of the instructor, and any such recording properly approved in advance can be
used solely for the students own private use.