Chapter 10:Multiple Independent Variables: Factorial Designs

Advantage of Multifactor Study

More than one IV We can get a better look at the complex interplay of variables that affect behavior o Decennial census

Factorial ANOVA
When we have more than on IV we use factorial ANOVA o An experimental design where more than one IV is manipulated Why use multiple IVs? o Psychological questions are too complicated to answer using one IV o Using more than one IV gains us twice as much information from a two-factor study as in one-factor study Factorial design o (crossed) design o Each level of one IV is represented in each level of a second IV o If two variables, one IV with two levels, and second with three levels, we would have 6 conditions o Number of conditions, or factors derived from multiplying number of levels of first IV by number of levels of the second IV o Theoretically, any number of factors you can study is unlimited o But usually no more than four IVs

Stating the hypothesis

Adding second IV, we have a more efficient design Barchorowski and Orwen (2001) o Gender Male Female o Type of laughter Voiced (harmonic) Unvoiced (grunting) o Conditions (4): Male/voiced Male/unvoiced Female/voiced Female/unvoiced Stating the hypothesis with both IV allows to us examine the data to determine if there is an interaction among IVs that might influence desirability of meeting a person (DV) Interaction effect: when the level of one IV is affected by a level of a second IV The two variables, considered together, produce a combination of effects not predictable from either one alone Main effect: the effects of a single variable on a dependent variable

Chapter 10:Multiple Independent Variables: Factorial Designs

o

use two separate hypothesis desirability of laugh based on male/female desirability of laugh based on voiced/unvoiced factorial ANOVA is valuable because allows o test for an interaction effect and main effects for each of the IVs SIMULTANEOUSLY

Assumptions of Factorial ANOVA

Employs basic statistical ratio as inferential study. We are simply calculating a ratio of Treatment to Error Variance. Compare the difference between the treatment means to the differences that exist within groups, or error. ANOVA= Treatment Variance/Error Variance o If calculated ratio large then conclude combo of treatment likely made a difference and is statistically significant outcome DV must be scalar or interval Test for homogeneity of variance (assumption that variance across multiple treatment conditions is similar) a. Use Hartey F-Max test to determine if we meet homogeneity. Levenes Test of Equality of Variances used as an alternative. Looking for non-significant outcomes to meet homogeneity assumption. Check for assumption of normality. Must ensure our observations are independent. a. Participants are randomly assigned to one condition b. If meet homogeneity then have met normality assumption. If statistical model is strong, then we can have confidence in results even if we violate assumption of equal variances and normality: Howell

1. 2.

3. 4.

5.

Portioning Variance
Main effects are listed outside the table. (Mmale= 4, Mfemale=6)
We derive an F ratio for each of the main effects (two IVs individually) Data also includes means for each of the four treatment groups or cells o We simultaneously compare two IVs, gender and voice, and derive an F value to determine if

interaction effect is present We derive three F rations o Two main effects o One interaction effect WHY? o Because we are testing three hypothesis Desirability of laughter changes based on how it voiced (Main effect) Desirability of laughter changes based on gender (Main Effect) Desirability of laughter will change based on gender and type of voice (Interaction Effect)

Chapter 10:Multiple Independent Variables: Factorial Designs

Calculating the Factorial ANOVA

TOTAL Variance
Dont actually calculate a total variance for the Source Table Calculate variances for Treatment (MSTreatment) effects and Error (MSError). we do calculate a total SS reflecting all of the variability present in the data

SSTOTAL = (X MG)2
Calculate total SS by compiling the data from all four conditions 1. Calculate am overall mean or grand mean (MG = 5) 2. Then use Grand mean to calculate the SSTOTAL for the combined data set Total SS gives us a general indication of total amount of variability present in our data o

TREATMENT Variance
Break out the Treatment variance even further We need to separate the treatment into variability associated with each of the IVs o In example we have two IVs (gender and laughter) Goal is to calculate a ratio of the Treatment variance to Error variance for each of our three hypothesis 1. Independently calculate the treatment sum of the squares for each of the IVS o Gender Main effect SS treatment formula is:

SSFactor = (MLevel MGrand)2n SSVARIABLE1 = (MLevel MGrand)2n

n= number of men or women SSFACTOR = SSMALE + SSFEMALE Degrees of freedom for treatment: (number of conditions (k)- 1) DfGENDER = k 1 Calculation of variance (MS): MSGENDER = SSGENDER/dfGENDER

Voice Main effect SS treatment formula is:

SSFactor = (MLevel MGrand)2n SSVARIABLE1 = (MLevel MGrand)2n

n= number of men SSFACTOR = SSVOICED + SSUNVOICED Degrees of freedom for treatment: (number of conditions (k)- 1) DfUNVOICED = k 1 Calculation of variance (MS) MSGENDER = SSVOICE/dfVOICE

Chapter 10:Multiple Independent Variables: Factorial Designs

2. All together o Gender by Voice Interaction Main effect SS treatment formula is:

SSCell = (MCell MGrand)2n

We use means from each of the cells or groups o SSMaleVoiced = (MMALEVOICED MGRAND)2n (5 5)25 = 0 o SSMaleUnvoiced = (MMALEUNVOICED MGRAND)2n (3 5)25 = 20 o SSFemaleVoiced = (MFEMALEVOICED MGRAND)2n (3 5)25 = 20 o SSFemaleUnvoiced = (MFEMALEUNVOICED MGRAND)2n (9 5)25 = 80

Sum the individual treatment sum of squares:

SSGROUP = (MCell MGrand)2n

o

SSGROUP = 0 + 20 + 20 + 80 = 120

SSINTERACTION =[ (MCell MGrand)2n ] SSA SSB

SSINTERACTION =[120] 20 -20 = 80

Degrees of freedom for interaction: multiply df for main effects o DfINTERACTION = (A -1) (B-1) Calculation of variance (MS) MSINTERACTION = SSINTERACTION/dfINTERACTION o MSA = SSA / dfA o MSB = SSB / dfB

o MSAXB= SSAXB / dfAXB

ERROR Variance
Calculation of a single error term Variability within each cell Error reflected in differences among people within each treatment group o (X M1)2 = 16 o (X M2)2 = 6 o (X M3)2 = 10 o (X M4)2 = 4

SSERROR = SSCELL1 + SSCELL2 + SSCELL3 + SSCELL4

SSERROR = 16 + 6 + 10 + 4 = 36
Ultimate goal is to obtain index of error or Error variance so then calculate df associated with Error or Within Group

dfERROR = n 1 dfERROR = N k

Chapter 10:Multiple Independent Variables: Factorial Designs

Now obtain amount of variance associated with error

MSERROR = ssERROR / dfERROR

F Statistics
We test effects of more than one IV so test for effect of each IV independently (Main Effect) ad we test or combined effects (Interaction) or interaction of IV Yields multiple F values o We derive multiple measures of treatment variance One for each main effect One for combination or interaction effect But we need only ONE measure of Error variance

ANOVA= Treatment Variance/Error Variance = MStreatment / MSerror FA = MSA / MSERROR FB = MSB / MSERROR FC = MSC / MSERROR
place F values in table

Determining Significance
compare the calculated F values to the tabled F values use the numerator df= Treatment/ Error (1 for numerator and 16 for denominator) Yields multiple F values o We derive multiple measures of treatment variance One for each main effect Generally interpret statistically significant interaction first o Because interaction reflects the combined effect of the IVs contained in design For main effect look at the same numbers F(1,16) o Combination of IVs produce a unique effect not present when variables are examined independently

Post Hoc Analyses

An ANOVA allows us to test statistically significant differences among multiple conditions while holding alpha constant If more than three levels of an IV present, an additional post hoc analysis is conducted to determine which levels of IV differ Use Tukey HSD and the Scheffee post hoc analyses

Chapter 10:Multiple Independent Variables: Factorial Designs

Effect Size

2 = variance A/ variancetotal 2 = SS AxB (df AxBMSERROR) / SStotal + MSERROR

variance explained