1

Appendix 10: Post Hoc Tests

Post hoc tests in SPSS are available in more than one procedure, including
ONEWAY and GLM.

Notation
The following notation is used throughout this appendix unless otherwise stated:
k

Number of levels for an effect

ni

Number of observations at level i

xi

Mean at level i

si

Standard deviation of level i

vi

Degrees of freedom for level i, ni 1

s pp

Square root of the mean square error

i=1 j =1( xij xi )2

k
i=1(ni 1)
k

ni

Experimentwise error rate under the complete null hypothesis

Comparisonwise error rate

Number of steps between means

Degrees of freedom for the within-groups mean square

k

(n 1)
i

i =1

vi , j

Absolute difference between the ith and jth means | xi x j |

k*

k k 1 / 2

0 5

These algorithms apply to SPSS 7.0 and later releases.

1

Appendix 10

Qi, j

s pp

nh




1 1
1
+
2 ni n j




Harmonic mean of the sample size

nh =

ni1

1i k

Qh

s pp / nh

Studentized Range and Studentized Maximum Modulus

Let x1 , x 2 ,K, x r be independent and identically distributed N( , ) . Let
estimate of with m degrees of freedom, which is independent of the
2
msm

/ ~ . Then the quantity

Sr ,m =

s m be an
xi , and

; @

max( x1 , K, x r ) min( x1 ,K, x r )

sm

is called the Studentized range. The upper- critical point of this distribution is
denoted by S ,r ,m .
The quantity

Mr,m =

max(| x1 |,K,| x r |)
sm

is called the Studentized maximum modulus. The upper- critical point of this
distribution is denoted as M ,r,m .

Methods
The tests are grouped below according to assumptions about sample sizes and
variances.

Equal Variances
The tests in this section are based on the assumption that variances are equal.

Appendix 10

Waller-Duncan t Test
The Waller-Duncan t test statistic is given by

vi, j =| xi x j | t B ( w, F, q, f )S 2 / n
where t B (w, F, q, f ) is the Bayesian t value that depends on w ( a measure of the
relative seriousness of a Type I error versus a Type II error), the F statistic for the
one-way ANOVA,

F=

MStreat
MSerror

and

S 2 = MSerror
Here f = k (n 1) and q = k 1. MSerror and MStreat are the usual mean squares in
the ANOVA table.
Only homogeneous subsets are given for the Waller-Duncan t test. This method is
for equal sample sizes. For unequal sample sizes, the harmonic mean nh is used
instead of n.

Constructing Homogeneous Subsets

For many tests assuming equal variances, homogeneous subsets are constructed
using a range determined by the specific test being used. The following steps are
used to construct the homogeneous subsets:
1.

Rank the k means in ascending order and denote the ordered means as
x(1) ,K, x( k ) .

2.

Determine the range value, R ,k , f , for the specific test, as shown in Range
Values below.

3.

If x( k ) x(1) > Qh R ,k , f , there is a significant range and the ranges of the two
sets of k 1 means { x(1) ,K, x( k 1) } and { x(2 ) ,K, x( k ) } are compared with
Qh R ,k 1, f . SPSS continues to examine smaller subsets of means as long as
the previous subset has a significant range.

Appendix 10

For some tests, Qi, j is used instead of Qh , as indicated under specific tests
described in Range Values below.
4.

Each time a range proves nonsignificant, the means involved are included in a
single groupa homogeneous subset.

Range Values
Range values for the various types of tests are provided below.
Student-Newman-Keuls (SNK)
R ,r, f = S ,r, f

Tukeys Honestly Significant Difference Test (TUKEY)

R ,r, f = S ,k , f

The confidence intervals of the mean difference are calculated using Qi, j instead of

Qh .
Tukeys b (TUKEYB)

R ,r, f =

S ,r , f + S , k , f
2

Duncans Multiple Range Test (DUNCAN)

R ,r, f = S r ,r, f where r = 1 (1 ) r 1

Scheff Test (SCHEFFE)

R ,r, f = 2( k 1) F1 ( k 1, f )

Appendix 10

The confidence intervals of the mean difference are calculated using Qi, j instead of

Qh .
Hochbergs GT2 (GT2)

R ,r, f = 2 M ,k * , f
The confidence intervals of the mean difference are calculated using Qi, j instead of

Qh .
Gabriels Pairwise Comparisons Test (GABRIEL)
The test statistic and the critical point are as follows:

| xi x j | s pp (

1
1
+
) M , k * , f
2 ni
2n j

(1)

For homogeneous subsets, nh is used instead of ni and n j .

The confidence intervals of the mean difference are calculated based on equation
(1).

Least Significant Difference (LSD), Bonferroni, and Sidak

For the least significant difference, Bonferroni, and Sidak tests, only pairwise
confidence intervals are given. The test statistic is
x i x j > Qi, j R ,k , f

where the range, R ,k , f , for each test is provided below.

Least Significant Difference (LSD)

R ,r, f = 2 F1 (1, f )

Appendix 10

Bonferroni t Test (BONFERRONI or MODLSD)

R ,r, f = 2 F1 (1, f )

where = / k *
Sidak t Test (SIDAK)

R ,r, f = 2 F1 ,1, f

where = 1 (1 )

2
k ( k 1)

Dunnnett Tests
For the Dunnett tests, confidence intervals are given only for the difference
between the control group and the other groups.
Dunnetts Two-Tailed t Test (DUNNETT)
When a set of new treatments ( xi ) is compared with a control ( x 0 ), Dunnetts twotailed t test is usually used under the equal variances assumption.
For two-tailed tests,

vi,0 =| xi x 0 | > dk,v s dd

1
1
+
n0 ni

where d k,v is the upper 100 percentage point of the distribution of

T = max {| Ti |}
1i k

( xi x 0 )
2
and sdd
where Ti =
1
1
s dd
+
n0 ni

ni

i =0

j =1

i =0

( x ij xi. ) 2

(ni 1)

Appendix 10

Dunnetts One-Tailed t Test (DUNNETTL)

This Dunnetts one-tailed t test indicates whether the mean at any level is smaller
than a reference category.

xi x 0 > dU k,v sdd

1
1
+
n0 ni

where dU k,v is the upper 100 percentage point of the distribution of

T = max {Ti }
1i k

Confidence intervals are given only for the difference between the control group
and the other groups.
Dunnetts One-Tailed t Test (DUNNETTR)
This Dunnetts one-tailed t test indicates whether the mean at any level is larger
than a reference category.

xi x 0 < dLk ,v s dd

1
1
+
n0 ni

where dLk ,v is the lower 100 percentage point of the distribution of

T = max {Ti }
1i k

Confidence intervals are given only for the difference between the control group
and the other groups.

Ryan-Einot-Gabriel-Welsch (R-E-G-W) Multiple Stepdown Procedures

For the R-E-G-W F test and the R-E-G-W Q test, a new significant level, r , based
on the number of steps between means is introduced:

r =

%&1 (1 )
K'

r/k

if r < k 1
if r k 1

Appendix 10

Note: For homogeneous subsets, the ni and n j are used for the R-E-G-W F test and
the R-E-G-W Q test. To apply these methods, the procedures are same as in
Constructing Homogeneous Subsets on p. 3, using the tests provided below.
Ryan-Einot-Gabriel-Welsch Based on the Studentized Range Test (QREGW)
The R-E-G-W Q test is based on

max {( x i x j ) min(ni , n j )} / s pp S r ,r , f
i, j R

Ryan-Einot-Gabriel-Welsch Procedure Based on an F Test (FREGW)

The R-E-G-W F test is based on
2




2
 ni xi  ni xi  / ni 
 iR  iR  iR  F ,r 1, f ,

(r 1)s 2pp

where r = j i +1 and summations are over R = i,K, j .

Unequal Sample Sizes and Unequal Variances

The tests in this section are based on assumptions that variances are unequal and
sample sizes are unequal. An estimate of the degrees of freedom is used. The
estimator is

v=

( si2 / ni + s 2j / n j )2
si4 / ni2 vi + s 4j / n 2j v j

Two means are significantly different if

| xi x j | Qi*, j R ,r,v

Appendix 10

where

Qi*, j =

2
si2 s j
+
ni n j

and R ,r , depends on the specific test being used, as listed below.

For the Games-Howell, Tamhanes T2, Tamhanes T3, and Dunnetts C tests, only
pairwise confidence intervals are given.
Games-Howell Pairwise Comparison Test (GH)

R ,r,v = S ,k ,v / 2

Tamhanes T2 (T2)

R ,r,v = F ,1,v = t ,v where = 1 (1 )1/ k

Tamhanes T3 (T3)

R ,r,v = M ,k * ,v

Dunnetts C (C)

R ,r,v =

( S ,k ,ni 1si2 / ni + S ,k,n j 1s 2j / n j ) / 2

si2 / ni + s 2j / n j