Sign Test & McNemar Test

KAREN FATIMA R. MACALIMBON

Sign Test
Frequently used nonparametric test that does not depend on the assumptions of the t test, or measurement beyond the ordinal scale.

FOCUSES on the MEDIAN rather than the mean as a measure of central tendency or location.
Only assumption underlying the test: the distribution of the variable of interest is continuous.

 The sign test gets its name from the fact that pluses and minuses rather than numerical values, provide the raw data used in the calculations.

Sign test for two Independent samples (Median two sample case)

Median test. Used to compare the median of two independent samples.

Counterpart of the t-test under parametric The data consist of two independent samples of n1 and n2 observations. The medians of the samples are taken jointly.

 In each sample observation,

= (-) the values above (>) the medians plus (+) sign those at or below (<) = negative sign.

Then the number of + and signs for each sample is obtained. A 2 test is used to determine whether the observed frequencies of + and signs differ significantly.

Formula

2 =
2

= Chi square test = observed (+) frequencies = observed (-) frequencies

a and c b and d

k and l
N

= the row total

= the grand total

m and n = the column total

example
Female 12 26 25 10 10 10 22 20 19 17 17 15

Male

22 19

12

16

19

Consider the test scores of 12 female and 9 male students in a spelling test. I. Problem: Is there a significant difference in the performance of two groups?

II. Hypothesis: Ho: There is no significant difference in the performance of the two groups. Ha: There is a significant difference in the performance of the two groups.

III. Level of Significance:

df

= .05
= (c-1)(v-1)

2 .05 = 3.841
IV. Statistics: Median test for two independent samples.

Computations:
Female Male 12 6 + 26 22 + + 25 19 + 10 7 10 8 -

Median = 16.
10 12 + 22 16 + 20 8 + 19 19 + + 17 + 17 15

+ F M Total a c m 7 3 10 b d n

5 6 11 k l N

Total 12 9 21

V. Decision Rule: If 2 computed > 2 tabular, Reject Ho. VI. Conclusion:

2 computed = 1.288 < tabular 3.841 at .05 level of significance, with 1 df, the Ho is confirmed.

Sign test for two-correlated samples (Fisher Sign Test)

Counterpart of t-test for correlated sample

Compares two correlated samples and is applicable to data composed of N paired observations.

 Difference between each pair of observation is obtained.

This test is based on the idea that half the difference between the paired observations will be positive abd the other half will be negative. Formula:

z=

z = the Fisher Sign Test D = the difference between the number of + & - signs

Example
Consider the pretest and posttest results before and after the implementation of the program Pretest x 15 19 Posttest y 19 30

31
36 10 11 19 15 10 16

26
8 10 6 17 13 22 8

I. Problem:

Is there a significant difference between the pretest and posttest results of the 10 students? There is no significant difference between the pretest and posttest results of the 10 students.

II. Hypothesis:
Ho:

Ha:

There is a significant difference between the pretest and posttest results of the 10 students.
.05 = 1.96

III. Level of Significance: = .05 IV. Statistics: z test (the Fisher Sign Test)

Computation:
Pretest x
15 19 31 36 10 11 19 15 10 16

z=
Posttest y
19 30 26 8 10 6 17 13 22 8

D
+ + 0 + + + +

Sign of x-y

V. Decision Rule: if z computed > z tabular = Reject Ho

VI. Conclusion:
z computed= .67 < z tabular 1.96 at .05 level of significance, Accept Ho.

Sign test for K independent samples (The Median test: MultiSample test)
A straightforward extension of the median test for two independent samples.

The test is used for k independent samples.

=
Where:

( )

2 = chi square test O = observed frequencies E = expected frequencies

example
A sampling of the acidity of rain for ten randomly selected rainfalls was recorded at three different locations in the province of Northern Samar, Biri Island, Catarman and Silvino Lubos. The pH readings for these 30 rainfalls are shown in the table. (Note that the pH readings range from 0 to 14; 0 is acid, 14 is alkaline. Pure water falling through clean air has a pH reading of 5.7)

Biri 4.4 4.0 4.1

Catarman 4.6 4.5 4.3

Silvino Lobos 4.7 4.8 5.0

3.5
2.4 3.8 4.2 3.9 4.1 4.2

3.8
4.2 4.5 4.7 4.3 4.5 4.8

4.9
3.9 4.5 4.6 4.3 4.0 4.7

Use the median test at .05 level of significance to test Ho that there is no significant difference among the pH reading of the three different municipalities of Northern Samar.

I. Problem:

Is there a significant difference in the pH readings among the three different municipalities of Northern Samar?

II. Hypothesis:

III.Level of Significance:

= .05

df = (c-1)(r-1) = 2 2 .05 = 5.991

IV. Statistics: Median test for k independent samples

Computation
Biri 4.4 4.0 4.1 3.5 2.4 3.8 4.2 3.9 4.1 4.2 + Catarman 4.6 4.5 4.3 3.8 4.2 4.5 4.7 4.3 4.5 4.8 + + + + + + Silvino Lobos 4.7 4.8 5.0 4.9 3.9 4.5 4.6 4.3 4.0 4.7 + + + + + + +

Municipalities

Above 4.3 O E (4.7) (4.7) (4.7)

At or below 4.3 O 9 4 3 16 E (5.3) (5.3) (5.3)

Total

Biri Catarman Silvino Lubos Total

1 6 7 14

10 10 10 30

Solve for expected frequencies:

14 10 30

= 4.7

16 10 30

= 5.3 = 8.296

( )

V. Decision Rule: if computed > tabular, Reject Ho.

VI. Conclusion:
The computed of 8.296 > tabular value of 5.991 at .05 level of significance with 2 df, hence Reject Ho, Accept Ha

Mcnemar
It is named after Quinn McNemar, who introduced it in 1947. Used to determine whether there is evidence of a difference between the proportions of two related samples. Uses a test statistic that approximately follows the normal distribution enabling you to carry out either a one-tail or twotail test.

 Is a chi square test for situations when samples are matched, that is, they are not independent.

This is a before and after design which is tested to find out whether there is a significant change between the before and after situations.

2x2 contingency table for McNemar Test

Condition (group 1)

Condition (group 2) No b d b+d Row total a+b c+d n

Yes a c a+c

Yes No Column total

A = # of respondents that answer YES to condition 1 and YES to condition 2 B = # of respondents that answer YES to condition 1 and NO to condition 2 C = # of respondents that answer NO to condition 1 and YES to condition 2 D = # of respondents that answer NO to condition 1 and NO to condition 2 n= # of respondents in the sample

Sample proportions of interest: P1 = A + B / n = proportion of respondents who answer YES to condition 1 P2 = A + C /n = proportion of respondents who answer YES to condition 2

Population proportions of interest:

1 = proportion of population who would answer YES to condition 1 2 = proportion of population who would answer YES to condition 2

Example
Actually purchased Planned to purchase Yes No Total

Yes
200 100 300

No
50 650 700

Total
250 750 1,000

You want to determine whether there is a difference between the population proportion who planned to purchase a big screen tv and the population who actually purchased. Ho: 1 = 2 Ha: 1 2

Using 0.05 level of significance, the critical values are -1.96 and +1.96 and the decision rule is: Reject Ho if Z < -1.96 or if Z > +1.96

A = 200 C = 100

B = 50 D = 650

P1 = A+B/n

P2 = A+C/n Z = B-C/ B+C

Thank You!