Professional Documents
Culture Documents
This modules discusses the concepts of hypothesis testing, including -level, p-values, and statistical power.
15 - 1
Example
Suppose we have a random sample of n = 25 measurements of chest circumference from a population of newborns with = 0.7 inches and the sample mean = 12.6 inches.
C[ x 1.96 / n x 1.96 / n ] 0.95 C[12.6 1.96(0.7 / 5) 12.6 1.96(0.7 / 5)] 0.95 C[12.6 2.7 12.6 2.7] 0.95 C[12.33 12.87] 0.95
15 - 2
Questions
Is it possible that this sample with x 12.6 came from a population with 13.0 ? Is it likely that this sample with x 12.6 came from a population with 13.0 ?
15 - 3
1. The hypothesis:
2. The assumptions: Random sample from a normal distribution with = 0.7 inches 3. The -level: = 0.05
15 - 4
x z n
5. The critical region: Reject H0: = 13.0 if the value calculated for z is not between 1.96 6. The result:
7. The conclusion:
15 - 5
This test was performed under the assumption that = 13.0. Our conclusion is that our sample mean x = 12.6 is so far away from = 13.0 that we find it hard to believe that = 13.0.
That is, our observed value of x = 12.6 for the sample mean is too rare for us to believe that = 13.0.
How rare is
15 - 6
15 - 7
x ~ N (13.00, 0.14)
x 12.6
Z
12.86
for the sample mean (n = 25); x 13.0, 13.0 0.49 2 x 0.02 25 0.49 0.7 x 0.14 25 5
Under H 0 : 13.0
2 = 0.49 = 0.7
15 - 8
x ~ N (13.00,0.14)
x 12.6
15 - 9
1. The hypothesis:
2. The assumptions: Random sample from a normal distribution with = 0.7 inches 3. The -level: = 0.05
15 - 10
x z n
5. The critical region: Reject H0: = 13.0 if the value calculated for z is not between 1.96 6. The result:
7. The conclusion:
This test was performed under the assumption that = 13.0. Our conclusion is that our sample mean x = 13.5 is far away from = 13.0 that we find it hard to believe that = 13.0.
That is, our observed value of x = 13.5 for the sample mean is too rare for us to believe that = 13.0.
How rare is
15 - 12
x ~ N (13.00, 0.14)
x 13.5
15 - 13
1. The hypothesis:
2. The assumptions: Random sample from a normal distribution with = 0.7 inches 3. The -level: = 0.05
15 - 14
x z n
5. The critical region: Reject H0: = 13.0 if the value calculated for z is not between 1.96 6. The result:
13 .1 13 .0 0.1 z 0.71 0.14 0.7 25
7. The conclusion:
Accept H0: = 13.0 since the value calculated for z is not between 1.96
15 - 15
This test was performed under the assumption that = 13.0. Our conclusion is that our sample mean x = 13.1 is not so far away from = 13.0 that we find it is not hard to believe that = 13.0.
That is, our observed value of x = 13.1 for the sample mean is not so rare and it could be that = 13.0.
How rare is
15 - 16
x ~ N (13.00,0.14)
x 13.1
15 - 17
Question
Suppose = 13.0, x ~ N (13.0, 0.14) , and we want to test the hypothesis: H0: = 13.0 vs.
H1: 13.0
What are the possible outcomes and how many are likely?
15 - 18
13.0
x
zupper zlower
12.73 - 13.00 = 1.96 , Area below = 0.025 0.14 13.27 - 13.00 = 1.96 , Area above = 0.025 0.14
15 - 19
Question
Suppose = 12.8, x ~ N (12.8, 0.14) , and we want to test the hypothesis: H0: = 13.0 vs.
H1: 13.0
What are the possible outcomes and how many are likely?
15 - 20
12.8
Question
Suppose = 13.4, x ~ N (13.4, 0.14) , and we want to test the hypothesis: H0: = 13.0 vs.
H1: 13.0
What are the possible outcomes and how many are likely?
15 - 22
13.4
15 - 23
15 - 24
Design of experiments
15 - 25
H0 Correct OK
Type I or Error
Accept H0
Reject H0
15 - 26
The p-value and the -level are related concepts, but there are important differences between them. The level should be determined as a part of the process of setting up the hypothesis test. That is, it is a fundamental component of the ground rules established in setting up the hypothesis test and it should be set before the test is actually conducted. Setting the -level at, say, = 0.05, is the way we implement the decision as to how willing we are to reject the null hypothesis as being true when it is actually true, that is, our willingness to make a Type I or -error.
15 - 28
The p-value, on the other hand, can be determined only after the test statistic is calculated. They are related in the sense that, if = 0.05, then we will reject the null hypothesis as being true if the value we calculate for p is p < 0.05.
-error or Type I error: The error made when we reject a null hypothesis as being true when it is, if fact, true. The number we select for , typically = 0.05, represents our willingness to make an -error. We control the frequency of making this error when we select the level as an initial part of setting up the hypothesis test. When we use this level, we are saying that we are willing to run a 5% risk of rejecting the null hypothesis as true when it is actually true.
15 - 29
-error or Type II error: The error made when we accept as true a null hypothesis that is false. The value of is the likelihood of making a -error. Controlling this error is more complicated than controlling the error. It usually involves selecting an appropriate sample size to detect a difference of a specified magnitude. Power or 1-: The probability of rejecting the null hypothesis when it is false. This is often thought of in the context of the power to detect a difference of a certain magnitude.
15 - 30