Power of a test
description
Transcript of Power of a test
![Page 1: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/1.jpg)
Power of a testPower of a test
![Page 2: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/2.jpg)
The powerpower of a test (against a specific alternative value)• Is the probability that the test
will reject the null hypothesis when the alternative is true
• In practice, we carry out the test in hope of showing that the null hypothesis is false, so high power is important
![Page 3: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/3.jpg)
H0 True
H0
FalseReject
Fail to reject
Type I Correct
Correct
Type II
Power
Suppose H0 is true – what if we decide to
fail to reject it?
Suppose H0 is false – what if we decide to
reject it?
Suppose H0 is true – what if we decide to reject
it?
Suppose H0 is false – what if
we decide to fail to reject it?
We correctly We correctly reject a false Hreject a false H00!!
![Page 4: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/4.jpg)
A new flu vaccine claims to prevent a certain type of flu in 70% of the people who are vaccinated. A random sample of 100 people are vaccinated and then exposed to the flu. Is this claim too high? Use = .05.
What are the hypotheses?H0: p = .7
Ha: p < .7
![Page 5: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/5.jpg)
A new flu vaccine claims to prevent a certain type of flu in 70% of the people who are vaccinated. A random sample of 100 people are vaccinated and then exposed to the flu. Is this claim too high? Use = .05.
Find p and p.p = .7p = .0458
![Page 6: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/6.jpg)
A new flu vaccine claims to prevent a certain type of flu in 70% of the people who are vaccinated. A random sample of 100 people are vaccinated and then exposed to the flu. Is this claim too high? Use = .05.
What is the probability of committing a Type I error? = .05
![Page 7: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/7.jpg)
.7
H0: p = .7Ha: p < .7 = .05For what values of the sample proportion would you reject the null hypothesis?
Invnorm(.05,.7,.0458) =.625
= .05
p?
So if we get p-
hat=.625 or less, we
would reject H0.
![Page 8: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/8.jpg)
H0: p = .7Ha: p < .7
We reject H0 and decide that p<.7.
Suppose that pa is 0.6.
What is the probability of committing a Type II error?
Where did this
number come from?
I selected a number that
was less than .7
.7
.6
= .05Reject
What is a type II error?
= ?
How can we find this area?What is the standard deviation of this curve?
Normalcdf(.625,∞,.6,.0458) =.293
failing to reject H0 when the alternative is true
![Page 9: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/9.jpg)
What is the power of the test?
Power = 1 - .293= .707
.7
.6
= .05
=.293
What is the definition of
power?The probability that the test correctly rejects H0
Power = ?
Power - the probability
that the test correctly
rejects H0, if p = .6, is .707
Is power a conditional probability?
![Page 10: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/10.jpg)
Suppose we select .55 as the alternative proportion (p).
a)What is the probability of the type II error?
b) What is the power of the test?
= normalcdf(.625,∞, .55,.0458) = .051
.7
.6
.55
= .05
Power = 1 - .051= .949
What happened to the power of the
test when the difference |p0 – pa| is
increased?
![Page 11: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/11.jpg)
Suppose we select .65 as the alternative proportion (p).
a) What is the probability of the type II error?
b) What is the power of the test?
Power = 1 - .707= .293
.7
.6
.65
= .05
= normalcdf(.625,∞, .65,.0458) = .707
What happened to the power
when the difference |p0-pa|
is decreased?
Power
![Page 12: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/12.jpg)
Suppose that we change alpha to 10%.
Using pa = .6, what would happen to the probability of a type II error and the power of the test?
.7
.6
= .05 = .1
Power
The probability of the type II error () decrease and power increased, BUT BUT the probability of a type I error also also increasedincreased.
= .1836
Power = .8164
![Page 13: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/13.jpg)
What happens to What happens to , , , & , & power when the sample size power when the sample size
is increased?is increased?Reject H0Fail to Reject H0
p0
pa
P(type II) decreases
when n increases
Power
Power increases when n
increases
![Page 14: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/14.jpg)
p0
pa
Reject H0Fail to Reject H0
Power = 1 -
![Page 15: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/15.jpg)
Recap:What affects the power of a test?
As |p0 – pa| increases, power increases
As increases, power increases
As n increases, power increases
![Page 16: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/16.jpg)
Facts:Facts:• The researcher is free to determine the
value of .• The experimenter cannot control , since it
is dependent on the alternate value.• The ideal situation is to have as small as
possible and power close to 1. (Power > .8)• As increases, powerpower increases. (But also
the chance of a type I error has increased!)• Best way to increase power, without
increasing , is to increase the sample sizesample size
![Page 17: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/17.jpg)
A new flu vaccine claims to prevent a certain type of flu in 70% of the people who are vaccinated. In a test, vaccinated people were exposed to the flu. Is this claim too high?
Identify the decision:
a) You decide that the proportion of vaccinated people who do not get the flu is less than 70% when it really is not.
Type I Error
![Page 18: Power of a test](https://reader036.fdocuments.net/reader036/viewer/2022083006/568139ce550346895da17fb5/html5/thumbnails/18.jpg)
A new flu vaccine claims to prevent a certain type of flu in 70% of the people who are vaccinated. In a test, vaccinated people were exposed to the flu. Is this claim too high?
Identify the decision:
b) You decide that the proportion of vaccinated people who do not get the flu is less than 70% when it really is.
Correct –
Power!!