Dichotomous Tests (Tom)
description
Transcript of Dichotomous Tests (Tom)
![Page 1: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/1.jpg)
Dichotomous Tests (Tom)
![Page 2: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/2.jpg)
•Their results change the probability of disease
Negative test Positive test
Reassurance TreatmentOrder a Test
•A good test moves us across action thresholds.
0% 100%
T+T-
•The best tests are definitive
What tests do
![Page 3: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/3.jpg)
Post-Test Probability of Disease Depends on 2 Things
1. Where you started from (low, medium, high)
2. Length and direction of the “arrow” Basic paradigm:
What we thought before + test result = what we think now
Prior probability + LR from test = post-test probability
LR = P(Result|Disease)/P(Result|No Disease)
![Page 4: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/4.jpg)
Assessing information from dichotomous tests (review):
Disease + Disease - Total
Test + a b a+b
True Positives False Positives Total Positives
Test - c d c+d
False Negatives True Negatives Total Negatives
Total a+c b+d Total N
Total With Disease
Total without Disease
Sensitivity=a/(a+c) Specificity =d/(b+d)Positive predictive value (PPV) = a/(a+b); Negative predictive value (NPV) d/(c+d)Prior probability = P(D); Posterior probability = P(D|test result)
![Page 5: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/5.jpg)
False-negative confusion
Sensitivity of rapid strep test is 85%
Therefore, false negative rate is 15%
15% is too high, so always culture to confirm negative rapid strep tests
![Page 6: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/6.jpg)
What’s wrong?Strep No StrepTotal
Rapid Test + TP FP TP+FPRapid Test - FN TN TN+FN
TP+FN FP+TN 2 definitions of “false negative rate”
1-sensitivity = FN/(TP+FN). This one is easier because it’s (assumed to be) constant.
1 - negative predictive value = FN/(FN+TN). This one is harder because it depends on prior probability, but it is the one that should determine clinical decisions.
![Page 7: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/7.jpg)
If prior probability of strep = 20%
False negative rate (def #2) = 15/407 = 3.7%
NNC (number needed to culture) = 1/.037 = 27 to identify 1 false negative rapid test. (Pre-test probability of 20%)
At some prior probability of strep, culture after negative quick test is not indicated.
Strep No Strep TotalRapid test + 85 8 95Rapid test - 15 392 407Total 100 400 500
(Assumes 98% specificity)
![Page 8: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/8.jpg)
Similar examples:
Sensitivity of UA for UTI is only 80%, therefore always culture after a negative UA
Sensitivity of CT scan for subarachnoid hemorrhage is only 90%, therefore always do LP after a negative CT
![Page 9: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/9.jpg)
Importance of Sampling Scheme
If sampling separately from Disease+ and Disease– groups (case-control sampling), cannot calculate prevalence, positive predictive value, or negative predictive value.
![Page 10: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/10.jpg)
Dx Test:Case-Control SamplingDisease +Sampled
Separately
Disease –Sampled
Separately
Test +a
True Positivesb
False Positives
Test -c
False Negatives
dTrue
Negatives
Total
a + cTotal With
Disease
b + dTotal
WithoutDiseaseSensitivity = a/(a + c)
Specificity = d/(b + d)
![Page 11: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/11.jpg)
Dx Test: Cross-sectional Sampling
Prevalence = (a + c)/NPositive Predictive Value = a/(a + b)Negative Predictive Value = d/(c + d)
Disease + Disease - Total
Test + aTrue Positives
bFalse Positives
a + bTotal
Positives
Test - cFalse
Negatives
dTrue
Negatives
c + dTotal
Negatives
Total a + cTotal With
Disease
b + dTotal
WithoutDisease
a + b + c + dTotal N
![Page 12: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/12.jpg)
R. henselae titers and Cat Scratch Disease*
Case Control
R. henselae titer
Positive 38 4 42
Negative 4 108 122
45 112
*Zangwill, N Engl J Med. 1993;329:8-13. EBD Problem 3.2
Authors stated negative predictive value = 38/42 = 90.5%. Is there a problem?
![Page 13: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/13.jpg)
Example from Chapter 3
65-year-old woman with mammogram suspicious for malignancy
Pre-test probability ≈ 0.015LR(“suspicious for malignancy”) ≈
100Post-test probability = ?
![Page 14: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/14.jpg)
Update Pre-Test Probability Using LR(test result)
1) Convert pre-test probability (P) to pre-test odds. Pre-Test Odds = P/(1-P)
2) Calculate LR. P(result|D+)/P(result|D-). 3) Post-Test Odds = Pre-Test Odds × LR4) Convert post-test odds to post-test
probability. Prob = Odds/(1+Odds)
![Page 15: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/15.jpg)
Update Pre-Test Probability Using LR(test result)
1) Pre-test probability P = 0.015Pre-test odds = P/(1-P) ≈ 0.015
2) LR(“Suspicious for Malignancy”) = 100
3) Post-Test Odds = 0.015 × 100 = 1.54) Post-test probability =
Odds/(1+Odds) = 1.5/2.5 = 0.60
![Page 16: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/16.jpg)
Can Use Slide Rule
![Page 17: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/17.jpg)
Threshold Model
Single disease (D+,D-) with single treatment (no further testing available)
Cost of failing to treat D+ = B Cost of treating D- unnecessarily = C Treat if P(D) > C/(C+B) C/(C+B) = Treatment Threshold
Probability = PTTPauker SG, Kassirer JP.. N Engl J Med. 1975 Jul
31;293(5):229-34.
![Page 18: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/18.jpg)
Pauker SG, Kassirer JP.. N Engl J Med. 1975 Jul 31;293(5):229-34.
![Page 19: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/19.jpg)
Define Costs B and C
![Page 20: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/20.jpg)
![Page 21: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/21.jpg)
“X-Graph”
![Page 22: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/22.jpg)
Introduce a Dichotomous (+/-) Test
P(+|D+) = Probability of positive test “given” D+ = Sensitivity
P(-|D-) = Probability of negative test “given” D- = Specificity
P(+|D-) = 1 – Specificity or “False Positive Rate”
P(-|D+) = 1 – Sensitivity of “False Negative Rate”
T = Cost of Test
![Page 23: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/23.jpg)
Pauker SG, Kassirer JP. N Engl J Med. 1980 May 15;302(20):1109-17.
![Page 24: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/24.jpg)
![Page 25: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/25.jpg)
“X-Graph”
![Page 26: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/26.jpg)
New “X-Graph”
![Page 27: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/27.jpg)
Threshold Formulas
![Page 28: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/28.jpg)
Assumptions in the Threshold ModelThreshold Model: One disease One dichotomous test Only two post-test options: treat and no treat
Real world: Multiple possible diseases Multiple possible test results (not just
+/-) Multiple possible tests Multiple post-test options including
observation and additional testing
![Page 29: Dichotomous Tests (Tom)](https://reader034.fdocuments.net/reader034/viewer/2022050910/56815a91550346895dc80757/html5/thumbnails/29.jpg)
2) Multilevel Tests (Michael)
Likelihood ratios for results other than “+” or “-”