CIS4330: Professor KirsExpert Systems Slide 1 An Overview of Expert Systems.
Power Point Slide Catalog From PreViser Corporation Expert Validation Study.
9
Power Point Slide Power Point Slide Catalog Catalog From PreViser From PreViser Corporation Corporation www.previser.com www.previser.com Expert Validation Expert Validation Study Study
-
Upload
dustin-rogers -
Category
Documents
-
view
219 -
download
4
Transcript of Power Point Slide Catalog From PreViser Corporation Expert Validation Study.
Power Point Slide Power Point Slide CatalogCatalog
From PreViser From PreViser CorporationCorporation
www.previser.comwww.previser.com
Expert Validation StudyExpert Validation Study
How Good are Dentists and How Good are Dentists and Periodontists at Assessing Periodontists at Assessing
Risk for Periodontitis?Risk for Periodontitis?
Assessing periodontal disease risk: A Assessing periodontal disease risk: A comparison of clinicians’ assessment comparison of clinicians’ assessment versus a computerized tool versus a computerized tool
G. Rutger Persson, Lloyd A. Mancl, John G. Rutger Persson, Lloyd A. Mancl, John Martin, Roy PageMartin, Roy Page
Journal of the American Dental Journal of the American Dental Association. Volume 134, May 2003. Association. Volume 134, May 2003. Pages 575 – 582.Pages 575 – 582.
Courtesy PreViser Corporation, all rights reserved
Expert Validation of the OHIS Expert Validation of the OHIS Periodontal Risk CalculatorPeriodontal Risk Calculator
A group of 107 subjects was assembled to A group of 107 subjects was assembled to manifest a wide range of risk, and a periodontal manifest a wide range of risk, and a periodontal examination performedexamination performed
Based on the records, a risk score from 1 - 5 was Based on the records, a risk score from 1 - 5 was determined by the OHISdetermined by the OHIS
The records were evaluated individually by one The records were evaluated individually by one group of 10 periodontists, another group of 6 group of 10 periodontists, another group of 6 periodontists and a group of 36 general dentists, periodontists and a group of 36 general dentists, and a risk score assigned for each subjectand a risk score assigned for each subject
Expert scores were compared statistically to the Expert scores were compared statistically to the OHIS-assigned scoresOHIS-assigned scores
Courtesy PreViser Corporation, all rights reserved
0%
10%
20%
30%
40%
50%
60%
GROUP
5
A B CGROUP
3
A B CGROUP
2
A B CGROUP
1
A B CGROUP
4
A B C
Risk Calculator107 Patient Records, Risk Assessed using OHIS™
Three Expert Groups Subjectively Assess Same Patients
OHIS™
Courtesy PreViser Corporation, all rights reserved
107 Patient Records, Risk Assessed using OHIS™
Three Expert Groups Subjectively Assess Same Patients
0%
10%
20%
30%
40%
50%
60%
GROUP
5
A B CGROUP
3
A B CGROUP
2
A B CGROUP
1
A B CGROUP
4
A B C
Risk Calculator
6 Practicing Experts
OHIS™
Courtesy PreViser Corporation, all rights reserved
107 Patient Records, Risk Assessed using OHIS™
Three Expert Groups Subjectively Assess Same Patients
6 Practicing Experts
OHIS™
0%
10%
20%
30%
40%
50%
60%
GROUP
5
A B CGROUP
3
A B CGROUP
2
A B CGROUP
1
A B CGROUP
4
A B C
Risk Calculator
10 PreViser Founders
Courtesy PreViser Corporation, all rights reserved
107 Patient Records, Risk Assessed using OHIS™
Three Expert Groups Subjectively Assess Same Patients
6 Practicing Experts
OHIS™
10 PreViser Founders
36 General Dentists “Periodontally Aware”0%
10%
20%
30%
40%
50%
60%
GROUP
5
A B CGROUP
3
A B CGROUP
2
A B CGROUP
1
A B CGROUP
4
A B C
Risk Calculator
Courtesy PreViser Corporation, all rights reserved
RiskCalculatorScore = 3
General Dentist(5 Patient Evaluations…
Expert Periodontists(5 Patient Evaluations per data point)
Previser Founder’s(5 Patient Evaluations…)
Practitioner evaluation
over-estimating risk by 2 scores
Practitioner evaluation
under-estimating risk by 1
score
Over-Estimated
Risk = Inappropriate
Treatment
Under-Estimated
Risk = Inappropriate
Treatment
Practitioner evaluation
over-estimating risk by 1
score
Practitioner evaluation
under-estimating risk by 2 scores
20% Agreement with OHIS™
For OHIS™
assessed patients with Risk Score of 3..
Conclusion: Clinicians
can’t assess the risk of
future diseaseCourtesy PreViser Corporation, all rights reserved
ConclusionsConclusions
There is great variation among practitioners There is great variation among practitioners in assessing risk in assessing risk
Agreement between practitioners and the Agreement between practitioners and the OHIS is poor OHIS is poor
Probability of an expert clinician assigning Probability of an expert clinician assigning given patient a “correct” risk score is remote given patient a “correct” risk score is remote
Relative to the OHIS Risk Calculator, dentists Relative to the OHIS Risk Calculator, dentists and periodontists underestimate risk , and periodontists underestimate risk , especially for patients in the higher risk especially for patients in the higher risk groupsgroups
Courtesy PreViser Corporation, all rights reserved
