Chapter 1: New world, new web, new skills Valerie Kryc Devorah Shiffman Michael Abbott.
Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH...
-
Upload
frank-gilbert -
Category
Documents
-
view
216 -
download
0
Transcript of Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH...
![Page 1: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/1.jpg)
Richard N. Shiffman, MD, MCISGeorge Michel, MS
Abdelwaheb Essaihi, MDTheodore W. Marcy, MD, MPHYale Center for Medical informatics
University of Vermont College of Medicine
Richard N. Shiffman, MD, MCISGeorge Michel, MS
Abdelwaheb Essaihi, MDTheodore W. Marcy, MD, MPHYale Center for Medical informatics
University of Vermont College of Medicine
Using a Guideline-Centered Approach for the Design of a
Clinical Decision Support System to Promote Smoking Cessation
Using a Guideline-Centered Approach for the Design of a
Clinical Decision Support System to Promote Smoking Cessation
![Page 2: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/2.jpg)
• Ambiguity; guideline terms often lack explicit definitions
• Incomplete specification
• Additional knowledge is always necessary to create a decision support tool
• Creation of DSS KB risks error
• Local adaptation (necessary) risks preservation of habit, self interest
• Knowledge maintenance is a largely unaddressed but critical issue
• Ambiguity; guideline terms often lack explicit definitions
• Incomplete specification
• Additional knowledge is always necessary to create a decision support tool
• Creation of DSS KB risks error
• Local adaptation (necessary) risks preservation of habit, self interest
• Knowledge maintenance is a largely unaddressed but critical issue
Knowledge Acquisition from Guidelines:
What’s the Problem?
Knowledge Acquisition from Guidelines:
What’s the Problem?
![Page 3: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/3.jpg)
• Members of the InterMed Collaboratory encoded representations of guidelines for vaccination and workup of breast masses
• Tested with patient scenarios
• Different recommendations were given for the same patient
• Members of the InterMed Collaboratory encoded representations of guidelines for vaccination and workup of breast masses
• Tested with patient scenarios
• Different recommendations were given for the same patient
Representation of Guideline Knowledge for Decision Support
Representation of Guideline Knowledge for Decision Support
Patel VL.JAMIA 1998Patel VL.JAMIA 1998
![Page 4: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/4.jpg)
Guideline Implementation GapGuideline Implementation Gap
Black BoxBlack BoxPublished GuidelinePublished Guideline
Computer-Based Guideline Implementation
Computer-Based Guideline Implementation
![Page 5: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/5.jpg)
• Articulate a systematic, explicit, and transparent process for translating GL knowledge into DS tools
• GEM Overview
• Handheld, wireless DSS (under construction) for smoking cessation
• Articulate a systematic, explicit, and transparent process for translating GL knowledge into DS tools
• GEM Overview
• Handheld, wireless DSS (under construction) for smoking cessation
Goal (Intention) of This WorkOverview of Presentation
Goal (Intention) of This WorkOverview of Presentation
![Page 6: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/6.jpg)
• Preservation of authenticity of knowledge
• Audit of local adaptation (knowledge modifications)
• Diminished variability of DSS designs
• Preservation of authenticity of knowledge
• Audit of local adaptation (knowledge modifications)
• Diminished variability of DSS designs
Advantages of Document-Centered DSS Design
Advantages of Document-Centered DSS Design
![Page 7: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/7.jpg)
GEMGEM
• XML
• Hierarchy of > 100 elements
• Models heterogeneous information
• Has been used successfully for:
Guideline quality appraisal (GEM-Q)
Feedback to developers (Extractor)
Partial generation of MLMs (GEM-Arden)
Creating database of NGC guidelines
• DTD adopted as standard by ASTM (E2210-02)
![Page 8: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/8.jpg)
TitleTitle
CitationCitation
Release DateRelease Date
AvailabilityAvailability
ContactContactStatusStatus
Companion DocumentCompanion Document
AdaptationAdaptation
Developer NameDeveloper Name
Committee NameCommittee Name
FundingFunding
EndorserEndorserComparable GuidelineComparable Guideline
Health PracticesHealth Practices
CategoryCategory
Target PopulationTarget Population
RationaleRationale
ObjectiveObjective
Available OptionsAvailable Options
Implementation StrategyImplementation Strategy
Health OutcomesHealth Outcomes
ExceptionsExceptions
Care SettingCare Setting
Clinician UsersClinician Users
Evidence CollectionEvidence Collection
Evidence Time PeriodEvidence Time Period
Evidence GradingEvidence Grading
Combining EvidenceCombining EvidenceSpecification of Harm/BenefitSpecification of Harm/Benefit
Quantification of Harm/BenefitQuantification of Harm/Benefit
Value JudgmentValue Judgment
Patient PreferencePatient Preference
Qualifying StatementQualifying Statement
Cost AnalysisCost Analysis
RecommendationRecommendationConditional (decision variable) Conditional (decision variable) . .
Action Action . .
Logic Logic . .
Reason Reason . .
Strength of Recommendation Strength of Recommendation . .
Evidence Quality Evidence Quality . . . . . .Cost Cost . .
Certainty Certainty . .
AlgorithmAlgorithm
EligibilityEligibility
DefinitionDefinition
External ReviewExternal Review
Pilot TestingPilot Testing
Expiration DateExpiration Date
Scheduled ReviewScheduled Review
DeveloperDeveloper
PurposePurpose
MethodMethod
KnowledgeKnowledge
AudienceAudience
IdentityIdentity
TestingTestingRevisionRevision
Health InformaticsSvcs
Health InformaticsSvcs
Element Sources
GEMGEM
![Page 9: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/9.jpg)
GEM: Top LevelsGEM: Top Levels
GuidelineGuideline
IdentityIdentityPurposePurpose
Intended Audience
Intended Audience
Method ofDevelopment
Method ofDevelopment
KnowledgeComponents
KnowledgeComponents
TestingTesting RevisionPlan
RevisionPlan
TargetPopulation
TargetPopulation
DocumentHeader
DocumentHeader
DocumentBody
DocumentBody
DeveloperDeveloper
![Page 10: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/10.jpg)
KnowledgeComponents
KnowledgeComponents
DefinitionDefinition
TermTerm
TermMeaning
TermMeaning
Knowledge ComponentsKnowledge Components
RecommendationRecommendation
ConditionalConditional ImperativeImperative
AlgorithmAlgorithm
SyncStep
SyncStep
ActionStep
ActionStep
Condit’lStep
Condit’lStep
BranchStep
BranchStep
![Page 11: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/11.jpg)
ConditionalConditional
FlexbltyFlexbltyReasonReason Evid
Quality
Evid
QualityRecmdn
Strength
Recmdn
StrengthLogicLogic CostCost LinkLink RefRef CertaintyCertainty
Action
Benefit
Action
Benefit
ActionRi
sk
Harm
ActionRi
sk
Harm
Action
Descripn
Action
DescripnAction
Cost
Action
CostValueValue Dec Variable
Descripn
Dec Variable
DescripnTest
Param
Test
Param
Dec
Var
Cost
Dec
Var
Cost
SensitivitySensitivity SpecificitySpecificity Predictive
Value
Predictive
Value
KnowledgeComponents
KnowledgeComponents
RecommendationRecommendation
ConditionalConditional
Dec
Var
Dec
VarActionAction
![Page 12: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/12.jpg)
GEM CutterGEM Cutter
![Page 13: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/13.jpg)
• Each GEM element has
• a unique identifier attribute
• a source attribute:
• default value is “explicit”
• changes to “inferred” if content is modified
• Each GEM element has
• a unique identifier attribute
• a source attribute:
• default value is “explicit”
• changes to “inferred” if content is modified
Maintaining Links to Guideline TextMaintaining Links to Guideline Text
![Page 14: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/14.jpg)
GEM PolishingGEM Polishing
• Select (GL & Rec)• Semantic
Refinement (Markup) Atomize De-abstract Disambiguate Verify completeness Build executables
• Select (GL & Rec)• Semantic
Refinement (Markup) Atomize De-abstract Disambiguate Verify completeness Build executables
Workflow Integration
• Origins and insertions
• Define action types
• Assoc’d beneficial services
• Develop requirement spec
Encode, design interface
Test
Workflow Integration
• Origins and insertions
• Define action types
• Assoc’d beneficial services
• Develop requirement spec
Encode, design interface
Test
![Page 15: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/15.jpg)
• Cigarette smoking is most common cause of preventable death in the US
• Cessation can dramatically reduce risk of cancer and other diseases
• Smokers are more likely to quit if physicians counsel them
• Physicians infrequently counsel
• -->USPHS Guideline
• Cigarette smoking is most common cause of preventable death in the US
• Cessation can dramatically reduce risk of cancer and other diseases
• Smokers are more likely to quit if physicians counsel them
• Physicians infrequently counsel
• -->USPHS Guideline
Smoking CessationSmoking Cessation
![Page 16: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/16.jpg)
MarkupMarkup
• Bupropion SR should be used during pregnancy only if the increased likelihood of smoking abstinence, with its potential benefits, outweighs the risk of bupropion SR treatment and potential concomitant smoking.
• Bupropion SR should be used during pregnancy only if the increased likelihood of smoking abstinence, with its potential benefits, outweighs the risk of bupropion SR treatment and potential concomitant smoking.
![Page 17: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/17.jpg)
• Atomize: “Bupoprion should be used” -> Prescribe bupoprion
• Deabstract: “potential benefits outweigh the risks”
• Benefits: avoid smoking-induced stillbirths, spontaneous abortions, decreased fetal growth, premature births, low birth weight, placental abruption, sudden infant death syndrome (SIDS), cleft palates and cleft lips, and childhood cancers. and infant respiratory disease
• Risks: unknown + seizures in 1:1000; may be ineffective
• Atomize: “Bupoprion should be used” -> Prescribe bupoprion
• Deabstract: “potential benefits outweigh the risks”
• Benefits: avoid smoking-induced stillbirths, spontaneous abortions, decreased fetal growth, premature births, low birth weight, placental abruption, sudden infant death syndrome (SIDS), cleft palates and cleft lips, and childhood cancers. and infant respiratory disease
• Risks: unknown + seizures in 1:1000; may be ineffective
Semantic RefinementSemantic Refinement
![Page 18: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/18.jpg)
Extractor -> Decision Variables, Extractor -> Decision Variables,
Tobacco useCurrent, quit recently, abstinent for an extended period, never
used
Age Adolescent, adult
Pregnant Y/N/0
Breastfeeding Y/N/0
Hx of depression Y/N/0
Cardiovascular disease
Y/N/0
Concern about weight gain
Y/N/0
Hx of seizures Y/N/0
![Page 19: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/19.jpg)
• Identify origins of DVs, insertions of actions
• Define action type
• Describe associated beneficial services
• Identify origins of DVs, insertions of actions
• Define action type
• Describe associated beneficial services
Workflow IntegrationWorkflow Integration
![Page 20: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/20.jpg)
Guideline Action Classifier (N=405)Guideline Action Classifier (N=405)
MonitorMonitor
TestTest
GatherGather InterpretInterpret PerformPerform DisposeDispose
ActionAction
ConcludeConclude PrescribePrescribe
EducateEducate
DocumentDocument
ProcedureProcedure
ConsultConsult
AdvocateAdvocate
PreparePrepare
![Page 21: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/21.jpg)
System for Delivering AdviceSystem for Delivering Advice
![Page 22: Richard N. Shiffman, MD, MCIS George Michel, MS Abdelwaheb Essaihi, MD Theodore W. Marcy, MD, MPH Yale Center for Medical informatics University of Vermont.](https://reader035.fdocuments.net/reader035/viewer/2022070415/5697bf871a28abf838c88c61/html5/thumbnails/22.jpg)
• Bridging the gap between guideline text and valid, useful decision support tools is complex
• Extraction of DVs and actions from contextual narrative facilitates clarification
• Document-centered approach helps maintain authenticity of knowledge
• Bridging the gap between guideline text and valid, useful decision support tools is complex
• Extraction of DVs and actions from contextual narrative facilitates clarification
• Document-centered approach helps maintain authenticity of knowledge
ConclusionConclusion
[email protected]://ycmi.med.yale.edu/GEM
[email protected]://ycmi.med.yale.edu/GEM