A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo...
-
Upload
tyler-rose -
Category
Documents
-
view
218 -
download
0
Transcript of A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo...
![Page 1: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/1.jpg)
A Comprehensive Review of Dissemination and Implementation Science Instruments
Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois
![Page 2: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/2.jpg)
Agenda
1. Background
2. Goals
3. Framework & Scope of Review
4. Overview of Review Process &
Findings
5. Evidence-Based Assessment Criteria
6. SIRC Instrument Review Task Force
7. Shared Product
![Page 3: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/3.jpg)
Background
Impetus for the project:
✦ Measurement redundancy
✦ Constructs with no measures
✦ Prioritize both measure quality and usability
![Page 4: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/4.jpg)
Goals
Step 1
Instrument Repository
Step 3
Consensus Battery
Step 2
Comprehensive Review
Evidence Based Assessment
![Page 5: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/5.jpg)
Framework & Scope
Consolidated Framework for Implementation Research
✦ 39 Constructs
Damschroder, Aron, Keith, Kirsh, Alexander, & Lowery, 2009
![Page 6: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/6.jpg)
Framework & Scope
Outcomes for Implementation Research
✦ 17 Constructs
Proctor, Silmere, Raghavan, Hobmand, Aarons, Bunger, et al. 2011
![Page 7: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/7.jpg)
Comprehensive Review
1 Literature Review
3 Measure Specific
4Individual and Listserv Requests
5 Comprehensive Measure List
2Construct Specific
215 measures
![Page 8: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/8.jpg)
Comprehensive Measures List
![Page 9: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/9.jpg)
SIRC Website: Main Page
www.seattleimplementation.org
![Page 10: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/10.jpg)
SIRC Website: Main Page
www.seattleimplementation.org
![Page 11: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/11.jpg)
SIRC Website: Construct Page
www.seattleimplementation.org
![Page 12: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/12.jpg)
SIRC Website: Measure Page
www.seattleimplementation.org
![Page 13: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/13.jpg)
Goals
Step 1
Instrument Repository
Step 3
Consensus Battery
Step 2
Comprehensive Review
Evidence Based Assessment
Criteria
![Page 14: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/14.jpg)
Evidence Based Assessment Criteria
First Draft
SPG Feedback (N = 58)
Test Developer Input
IRT Pilot
Hunsley & Mash, 2008
![Page 15: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/15.jpg)
Evidence-Based Assessment Criteria
EBA2 =
Adequate 3 = Good 4 = Excellent1 = Minimal0 = None
Psychometric Properties
✦ Norms
✦ Reliability Information
✦ Validity Information: Criterion, Content, Construct
✦ Validity Generalization versus Test Bias
✦ Validity Information: Predictive, Discriminant, Concurrent
![Page 16: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/16.jpg)
Seattle Implementation Research Conference: Instrument Review Task Force
VA Center for Implementation Practice and Research Support
International Evidence Informed Practice Consortium
40 Implementation Science Experts from SIRC SPG
Universities of Washington, Montana, & Indiana U
IRT
![Page 17: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/17.jpg)
SIRC Instrument Review Task Force
Gregory Aarons
Cassidy Arnold
Melanie Barwick
Rinad Beidas
Helen Best
Elisa Borah
Cameo
Borntrager
Craig Bryan
Adam Carmel
Mark Chaffin
Kate Comtois
Laura Damschroder
Dennis Donovan
Michelle Duda
Dean Fixsen
Howard Goldman
Carmen Hall
Amanda Jensen-
Doss
Sarah Kaye
Sara Landes
Cara Lewis
Marsha Linehan
Aaron Lyon
Michael
McDonell
Kate McHugh
Maria Mancebo
Shari Manning
Christopher
Martell
Brian Mittman
Sandra Naoom
Raphael Rose
Lisa Ruble
Joe Ruzek
Anju Sahay
Sonja Schoenwald
Jeremy Smith
Bradley Steinfeld
Phil Ullrich
Shannon Wiltsey
Stirman
Jennifer Villatte
![Page 18: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/18.jpg)
Comprehensive Review
1 Literature Review
3 Measure Specific
4Individual and Listserv Requests
5 Comprehensive Measure List
2Construct Specific
215 measures
![Page 19: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/19.jpg)
Specific Measure Review: Product for IRT
![Page 20: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/20.jpg)
Specific Measure Review: Product for IRT
![Page 21: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/21.jpg)
Specific Measure Review: Product for IRT
![Page 22: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/22.jpg)
Summary of Review to Date
Constructs with several measures (i.e., more than 5):✦ Acceptability✦ Adoption✦ Relative Advantage✦ Organizational Culture and Climate✦ Readiness for Implementation✦ Knowledge & Beliefs about Intervention✦ Planning✦ Reflecting & Evaluating
Constructs with zero measures:✦ Institute of Medicine’s Service Outcomes: Efficiency, Equity,
Timeliness✦ Intervention Adaptability, Complexity, Design Quality and
Packaging, Source✦ Outer Setting: Cosmopolitanism, Policy & Incentives, Peer
Pressure✦ Implementation Climate: Relative Priority, Goals & Feedback✦ Engaging & Executing
![Page 23: A Comprehensive Review of Dissemination and Implementation Science Instruments Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois.](https://reader030.fdocuments.net/reader030/viewer/2022033107/56649e445503460f94b38685/html5/thumbnails/23.jpg)
Q&A