Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings
-
Upload
hu-ferrell -
Category
Documents
-
view
15 -
download
1
description
Transcript of Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings
![Page 1: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/1.jpg)
Contextualizing the Evaluand: Contextual Influences and Constraints
on Communicating Findings
Kristi Pettibone, PhD
The MayaTech Corporation, With CDC’s National Center for Injury Prevention and Control
American Evaluation AssociationNovember 13, 2009
The findings of this presentation are the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention
![Page 2: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/2.jpg)
Review of Key Stakeholders
• CDC leadership
• NCIPC program staff
• ICRC program evaluation workgroup
• ICRC directors
• External peer review panel
• Evaluation contractors
• Board of Scientific Counselors
![Page 3: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/3.jpg)
Purpose of Evaluation & Report
• Intended for internal use only, though some parts may be shared
• Identify research gaps and areas for program improvement
• Required by CDC policy to conduct program and portfolio reviews for research and scientific programs every 5 years
![Page 4: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/4.jpg)
Potential Uses of Findings
• Demonstrate accountability
• Program improvement
• Future FOA requirements
• Documentation of program history
![Page 5: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/5.jpg)
Potential Uses of Findings (continued)
• Talking points with Congress and state legislatures
• Success stories
• Sharing through general publications and/or Extramural Research Program Office website
![Page 6: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/6.jpg)
Implications for Sharing Findings with Stakeholders
• Only few stakeholders will receive the full report
• Some stakeholders might receive only key findings
• When possible, findings reported in format that prevents comparisons between centers
![Page 7: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/7.jpg)
Contextual Influences/Constraints
ICRC Directors
• Wanted to promote their programs
• Concerned about comparisons among centers
• Half of the centers reapplied for funding under the 2009 Funding Opportunity Announcement
• Asked for additional funding for program
![Page 8: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/8.jpg)
Contextual Influences/Constraints
ICRC Portfolio Evaluation Workgroup• Comprised of
– ICRC Directors– CDC Evaluators– NCIPC Leadership and Researchers
• Designed to ensure that members had– Experience with other programs/centers– History with ICRCs– Representation from ICRCs
![Page 9: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/9.jpg)
Contextual Influences/Constraints
NCIPC
• Showcased benefits of program
• Identified areas for program improvement
Evaluation contractor
• Guided by previous portfolio reviews
• Financial constraints
![Page 10: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/10.jpg)
Managing Competing Contexts
• Discuss dissemination of findings early• Crosswalk data collection and analysis
activities with dissemination plans• Ensure budget supports dissemination
activities• Clarify and manage expectations with all
stakeholders in advance• Revisit these expectations throughout
evaluation to address possible changes
![Page 11: Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings](https://reader035.fdocuments.net/reader035/viewer/2022072015/56813080550346895d965a72/html5/thumbnails/11.jpg)
Contact Information
Kristi Pettibone
The MayaTech Corporation