It is my business to locate trouble… Making Evaluation Work.
-
Upload
osborne-preston -
Category
Documents
-
view
213 -
download
0
Transcript of It is my business to locate trouble… Making Evaluation Work.
![Page 1: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/1.jpg)
It is my business to locate trouble…Making Evaluation Work
![Page 3: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/3.jpg)
Using Resultsin many ways with many people who need to know
Who
needs
to know?
![Page 4: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/4.jpg)
Using Resultsin many ways with many people who need to know
What do they
need to know?
![Page 5: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/5.jpg)
Using Resultsin many ways with many people who need to know
![Page 6: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/6.jpg)
Using Resultsto communicate with decision-making stakeholders
Demonstration
Advocacy
Accountability
![Page 7: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/7.jpg)
Using Results to communicate with broader stakeholders
Marketing
Informing
Recruiting
![Page 8: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/8.jpg)
Using Resultsto make improvements …with the help of participants
Program
Improvement
Participant
Engagement
![Page 9: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/9.jpg)
Using Resultsto celebrate and encourage staff, volunteers, and participants
Participant
Recognition
![Page 10: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/10.jpg)
Using Resultsto build capacity for staff and organizations
Training and Supervision
Organizational Improvement
![Page 11: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/11.jpg)
Using Resultsto advance practice
Publications
Proposals
![Page 12: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/12.jpg)
Using Resultsin multiple ways
![Page 13: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/13.jpg)
Using Resultsto write a report
Accountability
![Page 14: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/14.jpg)
Report Elementscomponents of a formal report
Accountability
Opportunity
Program Response
Impact
Problem/NeedResearch Base
-Local Needs
-National Trends
-Prior Research
![Page 15: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/15.jpg)
Report Elementscomponents of a formal report
Accountability
Opportunity
Program Response
Impact
Problem/Need
Program
Details
Research Base
-Local Needs
-National Trends
-Prior Research
Best Practice Strategy
-Audience
-Setting
-Activities
-
![Page 16: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/16.jpg)
Report Elementscomponents of a formal report
AccountabilityEvidence of
Merit and
Worth
Evidence of
Merit and
Worth
Opportunity
Program Response
Impact
Problem/Need
Program
Details
Research Base
-Local Needs
-National Trends
-Prior Research
Best Practice Strategy
-Audience
-Setting
-Activities
Changes in Key Indicators
relative to context and
expectations
![Page 17: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/17.jpg)
Report Elementscomponents of a formal report
AccountabilityEvidence of
Merit and
Worth
Evidence of
Merit and
Worth
Opportunity
Program Response
Impact
Problem/Need
Program
Details
Research Base
-Local Needs
-National Trends
-Prior Research
Best Practice Strategy
-Audience
-Setting
-Activities
Changes in Key Indicators
relative to context and
expectations
Why?
Who
What
When
Where
How
What’s so?
So What?
![Page 18: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/18.jpg)
Report Elementscomponents of a formal report
AccountabilityEvidence of
Merit and
Worth
Evidence of
Merit and
Worth
Opportunity
Program Response
Impact
Problem/Need
Program
Details
Research Base90% of jobs require STEM skills
50% of local teachers cited need for
STEM
90% of jobs require STEM skills
50% of local teachers cited need for
STEM
![Page 19: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/19.jpg)
Report Elementscomponents of a formal report
AccountabilityEvidence of
Merit and
Worth
Evidence of
Merit and
Worth
Opportunity
Program Response
Impact
Problem/Need
Program
Details
Best Practice Strategy
500 youth…50 events…
60 volunteers
Partnering with schools,
businesses, civic clubs…
500 youth…50 events…
60 volunteers
Partnering with schools,
businesses, civic clubs…
Research Base90% of jobs require STEM skills
50% of local teachers cited need for
STEM
90% of jobs require STEM skills
50% of local teachers cited need for
STEM
![Page 20: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/20.jpg)
Report Elementscomponents of a formal report
AccountabilityEvidence of
Merit and
Worth
Evidence of
Merit and
Worth
Opportunity
Program Response
Impact
Problem/Need
Program
Details
Best Practice Strategy
Changes in Key Indicators
500 youth…50 events…
60 volunteers
Partnering with schools,
businesses, civic clubs…
500 youth…50 events…
60 volunteers
Partnering with schools,
businesses, civic clubs…
Research Base90% of jobs require STEM skills
50% of local teachers cited need for
STEM
90% of jobs require STEM skills
50% of local teachers cited need for
STEM
Survey: 82% of 345 youth…
Obs: 12 teams Excellent on Tech
Interview…
Records: Service, Training..
Survey: 82% of 345 youth…
Obs: 12 teams Excellent on Tech
Interview…
Records: Service, Training..
![Page 21: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/21.jpg)
Report Elementscomponents of a formal report
Try to describe
your own program
Evidence of
Merit and
Worth
Evidence of
Merit and
Worth
Opportunity
Program Response
Impact
Problem/Need
Program
Details
Best Practice Strategy
Changes in Key Indicators
500 youth…50 events…
60 volunteers
Partnering with schools,
businesses, civic clubs…
500 youth…50 events…
60 volunteers
Partnering with schools,
businesses, civic clubs…
Research Base90% of jobs require STEM skills
50% of local teachers cited need for
STEM
90% of jobs require STEM skills
50% of local teachers cited need for
STEM
Survey: 82% of 345 youth…
Obs: 12 teams Excellent on Tech
Interview…
Records: Service, Training..
Survey: 82% of 345 youth…
Obs: 12 teams Excellent on Tech
Interview…
Records: Service, Training..
![Page 22: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/22.jpg)
Report Elementscomponents of a formal report
Accountability
Opportunity
Program Response
Impact
Challenges
New Opportunities
Enhancements
Appendices
Problems,
Details,
Evidence
Obstacles,
Adjustments
Difficult Experiences30% had no transportation…
When the budget was cut…\
30% had no transportation…
When the budget was cut…\
Conclusions
Support
Materials
Program
Details
![Page 23: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/23.jpg)
Report Elementscomponents of a formal evaluation
Accountability
Opportunity
Program Response
Impact
Challenges
New Opportunities
Enhancements
Appendices
Problems,
Details,
Evidence
Obstacles,
Adjustments Implications
Advanced training is needed…
Organization policy change…
Advanced training is needed…
Organization policy change…
Difficult Experiences30% had no transportation…
When the budget was cut…\
30% had no transportation…
When the budget was cut…\
Conclusions
Support
Materials
Program
Details
![Page 24: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/24.jpg)
Report Elementscomponents of a formal evaluation
Accountability
Opportunity
Program Response
Impact
Challenges
New Opportunities
Enhancements
Appendices
Problems,
Details,
Evidence
Obstacles,
Adjustments Implications
Illustrations
Advanced training is needed…
Organization policy change…
Advanced training is needed…
Organization policy change…
Difficult Experiences30% had no transportation…
When the budget was cut…\
30% had no transportation…
When the budget was cut…\
As shown in the Table …
One participant said…
Pictured in the photo are…
As shown in the Table …
One participant said…
Pictured in the photo are…
Conclusions
Support
Materials
Program
Details
![Page 25: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/25.jpg)
Report Elementscomponents of a formal evaluation
Accountability
Opportunity
Program Response
Impact
Challenges
New Opportunities
Enhancements
Appendices
Problems,
Details,
Evidence
Obstacles,
Adjustments Implications
Illustrations
Advanced training is needed…
Organization policy change…
Advanced training is needed…
Organization policy change…
Difficult Experiences30% had no transportation…
When the budget was cut…\
30% had no transportation…
When the budget was cut…\
As shown in the Table …
One participant said…
Pictured in the photo are…
As shown in the Table …
One participant said…
Pictured in the photo are…
Conclusions
Support
Materials
Program
Details
Additional Materials Program History… Organizational
Chart…
Detailed Budget…
Program History… Organizational
Chart…
Detailed Budget…
![Page 26: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/26.jpg)
Report Elementscomponents of an detailed evaluation
So what would you
add to your report?
Opportunity
Program Response
Impact
Challenges
New Opportunities
Enhancements
Appendices
Problems,
Details,
Evidence
Problems,
Adjustments Implications
Illustrations
Advanced training is needed…
Organization policy change…
Advanced training is needed…
Organization policy change…
Difficult Experiences30% had no transportation…
When the budget was cut…\
30% had no transportation…
When the budget was cut…\
As shown in the Table …
One participant said…
Pictured in the photo are…
As shown in the Table …
One participant said…
Pictured in the photo are…
Conclusions
Support
Materials
Program
Details
Additional Materials Program History… Organizational
Chart…
Detailed Budget…
Program History… Organizational
Chart…
Detailed Budget…
![Page 27: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/27.jpg)
Evaluation and Researchpaws for thought
Research
Discovery of Knowledge
Evaluation
Evidence for Effectiveness
![Page 28: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/28.jpg)
Evaluabilityis this the right time to ask?
Missing the Mark…or the Data
![Page 29: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/29.jpg)
Focusingwhat difference was intended?
IndicatorsLevelPriorityPrecision
![Page 30: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/30.jpg)
Big P, little Pwhat did you expect?
Big picturePurpose-drivenCommunity-drivenEvidence-drivenDriven to completion
![Page 31: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/31.jpg)
Mapping Evaluationenjoying the journey
Program Plan of WorkLogic ModelQuality and OutcomesPurposes of Evaluation
![Page 32: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/32.jpg)
Mapping Evaluationenjoying the journey
Program Plan of WorkLogic ModelQuality and OutcomesPurposes of Evaluation
![Page 33: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/33.jpg)
The End
Bye
![Page 34: It is my business to locate trouble… Making Evaluation Work.](https://reader035.fdocuments.net/reader035/viewer/2022070409/56649e7d5503460f94b8099c/html5/thumbnails/34.jpg)
Reportingwhat do you have to say for yourself?
Annual Report: Program Impact