How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079
description
Transcript of How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079
![Page 2: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/2.jpg)
Huh? Why this topic?
![Page 3: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/3.jpg)
Top-ranked topics re: Program development
![Page 4: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/4.jpg)
Top-ranked topics re: Organizational development
![Page 5: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/5.jpg)
At www.abcee.org/pd/2010lc-resources…
![Page 6: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/6.jpg)
Your commitment (from your application to attend the Clinic…)
• We will create an action plan to accomplish the goal described above
• We will implement the action plan to the best of our ability
• We will evaluate the effectiveness of our action plan…
![Page 7: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/7.jpg)
This workshop will…
1. Show you a way in which you can plan your program (“logic model”)
2. give you the tools you need to see if your program is achieving results
• Why do #2?
![Page 8: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/8.jpg)
![Page 9: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/9.jpg)
Ever wondered this? “Does our environmental education program…”
• Increase knowledge?
![Page 10: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/10.jpg)
Ever wondered this? “Does our environmental education program…”
• Increase knowledge?• Build skills?
![Page 11: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/11.jpg)
Ever wondered this? “Does our environmental education program…”
• Increase knowledge?• Build skills?• Shift attitudes and values?
![Page 12: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/12.jpg)
Ever wondered this? “Does our environmental education program…”
• Increase knowledge?• Build skills?• Shift attitudes and values?• Change behaviours?
![Page 13: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/13.jpg)
Ever wondered this? “Does our environmental education program…”
• Increase knowledge?• Build skills?• Shift attitudes and values?• Change behaviours?• Improve the environment?
![Page 14: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/14.jpg)
Ever wondered this? “Does our environmental education program…”
• Increase knowledge?• Build skills?• Shift attitudes and values?• Change behaviours?• Improve the environment?• Create environmentalists?
![Page 15: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/15.jpg)
Question: Can all these things be measured?
• Increase knowledge?• Build skills?• Shift attitudes and values?• Change behaviours?• Improve the environment?• Create environmentalists?
![Page 16: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/16.jpg)
Answer: YES...
![Page 17: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/17.jpg)
Resource: “Measuring the Success of Environmental Education Programs”
![Page 18: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/18.jpg)
Logic model
“Now that I’ve written my logic model for my Education Program, I’ve got a single table that captures all the activities and the outputs, outcomes, and impacts that I hope to achieve.
Now whenever a board member or teacher asks me ‘What do you do?’ I can show them my plan on one sheet of paper.”
Jenn Hoffman,
Sierra Club of Canada, BC Chapter, 2002
![Page 19: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/19.jpg)
Logic model
![Page 20: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/20.jpg)
Metaphor: ‘Splash and Ripple’
![Page 21: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/21.jpg)
Booklet: page 19 - 23
![Page 22: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/22.jpg)
ACEE uses logic models everywhere!
![Page 23: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/23.jpg)
Give it a try!
![Page 24: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/24.jpg)
Indicators…
• Evidence that the program is producing expected results at the output and outcome levels. Definition on page 22.
• They can be expressed quantitatively and qualitatively
• Spell out who will do the collection and analysis of the data for each indicator (share responsibility!)
• See example in Booklet, page 29-30
![Page 25: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/25.jpg)
![Page 26: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/26.jpg)
Booklet, pages 33-40
How to measure…• Values shift• Behaviour change• Benefits to the environment
![Page 27: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/27.jpg)
Appendices, pg 44-66: Scavenger Hunt
On what page are the following located?• “Questionnaires and surveys:” description, and
design tips• Table summarizing pros and cons of evaluation
instruments• Questionnaire used by Sierra to determine teacher
satisfaction, post-program delivery.• Teacher Interview/Focus Group Questions• CPAWS questionnaire to measure changes in• students’ knowledge, attitudes, and behaviours
![Page 28: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/28.jpg)
Appendices, pg 44-66: Scavenger Hunt
On what page are the following located?• “Questionnaires and surveys:” description, and design tips
– pp 44-45• Table summarizing pros and cons of evaluation
instruments - pp 50-51• Questionnaire used by Sierra to determine teacher
satisfaction, post-program delivery. – pg 55• Teacher Interview/Focus Group Questions– pg 57• CPAWS questionnaire to measure changes in• students’ knowledge, attitudes, and behaviours – pp 60-62
![Page 29: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/29.jpg)
Thanks to our Sponsors!
![Page 30: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/30.jpg)
Give it a try…
![Page 31: How to plan your program, and evaluate its success Gareth Thomson Gareth@abcee; 403-678-0079](https://reader036.fdocuments.net/reader036/viewer/2022081520/56814f1c550346895dbcad63/html5/thumbnails/31.jpg)
Give it a try!