Evaluation of treatment for camptodactyly: retrospective ...
The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -
-
Upload
bonnie-harrison -
Category
Documents
-
view
219 -
download
0
Transcript of The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -
![Page 1: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/1.jpg)
The National Human Services Training Evaluation Symposium:
- A 10 Year Retrospective -
![Page 2: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/2.jpg)
10 Yrs of Picturesque Settings
The Faculty Club
![Page 3: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/3.jpg)
10 Years of Enlightening Presentations
![Page 4: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/4.jpg)
Looking back and moving forward……..
![Page 5: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/5.jpg)
1998: The First
In the beginning
![Page 6: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/6.jpg)
1999: The 2nd Annual
Keynote: Bernadette McCarthy—Using Training Evaluation to Improve Services
Program Examined: Training outcomes: performance monitoring Delphi Techniques Nominal Group Techniques Knowledge testing Promoting & evaluating skill development Using training to influence policy Levels of competence TOL
![Page 7: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/7.jpg)
2000: The 3rd Annual
Kirkpatrick’s model, but what about Level Four?
Keynote: Icebreaker on the first evening instead Program examined:
Evaluation of Interdisciplinary training: Child Welfare workers and supervisors
Strategic training evaluation Embedded evaluation TOL/measuring behavioral change Skills assessment
![Page 8: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/8.jpg)
2000
![Page 9: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/9.jpg)
2001: The 4th Annual
The year of “Affinity Action Groups”
Keynote: Dave Wegenast on “Return on Investment” of the Evaluation Symposium
Program examined: Assessing underlying competencies Models for evaluating core curriculum Evaluation of statewide training program The logic model Integration of TOL Evaluating group behavior Blackboard—E Learning
![Page 10: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/10.jpg)
2001
![Page 11: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/11.jpg)
2002: The 5th Annual
Outcomes in Child Welfare
Keynote: Mark Courtney–Evaluation in Child Welfare Services: Big Questions
Program examined: Training Evaluator Competency SPrA CPS system Compliance with practices standards Needs assessments
![Page 12: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/12.jpg)
2002
![Page 13: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/13.jpg)
2003: The 6th Annual
Measuring outcomes, the long and winding road…
Keynote: Elena Cohen—Getting the whole picture: The CFSR, Training and Frontline Practice Links
Program Examined: Chain of evidence Panel presentation on each of Kirkpatrick’s levels Project briefings
![Page 14: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/14.jpg)
2003
![Page 15: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/15.jpg)
2004: The 7th Annual
Improving Evaluation Capabilities
Keynote: Wayne Stevenson—Training as an Avenue to Support Practice Improvement
Program Examined: National Frameworks: National Evaluation of Child Welfare
Training & North American Certification Project TOL Staff Retention Organizational Culture
![Page 16: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/16.jpg)
2004
![Page 17: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/17.jpg)
2005: The 8th Annual
Expanding our horizons: Enhancing current methods, creating new methods…
Keynote: Eileen Gambrill Program Examined:
Future trends in child welfare training Addressing fairness & equity in training evaluation Training evaluation in large systems Linking training outcomes to children and families Instruments to measure skill acquisition Practice assessments in a large system
![Page 18: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/18.jpg)
2005
![Page 19: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/19.jpg)
2006 – The International House
![Page 20: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/20.jpg)
2006: The 9th Annual
Evidence-based training: What does it mean when we say training
is effective?
Keynote: Kurt Kraiger – Alternative Frameworks for Training Evaluation
Program Examined: How evaluation brings attention to gaps in training Teaching & training methods that contribute to knowledge
retention Logic models Measuring knowledge/skill Evaluating assumptions, values and beliefs
![Page 21: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/21.jpg)
2006
![Page 22: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/22.jpg)
2007: The Berkeley City Club
![Page 23: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/23.jpg)
2007: 10th Annual
Looking back and moving forward…
Keynote: Peter Watson—Training Evaluation as a tool for organizational development
Program Examines: Findings from the National Evaluation of Child Welfare
grants Measuring TOL Revisiting Level 1 The future of training evaluation Using tests to predict job performance Evaluation of training content
![Page 24: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/24.jpg)
Lessons Learned…(NSDTA Journal Article)
1. You can teach a turkey to climb a tree, but it's easier to hire a squirrel.
2. Effective utilization of training is influenced by individual, organizational, and training design factors.
3. Training evaluation can help administrators differentiate between training and non-training solutions.
![Page 25: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/25.jpg)
Lessons Learned, cont’d
4. We know what we don’t know.
5. Sometimes the training evaluation “tail” wags the training content “dog”.
6. Be careful what you wish for, the focus on outcomes cuts both ways.
![Page 26: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/26.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
![Page 27: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/27.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
Increased funding, value, and visibility of training and development
![Page 28: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/28.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
Increased funding, value, and visibility of training and development
Expanded roles and functions (e.g., NSDTA nine roles and competencies – the advent of the HSTD consultant) – HSTD as a career
![Page 29: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/29.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
Increased funding, value, and visibility of training and development
Expanded roles and functions (e.g., NSDTA nine roles and competencies – the advent of the HSTD consultant) – HSTD as a career
Increased accountability of child welfare/human services
![Page 30: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/30.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
Increased funding, value, and visibility of training and development
Expanded roles and functions (e.g., NSDTA nine roles and competencies – the advent of the HSTD consultant) – HSTD as a career
Increased accountability of child welfare/human services
Introduction of litigation into the HSTD arena
![Page 31: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/31.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
An increased understanding of the importance of transfer of learning without a substantial increase in evaluation efforts beyond the reaction/satisfaction level
![Page 32: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/32.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
An increased understanding of the importance of transfer of learning without a substantial increase in evaluation efforts beyond the reaction/satisfaction level
Technology – An increase in distance models and alternative delivery systems
![Page 33: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/33.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
An increased understanding of the importance of transfer of learning without a substantial increase in evaluation efforts beyond the reaction/satisfaction level
Technology – An increase in distance models and alternative delivery systems
Agency-University partnerships
![Page 34: The National Human Services Training Evaluation Symposium: - A 10 Year Retrospective -](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649e965503460f94b9a3a2/html5/thumbnails/34.jpg)
THE CHANGED NATURE OF HUMAN SERVICES TRAINING AND DEVELOPMENT
An increased understanding of the importance of transfer of learning without a substantial increase in evaluation efforts beyond the reaction/satisfaction level
Technology – An increase in distance models and alternative delivery systems
Agency-University Partnerships Development of the field and emerging profession of
HSTD (e.g., Code of Ethics, roles and competencies, journal, landmark events 10 years NHSTES & 20 years NSDTA conference)