Training Evaluation - PPT 6
-
Upload
morjagdish -
Category
Documents
-
view
447 -
download
0
Transcript of Training Evaluation - PPT 6
![Page 1: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/1.jpg)
6 - 1
Training Evaluation
![Page 2: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/2.jpg)
1. Explain why evaluation is important.2. Identify and choose outcomes to
evaluate a training program.3. Discuss the process used to plan and
implement a good training evaluation.
4. Discuss the strengths and weaknesses of different evaluation designs.
6 - 2
![Page 3: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/3.jpg)
5. Choose the appropriate evaluation design based on the characteristics of the company and the importance and purpose of the training.
6. Conduct a cost-benefit analysis for a training program.
6 - 3
![Page 4: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/4.jpg)
Walgreen Company wanted to determine if the time, money, and effort devoted to training technicians actually made a difference. It was interested in assessing the
effectiveness of the training program.
6 - 4
![Page 5: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/5.jpg)
Training effectivenessTraining effectiveness refers to the benefits that the company and the trainees receive from training.
Training outcomes or criteriaTraining outcomes or criteria refer to measures that the trainer and the company use to evaluate training programs.
Training evaluationTraining evaluation refers to the process of collecting the outcomes needed to determine if training is effective.
Evaluation designEvaluation design refers to from whom, what, when, and how information needed for determining the effectiveness of the training program will be collected.
6 - 5
![Page 6: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/6.jpg)
Companies are investing millions of dollars in training programs to help gain a competitive advantage.
Training investment is increasing because learning creates knowledge which differentiates between those companies and employees who are successful and those who are not.
6 - 6
![Page 7: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/7.jpg)
Because companies have made large dollar investments in training and education and view training as a strategy to be successful, they expect the outcomes or benefits related to training to be measurable.
6 - 7
![Page 8: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/8.jpg)
Formative evaluation –Formative evaluation – evaluation conducted to improve the training process.
Summative evaluation –Summative evaluation – evaluation conducted to determine the extent to which trainees have changed as a result of participating in the training program.
6 - 8
![Page 9: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/9.jpg)
To identify the program’s strengths and weaknesses.
To assess whether content, organization, and administration of the program contribute to learning and the use of training content on the job.
To identify which trainees benefited most or least from the program.
6 - 9
![Page 10: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/10.jpg)
To gather data to assist in marketing training programs.
To determine the financial benefits and costs of the programs.
To compare the costs and benefits of training versus non-training investments.
To compare the costs and benefits of different training programs to choose the best program.
6 - 10
![Page 11: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/11.jpg)
6 - 11
Conduct a Needs Analysis
Develop Measurable Learning Outcomes
Develop Outcome Measures
Choose an Evaluation Strategy
Plan and Execute the Evaluation
![Page 12: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/12.jpg)
LevelLevel CriteriaCriteria FocusFocus
1 Reactions Trainee satisfaction
2 Learning Acquisition of knowledge, skills, attitudes, behavior
3 Behavior Improvement of behavior on the job
4 Results Business results achieved by trainees
6 - 12
![Page 13: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/13.jpg)
6 - 13
Cognitive Outcomes
Skill-Based Outcomes
Affective Outcomes
Results
Return on Investment
![Page 14: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/14.jpg)
Cognitive OutcomesCognitive OutcomesDetermine the degree to which trainees
are familiar with the principles, facts, techniques, procedures, or processes emphasized in the training program.
Measure what knowledge trainees learned in the program.
Skill-Based OutcomesSkill-Based OutcomesAssess the level of technical or motor
skills. Include acquisition or learning of skills
and use of skills on the job.6 - 14
![Page 15: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/15.jpg)
Affective OutcomesAffective Outcomes Include attitudes and motivation.Trainees’ perceptions of the program
including the facilities, trainers, and content.
ResultsResultsDetermine the training program’s
payoff for the company.
6 - 15
![Page 16: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/16.jpg)
Return on Investment (ROI)Comparing the training’s monetary
benefits with the cost of the training. Direct costs Indirect costs Benefits
6 - 16
![Page 17: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/17.jpg)
Good training outcomes need to be: Relevant Reliable Discriminate Practical
6 - 17
![Page 18: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/18.jpg)
Criteria relevance –Criteria relevance – the extent to which training programs are related to learned capabilities emphasized in the training program.
Criterion contamination –Criterion contamination – extent that training outcomes measure inappropriate capabilities or are affected by extraneous conditions.
Criterion deficiency – failure to measure training outcomes that were emphasized in the training objectives.
6 - 18
![Page 19: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/19.jpg)
6 - 19
Relevance
Outcomes Identified by Needs Assessment and Included in Training Objectives
Outcomes Measured in Evaluation
DeficiencyContaminationOutcomes Related to Training Objectives
![Page 20: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/20.jpg)
Reliability –Reliability – degree to which outcomes can be measured consistently over time.
Discrimination –Discrimination – degree to which trainee’s performances on the outcome actually reflect true differences in performance.
Practicality –Practicality – refers to the ease with which the outcomes measures can be collected.
6 - 20
![Page 21: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/21.jpg)
Threats to validityThreats to validity refer to a factor that will lead one to question either: The believability of the study results (internal (internal
validity)validity), or The extent to which the evaluation results are
generalizable to other groups of trainees and situations (external validity)(external validity)
6 - 21
![Page 22: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/22.jpg)
Threats To Internal ValidityCompanyPersonsOutcome Measures
Threats To External ValidityReaction to pretestReaction to evaluation Interaction of selection and training Interaction of methods
6 - 22
![Page 23: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/23.jpg)
6 - 23
Pre- and Posttests
Use of Comparison Groups
Random Assignment
![Page 24: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/24.jpg)
Posttest – only
Pretest / posttest
Posttest – only with Comparison group
Pretest / posttest with Comparison group
Time series
Time series with Comparison group and Reversal
Solomon Four – group
6 - 24
![Page 25: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/25.jpg)
FactorFactor How Factor Influences Type of Evaluation DesignHow Factor Influences Type of Evaluation Design
Change potential Can program be modified?
Importance Does ineffective training affect customer service, product development, or relationships between employees?
Scale How many trainees are involved?
Purpose of training Is training conducted for learning, results, or both?
Organization culture Is demonstrating results part of company norms and expectations?
Expertise Can a complex study be analyzed?
Cost Is evaluation too expensive?
Time frame When do we need the information?
6 - 25
![Page 26: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/26.jpg)
To understand total expenditures for training, including direct and indirect costs.
To compare costs of alternative training programs.
To evaluate the proportion of money spent on training development, administration, and evaluation as well as to compare monies spent on training for different groups of employees.
To control costs.6 - 26
![Page 27: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/27.jpg)
1. Identify outcome(s) (e.g., quality, accidents)
2. Place a value on the outcome(s)3. Determine the change in performance
after eliminating other potential influences on training results.
4. Obtain an annual amount of benefits (operational results) from training by comparing results after training to results before training (in dollars)
6 - 27
![Page 28: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/28.jpg)
5. Determine training costs (direct costs + indirect costs + development costs + overhead costs + compensation for trainees)
6. Calculate the total savings by subtracting the training costs from benefits (operational results)
7. Calculate the ROI by dividing benefits (operational results) by costs.
The ROI gives you an estimate of the dollar return expected from each dollar invested in training.
6 - 28
![Page 29: Training Evaluation - PPT 6](https://reader033.fdocuments.net/reader033/viewer/2022061123/54759ad1b4af9f95118b45d2/html5/thumbnails/29.jpg)
Industry Training Program ROI
Bottling company Workshops on managers’ roles 15:1
Large commercial bank Sales training 21:1
Electric & gas utility Behavior modification 5:1
Oil company Customer service 4.8:1
Health maintenance organization
Team training 13.7:1
6 - 29