Evidence-Based Training Interventions that Reduce Aircrew Errors.
25
Evidence-Based Training Interventions that Reduce Aircrew Errors
Transcript of Evidence-Based Training Interventions that Reduce Aircrew Errors.
Evidence-Based Training Interventions that Reduce Aircrew
Errors
Why Evidence Based Training?
2
“One way of looking at this might be that, for 42 years, I’ve been making small regular deposits in this bank of experience: education and training. And on January 15, the balance was sufficient so that I could make a very large withdrawal”
Captain Chesley “Sully” SullenbergerCBS Evening News, February 10, 2009
AFRL-Sponsored Research Study2007-2010
Phase One – Research top causal or major factors,1-year study
Phase Two – Design, develop, test new training methods2-year test and evaluation
Analyzed Three Sources of Data• Class A mishaps from 1995-2006• Delphi Panel of War-Fighter Experts• Review Training Records (305)
Common Human Factor Deficiencies
• Channelized Attention• Task Mis-prioritization• Selecting an Inappropriate Course of
Action• Poor Crew Coordination
Training Interventions• Enhanced Academics (EA)
Immersive multi-media, interactive, facilitated case studies
• Web-Based Interactive Case Histories (ICH) Four dedicated, in-depth case studies
• Game-Based Multi-task Trainer (MTT) Personal skills trainer
• Serious Gaming Team Trainer (TT) Cooperative and competitive space-based game
Evaluation Methodology
Enhanced Academics (EA)
Enhanced Academics
EA ResultsLevel I: Avg 4.4 out of 5.0Level II: Statistically significant
Pretest Posttest4
4.5
5
5.5
6
6.5
PilotsSensors
EA ResultsLevel III: Statistically significant
Attentio
n
Priorit
izatio
n COA
Coordinati
on0
1
2
3
4
5
6
7
8
9
10
CO-3
Attention Prioritization COA Coordination0
1
2
3
4
5
6
7
8
9
10
EPE
Interactive Case History (ICH)
ICH ResultsLevel I: Pilots split, however,
Sensor overwhelmingly supported
Level II: Statistically significant learning for both Pilot and Sensor, however, more impactful for the Sensor
Level III: No statistical difference
Multi-task Trainer (MTT)
MTT Results
Level I: Moderately useful – pilots mostlyLevel II: Evidence of learning occurredLevel III: Positive direction for Sensors,
however, no statistical significance
Skill Based Exercise
• GemaSim Team Trainer Have to employ all skills in a serious game under stress How you operate under stress is real life Capstone to eLearning Proven improvement in CRM skills 6-8 weeks after
training
16
Team Trainer in Action
Team Trainer Results
Level I: Highest of all interventions (4.7)Level II: Significant learning in all four skillsLevel III: Significant reductions in negative behaviors
Level III Results
Attention Task COA Coordination0
1
2
3
4
5
6
7
8
9
10
EPEEPE ControlSpiral 1Spiral 4
Attention Task COA Coordination0
1
2
3
4
5
6
7
8
9
10
CO-3C03 ControlSpiral 1Spiral 4
For Lasting Change of Behavior
20
Knowledge + Skill Exercise + Booster Training = True Learning
Enhanced Academics (EA)
eLearningDesign for Learning!
22
• Knowledge and skill• Scenario based
cases• Critical decision
making• Branching
outcomes• 24/7
“The best that can be said about most eLearning is that it gives you the sensation of a coma without the
worry or inconvenience!”
Skill Based Exercise
• GemaSim Team Trainer Have to employ all skills in a serious game under stress How you operate under stress is real life Capstone to eLearning Proven improvement in CRM skills 6-8 weeks after
training
23
Booster Training
• Incorporate CRM Behavior Markers into sim & checkride events – Culture change
• “Booster” events for increased retention• 2 days• 2 weeks• 2 months
