The benefits of Evidence-based Training Captain Michael ... Varney.pdf · Captain Michael Varney...

18
Managing Risk through Training The benefits of Evidence-based Training Captain Michael Varney FRAeS President EBT-Foundation

Transcript of The benefits of Evidence-based Training Captain Michael ... Varney.pdf · Captain Michael Varney...

Managing Risk through Training

The benefits of Evidence-based Training

Captain Michael Varney FRAeS President

EBT-Foundation

Today’s menu?

Evidence-based Training Foundation © 2015

Excellence

Evidence-based Training Foundation © 2015

Today’s menu

Evidence-based Training Foundation © 2015

Does one-size fit all?

Evidence-based Training Foundation © 2015

EBT Working group

Evidence-based Training Foundation © 2015

New references for EBT

Applicability 3rd May 2013

Evidence-based Training Foundation © 2015

Comparison by aircraft generation Fatal accident rate – 4Q 2011

0

1

2

3

0 10 20 30 40

3rd generation 4th generation

2nd generation

Sources: Ascend, Airbus

Years of operation

Fatal accident per million departures 2nd generation:

2nd jet generation

3rd generation:

Glass-cockpit

Nav display

FMS

4th generation:

FBW

Flight Envelope

Protection

further improvement ?

Evidence-based Training Foundation © 2015

Competency development

Session 1

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

Task/condition/standard

S

essio

n 2

Sessio

n 3

Sessio

n 4

Sessio

n 5

Sessio

n 6

Competencies tool shop

Tasks

66 Performance

indicators

Evidence-based Training Foundation © 2015

EBT – data analyses

Evidence-based Training Foundation © 2015

Evidence example

TEM indicator: Average number per flight

Outstanding leadership and communication

Good leadership and poor communication

Poor leadership and communication

Threats

Mismanaged threats

Errors

Undesired aircraft states (UAS)

LOSA observer ratings for captain leadership and communication

4.9 4.3 5.0

1.4

0.7 1.1

2.3 5.6 7.0

0.4

0.3

1.8

Evidence-based Training Foundation © 2015

Ob

ject

ive

Co

nd

uct

Manoeuvres

Validation (Training)

Train manoeuvre

skills

to proficiency

e.g. “V1 cut”

All engine Go -

around (New)

EBT Training Phases

Evaluation

Assess competence

Identify

training needs

Line Orientated

Evaluation

Scenario Based

Training

Develop resilience,

learning by

exposure

Line-orientated

training

Evidence-based Training Foundation © 2015

ICAO Doc 9868 PANS-TRG Applicability 3rd May 2013

ICAO Doc 9995 Manual of EBT Applicability 3rd May 2013

IATA EBT Data Report July 2013

EBT Implementation Guide June 2013

FAA Endorse transition from AQP

EASA EBT Task Group Q1-2 2015

CAAC CCAR 121 R4

EBT – Current status

Evidence-based Training Foundation © 2015

EBT Implementation

Evidence-based Training Foundation © 2015

“In a breakthrough that I would not have expected for years, the International Civil Aviation Organization (ICAO) has approved provisions for evidence-based training (EBT) in ICAO Standards and Recommended Practices…”

“Credit goes to some extraordinary work done by a range of people and organizations

that came together faster and better than anyone expected…”

Bill Voss (2013) President Flight Safety Foundation

Evidence-based Training Foundation © 2015

Summary

Continually examine the

evidence

Measure performance

effectively

Learn through exposure

Learn from positive

performance

Continuous improvement

Evidence-based Training Foundation © 2015

EBT Foundation

Captain Steve Chealander – ex NTSB Board Member / American Airlines Carey Edwards – Managing Director LMQ Ltd Captain Iain Gunther – FDA specialist / Airbus Lars Fucke – Research and Development Engineer / Boeing Captain Dieter Harms – CEO Harms Consulting Captain Simon Henderson PhD (Manager Standards Virgin Australia) Barbara Mahwin PhD – Human Factors & Fatigue / Neuroscience specialist Professor Patrick Murray – Griffith University / LOSA Collaborative Jari Nisula – CEO Risk In Motion David Robinson PhD – Head of Statistics University of Minnesota Captain John Scully – Head of EBT Data Analyses Captain Michael Varney – EBT Project Leader Captain Simon Wood – Virgin Atlantic / Coventry University

Evidence-based Training Foundation © 2015