Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk...
Transcript of Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk...
![Page 1: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/1.jpg)
Page 1
Strategic Risk Management using Bow-Tie Risk Models
Air France Safety Risk Management
Stephane CARRERES – Corporate Risk manager Yvan BOISHU – Corporate Safety Manager
![Page 2: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/2.jpg)
Page 2
Air France key figures 2013 Worldwide network
• 78 millions passengers
• 800 flights per day
• 69 000 employees
• 242 aircraft
• 243 airports (AF/KL)
![Page 3: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/3.jpg)
Page 3
Integrated Management System Reports 2013
36 000 Reports 15 000 Safety Reports
![Page 4: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/4.jpg)
Page 4
All involved (Safety Culture) IMS or SMS Participative dimension One common reporting tool Be reactive Investigation, analysis,
corrective action, feedback Be proactive Safety barriers Risk model Risk factors – Safety Issues,.
Be Predictive How to anticipate them ?
Need for IMS, SMS
![Page 5: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/5.jpg)
Page 5
Time boxing project and now on
AF only Safety model Training Too rich… Reactive, not enough proactive Transversal IMS orientated
Aviation Industry approach : Bow tie Barrier performances monitoring (KPI) Extend data register to Audits, FDM, ATQP, LOSA…
2 years…
Coming soon…
![Page 6: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/6.jpg)
Page 6
Proactive
Reactive Predictive
Risk Management Process
Occurrence Management Change Management Hazard
Identification
Continuous Improvement
Event analysis Significant failure of a barrier Event Risk Classification (lagging indicators) Immediate action or conservatory measure
Barrier management with Bow Ties (leading indicators)…coming soon Safety surveys considering Safety Issues with actual hazard Proactive action plans
Change is a potential hazard Predictive risk analysis with experts round tables Predictive action plans
How is the new reality after the change ?
Probabilité d'accident
1,E-01 Très
probable Secure Improve Stop Stop Stop 1,E-02 1,E-03
Probable Monitor Secure Improve Stop Stop 1,E-04 1,E-05
Peu probable Monitor Monitor Secure Improve Stop 1,E-06 1,E-07 Très
peu probable Monitor Monitor Monitor Secure Improve 1,E-08 1,E-09
Improbable Monitor Monitor Monitor Monitor Secure 1,E-10
Négligeable Mineur Modéré Majeur Catastrophique
Gravité
1,E-01 1,E-03 1,E-05 1,E-07 1,E-09
![Page 7: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/7.jpg)
Page 7
Occurrence management process One tool : reporting, dispatching, analyzing, investigating, reacting, anticipating…
VIDEO
![Page 8: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/8.jpg)
Page 8
Safety Risk Management Process Dispatching
![Page 9: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/9.jpg)
Page 9
Safety Risk Management Process SMI Risk Allocation and Assessment
![Page 10: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/10.jpg)
Page 10
ERC : ARMS methodology
Risk tolerable : Risk analysis necessary
Risk acceptable : Data register
Risk unacceptable : Immediate action, conservatory measures and safety Issue risk assessment
Safety expert round table
Corporate weekly meeting (RX2)
2D Vision (scenario of accident and remaining barriers)
![Page 11: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/11.jpg)
Page 11
![Page 12: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/12.jpg)
Page 12
Event register and global risk assessment
Unsafe state
Control Barriers
Undesired event
Recovery Barriers
Consequence
Systemic Risk Level
(estimated)
![Page 13: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/13.jpg)
Page 13
Global Risk assessment eCARE
Threat frequency
Probability of control barrier failure
Probability of recovery barrier failure
Systemic Risk Level
3D Vision
![Page 14: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/14.jpg)
Page 14
eCARE New Generation 2015
• Bow Tie
• Barrier management
• Facilitated analysis
• Flight safety lagging and leading indicators
• Fully integrated ERC
• Full cooperation (Arms, ETQ, Bow Tie XP and you !!! …)
Human factors
Technical factors
SMS automation with eCARE* * ETQ reliance = AF eCARE
![Page 15: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/15.jpg)
Page 15
The Risk Question Q
ua
lity
Re
po
rts
Tech
nic
al
Dat
a
Au
dit
R
ep
ort
s
Insp
ect
ion
s
Qu
alit
y R
evi
ew
s
Inve
stig
atio
n
Re
po
rts
Tra
inin
g St
atu
s
Ext
ern
al
Au
dit
s
Ma
inte
na
nce
R
ep
ort
s ?
What does all this “small stuff” tell you about the risk of the “big stuff”?
![Page 16: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/16.jpg)
Page 16
A Strategic Approach to Risk
16
Strategic Risk Management •Timeframe annual •Major Risks – Safety, Quality, Compliance •Update BowTie Models
Tactical Risk Management •Timeframe months •Risk Dashboard Trends •Focussed action
Event Risk Management •Response – investigate or add to data? •What does this event add to the picture?
![Page 17: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/17.jpg)
Page 17
Safet
y Re
ports
Fligh
t Data
Audit
Re
ports
Confi
dent
ial
Repo
rts
Safet
y Co
mmitt
ees
Inves
tigati
on
Repo
rts
Majo
r Glob
al Ev
ents
Exter
nal
Audit
s
Corre
ctive
Ac
tions
Organisational Learning Engine
Data Taxonomy
Engine
Internal Data (Small Stuff) Global Experience (Big Stuff)
BowTie Risk Models
Runway Excursion - TO
Loss of Control in Flight
Runway Excursion - Landing
Controlled Flight Into Terrain
In-Flight Fire
Mid-Air Collision
Turbulence Injury
Threats
Controls
Distraction
Bird Hazard
AC Malfunction
Runway State
Weather
ATC
Weight and Balance
Threat Drivers
A320 A330 A340 B747 B777
Procedures
Competence/Training
Hardware
Software
Control Framework
Risk Dashboards
Global picture
![Page 18: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/18.jpg)
Page 18
Other Sources : Audit, Flight Data Monitoring, LOSA,
ATQP…
investigate or add to data ?
20% Significant events
=> reactive process
80% Precursors, weak
signals (black ones) => Data
Input only
Safety Issues => Safety Survey
and recommendation
Investigations Action plans
Air France 15 000
Safety Reports per Year
The AF “Small” Stuff
monitoring leading indicators (barriers)
![Page 19: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/19.jpg)
Page 19 19
Control Framework • Process Design • Testing • Training • Equipment • Software • Policies &
Procedures • Maintenance
Air France project : “Safective” • Project team structure • 2 consultants + 1 full time trainee • 5 operational division and the Corporate level involved • More than 1 year project to go from actual Risk model to Bow Tie • IT needs, CGE/ETQ/Aloft help, Industry (Arms and SMICG…) • Process review • Training, testing…
Bow-Ties Project
![Page 20: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/20.jpg)
Page 20
Flight Safety Risk Management is mainly focused on significant 7 1st idea : Flight Ops culture
Generic Bow-Ties
Bow Tie in a corporate approach within Air France
Fine but not enough : Flight Safety depends on all operational departments in Flight
Ops, Cabin
Ground Ops, Cargo,
Maintenance, Operations Control Center
Each department shall describe its own operational processes in
the Bow-Ties Operational Division BOW-Ties
![Page 21: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/21.jpg)
Page 21
2014 Bow-Ties set up : coordinate operational divisions
Help divisions describe their own risk-based processes Coordinate the bow-ties at the corporate level to make sense
Flight Ops process
Ground Ops process
LDS / NOTOC not reflecting actual
loading at doors closed
Take Off misconfiguration or
outside performance assumption
![Page 22: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/22.jpg)
Page 22
and Risk Assessment !!
……….
Flight Ops process
Ground Ops process
Facilitate safety culture and safety communication
![Page 23: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/23.jpg)
Page 23
AF Ground Ops 9.5 : Load sheet / NOTOC incorrect at doors closed : not reflecting actual load or not taking into account aircraft operational limits)
![Page 24: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/24.jpg)
Page 24
Data Inputs
Threat Rates
Consequence Rates
Control Failures
Recovery Activation UOS
Risk Register
Data Taxonomy Based on BowTie Models
Threat Risk Control
Risk Control
Risk Control
Undesired Operational
State
Recovery Control
Recovery Control
Recovery Control
Recovery Control
Recovery Control
Recovery Control
Risk Control
Risk Control
Risk Control
Risk Control
Risk Control
Risk Control
Consequence
Recovery Control
Recovery Control
Safety System and Culture Threats
Threat
Threat
Consequence
Consequence
Consequence
![Page 25: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/25.jpg)
Page 25
Bowtie XP Integration
Risk Item document Hazard/Top event Threats Consequences Controls Escalation Factors
CGE Bow Tie And
eCARE Reliance
![Page 26: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/26.jpg)
Page 26
Risk Item document
Risk Classification
Threats
Hazard description and classification
Threat 1, 2, 3… Preventive Controls… / Escalation Factors
Consequences
Consequence 1, 2, 3… Recovery Controls… / Escalation Factors
In eCARE but with CGE interface
![Page 27: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/27.jpg)
Page 27
Event document
Event Risk Classification
Effectiveness of Controls
Event description and classification
Safety, Security or
Safety Issue
Hazard : Consequence: Recovery Control
Hazard : Threat : Preventive Control
Risk Assessment
Corrective Action Alert
Severity of Most Credible Consequence
Overall Effectiveness of Remaining Controls
Likelihood of reaching consequence
Risk Level
ERC Arms Methodology
Air France participation
![Page 28: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/28.jpg)
Page 28
Risk Dashboards (Leading and Lagging indicators)
Runway Excursion - TO
Loss of Control in Flight
Runway Excursion - Landing
Controlled Flight Into Terrain
In-Flight Fire
Mid-Air Collision
Turbulence Injury
Threats
Controls
Distraction
Bird Hazard
AC Malfunction
Runway State
Weather
ATC
Weight and Balance
Threat Drivers
Risk Trends Barriers Management
![Page 29: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/29.jpg)
Page 29
Audits
Incidents reports analysis
Investigations
LOSA ATQP
FDM
Continuous monitoring with all operational data
EDS
![Page 30: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/30.jpg)
Page 30
Air France Corporate risk model : Bow-Ties Shared and Spread with the industry (SMICG, Webinar…) Tool for investigation and event analysis Easier risk assessment Barrier management (KPI), leading indicators Integrate Audits, LOSA, FDM, ATQP, Reports with HF Training and comprehensive material Collaborative work with editors and consultants Full SMS Dashboard
Perspective 2015
Bow-Ties Model Our expectations…
![Page 31: Strategic Risk Management using Bow-Tie Risk Models · PDF filePage 1 Strategic Risk Management using Bow-Tie Risk Models Air France Safety Risk Management Stephane CARRERES – Corporate](https://reader034.fdocuments.net/reader034/viewer/2022051508/5aa020777f8b9a0d158db63a/html5/thumbnails/31.jpg)
Page 31
Safety Culture
Just and Fair
Collective Memory
Great but let’s not forget …