Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be...
Transcript of Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be...
![Page 1: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/1.jpg)
Fecha
Titulo
1
Quantifying Air Traffic Controller Mental Workload
Nicolas Suarez [email protected]
Patricia López [email protected]
Eva Puntero [email protected]
Sara Rodriguez [email protected]
![Page 2: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/2.jpg)
FechaTitulo 2
![Page 3: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/3.jpg)
Index
FechaTitulo 3
2. Modelling ATCo workload
1. Introduction
5. Conclusions
3. Workload Analysis Component (WAC)
4. Validation
![Page 4: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/4.jpg)
Air Traffic Complexity
Mental Workload
INTRODUCTION
Fecha
Titulo
4
![Page 5: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/5.jpg)
Basic Concepts
• Difficulty perceived byATCo
Air Traffic Complexity
• Ability to perceive and respond to variables
• Prior experience
• Prior developed personal constructs
ATCo Mental Complexity
• Mental structures used to interpret & respond
• How each one relates, overlaps & influences the others determines cognitive complexity
Personal constructs
![Page 6: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/6.jpg)
How do we define complexity
FechaTitulo 6
Currently:
• “…measure of the difficulty that a particular traffic situation will present to an air traffic controller…”
SESAR• “number of simultaneous or near-
simultaneous interactions of trajectories in a given volume of airspace” Factors impacting complexity:
• Geometrical nature of the air traffic
• Operational procedures and practices used to handle the traffic
• Characteristics and behaviour of individual controller
![Page 7: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/7.jpg)
Two basic hypotheses
FechaTitulo 7
Complexity inside a sector is a function of
the ATCo mental workload
Assessing the ATCo mental workload inside a sector will provide an
estimation of the associated complexity
![Page 8: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/8.jpg)
What is ATCo Mental Workload?
The ATCo Mental Workload Framework
Multiple Resource Workload Model (MWM)
Experimental system
MODELLING ATCO WORKLOAD
Fecha
Titulo
8
![Page 9: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/9.jpg)
Primitive Operator Tasks
9
Visual & Auditory Processing
Visual Auditory
Fixate
Object
Track
Object
Search
with
pattern
Scan
with
pattern
Listen
Monitor
Audio
Signal
Perception (Visual & Auditory)
Compre-hension
Strategic Thinking
Decision Making
Responding (Manual &
Verbal)
Human Behavior can be represented/segmented in Primitive Operator Tasks
C. D. Wickens, “Multiple Resources and Mental Workload,” Hum. Factors J. Hum. Factors Ergon. Soc., vol. 50, no. 3, pp. 449–455, Jun. 2008.
![Page 10: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/10.jpg)
Primitive Operator Tasks
10
Central Processing
Comprehension Strategic Thinking Decision Making
Recall Recognise Select Compare Compute Decide
Perception (Visual & Auditory)
Compre-hension
Strategic Thinking
Decision Making
Responding (Manual &
Verbal)
Human Behavior can be represented/segmented in Primitive Operator Tasks
C. D. Wickens, “Multiple Resources and Mental Workload,” Hum. Factors J. Hum. Factors Ergon. Soc., vol. 50, no. 3, pp. 449–455, Jun. 2008.
![Page 11: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/11.jpg)
Primitive Operator Tasks
11
Perception (Visual & Auditory)
Compre-hension
Strategic Thinking
Decision Making
Responding (Manual &
Verbal)
Responding Processing
Manual Verbal
Reach
Object
Press
with
foot
Move
with
pattern
Grasp TouchPush &
holdWrite Type ……
Say a
message
Human Behavior can be represented/segmented in Primitive Operator Tasks
C. D. Wickens, “Multiple Resources and Mental Workload,” Hum. Factors J. Hum. Factors Ergon. Soc., vol. 50, no. 3, pp. 449–455, Jun. 2008.
![Page 12: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/12.jpg)
What is workload?
Required psychological
resources
Available psychological
Resources
Workload
Task load
![Page 13: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/13.jpg)
FechaTitulo 13
Demanded Mental Resources (Task Load):
• Physical and mental activities demanded to carry out perceptual actions, cognitive actions and motor skills
• Empirical research and psychological theories of human cognitive processes
Available Mental Resources:
• Physical and mental abilities (perceptual actions, cognitive actions and motor skills) that an ATCohas available to provide the control service
• Psychological factors (e.g. fatigue, stress) shape the available resources
Threshold:
• Value beyond which Demanded Mental Resources (Task Load) exceeds the Available Mental Resources
![Page 14: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/14.jpg)
Underload
How a Controller does it
Operating modes
What aircraft do
What a Controller needsto do
Demanded Mental Resources (Task Load)
Ava
ilab
le M
enta
l Res
ou
rce
s
Flight Events
Control Events
Situ
atio
na
l A
war
enes
s
Dec
isio
n
Mak
ing
Re
spo
nse
Overload
Operating Concept
Threshold
Mental Workload Framework
![Page 15: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/15.jpg)
This is nice, but how do we use it?
FechaTitulo 15
Identification of flight events
Identification of control events • Required cognitive
channels
• Interference matrix
• Resolution of the Matrix
Multiple Resources Workload Model
algorithm (MWM)
Develop an experimental system that is able to estimate the workload
![Page 16: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/16.jpg)
FechaTitulo 16
Flight Event Layer:
• Identification & use of flight events
• Traffic demand / Traffic data or sector configuration data
• Aircraft behaviourwithin a specific airspace
Controller Event Layer:
• Actions expected from an ATCo
• e.g. solve conflict
Cognitive Process Layer:
• Manner in which an ATCo performs a specific action
• Operating concept
• Mental processes required to perform said actions
![Page 17: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/17.jpg)
![Page 18: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/18.jpg)
What is WAC?
Use of WAC
WORKLOAD ANALYSIS COMPONENT (WAC)
Fecha
Titulo
18
![Page 19: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/19.jpg)
Workload Analysis component
Stand alone workload estimation and measurement
Calculates workload per sector / volume
![Page 20: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/20.jpg)
A sample application of WAC
FechaTitulo 20
![Page 21: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/21.jpg)
Use of mental workload to estimate sector capacity
Assessment of the coherency of mental workload results through the comparison of Predicted and Perceived Workload
Further work
VALIDATION
Fecha
Titulo
21
![Page 22: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/22.jpg)
Validating the model
Not easy
Difficult to measure the actual workload
Using indirect methods to perform the validation
• Use of Mental Workload to Estimate Sector Capacity
• Assessment of the coherency of mental workload results through the comparison of Predicted and Perceived Workload
![Page 23: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/23.jpg)
Use of mental workload to estimate sector capacity
FechaTitulo 23
•Representative sample of actual traffic
•Use WAC component to estimate capacity
Estimate actual capacity using
workload
Access data base to identify actual capacity •Similar or Equal
workload assessment were accurate
•Different workload assessment were accurate
Compare both values
![Page 24: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/24.jpg)
Assessment of the coherency of mental workload results through the comparison of Predicted and Perceived Workload
Record ISA (Instantaneous Self Assessment)
• Normalized values
Calculate workload using WAC
Issues
• Low correlation (R = 0.75, p = 0.35)
0
20
40
60
Cognitive WL ISA WL
FechaTitulo 24
0
20
40
60
Cognitive WL ISA WL
Causes:
• Time shift
• Need to improve calibration of non-nominal events
With correction
• Strong correlation (R = 0.93, p = 0.14)
![Page 25: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/25.jpg)
Do we think that the validation work is completed?
SESAR EXE-04.07.01-VP-003 Resolving complexity by dynamic management of airspace
• December 2014
FechaTitulo 25
R 0,908 0,908 0,904 0,927 0,741 0,910 0,774
p 0,003 0,002 0,002 0,009 0,035 0,002 0,024
R 0,894 0,878 0,934 0,934 0,818 0,656
p 0,003 0,004 0,001 0,001 0,013 0,077
R 0,902 0,858 0,858 0,840 0,819
p 0,002 0,006 0,006 0,009 0,001
Ha, Kim and Seong (2006)
Physiological measures Subjective Measures
Correlat ion fac tors
EXPERIMENT RESULTS BETWEEN WORKLOAD MEASURES
Eye closure
fraction
Blink
duration
Number of
fixation on
Regions
Fixation time on
Regions
Fixation-related parameters Blink-related parameters
Informat ion f low rate
NASA-TLX
MCH score
NASA-TLX MCH scoreBlink
frequency
NO
![Page 26: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/26.jpg)
Estimating complexity
How to improve the model
CONCLUSIONS
Fecha
Titulo
26
![Page 27: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/27.jpg)
Estimating complexity
Key enabler for several SESAR concepts
Using workload as an indicator of air traffic
complexity
Mental Workload framework:
•Demanded resources
•Available resources
•Thresholds.
Workload estimation algorithm (MWM)
Workload Analysis Component (WAC)
![Page 28: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/28.jpg)
Validation
FechaTitulo 28
On-going
Needs to be improved
• More calibration experiments
• Identifying more direct workload methods
Results
• Workload estimations are accurate
• Useful for ATM
• Suggest relationship between perceived & predicted mental workload
But…
• Improvements must be made on both the framework and the algorithm
![Page 29: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/29.jpg)
Areas of improvement
FechaTitulo 29
Introducing psychological factors
(fatigue, stress & emotion)
Introducing dynamic thresholds
Enhancement of the operating mode
definition
Impact of system automation features
Full development and integration of situational awareness and decision
making processes
![Page 30: Quantifying Air Traffic Controller Mental Workload 2014... · Verbal) Human Behavior can be represented/segmented in Primitive Operator Tasks C. D. Wickens, “Multiple Resources](https://reader030.fdocuments.net/reader030/viewer/2022040809/5e4e8bca634a642c80494214/html5/thumbnails/30.jpg)
FechaTitulo 30
Centro de Referencia I+D+i ATM