EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental...
Transcript of EUROCONTROL · european organisation for the safety of air navigation eurocontrol experimental...
EUROPEAN ORGANISATIONFOR THE SAFETY OF AIR NAVIGATION
EUROCONTROL EXPERIMENTAL CENTRE
OBJECTIVE EVALUATION OF PHYSIOLOGICALBEHAVIOUR AND WORKLOAD
OF CONTROLLERS
EEC Report No. 339
Project HUM-7-E2
Issued: August 1999
The information contained in this document is the property of the EUROCONTROL Agency and no part should bereproduced in any form without the Agency’s permission.
The views expressed herein do not necessarily reflect the official views or policy of the Agency.
EUROCONTROL
REPORT DOCUMENTATION PAGE
Reference:EEC Report No. 339
Security Classification:Unclassified
Originator:EEC - IND
(INDependent Research)
Originator (Corporate Author) Name/Location:EUROCONTROL Experimental CentreBP1591222 Brétigny-sur-Orge CEDEXFRANCETelephone : +33(0) 1 69 88 75 00
Sponsor: Sponsor (Contract Authority) Name/Location:EUROCONTROL AgencyRue de la Fusée, 96B -1130 BRUXELLESTelephone : +32 (0)2 729 90 11
TITLE:OBJECTIVE EVALUATION OF PHYSIOLOGICAL BEHAVIOUR AND WORKLOAD
OF CONTROLLERS
Authors
P. Cabon, B. Farbos, S. Bourgeois-Bougrine,
R. Mollard,LAA, Université RenéDescartes - Paris V
Date
08/99Pages
xii + 64Figures
24Tables
3Annexes
1References
11
EATCHIP TaskSpecification
-
Project
HUM-7-E2
Task No. Sponsor Period
1999
Distribution Statement:(a) Controlled by: Head of IND(b) Special Limitations: None(c) Copy to NTIS: YES
Descriptors (keywords):ATC, RT Simulation, learning, fatigue, sleepiness, stress, workload, EEG, ERP, Sleep, Salivary Cortisol.
Abstract:
The MILAN 99 real-time Simulation, carried out at The EUROCONTROL Experimental Centre (EEC) inJanuary/February 1999 was concerned with the reorganisation of the Milan Terminal Management Area(TMA), in view of the opening of the new Malpenza Airport. Sleep logs, workload assessment and fatigueevaluation questionnaires were employed, with Event Related Potential for mental fatigue assessmentand salivary cortisol for workload and stress assessment on selected working positions.
Psychophysiological observations suggested that time of day and day within the week significantlyaffected fatigue and workload measures, so that subjective measures taken on, for example, Mondaymorning and the last day of the simulation may be distorted. Controllers’ experience in the specificworking positions should also be taken into account. Observations also suggested that adaptationcontinues well into the measured phase of such a simulation, and should be controlled or balanced injudging the conclusions.
This document has been collated by mechanical means. Should there be missing pages, please report to:
EUROCONTROL Experimental CentrePublications Office
B.P. 1591222 - BRETIGNY-SUR-ORGE CEDEX
France
v
SUMMARY
OBJECTIVE EVALUATION OF PHYSIOLOGICAL BEHAVIOUR AND WORKLOAD
OF CONTROLLERS
By
P. Cabon, B. Farbos, S. Bourgeois-Bougrine, R. Mollard,LAA, Université René Descartes - Paris V
The MILAN 99 real-time Simulation, carried out at The EUROCONTROL ExperimentalCentre (EEC) in January/February 1999, was concerned with the reorganisation of the MilanTerminal Management Area (TMA), in view of the opening of the new Malpenza Airport. EEChas carried out studies of psychophysiological methods in small-scale simulation, and ofcontrollers’ adaptation to altered interfaces in real-time Simulation (SweDen 98). In MILAN99 these methods were applied to an organisational simulation.
Sleep logs, workload assessment and fatigue evaluation questionnaires were employed, withEvent Related Potential for mental fatigue assessment and salivary cortisol for workload andstress assessment on selected working positions.
Psychophysiological observations suggested that time of day and day within the weeksignificantly affected fatigue and workload measures, so that subjective measures taken on,for example, Monday morning and the last day of the simulation may be distorted.Controllers’ ‘real-life’ experience in the specific working positions affects their responsesmeasurably, and should also be taken into account. Observations also suggested thatadaptation continues well into the measured phase of even an organisational simulation, andshould be controlled or balanced in judging the conclusions.
It is clear that psycho-physiological measures, chosen to fit the aims of an operationalsimulation, can contribute significantly to the assessment of alternative organisations, bothdirectly, and indirectly by warning of extraneous fatigue and learning effects, which maydistort subjective conclusions.
vi
Intentionally Left Blank
vii
TABLE OF CONTENTS
ABBREVIATIONS.............................................................................................................................................IX
FOREWORD.......................................................................................................................................................XI
ACKNOWLEDGEMENTS.............................................................................................................................. XII
1 - INTRODUCTION AND OBJECTIVES - ................................................................................................. 1
2 - METHOD - .................................................................................................................................................. 3
2.1 - SAMPLE -..................................................................................................................................................... 32.2 - PROCEDURE AND PROTOCOL - ..................................................................................................................... 62.3 - DATA COLLECTED - ..................................................................................................................................... 72.4 - SUBJECTIVE MEASURES - ............................................................................................................................. 7
2.4.1 - Sleep -................................................................................................................................................. 72.4.2 - Workload -.......................................................................................................................................... 82.4.3 - Fatigue - ............................................................................................................................................. 8
2.5 - OBJECTIVE MEASURES -............................................................................................................................... 92.5.1 - Stress -................................................................................................................................................ 92.5.2 - Mental fatigue through the Event Related Potential (ERP) - ............................................................ 9
2.6 - OTHER DATA - ........................................................................................................................................... 142.7 - DATA COLLECTION SCHEDULE -................................................................................................................ 14
3 - RESULTS -................................................................................................................................................. 17
3.1 - SLEEP QUANTITY AND QUALITY - ............................................................................................................... 173.2 - TRAFFIC VOLUME EFFECT - ........................................................................................................................ 20
3.2.1 - Perceived workload - ....................................................................................................................... 203.2.2 - Fatigue - ........................................................................................................................................... 203.2.3 - Objective evaluation of mental fatigue by the ERP -....................................................................... 213.2.4 - Stress -.............................................................................................................................................. 243.2.5 - Controllers orders to pilots - ........................................................................................................... 24
3.3 - ORGANISATION EFFECT - ........................................................................................................................... 273.3.1 - Perceived Workload -....................................................................................................................... 273.3.2 - Self-rating of fatigue -...................................................................................................................... 273.3.3 - Objective evaluation of mental fatigue by the ERP’S - ................................................................... 313.3.4 - Stress -.............................................................................................................................................. 313.3.5 - Controllers orders to pilots - ........................................................................................................... 32
3.4 - EFFECTS OF EXPERIENCE ON THE POSITION - .............................................................................................. 363.4.1 - Fatigue - ........................................................................................................................................... 363.4.2 - Perceived workload - ....................................................................................................................... 363.4.3 - Stress -.............................................................................................................................................. 363.4.4 - Controllers orders to pilots - ........................................................................................................... 383.4.5 Approach versus En-route sectors ..................................................................................................... 38
4 - DISCUSSION - .......................................................................................................................................... 45
5 - CONCLUSION - PROSPECTS -............................................................................................................. 51
6 - REFERENCES - ........................................................................................................................................ 53
viii
TRADUCTION EN LANGUE FRANÇAISE................................................................................................... 55
SOMMAIRE........................................................................................................................................................ 55
AVANT-PROPOS - ............................................................................................................................................ 56
INTRODUCTION - OBJECTIFS -................................................................................................................... 57
CONCLUSIONS - RECOMMANDATIONS -................................................................................................. 58
A N N E X ............................................................................................................................................................ 59
ix
ABBREVIATIONS
ANOVA ANALYSIS OF VARIANCE
ATC AIR TRAFFIC CONTROL
AU ARBITRARY UNIT
EEC EUROCONTROL EXPERIMENTAL CENTRE
EEG ELECTRO-ENCEPHALOGRAM
EOG ELECTRO-OCULOGRAM
EUROCONTROL EUROPEAN ORGANISATION FOR THE SAFETY OF AIR NAVIGATION
IANS INSTITUTE OF AIR NAVIGATION SERVICES
ISA INSTANTANEOUS STRESS ASSESSMENT
NASA NATIONAL AVIATION AND SPACE AGENCY
NASA-TLX NASA TASK LOAD INDEX
RT Simulation REAL-TIME SIMULATION
SA SALIVARY CORTISOL
TMA TERMINAL MANOEUVRING AREA
TRACON TERMINAL RADAR APPROACH CONTROL (SIMULATOR)
UACC MAASTRICHT UPPER AIRSPACE CONTROL CENTRE
x
Intentionally Left Blank
xi
FOREWORD
One of the main purposes of the establishment of Independent Research Fellows at theEurocontrol Experimental Centre is the search for and introduction of advanced methodsfor research in Air traffic control.
The need for more ‘objective’ measures of the effects of Air Traffic Control on controllershas long been apparent, and various studies have been undertaken at EEC on potentialmethods of measuring these effects (EEC Reports 64, 164, 183, 219, 226, 228, 323 and334).
The Laboratoire d’Anthropologie Appliquée of the Université de Paris V (Université RenéDescartes), under the direction of Professor Alex Coblentz, has carried out a series ofstudies of fatigue, sleep disorders and associated strain among airline pilots (Cabon etasl 1996), car drivers (Cointot et al, 1997) and Air Traffic controllers (Mollard et al, 1996)among others.
In accordance with our policy of maintaining awareness of developments, we becameaware that the development of EEG studies (in particular the technique of CorticalEvoked Potential) and of salivary cortisol analysis were potentially useful measures.
We therefore commissioned the Laboratoire d’Anthropologie Appliquée, as a leadingpractitioner of these techniques, to undertake a feasibility study of the use of thesetechniques at the EEC. This study was reported in EEC Report No. 323, and a furtherstudy was reported in EEC Note No. 16/98.
Selected methods were then transferred to a real-time simulation (Sweden-Denmark) asreported in EEC Report No. 334. This simulation involved the evaluation of an unfamiliarhuman-computer interface.
The real-time simulation MILAN 99 concerned the evaluation of changes in sectorisationin the Milan TMA, using a close approximation to the existing system. The opportunitywas taken to apply psychophysiological methods in an ‘organisational’ as opposed to a‘research’ simulation. This report describes the application of these methods.
On behalf of the Director EEC, the experimenters of the Laboratoire d’AnthropologieAppliquée and ourselves, the Project Officers wish to thank the controllers and the EECstaff involved in the running of the MILAN 99 simulation, who co-operated so actively inthis research.
Francoise CalooHugh David
EEC Project Officers
xii
ACKNOWLEDGEMENTS
The LAA would like to express their gratitude to the Eurocontrol team in charge
of the real time simulation, especially to Yann KERMARQUER, Adrian GIZDAVU and
Peter SLINGERLAND.
These evaluations could not have been undertaken without the active
cooperation of Italian Controllers involved in this study. The help of Pietro PAGLIA was
greatly appreciated.
Finally, the authors would like to thank the EEC project officers
Françoise CALOO and Hugh DAVID for their practical help in the organisation of this
study.
* * * *
A N T H R O P O L O G I E A P P L I Q U E E
45, rue des Saints-Pères 75270 PARIS Cedex 06Téléphone : 01 42 86 20 37- 01 42 86 20 41 -Télécopie : 01 42 61 53 80
E.mail : [email protected]
OBJECTIVE EVALUATION OF PHYSIOLOGICAL BEHAVIOUR
AND WORKLOAD OF CONTROLLERS
* * * *
REAL-TIME SIMULATION MILAN 99
* * * *
Doc AA 398/99 MARCH 1999
1
1 - INTRODUCTION AND OBJECTIVES -
This document reports the results of the objective evaluations of the
psychophysiological state of Controllers during the Real-Time simulation Milan 99,
conducted at Eurocontrol Experimental Centre (EEC). The data were collected with the
aim in view to support some operational choices in terms of sectorisation and
organisation of the Milan Traffic Management Area (TMA) in the context of the opening
of the new Malpenza airport. After the Sweden-Denmark simulation, Milan 99 is the
second opportunity of a transposition into a real-time simulation of physiological
measures which were validated into previous basic works conducted on simple
simulation1 using the TRACON Pro software (Cabon et al, 1997, 1999 ; David et al,
1998 ; Farbos et al, 1998, 1999). However while the purpose of the Sweden-Denmark
was to evaluate the impact of a new interface2 (Cabon et al, 1998), the objectives of
the present simulation deal with the comparison of various airspace organisations in
their ability to cope with the increasing volume of traffic foreseen in this area.
Therefore, the method used was adapted to the specific objectives of this simulation.
Three main aspects were assessed into this simulation regarding the different
organisations tested :
- fatigue,
- workload,
- stress.
Considering the future implementation of a new airspace organisation, these
three topics appear to be particularly relevant from an operational point of view as they
can impair performance and safety. Therefore, they add some validity to the
operational choices made along this Real-Time Simulation (RTS).
1 EEC report Nb 323 and EEC note 16/98.2 EEC report Nb 334.
2
Intentionally Left Blank
3
2 - METHOD -
2.1 - Sample -
The sample involved 19 Italian Controllers male and female aged from 26 to 46
years. The whole sample can be divided into three sub-groups : En-Route Radar
Controllers (n = 7), Approach Radar Controllers (n = 6) and En-Route Planner
Controllers (n = 6). The table 1 gives the main characteristics of these 3 sub-groups
regarding age, gender and experience. A statistical analysis on these factors revealed
that female Controllers have significantly less experience on the position (9.6 months)
than males (40.7 months, p<.05) and that females were significantly younger (28.6
years) than males (35.2 years, p<.05).
ATC Age Gender
n = 6 < 30 years n = 4 Females n = 2 Males
n = 9 > 30 and < 40 n = 1 Female n = 8 Males
n = 4 > 40 n = 4 Males
Total = 19
ATC Qualification Experience of controllers on the
position (in months)
7 En Route Radar 38
6 Approach Sector 40
6 En Route Planner 10
Total = 19
Table 1.
Description of the sample
4
WEEK 1 Start Stop ORG /EXERCICES
TRAFFICCODE
Start Stop ORG /EXERCICES
TRAFFICCODE
Programmed RealisedMON.25 JAN 0900 1015 General briefing 0900 1015 General briefing
1030 1200 Org.A/ex.A: 1T99A 1100 1215 Org.A/ex.A: 1T99A1315 1445 Org.A/ex.B: 2T99A 1330 1445 Org.A/ex.B: 2T99A1500 1630 Org.A/ex.C: 3T99A 1515 1630 Org.A/ex.C: 3T99A1645 1730 Debriefing 1615 1730 Debriefing
TUE.26 JAN 0900 1030 Org.B/ex.A: 1T99B 0915 1030 Org.B./ex.A: 1T99B+1045 1215 Org.B./ex.B: 2T99B 1100 1215 Org.B./ex.B: 2T99B+1330 1500 Org.B/ex.C: 3T99B 1330 1445 Org.B./ex.C: 3T99B+1515 1600 Debriefing 1500 1630 Debriefing
WED.27 JAN 0900 1030 Org.C/ex.A: 1T99C 1030 1145 Org.C/ex.A: 1T99C+1100 1230 Org.C/ex.B: 2T99C 1300 1415 Org.C/ex.B: 2T99C+1345 1515 Org.C/ex.C: 3T99C 1430 1545 Org.C/ex.C: 3T99C+1545 1700 Debriefing 1600 1645 Debriefing
THU.28 JAN 0900 1030 Org.D/ex.A: 1T99D 0915 1030 Org.A/ex.A: 1T99A+1100 1230 Org.D/ex.B: 2T99D 1130 1245 Org.A/ex.B: 2T99A+1345 1515 Org.D/ex.C: 3T99D 1430 1545 Org.A/ex.C: 3T99A+1545 1700 Debriefing 1600 1700 Debriefing
FRI.29 JAN 0845 1015 ex.A: spare1045 1215 General dbfng week 1
Program week 21000 1200 General dbfng week 1
Program week 21330 1630 Visit LFPG/PO approach 1300 1630 Visit LFPG/PO approach
Table 2.1. Description of organisations performed during the first week.
WEEK 2 Start Stop ORG /EXERCICES
TRAFFICCODE
Start Stop ORG /EXERCICES
TRAFFICCODE
Programmed RealisedMON.1 FEB 0900 1015 Valid. synthesis week 1 1000 1030 Presentation physio.data
1030 1200 Org.A/ex.A: 1T02A 1030 1145 Org.A/ex.A: 1T02A1315 1445 Org.A/ex.B: 2T02A 1330 1445 Org.A/ex.B: 2T02A1500 1630 Org.A/ex.C: 3T02A 1445 1600 Org.A/ex.C: 3T02A1645 1730 Debriefing 1615 1645 Debriefing
TUE.2 FEB 0900 1030 Org.B/ex.A: 1T02B 1045 1200 Org.B./ex.A: 1T02B1100 1230 Org.B./ex.B: 2T02B 1315 1430 Org.B./ex.B: 2T02B1345 1515 Org.B/ex.C: 3T02B 1500 1615 Org.B./ex.C: 3T02B1545 1700 Debriefing 1630 1700 Debriefing
WED.3 FEB 0900 1030 Org.C/ex.A: 1T02C 0900 1000 Briefing1100 1230 Org.C/ex.B: 2T02C 1000 1115 Org.C/ex.A: 1T02C1345 1515 Org.C/ex.C: 3T02C 1200 1315 Org.C/ex.B: 2T02C1545 1700 Debriefing 1415 1530 Org.C/ex.C: 3T02C
1600 1645 Debriefing
THU.4 FEB 0900 1030 Org.E/ex.A: 1T02E 0900 0945 Briefing1100 1230 Org.E/ex.B: 2T02E 0945 1100 Org.E/ex.A: 1T02E1500 1630 Org.E/ex.C: 3T02E 1115 1230 Org.E/ex.B: 2T02E1645 1730 Debriefing 1430 1545 Org.E/ex.C: 3T02E
1615 1700 Debriefing
FRI.5 FEB 0845 1015 Org.?/ex.A: spare 0945 1100 Org.E/ex.A: 1T02E1045 1215 General dbfng week 2 1115 1200 Dbfng / Program week 31330 1630 Visit Paris ACC 1330 1630 Visit Paris ACC
Table 2.2. Description of organisations performed during the second week.
5
WEEK 3 Start Stop ORG /EXERCICES
TRAFFICCODE
Start Stop ORG /EXERCICES
TRAFFICCODE
Programmed RealisedMON.8 FEB 0900 1015 Valid.synthesis week 2 0900 1015 Debriefing physiolo. data
1030 1200 Org.E/ex.A: 3T05E 1030 1145 Org.E/ex.A: 3T05E1515 1445 Org.E/ex.B: 1T05E 1300 1415 Org.E/ex.B: 1T05E1500 1630 Org.E/ex.C: 2T05E 1430 1545 Org.E/ex.C: 2T05E1645 1730 Debriefing Debriefing
TUE.9 FEB 0900 1030 Org.E2/ex.A: 3T05E 2 0900 1100 Filling questionnaires1100 1230 Org.E2/ex.B: 1T05E 2 1115 1230 Org.F/ex.A: 3T05E1345 1515 Org.E2/ex.C: 2T05E 2 1345 1500 Org.E/ex.B: 1T05E1545 1700 Debriefing 1515 1630 Org.E/ex.C: 2T05E
1630 1700 Debriefing
WED.10 FEB 0900 1030 Org.E3/ex.A: 3T05E 3 0915 1030 Org.E/ex.A: 3T05E1100 1230 Org.E3/ex.B: 1T05E 3 1100 1215 Org.F/ex.B: 1T05E1345 1515 Org.E3/ex.C: 2T05E 3 1200 1400 Social lunch1545 1700 Debriefing 1415 1530 Org.F/ex.C: 2T05E
1545 1630 Debriefing
THU.11 FEB 0845 1015 Org.E4/ex.A: 2T05E 4 0945 1100 Org.FW/ex.A 1T05E+wind
1045 1215 Org.E4/ex.B: 1T05E 4 1145 1300 Org.EW/ex.B 1T05E+wind
1230 1300 Debriefing 1345 1445 Filling questionnaires1400 1530 Visit of IFPU (or else) 1545 1630 Visit of IFPU
FRI.12 FEB 1000 1200 General debriefing 1015 1230 General debriefing
Table 2.3. Description of organisations performed during the third week.
6
2.2 - Procedure and protocol -
This simulation took place at EEC at Brétigny from the 25th January to the 12th
February 1999. Each week, the following traffic levels were successively simulated :
- week 1 : traffic level observed in Milan airspace in 1999 (T99),
- week 2 : traffic level foreseen for the year 20021 (T02),
- week 3 : traffic level foreseen for the year 20051, (T05).
Initially, it was planned to evaluate four organisations during this RTS (one per
day). However, based on the evaluations performed in the first week it was decided
that if some differences would already appeared between the four organisations at
least one organisation could be rejected. The foreseen and actual program of the
simulation are presented in the table 2.
During the first week (T99) due to a technical problem, the organisation A of the
first day was not considered as realistic regarding to the traffic volume. Therefore it was
decided to adjust the traffic volume and to replay it on the day 4 in place of the
organisation D.
The second week (T02), on the basis of the previous exercises and of the
preliminary data processing, a new organisation (E) has been designed by the
Controllers and the EEC team. As this new organisation was expected to be better than
D, it was decided to replace D by E. At the end of the week 2 it was confirmed that the
organisation E was the one to keep and it was decided to reject organisation A, B and
C.
The third week (T05) the basic organisation E was played the Monday. From
Tuesday, organisation E and a new organisation F were played alternatively.
Organisation F was another variant of organisation B in which different procedures
were applied.
1 Brussels data base.
7
Therefore the data analysis presented in this report aims to investigate
the following comparisons regarding the workload, the stress and the fatigue of
Controllers :
- comparison of the organisations A, B and C during the first week (T99),
- comparison of these organisations with the organisation E during the second
week (T02),
- comparison of the different versions of the organisation E end F simulated during
the third week (T05).
2.3 - Data collected -
Three kinds of data were collected during the real time simulation :
- subjective measures : sleep log, workload assessment and fatigue evaluation,
- objective measures : Event Related Potential (mental fatigue assessment) and
salivary cortisol (workload and stress assessment).
The interest and the relevance of these subjective and objective measures had
already been demonstrated in the previous studies (Cabon et al, 1997, 1998) and
during the Sweden-Denmark RTS (Cabon et al, 1998 ; Farbos et al, 1999).
2.4 - Subjective measures -
2.4.1 - Sleep -
Sleep quantity and quality were assessed from one week before the RTS to the
4 days following the simulation covering the three weeks of the simulation. This
evaluation was done using a daily sleep log (cf Annex). Each day, the Controllers were
asked to fill out the sleep log, by indicating their bedtime, rising time and awakening
periods during sleep and to evaluate their fatigue and sleepiness before and after their
sleep.
8
2.4.2 - Workload -
Workload was assessed by the NASA-Task Load Index (TLX) which includes six
dimensions that the controllers rated on visual analogue scales : mental demand,
physical demand, effort, temporal demand, self-assessment of performance and
frustration level. For each of these scales a score was obtained. A global workload
score is also derived from the comparison of each pair of scales (cf Annex). A further
scale regarding the task difficulty was added. During all the days of the RTS, the
NASA-TLX was filled at the end of each session by all the controllers working (en-
route, approach and feed sectors).
2.4.3 - Fatigue -
2.4.3.1 - Visual analogue scales of fatigue and sleepiness (cf Annex ) -
In order to provide some information about the effect of the simulation on fatigue,
each controller rated his fatigue and sleepiness before and after each simulation.
These evaluations were done through two visual analogue scales by marking a cross
on a 100 mm horizontal line separating two opposite adjectives : tired-fresh (fatigue
scale) and sleepy-alert (sleepiness scale). A score was obtained by measuring the
distance between the cross and the positive adjective (fresh-alert) the minimum (0)
corresponding to fresh and alert, the maximum (100) to tired and sleepy.
2.4.3.2 - Manifestations of fatigue (cf Annex) -
In addition to the visual analogue scales of fatigue and sleepiness, a set of four
groups of symptoms related to fatigue was presented : mental, sensorial, physical and
mood manifestations. For each one of these groups, controllers rated their feelings
from None to Very much, before and after each simulation. For each symptom, a score
ranging from 0 (None) to 4 (Very much) is derived.
9
2.5 - Objective measures -
2.5.1 - Stress -
Numerous studies have shown that the endocrine system of the corticosteroids
is a sensitive marker of workload and stress (Zeier et al, 1996 ; Fibiger et al, 1986).
The use of an unfamiliar device or the modification of the work environment can
produce stress, especially in the early stages. The stress may be caused by an
increase of the workload level related to the inexperience of the operator with the
situation or an unfamiliar increase of traffic level.
Moreover, cortisol level is known to be affected by two main factors :
a circadian factor (time of the day) and stress. During a normal sleep-wake rhythm, and
in absence of any stress factors, cortisol is only produced during the night with a peak
in the early morning. Its production decreases during the day with a minimum in the
afternoon. However, when a stress factor is occurring, its level tends to increase, even
during the daytime period.
2.5.2 - Mental fatigue through the Event Related Potential (ERP) -
The ERP is an objective and accurate method of evaluation of the physiological
state of an operator, especially of its ability to process an information. The ERP is
based on the following procedure. About 150 tones are auditory presented to the
controllers by means of a headphone. They are required to detect and to mentally
count high frequency tones (1500 Hz) and to ignore low frequency tones (1000 Hz).
The distribution of high and low tones are respectively 1/3 (about 50) and 2/3 (about
100). The data processing consists in computing the average wave of the 1-second
epoch of EEG which follows the expected tones. The mean wave allows to distinguish
two kinds of potentials : the early or exogenous components and the late or
endogenous components (figure 1). Exogenous components are directly related to the
stimulus. They are dependent on the physical features of the stimulus (e.g. pitch,
duration, intensity,…) as well as on the state of the human operator. They are rather
fixed in latency and amplitude and for healthy subjects they always appear as a
response to the stimulation.
10
On the contrary, endogenous stimulus may be induced by the stimulus or even in
the absence of a stimulus. They are related to psychological process and, as such,
depend on task demands and the instructions given to the subject. The ERP the most
studied is the P300, i.e. the positive wave occurring about 300 ms after the stimulation.
The amplitude of this wave reflects the cognitive attentional demands to task-relevant
stimuli. Numerous studies have demonstrated that a P300 is elicited only if the subject
actively processes or attends to a stimuli. On the contrary, the P300 is not elicited if the
stimulus is ignored (Duncan-Johnson and Donchin, 1977). Because of these
characteristics, the P300 has been frequently used in laboratory as an index of
workload for a particular task. In this case, the ERP is collected in a dual task
procedure, i.e. the subjects are required to detect the tone simultaneously to his main
task. From a theoretical point of view, this procedure refers to the resource theory of
workload (Navon and Gopher, 1979) based on the assumption that the performance
decrement in a dual-task can be attributed to the decrease of one or more of a set of
finite resources. Thus, if two tasks are completed concurrently, one of the tasks will
require a majority of the resources, leaving an insufficient supply for the performance of
the other task. Increases in the cognitive difficulty of the primary task result in a
decrease in the amplitude of the P300.
The ERP procedure was used during the preliminary study on TRACON
to assess the effect of different traffic level on mental fatigue (Cabon et al, 1997 ; David
et al, 1998) (figure 2).
11
III
IIIIV V
VI
No
Po
Na
Pa
Nb
P1
N1
P2
N2
P3
- 5 µ V
+ 5 µ V
StimulusOnset
10 100 1000
Brain stem
Endogenous componentsor Event Related Potential
Mid-latency
Time (ms)
Long-latency
Exogenous components
Figure 1.The auditory exogenous (solid line) and endogenous (dotted line)components in response to a "click" (adapted from Landolt, 1987).
12
-0.3
-0.2
-0.1
0.0
0.1
0.2
0.3
0.4
-100 0 100 200 300 400 500 600 700 800 900 1000
Time (ms)
before during after
P300
FEASIBILITY STUDY ON TRACON (1997)
Event Related Potential (ERP) - low traffic control session -
-0.3
-0.2
-0.1
0.0
0.1
0.2
0.3
0.4
0.5
-100 0 100 200 300 400 500 600 700 800 900 1000
Time (ms)
before during after
P300
FEASIBILITY STUDY ON TRACON (1997)
Event Related Potential (ERP) - high traffic control session -
Figure 2.
Event Related Potential before, during and after a low and
a high traffic control session (EEC report Nb 323).
13
Photo 1. Electrodes location on an Approach Controller for the recording of the Event Related Potentials
Photo 2. Numeric polygraph and microcomputer for the recording and processing of the Event Related Potentials
14
For the recording of the ERP, 3 derivations were used : FzP3, CzP3 and PzP3
according to 10-20 standard (Jasper, 1958) (figure 3 and photo 1). The P3 electrode
was used as a reference and the P4 electrode as the ground.
The EEG recording was carried out using a numeric 20-channel polygraph
(Discovery, Vickers Medical). For ERP as well as for subsequent processing, a
microcomputer (Apple Macintosh) was used in connection with the polygraph (photo 2).
The data processing was conducted using some specific applications developed with
LabView by LAA.
2.6 - Other data -
In addition, the number of Controllers orders to pilots were provided by EEC. It is
expected that the number of Controllers orders will be reduced for the best airspace
organisations.
2.7 - Data Collection Schedule -
The subjective measures were collected on the whole sample during the three
weeks.
The objective measures were collected on sub-groups (figure 4). The ERP
recordings involved one approach controller per organisation. Each of these controllers
was assigned to the same sectors and position. In total, 5 EEG recordings were
performed per organisation. The schedule of the data collection is presented (in figure
4).
Salivary cortisol was collected for all approach sectors and one en-route sector
(REN) for the three weeks. During the last week two other en-route sectors (RWS and
RWN) were included.
15
Fz
Cz
Pz G
Fz-P3
Cz-P3
Pz-P3
P3
Figure 3.Electrodes locations for ERP
Fz, Cz, and Pz electrodes are used for ERP recordingP3 was the referenceG = ground electrode
16
Exercise Exercise Exercise
- Self evaluation of fatigue - Self evaluation of fatigue - Self evaluation of fatigue - Salivary sample - Salivary sample - Salivary sample
(only REN and RWS position) - Self evaluation of fatigue - Self evaluation of fatigue - NASA-TLX - NASA-TLX - Self evaluation of fatigue - Salivary sample - Salivary sample - NASA-TLX
- Salivary sample - Auditory Evoked Potential (only REN and RWS position)
Four approach ATC All approach controllers En-route and Feed position controllers
Figure 4.Description of data collected before and after each simulation.
The duration of each simulation was about 1 hour 15.
17
3 - RESULTS -
The results were analysed as a function of the following factors :
- traffic levels (T99, T02 and T05),
- organisations (A, B, C and the different versions of E),
- individual factors.
The results were also analysed regarding the sectors. As no significant
difference was found between the sectors the results are not reported for each
individual sectors. The lack of statistical results does not mean that there is no effects
but is probably related to the low number of data for each sector. However, a
comparison of the data between approach and en-route sectors shows some
interesting trends which are presented in a separate section.
3.1 - Sleep quantity and quality -
The figure 5 shows the evolution of averaged time to fall asleep and sleep
duration from the week preceding the simulation, the weeks of the simulation, the days-
off and the 3 days following the RTS. During the RTS, the mean sleep duration is lower
than 400 minutes (i.e. 06 hours 30) instead of 450 minutes (i.e.7 hours 30) during the
days-off or while the Controllers are at home. The sleep latency is very high (about 20
minutes) during the first week and then tends to decrease during the subsequent
periods. From these results, it is very clear that the presence of the Controllers in Paris
has affected their sleep duration with a reduction of around 1 hour compared to their
usual sleep time. The sleep reduction observed during the work periods is also
associated with a reduction of sleep quality (figure 6) with an increase of sleepiness
and fatigue at raisetime compared to the day-off periods. However, sleepiness and
fatigue at raisetime and sleep latency are the highest during the first week (T99) and
tend to decrease during the second and third week. Therefore, these results indicate
that Controllers were progressively adjusted to the hours of work from the first to the
last days of their stay in Paris.
18
These data have obviously some impact on their diurnal alertness and
consequently on the evaluations performed during the RTS. Subjective evaluations of
fatigue and workload are generally amplified when sleep debts are cumulated over
more than one week.
19
Figure 5.Evolution of sleep time and latency before, during
and after the simulation (n = 19).
0
10
20
30
40
50
60
70
80
1 weekbefore thesimulation
Days off Days off 3 daysafter the
simulation
Fat
igu
e (A
.U.)
Fatigue at bedtime Fatigue at raisetime
-
+
Figure 6.Evolution of fatigue and sleepiness at bedtime and raisetime before,
during and after the simulation (n = 19).
A.U. : Arbitrary Units.
300
350
400
450
500
1 weekbefore thesimulation
Days off Days off 3 daysafter the
simulation
leep
tim
e (m
n)
0
5
10
15
20
25
leep
late
ncy
(m
n)
Sleep time (mn) Sleep latency (mn)
**
*
* : Statistical significant difference at .05 compared to other periods
- : fresh ; + : tired.
Week 1 Week 2 Week 3
Week 2Week 1 Week 3
20
3.2 - Traffic volume effect -
3.2.1 - Perceived workload -
The mean self-assessment of workload during the three weeks remained,
generally, at a low level, lower than 50 (figure 7). In the same time, the level of
performance is assessed at a high level, around 75 (for a maximum of 100) during the
three weeks. All the scales of the NASA-TLX show an increase with the traffic except
the frustration level and the self-assessment of performance. Statistically, the
differences are significant between the traffic T99 and T02, T99 and T05 but not
between T02 and T05. This suggests that the Controllers were sensitive to the
increase of traffic from T99 to T02 but not from T02 to T05. However, this increase of
traffic was not sufficient to make them perceive a decrease in their performance. From
this results it seems that the increasing traffic did not reach the capacity limit of the
Controllers. In other terms, they increase their effort to maintain the same level of
performance but the effort remains at an acceptable level.
3.2.2 - Fatigue -
In order to analyse the effect of the simulation on fatigue, the difference between
the values observed after the session and before the session were computed.
Therefore, an increase of the score means an increase of fatigue after the session
compared to before the session. The figure 8 shows a slight decrease of fatigue from
the first to the third week. This result could be explained by two factors. The first is
related to the fact that Controllers are more and more familiar with the context of the
simulation and to the schedule of the simulation which is quite different from their usual
hours of work. The second deals with the changes in the organisations from the first to
the third week. In the third week, the organisations (E) tested were based on the choice
of the controllers as well as on the data previously collected. Therefore, the reduction
of fatigue can be related to the fact that they were involved in the design of this
organisation.
21
3.2.3 - Objective evaluation of mental fatigue by the ERP -
As already mentioned, these results were obtained on three Approach sectors
per day and do not concern the En-Route sectors.
22
20
30
40
50
60
70
80
T99 T02 T05
Traffic level
A.U
.
-
+*
20
30
40
50
60
70
80
T99 T02 T05
Traffic level
A.U
.
-
+*
20
30
40
50
60
70
80
T99 T02 T05
Traffic level
A.U
.
-
+ *
20
30
40
50
60
70
80
T99 T02 T05
Traffic level
A.U
.
-
+
20
30
40
50
60
70
80
T99 T02 T05
Traffic level
A.U
.
-
+*
20
30
40
50
60
70
80
T99 T02 T05
Traffic level
$�8�
-
+
Mental Demand Physical Demand
Temporal Demand Performance
Effort Frustration Level
A.U. : Arbitrary Units.
Figure 7.Self-rating of Workload (NASA-TLX) as a
function of traffic volume (n = 19).
- : low ; + : high. * : Statistical significant difference at .05.
23
5
6
7
8
9
10
T99 T02 T05
Traffic level
Mea
n d
iffe
ren
ce a
fter
-bef
ore
the
sess
ion
s o
f fa
tig
ue
(A.U
.)
A.U. : Arbitrary Units.
Figure 9.Mean difference of P300 amplitude after-before the sessions as a
function of traffic volume (n = 4).
-0,2
-0,15
-0,1
-0,05
0
0,05
0,1
0,15
0,2
T99 T02 T05
Traffic level
Mea
n d
iffe
ren
ce a
fter
-bef
ore
th
ese
ssio
ns
of
P30
0 am
plit
ud
e (µ
V)
-
+F
atig
ue
Figure 8.Mean difference of self evaluation of fatigue after-before the sessions as
a function of traffic volume (n = 19).
24
The figure 9 depicts the evolution of the mean difference between the P300
amplitude after the session and before the session. An increase of the negative values
constitutes an objective index of mental fatigue. The results obtained on the sub
sample of 4 Approach Controllers, show a decrease of mental fatigue as a function of
the traffic volume and are consistent with the subjective evaluations collected on the
whole sample of Controllers.
3.2.4 - Stress -
As for the ERP, the stress level of Controllers is assessed by computing the
difference between the excretion of cortisol after and before the sessions (figure 10).
All the differences are negative because the cortisol level show a diurnal variation with
a decrease along the day. A reduction of the decrease, however, is usually related to a
stress. The figure 10 show that the results of cortisol are consistent with those of the
perceived workload (cf. figure 7). The difference between after and before tends to
decrease from T99 to T05. Therefore these results even if they are not significant show
that the increase of traffic increased the level of stress of controllers.
3.2.5 - Controllers orders to pilots -
The orders provided by the Controllers to the pilot provides information about
some aspects of the performance of the Controllers during the simulation. The figure
11 shows the results of the total number of orders by week divided by the number of
aircraft, i.e. the frequency of orders per aircraft. It can be observed a decrease of this
frequency from T99 to T05 simulations. This decrease can be explained by two main
factors. The first deals with a learning process. As the situation of a RTS is not strictly
as the reality, most Controllers have stated that they « learned » the simulation
regarding the procedures, the aircraft behaviours,... The second explanation lies on the
improvement of the different airspace organisations which were tested in the third
week. These two factors will be further discussed in the general discussion of results.
25
-1
-0,9
-0,8
-0,7
-0,6
-0,5
-0,4
-0,3
-0,2
-0,1
0
T99 T02 T05
Traffic levelM
ean
dif
fere
nce
aft
er-b
efo
re t
he
sess
ion
s o
f co
rtis
ol s
ecre
tio
n (
ng
/ml)
Figure 10.Mean difference after-before the sessions
of salivary cortisol secretion as a function of traffic volume (n = 8).
26
1
1,1
1,2
1,3
1,4
1,5
1,6
1,7
1,8
1,9
2
T99 T02 T05
Traffic level
Nu
mb
er o
f co
ntr
olle
rs o
rder
s / N
um
ber
of
airc
raft
Figure 11.Number of controllers orders divided by the number of aircraft
as a function of traffic volume (n = 15).
27
3.3 - Organisation effect -
3.3.1 - Perceived Workload -
The results of perceived workload are presented on the figure 12 for the three
weeks. During the first week, the organisation A+ leads to the highest scores of
workload and the organisation B to the lowest. During the second week, the
organisation E showed the lowest scores of workload while the highest are observed
for the B. In the third week, the workload remains at a moderate level in E and F. The
organisation FW (windy condition) increased the perceived workload of Controllers
regarding mental, physical and temporal demands. The mental demand shows the
highest values, around 60. The self assessment of performance slightly decreased
during the organisation FW compared to the other organisations. On the contrary, the
windy condition associated with the organisation E (EW) leads to a moderate level of
workload and a higher self assessment of performance than the FW. This suggests
that the organisation E allowed the Controllers to cope with this condition.
3.3.2 - Self-rating of fatigue -
The figure 13 shows the data collected before and after the sessions. The
results are presented as a function of the day of week (from Monday to Thursday)
expect for the week 3 as various organisations were played everyday during this week
(cf table 2.3). For the three weeks, the self-rating of fatigue appears to be influenced by
the day of week with a level reaching a maximum the Monday and decreasing during
the other days. This is related to the effect of the week-end which changes the sleep-
wake patterns with a delay in the sleep schedules. On Monday morning these changes
lead to an increase of fatigue which can persist along the day. Some effects of the
organisations can be observed when the differences between after and before values
are computed (figure 14). During the first week the organisation B leads to the lowest
level of fatigue and A (on Monday) to the highest level. The organisation C showed the
lowest levels in the second week. In the third week, the lowest difference is observed
for FW and EW.
28
This could be related to the fact that these 2 organisations were played in the
very last day of the RTS. On the contrary, the same day, the organisation F leads to a
significant increase of fatigue. Therefore this suggests that the amended procedures
allow to reduce the level of fatigue.
29
20304050607080
A B C A+
Organisation
A.U
.
-
+
20304050607080
A B C A+
Organisation
A.U
.
-
+
Week 1
A.U. : Arbitrary Units.
Figure 12.Self-evaluation of Workload (NASA-TLX)
as a function of the organisations for the 3 levels of traffic (n = 19).
- : low ; + : high.
Mental Demand
Physical Demand
Temporal Demand
PerformanceEffortFrustration Level
20304050607080
A B C E
Organisation
.U.
-
+
20304050607080
A B C E
Organisation
A.U
.
-
+
Week 2
20304050607080
E F FW EW
Organisation
A.U
.
-
+
20304050607080
E F FW EW
Organisation
.U.
-
+
Week 3
30
NB : Various organisations were played everyday during the third week (cf. table 2.3)
0102030405060
A B C A+Organisation
A.U
.
-
+ **
*
-202468
101214
A B C A+Organisation
Mea
n d
iffe
ren
ce o
fse
lf e
valu
atio
n o
ffa
tig
ue
(A.U
.)
Week 1 (T99)
0102030405060
A B C E
Organisation
A.U
.
-
+* * *
-202468
101214
A B C E
Organisation
Mea
n d
iffe
ren
ce o
fse
lf e
valu
atio
n o
fat
igu
e (A
.U.)
Week 2 (T02)
0102030405060
E F FW EWOrganisation
A.U
.
-
+ * *
-202468
101214
E F FW EW
OrganisationM
ean
dif
fere
nce
of
self
eva
luat
ion
of
fati
gu
e (A
.U.)
Week 3 (T05)
Week 1 (T99)
Week 2 (T02)
Week 3 (T05)
Figure 13.Mean values of self evaluation of fatigue
before and after the sessions as a functionof the organisations for the 3 levels of traffic (n = 19).
- : fresh ; + : tired.
Figure 14.Mean difference of self evaluation of fatigue
after-before the sessions as a functionof the organisations for the 3 levels of traffic (n = 19).
Before After * : Statistical significant difference at .05.
31
3.3.3 - Objective evaluation of mental fatigue by the ERP’S -
During the first week, Controllers showed the most important level of mental
fatigue after the organisation A+ and the lowest level after the organisation B
(figure 15). The results of the second week are consistent with those of the first week
as fatigue was prominent for the organisations A and C and the less important after the
organisations B and E. Therefore these data seems to support the choice of the
organisation B and E. The third week, the results confirm those of the NASA-TLX with
the highest mental fatigue observed for the organisation FW and the lowest levels for
the organisation E. However it is not possible to compare these results with the
organisation EW as the data cannot be processed for technical reasons. Thus, these
results suggest that the windy condition leads to a greater effort compared to the
normal conditions and that the E and F lead to the minimum of fatigue. Moreover,
compared to subjective evaluations of fatigue, these results show that Controllers have
underestimated their level of fatigue in the windy condition (cf. figure 14).
3.3.4 - Stress -
The results concerning the first week (figure 16) show that the highest increase
of salivary cortisol is observed for the organisation C. During the second week the
lowest variation is noted for the organisation E, supporting the previous results of
workload and fatigue. The data of the last week are also consistent with the other data.
The highest level of stress is observed after the organisation FW (windy condition) and
the lowest levels of stress are noted for the organisation E as for the ERP values.
32
3.3.5 - Controllers orders to pilots -
The frequency of Controllers orders per aircraft is presented for each
organisation on figure 17. A decrease of this parameter can be observed from the first
to the last week. However, during the two first weeks, the frequency shows a peak for
the organisation C and organisation B. In the third week, the organisation E was
associated with a lower frequency than during the organisation E of the previous week.
The lowest value is associated with the organisation EW and the highest is observed
for the organisation FW. It is interesting to notice that the windy condition had more
impact on the organisation F than on the organisation E. Taken as a whole the level
reached during this week is the lowest level of all the organisations throughout the 3
weeks. These results suggest an improvement of performance due to the organisation
or to a learning process phenomena.
33
No dataavailable
Week 3 (T05)
-0,2-0,15
-0,1-0,05
00,050,1
0,150,2
A B C A+Organisation
Mea
n d
iffe
ren
ce o
f P
300
amp
litu
de
(µV
) +F
atigu
e
Week 1 (T99)
Week 2 (T02)
Figure 15.Mean difference of P300 amplitude after-before the sessions
as a function of the organisations for the 3 levels of traffic (n = 4).
-0,2-0,15
-0,1-0,05
00,050,1
0,150,2
A B C EOrganisation
Mea
n d
iffe
ren
ce o
f P
300
amp
litu
de
(µV
) +
Fatig
ue
-0,2-0,15
-0,1-0,05
00,050,1
0,150,2
E F FW EWOrganisation
Mea
n d
iffe
ren
ce o
f P
300
amp
litu
de
(µV
) +
Fatig
ue
34
No dataavailable
-4-3-2-101234
A B C A+Organisation
Mea
n d
iffe
ren
ce o
f sa
livar
y co
rtis
ol (
ng
/ml) *
Week 3 (T05)
Figure 16.Mean difference of salivary cortisol secretion
after-before values as a function of the organisations for the 3 levels of traffic (n = 8).
-4-3-2-101234
A B C EOrganisation
Mea
n d
iffe
ren
ce o
f sa
livar
y co
rtis
ol (
ng
/ml)
-4-3-2-101234
E F FW EWOrganisation
Mea
n d
iffe
ren
ce o
f sa
livar
y co
rtis
ol (
ng
/ml)
* : Statistical significant difference at .05.
*
35
1,4
1,5
1,6
1,7
1,8
1,9
2
A C B E E FW
Organisation
Nu
mb
er o
f co
ntr
olle
rs o
rder
s / N
um
ber
of
airc
raft
T99 T02 T05
Figure 17.Number of controllers orders divided by the number of aircraftas a function of organisations for the 3 levels of traffic (n = 19).
A
B A+ A C F EW
36
3.4 - Effects of experience on the position -
As a significant difference was observed for the experience on the position as a
function of age and of genders (see § 2.1) the data were analysed only as a function of
the experience of Controllers. Therefore, the sample was divided into 2 sub-groups :
Controllers having an experience lower than 20 months and Controllers having an
experience higher than 20 months. The effect of this factor are presented for fatigue,
perceived workload and stress.
3.4.1 - Fatigue -
No effect of experience was observed on the level of fatigue.
3.4.2 - Perceived workload -
All the scales of the NASA-TLX except the frustration level show a significant
effect of the experience (figure 18) : the less experienced Controllers perceived less
workload than experienced Controllers.
3.4.3 - Stress -
Effect of experience on stress is opposite to the perceived workload (figure 19) :
the high experienced Controllers showed less increase of secretion of salivary cortisol
than low experienced Controllers. Therefore, a dissociation between the perception of
Controllers and their objective reaction to the simulation in terms of stress can be
noticed. This dissociation is an important point as it means that less experienced
Controllers probably underestimate their workload. On the contrary, experienced
Controllers have probably a good appraisal of their own level of workload as the level is
lower than 50 for all the scales of NASA-TLX.
37
PhysicalDemand
Performance FrustrationLevel
0
20
40
60
80
100
MentalDemand Temporal
DemandEffort
A.U
.< 20 months of experience
≥ 20 months of experience
-
+
** *
*
*
-1
-0,8
-0,6
-0,4
-0,2
0
0,2
0,4
0,6
0,8
1
< 20 months of experience ≥ 20 months of experience
Mea
n d
iffe
ren
ce a
fter
-bef
ore
th
e se
ssio
ns
of
cort
isol
sec
reti
on
(ng/
l)
*
A.U. : Arbitrary Units,- : low ; + : high.
Figure 18.Effects of the experience of the position
on perceived workload (NASA-TLX) - n = 19.
Figure 19.Effects of the experience of the position on difference of salivary cortisol secretion
(after-before the sessions) - n = 8.
* : Statistical significant difference at .05.
* : Statistical significant difference at .05.
PhysicalDemand
Performance FrustrationLevel
38
3.4.4 - Controllers orders to pilots -
The effect of experience on Controllers orders to pilots is depicted on the figure
20. Two statistical significant differences are observed.
First, the high experienced Controllers show a significant reduction of their
orders between T05, T99 and T02, while no significant variation was observed for the
Controllers having less than 20 months of experience. Secondly, during the whole
simulation, the low experienced Controllers showed lower number of orders compared
to the high experienced Controllers. The composition of this group can explain these
results. In fact, all Controllers which have less than 20 months of experience are all En
route Controllers and therefore have less orders to provide to pilots.
Furthermore, the results of the low experienced Controllers seem to suggest the
absence of a learning process during the simulation in so far as none reduction of
orders was observed for the 3 levels of traffic.
3.4.5 Approach versus En-route sectors
3.4.5.1 Traffic effect
As mentioned earlier, the sector per sector analysis leads to an insufficient
number of data to reveal statistical results, especially for objective data which were
focused on approach sectors. However, some interesting trends can be observed when
the data are averaged for en-route and approach sectors. The figure 21 shows a
comparison of fatigue and global score of the NASA-TLX for the two kinds of sectors. It
is worth to note that both en-route and approach Controllers rated their workload as
increasing as a function of the traffic, but only the approach Controllers felt an increase
of fatigue with traffic. This results is consistent with the results of experience presented
in the previous section as the en-route Controllers were also the less experienced.
39
Figure 20.Effect of the experience of the position on the numberof controllers orders divided by the number of aircraft
as a function of the 3 levels of traffic (n = 19).
0,08
0,10
0,12
0,14
0,16
T99 T02 T05
Nu
mb
er o
f co
ntr
olle
rs o
rder
s / N
um
ber
of
airc
raft
*
*
**
****
* : Statistical significant difference at .05 between eachlevel of traffic
** : Statistical significant difference at .05 betweenthe two groups according to the level of traffic.
< 20 monthsof experience
≥ 20 monthsof experience
40
40
45
50
55
60
Traffic 1999 Traffic 2002 Traffic 2005
Mea
n N
AS
A-T
LX
sco
re (
A.U
.)MILAN 99 - REAL TIME SIMULATION -
0
5
10
15
Traffic 1999 Traffic 2002 Traffic 2005
Mea
n d
iffe
ren
ce o
f se
lfev
alu
atio
n o
f fa
tig
ue
(A.U
.)
En routecontrollers TiredFresh Å
1000Å Approachcontrollers
Approachcontrollers Low Å :
En routecontrollers
High
1000 Å
Figure 21.Mean difference of self evaluation of fatigue and Mean NASA-TLX score for
En route and Approach controllers as a function of traffic.
A.U. : Arbitrary Units.
41
MILAN 99 - REAL TIME SIMULATION
30
40
50
60
70
A B C A+
Mea
n N
AS
A-T
LX
sc
ore
(A
.U.)
-10
0
10
20
30
40
A B C A+
Mea
n d
iffe
ren
ce o
f se
lf e
valu
atio
n o
f fa
tig
ue
(A.U
.)
30
40
50
60
70
E F FW EW
Mea
n N
AS
A-T
LX
sc
ore
(A
.U.)
-10
0
10
20
30
40
E F FW EW
Mea
n d
iffe
ren
ce o
f se
lf e
valu
atio
n o
f fa
tig
ue
(A.U
.)
30
40
50
60
70
A B C E
Mea
n N
AS
A-T
LX
sc
ore
(A
.U.)
-10
0
10
20
30
40
A B C E
Mea
n d
iffe
ren
ce o
f se
lf e
valu
atio
n o
f fa
tig
ue
(A.U
.)
En route controllersTiredFresh Å
1000 Å Approach controllers HighLow
100 0 Å
WEEK 1
WEEK 2
WEEK 3
Figure 22.Mean difference of self evaluation of fatigue and Mean NASA-TLX score
for En route and Approach controllers as a function of organisations.
A.U. : Arbitrary Units.
Å
42
No dataavailable
-4-3-2-101234
A B C A+
Mea
n d
iffe
ren
ce o
f co
rtis
ol s
ecre
tio
n (
ng
/ml)
MILAN 99 - REAL TIME SIMULATION
-4-3-2-101234
E F FW EW
Mea
n d
iffe
ren
ce o
f co
rtis
ol s
ecre
tio
n (
ng
/ml)
En route controllers
Approach controllers
-4-3-2-101234
A B C E
Mea
n d
iffe
ren
ce o
f co
rtis
ol s
ecre
tio
n (
ng
/ml)
WEEK 1
WEEK 2
WEEK 3
Figure 23.Mean difference of salivary cortisol secretion
for En route and Approach controllers as a function of organisations.
43
T99 T02 T05
Figure 24.Number of controllers orders divided by the number of aircraft as a function of
organisations and type of sectors for the 3 levels of traffic (n = 19).
W = Wind
1,2
1,4
1,6
1,8
2
2,2
2,4
2,6
A B C A+ A B C E E F FW EW
Nu
mb
er o
f co
ntr
olle
rs o
rder
s / N
um
ber
of
airc
raft
Approach sector
En-Route sector
44
3.4.5.2 Organisations effect
The figure 22 shows that both fatigue and workload are rated lower for the en-
route Controllers for the organisation B and C during the first week. During the second
week, the en-route Controllers were more tired than the approach Controllers in, the
organisation C and E. However, the workload remains exactly at the same level for the
2 groups of Controllers. In the third week, the workload remains at the same level for
the two groups but fatigue shows a different trend with a peak for the en-route
Controllers during organisation FW. Therefore it seems that the en-route Controllers
were more affected in terms of fatigue by the windy condition associated with the
organisation F while they do not felt a higher level of workload. This result is still
consistent with those presented in the previous sections on the effect of experience
showing that the less experienced Controllers tend to underestimate their workload.
The results of salivary cortisol are presented on figure 23. It can be observed
that, generally speaking, en-route Controllers showed higher positive difference in
salivary cortisol. That means that their level of cortisol tends to increase more than for
approach Controllers, i.e. they had more stress related to the task. However, the
difference between the two groups of Controllers is especially high in the organisation
B of the second week. It is also worth to notice that both groups were affected by the
wind (FW).
The figure 24 compares the number of orders to pilots for en-route and approach
Controllers. As it could be expected, the number of orders are higher for approach
Controllers than for en-route Controllers. However, the evolution of this parameter
through the organisations is parallel for the two groups of Controllers.
45
4 - DISCUSSION -
The aim of the Milan 99 RTS was to identify the best airspace organisation to
implement in the Milan TMA. The airspace organisation to keep is intended to ensure
that Controllers will be able to perform a safe and efficient control with a reasonable
level of workload, despite the foreseen increase of traffic. With this aim in view, 3
organisations (A, B, C) were tested in the first week at the current level of traffic
observed in the area of Milan. During a second week, a new organisation (E) was
designed in collaboration with the Italian Controllers and tested at the level foreseen in
2002. The third week, based on a first data analysis and Controllers’ opinions, the
organisation E and the organisation F (a variant of organisation E) were tested with the
level of traffic foreseen in 2005 including 2 windy simulations.
In addition to the traditional evaluation used at EEC, a set of data were collected
in order to support the operational choices in terms of airspace organisation. These
data cover the following topics that could not be evaluated only by subjective tools :
fatigue, workload and stress. The main results are summarised into the table 3. This
table shows the effects that can be statistically demonstrated as well as the main
trends which do no reach a statistical level. In fact, as the objective measures were
collected on sub-groups, even when the differences are large the amount of data is not
sufficient to gives statistical results.
From the results, it can be noticed that the increasing level of traffic yields to
an increasing level of workload and stress. However, it should be keep in mind that
the levels of workload remain at a moderate level, lower than 50 on the NASA TLX
even for the highest traffic volume (2005). In the real world, the same evaluations are
frequently higher than 50.
46
Paradoxically, a slight decrease of fatigue, both subjective and objective is
observed. This finding could be explained by the progressive adaptation of the
Controllers to their stay in Paris in unusual conditions (i.e. the hotel, the hours of
work,...). This hypothesis is supported by the results of sleep quality which tends to
improve during the second and third week. However, two other factors dealing with the
RTS itself can explain this result. First, during the debriefing the Controllers have
stated that they need some time to adapt to the simulator which does not reflect exactly
the reality of their real work conditions. Therefore, the learning of the simulator
reaction had probably helped the controllers to slightly decrease their fatigue despite
the increase in traffic. The second factor concerns the organisation which have been
improved from the first to the third week on the basis of Controllers’ opinions.
47
Levelof traffic
Organisations(associated with
the lowest values)
Experienceof the position
Approach versus En-route sectors
Perceived
workload
(NASA-TLX)
(n=19)
Increase with
traffic (S)
Week 1 : B (NS)
Week 2 : E(NS)
Week 3 : E and F (NS).
Lower for less
experienced
Controllers (S)
Lower for en-route
than approach during
the first week. Higher
during the organisation
FW for approach (NS)
but lower for approach
for EW (NS)
Self rating of
fatigue
(n=19)
Decrease with
traffic (NS)
Week 1 : B (S)
Week 2 : C (S)
Week 3 : FW (S)
No effect. Lower for en-route
than approach during
the first week. Higher
during the organisation
FW for en-route (NS)
Objective
mental fatigue
assessed by the
Event Related
Potentials
(n=4)
Decrease with
traffic (NS)
Week 1 : B (NS)
Week 2 : B, E (NS)
Week 3 : E (NS)
Insufficient number
of data
En-route Controllers
were not recorded
Stress
assessed by the
salivary cortisol
(n=8)
Increase with
traffic (NS)
Week 1 : A+ (S)
Week 2 : E (NS)
Week 3 : E (S)
Higher for less
experienced
Controllers (S)
Insufficient number of
data
Frequency of
Controllers
orders to pilots
(n=19)
Decrease with
traffic (NS)
Week 1 : A+ (NS)
Week 2 : A (NS)
Week 3 : E and EW
(NS)
Higher for high
experienced
Controllers (S)
Higher for Approach
Controllers (NS)
NS : Not statistically SignificantS : Significant at P<.05
Table 3.Synthesis of results.
48
The feeling of a better organisation, well adapted to the level of traffic, could also have
a positive effect on fatigue. It is thus likely that the adaptation to the living conditions,
the learning of the simulator reaction as well as the improvement in the organisations
had played together a role in the slight reduction of fatigue. This is consistent with the
fact that the Controllers reduced the frequency of orders to pilots. However, due to the
scheduling of the simulations, it is difficult to identify which are the most contributing
factors.
Based on the results summarised in the table 3, it is difficult to clearly
differentiate all the organisations. This statement supports partially the Controllers’
opinions.
In the first week, the lowest levels of workload and fatigue was observed for the
organisation B which was considered as a good one according to the Controllers point
of view. Moreover, the organisation E was derived from this organisation. However, the
Controllers orders to the pilots (index of activity) and stress level (objective measures)
were the lowest for A+.
The second week, two organisations : B and E are associated with the lowest
values of perceived workload, objective fatigue and stress, but Controllers orders to
pilots were still the lowest for the organisation A.
In the third week, most of values suggest that the organisation E is the most
adapted. However, it is necessary to remain very careful in the interpretation. In fact, it
is possible that the learning process of the simulation already mentioned has
influenced the results in maintaining their workload at a moderate level for the
organisations E tested with the highest level of traffic. This hypothesis is supported by
the fact that the frequency of Controllers orders to the pilots decreased from the first to
the third week. Moreover, the organisation E of the third week leads to a lower number
of Controllers orders than during the second week while the traffic had increased.
As the other organisations (A, B and C) were not replayed with the 2005 traffic,
the comparison of all the organisations with the same level of traffic is not possible.
49
Some remarks can also be addressed from results reported in table 3
concerning the individual differences. Significant differences on stress, perceived
workload and number of manipulations appear between low and high experienced
Controllers. As mentioned before, it seems that the low experienced Controllers
underestimate their workload : they assess their workload lower than the experienced
Controllers although a stress reaction can be observed for them but not for
experienced Controllers. During the Sweden-Denmark RTS, strong individual
differences have been also revealed as a function of previous experience of the
interface. For Milan 99, the results of workload were contrary : the low experienced
Controllers had more workload than high experienced Controllers. This difference
could be explained by the fact that a totally new interface was tested in the Sweden-
Denmark campaign while Milan 99 involved new airspace organisations with the same
interface. Furthermore, most of the Italian Controllers included in the low experienced
group were only planning Controllers while the Swedish and Danish Controllers who
had no previous experience of the interface were all qualified as Executive Controllers.
The comparison of the data for the en-route and the approach sectors does not
revealed any significant differences due to the low number of Controllers in each of
these two groups.
50
Intentionally Left Blank
51
5 - CONCLUSION - PROSPECTS -
From the data collected in this RTS specific outcomes regarding the objectives
of Milan 99 can be addressed :
- the workload of Controllers was maintained at a moderate level for all the
organisations,
- the organisation E seems to be the most adapted as it induces less workload,
stress and fatigue. However, further investigations should be performed to
evaluate this organisation in different situations, e.g. fog (which is more frequent
in this area than wind), technical problems on aircraft,... and to determine
whether this organisation is still adapted. In addition, it should be worth to test
this organisation with Controllers who had not worked on previous exercises on
the simulator to avoid any learning effect.
From a more general point of view, these results have also some important
implications for further RTS :
- the day to day effect (e.g. increased level of fatigue and workload on Monday
morning, underestimation of fatigue on the last day of simulation) has to be taken
into account in the interpretation of subjective data,
- when setting up a group of controllers to be involved into a RTS it is necessary to
take into account the previous experience of Controllers on the position. If it is
not possible, the data processing has to be done separately for the high and low
experienced Controllers as the results would be significantly different for most
evaluations,
- due to the progressive adaptation of the Controllers to the general conditions of
the simulations and the learning process of the simulator, the scheduling of the
simulation should be also designed carefully to avoid misinterpretation. For the
specific case of Milan 99, this effect cannot be excluded and thus can mask
some aspects in the third week. Therefore, a training and familiarisation phase
should be planned before to start any evaluation on a simulator. This
familiarisation period should be representative of the exercises that will be
tested. Another method to avoid this learning effect should be to counterbalance
the order of the organisations from one week to another.
* * * *
52
Intentionally Left Blank
53
6 - REFERENCES -
CABON (P.) ; MOLLARD (R.) ; COINTOT (B.) ; MARTEL (A.) ; BESLOT (P.).-Elaboration of a method for the assessment of psychophysiological states of Air Trafficcontrollers in simulation. EEC Report N° 323, 1997, 64 p.
CABON (P.) ; FARBOS (B.) ; BOURGEOIS (S.) ; COINTOT (B.) ; MOLLARD (R.).-Objective evaluation of the learning process of controllers adapting to a new HMI forATC. EEC Note No 16/98, 1998, 26 p.
CABON (P.) ; FARBOS (B.) ; MOLLARD (R.) ; COBLENTZ (A.).- Objective evaluation oflearning process in Air Traffic Control Simulation. The Tenth International Symposium onAviation Psychology, Colombus, Ohio, USA, May 3 -6, 1999, 6 p.
DAVID (H.) ; CABON (P.) ; BOURGEOIS-BOUGRINE (S.) ; MOLLARD (R.).-Psychophysiological measures of fatigue and somnolence in simulated Air TrafficControl. In : Contempory Ergonomics, 1998, Taylor and Francis (ed.) pp. 429-433.
DUNCAN-JOHNSON (C.G.) ; DONCHIN (E.).- On quantifying surprise : The variation inevent-related potentials with subjective probability.- Psychophysiology, 14, 1977, pp.456-467.
FARBOS (B.) ; CABON (P.) ; BOURGEOIS (S.) ; DAVID (H.).- Psychophysiologicalmeasures of fatigue and somnolence in simulated Air Traffic Control. In : Proceedings ofthe Measuring Behavior 98 Conference, Groningen, August 18-21 1998, 2 p.
FARBOS (B.) ; CABON (P.) ; MOLLARD (R.). ; CALOO (F.) ; DAVID (H.).- Evaluationobjective de l'adaptation des contrôleurs aériens à une nouvelle interface homme-machine. Communication présentée au XXXIV Congrès de la Société d'Ergonomie deLangue Française, Caen, 15-17 Septembre 1999.
FIBIGER (W.) ; EVANS (O.) ; SINGER (G.).- Hormonal responses to graded mentalworkload.- European Journal Applied Physiology and Occupational Physiology, 55,1986, pp. 339-43.
JASPER (H.H.).- The ten-twenty electrode system of the International Federation.-Electroencephalography and Clinical Neurophysiology. - 10, 1958, 371-376.
NAVON (D.) ; GOPHER (D.).- On the economy of the human processing system.-Psychological Review, 86, 1979, pp. 214-255.
ZEIER (H.) ; BRAUCHLI (P.) ; JOLLER-JEMELKA (H.I.).- Effects of work demands onimmunoglobulin A and cortisol in air traffic controllers.- Biological Psychology, 42, 1996,pp. 413-423.
* * *
54
Intentionally Left Blank
55
Traduction en langue française
SOMMAIRE
La simulation temps réel MILAN 99 menée au Centre Expérimental Eurocontrol
(CEE) en Jan/Fév 99 avait pour principal objectif la réorganisation de la TMA Milan
dans le cadre de l’ouverture du nouvel aéroport de Malpensa.
Le CEE a réalisé plusieurs études sur des mesures psychophysiologiques et des
processus d’adaptation des contrôleurs à de nouvelles interfaces hommes/machines,
dans un premier temps en laboratoire puis au cours de la simulation temps réel
Suède/Danemark 98.
Des mesures objectives d’évaluation de la fatigue mentale par potentiel évoqué
auditif, de surcharge de travail et de stress par analyse de cortisol salivaire ont été
effectuées sur certains secteurs sélectionnés et complémentées par des mesures
subjectives tels que agendas du sommeil, questionnaires de surcharge de travail et de
fatigue.
Les résultats de ces observations psychophysiologiques suggèrent qu’il existe un
effet de l’heure pendant la journée ainsi que du jour de la semaine pouvant modifier,
de manière significative, les mesures de fatigue et de surcharge de travail , par
exemple, le Lundi et le dernier jour de la simulation, que l’expérience des contrôleurs
en ce qui concerne leurs secteurs a aussi un effet mesurable sur leurs réponses, qui
devra être pris en considération et enfin, que le processus d’adaptation se maintient
durant les exercices faisant l’objet de ces mesures y compris dans une simulation
d’organisation.
Il apparaît clairement que de telles évaluations psychophysiologiques
sélectionnées pour répondre aux objectifs d’une simulation opérationnelle, peuvent
contribuer d’une manière significative à une meilleure évaluation d’organisations
alternatives soit directement soit indirectement en alertant sur une fatigue superflue ou
des effets d’adaptation pouvant influencer des conclusions subjectives.
56
AVANT-PROPOS -
L’un des principaux objectifs du Centre d’expertise “Independant Research” au
Centre Expérimental EUROCONTROL est la recherche et l’introduction de méthodes
de recherches novatrices dans le domaine du contrôle aérien.
Le besoin d’évaluer plus objectivement l’impact du contrôle aérien sur les
contrôleurs est une préoccupation ancienne et de nombreuses études ont été menées
au CEE pour déterminer les méthodes d’investigations les plus adaptées (CEE
Rapports 64, 164, 183,219,226,228, 323 et 334).
Le Laboratoire d’Anthropologie Appliquée de l’Université Paris V (Université
René Descartes) a mené, sous la direction du Pr Alex Coblentz, de nombreuses
études sur la fatigue, les troubles du sommeil et autres troubles associés notamment
sur les pilotes de ligne (Cabon et al 1996) les conducteurs d'automobiles (Cointot et al
1997) et les contrôleurs aériens (Mollard et al 1996).
Conformément à notre politique d’actualisation de nos programme d’études, les
derniers développements dans le domaine d’études EEG et d’analyses de cortisol
salivaire ont retenu notre attention et conduit à penser que de telles mesures pouvaient
se révéler très utiles.
C’est pourquoi, nous avons demandé au Laboratoire d’Anthropologie Appliquée,
leader dans cette spécialité, de conduire une étude de faisabilité sur l’utilisation de ces
techniques au CEE. Cette étude a fait l’objet d’un rapport (CEE n° 323/97) et d’une
étude complémentaire (note CEE n° 16 /98).
Certaines de ces méthodes ont été appliquées à une simulation temps réel
(Suède/ Danemark) et fait l’objet d’un rapport CEE n° 334/99. Cette simulation avait
pour objectif d’évaluer une nouvelle interface homme/machine.
La simulation temps réel Milan 99 concerne l’évaluation de modification de
secteurs dans la TMA Milan, assez proche du système existant. L’occasion nous a été
donnée de pouvoir appliquer ces méthodes psychophysiologiques à une simulation
“Organisationnelle” par opposition à une simulation de “Recherche”. Ce rapport décrit
le transfert de ces méthodes.
Le Directeur du Centre Expérimental, les chercheurs du Laboratoire
d’Anthropologie Appliquée ainsi que les chefs de projets tiennent à exprimer leurs
remerciements aux contrôleurs et aux personnels du CEE pour leur étroite
collaboration à cette étude menée pendant la simulation Milan 99.
57
INTRODUCTION - OBJECTIFS -
Ce document rapporte les résultats des évaluations objectives du comportement
psychophysiologique des Contrôleurs au cours de la simulation temps réel Milan 99 qui
s’est déroulée au Centre Expérimental d’Eurocontrol. Ces évaluations ont pour objectif
d’orienter des choix opérationnels concernant l’organisation du trafic aérien de la
région de Milan dans le contexte de l’ouverture du nouvel aéroport de Malpenza. Après
Suède-Danemark 98, la simulation Milan 99 constitue la deuxième transposition dans
une simulation temps réel de mesures physiologiques validées dans des travaux
menés sur des simulations simplifiées(3) utilisant le logiciel TRACON PRO (Cabon et
coll., 1997, 1999 ; David et coll, 1998 ; Farbos et coll, 1998, 1999). Cependant, alors
que le but de la simulation Suède-Danemark était d’évaluer l’impact d’une nouvelle
interface(4) (Cabon et coll., 1998), l’objectif de la simulation Milan 99 concerne la
comparaison de plusieurs organisations dans leur capacité à gérer l’augmentation du
trafic aérien prévue dans cette région. La méthode utilisée a donc été adaptée aux
objectifs spécifiques de cette simulation. Trois aspects essentiels ont été évalués en
fonction des différentes organisations testées :
• la fatigue,
• la charge de travail,
• le stress.
Dans la perspective de la future organisation du trafic aérien, ces trois aspects
apparaissent essentiels d’un point de vue opérationnel puisqu’ils peuvent dégrader la
performance des Contrôleurs et donc la sécurité. De ce fait, ces évaluations
renforcent la validité des choix opérationnels réalisés au cours de cette simulation
temps réel.
3 EEC report N° 323 et EEC note 16/98.4 Rapport EEC N° 334.
58
CONCLUSIONS - RECOMMANDATIONS -
A partir des données recueillies dans cette simulation, les résultats suivants ont
été mis en évidence :
• la charge de travail des Contrôleurs est restée à un niveau modéré pour toutes les
organisations,
• l’organisation E semble la plus adaptée, car elle induit le moins de charge de travail,
de stress et de fatigue. Néanmoins, des simulations complémentaires devraient être
effectuées pour évaluer cette organisation dans différentes situations, par exemple la
présence de brouillard ou de problèmes techniques survenant sur un avion… et ainsi
déterminer si cette organisation reste toujours adaptée. Par ailleurs, il serait
nécessaire de tester cette organisation avec des contrôleurs n’ayant pas
préalablement effectué d’exercices sur le simulateur afin d’écarter un éventuel effet
d’apprentissage.
D’un point de vue plus général, ces résultats ont des implications importantes
pour les futures simulations temps réel :
• il existe un effet du jour de la semaine (par exemple une augmentation de la fatigue
le lundi matin, une sous-estimation de la fatigue le dernier jour de la simulation) qui
doit être pris en compte dans l’interprétation des données subjectives,
• lors de la constitution du groupe de Contrôleurs qui doivent participer à la simulation,
il est nécessaire de prendre en compte l’expérience passée de ces Contrôleurs sur le
secteur. Si cela n’est pas possible, le traitement des données doit être effectué
séparément pour les Contrôleurs expérimentés et non expérimentés car les résultats
peuvent être significativement différents pour la plupart des évaluations,
• en raison de l’adaptation progressive des Contrôleurs aux conditions générales de la
simulation, la planification de la simulation doit être conçue avec précaution pour
éviter de fausses interprétations. Dans le cas spécifique de Milan 99, cet effet ne
peut être exclu et peut donc masquer certains aspects relatifs aux évaluations
effectuées dans la 3ème semaine. Une période de familiarisation et d’entraînement
doit donc être prévue avant de débuter les évaluations sur le simulateur. Cette
période doit être représentative des exercices qui vont être présentés aux
Contrôleurs. Une autre méthode consisterait à contrebalancer l’ordre des
organisations d’une semaine à l’autre.
* * * *
59
* * *
A N N E X
* * *
QUESTIONNAIRES USED DURING
THE REAL TIME SIMULATION
- SLEEP LOG
- FATIGUE EVALUATION
- NASA-TLX
60
- Agenda de sommeil / Sleep log -
- Une feuille par cycle à détacher et à remettre, chaque jour au médecin ou dans la boite prévue à cet effet -- One sheet per cycle to remove and to give every day to the doctor or to put in the designed box-
Date
Jour Mois Année
Day Month Year
EveilléAwake
FatiguéTired
SomnolentDrowsy
En formeFresh
AU COUCHER / WHEN GOING TO BED
AU LEVER / WHEN GETTING UP
Temps d’endormissement
Time to fall asleep
Heure de réveil
Waking time
Heure de lever
Raise time
Si vous avez des commentaires, inscrivez les au verso de cette feuille / If you have somecomments, write them on the back of this sheet.
Heure de coucher / Bed time
Comment vous sentiez-vous au couchez ? / How did you feel at bedtime ?
Réveil naturel
Natural awakening
Réveil planifié Autres raisons
Other reasons
Réveil provoqué par une gêne
Disturbance
Avez-vous pris un médicament pour dormir / Did you take a drug for sleep ?Si oui, lequel / If yes, which one :
Au cours de la nuit vous êtes-vous réveillé pendant une durée importante/ Did you wake upduring the night for a significant time ?
Si oui, indiquer la durée et les heures approximatives / If yes, indicate the approximate time andduration :
Quelle a été la raison de votre réveil ? / What was the reason for your awakening ?
Planned awakening
Comment vous sentez-vous actuellement ? / How do you feel right now ?
EveilléAwake
FatiguéTired
SomnolentDrowsy
En formeFresh
61
Fresh
Sleepy
Tired
Awake
Date :Time :Name :
Fatigue evaluation( after session)
Did you feel difficulties, to remember information, to concentrate and tomaintain your attention, to interpret information or to estimate time ?
Indicate the degree through which you felt these manifestations :
Did you feel a hearing fatigue (difficulty to hearing) or a visual fatigue ?
Indicate the degree through which you felt these manifestations :
Did you feel headaches, pains in legs, in arms, in the back or in the neck ?
Indicate the degree through which you felt these manifestations :
Did you feel strained, aggressive, irritable, impatient, less interesting inyour surroundings or your environment ?
Indicate the degree through which you felt these manifestations :
HighAver
age
NoneVer
y high
Wea
k
4 - Mood
3 - Physical fatigue
2 - Sensorial fatigue
1 - Mental fatigue
According to your current feeling, write a mark on the following scales :
During the previous period, did you feel the following manifestations related with fatigue
HighAver
age
NoneVer
y high
Wea
k
HighAver
age
NoneVer
y high
Wea
k
HighAver
age
NoneVer
y high
Wea
k
62
On the following pages, you will find six scales concerning different aspects of operational loadwhich may contribute to the overall work load during the flight.Please, indicate on these six scales retrospectively your average load during the last part of theflight.
Scale 1 : Mental Demand
How much mental and perceptual activity was required (e.g. thinking, deciding, calculating,remembering, looking, searching, etc…) ?Was the work easy or demanding, simple or complex, exacting (exigeant) or forgiving ?
Low High
Scale 2 : Physical Demand
How much physical activity was required (e.g., pushing, pulling, turning, controlling, activating,etc…) ?Was the work easy or demanding, slow or brisk (rapide), slack (détendu) or strenuous (soutenu),restful or laborious ?
Low High
Scale 3 : Temporal Demand
How much time pressure did you feel due to the rate or pace (rythme ou cadence) at wich the workhad to be done ?Was the pace slow and leisurely (tranquille) or rapid and frantic (effréné) ?
Low High
NASA-TLX (Task Load Index)
Ce questionnaire en langue anglaise a été validé par la NASA
Néanmoins, certains termes n'étant pas du langage courant, unetraduction est présentée entre parenthèses et en italique
"Task difficulty" evaluation [1-3]
63
Scale 4 : Performance
How successful do you think you were in accomplishing the goals of the tasks set by the respectivework demands ?How satisfied were you with your performance in accomplishing these goals ?
Poor Good
Scale 5 : Effort
How hard did you have to work (mentally or physically) to accomplish your level of performance ?
Low High
Scale 6 : Frustration Level
How insecure, discouraged, irritated, stressed, and annoyed versus secure, gratified, content, relaxedand complacent (confiant) did you feel during the past part of the test.
Low High
"Task difficulty" evaluation [2-3]
How difficult was this session :
Veryeasy
Verydifficult
64
You will see bellow the six TLX scales presented in pairs.Please, mark a cross for the scale in each pair which was more importantin your overall workload
Mental demand Physical demand
Physical demand Temporal demand
Temporal demand Effort
Physical demand Frustration
Temporal demand Mental demand
Performance Effort
Frustration Effort
Temporal demand Performance
Mental demand Frustration
Physical demand Performance
Frustration Temporal demand
Mental demand Performance
Effort Physical demand
Performance Frustration
Mental demand Effort
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
"Task difficulty" evaluation [3-3]