EPISODE 3 - Eurocontrol...Episode 3 D3.3.3-02 - Simulation Report on Airspace Organization and...

Episode 3

D3.3.3-02 - Simulation Report on Airspace Organization and Management

Version : 1.00

of 103

Issued by the Episode 3 consortium for the Episode 3 project co-funded by the European Commission and Episode 3 consortium.

EPISODE 3 Single European Sky Implementation support through Validation

Document information

Programme Sixth framework programme Priority 1.4 Aeronautics and Space

Project title Episode 3

Project N° 037106

Project Coordinator EUROCONTROL Experimental Centre

Deliverable Name Simulation Report on Airspace Organization and Management

Deliverable ID D3.3.3-02

Version 1.00

Owner

Patricia López de Frutos Aena

Contributing partners

Isdefe, Ineco

Episode 3


Version : 1.00

of 103


- This page is intentionally blank -

Episode 3


Version : 1.00

of 103


DOCUMENT CONTROL

Approval

Role Organisation Name

Document owner AENA Patricia López de Frutos

Technical approver AENA Pablo Sanchez Escalonilla

Quality approver EUROCONTROL Frédérique Sénéchal

Project coordinator EUROCONTROL Philippe Leplae

Version history

Version Date Status Author(s) Justification - Could be a

reference to a review form or a comment sheet

1.00 25/11/2009 Approved Patricia López de Frutos

Rosana Casar Rodríguez

Mayte Cano

Alfredo Gómez

Approval of the document by the Episode 3 Consortium.

Episode 3


Version : 1.00

of 103


TABLE OF CONTENTS

EXECUTIVE SUMMARY........................................................................................................... 8

1 INTRODUCTION ............................................................................................................. 10 1.1 PURPOSE OF THE DOCUMENT ..................................................................................... 10 1.2 INTENDED AUDIENCE.................................................................................................. 10 1.3 SCOPE AND STRUCTURE OF DOCUMENT ..................................................................... 10 1.4 EXPERIMENT BACKGROUND AND CONTEXT.................................................................. 11 1.5 CONCEPT OVERVIEW ................................................................................................. 12 1.6 GLOSSARY OF TERMS ................................................................................................ 15

2 SUMMARY OF EXPERIMENT AND STRATEGY PLANNING ........ .............................. 18 2.1 EXPECTED EXPERIMENT OUTCOMES, OBJECTIVES AND HYPOTHESES .......................... 18

2.1.1 Description of Expected Experiment Outcomes.............................................. 18 2.1.2 Description of Experiment Objectives and Assumptions................................. 22 2.1.3 Description of Experiment Hypotheses ........................................................... 26

2.2 CHOICE OF METRICS AND MEASUREMENTS ................................................................. 27 2.3 CHOICE OF METHODS AND TECHNIQUES ..................................................................... 27

2.3.1 Tool/Platform description ................................................................................. 28 2.4 VALIDATION SCENARIO SPECIFICATIONS ..................................................................... 29

2.4.1 Airspace Information........................................................................................ 29 2.4.2 Actors: Roles and Responsibilities .................................................................. 31 2.4.3 Traffic Information............................................................................................ 31 2.4.4 Simulation scenarios........................................................................................ 32

3 CONDUCT OF VALIDATION EXERCISE ..................... ................................................. 38 3.1 EXPERIMENT PREPARATION........................................................................................ 38

3.1.1 Preparatory activities for Gaming on Paper Sessions..................................... 38 3.1.2 Preparatory activities for Gaming on CHILL platform...................................... 39

3.2 EXECUTED EXPERIMENT SCHEDULE............................................................................ 41 3.3 DEVIATIONS FROM THE PLANNING ............................................................................... 41

4 EXPERIMENT RESULTS................................................................................................ 42 4.1 CLARIFICATION ON AFUA CONCEPT ........................................................................... 42

4.1.1 Definition of Roles and Responsibilities .......................................................... 42 4.1.2 Criteria for location, delineation and dimension of a VGA............................... 45 4.1.3 Share use of airspace is conflicting with Capacity........................................... 46 4.1.4 Use of Capacity Opportunities ......................................................................... 48

4.2 ASSESSMENT OF THE PROCESS FEASIBILITY ................................................................ 49 4.3 EXPLORATION THE SUPPORTING TOOLS CAPABILITIES .................................................. 58

4.3.1 Definition of the What-If Tool Capabilities ....................................................... 58 4.3.2 Definition of the Supporting Tools Functionalities ........................................... 60

4.4 ASSESSMENT OF GAMING TECHNIQUE ........................................................................ 63 4.4.1 Using different supporting means.................................................................... 64 4.4.2 Accomplishment of the high level objectives ................................................... 65 4.4.3 Weaknesses, enhancements and good practices........................................... 67 4.4.4 Experts Opinions ............................................................................................. 68

4.5 CONFIDENCE IN EXPERIMENT RESULTS....................................................................... 70 4.5.1 Quality of Results of Experiment ..................................................................... 70 4.5.2 Significance of Results of Experiment ............................................................. 70

4.6 UNEXPECTED EXPERIMENT RESULTS .......................................................................... 71 5 ANALYSIS OF EXPERIMENT OUTCOMES .................... .............................................. 72

5.1 ANALYSIS OF OUTCOMES ON THE BASIS OF DETERMINED HYPOTHESES ....................... 72 5.2 ANALYSIS OF CONSEQUENCES OF OUTCOMES FOR EXPERIMENT OBJECTIVES AND ASSUMPTIONS ....................................................................................................................... 72

6 CONLUSIONS AND RECOMMENDATIONS ..................... ............................................ 77

Episode 3


Version : 1.00

of 103


6.1 KEY FINDINGS ............................................................................................................ 77 6.2 ISSUES ...................................................................................................................... 78 6.3 GENERAL RECOMMENDATIONS ................................................................................... 80

6.3.1 Recommendations for Gaming Technique Usage .......................................... 80 6.3.2 Recommendations on supporting DODs ......................................................... 82 6.3.3 Recommendations on supporting Operational Scenarios ............................... 88 6.3.4 Conclusions and Recommendations for Project Level .................................... 88

6.4 CONCLUSIONS ........................................................................................................... 88 7 REFERENCES AND APPLICABLE DOCUMENTS................ ....................................... 91

7.1 REFERENCES............................................................................................................. 91 7.2 APPLICABLE DOCUMENTS ........................................................................................... 91

8 ANNEX I .......................................................................................................................... 92 8.1 QUESTIONNAIRE BEFORE PREGAMING SESSIONS - TECHNIQUE.................................... 92 8.2 QUESTIONNAIRE AFTER GAMING SESSIONS -TECHNIQUE ............................................. 93 8.3 QUESTIONNNAIRE DEBRIEFINGS - EXAMPLE ................................................................ 98

9 ANNEX II ....................................................................................................................... 101

Episode 3


Version : 1.00

of 103


LIST OF TABLES

Table 2-1 OIs addressed linked to the objectives .................................................... 21

Table 2-2 Low level Objectives addressed .............................................................. 23

Table 2-3 Exercise Assumptions ............................................................................. 26

Table 2-4 Process Steps for Simulation Scenario #1: Location and Refinement of a VGA ................................................................................................................. 34

Table 2-5 Actors involvement for Simulation Scenario #1: Location and Refinement of a VGA .............................................................................................................. 36

Table 2-6 Process Steps for Simulation Scenario #2: Cancelation of a VGA........... 37

Table 2-7 Actors involvement for Simulation Scenario #2: Cancelation of a VGA.... 37

Table 4-1 General Advantages and Disadvantages of Sequential Process vs. Parallel Process. ........................................................................................................... 50

Table 4-2 Advantages and Disadvantages of Sequential Process vs. Parallel Process according to civil users’ involvement. ............................................................... 51

Table 4-3 Advantages and Disadvantages of Sequential Process vs. Parallel Process according to Airline Coordinator involvement. .................................................. 52

Table 4-4 Advantages and Disadvantages of Sequential Process vs. Parallel Process according to Civil Users and Airline Coordinator involvement........................... 53

Table 4-5 VGA Location and Refinement. Optimal Process .................................... 56

Table 4-6 Operational Quality Indicator ................................................................... 61

Table 4-7 Airspace Users Priorities ......................................................................... 62

Table 4-8 Example of Criteria for Trajectory Change. Commercial Airline ............... 63

Table 4-9 Example of Criteria for Trajectory Change. Low Cost Airline ................... 63

Table 4-10 Example of Criteria for Trajectory Change. Business Aviation ............... 63

Table 4-11 Example of Criteria for Trajectory Change. General Aviation................. 63

Table 4-12 Accomplishment of the High Level Objectives 1 .................................... 66

Table 4-13 Accomplishment of the High Level Objectives 2 .................................... 66

Table 4-14 Accomplishment of the High Level Objective 3 ...................................... 67

Table 5-1 Hypothesis accomplishment Summary.................................................... 72

Table 5-2 Low level objectives accomplishment ...................................................... 74

Table 5-3 Impact of Assumptions changes on objectives ........................................ 76

Table 6-1 Recommendations on Supporting DODs................................................. 87

Table 6-2 Conclusions per objective........................................................................ 90

Episode 3


Version : 1.00

of 103


LIST OF FIGURES

Figure 1-1 Synopsis of Medium/Short Term Network Planning................................ 13

Figure 2-1 Spanish-Portugal FAB............................................................................ 30

Figure 2-2 Proposed VGA shape from OS-34 ......................................................... 30

Figure 2-3 Story Board of the Simulation Scenarios: Location, Refinement and Cancelation of a VGA....................................................................................... 33

Figure 3-1 Schedule of the activities related to the WP3.3.3 Gaming Sessions ....... 41

Figure 4-1 Steps to find the most suitable VGA location, set of trajectories and Airspace Organization ...................................................................................... 46

Figure 4-2 Example 1 Access is in conflicting with Capacity.................................... 47

Figure 4-3 Example 2 Access is in conflicting with Capacity.................................... 47

Figure 4-4 Example of Historical distortions degrees............................................... 48

Figure 4-5 Optimal Process..................................................................................... 54

Figure 4-6 VGA Location and Refinement. Optimal Process Story Board................ 57

Figure 4-7 Information Flows in the What-if Tool ..................................................... 59

Figure 4-8 Information Flows in the Airspace Organizer and Optimizer Component 60

Figure 4-9 Operational Quality Indicators for every possible VGAs locations........... 62

Figure 4-10 Confidence in the Gaming Technique .................................................. 69

Figure 4-11 Usefulness of the Gaming Technique................................................... 69

Figure 4-12 High level objectives covering .............................................................. 70

Figure 6-1 Optimal Process..................................................................................... 77

Episode 3


Version : 1.00

of 103


EXECUTIVE SUMMARY

This document provides the report of Episode 3 (EP3) Work Package WP3.3.3 ”Airspace Organization and Management”. It describes the outcomes from the three planned gaming sessions that analysed the Demand and Capacity Balancing (DCB) Negotiation Processes at local/sub regional level among Civil Airspace Users, Military Users, Civil/Military Airspace Manager (AMC) and the Sub-Regional Manager (SBR). This occurs when a change of airspace reservation by military is produced.

The main objectives of EP3 WP3.3.3 were:

• Clarification of the concept in terms of collaborative planning focused on the short term phase and the end of the medium term phase (from one day to hours before the operation): Advance Flexible Use of Airspace AFUA concept and Collaborative Decision Making CDM processes;

• Assessment of process feasibility when Airspace Reservations are changed by military users when considering the dynamic diverse airspace use (AFUA concept). The civil users modify their trajectories in line with their preferences;

• Exploration the techniques and supporting tools needed to achieve an airspace organization and management efficiently adapted to changing demand considering civilian and military requests;

• Assessment of the alternative validation techniques that are best suited to these early stages of concept validation.

Gaming techniques are an innovative method for ATM Operational Concept Validation and are tested to check their suitability. In this exercise, two different types of gaming technique were used to reach the objectives:

• Gaming technique using papers; and

• Gaming technique using a hardware platform that was plugged with a what-if prototype tool to support the decision processes.

The exercise consisted of three gaming sessions . The first one was carried out through the gaming technique paper-based where four different games were designed to obtain the preliminary results according to the objectives and, some of these results were collected for the configuration of the hardware platform used in the following gaming sessions.

The next two gaming sessions were supported by the what-if prototype tool which could provide the most suitable airspace configurations to meet predicted demand with the minimum distortions to the business/mission trajectories. These Airspace Management (ASM) solutions reproduced the outputs of the what-if tools which the Airspace Managers, Sub-Regional Managers and airspace users used to perform their roles/responsibilities. Different games were played by mean of the platform to clarify the processes involved in CDM process.

Expert Groups (WP3.3.1) supported the definition of the exercises, clarifying some aspects of the ATM process and the strategies of different airspace users. Furthermore, they identified the assumptions for the gaming sessions. The results obtained in these sessions were sent as recommendations to Expert Groups (WP3.3.1) for the refinement of the M2 DOD and the related Operational Scenario OS-34 Military Collaboration in the Medium and Short Term.

Then the main outcomes from this exercise are qualitative and they are summarised thus:

• Several CDM processes were identified, analysed and detailed when a military reservation is requested in different contexts. These results will provide clarification regarding the AFUA concept and collaborative planning ;

Episode 3


Version : 1.00

of 103


• A new role/function was detected as necessary during these CDM processes. It was called Airline Coordinator . This role/function represents the airspace users and support them in the collaboration processes;

• Assessment about the gaming technique was obtained during the gaming sessions. Benefits of the use of this technique for concept clarification were found and detailed during the gaming sessions.

Episode 3


Version : 1.00

of 103


1 INTRODUCTION

1.1 PURPOSE OF THE DOCUMENT

This document provides the Validation Exercise Report for EP3 WP3.3.3 “Airspace Organization and Management”.

This document collects the results and main findings obtained during the three gaming sessions performed in EP3 WP3.3.3 exercise. They are grouped by the objectives defined for EP3 WP3.3.3 that were previously detailed in its Experimental Plan document [1].

The outcome of EP3 WP3.3.3 clarifies:

• The Collaborative Processes related to the AFUA Concept and airspace organization and management , considering the civil and military requirements, between the end of medium term phase and short term phase (from one day to some hours before the operation);

• The process feasibility when Airspace Reservations are changed by military users when considering the dynamic diverse airspace use (AFUA concept);

• The applicability of Human-in-the-Loop Gaming as a new validation technique.

This EP3 WP3.3.3 Simulation Report will feed to the integrated report of EP3 WP3 and finally to the EP3 Final Report. In turn, the results obtained from this document will feed SESAR Interim Detailed Operational Description: Medium/Sh ort Term Network Planning – M2 [6] and Military Collaboration during Medium/Short Term Pla nning Operational Scenario OS-34 [7].

1.2 INTENDED AUDIENCE

EP3 WP3.3.3 simulation report is intended for use by the exercise leaders involved in EP3 WP3 and in EP3 WP2.3 Validation Process Management for the consolidated validation strategy. The outcome of the validation exercise will also be presented to the EP3 WP3.3.1 Network Planning Expert Group whose participants have been deeply involved during the definition, preparation and running of EP3 WP3.3.3 validation activities. Later on, this report will contribute to the EP3 WP3 report (D3.4-01) and EP3 Final Report (D2.5-01).

The intended audience includes:

• EP3 WP3 participants:

o EP3 WP3 Leader;

o EP3 WP3.2 Validation strategy, support and operational concept refinement;

o EP3 WP3.3.1 Network Planning Expert Group.

• Other Episode 3 partners;

• SJU Project Managers.

1.3 SCOPE AND STRUCTURE OF DOCUMENT

The scope of this document is the description of the objectives of EP3 WP3.3.3 Airspace Organization and Management and how the Validation Exercises were prepared and executed. Finally, it provides a detailed analysis of the results obtained, including conclusions and recommendations.

The document is structured in seven main parts.

Episode 3


Version : 1.00

of 103


• Section 1 provides a general introduction to the document, detailing the scope, the background and the concept addressed by the exercise;

• Section 2 details the objectives, the expected outcomes together with the methodology, indicators and metrics, hypotheses and scenarios to be tested;

• Section 3 describes how the gaming sessions were designed and performed;

• Section 4 describes the results obtained from the sessions;

• Section 5 analyses the results described in section 4;

• Section 6 provides a set of conclusions and recommendations;

• Section 7 contains the list of applicable and reference documents.

1.4 EXPERIMENT BACKGROUND AND CONTEXT

This document reports on the validation exercise EP3 WP3.3.3 “Airspace Organization and Management” which is done within EP3 WP3 “Collaborative Planning Processes”.

Episode 3 is charged with beginning the validation of the operational concept expressed by SESAR Task 2.2 and consolidated in SESAR D3 [2]. The initial emphasis is on obtaining a system level assessment of the concept’s ability to deliver the defined performance benefits in the 2020 time horizon corresponding to ATM Capability Level 2/3 and the Operational Improvement Step IP 2.

The validation process as applied in EP3 is based on version 2 of the E-OCVM [11], which describes an approach to ATM Concept validation, and is managed and coordinated by EP3 WP2.3.

In order to prepare the validation exercises, an experimental plan was produced according to step 2 of the E-OCVM.

Based on the corresponding exercise plan, Validation exercises should provide evidence, preferably measured, about the ability of some aspect of the concept to deliver on some aspect of the performance targets. According to step 4 of the E-OCVM [11], an exercise report should be produced to lay down the evidence of qualities and shortcomings together with issues and recommendations.

EP3 WP3.3.3 aims at clarifying the SESAR concept in terms of the AFUA Concept and the related DCB Negotiation Processes that occur at FAB level among Civil & Military Airspace Users, Civil/Military Airspace Managers (AMC) and the Sub-Regional Manager (SBR). This occurs in the timeframe from one day to several hours ahead..

It analyses if these DCB Negotiation Processes at local/sub-regional level (FAB) are operationally feasible when a change of airspace reservation by military users is produced.

A set of three gaming sessions were planned and different games were designed to reach the objectives described for this exercise. This document reports on the validation exercise EP3 WP3.3.3 “Airspace Organization and Management” which is done within EP3 WP3 “Collaborative Planning Processes”.

The content of this document will support to EP3 WP3.3.1 Network Expert Group, directly involved during the preparation and performing of the gaming sessions, for the refinement of DOD [6] and OS [7] documents.

Finally, the results and conclusions contained in this document will serve as contribution to perform the integrated report of WP3 and the Final Report of EP3 project.

Episode 3


Version : 1.00

of 103


1.5 CONCEPT OVERVIEW

The applicable DOD for this exercise is DOD M2 [6] . This DOD focuses on the operating principles relevant to the Medium/Short Term Planning Phase for:

• Network management;

• Airspace management;

• Airspace user operations, when interacting with the network management function.

A synopsis of Medium/Short Term Network Planning, extracted from this DOD [6], is presented in Figure 1-1 to show the interactions between the three Services (Plan Traffic and Airspace Requirements, Refine ATM Resources, Balance Planned Demand and Capacity). They are provided through a number of key processes related to Airspace User Operations (in blue), Airspace Organisation and Management (in green), Demand and Capacity Balancing (in orange).

The most relevant aspect of EP3 WP3.3.3 Airspace Organization and Management is that all the DCB solutions applied by this exercise are related just to airspace at local level and focused at the end of medium term and during short term.

Episode 3


Version : 1.00

of 103


Figure 1-1 Synopsis of Medium/Short Term Network Pl anning

Episode 3


Version : 1.00

of 103


The link between the EP3 WP3.3.3 and the mentioned processes operates as follows:

• “Airspace Users declare their flight intentions and optimise their trajectory through SBTs (A2.1.2.2 and A2.1.2.3), in accordance with their business model – the NOP being visible to them at all times.“;

o The exercise is focused between a day before the operation (end of the medium term phase) and 2 hours before the operation (the short term phase). By this timeframe the final military intentions are refined and would affect the airspace reservation;

o The optimisation, validation and refinement of the SBTs have been part of the negotiation in the exercise. Different user’s business models have been considered in the exercise.

• “The airspace is organised so as to respect their preferences and provide enough capacity (A2.2.1.2, A2.2.1.3 and A2.2.2.2), taking into account airspace requirements (A2.1.1)”;

o The gaming exercises have been focused on the military airspace requirements at short notice to perform exercises in ad-hoc structures not covered by predefined scenarios (A2.2.1.2);

o During the gaming sessions, a what-if tool has supported the Civil/Military Airspace Managers and Sub-Regional Manager to select the different airspace configurations (A2.2.2.2) from a set of predefined solutions surrounding the military airspace reservation. The what-if tool have provided indicators in real time such as demand and capacity balancing in terms of movements, number of saturated sectors, total open sectors, movements not handled with the selected sectorization, etc.. that have supported the Civil/Military Airspace Managers and Sub-Regional Manager to make decisions regarding airspace configurations.

o The military airspace requirements (A2.1.1) along with the new trajectories from civil users have been considered as an input for the what-if tool to select the different airspace configurations to respect the users’ preferences. The gaming has been triggered by a modification of military request for airspace reservation;

o Since airport usage rules are not considered, A2.2.1.3 is not covered (network usage rules). These airspace configurations have been considered as inputs for the gaming at the beginning of the negotiation;

o According to the DOD the process aims at refining the possible configurations that are part of the available capacity plan established in the long term and medium term planning phase. As the exercise is focused at the end of medium term and short term, and the airspace organization for future is not known, the prototype tool (modelling) has considered the elementary volumes that according to the expected demand will be combined to provide a set of airspace configurations. The best airspace configurations are based on the capacity imbalance expected for the day of operations and the users intentions.

• “The planned traffic and airspace demand (A2.1.2.4 and A2.1.1) and the planned capacity (A2.2.3.2) are evaluated by the Network Management function, so as to detect potential imbalances (A2.3.1.2)”;

o The planned traffic demand has been compared to the scheduled capacity to establish the local load plan and detect local imbalances.

Episode 3


Version : 1.00

of 103


• “In case of imbalance, a DCB Solution is selected in the Catalogue or elaborated with possible network impact assessment (A2.3.2.2.1, dotted arrow)”;

o The DCB solutions considered in the exercise are focused only at Airspace level in a FAB. The most suitable airspace configuration solutions have been selected from a set of predefined airspace configurations;

o According to the DOD, the application of airspace DCB Solutions are local to the airspace element (FAB, ACC, any other airspace volume): this/these solution(s) can be based on airspace configurations inc. military activity, temporary route structure, flight level capping, advisory routing, queue management (inc. UDPP). For this exercise airspace configuration, flight level capping, flight merging, delay on ground and re-routing have been applied as solutions;

o For the gaming that has been triggered by a new military request or cancellation of airspace reservation, if an imbalance is detected, a negotiation process has been initiated. A what-if tool has supported the gaming for the selection of the ASM solution from a set of predefined configurations;

o The gaming has simulated a CDM including military users, civil users, Civil/Military Airspace Manager and a Sub-Regional Manager responsible for selecting, proposing and applying the best DCB solution.

• “The solution is then applied (A2.3.2.2.2), resulting in capacity adjustments (triggering A2.2.1.2, A2.2.1.3 and A2.2.2.2) and possibly demand adjustments if advisories are notified or constraints are necessary (triggering A2.1.2.2). Airspace reservations are also optimised accordingly, if possible (triggering A2.1.1). UDPP is exceptionally triggered to prioritise flights (A2.1.3, dotted arrow)”.

o The exercise has analysed the operational feasibility of the processes associated to AFUA, refining the traffic demand and the airspace configuration. Therefore the output coming from the gaming has consisted of refined SBTs that are the result of the CDM triggered by a new airspace reservation by military users. In turn, the gaming has provided, as an output, a refined airspace configuration, which is the most suitable in terms of access and equity and capacity balancing (A2.2.1.2, A2.2.1.3 and A2.2.2.2).

EP3 WP3.3.3 addresses Operational Improvements (OI) steps corresponding to the Implementation Packages (IP) 1 and 2. As mentioned in EP3 WP3 Validation Strategy [5], the R&D activities related to EP3 WP3 scope (Collaborative Planning) are less mature than in other areas, and hence the starting point is different to EP3 WP4 (En-route Operations at Execution Phase) and EP3 WP5 (Airport and TMA Operations at Execution Phase). Although EP3 focuses on the 2020 timeframe looking at improvements implemented within Implementation Package 2 (IP2), in those aspects of the SESAR CONOPS related to the collaborative layered planning, there is still high uncertainty in IP1. Therefore, it is necessary to work at this level defining how the basic processes will work.

1.6 GLOSSARY OF TERMS

Term Definition

ACC Airspace Control Centre

AOCCo Airline Operation Centre Coordinator

AENA Aeropuertos Españoles y Navegación Aérea

AFUA Advanced Flexible Use of Airspace

AMC Airspace Management Cell

ANSP Air Navigation Service Provider

Episode 3


Version : 1.00

of 103


Term Definition

AOC Airline Operation Centre

ASM Airspace Management

ATC Air Traffic Control

ATFM Air Traffic Flow Management

ATFCM Air Traffic Flow and Capacity Management

ATM Air Traffic Management

CDM Collaborative Decision Making

CDR Conditional Route

CFMU Central Flow Management Unit

CHILL Collaborative Human in the Loop Laboratory

CONOPS Concept of Operations

DCB Demand/Capacity Balancing

DCMAC Directorate of Civil-Military ATM Coordination

DOD Detailed Operational Description

EC European Commission

ECAC European Civil Aviation Conference

E-OCVM European Operational Concept Validation Methodology

EUROCONTROL European Organization for the Safety of Air Navigation

EP3 Episode 3

FAB Functional Airspace Blocks

FL Flight Level

FUA Flexible Use of Airspace

FOC Final Operational Capability

GAT General Air Traffic

HMI Human-Machine Interface

IBERIA IBERIA Airlines

ISDEFE Ingeniería de Sistemas para la DEFEnsa de España

IOC Initial Operational Capability

IP Implementation Package

KPA Key Performance Area

KPI Key Performance Indicator

LCIP Local Convergence and Implementation Plan

MET METeorology

MIL MILitary

MVPA Military Variable Profile Area

NM Nautical Miles

NOP Network Operations Plan

Episode 3


Version : 1.00

of 103


Term Definition

NOPLA Network Operations Plan Applications

OI Operational Improvement

OS Operational Scenario

RBT Reference Business Trajectory

SESAR Single European Sky ATM Research in Air Transportation

SESAR JU SESAR Joint Undertaking

SBT Shared Business Trajectory

SBR Sub-Regional Manager

SUA Special Use of Airspace

STATFOR STATistical FORcasts

SWIM System Wide Information Management

TMA Terminal Manoeuvring Area

TSA Temporary Segregated Area

TRA Temporary Restricted Area

UDPP User Driven Prioritisation Process

VGA Variable Geometry Area

WP Work Package

Episode 3


Version : 1.00

of 103


2 SUMMARY OF EXPERIMENT AND STRATEGY PLANNING

2.1 EXPECTED EXPERIMENT OUTCOMES, OBJECTIVES AND HYPOTHESES

2.1.1 Description of Expected Experiment Outcomes

EP3 WP3.3.3 aims at gaining insight into the interactions of the different involved actors and the information needed to support the decision making processes when any change in the military airspace requirements (at end of medium term and in short-time) affects the airspace organization and management, interferes with the civil flights and modifications must be made in the NOP.

In order to achieve this goal, the negotiation processes at FAB level, between civil and military actors, Civil/Military Airspace Managers and Sub-Regional Manager and their responsibilities, are reproduced in order to determine whether the processes are feasible or not.

The high-level objectives for this exercise and the initial expectations from EP3 WP3.3.3 are described in the following bullets. It is necessary to highlight that at the end of this section, the modifications with respect to the EP3 WP3.3.3 Experimental Plan [1] are included:

• Objective 1: Clarification of the concept in terms of collaborative planning focused at short term phase and partially medium term phase i.e. from one day to some hours before the operation when there is a sudden change in military airspace reservation.

EP3 WP3.3.3 is not focused on validation of the concept. The concept is not mature enough and as a consequence the main outcome is a qualitative assessment of two main aspects of the concept both in IP1 and IP2:

o Advanced Flexible Use of Airspace (AFUA concept);

o Agreement of the Business / Mission Trajectories through collaborative flight planning when there is a change in military airspace reservation.

Clarification of both aspects includes the definition of the steps in the CDM processes and how the coordination of the roles takes place to find the best airspace solution when a military reservation is requested at short notice.

• Objective 2: Assessment of process feasibility when Airspace Reservations are changed by military users considering the dynamic diverse airspace use (AFUA concept).

The different processes involved when military changes the location or timescale of a reserved area have been analyzed. The users will have the opportunity to change trajectories to best fit their preferences. The Civil/Military Airspace Manager along with the Sub-Regional Manager will have to provide the most suitable airspace configuration considering civil and military needs. Through the configuration or design of different scenarios, the different processes involved in each of the pre-configured situations were assessed.

• Objective 3: Exploration the techniques and supporting tools needed to achieve an airspace organization and management efficiently adapted to changing demand considering civilian and military requests.

The exercise has analysed and identified the potential functionalities of a what-if tool for airspace organization which will support the decisions of Airspace Managers and Sub-Regional Managers, providing the most suitable airspace configurations. In

Episode 3


Version : 1.00

of 103


addition, several requirements for the supporting tools for the rest of roles involved in the processes have been identified.

• Objective 4: Assessment of alternative validation t echniques suited to these early stages of concept validation e.g. the Human-in-the-loop gaming techniques.

The outcome of the exercise was expected to enhance these techniques for validation of operational feasibility of processes. Two alternatives of gaming technique were used:

o Gaming based on papers (the only material used in the design and the trial of the game is paper);

o Gaming on a dedicated software platform called CHILL and plugged with a what-if tool for supporting the decision processes. CHILL allows simulating the pre-designed situations in a more realistic way and so, the behaviour of the players/roles, communications between the actors and the operation with the tools would be near to the reality.

During the definition of EP3 WP3.3.3 Experimental Plan [1], CHILL was considered as a suitable validation tool for addressing process feasibility. It was expected that the use of CHILL would increase the confidence on the results than the one obtained through other techniques such as Expert Groups. On the other hand, EP3 WP3.3.3 examined the added value of using a dedicated gaming platform above the paper-based.

It was initially planned to use a what-if prototype tool plugged to CHILL platform comprised of three main components:

o Workload calculator module which estimates the expected workload for every operational controller for all the predefined configurations: the one which is applied in that moment and the rest of predefined sector configurations;

o Optimizer module which calculates the optimum sector configuration at each moment through user selected criteria;

o HMI (Human Machine Interface) is the interface where all graphical data are shown. This interface will be integrated in the Sub-Regional Manager Position.

However, due to time constraints it was impossible to develop such a tool with the automation initially planned and it was preferred to enhance the CHILL platform.

The functionalities that the what-if tool that have supported the Civil/Military Airspace Managers and Sub-Regional Manager to make decisions regarding airspace configurations finally were:

• A set of predefined airspace configurations;

• A calculator in real time of high level indicators for every airspace configuration, such as: demand and capacity balancing in terms of movements, number of saturated sectors, total open sectors, movements not handled with the selected sectorization, etc... The selection of the most suitable airspace configuration was done manually by the Civil/Military Airspace Managers and Sub-Regional Manager.

In the EP3 WP3.3.3 Experimental Plan [1], it is described the possibility to do a preliminary assessment about the impact of the processes on the key performance areas and a performance assessment of the best airspace configuration to optimise the network. This assessment would have to be performed through the events recorded in the gaming platform and the what-if prototype tool.

As it was mentioned, the design and the definition of the exercises were finally performed to get more qualitative results and evaluate the feasibility of the processes.

Episode 3


Version : 1.00

of 103


Events recorded in the different components of the platform were not significant due to the performing of the different games (processes were not performed in a realistic way in terms of time, no several runs could be managed). Then, no indicators and no impact on the key performance areas could be identified. This was previously identified as risk 6 in the EP3 WP3.3.3 Experimental Plan [1].

The table below provides the list of the OI steps addressed in the exercise linked to the corresponding objectives described in the paragraphs above:

OI Title OI

Step Id

OI Step Title

OI Step Description

OI Step Rationale

IP IOC/FOC

How addressed?

[L02-03]

From FUA to Advanced FUA

High Level Objective 2&3

AOM-0202

Enhanced Real-time Civil-Military Coordination of Airspace Utilisation

Real-time coordination is further enhanced through what-if functionalities and automated support to airspace booking and airspace management (e.g. integrated toolset allowing AMC and other parties to design, allocate, open and close military airspace structures on the day of operations).

Progress has been made in the recent years to facilitate exchanges between civil and military units through the deployment of a civil-military ATM-air defence coordination tool (integrated civil and military air information picture). However, civil-military interoperability is to be increased especially to cater for the requirements for more dynamic use of airspace. Furthermore, air defence and security concerns remain high, implying the continued need for efficient detection of renegade targets.

IP1 2009/2013

This OI step has been addressed by identifying the tool capabilities needed for airspace booking and management when military changes the airspace reservation.

Episode 3


Version : 1.00

of 103


OI Title OI

Step Id

OI Step Title

OI Step Description

OI Step Rationale

IP IOC/FOC

How addressed?

[L02-03]

From FUA to Advanced FUA

High Level Objectives 1&2

AOM-0206

Flexible Military Airspace Structures

The possibility for ad-hoc structure delineation at short notice is offered to respond to short-term airspace users' requirements not covered by pre-defined structures and/or scenarios. Changes in the airspace status are uplinked to the pilot by the system.

The objective is to better respond to military airspace requirements and/or meteorological constraints while giving more freedom to GAT flights to select the preferred route trajectories and to achieve more flexibility from both civil and military partners.

IP2 2016/2021

A VGA (Variable Geometry Area) has been analysed in the gaming to clarify the operational feasibility of the related processes when one is implemented at short notice.

[L03-03]

Planning the Shared Business Trajectory (SBT)

High Level Objective 2

AUO-0204

Agreed Reference Business / Mission Trajectory (RBT) through Collaborative Flight Planning

Airspace users can refine the Shared Business / Mission Trajectory (SBT) in a number of iterations taking into account constraints arising from new and more accurate information. They access an up-to-date picture of the traffic situation with the level of detail required for planning (incl. Historical data, forecasted data, already known intentions, MET forecast, current traffic, ASM situation). The collaborative planning process terminates when the Reference Business / Mission Trajectory (RBT) is published.

IP2 2016/2021

This OI step has been addressed during the gaming sessions.

The airspace users had the opportunity to change their trajectories when airspace demands are changed by military.

Table 2-1 OIs addressed linked to the objectives

Episode 3


Version : 1.00

of 103


OI step AOM-0205 Modular Temporary Airspace Structures and Reserved Areas could not be finally addressed by EP3 WP3.3.3. The initial intention reflected in EP3 WP3.3.3 Experimental Plan document [1] consisted of considering different types of reservation areas e.g. MVPA and VGA. Finally, and due to time constraints, the reservation area selected to be implemented in the exercise was the VGA. The VGA was included in the description of the operational scenario in which this exercise is based on i.e. OS-34 document [7]. The stakeholders’ performance expectations identified in EP WP3.3.3 Experimental Plan document [1] could not be verified / falsified. The qualitative nature of the results obtained through the validation runs could not provide insight on the performance benefits linked to the OIs addressed by EP3 WP3.3.3. As it was mentioned in EP3 WP3.3.3 Experimental Plan, the exercise main objective is to clarify the processes feasibility and the roles and responsibilities than to provide measurable or quantitative results.

2.1.2 Description of Experiment Objectives and Assumptions

EP3 WP3.3.3 is an exercise for concept clarification, identification of the tools requirements necessary to perform the processes and also exploration of the new validation techniques, in this specific case, Gaming technique. It is necessary to highlight that the objectives defined in the experimental plan and afterwards, in the design of the exercises do not address any performance areas.

2.1.2.1 Objectives

Section 2.1.1 details a summary of EP3 WP3.3.3 main objectives. The following table come down to be more specific and concrete in the description of the objectives addressed for this exercise. The mentioned table also reflects those low level objectives that were initially identified in EP WP3.3.3 Experimental Plan document [1] but that finally they couldn’t been addressed.

Low Level Objectives as they are in the Experimental Plan Outcomes

#1a: The Flexible Use of Airspace (FUA) process is improved with more dynamic airspace management enabling dynamic responses to short notice military airspace requirements (up to 3 hours before operations) or very short term changes (e.g. bad weather);

Successfully covered.

See §4.1.2, 4.1.3 and 4.1.4.

#1b: Real-time coordination to design, allocate, open and close military airspace structures on the day of operations (short term phase)


See §4.1.2, 4.1.3 and 4.1.4.

#1c: The possibility for ad-hoc structure definition at short notice is offered to respond to short-term airspace users' requirements not covered by pre-defined structures and/or scenarios

Successfully covered. See §4.1.2, 4.1.3 and 4.1.4.

Hig

h Le

vel O

bjec

tive

#1

Clarification of the SESAR Concept in the following aspects

#1d: The route network will evolve to fewer pre-defined routes with the exploitation of advanced navigation capabilities and generalisation of FABs not constrained by FIR boundaries, allowing for more direct routes and free routing. However, it is assumed that some form of route network will be retained to cater for specific requirements (e.g. corridors/routes for capable aircraft through the military area, military flight planning, etc.)

Not addressed.

Episode 3


Version : 1.00

of 103


Low Level Objectives as they are in the Experimental Plan Outcomes

#1e: Airspace users can refine the Shared Business / Mission Trajectory (SBT) taking into account constraints arising from new and more accurate information. They access to an up-to-date picture of the traffic situation with the level of detail required for planning (incl. Historical data, forecasted data, already known intentions, MET forecast, current traffic, ASM situation, etc.).


See §4.1.2, 4.1.3 and 4.1.4.

#1f: Clarification on the definition of the roles and responsibilities of all actors involved in the exercise (Users, Military, Civil/Military Airspace Managers, and Sub-Regional Manager


See §4.1.

Hig

h Le

vel

Obj

ectiv

e #2

#2a: Providing evidence of the operational feasibility of the collaborative planning processes involved when Airspace Reservations are changed by military users by considering the dynamic diverse airspace use (AFUA concept)


See §4.2.

#3a: Identification of the potential functionalities of what-if tools to support the selection of the airspace configurations and management which will support the decisions of Airspace Managers and Sub-Regional Managers


See §4.3. Furthermore, supporting tools capabilities for civil users were also detected.

#3b: Exploration the possibility of creating a what-if prototype tool with some of the potential functionalities to obtain the most suitable airspace configurations considering the civil and military needs

Not fully addressed due to effort limitations.

Hig

h Le

vel O

bjec

tive

#3

#3c: Identification of which are the set of criteria relevant to select the most suitable airspace configurations (e.g. minimise network effect, optimise flight efficiency (both temporal and fuel efficiency), minimise the impact on users’ initial requirements, etc.). These criteria should be included as functionalities of the what-if prototype tool



#4a: Test, as an innovative validation mean, the integration of validation techniques (gaming + what-if prototype tool)

Not fully covered. This analysis has been done with expert judgement.

#4b: Analysis of gaming technique as an innovative mean for clarification of the concept


See §4.4.

Hig

h Le

vel O

bjec

tive

#4

#4c: Preliminary assessment if possible, because of the combination of the what-if prototype tool and the gaming platform, events could be recorded after the gaming sessions and therefore a preliminary assessment could be done.

Not covered.

Table 2-2 Low level Objectives addressed

2.1.2.2 Assumptions

This section details all the assumptions established for EP3 WP3.3.3. Some of these assumptions have been modified. In order to track the changes with respect to the EP3

Episode 3


Version : 1.00

of 103


WP3.3.3 Experimental Plan document [1], Table 2-3 gathers the modifications regarding the assumptions.

Assumptions stated for the exercise:

• The Regional Manager does not participate part of the gaming. The effect on the Network is not considered since the exercise assumes that the Sub-Regional Manager solutions do not have a negative impact on the Network;

• The Complexity Manager role is not considered within the scope of this exercise. This actor performs tasks during execution phase;

• Only Managed airspace is considered;

• Weather conditions: weather constraints e.g. bad weather conditions, storms are not be considered;

• Ideal Equipment: no systems failures and consequently no emergencies are considered;

• The timeframe of the Exercise is medium term close to short term i.e. from one day to two hours before the operation. Initially, all trajectories are SBTs;

• Airport usage rules are not considered;

• Traffic uncertainty at the short-term planning phase does not affect the results as EP3 WP3.3.3 is mainly focused on operational feasibility and the traffic uncertainty does not affect the processes;

• The military activities are classified in two categories:

o Major/Special Exercises: The yearly plan contains the planned exercises in terms of airspace impact e.g. international, national, regional, altitude, managed and/or unmanaged airspace. This plan is defined through CDM sessions between civilians and MIL. Some weeks before the Day of Operation, the location, size and timeframe of these military activities are refined;

o Day to day Exercises: These activities are planned the day before the Day of Operation or even the same day. They are defined through CDM sessions between the Civil and Military Airspace Managers.

The Scenarios implemented in the gaming sessions are focused in the day to day exercises. This assumption is different to the one described in EP3 WP3.3.3 Experimental Plan document [1];

• The role of the military/civil pilots is not included in the gaming sessions.

Concept Assumptions

• The airspace capacity plan defined at the end of the medium term planning phase is consistent with the target airspace capacity. This means that enough capacity can be provided en-route to cope with the foreseen traffic, taking into account the airspace requirements defined in the long-term;

• The DCB solutions considered in the exercise are focused only at Airspace level in a FAB. The catalogue of airspace DCB solutions contains ASM solutions to (re)organise airspace in response to an imbalance, with an integrated view of traffic demand and airspace requirements. They would consist of predefined solutions: change of sectorizations;

• The best airspace configurations are based on the maximum throughput handled by considering sector capacities expected for the day of operations and the users intentions;

Episode 3


Version : 1.00

of 103


• The methodology to detect imbalances is based on Traffic throughput vs. Capacity. The capacity values have been tuned to comply with the objective of each gaming session, e.g. when analysing share use of airspace in conflict with capacity, the capacity values were modified to reproduce this situation;

• There are no Queue Managements measures applied as DCB measures, including UDPP;

• At FAB level, the Airspace Manager and the Sub-Regional Manager can be merged in only one role performing all the related functions.

Assumptions extracted from the OS-34 [7]

• SWIM-enabled NOP is operational, 75% of the aircraft are nodes connected to the network via SWIM. However, in the gaming exercises, a rate of 100% of equipped aircraft was considered for simplification purpose;

• Full application of FUA concepts in place in Spain and Portugal providing the basis for the next step to AFUA;

• Equity will be given to meeting the needs of civil Airspace Users and military requirements;

• ATM Service Level 31 is operational, 75%2 of the flights are capable of ATM Service Level 3 operations. However, in the gaming exercises, a rate of 100% of equipped aircraft was considered for the purpose of simplification.

Assumption as it is in the Experimental Plan Modification

The timeframe of the Exercise is medium term close to short term i.e. from one day to two hours before the operation. Initially, all trajectories are SBTs. However, RBTs are considered just in the case that the airport origin is far from the area

The timeframe of the Exercise is medium term close to short term i.e. from one day to two hours before the operation. All trajectories are considered SBTs.

The definition of airspace configurations is related to airspace volumes but also route and may combine both of them e.g. routes to activate depending on sector configuration. The Airspace Organization would consist of predefined solutions: Temporary Route Structures and Change of sectorizations.

The definition of airspace configurations is related to airspace volumes. The Airspace Organization would consist of predefined solutions (change of configurations).

• The catalogue of airspace DCB solutions contains ASM solutions to (re)organise airspace in response to an imbalance, with an integrated view of traffic demand and airspace requirements;

The DCB solutions considered in the exercise are focused only at Airspace level in a FAB. The catalogue of airspace DCB solutions contains ASM solutions to (re)organise airspace in response to an imbalance, with an integrated

1 ATM Service Level 3 is characterized by:

• Achieving advanced automation in a shared trajectory environment;

• Dynamic TMAs and Flexible Military structures;

• Dynamic DCB using RBT;

• Management Revision of RBT using Datalink;

• Full set of Advanced Controller tools using RBT/SBT;

• ASEP-ITP;

• 2D-PTC on User Preferred Trajectories;

• 3D-PTC on Predefined Routes.

2 According to SESAR D5 delivery [3], 25% of aircraft could be ATM level 2 capable. The proposed 75% value

includes flights ATM level 2 capable. AFUA supposes ATM level 3 capabilities.

Episode 3


Version : 1.00

of 103


Assumption as it is in the Experimental Plan Modification

• The DCB solutions considered in the exercise are focused only at Airspace level in a FAB:

o Airspace configuration including military activity;

o Temporary route structure.

view of traffic demand and airspace requirements. They consist of predefined solutions: change of sectorizations.

The best airspace configurations are based on the traffic complexity expected for the day of operations and the users intentions;

The best airspace configurations are based on the maximum throughput handled by considering sector capacities expected for the day of operations and the users intentions.

The methodology to detect imbalances is based on traffic complexity (ATC Workload) measurement when the maximum admissible values are reached

The methodology to detect imbalances is based on Traffic throughput vs. Capacity. The capacity values have been tuned to comply with the objective of each gaming session, e.g. when analysing share use of airspace in conflict with capacity, the capacity values were modified to reproduce this situation.

The mission trajectories should be considered as if they were business trajectories and affect the workload of the controller when they fly from their airbase to the airspace reservation. The degree of workload affection will be dependent on:

• The distance between the airbase and the airspace reservation;

• The civil traffic density during this aforementioned transition;

• The number of military flights flying to the airspace reservation

Removed as workload assessment has not been performed.

SWIM-enabled NOP is operational 75%. The non equipped aircraft are penalised: they are out of the negotiation and have to accept any solution

SWIM-enabled NOP is operational, 75% of the aircraft are nodes connected to the network via SWIM. However, in the gaming exercises, a rate of 100% of equipped aircraft was considered for simplification purpose.

ATM Service Level 3 is operational, 75% of the flights are capable of ATM Service Level 3 operations

ATM Service Level 33 is operational, 75%4 of the flights are capable of ATM Service Level 3 operations.

Table 2-3 Exercise Assumptions

2.1.3 Description of Experiment Hypotheses

The list below contains the main hypothesis identified for this exercise and extracted from EP3 WP3.3.3 Experimental Plan document [1].

The DCB Negotiation Processes at local/sub-regional level between Civil/Military Airspace Users, Civil/Military Airspace Manager and the Sub-Regional Manager when a change of airspace reservation by military is produced:

• H1: will be operationally feasible;

• 3D-PTC on Predefined Routes.

Episode 3


Version : 1.00

of 103


• H2: will increase the airspace capacity through the identification of the most suitable airspace configuration adapted to the military and civil users (AFUA Concept);

• H3: will increase the flight efficiency, both temporal and fuel efficiency, as the distortion of users trajectories will be minimised;

• H4: will increase flexibility to manage changes in Airspace Reservations: quick reaction to take advantage of capacity opportunities due to the release of an initially planned military airspace reservation.

Due to the design of the exercises was oriented to clarification of processes and concepts, no quantitative assessment about the airspace capacity, flight efficiency and flexibility was obtained, and then the hypothesis H2, H3, and H4 could not be demonstrated or assessed.

2.2 CHOICE OF METRICS AND MEASUREMENTS

EP3 WP3.3.3 validation exercise provides indicators on:

• Operational feasibility: extracting and analysing information from questionnaires and debriefing sessions generated during the gaming sessions. EP3 WP3.3.3 results provide insight information on issues such as:

o How do the different actors feel about the problem / solution?

o Which are the conditions where there is no agreement between different actors?

o How will the working environment (tools, information availability, etc.) of the actors change? How can the different actors be adapted to the change?

o Impact on actors’ situational awareness, procedural and working methods, etc;

o Definition of the roles and responsibilities during the negotiation process and identification of potential ambiguities;

o Identification of potential bottlenecks in the process.

EP3 Performance Framework [9] is focused on performance assessment and a set of selected KPAs, so metrics and indicators related to Operational Feasibility are not covered in it.

• Gaming as a validation technique: extracting and analysing information from the dedicated questionnaires filled in by the participants during the gaming sessions to assess the technique for validation concept purpose. The assessment of the gaming technique is based on the following data:

o Participant’s feeling about the gaming technique;

o Confidence on the results obtained during the gaming sessions;

o Added value (if any) of using a dedicated software platform during the gaming sessions respect to other gaming techniques e.g. based on paper, Expert groups;

o Evaluation of the gaming technique based on a set of factors such as: Usefulness, reliability, accuracy, understanding, liking and easiness.

2.3 CHOICE OF METHODS AND TECHNIQUES

EP3 WP3.3.3 is focused on operational feasibility of the processes emulated during the gaming sessions. For that purpose, a set of different methods were applied in order to collect as much information as possible. These methods consist of a combination of:

Episode 3


Version : 1.00

of 103


• Structured questionnaires: designed on purpose and used during the three gaming sessions for two main purposes:

o Questionnaires on the concept addressed: These questionnaires were tailored for each game containing also different questions/content depending on the role played by the participant in each game. The structured questionnaires had a specific relevance during the debriefing sessions which took place at the end of each game since the collected answers were discussed by all participants, identifying agreed conclusions, disagreements or open issues.

o Questionnaires on the Gaming Technique: Distributed before and after each gaming session, these questionnaires collected the participants’ initial expectations and final feedback on gaming as a validation technique for concept clarification purposes.

These questionnaires include two types of questions:

o Open questions, where participants were requested to give their opinion, understanding or consideration to a definition, statement or idea. All alternatives were valid;

o Scoring questions, where gamers evaluated the elements giving a score.

These questionnaires can be found in Annex I. Section 4 of this document reports the output and analysis of the answers to these questionnaires filled by all participants during the gaming sessions;

• Communications between participants: all communications between the different roles playing during the games were collected and/or recorded and, at the end of each game, analysed during the debriefing sessions. The means for recording the communications depend on the gaming technique used:

o Gaming technique on papers: the conversations are registered through specific paper templates;

o Gaming technique on CHILL platform: the participants had at their disposal a specific Chat tool to maintain conversations with any other participant/s when they needed. All the conversations were automatically recorded by the tool, and later on presented to the participants at the end of each game for further analysis.

2.3.1 Tool/Platform description

EP3 WP3.3.3 validation exercise was carried out on CHILL platform. CHILL5 is a versatile collaborative ATM validation platform. In CHILL, different categories of actors can work together to efficiently manage traffic demand and capacity, exchange ATM data and share information in support of a collaborative ATFM planning process. The CHILL modelling Platform has been designed as a suite of interoperable modelling services and components to support the evaluation, performance assessment and validation of existing and future ATM concepts of operation.

• Sub-Regional Manager/Network Manager use CHILL to:

o Adapt and plan airspace configuration to suit airspace users needs;

o Enable airspace users to provide alternatives when there is a mismatch between capacity and demand;

5 Collaborative Human-In-The-Loop Laboratory.

Episode 3


Version : 1.00

of 103


o Provide final arbitration decisions when users are unable to resolve resource contention.

• Airspace users use CHILL to:

o Access to the pool of common information, including traffic demand, airspace status, etc;

o Create/update flight profiles;

o Check flight profiles against the known airspace constraints;

o Trial plan alternative profiles for flights;

o Exchange these alternative plans with other participants.

• Military users use CHILL to:

o Plan special use of airspace (SUA);

o Upload the created/updated SUA to the pool of common information;

o Notify other participants;

o Monitor projected demand on the SUA.

Sub-Regional Manager and Airspace Managers (Civilian and Military) disposed of two CHILL platforms:

• One representing the actual NOP, available for all participants;

• A second one, operating as a what-if tool , where these roles had the opportunity to analyse/assess his/her own alternatives or other participants’ proposals received before publishing the final decision in the NOP and thus making it available for the rest of participants. Some of the what-if tool functionalities and capabilities have been identified through the EP3 WP3.3.1 Expert Group Sessions [8]. The what-if tool supported the assessment of the most suitable configuration.

2.4 VALIDATION SCENARIO SPECIFICATIONS

2.4.1 Airspace Information

The operational context for the validation activities corresponds to a FAB due to the scope of the exercise objective, local/sub-regional level at airspace level.

The selected operational context was the Spain-Portugal FAB. However, the exercise did not consider the entire FAB, but concentrated on the continental area over Spain and Portugal where the main traffic flows are (see Figure 2-1).

Episode 3


Version : 1.00

of 103


Figure 2-1 Spanish-Portugal FAB

Modular Sectorisation Adapted to Variations in Traf fic Flows: Airspace is apportioned to small elementary sectors or modules. Modules are grouped in control sectors according to grouping principles and pre-defined configuration scenarios.

In this gaming exercise, the small elementary volumes were the current existing ones of Spain and Portugal control sectors. Combination of these elements provided the predefined airspace configurations and was defined during the exercise modelling activities (preparatory activities).

Flexible Military Airspace Structures/ Variable Geometry Area (VGA) is applied to have an area (TSA or TRA) which is the core of the segregated airspace considered, and to have several pre-planned possible extensions (lobes) next to it which would be activated and utilized by the Military according to the size of the training requested. This core part of the segregated airspace will be newly created in the future SESAR context. The possibility for ad-hoc structure delineation at short notice is offered to respond to short-term airspace users' requirements not covered by pre-defined structures and/or scenarios.

The OS-34 [7] proposes a VGA whose core area is a circle and two possible lobes. However, during the gaming sessions, it was highlighted that the VGA shape is not necessarily a round core area with two additional extensions in the form of lobes. These possible extensions can be required in a different time frame (for example the last ten minutes of the mission).

Figure 2-2 Proposed VGA shape from OS-34

These kinds of areas allow planning day to day exercises where:

• Military activities are planned the day before the operations or even the same day;

Episode 3


Version : 1.00

of 103


Civil User

• Airspace needs are coordinated at the end of the medium term planning phase;

• Tactical changes are established through CDM sessions.

In addition, during the preparatory activities, the different types of military missions where a VGA could be applied were identified with supporting from military experts. This information can be found in Annex II.

2.4.2 Actors: Roles and Responsibilities

The Actors included in the Collaborative Processes reproduced in the EP3 WP3.3.3 exercise are briefly described. The refinement of the roles and responsibilities is part of the results of this exercise and will be presented in §4.1.1. That is the reason why the different gaming sessions were preformed with the involvement of different roles in order to evaluate the most efficient and suitable participation.

The Civil Users (AOC) convey the business intentions of the civil airspace users. As trajectory owners, they hold all the information related to their trajectories and contained in the NOP. They always give their consent before any demand adjustment and will adapt their intentions according to their strategies.

The Exercise Director (Ex. D) is responsible for scheduling the military exercise and to coordinate with airspace managers (AMC) the military needs in terms of airspace reservation and time slot at any time;

The Ex. Director is the leader authority for all MIL units, involved in the exercise.

The Civil/Military Airspace Management body, is the AMC (Airspace Management Cell), established at FAB level and staffed with civil and military personnel responsible for ASM. The AMC collects airspace allocation requests and following proper consideration of civil and military users needs, promulgates its decisions regarding the activation/deactivation of manageable airspace under its jurisdiction via the NOP.

The AMC closely cooperates with the Sub-Regional Manager for the most efficient use of airspace.

The Sub-Regional Manager assures the stability and efficiency of the ATM Network on the sub-regional level, typically a FAB.

According to the Experts involved in EP3 WP3.3.1 sessions, and during the gaming sessions, it was decided that at FAB level, the functions developed by the Airspace Manager and the Sub-Regional Manager should be merged in one role.

The Airline Coordinator represents the civil airspace users interests into the ATM System and deal with their problems.

This is a new role/function that is not defined during the SESAR Definition Phase and therefore gathered in DOD M2 [6]. This function was detected as a need during the first gaming sessions whose detailed and agreed responsibilities were agreed by the participants during the gaming sessions and will be described in §4.1.1.1.

2.4.3 Traffic Information

EP3 WP3.3.3 “Airspace Organization and Management” is focused on the short term phase and the end of the medium term phase (from one day to several hours before the operation),

Exercise

Director

MIL ASM

CIVIL ASM

Sub-Regional

Manager

Airline

Coordinator

Episode 3


Version : 1.00

of 103


aiming at the clarification of the concept, the exploration of validation techniques and the assessment of the processes feasibility.

When selecting the traffic used in the exercise, there was two options for the traffic sample to be used:

• Adapting EP3 WP2 traffic sample to EP3 WP3.3.3 objectives;

• Using an already treated traffic sample (the one from T231 SESAR Definition Phase, [4]).

It was decided that the available effort was better utilised in trying to model the new concept features rather than modifying and adapting the traffic sample provided by EP3 WP2. The traffic sample selected by T231 in the SESAR Definition Phase is representative of the traffic demand expected for the year 2020.Despite the possibility being mentioned in the experimental plan, no assessment of the performances was made.

Based on the previous reasons, the traffic sample used as the reference in EP3 WP3.3.3 is based on the traffic provided by EUROCONTROL for the simulation exercises run within T231 in SESAR Definition Phase. This traffic is built through the increment of a reference traffic corresponding to the 19th of July 2005.

For more details on the traffic reference and 2020 traffic samples, please see the Experimental Plan of this exercise [1].

2.4.4 Simulation scenarios

Two main processes have been analysed:

• Simulation Scenario #1 Location and Refinement of a VGA: The Exercise Director requests an airspace reservation (particularly a VGA) to perform a mission the following day. The simulation scenario time span covers from the day before up to some hours before the operation. During this period, the location and refinement of the dimension (size, shape, and timing slots) of this ad hoc structure are performed in an iterative collaborative way between the different users (civilian and military) up to some hours before the activation of the area. The business trajectories are agreed and adapted by considering the airspace military needs along with the surrounding airspace to safely and efficiently handle the users’ trajectories.

• Simulation Scenario #2 Cancelation of a VGA: Due to bad weather conditions, the Exercise Director cancels the exercise and releases the airspace reservation. The process is finished when the new agreed user’s trajectories do not provoke a capacity imbalance in the airspace. The simulation scenario runs from some hours before the supposed activation of the VGA.

The following figure (Figure 2-3) shows the story board of the Simulation Scenarios from the day before the operation to some hours before. The blue boxes reflect the main milestones from the day before the operation to the supposed activation of the VGA. The white boxes represent a collaborative process between different actors to accomplish with the milestones.

Episode 3


Version : 1.00

of 103


SBR/AMC notifies

the final set of trajectories and the associated

airspace configuration.

SBR/AMC

defines the suitable locations of the VGA and

the airspace configurations

Exercise

Director notifies the airspace

needs and the

flexibility

Exercise

Director

Simulation Scenario #1:

LOCATION of a VGA

MIL ASM

CIVIL ASMSub-Regional

Manager

Civil User #1Civil User #2

Exercise

Director

Sub-Regional

Manager

MIL ASM

CIVIL ASM


REFINEMENT of a VGA

MIL ASM


Manager

Civil User #1

Civil User #2

Exercise

Director

MIL ASM


Manager

Exercise

Director cancels the exercise due to bad weather

conditions

Exercise

Director


CANCELATIONof a VGA

MIL ASM

CIVIL ASM

Sub-Regional

Manager

Civil User #1

Civil User #2

Airline

Coordinator

Airline

Coordinator

Airline

Coordinator

Day before operation Day D-hours

Publication

in the NOP

Figure 2-3 Story Board of the Simulation Scenarios: Location, Refinement and Cancelation of a VGA

2.4.4.1 Simulation Scenario #1 Location and Refinement of a VGA

As one of the main results of the exercise is to clarify the roles and responsibilities in these processes and their feasibility, different combinations for actors’ participation and interactions among them have been tested. The following table described the different processes steps tested in this simulation scenario (Table 2-4). It can be appreciated for the same simulation scenario, different processes steps can be defined:

Simulation Scenario #1: Location and Refinement o f a VGA

From the day before the airspace reservation activa tion and several hours before this event...

Step #1: First, the Exercise Director requests his/her airspace needs to the AMC/SBR and informs about the flexibility in terms of location, dimension ad slot timing. This flexibility is translated to a set of possible locations and dimensions.

Step #2a: Then, in a sequential process, the AMC/SBR analyses the different possibilities. The set of possible locations and dimensions is reduced to those that are compliant with the FAB (no negative impact on capacity) by using supposed users trajectories.

The AMC/SBR requests the preferred location and dimension of the VGA along with their preferred trajectories among the reduced set of possible VGA locations and dimensions.

Step #2b: Then, in a parallel process , the AMC/SBR requests the preferred location and dimension of the VGA along with their preferred trajectories among all the military set of possible VGA locations and dimensions.

In parallel, the AMC/SBR analyses the different possibilities that are compliant with the FAB (no negative impact on capacity) by using supposed users trajectories.

Episode 3


Version : 1.00

of 103


Simulation Scenario #1: Location and Refinement o f a VGA

Step #3:

• Case #1: Exercise Director, Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager and Civil Users .

The affected users calculate the preferred VGA locations and dimensions and the preferred trajectories.

• Case #2: Exercise Director, Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager and Airline Coordinator .

The Airline Coordinator, who knows the general civil preferences in advance, calculates the most feasible, suitable and equitable location and dimension of the VGA along with the supposed preferred trajectories.

• Case #3: Exercise Director, Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager, Civil Users and Airline Coordinator .

The Airline Coordinator requests in real time the preferred solutions to the civilian users and calculates the most feasible, suitable and equitable location and dimension of the VGA along with the preferred trajectories.

Step #4: The AMC/SBR analyses the preferred trajectories according to the preferred locations and dimension of the VGA and assesses the one that has no negative impact at FAB level in terms of capacity and efficiency.

Step #5: As the time goes by, the trajectories become more accurate and the military request may slightly change what would supposed a refinement of the location, dimension and timing slot of the VGA. This step would suppose a repetition of the process from Step#2 to Step#4.

Step #6: After Exercise Director acceptance, the SBR publishes in the NOP (it is supposed the Network Manager acceptance).

Table 2-4 Process Steps for Simulation Scenario #1: Location and Refinement of a VGA

The following table (Table 2-5) summarises the Simulation Scenarios performed during the gaming sessions. The scenarios deal with validation aspects such as sequential, parallel process, actors’ involvements and airspace balances and imbalances:

Episode 3


Version : 1.00

of 103


Simulation Scenario #1: Location and Refinement of a VGA

No Airspace Imbalance Airspace Imbalance 6

Involved Actors

Sequential Process: Step #1+ Step #2a +Step #3 +Step #4 + Step#5

2

Exercise

DirectorSub-Regional

Manager

MIL ASMCIVIL ASM

Civil User #1

1 2

34

5

34

23

VGA needs and

flexibility:

Solutions 1-5

Evaluation with estimated

rerouted trajectories the

impact on airspace

organization.

Preferred Solutions 2,3,4

Evaluation with real

rerouted trajectories

their preferences.

Solutions 2,3

Sub-Regional

Manager

MIL ASMCIVIL ASM

Check solutions against

real rerouted trajectories.

?Civil User #2

3

4

Case #1:

Ex.D + AMC/SBR

+ Civil Users

Parallel Process: Step #1+ Step #2b +Step #3 +Step #4 + Step#5

Exercise

Director

1 2

34

5

VGA needs and

flexibility:

Solutions 1-5

2

Sub-Regional

ManagerMIL ASM

CIVIL ASM

34

Evaluation with estimated rerouted

trajectories the impact on airspace

organization.

Solutions 2,3,4

Evaluation with real rerouted trajectories their

preferences. Solutions 1,5

Sub-Regional

Manager

MIL ASMCIVIL ASM


real rerouted trajectories.

?1

5Civil User #1

23

Civil User #2

Case #2: Ex.D +

AMC/SBR + AOCCo


2

Exercise

DirectorSub-Regional

Manager

MIL ASMCIVIL ASM

Airline

Coordinator

1 2

34

5

34

23

VGA needs and

flexibility:

Solutions 1-5



impact on airspace

organization.


Evaluation with

agreed preferred

trajectories in

adavance.

Solutions 2,3

Sub-Regional

Manager

MIL ASMCIVIL ASM


agreed preferred

trajectories in adavance

?

6 It has to be clarified that the airspace imbalances not were addressed in all the described gaming sessions.

Episode 3


Version : 1.00

of 103




Exercise

Director

1 2

34

5

VGA needs and

flexibility:

Solutions 1-5

2

Sub-Regional

ManagerMIL ASM

CIVIL ASM

34

Evaluation with estimated rerouted

trajectories the impact on airspace

organization.

Solutions 2,3,4

Airline

Coordinator

Evaluation with agreed

preferred trajectories in

adavance.

Solutions 1,5


agreed preferred

trajectories in adavance.

?1

5

Sub-Regional

ManagerMIL ASM

CIVIL ASM


2

Exercise

Director

Civil

User #1

1 2

34

5

34

23

VGA needs and

flexibility:

Solutions 1-5



impact on airspace

organization.


Evaluation with real rerouted

trajectories their preferences.

Solutions 2,3

Sub-Regional

ManagerMIL ASM

CIVIL ASM


real rerouted trajectories

?Civil

User #2

3

4

Airline

Coordinator

Sub-Regional

ManagerMIL ASM

CIVIL ASM

Case #3:

Ex.D + AMC/SBR + AOCCo

+ Civil Users


Exercise

Director

1 2

34

5

VGA needs and

flexibility:

Solutions 1-5

234

Evaluation with estimated rerouted trajectories the impact on airspace.

Solutions 2,3,4

Evaluation with real rerouted trajectories their preferences.

Solutions 1,5

1

5Civil User #1

23

Civil User #2

Airline Coordinator

Sub-Regional

ManagerMIL ASM

CIVIL ASM Sub-Regional

ManagerMIL ASM

CIVIL ASM



?

Table 2-5 Actors involvement for Simulation Scenari o #1: Location and Refinement of a VGA 1

2.4.4.2 Simulation Scenario #2 Cancelation of a VGA 2

Chronologically, this simulation scenario was run during the last gaming sessions. The 3 different possibilities regarding actors’ involvement and processes steps were enough tested 4 during the gaming sessions for Simulation Scenario #1 and therefore, Simulation Scenario #2 5 has been performed with all actors (Exercise Director, Civilian Users, Civil/Military Airspace 6 Managers, Sub-Regional Manager and the Airline Coordinator when necessary) and as a 7 parallel process. 8

Table 2-6 and Table 2-7 revise the followed process steps and the actors’ involvement. 9

Simulation Scenario #2: Cancelation of a VGA

From some hours before this event....

Step#1: The Exercise Director announces to the AMC/SBR that the planned exercise to be

Episode 3


Version : 1.00

of 103


activated in the next hours must be cancelled due to bad weather conditions.

Step#2: The AMC/SBR analyses the situation with straight trajectories and due to the mentioned bad weather conditions publishes that the released airspace has a reduced capacity in comparison with the normal situation and therefore some flights must avoid the area.

Step#3: The Users analyses their preferences and send them to the AMC/SBR with Airline Coordinator help if necessary.

Step#4: The AMC/SBR evaluates the situation with the new trajectories and identifies the best airspace configuration.

Step#5: The SBR publishes in the NOP (it is supposed the Network Manager acceptance).

Table 2-6 Process Steps for Simulation Scenario #2: Cancelation of a VGA 1

Simulation Scenario #2: Cancelation of a VGA

No Airspace Imbalance Airspace Imbalance

Involved Actors

Ex.D + AMC/SBR + AOCCo

+ Civil Users

Parallel Process

Exercise

Director

VGA is

cancelled

Evaluation with estimated rerouted trajectories the impact on airspace.

Evaluation with real rerouted trajectories their preferences.

Civil User #1 Civil User #2

Airline Coordinator

Sub-Regional

ManagerMIL ASM

CIVIL ASM Sub-Regional

ManagerMIL ASM

CIVIL ASM



?

Table 2-7 Actors involvement for Simulation Scenari o #2: Cancelation of a VGA 2

3

4

5

6

Episode 3


Version : 1.00

of 103


3 CONDUCT OF VALIDATION EXERCISE

3.1 EXPERIMENT PREPARATION

As stated in §2.1.1, two alternatives of gaming technique have been used during this exercise:

• Gaming on paper (1st Gaming sessions);

• Gaming on CHILL platform (2nd and 3rd Gaming Sessions).

Although the preparation activities for both alternatives have issues in common, these activities have been structured in different sections to highlight the differences between both techniques.

3.1.1 Preparatory activities for Gaming on Paper Sessions

In the preparation phase of the WP3.3.3 Gaming sessions, it was decided to perform a first gaming session using papers before the performance of the sessions using the CHILL platform. It was considered that this kind of games could be a good training to introduce to the actors to play with a hardware platform which they had never managed. In addition, these sessions aimed at refining the scope of the gaming sessions on CHILL platform and its capabilities.

The games designed with the Gaming based-on-paper technique were played with experts behaving as actors. The tools used were presentations, papers and ball pens and several rules were established to support the execution of these gaming sessions. The Game Master (Director of the game) managed the accomplishment of the objectives and the rules.

The design of this kind of games consists of different steps:

1. Clear definition of the purpose of the game;

2. Definition of the scenarios;

3. Preparation of the supporting material. In this exercise, the supporting material consisted of:

• Templates:

o Roles Template: Description of the role, its responsibilities, its possible interactions with other actors and available tools during this specific game;

o Communications Templates: Paper sheets which simulate the different communications/interactions (communications between actors and interaction with tools as what-if tools).

• Comments Sheet for each participant;

• Pre-Gaming and Post-Gaming Questionnaires;

4. Definition of the rules of the game. Some examples used during these gaming sessions are:

• All the communications between roles and the interactions with tools must be done through a paper template specifically designed for each purpose;

• The Game Master can introduce events into the game in any time during the trial;

• The Game Master is in charge to initiate the game.

Episode 3


Version : 1.00

of 103


3.1.1.1 Participants

In the design of the game, it was distinguished different kind of participants with different responsibilities during the execution of this gaming session:

• Game Master: He/she supervises the game, assigns intervention turns, directs the game progression (providing information – previously required or not – to the actors) and supervises that the game rules are complied by all participants. The Game Master may also introduce unexpected events during the game that alter the game progression;

• Actors: These are the players of the gaming who perform the different roles defined in each game. They can be different in each game but they are into the following list: Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager, Exercise Director and airspace users;

• Observer: They are the people who do not play the game but they deeply know the concept to clarify and they can provide feedback and information during the discussions or when it was required;

• Assistant: These people do not play the game but they participated and know the design and implementation of the game. Their mission is supporting Game Master when he/she needs it.

3.1.2 Preparatory activities for Gaming on CHILL platform

The games designed for these gaming sessions are designed following very similar steps that in the design of the gaming sessions based on paper. The main difference is that the design must be adapted to the functionalities of the hardware platform.

Due to the importance of the platform and its configuration and operation, two types of preparation activities are distinguished:

• Games design, including definition of objectives, scenarios and rules;

• Platform adaptation (improvements) to achieve the objectives of the exercise.

3.1.2.1 Design of the games

The design of the games consists of steps very similar to ones defined for gaming-on-paper sessions:

1. Clear definition of the purpose of the game;

2. Definition of the scenarios;

3. Preparation of the supporting material. In this exercise, the supporting material consisted of:

• Storyboards of the processes to be simulated in each exercise;

• Templates for each game: Only one template was used during these gaming sessions for the description of the role, its responsibilities and interactions with other actors.

• Comments Sheet for each participant;

• Pre-Gaming and Post-Gaming Questionnaires;

• Specific questionnaires for the De-briefing sessions;

4. Definition of the rules of the game. Some examples used during these gaming sessions are:

Episode 3


Version : 1.00

of 103


• All the communications between roles must be done through the CHAT tool installed in each position of the CHILL platform. The Game Master must be in copy of all the transmission made by any actor;

• The Game Master can introduce events into the game in any time during the trial;

• Game Master is in charge to initiate and finish the game.

3.1.2.2 Platform Adaptation

Once the objectives of the exercise were defined, the functionalities of the CHILL platform were analysed and the requirements for new developments needed to carry out the gaming sessions were identified. In the next paragraphs, it is specified the main improvements performed for the different gaming sessions.

The CHILL platform was configured with the following positions (adapted for each role):

• Civil/Military Airspace Manager and Sub-Regional Manager position. This one was also supported with a what-if tool to obtain the assessment of the possible airspace configuration solutions;

• Exercise Director Position;

• Three Airspace Users Positions: One of them was configured to be used by the Airline Coordinator; a new role emerged as result of the first gaming sessions;

• Game Master Position: It allows to the Game Master to launch events, to record the communications between actors and manage the execution of the game.

The main requirements specified to adapt the platform to the necessities of the exercise were:

• CHILL supports the definition of VGAs with multiple orientations;

• The possible airspace configurations are selected according to some pre-defined parameters. The prioritisation criteria to select the best configuration was defined according to pre-defined parameters;

• The information of an airspace configuration could be adapted and configured according to the specific requirements, as the parameter “demand and capacity balance”;

• The possible airspace solutions for the Civil/Military Airspace Manager and Sub-Regional Manager, can be evaluated according a predefined parameter defined as “cost” of solution (see §4.3.1);

• A what-if tool is available in the CHILL platform to support the decisions of the Sub-Regional Manager/AMC;

• The trajectories planning is managed depending on the type of user (Commercial, Low Cost, Business, General Aviation);

• CHILL platform supports a CHAT tool for communications between roles.

After the first interaction with the CHILL platform, some improvements for the last gaming sessions were accomplished to improve its usability taking into account the feedback from the participants:

• Additional filters were implemented to ease the visualization of the information;

• CHAT tool was modified to provide the historical information about the conversations maintained during the game.

3.1.2.3 Training Sessions

To perform the gaming sessions with the CHILL platform, one training session on this platform was needed to familiarise the participants with its functionalities.

Episode 3


Version : 1.00

of 103


On the other hand, it is important to highlight that the role of the assistant had a special relevance during the execution of the games. They support the players to use the CHILL platform, facilitating the interaction with it.

3.1.2.4 Participants

The participants in these Gaming sessions were the same as the gaming sessions on paper, but there are some slight differences in terms of their responsibilities:

• Game Master: he/she supervises the game, assigns intervention turns, directs the game progression (providing information – previously required or not – to the actors) and supervises that the game rules are complied by all participants. The Game Master may also introduce unexpected events during the game that alter the game progression;

• Actors: The players of the gaming who participate in these gaming sessions are the following: Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager, Exercise Director and airspace users. Furthermore, an additional actor had to be defined as a result of the first gaming session; this is the Airline Coordinator role;

• Observer: They are the people who do not play the game but they deeply know the concept to clarify and they can provide feedback and information during the discussions or when it is required;

• Assistant: As it was mentioned, these participants do not play the game but they participated and know the design and implementation of the game. Their mission is supporting Game Master when he/she needs it. In this case, they were especially relevant and helpful supporting the players in the management of the tools (CHILL platform, what-if tool and CHAT tool).

3.2 EXECUTED EXPERIMENT SCHEDULE

Here, there is a schedule of the executed activities regarding the Gaming Sessions in the exercise WP3.3.3. The preparation activities and the milestones programmed for the exercise are detailed in the following figure:

Figure 3-1 Schedule of the activities related to th e WP3.3.3 Gaming Sessions

3.3 DEVIATIONS FROM THE PLANNING

The activities planned for the gaming sessions were modified respecting to the planning specified in the WP3.3.3 Experimental Plan Document [1] .

Although the first gaming sessions were executed on time, the gaming sessions on CHILL platform were postponed until the end of May due to the lack of availability of the Experts and the necessity of adapting the hardware platform. Consequently the last gaming sessions were also delayed.

Episode 3


Version : 1.00

of 103


4 EXPERIMENT RESULTS The gaming sessions performed have always chased the assessment of the WP3.3.3 objectives. Therefore, the results obtained are classified according to its High Level Objectives.

• Clarification on the AFUA Concept (High Level Objective 1);

• Assessment of the process feasibility (High Level Objective 2);

• Exploration of techniques and supporting tools (High Level Objective 3);

• Assessment of alternative validation techniques: The Gaming Technique (High Level Objective 4).

4.1 CLARIFICATION ON AFUA CONCEPT

This section gathers the results obtained during the gaming sessions related to the Flexible Use of Airspace and the Agreement of the Business / Mission Trajectories through collaborative flight planning when military requests or changes its airspace reservation.

The access to share use of airspace by different users (military and civil users) in an equitable way has been the driver to identify and describe the details necessary to be included in the concept to ensure the objective.

Simulation Scenario #1: Location and Refinement of a VGA and Simulation Scenario #2: Cancelation of a VGA has been performed during several sessions (see §2.4.4.1 and §2.4.4.2) obtaining clarification on the following main aspects of the concept:

• Definition of the roles and responsibilities of all actors involved in the exercise (Civil Users, Exercise Director, Airspace Managers, Sub-Regional Manager and a new function detected: Airline Coordinator);

• Criteria for location, delineation and dimension of ad-hoc structures at short notice to respond to short-term military users' requirements not covered by pre-defined structures and/or scenarios: Variable Geometry Area (VGA) ;

• Alternatives to solve situations where shared use of airspace is conflicting with other performance expectations such as capacity ;

• Use of Capacity Opportunities when military cancels a planned exercise. Analysis if other airspace users take advantage of this extra capacity due to airspace release and under which circumstances the airspace is used.

4.1.1 Definition of Roles and Responsibilities

The first topic to be treated is the clarification of the roles and responsibilities to ensure a feasible process when military requests or changes its airspace reservation.

4.1.1.1 Airline Coordinator

As it has been already mentioned, from the first gaming sessions the need of having a function that would represent users’ interests was detected when a considerable number of users were affected because of military airspace reservations.

The AMC/SBR role found difficult to handle in a same function, all preferences coming from the different users along with the stability of the FAB and the accomplishment with airspace capacity restrictions. For these reasons, a new role/function was identified to assist the AMC/SBR to identify the best solution (equitable, suitable and feasible) for airspace users.

Airline

Coordinator

Episode 3


Version : 1.00

of 103


The main roles and responsibilities were agreed by expert participants and consolidated in the following points:

• Represents the civil airspace users’ interests into the ATM System and deal with their problems;

o Risk detected: Not all the airspace users may want to be represented by this role.

o Risk detected: Those that are not represented by the AOCCo may not be treated with the same equitable way and may see the AOCCo like a lobby.

• Is a function that does not occupy a hierarchical position over the users but it is a supporting role both for the SBR and the airspace users;

• Is always aware of the process and intervenes when necessary taking part of the decision only if the problem cannot be solved through direct negotiation between users and AMC/SBR e.g. a considerable number of users are affected;

• Works in close coordination with the SBR to identify the best solution (equitable, suitable and feasible) for airspace users;

• Is a facilitator that ensures the communication on the explanation of the decisions taken by the AMC/SBR for maintaining e.g. capacity and safety levels;

• Before triggering a DCB measure, the AOCCo will analyse with the SBR other possible solutions in terms of flow management;

• Is a facilitator of the UDPP process in the best way for users.

The AOCCo will have detailed information on civil users to support AMC/SBR for the selection of equity solutions. The Equity Indicators will consist of historical data (for every airspace user (number of times that each civil airspace user preferred trajectories have been affected and degree of trajectory distortions), trajectory distortions for the day of operations, flight priorities and number of affected trajectories. For more details on these Equity Indicators, please see §4.1.3.

If necessary, the Airline Coordinator could contact civil users in real time to know particular civil users preferences during the different processes.

4.1.1.2 Civil Users

The Civil Users (AOC Staff) convey the business intentions of the civil airspace users. As trajectory owners, they hold all the information related to their trajectories and contained in the NOP.

• They always give their consent before any demand adjustment;

• They drive all the user-centric processes along with the Airline Coordinator, triggered in reaction to imbalance events;

• They will adapt their intentions according to their strategies/business models when distortions are requested due to airspace restrictions. The selection of the preferred trajectories and the least penalising SBT distortions is done maximizing the Operational Quality Indicator . Two main factors define the civil users business models and build the Operational Quality Indicator: Passenger Quality Indicator and Operating Cost Indicator. For more details on this indicator, please see §4.3.2.

Civil User

Episode 3


Version : 1.00

of 103


4.1.1.3 Exercise Director

The Exercise Director is the leader authority for all MIL units, involved in the exercise.

• She/he is responsible for scheduling the military exercise;

• She/he is responsible for coordinating with airspace managers (AMC) the military needs in terms of airspace reservation and time slot at any time. Particularly with the Military Airspace Manager;

• She/he will collaborate to find suitable solutions to impact civil users to a minimum.

4.1.1.4 Civil Military Airspace Management

The body, is the AMC (Airspace Management Cell), established at FAB level and staffed with civil and military personnel responsible for Airspace Management. The AMC collects airspace allocation requests and following proper consideration of civil and military users needs, promulgates its decisions regarding the activation/deactivation of manageable airspace

under its jurisdiction via the NOP.

The AMC closely cooperates with the Sub-Regional Manager for the most efficient use of airspace.

In particular the AMC has to:

• Organise and manage the airspace to accommodate predicted traffic demand according to airspace users’ preferences. If ASM alone cannot provide enough resource by considering the users preferences, then the imbalances are communicated to users to finally make demands compatible with available resources;

• Transparently propose equitable solutions to users to help them adapt their trajectories in case shared use of airspace is conflicting with other performance expectations (safety, security, capacity, etc.);

• In order to detect the most suitable airspace organization, evaluate the Cost of Solution Indicator that is a combination of: Equitable criteria (Minimum Number of affected SBTs, Historic information at FAB Level, Minimum SBT distortion), Demand and capacity balance among sectors, Workload saturation, Workload balance among sectors and Total Workload. For more details on this indicator, please see §4.3.1.

• Work in close coordination with the Airline Coordinator in case a considerable number of civil users are affected to find the best solution (equitable, suitable and feasible) for airspace users;

• Coordinate airspace reservations (location, size, time) with military units, with the Sub-Regional Manager, and with the neighboring FABs, in order to mitigate the impact on civil users;

• Publish the airspace allocation in the NOP after the confirmation or acceptance of the solution by the Exercise Director and the Sub-Regional Manager;

• Specifically, the Military Airspace Manager has the responsibility to manage military missions/trainings and when a conflict between mission is detected, the Military AMC will be responsible for solve them according to predefined priorities.

The AMC is the interface between the Exercise Director and the SBR. In turn deals with Civil Users/AOCCo to know their preferences.

Exercise

Director

MIL ASM

CIVIL ASM

Episode 3


Version : 1.00

of 103


4.1.1.5 Sub-Regional Manager

The Sub-Regional Manager assures the stability and efficiency of the ATM Network on the sub-regional level, typically a FAB:

• Propose DCB solutions (in particular those dealing with MIL activity) when an imbalance is detected by considering users preferences;

• Evaluates with the AMC the impact of the military needs at FAB level;

• Initiates CDM processes between users, military, and AMC;

• Verifies applicability of proposed airspace user solution at FAB level checking all the stability of the FAB (airports restrictions, weather conditions, staffing problems, interactions with the neighboring FABs);

• Looks for capacity opportunities when military release total or partially airspace and evaluates the situation assuming that all the trajectories should come back to the original SBTs;

• At FAB level, works jointly with the Airspace Managers and with the Airline Coordinator (when necessary) in order to find the best solution (equitable, suitable and feasible) for all users and for the FAB stability.

The SBR is the final responsible to accept the new proposed trajectories with the support of the AOCCo (when this role is necessary) or with the civil users. But the users are the owners of the trajectories and they have to confirm the final routes that they want to fly.

4.1.2 Criteria for location, delineation and dimension of a VGA

The principle of the VGA is to have an area which is the core of the segregated airspace considered, and to have several pre-planned possible extensions (lobes) next to it which would be activated and utilized by the military according to the size of the training requested and to the GAT traffic in the area at the time. This type of airspace reservation allows military to plan the day before the operation ad-hoc structures to respond to short-term airspace military requirements not covered by pre-defined structures and/or scenarios.

This revolutionary approach (fixed areas currently existing) provides a greater flexibility to military for airspace reservation which means:

• Military will reserve just areas tailored dimensioned for the mission needs and therefore will release spare airspace for civilian use;

• Military will collaborate with AMC/SBR to find the best dimension and shape of the VGA in order to keep the impact on civil air traffic to a minimum;

• Military will reserve tighter time slots than today adjusted to their real needs;

• Military will inform about the cancelation of an area or part of it if the airspace is not needed anymore providing capacity opportunities to civil users.

When a military area is reserved, priorities at state level or FAB level will be defined in advance at strategic level to ensure the success of the processes. Equity Indicators to analyse the access to share airspace between civil and military users are considered for identifying the use of airspace and the AMC/SBR will be responsible for deciding the use of the airspace between civilian and military users. Today the “Ratio of Military Requests effectively accomplished” along with the number of affected civil flights are the main factors to be considered for military airspace locations.

Regarding the civil users’ impact, the main criterion to locate a VGA is to impact civil air traffic to a minimum. With this maxim, several indicators have been accepted and consolidated

Sub-Regional

Manager

Episode 3


Version : 1.00

of 103


during the gaming sessions and will be used along the process. For more information on when these indicators are used along the optimal process, it is recommended to see §4.2:

• Minimum Number of affected SBTs;

• Minimum Number of times that same civil users have been affected (historic information at FAB Level): for equity reasons, the impact on every individual user should be calculated in advance and after the operation. This information should be stored to obtain historic data and to identify when a company has been punished and therefore, to take into consideration this information to assign an equitable share use of airspace;

• Operational Quality Indicator: It will be evaluated by civil airspace users or the Airline Coordinator (when this role is necessary). This indicator is described later in depth (see §4.3.2). Two main factors build this indicator: Passenger Quality Indicator and Operating Cost Indicator.

• Cost of Solution Indicator: It will be evaluated by the AMC/SBR. For more details on this indicator, see §4.3.1.

According to these criteria, the final solution is obtained as an iterative process with several loops. The figure below reflects one loop of the process to find the most suitable VGA location, set of trajectories and airspace organization. The negotiation with military for selecting a set of possible VGA locations is not shown in this figure.

Set of

distorted trajectories

Operational

Quality IndicatorEvaluator

and Optimizator

Most suitable

(optimized distorted) set of trajectories and VGA location

Possible

VGA Locations

Cost of

SolutionIndicator

Evaluator and

Optimizator

(What-If Tool)

Most suitable

Airspace Organization

Civil User #1 Civil User #2Airline CoordinatorSub-Regional

ManagerMIL ASM

CIVIL ASM

Figure 4-1 Steps to find the most suitable VGA loca tion, set of trajectories and Airspace Organization

4.1.3 Share use of airspace is conflicting with Capacity

According to the qualitative objectives associated to “Access and Equity KPA”, where shared use is conflicting with other performance expectations, such as capacity, viable airspace alternatives will be provided to satisfy the airspace users’ business needs (AEQ.1.OBJ2), in consultation with all affected stakeholders. For priority management, more options will be available than just the ‘first come first serve’ rule (AEQ.2.OBJ1).

The following examples were analysed during the gaming sessions represents two situations where the access to airspace is in conflicting with capacity and equitable solutions have to be decided to solve the capacity issue.

Example 1 describes the situation where most of civil users have preferred similar trajectories in order to avoid a military reservation and have provoked a demand and capacity imbalance and some of them cannot access the same airspace. The AMC/SBR along with the AOCCo must decide who has priority to access the preferred airspace.

Episode 3


Version : 1.00

of 103


Máx. 3

2 flights must

be rereouted. WHO?

Preferred Users

Trajectories

Figure 4-2 Example 1 Access is in conflicting with Capacity

Example 2 describes the situation where a military exercise has been cancelled due to bad weather conditions. As a consequence, and due to the same reason of weather, the released airspace cannot cope with the same nominal number of movements. In this case, the AMC/SBR along with the AOCCo must decide who cannot access the release airspace where the SBT is less penalised.

2 flights can

reduce their flight time. WHO?

Máx. 2 Máx. 2

Preferred Users

Trajectories

Figure 4-3 Example 2 Access is in conflicting with Capacity

In both examples, the AMC/SBR informs the civil users and AOCCo about the global restriction. The civil users with the help of the Airline Coordinator will decide who can access the preferred trajectories and for those who cannot access, the civil users will decide how to change their SBTs depending on their business models.

In order to ensure the qualitative objective AEQ.2.OBJ2:” Priority rules will always be applied in a transparent, correct manner” the Airline Coordinator function will ensure the equity of the prioritised users. To perform this responsibility, the Airline coordinator should handle specific information to ensure that the civil users’ access when conflicting with capacity is solved in an equitable way.

In any case, the final responsible to check the operational feasibility of the new users’ trajectories is the AMC/SBR with the support of AOCCo.

During the gaming session some indicators were tested to analyse their suitability.

• Historical Reasons. For every civil user, the Airline Coordinator should know:

o Number of times that same civil users have been affected (historic information at FAB Level). This information could be calculated for seasons for instance;

o Historical distortions degrees : Every civil user would have a “bucket of admissible distortions”. If this bucket has been already filled in, no more distortions can be assigned during a season. The degrees of distortions can be measured through the operational quality indicator. The maximum

Episode 3


Version : 1.00

of 103


admissible level for the distortions degree would be weighted depending on the civil user and also the airspace location;

Figure 4-4 Example of Historical distortions degree s

The expert participants agreed that these historical indicators that may imply high detailed information should be handled just by the Airline Coordinator. Meanwhile the AMC/SBR could just cope with high level equity indicators such as extra flight time, extra flight miles or flight priorities and even propose technical solutions to ensure the FAB stability.

• Current Operational Quality Indicator that would mean the current SBT distortion;

• Flight priorities that would mean special treatment;

• Current number of affected SBTs or RBTs (in case the timeframe is close to the operation).

The decision for access prioritization will be limited to Boundary Conditions such as equipment; environment, safety, ready to be used (operation timeframe), etc...

4.1.4 Use of Capacity Opportunities

During the Simulation Scenario #2: Cancelation of a VGA, the conditions for cancelation of a military exercise and how the civil users may take advantage of the release airspace were analysed.

• The probability of cancellation is higher for day-to-day exercises than for Major exercises. The cancelation of a major exercise is normally due to very bad weather conditions and this is decided in a very short time although it takes into consideration the reaction time of the civil users to take advantage of the capacity opportunities. Furthermore, the cancelation may not be total, jus partial;

• From the Military point of view, to cancel a major exercise has a bigger impact than a day-to-day operation. Major exercises are planned very much time in advance;

• On the contrary, from the SBR point of view, since the major exercises are planned in advance and usually need more airspace, if it is cancelled, the airspace released and extra capacity are bigger;

• In general, most of civil users would like to take advantage of a released airspace if they were originally affected, and therefore would like to fly more direct routes. But this decision is dependent on the timeframe that means the time available to manage the change of trajectories (at least two hours before the EOBT although this value will be dependent on the company). If the release airspace information is published really close the operation, the airlines may decide of not considering the capacity opportunities. For instance, the already loaded fuel may affect on the decision. The current strategy of a company is to leave on time and get the destination in the quickest way. If the flight time is reduced enough due to a military airspace release, then part of the fuel is not needed anymore and it is necessary to unload it for landing

Episode 3


Version : 1.00

of 103


safely at the airport destination. This could imply a cost in term of time and money that would make uninteresting the use of the released airspace.

4.2 ASSESSMENT OF THE PROCESS FEASIBILITY

The gaming sessions to assess the process feasibility have been focused on the Simulation Scenario #1: Location and Refinement a VGA: when military decides to perform a mission the following day and it is necessary to find the most suitable location, dimension and timing slot by ensuring the impact on civil users to a minimum.

This Simulation Scenario #2 (Cancelation of a VGA) was run during the last gaming sessions. The different possibilities regarding actors’ involvement and processes steps were enough tested during the gaming sessions for Simulation Scenario #1 and therefore, Simulation Scenario#2 was performed with all actors (Exercise Director, Civilian Users, AMC/SBR and the Airline Coordinator when necessary) and as a parallel process. As a consequence, without a loss of representativeness, the assessment of the processes feasibility has been performed just for Simulation Scenario #1: Location and Refinement a VGA. In order to evaluate which process to perform this scenario (sequence of steps and actors involvement) is the most suitable, different combinations were tested.

The conclusions obtained from a particular process were used to feed and design the following process (combination of actors’ involvement and sequences). In this way the advantages and disadvantages found in every gaming session were refined in the next session.

The refinement of the location and dimension (size, shape, and timing slots) of these ad hoc structures have been performed in a collaborative way between the different users (civilian and military) from the day before the operation up to some hours before the activation of the area. The business trajectories are agreed and adapted by considering the airspace military needs along with the surrounding airspace to safely and efficiently handle the users’ trajectories.

The assessment of the process have been accompanied with the definition of the most suitable process enabling dynamic responses to design, allocate, open and close military airspace structures (up to 3 hours before operations) or very short term changes (e.g. bad weather). With these purposes several processes have been tested. The following tables gather the main advantages and disadvantages of the performed processes along with the reached conclusions agreed and consolidated with the expert participants.

• Table 4-1 analyses in general terms the advantages, disadvantages and suggestions of a Sequential process vs. Parallel process.

• The following tables analyses the particular advantages, disadvantages and conclusions of a Sequential process vs. Parallel process when different users are involved in the processes:

o Case #1: Exercise Director, Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager and Civil Users (Table 4-2).

o Case #2: Exercise Director, Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager and Airline Coordinator (Table 4-3).

o Case #3: Exercise Director, Sub-Regional Manager, Civil Airspace Manager, Military Airspace Manager, Civil Users and Airline Coordinator (Table 4-4).

Episode 3


Version : 1.00

of 103


General...

Disadvantages Advantages Suggestions

Seq

uent

ial P

roce

ss

• In the first step of the process, the solutions provided by the AMC/SBR may not fully represent users’ interests since it is a sequential process and the civil users’ preferences have not been provided so far;

• When the AMC/SBR checks the solutions against the accurate trajectories provided by the users, they may find an unexpected demand and capacity imbalance in the FAB. This may trigger a new iteration with users;

• Near the operation time:

o The Civil users may be involved in the process too late;

o The Exercise needs at least 2 hours to be prepared once the location of the VGA is fixed. An iterative loop in the sequential process may affect negatively the success of the mission.

• However, the AMC/SBR will try to estimate the trajectories based on shortest routes and level capping;

• There is always a solution in case the civil users do not find an equitable solution;

• Limited number of solutions to be assessed by the civil users.

Par

alle

l Pro

cess

• Lack of situational awareness at FAB level for Users (staffing problems, weather, number of sectors,…);

• The users’ solutions may not be compliant with the demand and capacity constraints identified by AMC/SBR;

• This may trigger an endless succession of iterations with users;

• Inefficient use of resources: two actors performing the same tasks at the same time (defining optimum trajectories);

• In case the solutions provided by users are not aligned with AMC/SBR’s, AMC/SBR may not have enough time for iterations with users.

• Since the input from the users is considered from the very beginning of the process, there is always more time than in the sequential process to find an equitable solution;

• The solutions provided by the AMC/SBR represent users’ preferences since the input from the users are considered from the first step of the process.

The optimal solution should consist of an intermediate one: the AMC/SBR should take into consideration the users preferences from the beginning to discuss together the best solutions for all. The idea is to have communication with users during all the process but the responsible for the final solution is the AMC/SBR. If the users preferences are not initially compliant with the airspace restrictions, the AMC/SBR will try to find solutions to consider users proposals.

Table 4-1 General Advantages and Disadvantages of S equential Process vs. Parallel Process.

Episode 3


Version : 1.00

of 103


Civil Users Involvement...


Seq

uent

ial p

roce

ss

• Every individual user doesn’t have visibility of the other users and therefore the preferences provided to the AMC/SBR may be in contradiction.

• The solutions provided to the AMC/SBR as a global solution, may not be compliant with demand and capacity constraints as they are presented as individual proposals.

• The AMC/SBR receives proposals for change on trajectories from the different users involved and if the number of affected users is considerable, the AMC/SBR may not cope with all their preferences and proposals.

• If the number of affected civilian users is considerable, the users may not feel that the solutions provided by the AMC/SBR to ensure the maintenance of capacity and safety levels are equitable and transparent.

Par

alle

l Pro

cess

• The lack of situational awareness at FAB level is worsened because every individual user doesn’t have visibility of the other users and the possible options to be selected are higher than in the sequential process.

• Same disadvantages as in the sequential process related to the lack of transparency and communications regarding AMC/SBR solutions.

• The users, as the trajectory owners provide the most accurate information on their own trajectories. Therefore, the AMC/SBR may evaluate the situations with real and desired trajectories instead of estimations.

To improve the airspace users’ involvement in the process and to ensure the consideration of their interests, the introduction of a new actor is proposed: an Airline Coordinator (AOCCo) who would represent the views of the airlines and would be in charge of communications directly with the SBR/ASM. This actor would take part in the negotiation process (when necessary) between civil and military actors (Ex. Director and AMC/SBR) and would ensure that the negotiation about trajectories’ changes is transparent for the airlines owning the affected trajectories.

Table 4-2 Advantages and Disadvantages of Sequentia l Process vs. Parallel Process according to civil u sers’ involvement.

Episode 3


Version : 1.00

of 103


Airline Coordinator Involvement...


Seq

uent

ial p

roce

ss

• The AOC doesn’t know the accurate trajectories of the preferred users, just general preferences conveyed by users in advance;

• Not all the airspace users may want to be represented by an AOCCo;

• Those that are not represented by the AOCCo may not be treated with the same equitable way and may see the AOCCo like a lobby.

Par

alle

l Pro

cess

Same disadvantages than in the Sequential Process plus:

• The AOCCo needs a support tool in order to analyze a higher number of possible solutions;

• The AOCCo has a lack of situational awareness at FAB level for Users (airport constraints, staffing problems, weather, number of sectors…);

• The AOCCo is not responsible for deciding which the best solution for the network is.

• The AOCCo improves the airspace users’ involvement who represents the views of the airlines.

• The AOCCo ensures the communication on the explanation of the decisions taken by the AMC/SBR

AMC/SBR works together with the AOCCo from the beginning of the process to obtain, for each possible allocation of the airspace reservation, a number of solutions (set of modified trajectories avoiding the reserved area) optimized taken into account previously agreed indicators (operational quality indicators). The idea is to have communication during all the process but the responsible for the final solution is the AMC/SBR.

Table 4-3 Advantages and Disadvantages of Sequentia l Process vs. Parallel Process according to Airline Coordinator involvement.

Episode 3


Version : 1.00

of 103


Civil Users and Airline Coordinator Involvement...


Seq

uent

ial P

roce

ss

Par

alle

l P

roce

ss

• The AOCCo needs a support tool in order to analyze a higher number of possible solutions;

• The AOCCo has a lack of situational awareness at FAB level for Users (airport constraints, staffing problems, weather, number of sectors…);

• The AOCCo is not responsible for deciding which the best solution for the network is.

• Those civil users that do not feel being represented by the AOCCO would be involved directly;

• AMC/SBR requests to the AOCCo a solution according to the constraints of the airspace reservation, and the AOCCo, together with the airspace users affected, work taking into account direct users’ preferences.

The AOCCo should always be aware of the process and intervenes when necessary taking part of the decision only if the problem cannot be solved through direct negotiation between users and AMC/SBR e.g. a considerable number of users are affected.

Table 4-4 Advantages and Disadvantages of Sequentia l Process vs. Parallel Process according to Civil U sers and Airline Coordinator involvement.

Global Conclusions:

• The ideal process would be a compromise between a parallel and a sequential process. The AMC/SBR should take into consideration the users preferences from the beginning to discuss together the best solutions for all. The idea is to have communication with users during all the process but the responsible for the final solution is the AMC/SBR. If the users preferences are not initially compliant with the airspace restrictions, the AMC/SBR will try to find solutions to consider users proposals. This would mean restrictions on the trajectories for the preferred VGA locations;

• The criteria to select the best location of the VGA will be based in a combination of affected SBTs and previously agreed operational users’ indicators along with equitable and accessible indicators. These criteria was fully covered and described in § 4.1.2.

• To ensure the transparency of process for users and that the users’ preferences are taken into consideration, a new function arises called Airline Coordinator. This new role should work together (even in the same room) with the AMC/SBR to identify the best solution (equitable, suitable and feasible) for airspace users.

• The Airline Coordinator should only intervene if the problem cannot be solved through direct negotiation between users and AMC/SBR e.g. a considerable number of users are affected;

• It is important to keep the military in the negotiation loop up to the end of the planning phase. The involvement of the military is beneficial for the process, and can help reaching a better solution that minimise the impact caused by the reservation while allowing the Exercise Director to perform the planned military exercise. Even though the military has taken part in the process leading to the definition of the VGA dimensioning, it does not mean that this previous agreement cannot be revised and new flexibility added.

Episode 3


Version : 1.00

of 103


• When shared use is conflicting with other performance expectations, such as capacity, the AMC/SBR informs the civil users and AOCCo about the global restriction. The civil users with the help of the Airline Coordinator will decide who can access the preferred trajectories and for those who cannot access, the civil users will decide how to change their SBTs depending on their business models. The Airline Coordinator function will ensure the equity of the prioritised users (Equity Indicators such as Number of times that same civil users have been affected and Historical distortions degrees). See § 4.1.3 for detailed information on Equity Indicators.

The following figure reflects the optimal process sketch. After analyzing several possible processes, the most promising solution highlights two main needs: the exercise director presence during all the process who is willing to soften his/her needs and the civil users involvement during all the process to ensure their interests considerations.

Exercise

Director

1 2

34

5

VGA needs and

flexibility:

Solutions 1-5

4

Evaluation with real preferred rerouted trajectories and VGA location

preferences the impact on airspace.

Evaluation of alternative solutions to ensure users preferences

considerations.

Evaluation of users preferences.

5


Airline

Coordinator

Sub-Regional

ManagerMIL ASM

CIVIL ASM

54

Figure 4-5 Optimal Process

The Table 4-5 and Figure 4-6 shows in detail the Optimal Process.

Episode 3


Version : 1.00

of 103



From the day before the airspace reservation activa tion and some hours before this event....

Step #1: First, the Exercise Director requests his/her airspace needs to the AMC/SBR and informs about the flexibility in terms of location, dimension ad slot timing. This flexibility is translated to a set of possible locations and dimensions.

Step #2: Then, the AMC/SBR requests to Civil Users the preferred location and dimension of the VGA along with their preferred trajectories among all the military set of possible VGA locations and dimensions.

In parallel, the AMC/SBR analyses the different possibilities. As the new preferred trajectories due to the possible VGA locations and dimensions are still unknown, the analysis will be done through high level indicators such as: Minimum number of affected trajectories and flight priorities.

For detailed information on civil users and to ensure the equity, the AOCCo would provide more specific information related to the mentioned indicators. The AOCCo should always aware of the process and intervenes when necessary if a considerable number of users are affected.

Step #3: The affected Civil Users/AOCCo calculate the preferred VGA locations and dimensions and the preferred trajectories by evaluating their particular Operational Quality Indicators depending on their business models.

Step #4: The AMC/SBR analyses the preferred trajectories according to the preferred locations and dimension of the VGA and assesses the one that has no negative impact at FAB level in terms of capacity and efficiency.

For this assessment, the AMC/SBR calculates for each VGA location/dimension and associated users preferred trajectories and the different airspace configurations, the Cost of every Solution.

The Cost of Solution is an indicator that consist of: Equity indicators (Minimum number of affected trajectories, Historic information at FAB level, Minimum trajectories distortion e.g. extra flight time and extra fuel consumption), Demand and Capacity balance among sectors, Workload saturation, Workload balance among sectors, Total workload.

The best solution (VGA location/dimension+ preferred trajectories +airspace configuration) will have the best Cost of Solution.

As the time goes by, the trajectories become more accurate and the military request may slightly change what would supposed a refinement of the location, dimension and timing slot of the VGA. This step would suppose a repetition of the process from Step#2 to Step#4.

Episode 3


Version : 1.00

of 103



Step #5b: If there isn’t a positive solution (negative impact at FAB level and considerable impact on civil users), the AMC/SBR will request to Exercise Director more flexibility, if possible. In case there is extra flexibility, this step would suppose a repetition of the process from Step#2 to Step#4.

Step #6b: If military cannot provide extra flexibility, the AMC/SBR will communicate the Civil Users/AOCCo the global restriction (maximum number of flights through the affected volume) and request them which flights will cross the restricted area and the distorted preferred trajectories of the rest.

Step #7b: The Civil Users with the help of the AOCCo will decide who can access the restricted volume and for those who cannot access, the civil users will decide how to change their SBTs depending on their business models. The AOCCo will ensure the equity of the Civil Users by handling handle Equity Indicators : Number of times that each civil airspace user preferred trajectories have been affected, Degree of trajectory distortions, operational quality indicators given by users, flight priorities and current number of affected SBTs or RBTs.

Step #5a: If there is a positive solution with no negative impact at FAB level and minimum impact to civil users, the AMC/SBR informs the Exercise Director about the solution and requests his/her acceptance.

Step #8b: The AMC/SBR will evaluate the solution with the new trajectories. If there is a positive solution with no negative impact at FAB level, the AMC/SBR informs the Exercise Director about the solution and requests his/her acceptance.

Step #6: After Exercise Director acceptance, the SBR publishes in the NOP (it is supposed the Network Manager acceptance).

Table 4-5 VGA Location and Refinement. Optimal Proc ess

Episode 3


Version : 1.00

of 103


Users (AOCs) with the help of the AOCCo will

decide who can access the restricted volume

and for those who cannot access, the civil users

will decide how to change their SBTs depending

on their business models. The AOCCo will

ensure the equity of the Civil Users by handling

handle Equity Indicators

For that, the users evaluates their less

penalising Operational Quality Indicators

(passenger quality + operating cost).

EXERCISE DIRETOR

communicates that

there´s no possibility

to change the airspace

restricitions.

EXERCISE

DIRECTOR

communicates the

new airspace

needs

Users (AOCs) communicate the new set of

trajectories for the different possible VGA

locations/dimensions/timings as well as the

preferred VGA locations to AMC/SBR

AMC/SBR requests to civil users the business preferred

trjectories and the range of VGA locations/dimensions/timing

slots preferrences.

In parallel, the AMC/SBR analyses the different possibilities.

As the new preferred trajectories due to the possible VGA

locations and dimensions are still unknown, the analysis will

be done through high level indicators such as: Minimum

number of affected trajectories and flight priorities.

For detailed information on civil users and to ensure the

equity, the AOCCo would provide more specific information

The AOCCo should always aware of the process and

intervenes when necessary if a considerable number of

users are affected.

AMC/SBR publishes in the

NOP that for the following

day one or more locations/

dimensions/timings of the

VGA are expected.

AMC/SBR requests to the

exercise director approval to

the final VGA location/

dimension/timing

EXERCISE DIRECTOR

notifies the airspace

needs and as many

details as possible on

flexibility in terms of slot

timing, size, FLs and

location

AMC/SBR informs the

Exercise Director about

the different possible

positive VGA locations,

along with the flexibiliy

that is compliant with both

the military needs and the

FAB analysis from AMC/

SBR.

EXERCISE

DIRECTOR checks

this information

Are the VGA location,

dimension and the timing

slot proposal suitable?

Exercise Director

informs the AMC/SBR

that the proposal is not

feasible anymore and

some changes are

necessary.

No

Yes

Is this evaluation

positive?

AMC/SBR requests to

the exercise director

some flexibility (if

possible) to keep the

impact on civil air

trafffic to a minimum

EXERCISE DIRECTOR

analises if some flexibility

on the particular airspace

reservation constraints is

possible.

Is there

flexibility?Yes

No

Yes

NO

AMC/SBR informs the users

that there is no possiblity of

military flexibility and the

associated capacity

constraint.

Civil Users analyse their preferred business

trajectories for the different VGA locations/

dimensions/timings and a range of solutions

suitable for them and the preferred ones.

For that, the users evaluates their less

penalising Operational Quality Indicators

(passenger quality + operating cost).

The AMC/SBR will communicate the Civil Users/

AOCCo the global restriction (maximum number of

flights through the affected volume) and request

them which flights will cross the restricted area and

the distorted preferred trajectories of the rest.

Users (AOCs) communicate the new set of

trajectories for the different possible VGA

locations/dimensions/timings.

Exercise

Director

Airline

Coordinator

Civil

User #2Civil

User #1

Civil

User #3

Civil

User #2Civil

User #1

Civil

User #3

Civil

User #2Civil

User #1

Civil

User #3

MIL ASM


Manager

Exercise

Director

Exercise

Director

Exercise

Director

Exercise

Director

Exercise

Director

MIL ASM

CIVIL ASM

Sub-Regional

Manager

MIL ASM

CIVIL ASM

Sub-Regional Manager

MIL ASM

CIVIL ASM

Sub-Regional

Manager

MIL ASM

CIVIL ASM

Sub-Regional

Manager

MIL ASM

CIVIL ASMSub-Regional Manager

Airline

Coordinator

MIL ASM

CIVIL ASM

Sub-Regional

Manager

Civil

User #2Civil

User #1

Civil

User #3

Exercise

Director

The AMC/SBR analyses the preferred trajectories according

to the preferred locations and dimension of the VGA and

assesses the one that has no negative impact at FAB level

in terms of capacity and efficiency.

For this assessment, the AMC/SBR calculates for each VGA

location/dimension and associated users preferred

trajectories and the different airspace configurations, the

Cost of every Solution.

The best solution (VGA location/dimension+ preferred

trajectories +airspace configuration) will have the best Cost

of Solution.

Figure 4-6 VGA Location and Refinement. Optimal Pro cess Story Board

Episode 3


Version : 1.00

of 103


4.3 EXPLORATION THE SUPPORTING TOOLS CAPABILITIES

This section gathers the results related to the exploration the supporting tools needed to achieve an airspace organization and management efficiently adapted to changing demand considering civilian and military requests.

One specific gaming session was performed to analyse and identify the potential functionalities of the what-if tool for airspace organization and management to support the decisions of Civil/Military Airspace Managers and Sub-Regional Managers for providing the most suitable airspace configurations.

However, during all the gaming sessions, the importance of the automation of the process was highlighted in order to enable dynamic responses to design, allocate, open and close military airspace structures. One of the conclusions obtained was that one VGA location processes implied long time horizons that are not admissible if considering that not only one VGA needs to be planned several hours before the operation but a considerable number of different reserved areas. Therefore, not only the specification of the what-if tool capabilities have been covered in the related gaming session, but also several requirements for the supporting tools of all the roles involved in the simulated processes have been gathered during all sessions.

4.3.1 Definition of the What-If Tool Capabilities

This section gathers the main results consolidated with the expert participants during the gaming session focused on the specification of what-if tool capabilities.

The what-if tool is the supporting tool of the Civil/Military Airspace Managers and the Sub-Regional Manager for:

• Evaluating a set of possible solutions related to the most appropriate orientation of the VGA under given traffic conditions according to an agreed ‘cost of solution’ indicator; and

• Providing the most suitable airspace organization associated to each possible VGA orientations by:

o Considering the user preferences and military airspace reservations;

o Ranking them according to a cost of solution;

o Ensuring the demand/capacity balance based on both number of movements and traffic complexity (ATC Workload) measurement;

o Assessing the impact at FAB level.

The What-if tool works in an iterative way with several loops until the final decision is agreed. The figure below shows the information flows in the what-if tool, including the inputs from other actors involved in the process.

Episode 3


Version : 1.00

of 103


Airline

CoordinatorCivil Users

SUPPORTING

TOOL

CIVIL ASM

MIL ASMSub-Regional

Manager

Exercise

Director

Figure 4-7 Information Flows in the What-if Tool

For each possible VGA location and taking into account estimated trajectories, the ‘Cost of Solution Indicator Evaluator’ component will calculate the ‘Cost of Solution’ Indicator which is a combination of the following factors:

• Equitable criteria: Minimum number of affected trajectories, historic information at FAB level, minimum trajectories distortion e.g. extra flight time and extra fuel consumption;

• Demand and Capacity balance among sectors i.e. standard deviation;

• Workload Saturation Indicator of the most suitable airspace organization;

• Workload Balance Indicator among sectors of the most suitable airspace organization;

• Total Workload Indicator of the most suitable airspace organization.

The ‘Airspace Organizer and Optimizer’ component of the what-it tool will be comprised of four main modules:

• Airspace organizer module which provides a set of predefined airspace configurations composed of elementary volumes and taking into account the flexible military structure i.e. VGA. These solutions will consider temporary predefined route structures in case the change of sectorizations do not solve the imbalances;

• Workload calculator module which estimates the expected workload for every operational controller for all the predefined sector configurations;

• Optimizer module which calculates the optimum sector configuration at each moment according to the following criteria:

o ATC Workload Saturation: None sector shall be saturated for the selected configuration;

Episode 3


Version : 1.00

of 103


o Workload Balance: The workload of the sectors that take part of the selected configuration shall be balanced;

o Total Workload: The sum of the workload of every sector of the selected configuration shall be balanced.

In addition, the user will be able to establish the maximum number of sectors of the configuration as a restriction for the catalogue of solutions taking into available Human Resources.

• HMI (Human Machine Interface) module which is the interface where all graphical data are shown.

The following figure shows the information flows among these modules.

Figure 4-8 Information Flows in the Airspace Organi zer and Optimizer Component

4.3.2 Definition of the Supporting Tools Functionalities

As mentioned before, during all gaming sessions, it was stated that all actors involved in the design, allocation, opening and close of any military airspace structures should be supported by tools automating the process as much as possible. Some results related to the functionalities of these supporting tools have been obtained.

• These supporting tools should comply with the following requirements:

o Information sharing and the transparency on data are key stones. The quantity and quality of information shared by all actors affected by the military airspace reservation e.g. users’ preferences, proposed solutions, options and capacity constraints for negotiation, etc., determine the suitability of the reached solution. Therefore, there is a need of a tool for publishing and sharing information during the negotiation process in order to guarantee transparency of the shared data and to provide a common basis for the negotiation. Thus all the actors/roles have the same reliable and updated information in real-time. This tool/functionality must be accessed via SWIM. It is important to note that the NOP cannot be used with this purpose since it is only updated when an agreement is reached;

o For those users who cannot afford to invest on tools, an access via SWIM to a standard supporting tool could be enabled so that they could tune it according to their business model. This standard supporting tool for civil airspace users need to be agreed developed and made available to the ATM community. The supporting tool needs to be configurable, so each civil airspace user could customize it depending on its business model;

Episode 3


Version : 1.00

of 103


o Are we really suggesting a standard supporting tool? Is this incentivisation? There needs to be investment in development as wall as provision of the basic tool. What are the basic and enhanced functions?

o The supporting tool in the hands of the Airline Coordinator need to be connected to all the civil airspace users’ supporting tools since they consider their different business models;

o The supporting tools for all actors/roles must be equipped with customizable alarms that alert them about changes affecting the progress of the negotiation e.g. new information sharing, changes in the NOP.

In addition, the supporting tool of the Civil Airspace Users and the Airline Coordinator needs to calculate, for each possible VGA location, the ‘Operational Quality’ Indicator which is a combination of the following factors:

• Passenger Quality Indicator: quality of service provided to the passenger directly related to the airport delays, loss of connections and affected passengers;

• Operating Cost Indicator: factors associated to the company cost such as extra-flight time, extra fuel consumption, crew activity, airport taxes i.e. night curfews, aircraft capacity, flight priorities, etc.

All these factors have to be weighted according to previous criteria agreed by all civil airspace users since they have different priority depending on the business model of each civil airspace user.

The Table 4-6 summarises the combination of indicators to be considered in the Operational Quality Indicator:

Passenger Quality Indicator Operating Cost Indicator

• Airport Delay (departures);

• Loss of connections;

• Number of affected passengers.

• Crew Activity;

• Fuel Consumption;

• Flight Time;

• Airport Taxes (night curfews);

• Aircraft Capacity;

• Flight priorities.

o Flights to HUB;

o Long Haul flights.

Table 4-6 Operational Quality Indicator

The Operational Quality Indicator will be used to assess the optimised set of trajectories when they have to be modified because of airspace reservation avoidance.

Episode 3


Version : 1.00

of 103


VGA #1

Optimiseddistorted SBTs

Optimised

distorted SBTs

Optimiseddistorted SBTs

Figure 4-9 Operational Quality Indicators for every possible VGAs locations

Finally, it should be highlighted that the supporting tools of the Airspace Users and the Airline Coordinator must have ‘trajectory planning’ capabilities which allow applying the following options to modify the trajectories in reaction to a proposed VGA reservation:

• Re-routing;

• Stay on ground;

• Level Capping;

• Slow down;

• Slot (TTA) swapping;

• Cancelation and/or Integration of flights.

The Airspace Users and the AOC Co must be able to configure criteria to apply the aforementioned options automatically according to their strategies. These criteria will be based on factors such as departure delay, extra flight time and extra fuel consumption.

The tables below show an example of these criteria. The first table includes the priorities of the indicators used by commercial and low cost airlines and business and general aviation to perform their strategies. The following tables show the criteria defined by users based on these indicators and their priorities.

Factors Commercial Airline

Low Cost Airline

Business Aviation

General Aviation

Passenger Quality

Departure Delay 1 2 1 3

Flight Time 2 3 2 2 Operating Cost Fuel

Consumption 3 1 3 1

Table 4-7 Airspace Users Priorities

Episode 3


Version : 1.00

of 103


Departure Delay Criteria Extra Flight Time Criteria Extra Fuel Consumption Criteria

Com

mer

cial

A

irlin

e

If DD>180 min go to extra flight time criteria

If 1440>DD>180 min ‘stay on ground’

If DD>1440 min ‘cancellation’

If EFT<20% go to extra fuel consumption criteria

If EFT>20% ‘stay on ground’

If EFC<20% ‘re-routing’, ‘slow down’, ‘FL change’

If EFC>20% ‘stay on ground’

Table 4-8 Example of Criteria for Trajectory Change . Commercial Airline

Extra Fuel Consumption Criteria Departure Delay Criteria Extra Flight Time Criteria

Low

Cos

t Airl

ine

If EFC<10% go to Departure Delay criteria


If DD<40 min go to extra flight time criteria


If DD>180 min ‘cancelation’

If EFT<10% ‘re-routing’, ‘slow down’, ‘FL change’


Table 4-9 Example of Criteria for Trajectory Change . Low Cost Airline

Departure Delay Criteria Extra Flight Time Criteria Extra Fuel Consumption Criteria

Bus

ines

s A

viat

ion

If DD>300 min go to extra flight time criteria


If DD>1440 min ‘cancellation’

If EFT<30% go to extra fuel consumption criteria


If EFC<30% ‘re-routing’, ‘slow down’, ‘FL change’


Table 4-10 Example of Criteria for Trajectory Chang e. Business Aviation

Extra Fuel Consumption Criteria Extra Flight Time Criteria Departure Delay Criteria

Gen

eral

Avi

atio

n

If EFC<5% go to extra flight time criteria


If EFT<20% go to Departure Delay criteria


If DD<60 min ‘re-routing’, ‘slow down’, ‘FL change’


If DD>120 min ‘cancelation’

Table 4-11 Example of Criteria for Trajectory Chang e. General Aviation

4.4 ASSESSMENT OF GAMING TECHNIQUE

The final high level objective to be exposed here is referred to the assessment of alternative validation techniques suited to these early stages of concept validation. Gaming technique has been the innovative mean used to conduct the exercise.

Gaming techniques are an innovative method for ATM Operational Concept Validation. Mostly used for military strategy purposes, today they have been adopted and enhanced for validation of operational feasibility of processes.

The assessment of gaming techniques has been done from different evaluation perspectives:

• When using different supporting means for conducting of the experiment;

Episode 3


Version : 1.00

of 103


• By considering the accomplishments of the high level objectives;

• By identification of weaknesses and good practices to exploit correctly the technique;

• By asking experts’ opinions on the technique.

4.4.1 Using different supporting means

As it was explained in §3, the exercise was conducted using gaming techniques with two different supporting means and two different objectives: using just cards and using a dedicated software platform.

4.4.1.1 Using cards

The first gaming sessions were conducted by the game master with the use of cards (papers) that included:

• Role missions and objectives in every game including the necessary information to play;

• Predefined indicators and metrics to rule the games and to cover the identified objectives.

The objective of these sessions were focused on getting familiar with the gaming technique by itself and helping the design of the most interesting processes with the dedicated software platform and its hardware configurations.

Very important initial findings were detected during the sessions with cards that laid the foundations for the investigations in the following sessions with the dedicated software platform (see Table 4-12, Table 4-13 and Table 4-14).

The conclusions obtained from these sessions just using “papers” (cards) were surprisingly constructive. With very cheap means some important topics were already detected during the first gaming sessions. This discover led to the suggestion of using this technique (where every actor plays a different role according to the guidelines of a game master) as a support for clarification of concepts and processes apart from the detection of tools capabilities needed for the correct flow of the operational process. The Expert Groups should incorporate this technique as good practice during their meetings at these stages of the concept maturity.

4.4.1.2 Using a dedicated software platform

The two following gaming sessions used CHILL, a dedicated software platform (apart from cards as supporting material) that provided:

• An area for real-time information sharing offering visibility on the results of the decisions and/or requests;

• Automation in the exchanging of information and communications;

• Evaluation in real time indicators related to the users operations and demand and capacity values in order to support the decision makings of the different roles.

The objective of these sessions were focused on the refinement of the initial findings from the game sessions with cards, the identification of new capabilities for future supporting tools and the analysis of feasibility of gaming techniques as a validation mean.

The use of a dedicated platform to play with during the gaming sessions provided an added value to the analysis in comparison with using just cards. CHILL platform acted as the platform and several advantages were detected:

• The platform provides realism to the scenarios and makes easier, faster and more understandable the roles responsibilities. The platform lets users more concentration on the own role acting as pseudo real stakeholders;

Episode 3


Version : 1.00

of 103


• Additionally, this process realism allows assessing the invested time spans needed by the different roles at every step and for the entire process;

• The platform offers quantitative indicators in real time that support the decision making at every step of the process. The quantitative results can be exploited depending on the role needs. In this way, for instance the operational quality indicators (related to passenger quality and operating cost) would be focused for civilian use purpose. But meanwhile, demand and capacity imbalance indicators would be exploited by AMC/SBR;

• During the gaming, the platform provides an area for real-time information sharing offering visibility on the results of the decisions and/or requests due to the automation in the exchanging of information and communications.

• The platform allows storing the communications during the gaming. This is a priceless information in order to analyse with the expert users (after the sessions) not only how the process evolved and to detect the steps that could have been avoided, modified or omitted, but also to detect the kind of information that was interchanged among users to allow the process flow;

• Furthermore, the platform offers the possibility to register all the changes done on the scenarios during sessions in terms of business trajectories, VGA dimensions, airspace organization… to be taken and exploited for quantitative assessment studies. These data can be pos processed to further analyse the impact on performances;

• Eases the detection of supporting tools capabilities for stakeholders use. The proposed indicators currently implemented in the platform have given clues for experts to identify new metrics and indicators that would help them take decisions and should be implemented in future versions.

4.4.2 Accomplishment of the high level objectives

The conclusions obtained about the use of the gaming technique to cover the high level objectives, have been obtained and consolidated with the experts’ participants of the sessions. The Table 4-12, Table 4-13 and Table 4-14 explain why the gaming technique is good at accomplishing the first three high level objectives: Clarification on AFUA Concept, Process feasibility assessment and Exploration of supporting tools capabilities.

The table also gathers the main high level outcomes related to these three objectives and in which sessions (using just cards or using CHILL) these results raised for the first time. This distinction has been done to highlight that just with cards very important findings were identified. The low level results have been already described in §4.1, 4.2 and 4.3.

Episode 3


Version : 1.00

of 103


MAIN OUTCOMES

GAMING TECHNIQUE IS GOOD AT… USING JUST CARDS USING CHILL

Hig

h Le

vel O

bjec

tive

1: C

LAR

IFIC

AT

ION

ON

AF

UA

C

ON

CE

PT

� Identifying and clarifying the different predefined roles and responsibilities detecting the gaps and overlapping among them. As a consequence, new role functions are recognised and is clearer when and where the different actors should intervene;

� Identifying and defining during debriefing sessions criteria for airspace organization by considering the share use of airspace in an equitable way for all civil and military users. After every session, the findings should be used in the next gaming and therefore the suitability of these criteria and/or new indicators is validated.

� The need of a new function (the Airline Coordinator) to represent users’ interests and to support the AMC/SBR to identify the best solution (equitable, suitable and feasible) for airspace users;

� The need of the communication of explanation on decisions taken by the AMC/SBR for maintaining e.g. capacity and safety levels;

� Previously agreed indicators such as operational quality indicators or equity indicators should be defined in advance to support the AMC/SBR decisions.

� Clarification of Airline Coordinator responsibilities: Having played numerous games involving the Airline Coordinator, the main aspects of this new function have already agreed. This role would also cover the need of ensuring transparency on decisions taken by the AMC/SBR that may impact on civilian users;

� Detailed information in terms of indicators and metrics to be handled by the different users was identified with the use of CHILL platform and operational experts’ participation. Operational quality indicators and equity indicators have been defined.

Table 4-12 Accomplishment of the High Level Objectives 1

MAIN OUTCOMES


Hig

h Le

vel O

bjec

tive

2: P

RO

CE

SS

F

EA

SIB

ILIT

Y A

SS

ES

SM

EN

T

� Analysing feasibility and suitability of different possible processes at early stages of concept validation. The game technique helps identify the appropriateness of the process;

� Highlighting and detecting the operational and decision making issues and bottlenecks raised by the new concepts. The realism for reproducing the process allows detecting the showstoppers of the processes and searching on solutions that may fix the problems.

� The importance of keeping the militaries and the civil users in the negotiation loop up to the end of the planning phase.

� The involvement of civil and military along the process was deeply analyzed by considering all the possible combinations of sequence steps (parallel, sequential) and actors involvements (with or without civil users, airline coordinator, exercise director) In order to detect the most suitable process. This analysis allowed indentifying the most suitable and feasible process to locate and dimension a VGA.

Table 4-13 Accomplishment of the High Level Objectives 2

Episode 3


Version : 1.00

of 103


MAIN OUTCOMES


Hig

h Le

vel O

bjec

tive

3: E

XP

LOR

AT

ION

OF

TH

E

SU

PP

OR

TIN

G T

OO

LS C

AP

CB

ILIIT

ES

� Identifying supporting tools functionalities and required data to help roles take decisions at every step of the process. Every role may have different supporting tools needs according to their responsibilities as well as different information needs and data delivery that is easily detectable during gaming sessions.

� Capture requirements for support functionalities or applications needed for the process that implies configurable what-if tools, able to calculate solutions to optimise the chosen predefined indicators;

� Automation is essential to cope with the users access to airspace with the most equitable way and to assess the best airspace organization to reduce the impact on civil users to a minimum.

� The requirements for supporting tools were refined not only for use by the AMC/SBR but also the civil and military users.

� The AMC/SBR need a tool/functionality that provides indicator of complexity/DCB imbalance associated to each possible airspace solution;

� More powerful what-if tools would make possible to calculate the best airspace organizations taking into account the users business models in real time;

� The different users need tools to calculate the optimised operational quality indicators according to their business models.

Table 4-14 Accomplishment of the High Level Objective 3

4.4.3 Weaknesses, enhancements and good practices

During the gaming sessions, some issues were detected, and as a consequence enhancements were implemented. In this section, some recommendations and good practices are gathered to make a good exploitation of the technique. The main ideas are met in the following bullets:

• In order to make the most of the time, training of the actors/players on the gaming technique and tools is essential before starting the sessions. The training would consist of toy games that are simple games to clearly understand the rules, dynamicity of the serious games and to get familiar with the platform capabilities (in case a dedicated platform is used). Even, it could be interesting that experts are involved in the preparation of scenarios of the exercises previously to the sessions running;

• Ensuring that actors have the right understanding of their predefined roles and responsibilities at these stages of the concept is also of outmost importance. Making use of operational experts participation combined with the future concept application, the results of the game may inspire changes or additions to the predefined roles functions;

• In this way, the actors should be operational experts that are well connoisseurs of the current problems and therefore, they are the masters to judge if the application of the future concept “pieces” are beneficial in terms of performances and process feasibility;

Episode 3


Version : 1.00

of 103


• Additionally, different ways of interpreting the same roles were present, so ideally, to fully exploit the technique possibilities, same games should be repeated with different groups of actors in order to check the suitability of the different interpretations.

• Other option that was also successfully tested and for that reason, strongly recommended, was exchanging the roles among experts participants. That allowed detecting what changes would be desired from different points of view;

• The definition of the session scope needs to be very precise. This technique is not useful to explore a full concept but delimited concept “pieces”. It is necessary to stress on the objectives that are intended to be covered and the possible issues of the game;

• Due to room limitations, it is not possible to play with all actors involved in a real operational scenario. In the case of civil users, the actor performance should represent not only a particular company but civil user’s collectives such as commercial aviation, low cost, business or general aviation. In this case the actor performance can be considered more representative;

• In order to ensure the confidence on the quantitative assessment due to the processes feasibility, it would be recommended to repeat the same games with different actors to ensure the representativeness of the role patterns.

4.4.4 Experts Opinions

Before starting the gaming sessions and after the session using cards and using the dedicated platform, some questioners were delivered to experts so that they could express their thoughts about the technique. Most of these ideas have been already collected in the previous bullets but here in this section, the results are focused on experts’ feelings regarding confidence on the technique and the obtained results by using it, i.e., subjective aspects of the technique.

At these stages of the concept maturity, the use of gaming techniques to support Expert Judgement was unanimously found extremely positive. The conclusions obtained from an expert group are more solid if the process is played than if they are only based on discussions and theoretical ideas. For example, gaming sessions allow simulation of the discussions practically by exploring concepts.

In this way, the Expert Judgement provides more fruitful conclusions for concept clarification. Furthermore, the performance of actors’ interactions in a pseudo real environment makes possible the process feasibility assessment and the detection of supporting tools capabilities.

The following charts show some questions and answers obtained after analysing the questioners.

The following charts (Figure 4-10) show the experts opinions means on the confidence that they had in the gaming technique. The answers have been compared in three situations: before starting any game sessions (pre-gaming questionnaire) and after game sessions using cards (post-gaming with papers) and after game sessions using CHILL (post-gaming with CHILL).

Episode 3


Version : 1.00

of 103


6

6,5

7

7,5

8

8,5

9

What do you think about the gaming technique?

6

6,5

7

7,5

8

8,5

9

How much confidence did you have in the results

obtained during the gaming sessions?

Results of the PRE-GAMING questionnaire

Results of the POST-GAMING (WITH PAPERS) questionnaire

Results of the POST-GAMING (WITH CHILL) questionnaire

Figure 4-10 Confidence in the Gaming Technique

The gaming technique was really well valuated and it can be appreciated how the feeling on the technique improved along the sessions. Just one of the experts had participated once in a gaming session, so in general the participants did not have any experience on the technique but high expectations. The confidence on the results is higher when using a dedicated platform than when using just cards that was a repeated conclusion during the last sessions.

In addition, the questioners also investigated about their opinions on particular aspects of the technique such as: usability, reliability, accuracy, understandable, likeliness and ease to play (Figure 4-11).

0

1

2

3

4

5

6

7

8

9

Useful? How reliable is

it?

How accurately

does it work?

Understanding

how it works

Do like playing

it?

Is it easy to

play?



Figure 4-11 Usefulness of the Gaming Technique

The experts enjoyed playing the games and understood quickly the dynamicity of the technique. But also they detected some weaknesses of the technique already included in the previous section: the results can have variability that impacts on the reliability on the results and their accuracy. This variability is very sensitive to aspects like: different ways of interpreting the same roles, not having clear understanding of the game scope or a poor training. In order to bridge these gaps, some good practices have been summarised in § 4.4.3.

Episode 3


Version : 1.00

of 103


Finally, going to more details on the gaming technique confidence, the experts were asked if the use of this technique had covered the high level objectives planned for the exercise. Confidence on the results in the accomplishment of the objectives was really positive and highly valuated. Special mention is done about the usefulness of the technique to explore tools capabilities.

Regarding the use of different supporting means, after having used CHILL the opinion about confidence on results just using papers decreased, what means that using a dedicated platforms enhance the results confidence.

0

2

4

6

8

10

Using papers Using

hardware

platforms

To clarify

AFUA

concept

Assessment

of process

feasibility

To explore

tools

capabilities



Figure 4-12 High level objectives covering

4.5 CONFIDENCE IN EXPERIMENT RESULTS

4.5.1 Quality of Results of Experiment

In order to ensure the confidence on results, questionnaires and debriefing sessions were used to consolidate the mentioned results and to obtain the feedback from the experts.

In some sessions, the roles among experts participants were exchanged in order to check the suitability of the different interpretations.

At early stages of the concept maturity conclusions from local environments (such as a FAB) on process feasibility can be extrapolated to other FABs as it happens to this exercise.

4.5.2 Significance of Results of Experiment

As it was stated in the Experimental Plan [1], operationally significant changes are those that have a significant impact on ATM operations. This impact has been locally analysed considering our exercise objectives. Expert Groups sessions concluded that operationally significant improvements could be recognized if the expected benefits are achieved. These benefits are qualitatively in our exercise. The confidence level of these results has been identified depending on the level of agreement achieved by the gamers involved in the process.

The treated topics, were mostly agreed by all experts except some aspects of the AOCCo:

• Represents the civil airspace users’ interests into the ATM System and deal with their problems;

Episode 3


Version : 1.00

of 103




Further research is needed to clarify this issue.

4.6 UNEXPECTED EXPERIMENT RESULTS

As it has been already mentioned, from the first gaming sessions the need of having a new function that would represent users’ interests was detected when a considerable number of users were affected because of military airspace reservations.

The AMC/SBR role found difficult to handle in a same function, all preferences coming from the different users along with the stability of the FAB and the accomplishment with airspace capacity restrictions. For these reasons a new role/function was identified to assist the AMC/SBR to identify the best solution (equitable, suitable and feasible) for airspace users.

Episode 3


Version : 1.00

of 103


5 ANALYSIS OF EXPERIMENT OUTCOMES

5.1 ANALYSIS OF OUTCOMES ON THE BASIS OF DETERMINED HYPOTHESES

The hypotheses stated in the Experimental Plan were mainly focused on performance benefits. Performance results have not been finally provided but operational feasibility. Therefore just hypothesis H1 has been covered and accepted.

The DCB Negotiation Processes at local/sub-regional level between Civil/Military Airspace Users, Civil/Military Airspace Manager and the Sub-Regional Manager when a change of airspace reservation by military is produced:

Hypothesis acceptance Justification

H1: will be operationally feasible Accepted

As the process was high level described in the concept, a detailed process has been designed to ensure its operational feasibility. For more information on the process assessment to check its feasibility see §4.2.

H2: will increase the airspace capacity through the identification of the most suitable airspace configuration adapted to the military and civil users (AFUA Concept)

NA Performance assessment has not been accomplished

H3: will increase the flight efficiency, both temporal and fuel efficiency, as the distortion of users trajectories will be minimised


H4: will increase flexibility to manage changes in Airspace Reservations: quick reaction to take advantage of capacity opportunities due to the release of an initially planned military airspace reservation


Table 5-1 Hypothesis accomplishment Summary

5.2 ANALYSIS OF CONSEQUENCES OF OUTCOMES FOR EXPERIMENT OBJECTIVES

AND ASSUMPTIONS

The following table analysis the low level objectives that were successfully covered and which ones would need further study.

Low Level Objectives as they are in the Experimental Plan Outcomes Consequence

on Objective

#1a: The Flexible Use of Airspace (FUA) process is improved with more dynamic airspace management enabling dynamic responses to short notice military airspace requirements (up to 3 hours before operations) or very short term changes (e.g. bad weather);


See §4.1.2, 4.1.3 and 4.1.4.

NA

Hig

h Le

vel O

bjec

tive

#1

Clarification of the SESAR Concept in the following aspects

#1b: Real-time coordination to design, allocate, open and close military airspace structures on the day of operations (short term phase)


See §4.1.2, 4.1.3 and 4.1.4.

NA

Episode 3


Version : 1.00

of 103



on Objective

#1c: The possibility for ad-hoc structure delineation at short notice is offered to respond to short-term airspace users' requirements not covered by pre-defined structures and/or scenarios

Successfully covered. See §4.1.2, 4.1.3 and 4.1.4.

NA

#1d: The route network will evolve to fewer pre-defined routes with the exploitation of advanced navigation capabilities and generalisation of FABs not constrained by FIR boundaries, allowing for more direct routes and free routing. However, it is assumed that some form of route network will be retained to cater for specific requirements (e.g. corridors/routes for capable aircraft through the military area, military flight planning, etc.)

Not addressed.

Further research activities should be performed to analyse the route structures combined with military areas.

#1e: Airspace users can refine the Shared Business / Mission Trajectory (SBT) taking into account constraints arising from new and more accurate information. They access to an up-to-date picture of the traffic situation with the level of detail required for planning (incl. Historical data, forecasted data, already known intentions, MET forecast, current traffic, ASM situation, etc.).


See §4.1.2, 4.1.3 and 4.1.4.

NA

#1f: Clarification on the definition of the roles and responsibilities of all actors involved in the exercise (Users, Military, Civil/Military Airspace Users, and Sub-Regional Manager


See §4.1.

NA

Hig

h Le

vel

Obj

ectiv

e #2

#2a: Providing evidence of the operational feasibility of the collaborative planning processes involved when Airspace Reservations are changed by military users by considering the dynamic diverse airspace use (AFUA concept)


See §4.2.

NA

#3a: Identification of the potential functionalities of what-if tools to support the selection of the airspace configurations and management which will support the decisions of Airspace Managers and Sub-Regional Managers



NA

Hig

h Le

vel O

bjec

tive

#3

#3b: Exploration the possibility of creating a what-if prototype tool with some of the potential functionalities to obtain the most suitable airspace configurations considering the civil and military needs

Not fully addressed due to effort limitations.

Investment on CHILL development to integrate the what-if tools is requested

Episode 3


Version : 1.00

of 103



on Objective

#3c: Identification of which are the set of criteria relevant to select the most suitable airspace configurations (e.g. minimise network effect, optimise flight efficiency (both temporal and fuel efficiency), minimise the impact on users’ initial requirements, etc.). These criteria should be included as functionalities of the what-if prototype tool



NA

#4a: Test, as an innovative validation mean, the integration of validation techniques (gaming + what-if prototype tool)

Not fully covered. This analysis has been done with expert judgement.

Further research activities should be performed to define a methodology to analyse the combined use of gaming and performance assessment tools

#4b: Analysis of gaming technique as an innovative mean for clarification of the concept


See §4.4.

NA

Hig

h Le

vel O

bjec

tive

#4

#4c: Preliminary assessment if possible, because of the combination of the what-if prototype tool and the gaming platform, events could be recorded after the gaming sessions and therefore a preliminary assessment could be done.

Not covered.

Further research activities should be performed to exploit the combination of gaming and performance assessment tools

Table 5-2 Low level objectives accomplishment

Regarding assumptions, the assumptions that finally have not been accomplished or modified are gathered in the Table 5-3. An analysis of the impact of these modifications on the objectives and results is also included.

Assumption as it is in the Experimental Plan Modification Consequence on the

results

The timeframe of the Exercise is medium term close to short term i.e. from one day to two hours before the operation. Initially, all trajectories are SBTs. However, RBTs are considered just in the case that the airport origin is far from the area

The timeframe of the Exercise is medium term close to short term i.e. from one day to two hours before the operation. All trajectories are considered SBTs.

Results on Objective #1 could have been more detailed with this sensitivity analysis regarding SBT/SBTs statues. Further research is recommended.

The definition of airspace configurations is related to airspace volumes but also route and may combine both of them e.g. routes to

The definition of airspace configurations is related to airspace volumes. The Airspace Organization would consist of

The low level objective #1d has not been accomplished so further research activities should be performed to

Episode 3


Version : 1.00

of 103



results activate depending on sector configuration. The Airspace Organization would consist of predefined solutions: Temporary Route Structures and Change of sectorizations.

predefined solutions (change of configurations).

analyse the route structures combined with military areas.

• The catalogue of airspace DCB solutions contains ASM solutions to (re)organise airspace in response to an imbalance, with an integrated view of traffic demand and airspace requirements;

• The DCB solutions considered in the exercise are focused only at Airspace level in a FAB:

o Airspace configuration including military activity;

o Temporary route structure.

The DCB solutions considered in the exercise are focused only at Airspace level in a FAB. The catalogue of airspace DCB solutions contains ASM solutions to (re)organise airspace in response to an imbalance, with an integrated view of traffic demand and airspace requirements. They consist of predefined solutions: change of sectorizations.

The low level objective #1d has not been accomplished so further research activities should be performed to analyse the route structures combined with military areas.

The best airspace configurations are based on the traffic complexity expected for the day of operations and the users intentions;

The best airspace configurations are based on the maximum throughput handled by considering sector capacities expected for the day of operations and the users intentions.

The low level objective #3b has not been accomplished so further investment on CHILL platform should be done.

The methodology to detect imbalances is based on traffic complexity (ATC Workload) measurement when the maximum admissible values are reached

The methodology to detect imbalances is based on Traffic throughput vs. Capacity. The capacity values have been tuned to comply with the objective of each gaming session, e.g. when analysing share use of airspace in conflict with capacity, the capacity values were modified to reproduce this situation.

The low level objective #3b has not been accomplished so further investment on CHILL platform should be done.

The mission trajectories should be considered as if they were business trajectories and affect the workload of the controller when they fly from their airbase to the airspace reservation. The degree of workload affection will be dependent on:

• The distance between the airbase and the airspace reservation;

• The civil traffic density during this aforementioned transition;

• The number of military flights flying to the airspace reservation

Removed.

Workload assessment has not been done as the what-if prototype tool initially foreseen to be plugged in the CHILL platform was not prepared. Objective #4a and #4c were not covered.

Episode 3


Version : 1.00

of 103



results

SWIM-enabled NOP is operational 75%. The non equipped aircraft are penalised: they are out of the negotiation and have to accept any solution

SWIM-enabled NOP is operational, 75% of the aircraft are nodes connected to the network via SWIM. However, in the gaming exercises, a rate of 100% of equipped aircraft was considered for simplification purpose.

Results on Objective #1 could have been more detailed with this sensitivity analysis regarding SIM-enabled NOP. Further research is recommended.

ATM Service Level 3 is operational, 75% of the flights are capable of ATM Service Level 3 operations

ATM Service Level 37 is operational, 75%8 of the flights are capable of ATM Service Level 3 operations.

Results on Objective #1 could have been more detailed with this sensitivity analysis regarding flight capabilities. Further research is recommended.

Table 5-3 Impact of Assumptions changes on objectives

7

ATM Service Level 3 is characterized by: • Achieving advanced automation in a shared trajectory environment;

• Dynamic TMAs and Flexible Military structures;

• Dynamic DCB using RBT;

• Management Revision of RBT using Datalink;

• Full set of Advanced Controller tools using RBT/SBT;

• ASEP-ITP;

• 2D-PTC on User Preferred Trajectories;

• 3D-PTC on Predefined Routes. 8 According to SESAR D5 delivery [3], 25% of aircraft could be ATM level 2 capable. The proposed 75% value

includes flights ATM level 2 capable. AFUA supposes ATM level 3 capabilities.

Episode 3


Version : 1.00

of 103


6 CONLUSIONS AND RECOMMENDATIONS

6.1 KEY FINDINGS

This section states to which extent the exercise provided evidence that the ATM concept relates to the OIs, inclusive findings with regard to validation technique.

1. The ideal process to design, allocate, open and close ad-hoc military airspace structures would consist of an intermediate process between a ‘parallel’ and a ‘sequential’ one. The figure below reflects this optimal collaborative process, taking into account that the final solution is obtained through an iterative process with several loops:

Exercise

Director

1 2

34

5

VGA needs and

flexibility:

Solutions 1-5

4

Evaluation with real preferred rerouted trajectories and VGA location

preferences the impact on airspace.

Evaluation of alternative solutions to ensure users preferences

considerations.

Evaluation of users preferences.

5


Airline

Coordinator

Sub-Regional

ManagerMIL ASM

CIVIL ASM

54

Figure 6-1 Optimal Process

The dimension and location of a military airspace reservation is a process where not only the Exercise Director and the Airspace Managers are the involved actors but also the civilian part are a key active part of the collaborative process.

In this way, the Exercise Director will intervene during all the process, willing to offer greater flexibility, if necessary, to impact civil users to a minimum. Particularly, when the civilian access intention interferes with capacity, the first step to do is to request military the possibility of flexibility in location, dimension or timing slots in order to smooth the impact.

o Addressed OI step AOM-0206 Flexible Military Airspace Structure: The creation of a VGA (Variable Geometry Area) to respond to short-term military users' requirements not covered by pre-defined structures and/or scenarios has been analysed in the gaming to clarify the operational feasibility of the related processes when is implemented at short notice.

2. Regarding refinement of roles and responsibilities , a new role/function, named Airline Coordinator , representing airspace users’ interests was detected. It should always be aware of the negotiation process, ensuring the transparency of process for

Episode 3


Version : 1.00

of 103


users and that the users’ preferences are taken into consideration. The new role/function only intervenes in the process flow if the problem cannot be solved through direct negotiation between the civil airspace users and the Sub-Regional Manager and the Airspace Management Cell (e.g. a considerable number of users are affected).

The Sub-Regional Manager and the Airspace Management Cell will be responsible for deciding the use of airspace between civil and military airspace users. Equity Indicators will be considered for guaranteeing the equitable access to the shared airspace. Cost of Solution Indicators will allow Sub-Regional Manager and the Airspace Management Cell to select the most appropriate airspace configuration in order to maintain the performance levels targets (essentially capacity and efficiency levels). The information needed for calculating these indicators includes historic data, workload, capacity, etc.

In addition, and with the equity as the final goal, the Airspace Users and the Airline Coordinator will work with the Operational Quality Indicator which is a combination of the Passenger Quality and Operating Cost factors.

If there is an unexpected airspace release by the military users and is published very close to the operation, the civil airspace users may not consider the capacity opportunity.

o Addressed OI step AOM-0206 Flexible Military Airspace Structure: The definition and dimension of a VGA (Variable Geometry Area) have been analysed in the gaming to clarify the roles and responsibilities during the process;

o Addressed OI step AUO-0204 Agreed Reference Business / Mission Trajectory (RBT) through Collaborative Flight Planning: During the gaming sessions the airspace users have had the opportunity to change their trajectories when airspace demands are changed by military.

3. Related to needed enablers to support the process , all actors involved in the negotiation processes should be supported by automation tools which guarantee the information sharing and its transparency. Real-time coordination is further enhanced through what-if functionalities and automated support. These supporting tools will be configurable and will be equipped with customizable alarms to alert actors/roles about changes affecting the progress of the negotiation.

o Addressed OI step AOM-0202 Enhanced Real-time Civil-Military Coordination of Airspace Utilisation. This OI step has been addressed by identifying the tool capabilities needed for airspace booking and management when military changes the airspace reservation. The negotiation and coordination processes between civil and military users have defined the needed what-if tool capabilities not only for airspace management but also civilian usage.

4. Finally, Gaming technique is proven as applicable and useful for validation purposes at early stages of the concept maturity. It can be used in combination with other techniques e.g. expert groups or modelling for clarification of concepts and processes as well as for the identification of tool requirements and capabilities and initial performance assessments.

6.2 ISSUES

Four main issues have been identified to be explored for further sessions and researching activities:

Episode 3


Version : 1.00

of 103


• Exploration of gaming techniques combined with mode lling techniques;

One of the outmost pending issues that due to lack of effort and time has not been fully explored is the combination of gaming sessions with modelling techniques to provide preliminary performance assessment. It is recognised that the way a process is performed is impacting the performance levels. The combination of techniques offers invaluable results for analysing the interaction between process and performances. Besides, this connection seems to be not so easy to be performed and a methodology is necessary to be defined and described as good practices to exploit the combination of techniques.

During these sessions, gaming technique has been presented as a technique that allows to run scenarios in real-time (or even slow time) for the decision process and has been used to promote non-routine thinking, thus enabling out-of-the-box thinking. The straightforward outputs are not appropriate to be fed directly to fast time simulation techniques or modelling in general to obtain performance assessment. The gaming results must be treated in advance to extrapolate and obtain general patterns at different levels to be used as inputs for these performance assessment techniques. The general patterns can be obtained with the support of experts and/or same games should be repeated with different groups of actors in order to ensure the representativeness of the results (for instance, different ways of interpreting the same roles were present during sessions).

• Wider airspace users’ representation and participat ion;

Participation of a wider range of airspace users have been also a weakness of the sessions. Although important airlines of commercial aviation (Iberia and Air Europa) have participated and provided priceless conclusions during sessions, other market segments (such as low cost, general aviation, business aviation) have not taken part into the games. Their views were captured with Experts Groups meetings and tried to fictitiously be considered during gaming sessions but this is not comparable with having their direct participation. Other showstoppers may have been discovered because of the interaction of these different interests among them.

• Working on the specification, development and test s of What-if and supporting tools prototypes for the next maturity s teps in the validation process;

Finally the other topic that has not fully covered due to effort limitations is the development of what-if tool full capabilities to support the airspace organization and management. The initial intension was to automate to a maximum the airspace management and to select the most suitable airspace configuration due to traffic complexity. For further sessions and exploitation of CHILL platform, a what-if tool with these capabilities would provide appreciable added value for making decisions and extrapolate results for performance assessment.

• Risks detected for AOCCo role.

When consolidating AOCCo role responsibilities with experts, two risks were detected. It was agreed that the AOCCo would represent the civil airspace users’ interests into the ATM System and deal with their problems, but two issues arose:



These risks should be further analysed and investigated.

Episode 3


Version : 1.00

of 103


6.3 GENERAL RECOMMENDATIONS

In section General Recommendations, the main suggestions have been grouped according the following topics:

• Recommendations for a correct application of the gaming technique;

• Recommendations for concept refinement (clarification and operational feasibility assessment) on supporting DODs;

• Recommendations for concept refinement (clarification and operational feasibility assessment) on supporting Operational Scenarios.

6.3.1 Recommendations for Gaming Technique Usage

Related to the application of the technique

• Gaming is focused on assessment of operational feasibility of processes (for instance CDM, UDPP processes). To check the feasibility of the process, actors are needed to represent all the roles involved in the analysed process (controllers, pilots, network managers, sub-regional managers, AOC, APOC, handling,…) in real time or even in slow time. This technique will identify the bottlenecks and shortcomings of the processes considering that actors may have different goals and have to make collaborative decisions;

• It is proven that gaming can be used at all concept definition stages : at early stages of concept maturity, gaming technique refines and clarifies the different roles and responsibilities involved in the processes, identifying the suitable steps in the process. As the concept gets more definition, this technique keeps refining details of roles and processes and identifying the showstoppers and bottlenecks and the appropriate strategies to fix them;

• Game can also be exploited to identify the information flows needed to be interchanged . In turn, it helps spot the necessary enablers to support the decision making of the different actors and capture their functional detailed capabilities ;

• Gaming can be used at all concept layered planning phases : long term, medium-short term and execution phases. During planning phases gaming would be more focused on the collaborative process feasibility and decision making between actors without being the time a constraining factor of the negotiation. During execution phase, time is the driver and therefore negotiation is more limited;

• Gaming is a good technique to analyse parts of the concept . This technique is not useful to explore a full concept but delimited concept “pieces”;

• Regarding the scenario scale to be performed, it is fully dependant on the means used for running the sessions. The most simple way to play a game is using cards and papers so the performance of large scales processes (for instance at network level) seems to be more feasible than when using software and hardware platforms to support the collaborative negotiations;

• Gaming has limited capability for performance assessment (just mainly on Access and Equity). The nature of the technique does not provide quantitative values but the operational feasibility of the process.

Related to the preparation of the sessions

• Preparation in advance of different processes alternatives (steps sequence) and actors involvement, in order to check the suitability of the set of the procedures;

• Clear definition of the objectives to be addressed during the session. The objectives can consist on refinement roles and responsibilities, identification of

Episode 3


Version : 1.00

of 103


showstoppers during the processes, interactions among actors, information flows, supporting tools capabilities identification, analysis of process suitability. The objectives can be diverse and even some of them can be addressed during the same session;

• The roles should have a high level clear view of their mission , objectives and personal strategies during the session. How to get their mission and personal objectives are the details on their roles and responsibilities and these are the expected outcomes of the game;

• The freedom degrees of roles performances are constrain ed by the level of maturity of the topic to deal with. The first gaming sessions to address a part of the concept not mature enough should let participants to act freely in order to obtain a preliminary description of the concept to work with in the following sessions. Once the concept is more detailed, the scenario should be prepared (or with the Game Master intervention) to lead the game towards the main topics to be refined during sessions;

• The outcomes of every process should be iterative : The conclusions obtained from a particular process should be used to feed and design the following process (combination of actors’ involvement and sequences). In this way the advantages and disadvantages found in every gaming session are refined in the next session;

• Training of the actors/players on the gaming technique and tools is essential before starting the sessions. The training would consist of toy games that are simple games to clearly understand the rules, dynamicity of the serious games and to get familiar with the platform capabilities (in case a dedicated platform is used). Even, it could be interesting that experts were involved in the preparation of scenarios of the exercises previously to the sessions running;

• In this way, the actors should be operational experts that are well connoisseurs of the current problems and therefore, they are the masters to judge if the application of the future concept “pieces” is beneficial in terms of process feasibility.

Related to the use of support means

Two supported means have been identified: paper based and platform based.

• It is recommended to start the games just using cards to get familiar with the gaming technique by itself and help the design of the afterwards most interesting processes with the dedicated software platform and its hardware configurations;

• The gaming paper-based allows is more suitable for early stages of concept maturity . The details are not well known in advance and with cheap means, the involved experts define and clarify processes;

• The gaming platform based provides greater realism of the process and makes easier, faster and more understandable the roles responsibilities offering quantitative indicators to support the decision making during negotiation and collaboration processes;

• Furthermore, the platform offers the possibility to register all the changes done on the scenarios during sessions to be taken and exploited for quantitative assessment studies. These data can be pos processed to further analyse the impact on performances;

• In order to enhance the platform capabilities, it is recommended to develop agent models to be plugged into the platforms to emulate roles. These agents would allow more interaction between actors for the analysis and reduce the human resources cost.

Episode 3


Version : 1.00

of 103


Related to the result analysis, representativeness and confidence

• It is strongly recommended to record the communications between actors and analyse them with the experts after the sessions. The purpose is twofold: analyse how the process evolved to detect the steps that could have been avoided, modified or omitted, and also to detect the kind of information that was interchanged among users to allow the process flows;

• Questionnaires and debriefing sessions provide insi ght information on issues such as: actors feeling about problems/solutions, detection of the conditions where there is no agreement between different actors, working environment dynamicity, impact on actors’ situational awareness, definition of the roles and responsibilities during the negotiation process and identification of potential ambiguities or identification of potential bottlenecks in the process;

• In order to ensure the confidence on results, it is recommended to repeat same games with different groups of actors in order to check the suitability of the different interpretations. Other option strongly recommended, is to exchange the roles among experts participants as it allows detecting what changes would be desired from different points of view;

• If repetition of games, or involvement of different actors are not possible, in order to ensure the behaviour representativeness, In the case of civil users , the actor performance should represent not only a particular role but the collective, as for instance civil users (such as commercial aviation, low cost, business or general aviation;

• At early stages of the concept maturity conclusions from local environments on process feasibility can be extrapolated . Once the game is played with further level of details and is referred to local constraints, the conclusions on the processes may not be representatives anymore.

Related to combination of techniques

• The Expert Groups should incorporate gaming sessions as good practice during their meetings at early stages of the concept maturity. Gaming promotes non-routine thinking facilitating the refinement, clarification and validation of the concept process feasibility;

• The combination with Modelling and FTS should allow the performance assessment due to processes impact but the straightforward outputs seems to be not appropriate to be fed directly to fast time simulation techniques or modelling in general to obtain performance assessment. The gaming results must be treated in advance to extrapolate and obtain general patterns at different levels to be used as inputs for these performance assessment techniques;

• Prototyping sessions and finally RTS should run after gaming sessions to analyse operational feasibility of processes in real environments and real time execution. These techniques would refine the conclusions of gaming at more mature concept stages.

6.3.2 Recommendations on supporting DODs

The Interim DOD D2.2.-033 Medium/Short Term Network Planning-M2 has been considered as reference and where the WP3.3.3 results can be integrated. The high level description is consistent with the WP3.3.3 findings in terms of concept clarification but for low level detailed processes scoped by M2, WP3.3.3 provides more clarification, additions and even corrections when military users require airspace reservation at short notice. The analysed process have been focused between the end of medium term phase and short term phase (from one day to

Episode 3


Version : 1.00

of 103


some hours before the operation), and therefore the recommendations for DOD changes are fitted to this time frame.

The key recommendations on supporting DODs are listed in Table 6-1 and linked with the low-level processes as they are in the ATM Process Model SADT diagrams. For more information, references to the content of this exercise report are also included in the mentioned table.

Code9 ATM Process DOD Description WP3.3.3 Contribution

A2.1.1

Refine/Define Airspace Reservation Demand

This process allows the long-term airspace requirements to be refined with more detailed requests, e.g. military reservations. But it also allows defining new airspace reservation demand during the medium/short term planning phase.

Civil users are also involved in this process. The dimension and location of a military airspace reservation is a process where not only the Exercise Director and the Airspace Managers are the involved actors but also the civilian part are a key active part by providing their preferences.

In turn, the Exercise Director will intervene during all the process, willing to offer greater flexibility, if necessary, to impact civil users to a minimum.

Reference §4.2

A2.1.2.2 Optimise SBT

Through this process, SBTs are filed/refined and optimised to the best outcome for the user. This process is mainly a short term process.

For the SBT optimization process, the civil users will refine their preferred trajectories according to an Operational Quality Indicator. This indicator is a combination of Passenger Quality Indicator and an Operating Cost indicator.

For those users who cannot afford to invest on tools, an access via SWIM to a standard supporting tool could be enabled so they could tune it according to their business model. This standard supporting tool for civil airspace users need to be agreed developed and made available to the ATM community. The supporting tool needs to be configurable, so each civil airspace user could customize it depending on its business model.

Reference §4.1.1.2, 4.1.2, 4.2 and 4.3.2

A2.1.2.3 Validate SBT

SBT Validation is the latest process before integration of the updated SBT inside the NOP.

No major contribution

9 This refers to the code associated to the process in the ATM Process Model SADT diagrams.

Episode 3


Version : 1.00

of 103



A2.1.3 Start UDPP on SBTs

This is an AOC process dealing with activities related specifically to UDPP process. However, SBT revisions are still effectively processed through "Optimise SBT" while UDPP Results should usually consist of a prioritised flight list.

No contribution

A2.1.4 Build/Refine Reference Traffic Demand

The Reference Traffic Demand is elaborated and used during the Medium Term Planning Phase. The reference planned traffic demand, built in a first step with only some SBTs in medium term, is continuously refined as soon as more SBTs are available or optimised.

No contribution

A2.2.1.2 Refine Airspace Usage Rules

In this process, airspace volume (including military areas) and route (route crossing military areas, SIDs, STARs, routes that can be activated in high density areas …) usage rules are refined if required.

The rules related to the definition of military areas should involve not only the Airspace Managers/SBR, and the Exercise Director but also the civil airspace users by providing the airspace reservation dimension along with their preferred distorted trajectories.

The criteria to allocate a VGA should take into consideration Equity Indicators to analyse the access to share airspace between civil and military users. Furthermore, to ensure the VGA location/dimension impact civil air traffic to a minimum several indicators have been accepted and consolidated: Minimum Number of affected SBTs, historic information at FAB Level, Operational Quality Indicator, and Cost of Solution.

Reference §4.1.2, 4.2 and 4.3

A2.2.1.3 Refine Network Usage Rules

This process produces network usage rules as a consistent check of refined Airspace Usage Rules and refined Airport Usage Rules.

No contribution

Episode 3


Version : 1.00

of 103



A2.2.2.2 Refine Possible Airspace Configurations

The possible airspace configurations refinement process aims at refining the possible configurations established in the long term planning phase. For each airspace resource, times of use are specified, e.g. per day type - i.e. week day, week-end, holiday, special event day.

For the refinement of the possible airspace configurations when military requests airspace needs at short notice, the AMC/SBR selects the most suitable airspace organization associated to each possible VGA by:

- considering the user preferences and military airspace reservations;

- ranking them according to a cost of solution;

- ensuring the demand/capacity balance based on both number of movements and traffic complexity (ATC Workload) measurement;

- assessing the impact at FAB level.

The ‘Cost of Solution’ Indicator is a combination of Equitable Criteria, Demand and Capacity balance among sectors, Workload Saturation Indicator of the most suitable airspace organization, Workload Balance Indicator among sectors of the most suitable airspace organization, Total Workload Indicator of the most suitable airspace organization.

Reference §4.1.1.4, 4.1.2, 4.2 and 4.3.1

A2.2.3.2

Refine Airspace Resource Available Capacity Plan

Airspace Available Resource Capacity Planning gathers for each Airspace Configuration the available capacity, taking into account human resources plans, enhancement plans, etc.

No contribution

A2.3.1.2

Detect Airspace Demand Capacity Imbalance

This process aims at balancing demand and capacity for each Airspace Volume. For each day of operation, flights are scheduled over time periods according to scheduled available capacity. Then, resources scheduling are consolidated in order to detect demand capacity imbalance.

The detection of demand and capacity imbalance is done at short term based also on traffic complexity. The agreed method for complexity assessment is the ATC workload assessment.

Reference §4.3.1

Episode 3


Version : 1.00

of 103



A2.3.2.1.2

Select/Refine/Elaborate a DCB Solution at Network Level

This process allows the selection/refinement/elaboration of a DCB Solution at the Airspace level. Taking into account the detected Demand/Capacity Imbalance, the resulting Airspace DCB Solution is provided with an associated cost.

Note: Solution acceptance depends on the related KPIs that are part of the target performance objectives defined and agreed by all Actors during the long-term planning phase.

The selection/refinement/elaboration of a DCB solution should always consider equity indicators as shared use is conflicting with other performance expectations, in this capacity. The indicator Cost of Solution should include indicators to ensure the equity between users such as historical reasons (Number of times that same civil users have been affected, Historical distortions degrees, flight priorities or SBT/RBT status).

Reference §4.1.3

A2.3.2.2.1 Assess Network Impact of the DCB Solution

This process describes respectively how the Sub-Regional and Regional Network Manager assesses the local/network impact of a DCB solution (possibly made of several DCB measures). Network impact assessment must be performed the more as DCB solutions will be defined most of the time at local level. Distant network impact cannot be detected at sub-regional/local level.

Not contribution

Episode 3


Version : 1.00

of 103



A2.3.2.2.2 Apply the DCB Solution

This process describes how the Sub-Regional Network Manager or APOC Staff may send a GO for implementation concerning the DCB solutions that have been activated in the NOP locally and require Network Impact assessment. Not all DCB solutions will require Network Impact assessment: those having sub-regional/local impact only (this being determined during the long-term planning phase) will not need network impact assessment in order to be published in the NOP (default GO for implementation).

No major contributions

Table 6-1 Recommendations on Supporting DODs

It also recommended updating section on Roles and Responsibilities related to Airspace Managers, Sub-Regional Manager and Airspace Users with the WP3.3.3 results. The three main points to be refined are:

• Identification of a new role/function named Airline Coordinator to represent the civil airspace users’ interests into the ATM System and deal with their problems. The role/function would work jointly with the Airspace Manager and Sub-Regional Manager to ensure the transparency of process for users and that the users’ preferences are taken into consideration. The new role/function only intervenes in the process flow if the problem cannot be solved through direct negotiation between the civil airspace users and the Sub-Regional Manager and the Airspace Management Cell (e.g. a considerable number of users are affected). More details can be found in §4.1.1.1 and 4.2;

• The Civil/military Airspace Managers closely cooperates with the Sub-Regional network manager for the most efficient use of airspace and at FAB level, the Airspace Manager and the Sub-Regional Manager can be merged in only one role performing all the related functions. More details can be found in §4.1.1.1;

• The AOC Staff along with the Airline Coordinator functions also intervene in the processes referred to Table 6-1, A2.1.1 Refine/Define Airspace Reservation Demand and A2.2.1.2 Refine Airspace Usage Rules. They provide their preferences on the military airspace reservation location and the associated trajectories. More details can be found in § 4.1.2, 4.2 and 4.3;

Episode 3


Version : 1.00

of 103


6.3.3 Recommendations on supporting Operational Scenarios

WP3.3.3 Airspace Organization and Management has used the Operational Scenario OS-34- Military Collaboration in the Medium-Short term [7] as the initial reference. The existing Operational Scenario focuses on military special exercises starting with the medium planning of a MIL exercise, going on with the implementation of a corridor and the application of a temporary route structure, negotiation due to adverse weather conditions resulting in the adjustment of a preplanned VGA and finally cancelling the exercise, providing civilians with spare airspace resources.

Military activities can be classified in:

• Major/Special Exercises (addressed in the OS-34):

o The yearly plan contains the planned exercises in terms of airspace impact;

o It is established through CDM sessions between civilians and MIL several months in advance;

o Some weeks before the operations the final snapshot of the activity is refined (location, size and time);

o Generally, the re-negotiation in time or space of these exercises is difficult once the requirements have been agreed.

• Day to day exercises (not addressed in the existing OS-34 and analysed in the WP3.3.3 in the form of the negotiation/coordination of an ad-hoc structure to respond to short-term airspace military requirements, a VGA, and going on with the negotiation/CDM with civil users for the best location and dimension of a VGA in order to keep the impact on civil air traffic to a minimum:

o Military activities are planned the day before the operations or even the same day;

o Airspace needs are coordinated at the end of the medium term planning phase;

o Tactical changes are established through CDM sessions.

The recommendation is to complete the existing oper ational scenario OS-34 with military day to day exercises or even to create a n ew scenario in case the scope of the mentioned scenario becomes too broad.

6.3.4 Conclusions and Recommendations for Project Level

Not yet applicable.

6.4 CONCLUSIONS

The main conclusions have been grouped according to the high level objectives and gathered in Table 6-2.

ID Description of Conclusions:

Objective #1 Clarification on the AFUA Concept: Definition of the roles and responsibilities

• Identification of a new role/function named Airline Coordinator to represent the civil airspace users’ interests into the ATM System and deal with their problems;

• At FAB level, the Airspace Manager and the Sub-Regional Manager can be merged in only one role performing all the related functions.

Episode 3


Version : 1.00

of 103



Objective #1 Clarification on the AFUA Concept: Criteria for location, delineation and dimension of ad-hoc structure at short notice (VGA)

Equity Indicators to analyse the access to share airspace between civil and military users are considered for identifying the use of airspace and the AMC/SBR will be responsible for deciding the use of the airspace between civilian and military users. The “Ratio of Military Requests effectively accomplished” along with the number of affected civil flights are the main factors to be considered for military airspace locations.

The AMC/SBR checks the airspace resources and the impact in the FAB due to these different VGA locations by evaluating the cost of the solution indicator of every possible airspace organization: Equitable criteria (Minimum Number of affected SBTs, Historic information at FAB Level, Minimum SBT distortion), Demand and capacity balance among sectors, Workload saturation, Workload balance among sectors, Total Workload.

Objective #1 Clarification on the AFUA Concept: Share use of airspace is conflicting with capacity

Where the access to airspace is in conflicting with capacity, equitable solutions have to be decided to solve the capacity issue. The decision is taking based on information of:

• Historical Reasons: Number of times that same civil users have been affected (historic information at FAB Level), Historical distortions degrees (every civil user would have a “bucket of admissible distortions”. If this bucket has been already filled in, no more distortions can be assigned);

• Current SBT distortion;

• Flight priorities;

• Current number of affected SBTs or RBTs (in case the timeframe is close to the operation).

Objective #1 Clarification on the AFUA Concept: Use of capacity opportunities

In general, most of civil users would like to take advantage of a released airspace if they were originally affected, and therefore would like to fly more direct routes. But this decision is dependent on the timeframe that means the time available to manage the change of trajectories (at least two hours before the EOBT although this value will be dependent on the company). If the release airspace information is published really close the operation, the airlines may decide of not considering the capacity opportunities.

Objective #2 Assessment of the Process Feasibility

The ideal process to design, allocate, open and close ad-hoc military airspace structures would consist of an intermediate process between a ‘parallel’ and a ‘sequential’ one.

Civil and Military Airspace Users involvement in the AFUA process related to military airspace reservation at short notice (VGA). The Civil users provide their preferences on the military airspace reservation location/dimension and the associated trajectories. Military users are aware of all the process and are willing to offer flexibility in their airspace requirements (if possible) when considerable impact on civil users.

Objective #3 Exploration the supporting tools and capabilities: Definition of the What-If Tool Capabilities

The what-if tool is the supporting tool of the Civil and Military Airspace Managers should evaluate a set of possible solutions related to the most appropriate orientation of the VGA under given traffic conditions and provide the most suitable airspace organization of VGA according to an agreed ‘cost of solution’ indicator (already described).

Objective #3 Exploration the supporting tools and capabilities: Definition of Supporting Tools

• There is a need of a tool for publishing and sharing information during the negotiation process in order to guarantee transparency of the shared data and to provide a common basis for the negotiation. This tool/functionality must be accessed via SWIM. It is important to note that the NOP cannot be used with this purpose since it is only updated when an agreement is reached;

Episode 3


Version : 1.00

of 103



Functionalities • For those users who cannot afford to invest on tools, an access via SWIM to a standard supporting tool could be enabled so they could tune it according to their business model.

• The supporting tools for all actors/roles must be equipped with customizable alarms that alert them about changes affecting the progress of the negotiation e.g. new information sharing, changes in the NOP.

Objective #4: Assessment of the gaming technique

• Gaming technique is proven as applicable and useful for validation purposes at early stages of the concept maturity. It can be used in combination with other techniques e.g. expert groups or modelling for clarification of concepts and processes as well as for the identification of tool requirements and capabilities and initial performance assessments.

• Paper based gaming sessions getting familiar with the gaming technique by itself and helping the design of the most interesting processes with the dedicated software platform and its hardware configurations;

• The gaming platform based provides greater realism of the process and makes easier, faster and more understandable the roles responsibilities offering quantitative indicators to support the decision making during negotiation and collaboration processes.

Table 6-2 Conclusions per objective

Episode 3


Version : 1.00

of 103


7 REFERENCES AND APPLICABLE DOCUMENTS

7.1 REFERENCES

[1] Episode 3 Experimental Plan on Airspace Organization and Management D3.3.3-01 Version V1.00 19/02/2009

[2] SESAR The Target Concept SESAR D3 Version V2.00 04/09/2007

[3] SESAR The SESAR Master Plan SESAR D5 Version V2.00 04/2008

[4] SESAR WP 2.3.1 Compute and Map Operational Concepts & Airspace KPIs based on identified available tools and methodologies Version 1.0 09/2007

[5] Episode 3 WP3 Validation Strategy D3.2.1-01 Version V1.00 20/10/2008

[6] Episode 3 SESAR DOD M2 Medium/Short Term Network Planning Detailed Operational Description D2.2-043

[7] Episode 3 OS-34 Military Collaboration during Medium/Short Term Planning - part of Annex to SESAR DOD G - Operational Scenarii D2.2-050

[8] Episode 3 WP3 Expert Groups Interim Report D3.3.1-02 Version V1.00 14/05/2009

[9] Episode 3 Performance Framework D2.4.1-05 Version 3.03 03/03/2009

7.2 APPLICABLE DOCUMENTS

[10] Episode 3 Exercise Report Template D2.5-03 Version V1.00 08/04/2009

[11] E-OCVM European Operational Concept Validation Methodology Version V2.00 17/03/2007

Episode 3


Version : 1.00

of 103


8 ANNEX I Three questionnaires are here presented:

• A general questionnaire delivered before the gaming sessions about gaming techniques;

• A general questionnaire delivered after the gaming session about gaming techniques;

• An example of questionnaire delivered for every role and after each gaming session.

8.1 QUESTIONNAIRE BEFORE PREGAMING SESSIONS - TECHNIQUE

Part 1 (please complete before the start of the day’s Pre-gaming sessions)

Please tell us who you are, and your forthcoming role in the simulation. Thank you.

About you:

Participant:

About the Pre-Gaming sessions:

Date:

Game:

Name of simulation project: WP3.3.3 Airspace Organization and Management

1. What do you think about the gaming technique so far? (Please mark the scale with an ‘X’).

Bad OK

Good

2. Have you used this technique before? Please say for what purpose and project.

No Yes

Episode 3


Version : 1.00

of 103


3. How much confidence do you have in the results obtained during the gaming sessions? (Please mark the scale with an ‘X’).

None OK

Full

0% 50% 100%

Thank you for completing this questionnaire.

8.2 QUESTIONNAIRE AFTER GAMING SESSIONS -TECHNIQUE

Part 2 (please complete after the day’s Gaming Sessions)

This post-run questionnaire is designed to gather information about the gaming sessions that you have just been involved in.

This information will be especially used by the analysis team when assessing the suitability of Gaming as a validation technique as well as to improve future gaming sessions.

Note: All individual data collected during the gaming, including the responses to this questionnaire, will be treated in the strictest confidence.

Please tell us who you are and your role in the Gaming Sessions. Thank you.

About you:

Participant:

Current Working Role:

About the Gaming sessions:

Date:

Game:


Your role

Commercial Airline, Low Cost Airline, Airline Coordinator, Exercise Director, Sub-Regional Manager, Civil AMC, Military AMC or AMC

Episode 3


Version : 1.00

of 103


1. What do you think of the gaming technique? (Please mark the scale with an ‘X’).

Bad OK

Good

2. If you have participated before in Gaming Sessions based on different means e.g. paper, do you find any added value in working with a dedicated platform e.g. CHILL?

No Yes

3. If the answer to the previous question is yes, please indicate below which are the main advantages of using a dedicated platform during the Gaming Sessions.

4. Would you find an added value combining Gaming Technique with Fast Time Simulation Tools?

No Yes

Please comment if needed.

5. Would you find an added value supporting Expert Groups with dedicated Gaming Sessions?

No Yes

Episode 3


Version : 1.00

of 103


Please comment if needed.

6. How much confidence did you have in the results obtained during the gaming sessions? (Please mark the scale with an ‘X’).

None OK

Full

0% 50% 100%

Please, comment if you need.

7. Please rate your amount of confidence in each of these five dimensions. Please mark the scale with an ‘X’.

1. CONFIDENCE IN GAMING TECHNIQUE (USE OF PAPERS)

0 50 100%

2. CONFIDENCE IN GAMING TECHNIQUE (USE OF HARDWARE PLATFORMS)

0 50 100%

3. CONFIDENCE IN GAMING TECHNIQUE FOR CLARIFICATION ON AFUA CONCEPT

0 50 100%

4. CONFIDENCE IN GAMING TECHNIQUE FOR ASSESSMENT OF PROCESS FEASIBILITY

0 50 100%

Episode 3


Version : 1.00

of 103


5. CONFIDENCE IN GAMING TECHNIQUE FOR EXPLORATION O F TOOLS CAPABILITIES

0 50 100%

8. Would you use again the gaming technique for clarification/validation of concepts? In your opinion, what changes would this technique need so that your confidence would be increased? If there are any other factors which influence your trust in this technique, or if you have any general comments, please write them here.

9. Please judge GAMING TECHNIQUE (using CHILL) against the following factors (Please mark the scale with an ‘X’).

Name of technique: GAMING

1. IS THE GAMING TECHNIQUE USEFUL?

� Not useful

-5 0 +5

Useful ☺

2. HOW RELIABLE IS IT?

� Not reliable

-5 0 +5

Reliable ☺

3. HOW ACCURATELY DOES IT WORK?

� Not accurate

-5 0 +5

Accurate ☺

Episode 3


Version : 1.00

of 103


4. CAN YOU UNDERSTAND HOW IT WORKS?

� Not understand

-5 0 +5

Understand ☺

5. DO YOU LIKE PLAYING IT?

� Dislike

-5 0 +5

Like ☺

6. HOW EASY IS IT TO PLAY?

� Difficult

-5 0 +5

Easy ☺

10. Please rank these factors in order of relative importance. Number them from 1 (least important) to 6 (most important). Please use each number once only.

Name of automation tool: GAMING TECHNIQUE

Usefulness Ranking:

Reliability Ranking:

Accuracy Ranking:

Understanding Ranking:

Liking Ranking:

Ease of use Ranking:

11. Are there any other comments you would like to make?

Thank you for completing this questionnaire.

Episode 3


Version : 1.00

of 103


8.3 QUESTIONNNAIRE DEBRIEFINGS - EXAMPLE

To complete after the Game 2 Session

Participant:

Date:

Game 2: Release of a VGA


Role in Game 2:

Commercial Airline, Low Cost Airline, Airline Coordinator, Exercise Director, Sub-Regional Civil AMC, Military AMC or AMC

Airline Coordinator:

1. Did you find any major problem/bottleneck in the process regarding your involvement as Airline Coordinator?

No Yes

If you have any suggestion for solving the problem, please comment below.

2. Did you find any limitation during the process as described in Game 1 for performing your tasks/responsibilities as Airline Coordinator? If the answer is yes, please describe them and be as specific as possible.

Information available No Yes

Communication with other actors No Yes

Lack of definition of your responsibilities, Overlaps

with other actors responsibilities

No Yes

Sequence of actions during the process No Yes

Episode 3


Version : 1.00

of 103


Inefficient Use of Resources (two actors performing the

same tasks at the same time) No Yes

Any Other

3. Have you identified at any step of the process the necessity of requesting information from the Airspace Users in terms of accurate trajectories or their business models?

No Yes

If the answer is yes, please comment below.

Airline Coordinator & Airline Users:

Questions on the Airline Coordinator and Airline Us ers about the Operational Quality Indicator:

1. Please, check if the following factors play a role for calculating the Operational Quality Indicator:

Airport Delays for Departures No Yes

Loss of connections No Yes

Number of affected passengers No Yes

Crew Activity No Yes

Fuel Consumption No Yes

Flight Time No Yes

Airport Taxes (Night Curfews) No Yes

Aircraft Capacity No Yes

Episode 3


Version : 1.00

of 103


Flight priorities No Yes

2. Please, check if the following factors play a role for ensuring the equity between Civil Users:

Ratio of Affected Flights for each User in the last season

(or a longer period) No Yes

Cumulative costs due to trajectory distortions caused

by Military Airspace reservations during the

Current Season (or a longer period)

No Yes

Flight Priorities No Yes

Number of Affected Civil Flights SBTs No Yes

Number of Affected Civil Flights RBTs No Yes

Episode 3


Version : 1.00

of 103


9 ANNEX II SESAR offers the possibility for ad-hoc structure delineation at short notice to respond to short-term airspace users´ requirements not covered by predefined solutions. These structures are called Variable Geometric Area (VGA). One VGA is composed by one core area (Temporary Segregated Area (TSA) or Restricted (TRA) Area) and several possible extensions of this area to be used upon military request, depending on the type of training and the General Air Traffic (GAT) in the area at that time.

Military Expert answers to three questions for each type of mission:

1. Is this mission typology suitable for a VGA shape (core + lobes)?

2. What are the main characteristics of the VGA in terms of shape, size, lobes orientations and FLs for each kind of mission?

3. What are the main restrictions to be taken into account for the negotiation with other actors?

The answers are showed below for each kind of mission:

Mission 1 – PARACHUTING AND DROPPING STORE : It is a training exercise where 2-ship with parachuting capability will transit from their main operating base, Madrid/Torrejón to join up with a 2 ship with dropping store capability that also leave from their main operating base, Zaragoza. Both formations will perform together a low level flight in the designated area VGA. In this area there are defined dropping zones for parachuting and stores previously coordinated with staff on ground. When completed the dropping exercise, the 4 ship parachuting will go back to their corresponding operating bases.

Answer:

It could be suitable a VGA shape with the following characteristics:

• Flight levels: Ground – FL 100;

• Core Area: 20NM;

• Additional lobes: 5NM;

• Orientation depending on the wind.

The main restrictions for negotiations will be time frame, location and if lobes exist, no modification on the lobes is allowed .

Mission 2 – REFUELING : It is a real exercise where 2-ship10 tanker formation will transit from Madrid/Torrejón to the designated VGA to refuel eight 2 ship formations that are in transit and cross the VGA at a certain time. The tankers are placed in the VGA at the same time forming a holding stack of three holding hippodromes. Every one of the tankers in a hippodrome and the 2-ship formation are refuelled by the tanker, one ship, one tanker. As there are eight 2- ship formations, this operation is repeated up to eight times). When completed the refuelling, the 2 tankers will go back to Madrid/Torrejón.

Answer:

The VGA could be suitable for this type of mission. These are the main characteristics:

• Flight Levels: 150 – 250 FL;

• Core area could not need additional lobes if size is 50NM.

The main restrictions for the negotiations are time frame 1 and lower FL.

10 In the mission for refuelling, the number of ships will be always by pair (2, 4, 6, …).

Episode 3


Version : 1.00

of 103


Mission 3 – SEARCH AND RESCUE (SAR) : It is a training exercise involving coordination between two ships. One ship with SAR capability will transit from the MOB Madrid/Torrejón to enter the defined Search Area (partial or complete VGA) at a predefined time (Entry Time or On Task Time). Another ship with SAR capability transiting from the other MOB Zaragoza will perform a swapping manoeuvre with the previous one, being its On Task Time the Off Task Time of the previous one. The second ship will remain in the Search Area until a predefined Off Task Time.

Answer:

This VGA shape is not suitable for this type of mission. Lobes are not necessary.

The Flight Levels are from Ground – 100FL and the main restriction is the time frame .

Mission 4 – AIR TO AIR FIGHTING : It is a training exercise involving coordination between two ships. One ship will transit from the MOB Madrid/Torrejón to enter the defined “Fighting Area” (partial or complete VGA) at a predefined time (On Task time). Another ship, transiting from the other MOB Zaragoza, will perform a Rendez-Vous manoeuvre with the previous one, entering the defined “Fighting Area” at the same predefined On Task time. The two ships will perform their Air to Air Attack Simulation exercises inside the “Fighting Area” until a predefined time (Off Task Time).

Answer:

The VGA shape is suitable for this type of mission. The characteristics are:

• Flight Levels: 200 to 400 FL;

• Core Area: 50NM;

• Additional lobes: 10NM more in the continuity of the core area.

The main restrictions for negotiation are Duration and Location.

Mission 5: UAV MISSION : It is a training exercise involving an UAV (Unmanned Aerial Vehicle) for RECCE mission.

Answer:

The VGA shape is suitable for this type of mission. The main characteristics are:

Flight Levels: Ground – 100FL; 200 – 250FL; Above 450FL.

The main restrictions for negotiations are the Flight Levels and no crossing is possible during the activation of the reserved area.

Episode 3


Version : 1.00

of 103


END OF DOCUMENT

EPISODE 3 - Eurocontrol...Episode 3 D3.3.3-02 - Simulation Report on Airspace Organization and...

Documents

Transcript of EPISODE 3 - Eurocontrol...Episode 3 D3.3.3-02 - Simulation Report on Airspace Organization and...