1

L 1

The Key to ICAO: First Experiences with a The Key to ICAO: First Experiences with a New Language Proficiency Examination for New Language Proficiency Examination for Military Air Traffic Controllers and its Military Air Traffic Controllers and its ImplicationsImplications

Dr. Dugald Sturges, Federal Office of LanguagesHürth, Germany

Dr. Christopher Hüllen, Federal Ministry of DefenceBonn, Germany

BILC Conference, Vilnius, May 2011

2

““Tower, I think you misunderstood our request…“Tower, I think you misunderstood our request…“

3

L 3

1997 - ICAO Air Navigation Commission (ANC) 1997 - ICAO Air Navigation Commission (ANC) reviews the existing provisions for air-ground reviews the existing provisions for air-ground and ground-ground voice communication in and ground-ground voice communication in international civil aviationinternational civil aviation

The New ICAO Language The New ICAO Language RequirementsRequirements

2003 - The Council of ICAO adopts language Standards and Recommended Practices recommended by the Proficiency Requirements in Common English Study Group (PRICE SG) for pilots, controllers, air traffic service providers and airlinesairlines. 2008 - These provisions become applicable.2008 - These provisions become applicable.

March 2011 - Deadline for ICAO member March 2011 - Deadline for ICAO member states to ensure that aviation personnel states to ensure that aviation personnel achieve ICAO Level 4 (Operational) proficiency achieve ICAO Level 4 (Operational) proficiency in English.in English.

4

L 4

The Tasking:The Tasking:October 2009: The German Air Force Office of Flight October 2009: The German Air Force Office of Flight Safety (AFSBw) commissions the Federal Office of Safety (AFSBw) commissions the Federal Office of Languages with the development of regular testing Languages with the development of regular testing procedures for military Air Traffic Controllers in procedures for military Air Traffic Controllers in accordance with ICAO Level 4.accordance with ICAO Level 4.

““Project ICAO Test”Project ICAO Test”

2010 - Development of new testing material in Listening 2010 - Development of new testing material in Listening Comprehension and Oral Proficiency Comprehension and Oral Proficiency in accordance in accordance with ICAO Standard with cooperation of the AFSBw.with ICAO Standard with cooperation of the AFSBw.

1st Half 2010 – All ATC personnel given assessment 1st Half 2010 – All ATC personnel given assessment tests.tests.

January 2011 - Testing January 2011 - Testing in accordance with ICAO in accordance with ICAO Level 4Level 4 begins.begins.

5

L 5

““Project ICAO Test”Project ICAO Test”

Test Item Approbation:Test Item Approbation:

• At the Air Force Officer School in At the Air Force Officer School in Fürstenfeldbrück (GAFFürstenfeldbrück (GAF officer candidates)officer candidates)

• At the BSprA, Hürth (Federal Police flight At the BSprA, Hürth (Federal Police flight school school candidates)candidates)

Test Development:Test Development:Development Team at the Air Force Officer Development Team at the Air Force Officer School in Fürstenfeldbrück, with assistance School in Fürstenfeldbrück, with assistance from the Bundessprachenamt (BSprA) in from the Bundessprachenamt (BSprA) in Hürth.Hürth.

6

L 6

““Project ICAO Test”Project ICAO Test”

Train the Trainer:Train the Trainer:• 8th to 10th December 2010 at the Air Force 8th to 10th December 2010 at the Air Force Officer School, Officer School, Fürstenfeldbrück.Fürstenfeldbrück.

• English instructors and testers from the English instructors and testers from the Bundessprachenamt in Fürstenfeldbrück, Bundessprachenamt in Fürstenfeldbrück, Hürth, and Hürth, and Army Aviation School, Bückeburg. Army Aviation School, Bückeburg.

• Goal: to introduce trainers to the testing Goal: to introduce trainers to the testing material and material and procedure, in particular the similarities and procedure, in particular the similarities and differences to differences to testing and evaluating English language testing and evaluating English language proficiency proficiency according to STANAG 6001.according to STANAG 6001.

7

L 7

““Project ICAO Test”Project ICAO Test”

Train the Trainer:Train the Trainer:Topics included:Topics included:• The Framework for Aviation English TestingThe Framework for Aviation English Testing• Test Purpose and Test TypesTest Purpose and Test Types• Fundamental Principles of TestingFundamental Principles of Testing• Test Formats (Listening, Oral)Test Formats (Listening, Oral)• Test AssessmentTest Assessment• The Role of the ExaminerThe Role of the Examiner• Practical Application in Mock Testing Practical Application in Mock Testing SituationsSituations

8

L 8

““Project ICAO Test”Project ICAO Test”Test Delivery:Test Delivery:• Teams of examiners at Fürstenfeldbrück, Teams of examiners at Fürstenfeldbrück, Hürth, and Hürth, and Bückeburg.Bückeburg.• Examinations delivered regionally Examinations delivered regionally • At BSprA schools (Fürstenfeldbrück/ South, At BSprA schools (Fürstenfeldbrück/ South, Hürth/West, Hürth/West, Bückeburg/ North & East)Bückeburg/ North & East)• Where number of examinees warrant - on Where number of examinees warrant - on locationlocationTest Population:Test Population:

Approximately 300 Military Air Traffic ControllersApproximately 300 Military Air Traffic Controllers

First Round of Testing:First Round of Testing:• January – June 2011January – June 2011• By end of June 2011 ca. 160 ATCs will have been testedBy end of June 2011 ca. 160 ATCs will have been tested• Second round to begin in September 2011Second round to begin in September 2011

9

Listening Comprehension TestListening Comprehension Test• 15 audio items15 audio items• 1 Multiple Choice question per item1 Multiple Choice question per item• Each audio item is heard Each audio item is heard twice twice (once for Level 5)(once for Level 5)• 11 items (70%) required for pass11 items (70%) required for pass

L 9

10

L 10Oral TestOral Test• Duration: ca. 12 MinutesDuration: ca. 12 Minutes• Four PartsFour Parts• Part 1: Warm-up, personal introduction. Part 1: Warm-up, personal introduction. (approx. 2 (approx. 2

minutes)minutes)• Part 2: Control-related information. Description of Part 2: Control-related information. Description of

job and experience(s). (approx. 2 minutes)job and experience(s). (approx. 2 minutes)• Part 3: Routine and Non-Routine Situations. Back-to Part 3: Routine and Non-Routine Situations. Back-to

back photo description (aviation situation). back photo description (aviation situation). (approx. (approx. 4 minutes)4 minutes)

• Part 4: Discussion. Aviation safety topics. (approx. 4 Part 4: Discussion. Aviation safety topics. (approx. 4 minutes)minutes)

• Testing Team of 2: 1 Examiner, one Evaluator (with Testing Team of 2: 1 Examiner, one Evaluator (with Evaluation Sheet)Evaluation Sheet)

11

L 11Comparison / Contrast: “ICAO Test” versus SLP testing

Oral ExamOral Exam• Use of scripted oral examination questionsUse of scripted oral examination questions• Restrictions on examiner feedbackRestrictions on examiner feedback• Picture description taskPicture description task• No preparation No preparation • Exclusively aviation and professionally-related Exclusively aviation and professionally-related itemsitems• MonolingualMonolingual

Listening Comprehension ExamListening Comprehension Exam• Non-native and “difficult native” speakersNon-native and “difficult native” speakers• Listening items heard Listening items heard twicetwice each each• “ “One out of three” MC questionsOne out of three” MC questions• Primarily aviation-related items (limited Primarily aviation-related items (limited topic areas)topic areas)• MonolingualMonolingual

12

L 12ICAO Level 4 = “SLP Level 2+ PLUS”ICAO Level 4 = “SLP Level 2+ PLUS”• Examinees with a “good” STANAG Level 2 Examinees with a “good” STANAG Level 2

GENERAL language competency passed GENERAL language competency passed according to the ICAO Level 4 descriptorsaccording to the ICAO Level 4 descriptors

• HoweverHowever, knowledge of specialist aviation , knowledge of specialist aviation terminology and usage is essential to successfully terminology and usage is essential to successfully deal with oral proficiency exam.deal with oral proficiency exam.

• ThereforeTherefore, experienced ATCs with weaker , experienced ATCs with weaker GENERAL language competency could GENERAL language competency could compensate with job experience, whereas compensate with job experience, whereas younger, inexperienced ATCs-in-training, who younger, inexperienced ATCs-in-training, who often were more fluent in GENERAL English were often were more fluent in GENERAL English were more challenged.more challenged.

13

L 13SLP level 2 requires ability to deal with ROUTINE SLP level 2 requires ability to deal with ROUTINE situations, while ICAO level 4 aims at mastering the situations, while ICAO level 4 aims at mastering the UNEXPECTED.UNEXPECTED.

• Reason: Most of the time, ATCs can get by with a Reason: Most of the time, ATCs can get by with a limited corpus of standardized terminology.limited corpus of standardized terminology.

• ICAO certification aims at ensuring that aviators master ICAO certification aims at ensuring that aviators master the rare but critical situations when the unexpected the rare but critical situations when the unexpected occursoccurs.

Therefore: Students are confronted with non-native Therefore: Students are confronted with non-native or “difficult“ native speakers in listening itemsor “difficult“ native speakers in listening items

• The experienced ATC who has literally “heard it all The experienced ATC who has literally “heard it all before“ may have an advantage over the novice before“ may have an advantage over the novice who is challenged by non-standard responses.who is challenged by non-standard responses.

14

L 14

The “Key?”The “Key?”

Or: Can SLP testing replace ICAO Or: Can SLP testing replace ICAO Certification for Military Aviators?Certification for Military Aviators?

15

Examinees with Examinees with valid valid level 3 certification level 3 certification according NATO STANAG 6001 have all according NATO STANAG 6001 have all passed the ICAO level 4 exam – albeit those passed the ICAO level 4 exam – albeit those with professional aviation experience had a with professional aviation experience had a considerable edge.considerable edge.

L 15

Consequence:Consequence: for newly trained personnel, for newly trained personnel, a combination of a Level 3 SLP and the US a combination of a Level 3 SLP and the US Qualification Course are mandatory.Qualification Course are mandatory.

16

Consequence:Consequence: for personnel already in service, for personnel already in service,

RECURRENT certification of ATCs according to ICAO RECURRENT certification of ATCs according to ICAO

level 4 has been implemented and will be maintained level 4 has been implemented and will be maintained

as a as a quality managementquality management measure. measure.

L 16

Reason: the tendency especially of personnel with Reason: the tendency especially of personnel with long years of service to settle into a routine “Tower long years of service to settle into a routine “Tower speak“, which restricts the ability to communicate in speak“, which restricts the ability to communicate in unexpected situations.unexpected situations.

Of the first 82 Candidates tested, Of the first 82 Candidates tested, 33 failed the Listening failed the Listening Comprehension Test, while all 82 passed the Oral Comprehension Test, while all 82 passed the Oral exam. All three cases involved OLDER (40+) ATCs exam. All three cases involved OLDER (40+) ATCs WITHOUT recent SLPs or language training.WITHOUT recent SLPs or language training.

17

Does testing military Air Traffic controllers according Does testing military Air Traffic controllers according to ICAO proficiency levels make sense as a means of to ICAO proficiency levels make sense as a means of maintaining and improving quality? maintaining and improving quality?

• Definitely!Definitely!

L 17

Is testing military Air Traffic controllers according to Is testing military Air Traffic controllers according to ICAO proficiency levels legally ICAO proficiency levels legally necessarynecessary? ?

• THAT is the question to be addressed in the second THAT is the question to be addressed in the second part of this talk…part of this talk…

Well, …..Well, …..

NO!NO!

……??

ICAO is the ICAO is the

International International CivilCivil Aviation Organization Aviation Organization

Strategic Objectives:• Safety – Enhance global civil aviation safety• Security – Enhance global civil aviation security• Environmental Protection and Sustainable Development of Air Transport – Foster harmonized and economically viable development of international civil aviation that does not unduly harm the environment

20

21

Adobe Acrobat Document

ICAO standards do not apply to Military ICAO standards do not apply to Military Aviation.Aviation.

But…But…

• What happens whenWhat happens when - Civil and military aviation meet?- Civil and military aviation meet? - Military pilots and air traffic controllers leave - Military pilots and air traffic controllers leave thethe military? military?• What does this mean for teaching and testing at What does this mean for teaching and testing at the the Bundessprachenamt? Bundessprachenamt?

??????Nothing!Nothing!

• Civil Aviation Authorities accept language Civil Aviation Authorities accept language tests tests developed and administered by the developed and administered by the Bundes-Bundes- sprachenamt. sprachenamt.

• There is no need for an “ICAO Test” as There is no need for an “ICAO Test” as such.such.

• Military pilots and air traffic controllers Military pilots and air traffic controllers leaving the leaving the military do not have to take ICAO tests. military do not have to take ICAO tests.

Lessons learned:Lessons learned:• The German Air Force wants to be as close as The German Air Force wants to be as close as possible to ICAO standards. possible to ICAO standards.• They do not want “ICAO language tests”.They do not want “ICAO language tests”.• They want a combination of SLP and Aviation They want a combination of SLP and Aviation EnglishEnglish tests. tests.• They want a certificate which states that this They want a certificate which states that this combination is equivalent to ICAO Level 4, 5 or combination is equivalent to ICAO Level 4, 5 or 6.6.• The Bundessprachenamt ICAO 4 test will be the The Bundessprachenamt ICAO 4 test will be the exception, not the rule. exception, not the rule.• ICAO is the key to a stronger position of the ICAO is the key to a stronger position of the Bundessprachenamt. Bundessprachenamt.

25

www.guy-sports.com/months/jokes_aircraft.htm