LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of...
-
Upload
kelley-montgomery -
Category
Documents
-
view
220 -
download
1
Transcript of LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of...
![Page 1: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/1.jpg)
LANGUAGE PROFICIENCY
TESTING
A Critical Survey
Presented by Ruth Hungerland, Memorial University of Newfoundland,
TESL Newfoundland and Labrador
![Page 2: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/2.jpg)
Please God may I not failPlease God may I get over sixty per
centPlease God may I get a high placePlease God may all those likely to beatme get killed in road accidents and may they die roaring.
Irish novelist McGahern
![Page 3: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/3.jpg)
Overview Types of language tests Ways of describing tests Evaluating the usefulness of language
tests Overview of common language tests:
TOEFL, TOEIC, IELTS, and CAEL Impact of testing on learning and teaching Critical use of language tests Testing Questions
![Page 4: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/4.jpg)
Testing Questions What is actually being tested by the
test we are using? What is the“best” test to use? What relevant information does the
test provide? How is testing affecting teaching and
learning behaviour? Is language testing “fair”?
![Page 5: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/5.jpg)
Types of Language Tests
Achievement test associated with process of instruction assesses where progress has been made should support the teaching to which it
relates Alternative Assessment
• need for assessment to be integrated with the goals of the curriculum
• learners are engaged in self-assessment
![Page 6: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/6.jpg)
Proficiency test aims to establish a test taker’s
readiness for a particular communicative role
general measure of “language ability” measures a relatively stable trait used to make predictions about future
language performance (Hamp-Lyons, 1998)
high-stakes test
![Page 7: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/7.jpg)
Some ways of describing tests
Objective Subjective
Indirect Direct Discrete-point Integrative Aptitude/ Achievement/ Proficiency Performance External Internal Norm-Referenced Criterion-
Referenced
![Page 8: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/8.jpg)
Evaluating the usefulness of a language test
Usefulness= reliability+validity+ impact authenticity+interactiveness+practicality
(Bachman and Palmer, 1996)
TESTUSEFULNESS
RELIABILITY VALIDITY
Impact Authenticity
Practicality Interactiveness
![Page 9: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/9.jpg)
Evaluating the usefulness of a language test
Essential measurement qualities reliability construct validity
Evaluation: test taker - test task - Target Language Use (TLU)
TLU
Test TaskTest Taker
![Page 10: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/10.jpg)
Overview of common language proficiency tests
TOEFL TOEIC
IELTS
CAEL
ETS, US
UK
CDN
![Page 11: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/11.jpg)
Test of English as a Foreign Language
One million test takers per year
P&P 310-677/ CBT 0-300 Three sections:
Listening Structure and Written
Expression Reading Comprehension TWE
![Page 12: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/12.jpg)
Test of English as a Foreign Language
Objective SubjectiveDiscrete-point IntegrativeProficiency Achievement discord between test and understanding of
language and communication passive recognition of language cutoff scores are very problematic general proficiency academic proficiency
![Page 13: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/13.jpg)
Test of English for International
Communication TOEFL equivalent for workplace setting
two sections, 200 q. listening reading
entertainment, manufacturing, health, travel, finance, etc.
“objective and cost-efficient”
![Page 14: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/14.jpg)
Test of English for International
Communication
Objective SubjectiveDiscrete-point IntegrativeProficiency Achievement lack of correspondence with TLU narrow construct test content is extremely broad
![Page 15: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/15.jpg)
International English Language Testing System
Academic/General Results reported
in band scores 1-9
Listening
G.Reading A.Reading
G.Writing A.Writing
Speaking
![Page 16: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/16.jpg)
International English Language Testing System
Objective SubjectiveDiscrete-point IntegrativeProficiency
Achievement test tasks reflective of academic tasks score reporting is diagnostic need for reliability research
![Page 17: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/17.jpg)
Canadian Academic English Language
Assessment Mirrors language use
in university Topic-
based,integrated reading, listening, and writing tasks
provides specific diagnostic information
scores are reported in bands 10-90
![Page 18: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/18.jpg)
Canadian Academic English Language
AssessmentObjective SubjectiveDiscrete-point IntegrativeProficiency Achievement tests performance and use diminished gap between test and
classroom validity is supported by teacher
evaluations studies on predicting academic success
![Page 19: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/19.jpg)
Washback: The Impact of Tests on Teaching and
Learning “The power of tests has a strong
influence on curriculum and learning outcomes” (Shohamy, 1993)
good test positive washback form of test impact depends on
antecedent: educational context and condition
process consequences (Wall, 2000)
![Page 20: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/20.jpg)
Critical Language Testing Focus on consequence and ethics of
test use Tests are embedded in cultural,
educational, and political arenas whose agenda?
Questions traditional testing knowledge English proficiency= academic success? English: got it or get it!
Responsible test use (Hamp-Lyons, 2000)
![Page 21: LANGUAGE PROFICIENCY TESTING A Critical Survey Presented by Ruth Hungerland, Memorial University of Newfoundland, TESL Newfoundland and Labrador.](https://reader036.fdocuments.net/reader036/viewer/2022062320/56649d945503460f94a7b4be/html5/thumbnails/21.jpg)
Testing Questions What is actually being tested by
the test we are using? What is the”best” test to use? What relevant information does
the test provide? How is testing affecting teaching
and learning behaviour? Is language testing “fair”?