INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

42
•INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

description

INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT. I. DIAGNOSTIC PIE**. Language is a system of symbols used to represent concepts formed through exposure and experience Students’ experiences may differ from mainstream school expectations - PowerPoint PPT Presentation

Transcript of INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Page 1: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Page 2: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• There are a lot of demonstrations on my youtube channel

• Just go to youtube and type in Celeste Roseberry—demo videos are there

Page 3: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

I. DIAGNOSTIC PIE**• Language is a system of symbols used to

represent concepts formed through exposure and experience

• Students’ experiences may differ from mainstream school expectations

• If teachers refer ELL students for testing, there may be a difference, not disorder, because of experiential differences

• LI=disorder in both L1 and English!!

Page 4: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

4 quadrants in the “Diagnostic Pie”** (p. 248)

• Quadrant 1==normal ability, adequate background

• Quadrant 2==normal ability, limitations of linguistic experience, environmental exposure

• Quadrant 3==LI, adequate background

• Quadrant 4==LI, limitations of linguistic experience, environmental exposure

Page 5: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Dr. Ron Gillam (CSHA)

Page 6: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

II. INDICATORS OF LI

Page 7: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 8: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

III. LEGISLATION: IDEA 2004**

• We must evaluate in a nondiscriminatory manner

• Tests must be administered in most proficient communication mode

• Testing cannot reflect limited English; must reflect child’s ability in area tested

Page 9: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• The IDEA does not require that standardized measures are used**

• Traditionally, many special educators have used standardized tests because they believe that a quantitative score is mandated by federal law; however, the law does not exclude subjective or qualitative measures. It leaves the choice of measurement tools and criteria to the educator.

Page 10: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 11: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 12: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

IV. PRE-EVALUATION PROCESS**

• Before doing formal testing, it is extremely important to carry out the following:

– 1. Language proficiency testing– 2. Ethnographic interviewing and case history– 3. Teacher evaluation of student’s classroom

performance

Page 13: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Language Proficiency Testing**

• Primary language?

• Dominant language?

• Interview parents, teachers, interpreters who have worked with the student

Page 14: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 15: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Be careful of the label “English Proficient”

Page 16: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Youtube video: **

• Channel Celeste Roseberry

• Assessment of ELLs with Language Impairment: Gathering Case History Through Interviews

• http://www.youtube.com/watch?v=X2myRI8XZ0g

Page 17: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

V. TESTING IN THE PRIMARY LANGUAGE**

• Problem: great heterogeneity within languages (dialects)

• Problem: Limited data on normal development in other languages

• Problem: Differences in vocabulary and linguistic knowledge bases of students who immigrate vs. those born and raised in U.S.

Page 18: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 19: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

NEVER Translate an English test into the child’s L1 and use the norms:

Page 20: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

VI. SELECTING ASSESSMENT INSTRUMENTS

• A. Appropriateness of Test Content

• *Many potentially unfamiliar items

Page 21: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• B. Adequacy of norms

• C. Possible Examiner Bias

Page 22: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

D. Possible Situational Bias

Page 23: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

E. Possible Format Bias (types of test items)

Page 24: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 25: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

F. Possible Value Bias**

• Example: Test of Problem-Solving Skills-Revised—”What should she do now?”

• Preschool Language Scale—”Why do you brush your teeth?” African American children in some communities “Because my momma told me to.” (scored as incorrect; correct answer is “because you get cavities if you don’t”)

Page 26: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

VII. NONBIASED ASSESSMENT: CONSIDERATIONS IN STANDARDIZED

TESTING**• A. Introduction

• Standardized, formal tests are commonly used with ELL students

• Many speech-language pathologists and other special educators operate from the belief that we must always obtain quantitative data such as percentile ranks and standard deviations

• However, the IDEA permits the use of qualitative, subjective measures which we will discuss more in the next section

Page 27: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

**The Native Americans have a

saying: When you are riding a horse and it dies, dismount--and find a new one. But

many of us keep wanting to revive the

old horse of standardized testing with ELL students.

Page 28: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Typical referral and assessment procedures** (p. 255)

Page 29: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

B. Pitfalls of using Standardized Tests with ELL Students—Formal Test Assumptions**

• There are very few standardized tests in most languages

• Most standardized tests are developed from a Western, literate, middle class framework

Page 30: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

These tests assume that students will:

Page 31: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

They also assume that students will:

Page 32: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Bias in Standardized Testing: Potentially Unfamiliar Items**

• Household objects• Vehicles• Sports• Musical instruments • Types of clothing• Professions/occupations• Historically related events and people• Foods• American nursery rhymes• Geography• Games

Page 33: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

An ELL student may not recognize things like American fruits and vegetables**

Page 34: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

In many countries, soccer is called football**

Page 35: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Holidays and seasons differ from country to country**

Page 36: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Many immigrant and refugee students are unfamiliar with items

involving snow…**

Page 37: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

VIII. Modifying Standardized Tests

Page 38: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• Give the student extra time to respond**

• If the student gives a “wrong” answer, ask her to explain it and record her explanation; score it as correct if it would be correct in her culture

• Repeat items when necessary

Page 39: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

I will often have 2 columns: **• First attempt Second attempt

–- +–- +–- -–- +–- --–-- +

Page 40: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

What I don’t want to see: **• First attempt Second attempt

- - -- - -- - -- - -- - -

Page 41: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 42: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

IX. CONSIDERATIONS IN TEST INTERPRETATION**

Don’t identify a student based solely on formal test scores

Ascertain if the student’s errors are typical of other students with similar backgrounds

Interpret overall results as a team

In assessment reports, include disclaimers about departure from standard testing procedures