MICHIGAN ENGLISH LANGUAGE PROFICIENCY ASSESSMENT (MI .michigan state testing program michigan...

download MICHIGAN ENGLISH LANGUAGE PROFICIENCY ASSESSMENT (MI .michigan state testing program michigan english

of 70

  • date post

    15-Jul-2018
  • Category

    Documents

  • view

    233
  • download

    1

Embed Size (px)

Transcript of MICHIGAN ENGLISH LANGUAGE PROFICIENCY ASSESSMENT (MI .michigan state testing program michigan...

  • MICHIGAN STATE TESTING PROGRAM

    MICHIGAN ENGLISH LANGUAGE PROFICIENCY ASSESSMENT

    (MI-ELPA)

    TECHNICAL MANUAL: 2006 ADMINISTRATION

    KINDERGARTEN THROUGH GRADE 12

    SUBMITTED TO THE MICHIGAN STATE DEPARTMENT OF EDUCATION

    FEBRUARY 2007

  • 2006 MIELPA Technical Manual

    i

    TABLE OF CONTENT

    TABLE OF CONTENT ........................................................................................................................ i FIGURES AND TABLES ................................................................................................................... iii OVERVIEW OF THIS MANUAL..........................................................................................................1 SECTION 1. INTRODUCTION............................................................................................................3

    1.1 Background ......................................................................................................................................................3 1.2 Rationale and Purpose .....................................................................................................................................3 1.3 Recommended Test Use....................................................................................................................................4 1.4 Test Accommodations.......................................................................................................................................4

    Large Type ......................................................................................................................................................5 Braille..............................................................................................................................................................5

    SECTION 2. TEST DESIGN AND DEVELOPMENT .............................................................................6

    2.1 Overview...........................................................................................................................................................6 2.2 Test Specifications by Modality and Grade Span.............................................................................................6 2.3 Item Blueprints by Michigan Learning Standards by Grade Span, Modality, and Form.................................7 2.4 Item Development and Review Processes.........................................................................................................7 Differential Item Functioning (DIF).................................................................................................................8 2.5 Test Construction............................................................................................................................................10

    Testing Written Language .............................................................................................................................11 Testing Oral Language..................................................................................................................................11

    SECTION 3. SCORING ....................................................................................................................13

    3.1 MI-ELPA Range Finding................................................................................................................................13 3.2 Rater Training ................................................................................................................................................14 3.3 Inter-Rater and Intra-Rater Reliability ..........................................................................................................14 3.4 Calibration Sets ..............................................................................................................................................15 3.5 Monitoring Reports ........................................................................................................................................15 3.6 Retraining.......................................................................................................................................................16

    SECTION 4. CLASSICAL ITEM-LEVEL AND MODALITY (SUBTEST) STATISTICS.........................17

    4.1 Classical Test Theory .....................................................................................................................................17 4.2 Item-Level Descriptive Statistics ....................................................................................................................18 4.3 Measure of Central Tendency.........................................................................................................................18 4.4 MI-ELPA Stand-Alone Field-Test Item Statistics ...........................................................................................21

    SECTION 5. RELIABILITY..............................................................................................................23 5.1 Internal Consistency Reliability .....................................................................................................................23 5.2 Classical SEM (based on Classical Test Theory)...........................................................................................23 5.3 Conditional SEM (based on Item Response Theory) ......................................................................................24 5.4 Inter-Rater Reliability ....................................................................................................................................25 5.5 Reliability of Each of the Five Modalities ......................................................................................................25 5.6 Reliability of Classification Decision at Proficient Cut .................................................................................28

    SECTION 6. VALIDITY ...................................................................................................................31

    6.1 Test Content....................................................................................................................................................31 6.2 Evidence of the Test Content for the MI-ELPA ..............................................................................................31 6.3 Internal Structure ...........................................................................................................................................32 6.4 Evidence of the Internal Structure of the MI-ELPA........................................................................................32 6.5 Relationships to Other Variables ...................................................................................................................35

    Performance Differences Between Native and Non-Native English-Speaking Students Taking the SELP ...35

  • 2006 MIELPA Technical Manual

    ii

    Relationship Between the SELP and the Stanford Diagnostic Reading Test (SDRT) ...................................36 Relationship Between the SELP and the Abbreviated Reading Subtest of the Stanford Achievement Test Series, Ninth Edition (Stanford 9) .................................................................................................................36

    SECTION 7. CALIBRATION, EQUATING, AND SCALING .................................................................37

    7.1 The Rasch and Partial Credit Models ............................................................................................................37 7.2 Calibration, Equating, and Scaling of the MI-ELPA......................................................................................39 7.3 Vertical Scaling of SELP ................................................................................................................................40 Forms Equating.............................................................................................................................................41 Scale Scores...................................................................................................................................................42 7.4 Linking MI-ELPA Scale to the SELP Vertical Scale ......................................................................................42 7.5 Scale Scores for the MI-ELPA .......................................................................................................................43 7.6 Test Characteristic Curves for the MI-ELPA by Grade Span ........................................................................44 7.7 Linking Subsequent MI-ELPA Operational Tests Across Years.....................................................................45

    SECTION 8. IRT STATISTICS ........................................................................................................46

    8.1 Model and Rationale for Use..........................................................................................................................46 8.2 Evidence of Model Fit ....................................................................................................................................46 8.3 Rasch Statistics...............................................................................................................................................48 8.4 Item Information.............................................................................................................................................49

    SECTION 9. STANDARD SETTING................................................................