Minnesota Assessment Conference

Mathematics MCA-III Online Testing

Jennifer Dugan, Sandy Gimpl, and Rosemary Heinitz

2

Math MCA-II vs. MCA-III Grades 3-8

• MCA-II was operational through Spring 2010 administration

• Aligned to 2003 Academic Standards

• Initial administration of MCA-III in grades 3-8 will be during 2010-2011 school year

• Aligned to 2007 Academic Standards

3

Background

• 2007 math standards were finalized in 2008. • Math MCA-III Test Specifications Committee

drafted first version of the test specifications in 2008.– Test specifications will be in draft form until the first

administration of the test.

• Math MCA-III items were field tested in both 2009 and 2010 spring administrations.

• A Math MCA-III online Fall Field Test was given to some students in fall 2009.

4

Designing the MCA-III

How can we provide – 1) the highest quality assessment 2) with the most information for educators3) that takes the least amount of time to

administer and4) the timeliest results?

Timely

Results

Short Administrati

on

High Qualit

y

Most Informatio

n

5

MCA-III Components

• Computer administered tests (CAT)• Technology-based items (computer scored)

assess higher-order thinking skills• Flexible assessment window allows for

convenient administration during the school year

• Computer-scored exams provide usable information during the school year

• Computer-adaptive assessment provides more precise information about students’ knowledge and skills

6

2011 Administration

• Computer administration with engaging, interactive items (not adaptive)

• Longer online test window to allow for more scheduling choices

• Ability for students to start and stop the online test during the test window

• Online calculator and formula sheet

7

2011 Administration

• Paper administration also available– Accommodations

• One administration per student• Spring 2011 results available after

performance levels are established (Standard Setting)

Minnesota Assessment Conference

8

2011 Administration

• Audio available to all students in online• On-demand – controlled by the student • Does not describe graphics• Audio pauses when there is text in the item

that is not read (graphics, expressions, numbers)

• Vast majority of students’ audio needs should be met

• Paper continues to have script and CD• Describes graphics• Available for students with IEP or 504

9

2011 Online vs. Paper Audio

The table shows Jimmy’s and Linda’s ages.

How old will Linda be when Jimmy is 13 years old?

A.9

B.12

C.16

D.17

2003 2004 2005 2006

Jimmy’s Age 8 9 10 11

Linda’s Age 12 13 14 15

Jimmy’s and Linda’s Ages on January 1

10

Item Types

• Multiple Choice

• Technology Enhanced (only on the online test)– Hot spot– Drag and drop– Graphing– Numeric type-in

• Gridded Response (only on the paper test)

11

Screen Tools

Pointer tool

Eliminate choice tool

Highlighter tool

Eraser tool

Calculator

Formula sheet

Help tool

Back/next buttons

Reset button

Audio box

12

Graphing Item Type

13

Fill-In Item Type

14

MCA-III Support Materials

• Samplers– Familiarize students with the overall testing

experience• Online and paper versions – same items

used in both formats– Do not predict performance on MCA-III– Current schedule has fall release

• Tutorial– Gives information on online tools,

procedures for navigating through the test, etc.

– Current schedule has fall release

15

MCA-III Support Materials

• Formula Sheets–MCA-III Formula Sheets aligned to 2007

standards–Grades 5-8

• Released Items–Provided in subsequent years as testing pool

allow

Minnesota Assessment Conference

16

Test Specifications

• Not final until first administration

• MCA-III and Modified Combined for 3-8

17

Other Minnesota Math Assessments

• 2010 was last year for MTELL– Universal Design and Simplified Language

Principles implemented in MCA-III development• 2011 MCA-II Grade 11

– Aligned to 2003 Math standards– CRs eliminated

• 2011 MCA-Modified will be operational– Grades 5-8 aligned to 2007 Math standards– Grade 11 aligned to 2003 Math standards

• 2011 MTAS– Grades 5-8 aligned to 2007 Math standards– Grade 11 aligned to 2003 Math standards

18

Plans for 2011-2012 Administration

• Adaptive computer administration with engaging, interactive items

• Paper administration also available• Three administrations per student• Test window late fall - spring• Ability for students to start and stop the test

during the test window• Preliminary results by student available

immediately

19

Plans for 2011-2012 Administration

• Audio available to all students in online• Text to speech

• Paper continues to have script and CD• Describes graphics• Available for students with IEP or 504

20

How can you become involved?

• Unique professional development opportunity at no cost to districts

• Teachers learn how tests are built

• Teachers learn the standards intimately

• Teachers advise MDE on how items are developed and tests are built

• Teachers see student performance across the state

21

MDE Contact Information

• Jennifer Dugan– Supervisor Test Development– (651) 582-8654– jennifer.dugan@state.mn.us

• Sandy Gimpl– Math Assessment Specialist– (651) 582-8634– sandy.gimpl@state.mn.us

• Rosemary Heinitz– Math Assessment Specialist– (651) 582-8836– rosemary.heinitz@state.mn.us