1

Michigan Merit Examination - Plans and Prospects

Edward Roeber, Mike Radke & Jim Griffiths, MDEDiane Walters & John Nelson, ACT

2

Current MEAP High School Test

Spring testing (March-April, 2006)Fall retesting (late October-early November, 2006)English Language Arts (Reading and Writing), Mathematics, Science count for the Merit AwardSocial Studies also assessed but does not count for the Merit Award

3

Current Program

Grade 10Students take the MEAP High School Assessment to qualify for dual enrollment (assessment in fall or spring)

Grade 11Students take the MEAP High School Assessment to qualify for dual enrollment (in the fall) and the Merit AwardAll students take the MEAP in the spring (if they have not already passed the MEAP)

Grade 12Students take the MEAP in the fall or spring to qualify for the Merit Award

4

Current Program

Merit Award: $2,500 for passing the English language arts tests (reading and writing), mathematics and science at the high school levelMerit Award: $500 for passing the same subjects in grade 7 and 8 (each is assessed in each of these two grades)The Merit Award program may changePlease contact the Michigan Department of Treasury with ALL Michigan Merit Award questions

5

MME Legislation

PA 592 of 2004 - MME inserted into Career and Technical Preparation ActPA 593 of 2004 - Replaces high school MEAP with MME in School Aid ActPA 594 of 2004 - Replaces high school MEAP with MME in Postsecondary Enrollment Options ActPA 595 of 2004 - Replaces high school MEAP with MME for determining Merit Award ScholarshipsPA 596 of 2004 - Replaces the high school MEAP with MME in the School Code

6

Steps Used to Implement MME

Visited potential vendors to share/obtain ideasCompetitively bid the MME programReviewed the bidsSelected new contractor(s) - Pearson/ACTDetermined the content of each MME testConducted statistical alignment study (pilot test)

7

Spring 2006 Pilot High Schools

8

Steps Needed to Implement MME

Conduct additional content alignment studies neededSet cut scores on MME and MEAP Grade 11, to be used for the Merit Award and NCLB AYPPrepare revisions to the NCLB Accountability WorkbookEstablish PLAN and PSAT cut scores for dual enrollment purposes

9

Steps Needed to Implement MME

Submit application for approval to U.S. Department of Education by July 1, 2006November 1 is the “drop-dead date” for the MME versus MEAP HST decision for Spring 2007Receive approval from USED prior to drop-dead date OR continue MEAP High School Assessment (if approval is not received by that date)Implement the MME in grades 11 in the 2006-07 school year; maintain MEAP HST for Grade 12 only

10

MME Assessment Design

Grade 10: College entrance readiness test (PLAN and PSAT - local school/student choice)Grades 11 and 12: Michigan Merit Examination

English Language Arts - ACT Reading, Writing, and English; WorkKeys Reading for Information; Michigan Social Studies constructed response itemMathematics - ACT Mathematics; items from ACT Science; WorkKeys Applied Mathematics; Michigan items Science - ACT Science; Michigan itemsSocial Studies - Michigan items

11

Michigan Merit Examination Components and Score Contributions

Assessments Administered

Contributes to an English

Language Arts Score

Contributes to a Mathematics

ScoreContributes to

a Science Score

Contributes to a Social Studies

Score

•ACT Plus Writing

•WorkKeys Applied Mathematics & Reading for Information, plus Michigan Mathematics

•Michigan Science and Social Studies

Total ELA Score

Reading•ACT Reading (MC)•WorkKeys Reading for Information items (MC)

Writing•ACT English (MC)•ACT Writing (CR)•Michigan Social Studies CR item -writing score

•ACT Mathematics (MC)

•WorkKeys Applied Mathematics (MC)

•Selected ACT Science items (MC)

•Michigan items (Approximately 14 MC)

•ACT Science (MC)

•Michigan Science (46 MC)

•Michigan Social Studies (57 MC and 2 CR - social studies score)

Note: The number of Michigan items shown includes field-test items to replace those released annually.

12

MME Assessment Administration(Spring 2007)

Grades 11 and 12 - Spring AdministrationMarch 13 - ACT Plus WritingMarch 14 - WorkKeys + Michigan MathematicsMarch 14-21 - Michigan Science and Social StudiesMarch 27 - Makeup ACT Plus WritingMarch 28 - Makeup WorkKeys + Michigan MathematicsMarch 28-April 4 Makeup Michigan Science and Social Studies

13

MME Assessment Administration(Fall 2007)

Grade 12 - Fall Administration Saturday, October 27, 2007 (ACT National Test Date) - ACT Plus WritingTuesday, October 30, 2007 - WorkKeys + Michigan MathOctober 30 -November 6 - Michigan Science and Social Studies

14

Future Administration Dates

Session

Component 2008 2009 2010

Initial ACT Plus WritingWorkKeys+MathScience & SS

3/113/123/12-19

3/103/113/11-18

3/93/103/10-17

Makeup ACT Plus WritingWorkKeys+MathScience & SS

3/253/263/26-4/2

3/243/253/25-4/1

3/233/243/24-31

15

MME Test Center Establishment

Review several key documents (Spring 2006)Standard Testing RequirementsSchool Schedule and Site Options for Administration of the 2007 Michigan Merit ExaminationSummary of Test Administration PoliciesQualifications and Responsibilities for Test Supervisors and Back-up Test SupervisorsQualifications for Test Accommodations Coordinators

Consider staffing requirements and decide possible staff to fill these positionsPlan for testing rooms/facilities

16

MME Test Center Establishment (Fall 2006)

Week of September 4

Test Establishment Packets sent to high school principals

September 12 MME 2007 Briefing Video Conference

September 29 Establishment packets due back to ACT - Staff and facilities

October 2-13 Administrator Training Workshop invitations mailed

17

MME Test Center Establishment (Fall 2006)

October 20 Administrator Training Workshop reservations due to ACT

Week of October 23

Administrator Workshop Training confirmations sent via e-mail

November - December

Administrator Workshop Training conducted at 12 sites statewide

December 1 Offsite testing requests due to ACT

18

Assessment Sites

Preferred site is in a quiet wing of the high school

School in session for all students, orSchool for juniors only

Off-site administrationCommunity CollegeISD/RESAOther public facilityChurchOther private facility

Each site must be approved by ACT

19

Assessment Facilities

Choice of testing rooms for standard time administration

Uncrowded seating – prefer classrooms with 25-30 examineesManageable security – prefer no more than 100 examinees in one room (if more than 100, see personnel requirements)Good lighting, comfortable temperature, quiet atmosphere

Adequate writing surfacesNo lapboards permitted; temporary surfaces resting on chair arms or back of chair in front must be reviewed and approved by ACTMust accommodate both test booklet and answer document

20

Assessment Facilities

Seating arrangements (Applies Equally to Desks and Tables)

Seats must be assigned by testing staff as students enter room Minimum of 3 feet apart side-to-side (measured shoulder-to-shoulder)Minimum of 3 feet apart front-to-back (measured head-to-head)All students must face the same direction, directly behind one another

21

Assessment Facilities

Freedom from distractionsNo one not involved in testing may be in the roomUninterrupted testing period required for all days of testingNo unnecessary noises (bells, public address systems, etc. must be turned off)Testing rooms must be separated from regular school activities

22

Assessment Personnel

Required number of qualified assistants per room

1 room supervisor required for each room,Plus 1 proctor for every 25 examinees in the room after the first 25 (i.e., 26-50=1; 51-75=2; 76-100=3)

Testing staff may not beInvolved in test preparation outside of normal teaching responsibilities

Enrolled in high school

23

Avoiding Conflicts of Interest

Test (and Back-up) Test Supervisors have access to secure test materials prior to testing.To avoid the appearance of a conflict of interest, and to protect relatives (siblings, children, step-children, grandchildren, nieces, nephews) and wards from allegations of impropriety:

Test (and Backup) Supervisors may not be related to any examinee taking the ACT/WorkKeys in 2006-2007 anywhere in Michigan.Room supervisors and proctors may not assist in a room where any relative is being tested

24

Adequate Training for all Staff

ALL Test Supervisors (TS), Back-up Test Supervisors (Back-up TS), and Test Accommodations Coordinators (TAC) are REQUIRED to attend training in November-December, 2006.Testing staff must have read and be familiar with both the Day 1 and Day 2 supervisor’s manuals (included with training materials)

25

Adequate Training for all Staff

A local training session for all staff is required before testing (conducted by the Test Supervisor at each school)Each room supervisor must have a complete copy of that day's supervisor’s manual in the test room

26

Attentiveness

During testing, the testing staff must:Focus on monitoring testing (reading, grading papers, other personal work is not permitted)Circulate frequently around the room to monitor examineesRecognize the potential for cheating and take action as instructed in supervisor’s manuals

Exact compliance with supervisor’s manuals is required…including reading spoken instructions verbatim

27

Assessment Administration

All test sites must test on the designated daysThe testing activity should be the first activity of the day for studentsAssessment administration staff will need to review procedures 30 minutes prior to the start of testing.No food or drink are permitted in testing room(s) – this applies to both staff and examinees.

28

Security

Receipt, check-in, and verification of test booklets are by serial numbersRestricted access at all times from moment of receipt to return (documented “chain of custody”)Answer documents not returned to students after test responses are griddedAll test sites must test on the designated test days with testing as the first activity of the morning.Immediate and complete return of all Day 1 materials to ACT and all Day 2 materials to Pearson

29

Security

Proper identification of examinees by room supervisor (personal recognition or photo ID)Direct consultation with ACT to handle testing irregularitiesUnannounced observation of assessment administration in selected schools

30

Exact Timing of the Tests

More than one timepiece must be used in each room to ensure back-upTime remaining may not be posted Five-minute warning must be read verbatim from the supervisor’s manuals

31

Documentation of Test Day Procedures

State Testing Staff List returned with answer documentsSeating Diagram, Test Book Count Form, and Testing Time Verification Form returned for each roomSupervisor’s Report Form (Day 1) and School ID Sheet (Day 2) completed accuratelyTesting Irregularity Report Form(s) returned with answer documents

32

MME Year-by-Year Implementation

2005-2006Fall - MEAP HST (grades 10, 11, 12)Spring - MEAP HST plus statistical pilot linking ACT to the MEAP HST (grade 11 only)

2006-2007 (Assuming Federal Approval)Grade 10 - use PLAN or PSAT for dual enrollment

Local district selects test; state sets qualification score(s)Student or school district pays the testing cost (no state reimbursement)

Grade 11 - Offer MME in the Spring for Merit AwardGrade 12 - Offer MEAP HST to complete Merit Award (one year only) OR MME

33

MME Year-by-Year Implementation

2007-08 (No More MEAP)Grade 10 - use PLAN or PSAT for dual enrollment

Local district selects test; state sets qualification score(s)Student or school district pays the testing cost (no state reimbursement)

Grade 11 - Offer MME in the Spring for Merit AwardGrade 12 - Offer MME in the Fall and Spring

Students get one free (state-paid) re-take

34

Key 2006-07 MME Dates

March 6, 2006 - Video conference on MME assessment accommodations (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’)

April 27, 2006 - Video conference on 2006-2007 MME plans (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’)

May - June 2006 - Analyze pilot school information; prepare application to USED to change to MMEJuly 2006 - Submit application to USEDJuly-August, 2006 - Select Michigan items

35

Key 2006-07 MME Dates

September 12, 2006 - Statewide video conference on 2007 MMESeptember-October 2006 - ACT establishes schools as test centersSeptember-October 2006 – Home school students notify district high school of intent to testNovember 1, 2006 - Drop-dead date for USED approval to implement the MME; use MEAP HST if approval not receivedNovember-December 2006 - Mandatory training for Test Supervisors, Backup Test Supervisors, and Test Accommodations Coordinators

36

Key 2006-07 MME Dates

December 1, 2006 - ACT-approved accommodations requests due to ACT for Day 1 Testing (ACT Plus Writing)*January 10, 2007 - State-allowed accommodations requests due to ACT for Day 1 Testing (ACT Plus Writing)*For Day 2 (WorkKeys + Michigan Mathematics) & Day 2-7 (Michigan Science and Social Studies), tests accommodations should be similar to those approved for Day 1

Accommodations decisions for Day 2 and Day 2-7 are the local school district responsibility

*Dates also apply to home school and non-public school students

37

Key 2006-07 MME Dates

January 10, 2007 (Estimated) - Materials orders for ALL students are due for Day 2 (WorkKeys + Michigan Mathematics) & Day 2-7 (Michigan Science and Social Studies tests)

Submitted via Pearson School House for all studentsNovember 2006-January 2007 (Estimated) - Non-public school students using test centers registered for the MMEFebruary 2007 - Accommodations determined and materials orderedFebruary-March 2007 - Test Supervisors train test administrators and proctors

38

Key 2006-07 MME Dates

MME TestingDay 1 - ACT Plus Writing (March 13, 2007)Day 2 - + Michigan Math (March 14, 2007)Day 2-7 - Michigan Science and Social Studies (March 14-21, 2007)Special Testing Windows (March 13-28, 2007)

39

Key 2006-07 MME Dates

MME Makeup TestingDay 1 - ACT Plus Writing (March 27, 2007)Day 2 - WorkKeys + Michigan Math (March 28, 2007)Day 2-7 - Michigan Science and Social Studies (March 28-April 4, 2007)Special Testing Windows (March 27-April 11, 2007)

40

Key 2006-07 MME Dates

May-July, 2007Students receive their reports

Regular ACT reports (college-reportable)WorkKeys reportsMME score reports

Schools receive ACT, WorkKeys, and MME score reportsMME scores used for EducationYES! accreditation and NCLB AYP accountability purposes

41

Key 2006-07 MME Dates

August-September - Students register for MME October Retake via ACT (using a voucher available at their school)MME Fall Retake

Day 1 - ACT Plus Writing (Saturday, October 27, 2007)Day 2 - WorkKeys+Michigan Math (Tuesday, October 30, 2007)Days 2-7 - Michigan Science and Social Studies (Tuesday, October 30-Wednesday, November 6, 2007)Special Testing (October 27-November 13, 2007)

42

How do Students benefit from taking the ACT?

The ACT is universally accepted for college admission.The ACT is curriculum-based.The ACT is more than a test.

43

How do Schools benefit from taking the ACT?

Evaluate student readinessEvaluate/inform instructional programsDocument Progress and Success with the

EPAS®

systemEffectively advise & guide students

44

...a foundational skills development system, best known for translating a vague statement like "we need more math" into a precise set of teachable skills really used in a career. Educators - tailor development plans and certify career readinessEmployers - determine hiring qualifications and training needsEconomic and workforce developers - match employers and communities

45

Job Profiles Job Profiles Sept 00 - Aug 05Sept 00 - Aug 05 4,136

6%

17%

32%

43%

1%

All ExamineesAll ExamineesSept 04 - Aug 05Sept 04 - Aug 05379,546

17%

9%

7%

17%

25%24%

Applied Mathematics

6

3

5

4

7

46

Getting Started Now

Consider how and where the MME will be administeredMake sure IEP teams are considering accommodations needed for both high school assessments

MEAP HSTMME

Think about who will manage the MMETest Supervisor and Back-up Test SupervisorTest Accommodations Coordinator

Review information posted on www.michigan.gov/mme website

47

Helping Students Prepare for MME

Assure that the high school’s curriculum is aligned to state standards and benchmarks, the new high school content expectations, and ACT-assessed standards Assure that course content matches course titlesEncourage students to enroll in rigorous college preparatory classes (or equivalent ones that address the same content with the similar rigor)

48

Helping Students Prepare for MME

Have students participate in reasonable ACT prep activities

Use ACT or commercial products to practice taking a timed testBecome comfortable with the test formats

Focus on learning the skills defined in the standards and benchmarks rather than just practicing test-taking skills

49

Getting Started Now

Review past ACT high school assessment reportsWhat percent of students take the ACT?What percent of students take recommended college core courses?What is the performance of students taking college core versus those who did not?What are the trends over time?

What are the implications of ACT results?For counselors - better course-taking advice?For academic departments - improved rigor of courses?For districts - More rigorous graduations requirements?

50

Challenges

Assuring adequate assessment administration preparation - for very secure tests (ACT)Participation of students with disabilities

What accommodations will be needed? See MME website – “Spring 2007 Michigan Merit Exam (MME) Accommodations Summary Table.”Will MI-Access be used by some students?

Participation of English language learnersWhat accommodations will be offered and under what conditions? See MME website – “Spring 2007 Michigan Merit Exam (MME) Accommodations Summary Table.”

51

For Questions and Comments

Edward Roeber(517) 373-0739 voiceRoebere@michigan.gov

Mike Radke(517) 241-0206 voiceRadkem@michigan.gov

Jim Griffiths (517) 373-4332 voice

Griffithsj@michigan.gov

Michigan Department of EducationOffice of Educational Assessment & AccountabilityP.O. Box 30008Lansing, MI 48909

52

For More Information

For more information on MMEwww.michigan.gov/mme

For MDE assessment questions(877) 560-TEST (8378)

For ACT- or WorkKeys-specific questionsmi.mme@act.org

For Pearson Educational Measurement(800) 204-4109

53

Thank you!

Video conference sites around MichiganWayne RESATCOM Consortium, Mistreamnet and the Sustained Learning RegionsSam LoPrestoPresenters and staffAnd You!

54

VHS Copies: $10.00 + $4.00 S & HDVD Copies: $15.00 + $4.00 S & H

Contact: Brenda Hose, 734-334-1437hoseb@resa.net

Rebroadcast archived at http://www.mistreamnet.com

Powerpoint and attachments available on MEAP website:

www.michigan.gov/meap