1

Ohio Achievement Tests

Grades 3–8District Test Coordinator District Test Coordinator

and and

School Test Coordinator School Test Coordinator

Schedule and UpdatesSchedule and Updates(F-1)(F-1)

September 2008September 200809-05-0809-05-08

2

Relevant Topics for 2008–2009

• Recent changes for grades 3–8• Test schedules• New OGT demographic pages• Ordering Form A• Review of generic labels• Review of Record Change windows • Rescores and verifications

3

Recent Changes for Grades 3–8

• Multiple forms spiraled within classrooms

• Test booklets sealed• Flexible scheduling of test

windows

4

October 2008 Test Schedule Grade 3 Reading Test

• September 22—DTCs receive materials from PEM; transfer materials to STCs well in advance of administration.

• October 6—First possible date for test administration.

• October 9—Pre-scheduled pickup of “Early Return” scorable materials from District location.

• October 10—Pre-scheduled pickup of “Regular Return” scorable materials from District location.

• October 10—DTCs call FedEx to request pickup of nonscorable materials by October 15.

5

May 2009 Test Schedule• April 13—DTCs receive materials from PEM; transfer

materials to STCs well in advance of administration.• April 20—First possible date for test administration.• May 1—Pre-scheduled pickup of “Early Return”

scorable materials from District location.• May 1—Pre-scheduled pickup of “Regular Return”

scorable materials from District location.• May 4—DTC calls FedEx to request pickup of

nonscorable materials by May 6.

6

Schedule Clarifications• Two-week window for testing.• Can start on Monday, April 20, Tuesday, April 21, or

Monday, April 27.• If starting on April 27, secure materials are picked up

beginning on Friday, May 1.• Sequence for testing: Reading, Mathematics,

Writing, Science, and Social Studies.• If desired, districts may test everyday in sequence.• All schools within a district must test the same grade-

level content on the same day.

7

SchoolHouse® and Pre-ID• Spring 2009 enrollment windows

o November 3, 2008–December 5, 2008: SWD enrollment, Pre-ID and optional services for OAT-AASWD.

o February 2–February 20, 2009: Regular and special versions enrollment and optional services.

• Pre-loaded enrollment countso Are based on 2008 enrollment counts plus 10% overage.o If insufficient, ODE will review/approve enrollment increase and

additional order requests.• Pre-ID file submission

o Submit grades 3–8 AASWD files and grades 3–8 achievement files under appropriate SchoolHouse® screen.

o February 2–March 6, 2009o New file names should be used: OH03-08PREID.txt and OH03-

08AAPREID.txt.

8

Checking Enrollments

• Enrollments are pre-loaded. Verify that enrollments are correct for all buildings.

• Contact Pearson to reallocate enrollments and to open/close buildings.

• Order Form A for read-aloud and CD accommodations.

9

Two-Sided Demographic PageOGT

• Front—to be completed by all.• If Pre-ID label used, no need to fill

out inside front cover.• Unit of Administration

10

OGT Demographic Sheet• The second page (inside front cover)

contains information that would be contained on a Pre-ID label.

• If a Pre-ID label is not available for the student and a generic Pre-ID label is being used, the second page must be filled out completely.

11

Field Testing OAT Items (Spring)

• For all subjects, blocks of potential test items are embedded within each operational form.

• These items do not affect student test results.

• For grades 5–8, the correct form letter must be bubbled on the demographic page.

12

Spiraling Multiple Forms Within Classrooms

• Starting in spring 2008, instead of a single form, three to four forms were administered within classrooms.

• This process provides better data for field-test questions by reducing classroom clustering effects.

• If a significant security breach occurs, exposure for field-test questions is limited.

13

Multiple Forms Within Schools and the Read-Aloud

Accommodation

• Read-aloud definition.• Test administrator and student

must have an identical form.• Form A’s must be ordered within

SchoolHouse®.

14

Using Form A - Spring• Form A—Make sure teacher and

student have the same form. • Audio CD and booklet must match.• Form A has same operational

expectations; every child is taking the same test.

• Only thing different is field-test items.

15

Use of Form ASpring 2009

• Use of read-aloud accommodations requires Form A.

• Be sure to order correct number of Form A’s.

• ODE will monitor Form A orders.

16

Review of Generic Pre-ID Labels

• Allows DTCs to assign classroom information (for reporting) to student records not contained on the submitted Pre-ID file. Information is entered during Record Changes.

• Labels have a write-in space for student name; do not grid.

• The STC needs to track barcode numbers assigned to students.

• Use is optional. Documents can still be bubbled. • If used, the DTC must update Pre-ID demographic

information via Record Changes. Demographic data must be entered on the correct corresponding Pre-ID number used on the student test booklet or answer document.

17

Record Changes—Overview• Allows online editing of student

demographic data, including classroom information required for reporting

• Allows districts to create Pre-ID records after Pre-ID files have been submitted

18

Record Changes—Overview

• Allows assignment of generic labels to students who do not receive a Pre-ID label.

• The Record Change System is located within SchoolHouse®. A detailed user’s guide for each Record Change window will be available for download.

19

Record Changes—FallFall 2008 Grade 3 Reading • Pre-ID record changes—Create Pre-ID student

records using the Add a Student function.• Pre-processing record changes—allows updates

to regular and generic Pre-ID records prior to test documents being processed.

• Pre-reporting record changes—Allows updates to student records after processing and before reports are produced.

20

Record Changes—Fall• Fall 2008 grade 3 Reading record

change windowso Window #1 Pre-ID record changes:

August 11–September 10 o Window #2 Pre-processing record

changes: September 29–October 17o Window #3 Pre-reporting record

changes: October 27–October 28

21

Record Changes—SpringSpring 2009 Grades 3–8 Achievement:

• Allows DTCs to enter and edit demographic information on student records.

• Allows DTCs to enter student information to create Pre-ID records. This window will be available at the same time Pre-ID files are uploaded to SchoolHouse®.

• In addition to uploading Pre-ID files, DTCs will have the option to key enter student demographic information for creation of Pre-ID files.

22

Record Changes—Spring• Pre-ID record changes—Allows districts to

enter all student demographic data prior to printing of Pre-ID labels. Information entered during this window will result in regular Pre-ID labels being produced.

• Pre-processing record changes—allows updates to regular and generic Pre-ID records prior to test documents being processed.

23

Record Changes—Spring• Pre-reporting record changes—

Allows updates to student records after processing and before reports are produced

• Pre-reporting record changes—Check enrolled grade to resolve TOG (Tested Out of Grade) Flags

• Enter DNS and INV codes

24

Record Changes—Spring• Spring 2009 record change windows

o Window #1 Pre-ID record changes:February 2–March 6

o Window #2 Pre-processing record changes: April 13–May 8

o Window #3 Pre-reporting record changes(two-day window): May 28–May 29

25

Accelerated Tester Identification• Flag indicating the subject and grade of accelerated

testing for students can be provided in the Pre-ID file submission.

• If Pre-ID flags are not used, flags must be entered using the Demographic page or the Record Change system within SchoolHouse®.

• Processing of documents and reporting of results from accelerated testers will be delayed if accelerated testers are not identified.

26

Review of Security Seals• Each subject area within a test booklet

will be individually sealed.• Seals are not to be removed or broken

until immediately before testing.• Students should be instructed not to

break the security seals for subjects that have not yet been tested.

• Seals for spring only—not used in fall.

27

Types of Security Seals• Grades 3 and 4

o Secured with a plastic seal.o These seals are broken by gently pulling the

plastic tab.• Grades 5 through 8

o Secured with a paper seal.o These seals are broken by inserting a pencil,

eraser side up, and pulling outward from left to right.

• Directions for breaking these seals are contained in the Directions for Administration.

28

Procedures for Security Discrepancies of Seals

STC procedures:• Test administrators should be trained to

report to the STC any seals that are broken before test administration.

• STCs should report any premature breaking of security seals to the DTC.

• If a book is damaged while removing the seal, transcribe and return the original with nonscorable materials. Mark the book as Do Not Score.

29

Procedures for Security Discrepancies of Seals

DTC procedures:• Should note on the Materials Resolution

Form any seals that are missing, broken or damaged when unpacking initial shipment.

• Should investigate and document any inappropriate breaking of security seals reported by the STCs.

• Should contact ODE if a security breach has occurred.

30

Late Batch Processing• Documents included in the late batch:

o Scorable materials that are returned incorrectly—with secure nonscorable materials (WRONG SHIPPING LABEL APPLIED).

o Materials received after the on-time processing deadline (1 week after the end of the test window).

o Materials received within 3 weeks after the end of the test window will be included in the late batch.

31

Late Batch Processing• Late batch reporting

o Will be limited to individual student score reports and late batch data file update online.

o Printed district, school and classroom reports will not be updated to reflect the late scores.

• SCORABLE DOCUMENTS RETURNED AFTER THE LATE BATCH CUTOFF DATE WILL NOT BE PROCESSED AND SCORED.

32

Rescores and VerificationsWeb Site

• The Rescores and Verifications Web site can be accessed via the SchoolHouse® Web site link: http://www.ncsschoolhouse.com.

• User login information (username and password) will be the same as your existing SchoolHouse® login information.

• A user guide (with detailed instructions on the new system) will be available for download under related links.

• In order for rescore results to be included in district data submitted to EMIS in July 2009, rescores must be submitted between June 15 and June 29, 2009.

33

Rescores and Verifications• The online application mirrors the form that was

previously used to submit rescores and verificationso THERE ARE NO PAPER FORMS FOR GRADES 3–8

• 2008–2009 features include theo Ability to enter rescore and verification requests for

3–8 achievement tests and AASWDo Ability to request rescores for any grade/subject for

any student testedo Ability to select students from pre-loaded lists of

district, school and student names based on documents returned for processing

o Ability to filter submitted requests for status based on school, grade, subject, student name

34

Rescores and Verifications• Verify your score data as soon as possible

after receipt (June 15, 2009)• Categories for submission of verifications

o Incorrect score assignment: Student score exchanged with another student’s score

o Invalid test score assignment: Student received a DNA on a test that he/she took or student received a score on a test that he/she did not take

o Missing student: Student tested but test results were not received

35

Rescores and Verifications• Rescore and Verification Request

results will be reported via on-line memos (including e-mail notification when results are posted for district review)

• Demographic Update Form, which references verification number, can be used to update OOARS (Ohio Online Assessment Reporting System)

36

Ohio Achievement Tests Document Archive (www.ohiodocs.org)

Non-secure test documents

37

Ohio Test of English Language Acquisition

(OTELA)Spring 2009

38

OTELA 2009 Key DatesOctober 13-November 7, 2008

TIDE open for pre-ID uploads and materials orders

January 12, 2009 Districts receive K-12 test materials

January 19-March 13, 2009 K-12 test window

March 16, 2009* Last day for UPS pickup of OTELA materials for return to AIR

* IMPORTANT: Materials not returned on 3/16/09 will not be scored. There will be no late processing or scoring for spring 2009 OTELA.

39

OTELA ContactsFor information about… Contact

•OTELA policy•Accommodations

Ohio Department of Education (ODE)

Office of Assessment

Phone: 614-466-0223

Fax: 614-995-5568

www.ode.state.oh.us

•Receiving and returning shipments•Ordering materials

American Institutes for Research (AIR)

Phone: 1-888-944-5001

Email: OHHelpDesk@air.org

40

Final Comments and Questions

• Thank you for your time and attention.

• Final questions?