Fall 2014 Florida Next Generation Sunshine State

Standards (NGSSS)End-of-Course (EOC)

AssessmentsTraining Materials

for Test Administrators Algebra 1, Biology 1, Civics, Geometry, and U.S. History

1

Test Administration Manual

2

One manual (2013–2014 EOC Manual) is provided for the Winter 2013, Spring 2014, Summer 2014, and Fall 2014 administrations.

Scripts and instructions for administering computer-based tests (CBT) ONLY are included in this manual.

Scripts and instructions for administering computer-based and paper-based accommodations are located at www.FLAsessments.com/EOC.

CBT Test Administrator Quick Reference Guide

• The CBT Test Administrator Quick Reference Guide (formerly Appendix D of the manual) has been removed from the manual and is available at www.FLAssessments.com/AdditionalResources.

• This guide lists possible error messages students may encounter, explanations for each message, and troubleshooting solutions.

3

Test AdministrationSchedules

• The Fall 2014 EOC testing schedule is September 15-26.– Algebra 1, Biology 1, Civics, Geometry, and US History

must be completed by September 26.

• The tests may be administered in any order, by school, based on needs of students within a school. One subject test does not need to be completed before another begins, and subject tests may be administered concurrently. – Additionally, testing should be completed within the least

number of days possible but must be completed by the last date noted above.

• All paper accommodations (for students with documented accommodations only) must be administered on the first three days of testing window; September 15-17.

4

EOC Manual 2, Training Packet

Test AdministrationSchedule

Testing Duration• Each EOC assessment will be administered in one 160-

minute session with a scheduled 10-minute break after 80 minutes. Individual restroom breaks are permitted as needed.

• Students may not be dismissed during the first 80 minutes. At the beginning of the break, any students who have completed testing may be dismissed.

• After the 10-minute break, students may be dismissed from the testing room as they complete testing.

• No special incentives should be given to students to encourage them to finish early.

• Any student who has not completed the test by the end of the allotted time may continue working; however, testing must be completed within one school day.5EOC Manual 3

Students with DisabilitiesAccommodations• Administration Accommodations

−Flexible presentation−Flexible responding−Flexible setting−Flexible scheduling−Assistive Devices and Tools

• Paper-based Accommodations−Regular print−Braille− Large print (New as Unique Accommodation for

CBT)6

EOC Manual 7; Appendix A

English Language Learners Accommodations • ESOL Levels 1-4 Only

– Students who are currently receiving services in a program operated in accordance with an approved district LEP plan: Flexible Setting Flexible Scheduling Additional Time Assistance In Heritage Language Approved Dictionary

7EOC Manual Appendix A, 167

Test Security

Per Test Security Statute, s. 1008.24, F.S., and Florida State Board Rule, 6A-10.042, FAC, inappropriate actions by school or district personnel can result in student or classroom invalidations, loss of teaching certification, and/or involvement of law enforcement.

Examples of prohibited activities include the following:• Reading or viewing the passages or test items before, during,

or after testing• Revealing the passages or test items• Copying the passages or test items• Explaining or reading passages or test items for students• Changing or otherwise interfering with student responses to

test items• Copying or reading student responses• Causing achievement of schools to be inaccurately measured

or reported

8

EOC Manual 19-20; Appendix C & D

Test Irregularities/Missing Materials

• Test administrators should report any test irregularities (e.g., disruptive students, loss of Internet connectivity) and possible security breaches to the school assessment coordinator immediately.

• Schools must investigate ANY report of missing materials and report missing secure materials (e.g., Student Authorization Ticket, used work folder, Session Roster) to Student Assessment & Educational Testing immediately at 305-995-7520.

• If a test irregularity or security breach is identified, the school assessment coordinator must contact Student Assessment & Educational Testing to discuss possible test invalidations. 9

EOC Manual 20

Test Irregularities/Security Breaches

• For test irregularities requiring further investigation by the district and for security breaches, a written report must be submitted within 7 working days after the irregularity or security breach was identified. The report must include: – The nature of the situation– The time and place of the occurrence– The names of the people involved– A description of the communication between the district

assessment coordinator’s office and school personnel– How the incident was resolved– What steps are being taken to avoid future test irregularities

or security breaches• Schools should submit completed reports to the Office of

Student Assessment & Educational to be forwarded to the FDOE.

10

EOC Manual 20

11

Electronic Devices

• School personnel must ensure that students do not have access to their cell phones or other electronic devices at any time during testing, including breaks (restroom breaks, etc.), even if they do not use them.− “Possession” is defined as “within arm’s reach,” even if

the electronic device is not visible.− Students should not have cell phones in their pockets,

clipped to their belts, at their desks, or anywhere they can be easily accessed during testing or breaks.

• If a student is found to be in possession of ANY electronic devices during testing or during a break, his or her test must be invalidated.

• Students and parents/guardians must be made aware of this policy prior to testing.

EOC Manual vi, 26, 33, Appendix D

Testing Rules Acknowledgment• All EOC assessments include a Testing Rules

Acknowledgment that reads, “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.”

• The last portion of the testing rules read to students now reads, “After the test, you may not discuss the test items with anyone. This includes any type of electronic communication, such as texting, emailing, or posting to blogs or websites like Facebook or Twitter. If you are found sharing information about test items, even without the intent to cheat, your test will be invalidated.”

• Students and their parents/guardians should be made aware of the testing rules prior to testing. 12

EOC Manual 34, 36

Caveon Forensic Analyses

• Caveon will analyze data to identify highly unusual test results for two primary groups: – Students with extremely similar test

responses; and – Schools with improbable levels of

similarity, gains and/or erasures.• Only the most extreme results are

flagged and withheld– One in a trillion chance of the pattern occurring

by chance 13

BEFORE TESTING

14

EOC Manual 28-34; 94-118

Communicate Testing Policies

Students and Parents/Guardians• Electronic Devices Policy—If students are found with ANY

electronic devices, including, but not limited to, cell phones and smartphones, during testing OR during breaks, their tests will be invalidated. The best practice would be for students to leave devices at home or in their lockers on testing days.

• Leaving Campus—If students leave campus before completing the test (for lunch, an appointment, or illness, etc.), they WILL NOT be allowed to complete the test. Students and parents/guardians should be made aware of this policy. If a student does not feel well on the day of testing, it may be best for the student to wait and be tested on a make-up day. Please make sure parents/guardians are aware of the test administration schedule and understand that appointments should not be scheduled on testing days.

15EOC Manual v, vi, 26, 33, and Appendix D

Communicate Testing Policies,(cont.)

Students and Parents/Guardians • Testing Rules Acknowledgment—Prior to testing, students will be

asked to affirm a Testing Rules Acknowledgment that reads: “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” Students taking computer-based EOC assessments show that they have read the statement by clicking a box (TestNav) or circle (TestHear); in paper-based EOC assessments, a signature line appears below the statement.

• Discussing Test Content after Testing—The last portion of the testing rules read to students before they sign/check the acknowledgment reads, “After the test, you may not discuss the test items with anyone. This includes any type of electronic communication, such as texting, emailing, or posting to blogs or websites like Facebook or Twitter. If you are found sharing information about test items, even without the intent to cheat, your test will be invalidated.” Please make sure that students understand this policy prior to testing, and remind them that “discussing” the items includes any kind of electronic communications, such as texting, emailing, or posting to blogs or social media websites (Facebook, Twitter, etc.). 16EOC Manual 34

Prepare the Room for Testing

• Make sure that each room is free of distractions and has– Comfortable seating– Good lighting– Sufficient workspace– Adequate ventilation

• Make sure that:– students are not facing each other

when seated at tables– there is at least three feet between

students– students cannot view others’

computer screens (visual barriers are installed)

• Remove or cover all visual aids on student desks or displayed in the room, such as posters showing mathematical and scientific concepts.

17

EOC Manual 29

Test Materials Needed (as applicable):

• Test Administration Manual• Scripts and Instructions for administering CBT/PBT

accommodations• Session Roster or Administration Record/Security

Checklist• Seating Chart• Student Authorization Tickets• Test Group Code• Security Log• Work Folders• CBT Worksheets• Calculators• Reference Sheets or Periodic Tables• Test and Answer Books (accommodations)

18

EOC Manual 32-33

2013–2014 EOC Manual

• The 2013–2014 End-of-Course Assessments Test Administration Manual must be used to read the test administration script(s) to students.

• When testing students with accommodations, you may need to modify the scripts. Review the scripts BEFORE testing begins to determine the necessary modifications.

• NEW! The scripts and instructions for the administration of accommodated computer-based test forms (large print, color contrast, screen reader, zoom, assistive devices) and paper-based accommodations are located at www.FLAssessments.com/EOC.

19

EOC Manual 35

Training – Test Administratorsand Proctors, cont.

Supervise Test Administration While students are working, ensure that students: • Have cleared the area around their workstations of all materials

except for Student Authorization Tickets, pens or pencils, and, as applicable, calculators, work folders, worksheets, reference sheets, and periodic tables.

• Check the Testing Rules Acknowledgment box and enter the correct test group code.

• Do not have electronic devices (except for approved calculators) of any kind during testing, even if they do not use them.

• Do not talk to other students or make any disturbance.• Are working independently.• Are working in the correct test. 20

EOC Manual 35-38

Training – Test Administratorsand Proctors, cont.

Supervise Test Administration • It is not appropriate to use cell or classroom phones, grade

papers, or work on the computer during testing.

• While you may encourage students to continue working, you may not talk with them about test items or help them with their answers.

• If a student’s computer is disconnected from the test, contact the school assessment coordinator or technology coordinator to help diagnose any technical issues. The student will need to be resumed in PearsonAccess before logging back in.

• If a student has continual difficulty logging in or gets kicked out of the test more than once, do not have the student continue attempting to log in until the issue is diagnosed and resolved.

• If students finish the test in the first 80 minutes before the 10-minute break, you may encourage them to go back and check their work.

21

EOC Manual 35-38

Training – Preparing for CBT

• Ensure that all software applications, including Internet browsers, are closed on all student workstations.

• Start TestNav, type in the correct URL, and open each student workstation to the student login screen, but do not log in for students.

• Display the student comment form URL (www.FLAssessments.com/EOCStudentCommentForm) on the day of testing, or create shortcuts on student workstations to ensure each student is able to complete the form after testing.

• Ensure that the test administrator has a way to contact the technology coordinator or school coordinator during testing without leaving the room unattended.

22

EOC Manual 35-38

Proctors

23

When testing a large group of students, proctors must be assigned to the room. Refer to the table below for the required number of proctors.

*FDOE strongly encourages the use of proctors in all testing rooms, even those with 25 or fewer students.

Note: Students cannot serve as proctors or volunteers.

1-25 students Test Administrator*

26-50 students Test Administrator and 1 Proctor

51-75 students Test Administrator and 2 Proctors

EOC Manual 21

Session Roster

• School assessment coordinators will provide a Session Roster (CBT only), which includes the following information:

24

− Test Administration− Session Name− Test to be Administered− Test Code (password) − Student Names− Student ID Numbers− Student Birth Dates− Class Information

− Test Form/Form Group Type

− Login IDs− Blank space to record

attendance and accommodations information

• Session Rosters may be used to record required administration information.

EOC Manual 9-10

Session Roster (cont.)

Session Rosters must be handled in a secure manner and returned to the school assessment coordinator immediately after each test session is completed.

25

EOC Manual 9-10, 115-116

Required Administration Information Record the following required information on your

Session Roster or Administration Record/Security Checklist:• Students assigned to the room• Attendance information• Accommodations provided to students• Accommodations used by students• Test group code• Unique security number of secure documents

assigned to each student (paper-based accommodations only)

• Signatures of test administrator and school assessment coordinator

• Dates and times for when secure materials are received and returned

26

EOC Manual 29-30

Seating Chart

• An accurate seating chart must be maintained for each testing room for each test session. Seating charts should record the following information:− Room name/number− Subject− Student names and their location in the room during testing− Direction students are facing− Date− Starting and stopping times− Test administrator name− Names of proctors (if applicable)− Test group code− Session name in PearsonAccess (CBT)

• If students are moved to a new location or the seating configuration changes during testing, a new seating chart must be created. 27

EOC Manual 30 and Training Packet (see sample provided)

Student Authorization Tickets

• For the test, each student needs a Login ID and a six-character test code (password), which are printed on the Student Authorization Tickets.

• Students will need a pen or pencil during testing to sign their tickets.

• Provide each student a ticket only AFTER all students have entered the testing room, as instructed in the script, and all tickets must be collected BEFORE students leave the testing room.

• Student Authorization Tickets must be handled in a secure manner and returned to the school assessment coordinator immediately after each day of testing is completed.

28

EOC Manual 8

Test Group Code

• A test group code is a unique four-digit number used as a security measure to identify a group of students tested together.

• Each testing room must use a different test group code.

• Students will enter the test group code before beginning the test, as indicated in the scripts.

• Your school assessment coordinator will provide you with a test group code.

• If students are absent for a test session, a different unique code must be used for each make-up session.

• The code must be recorded on the required administration information and on each seating chart.

29

EOC Manual 10

Test Code vs. Test Group Code

Test Code Test Group CodeA six-character code (password) created by PearsonAccess and printed on Student Authorization Tickets and Session Rosters. The Login ID and the test code are required to log in to TestNav and TestHear.

A unique four-digit number created by school assessment coordinators used to identify groups of students tested together. The test group code is entered after the Testing Rules Acknowledgment and before students see the first test item.

30

EOC Manual 29, 9-10

Security Log

31

A Security Log must be maintained for each testing room.

Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room.

EOC Manual 31, 189, Appendix D

Work Folders

• The Florida Computer-Based Testing Work Folder is a piece of yellow 11x17 paper folded in half with graph paper printed on the back cover.

• For the Algebra 1, Biology 1, and Geometry EOC assessments, students are provided with work folders to work the problems.

• Work folders must be distributed to students at the beginning of each test session.

• Ensure that students have enough desk space to use their folders.

• Collect all work folders when students finish testing before they leave the testing room, and return folders to the school assessment coordinator.

• Used work folders are secure materials. 32

EOC Manual 33

CBT Worksheets

• If schools choose to provide them, students taking the computer-based Civics and U.S. History Assessment (TestNav or TestHear) may use a CBT Worksheet to make notes rather than using the CBT notepad tool.

• The worksheet is an 8½ x 11 page (located in Appendix D and PearsonAccess) that may be copied and distributed to students at the beginning of a test session.

• Students must have enough desk space to use their worksheets.

• Collect all worksheets when students finish testing before they leave the testing room, and return worksheets to the school assessment coordinator.

• Used worksheets are secure materials.

33

EOC Manual 33 and Appendix D

Four-Function Calculators

34

TestNav TestHear

The computer-based TestNav Algebra 1 and Biology 1 EOC Assessments have a built-in four-function calculator.

The TestHear Algebra 1 and Biology 1 EOC Assessments do NOT have a built-in four-function calculator.

Students may use the built-in calculator, or they may use a handheld four-function calculator.

Students who will test using TestHear accommodated forms of the Algebra 1 and Biology 1 EOC Assessments MUST be provided handheld four-function calculators.

Test administrators should provide handheld calculators at the beginning of a test session to all students who request them.

Students with visual impairments may use the approved large key/large display calculators or approved talking calculators supplied by the FDOE.

Adequate supply of approved four-function calculators should be made available.

EOC Manual 11-12, 33

Scientific Calculators

35

TestNav TestHear

The TestNav Geometry EOC Assessment has a built-in scientific calculator.

The TestHear Geometry EOC Assessment does NOT have a built-in scientific calculator.

Students may use handheld scientific calculators, if the school has chosen to provide them.

Handheld scientific calculators will be provided by FDOE for students taking the Geometry EOC Assessment using TestHear accommodated CBT forms.

Handheld scientific calculators will not be provided by the FDOE for students taking the Geometry EOC Assessment using TestNav.

Students with visual impairments may use large key/large display scientific calculators that are comparable in function to the approved scientific calculators (on page 11 of the 2013–2014 EOC Manual).

The approved talking scientific calculator is the Orion TI-36X or one that is comparable in function to the Orion TI-36X. No other calculators may be used.

EOC Manual 11-12, 33

Reference Sheets and Periodic Tables• Reference sheets and periodic tables are provided in an online

format only for CBT testers. However, schools may provide hardcopy reference sheets or periodic tables to students.

• Any hardcopy reference sheets or periodic tables must be photocopies of the reference sheet and periodic table in Appendix D of the manual (also available at www.FLAssessments.com/EOC).

• If your school will provide hardcopy reference sheets or periodic tables to students, check each copy before distributing to students and follow the instructions in the administration scripts.

• Reference sheets and periodic tables for students with paper-based accommodations are packaged with test materials, and should be distributed to students as indicated in the administration scripts.

• Once students complete the test session, the test administrator should collect all reference sheets and periodic tables.

• Used reference sheets and periodic tables are secure materials.

36

EOC Manual 33 and Appendix D

Additional Items

• Pens and/or pencils– Ensure each student has a pen or

pencil to sign his or her authorization ticket and make notes or work the problems during testing

– Students taking paper-based tests must use No. 2 pencils

• Clock or watch• Signs (Appendix D)

R Do Not Disturb Sign—display on all entrances

R Electronic Devices Sign—display where it will be visible to all students in the testing room

37

EOC Manual 31 and Appendix D

DURING TESTING

38

EOC Manual 35-38; 119-123

Supervision of Test Administration• Ensure that test sessions have been started in

PearsonAccess

• Provide test administrators with additional materials, as necessary.

• Monitor each testing room to ensure that test administration and test security policies and procedures are followed, seating charts and Security Logs are properly completed, and required administration information is collected.

• Be available during testing to answer questions from test administrators and to ensure that there are no technical issues.

• Arrange for and supervise make-up administrations.

39

EOC Manual 119

40

Monitor Session Status

After a session begins, you can monitor the real-time status of students. Refer to the following table for a description of each possible status.

EOC Manual 120-121

41

• Certain circumstances, such as loss of an Internet connection, trigger the “Early Warning System” (EWS) on the interface that students see during testing. The EWS alerts students to possible problems with the transmission of their test data and allows the test administrator to take action to ensure student responses are captured.

Early Warning System

EOC Manual Scripts and 122-123.

AFTER TESTING

42EOC Manual 92-93; 131-144

Test Invalidation

• A test MUST be invalidated if either of the following circumstances occurs:R A student has an electronic device during testingR A student is cheating during testingR A student is given an accommodation not allowed on EOC assessmentsR A student is given an accommodation not indicated on the student’s

IEP, Section 504 plan, or ELL planR An error occurs in test administration or procedures that could

compromise the validity of test resultsR A student is given unauthorized help during testing

• A test MAY be invalidated if one of the following circumstances occurs:R A student becomes ill and is unable to finishR A student is not allowed the correct amount of timeR A student was not provided an allowable accommodation indicated on

the student’s IEP, Section 504 plan, or ELL planR A disruption occurs during testing (e.g., severe weather)R A student is disruptive during testing

43

EOC Manual 26-27, 128-129

• The following slides relate to the administration of paper-based tests (regular print, large print, or braille), which are available for eligible students who have such accommodations identified in their IEPs or Section 504 plans. Paper-based large print is available as a unique accommodation for eligible students.

• The upper-left corner of the following slides show an image of a pencil and a paper-based test (see below) to indicate that this information pertains to paper-based tests only.

44

Paper-Based Tests (PBT)

PBT Materials

Materials Needed for Testing• Test Documents

R Algebra 1 EOC Assessment Test and Answer BooksR Biology 1 EOC Assessment Test and Answer BooksR Civics EOC Assessment Test and Answer BooksR Geometry EOC Assessment Test and Answer BooksR U.S. History EOC Assessment Test and Answer Books

• Reference Sheets and Periodic Tables• Calculators (approved four-function and scientific)

45

EOC Manual 94

PBT Security Numbers

• Used to account for each test and answer book.

• Consists of a nine-digit number followed by a check digit located in the upper right corner of test and answer books.

• Packing list shows the number ranges assigned to each school, and written documentation of the number ranges must be maintained at all times during distribution and return of books.

• Pre-populated Administration Record/Security Checklists with security numbers for all test and answer books are provided in PearsonAccess.– Blank Administration Record/Security Checklist also provided in

PearsonAccess and in Appendix D of the manual.

• Test administrator should maintain a list of all secure materials assigned to him or her, including any additional materials assigned throughout the administration. 46

EOC Manual 21-23 and Appendix D

PBT Student Demographic Information

47

EOC Manual 13-18, 23, 116-118

PBT Defective Materials,DNS and UNDO Bubbles

• If a defective test and answer book is identified before testing begins, the student should be given a replacement document and the defective document should be returned with all other NOT TO BE SCORED materials.

• If a DNS bubble has been gridded by mistake, erase the DNS bubble and grid the UNDO bubble. Package the document with TO BE SCORED materials.

• The DNS bubble MUST be gridded in the follow circumstances:– The document is defective and used.– A student name, ID number, district number, or school number is incorrect on a PreID

label affixed to a USED document.– A student label has been placed over another label on a USED document.

• If a student discovers that a document is defective during testing, the student must be given a replacement and must, under close supervision, transcribe the exact responses from the defective document into the replacement when the test session is over.– The DNS bubble(s) must be gridded on the defective document and it should be

returned with NOT TO BE SCORED materials. 48

EOC Manual 24-27

Appendices

Appendices in the 2013–2014 EOC Manual include:• Appendix A—Accommodations

(pages 159-168)

• Appendix B—Pearson Support and PearsonAccess (pages 169-174)

• Appendix C—Test Security Statute and Rule (pages 175-180)

• Appendix D—Forms, Cover Sheets, Checklists, Signs (pages 181-213)

49

Comment Forms

50

• After testing, test administrators, school coordinators, technology coordinators, and district coordinators are encouraged to complete the appropriate comment form located at www.FLAssessments.com/EOC.

• FDOE and Pearson appreciate feedback from district and school personnel.

EOC Manual 144

Reminders

Test Security Policies and Procedures• Per Florida State Board of Education Rule 6A-10.042, FAC, and

Test Security Statute, s. 1008.24, F.S. (see Appendix C), district and school personnel are required to maintain test security before, during, and after testing.

• Please remember that inappropriate actions can result in student or classroom invalidations and/or loss of teaching certification.

• All school personnel, including itinerant teachers and proctors, must receive thorough training in test administration and security policies and procedures, familiarize themselves with all relevant content of the test administration manual, read the Statute and Rule in Appendix C, and then sign a Florida EOC Test Administration and Security Agreement.

• All test administrators must be certified educators and must sign the Test Administrator Prohibited Activities Agreement.51

EOC Manual 19-25; Appendix C and D

Reminders

Test Administrator Policies• ALL test administrators must be certified educators.• Test administrators are required to sign a Test Administrator

Prohibited Activities Agreement in addition to a Security Agreement. Test administrators must record their certification numbers on this document.

• The Florida EOC Test Administration and Security Agreement and the Test Administrator Prohibited Activities Agreement may be copied together so that double-sided, single-page copies can be distributed to test administrators.

• School assessment coordinators must file the signed forms with their signed security agreements.

• Test administrators must NOT administer the EOC assessments to their family members

52

EOC Manual 19-20; Appendix C and D

Pearson Support and PearsonAccess

Contact Pearson Support at:• 1-877-847-3043 (Monday–Friday, 7:00 am–8:30 pm

ET)

• Florida@support.pearson.com

Appendix B in the 2013–2014 EOC Manual provides the following information:

• PearsonAccessRUser accounts (FDOE distributed instructions for setting up

user accounts to district assessment coordinators.)RBrowser requirementsRLogging in for the first timeRResetting passwords

• Training CenterRTest Setup Exercise

53

EOC Manual Appendix B, 170

54

Student Assessment and Educational Testing

Maria C. Bruguera, Director

mbruguera@dadeschools.n

et

Mara Ugando, Staff

Specialist

mugando@dadeschools.net

Phone: 305-995-7520

Fax: 305-995-7522

Contact Information

ITS - Infrastructure and System Support

Mr. Javier Perez, Executive Director

JPerez@dadeschools.netTelephone Number: 305-995-

3331 

Mr. Roly Avila, SupervisorRAvila@dadeschools.net

Telephone Number: 305-995-3334

Thank you for ensuring secure and successful administrations of the EOC assessments this

year.

55