2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

134
2010 Spring 2010 Spring Regional Regional Meeting Meeting Office of Assessment, Office of Assessment, Evaluation, and Research Evaluation, and Research

Transcript of 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Page 1: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

2010 Spring 2010 Spring Regional Regional MeetingMeeting

Office of Assessment, Office of Assessment, Evaluation, and ResearchEvaluation, and Research

Page 2: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest Security

TCA 49-1-607TCA 49-1-607TN Test Security LawTN Test Security Law

Any person found not to have followed test security guidelines…

immediate suspensiongrounds for dismissal, including tenured employeesrevocation of state license

Page 3: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test AuditsTest AuditsState Test Security Measure:State Test Security Measure:

Conduct random visits during testing to ensure test security and consistency of

administration.Random audits may take place during any test administration.Test auditors show up unannounced.Assessment Audit Checklist

AER Tools & Resources pagehttp://www.state.tn.us/education/assessment/tools_resources.shtml

Page 4: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Testing Code of Ethics

School Systems must adopt a locally monitored test security policy that incorporates the State Test Security Guidelines and includes a Testing Code of Ethics for personnel to sign and leave at the

district office for documentation.•Example now available online•For system use•AER Tools & Resources pagehttp://www.state.tn.us/education/assessment/tools_resources.shtml

TN Test SecurityTN Test Security

Page 5: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

www.state.tn.us/education/assessment/tseoctoolresource.shtml

AER Website on AER Website on

Tools & Tools & ResourcesResources page page

Acknowledgement Acknowledgement of Test Security of Test Security

PolicyPolicy

For school/system use

All personnel involved in the testing process

must be trained. Training documentation should be retained for

system records.

Page 6: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

TN Test SecurityTN Test SecurityAll TCAP Achievement Tests must be administered within a specified testing window.

All students in a grade level within a school must adhere to the same test schedule with the exception of students who are taking makeup tests or require special accommodations (same subject at the same time on the same day).

Page 7: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest SecurityAll test materials must be secured before

and after the test administration.Test materials should be stored in a locked room that is not accessible to unauthorized persons. Handling of test materials must be restricted to authorized personnel at all times.Test materials should be picked up immediately prior to and returned immediately after each test session.

Page 8: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

www.state.tn.us/education/assessment/tseoctoolresource.shtml

AER Website on AER Website on

Tools & Tools & ResourcesResources page page

Test MaterialsTest MaterialsQuantity Quantity

VerificationVerification

All test materials must be kept secure by

implementing check-in, check-out and quantity verification procedures for all test materials at the system level, at the

school level, and for each test session.

Page 9: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest Security

Standard copyright laws must be maintained at all times.

Test items may not be reproduced or distributed in any way, for any reason, by any person.

Test content may not be paraphrased for use directly in instructional activities, study guides, or classroom resources.

Page 10: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest SecurityTest materials should not be read, reviewed,

or analyzed before, during, or after test administration unless indicated in test instructions or special accommodations.

Discussion of test content or specific test items with students, parents, or professional colleagues is prohibited to protect the validity of the test.

Page 11: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest Security

A secure environment must be ensured during testing.

Turn off all communication devices during each test session.

Maintain confidentiality of student specific accountability demographic information and test results at all times.

Page 12: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest SecurityAny information regarding the Any information regarding the

content being measured on the test content being measured on the test must be concealed during the test must be concealed during the test administration. Including but not administration. Including but not

limited to the following:limited to the following:Maps Maps ChartsChartsPosters Posters Student Work Student Work Bulletin Board Bulletin Board ItemsItemsWriting Formulas Writing Formulas Word ListsWord Lists

Parts of SpeechParts of SpeechGraphic OrganizersGraphic OrganizersNumber LinesNumber LinesDefinitionsDefinitionsWord WallsWord WallsDisplaysDisplaysModelsModels

Page 13: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Secure Testing EnvironmentSecure Testing Environment

Just because a manipulative has been used all Just because a manipulative has been used all year DOES NOT mean that it can be used on year DOES NOT mean that it can be used on

the test.the test.

Page 14: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest SecurityCarefully adhere to all test directions and

accommodation instructions.Make sure all students receive the correct test

materials.Follow all time limits outlined in the test

directions.Follow all schedules set by the school/system.Remain with students and be observant and

non-disruptive throughout the testing session.

Page 15: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest Security

Ensure that students respond to test without assistance from anyone.

Test administrators must ensure appropriate monitoring that does not include coaching or illegal assistance.

Test administrators must not read test items or passages to students unless indicated in instructions or accommodations.

Page 16: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test SecurityTest SecurityEnsure proper calculator use as outlined in the

Test Administration Manual. Calculators must be cleared before and after each

test administration. Sharing calculators during testing is not permitted. Students may not use the following types of

calculators: pocket organizers, cell phones, PSPs and IPODS, electronic writing pads, or input devices.

A list of prohibited calculator functions can be found in the TAM.

May not be used on K-2 test. Electronic translators not allowed for any students.

Page 17: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

www.state.tn.us/education/assessment/tseoctoolresource.shtml

Don’t forget to

complete Report of

Irregularity

.

Breach of Breach of Testing Testing Security Security ReportReport

Immediately report any test security

concerns to building/system

testing coordinator.

Page 18: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Breach of Breach of Testing Testing Security Security

ProceduresProcedures

All Test Administration

Manuals contain a flowchart provided

for guidance in handling potential breach of testing

security concerns.

Page 19: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

All Questions about SAT 10 (K-2) should be directed to:

Sandra G. Cagle

Pearson SAT 10 Consultant

Phone: 615.567.6312

Mobile: 615.483.3512

[email protected]

SAT 10 (K-2)SAT 10 (K-2)

Page 20: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Why So Many Changes?Why So Many Changes?New Curriculum

• NAEP Report

• TN Diploma Project

New ACH Contract

• ETS & Pearson

• MAAS & ELSA

New Achievement Levels

• Advanced

• Proficient

•Basic

•Below Basic

Page 21: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

New CurriculumNew Curriculum

http://www.state.tn.us/education/curriculum.shtml

Social Studies did not change!

Page 22: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• English Linguistically Simplified Assessment (ELSA)

• Modified Academic Achievement Standards (MAAS) Assessment

New Achievement TestsNew Achievement Tests

Page 23: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Use ACH answer document

• Bubble ELSA Bubble

• Same accommodations available

• T1 & T2 students cannot take ELSA

• Simplified language

• New AYP for ELL students

English Linguistically Simplified English Linguistically Simplified Assessment (ELSA)Assessment (ELSA)

Page 24: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Achievement Answer DocumentAchievement Answer Document

ELSA BubbleELSA Bubble

Page 25: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ELSA Bubble on ACH Answer ELSA Bubble on ACH Answer DocumentDocument

Students may take ELSA at the same Students may take ELSA at the same time and same setting as ACH if there time and same setting as ACH if there are no Read-Aloud Accommodations.are no Read-Aloud Accommodations.

Page 26: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

MAAS Answer DocumentMAAS Answer Document

Only three answer choices!Only three answer choices!

Page 27: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

•Fill in only one of the corresponding circles based upon the student’s anticipated availability for instruction/enrollment/attendance.

•This is not an indication of the number of days present when the test is taken.

Instructional Availability/Instructional Availability/Class AttendanceClass Attendance

Page 28: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Instructional Availability/Instructional Availability/Class AttendanceClass Attendance

Page 29: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

For Traditional schedules, select from among the following:

• 150 days or more• 75-149 days• 74 days or fewer

For Modified schedules, select from among the following:

• 75 days or more• 38-74 days• 37 days or fewer

Instructional Availability/Instructional Availability/Class AttendanceClass Attendance

Page 30: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• To be announced via listserv message

• Accurately completing the Instructional

Availability Bubble will make the

process faster and easier

• Instructional availability information

cannot be corrected in SDDV after

testing. It must be corrected in the FSD

application in RANDA.

Faculty Student Data (FSD) Faculty Student Data (FSD) WindowWindow

Page 31: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Consumable (students can write in books)

• New practice tests will be sent each year

• Grade 5 practice test misprints

RLA Key (ELSA & ACH)

Disregard Mathematics Item #44

New Full-length ACH Practice TestsNew Full-length ACH Practice Tests

• ACH Practice Tests are now being shipped

ACH Practice Tests

ELSA Practice Tests

MAAS Practice Tests

Page 32: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Book Covers – ELSA, MAAS, & ACHBook Covers – ELSA, MAAS, & ACH

Carefully check Test Book CoversCarefully check Test Book Covers

Page 33: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Practice Answer DocumentPractice Answer Document

http://www.state.tn.us/education/assessment/tools_resources.shtmlhttp://www.state.tn.us/education/assessment/tools_resources.shtml

Page 34: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Review your shipping addresses in RANDA immediately to ensure receipt of secure test materials (ACH and EOC).

• Contact the Office of Assessment ASAP if there are changes to shipping addresses.

• Notify us in writing of any shipping problems with R & L.

Very Important: Shipping AddressesVery Important: Shipping Addresses

Page 35: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Late orders or changes can be made by email to:

[email protected]

• Double check your Braille and LP orders immediately!

Late Achievement OrdersLate Achievement Orders

Page 36: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Achievement WebsiteAchievement Website

• Item Samplers & Practice Tests

• Test Administration Manual (TAM)

• Subtests Times and Item Charts

• Teacher Directions

• Reporting Categories

State Performance Indicators (SPIs)

Number of items per Reporting Category

http://www.state.tn.us/education/assessment/achievement.shtml

Page 37: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACH Testing WindowACH Testing Window2009-20102009-2010

• March 22 - April 23, 2010

• Systems select no more than six consecutive

school days (Do not have to use 6 days).

• Systems do not have to use six days.

• Good Friday may interrupt the test window.

• Spring Break may not interrupt the test

window.

Page 38: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• All schools within a system must follow the

system testing window.

• All students in a grade level within a school

must adhere to the same test schedule

(SPED, ELL, & make-up testing).

• ELL and Special Education students may not

be tested outside of the system or state

testing window.

ACH Testing WindowACH Testing Window2009-20102009-2010

Page 39: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Must notify Assessment Office if you need to

change your ACH Testing Window.

• Office of Assessment MUST approve new

window.

• White boxes MUST be sent back within 3

days after testing is complete.

ACH Testing WindowACH Testing Window2009-20102009-2010

Page 40: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACH Testing Schedule 2009-2010ACH Testing Schedule 2009-2010

All students in a grades 3 – 8 must adhere to

the following test schedule:

• Day 1 – Reading/Language Arts (Parts 1 & 2)

• Day 2 – Mathematics (Parts 1 & 2)

• Day 3 – Science (Parts 1 & 2)

• Day 4 – Social Studies (Parts 1 & 2)

Exceptions: SPED, ELL, & make-up testing

Page 41: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

GIS GuidelinesGIS Guidelines

• Must use valid teacher name & license

number.

• No made up names “Read Birds.”

• No more than 50 students under one GIS.

• Re-rostering will allow schools to create

reports with alphabetical list of students by

grade.

Page 42: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Revised Revised Group Information Sheet (GIS)Group Information Sheet (GIS)

Must use valid Teacher name

Must use valid license

number0

Page 43: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Teacher Licensure NumbersTeacher Licensure Numbers

Use “new” number from the look-up site. It is not the social security number!

https://www.k-12.state.tn.us/tcertinf

Must have login & password.

Page 44: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Alternative School StudentsAlternative School Students

• Must be coded back to the Remanding

School.

• Do NOT complete a GIS for an alternative

school.

• Systems/schools will not be able to complete

an SGL for Alternative School Students.

Page 45: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

December 2009 TDOE uploaded student demographic data to Pearson Access from EIS:

• Last name, First name• Student USID number• DOB & Grade• Gender & Ethnicity• System & School

PearsonAccess PearsonAccess (PEMSolutions)(PEMSolutions)

Page 46: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Pre-ID/PearsonAccessPre-ID/PearsonAccess• Changes made in PearsonAccess from

December 8th – February 5th will be printed

on the answer documents .

• Systems & Schools may still clean data

until March 19, 2010 but changes will not

be printed on the answer document.

• Pre-ID answer documents will be sent

directly from Pearson to LEAs.

• No machine pre-slugging allowed for

Achievement.

Page 47: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Pre-ID Answer DocumentsPre-ID Answer Documents

Page 48: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Do NOT bubble the following on Pre-ID Answer Documents:

+Name +DOB +Ethnicity+USID +Gender

Pre-ID Answer DocumentsPre-ID Answer Documents

Page 49: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• If a student has changed schools, even

within your own school system, use a

“blank” answer document.

• School systems were to “unregister”

portfolio students.

• Before distributing materials to teachers,

make sure all portfolio students have been

removed.

Pre-ID Answer DocumentsPre-ID Answer Documents

Page 50: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Place unused pre-

ID answer

documents under

this form and return

to the state in the

brown boxes:

• Portfolio students

• Students who

have moved

Page 51: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Other fields need to be bubbled if

they have NOT been uploaded to

PearsonAccess by March 19, 2010

(e.g., accommodations, SPED hrs,

ELL, ELL Excluded, Title I).

Achievement Pre-ID ProcessAchievement Pre-ID Process

Page 52: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Absent bubble

• Do not bubble if the student takes any

part of the test.

Version bubble

• Cannot be uploaded; must be

completed on the answer document

Important ACH BubblesImportant ACH Bubbles

Page 53: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Student Demographic Data Verification

(SDDV).

• Window to be announced via listserv

message.

• After SDDV, defaults will be applied

when required fields are left blank (e.g.,

Membership, Code A & B).

• First in/First out.

PearsonAccess SDDV WindowPearsonAccess SDDV Window

Page 54: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Friday March 26, 2010

7:30 – 9:30 CST

10:00 – 12:00 CST

1:30-3:30 CST

Monday March 29, 2010

7:30 – 9:30 CST

10:00 – 12:00 CST

1:30-3:30 CST

PearsonAccess SDDV PearsonAccess SDDV Live WebinarsLive Webinars

Page 55: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Recorded webinar available by March 19,

2010.

• You may not need to participate in live

webinars if you view the recorded

webinar.

• Live webinars will include question and

answers via “chat” feature.

PearsonAccess SDDV WebinarPearsonAccess SDDV Webinar

Page 56: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• View Student Demographic Data• View Reports• Support & FAQs• Training webinars• Dynamic Rostering (re-rostering)• EDvantage TN

Reminder:

Class selection in PearsonAccess is for packaging only (not FSD).

Improved PearsonAccessImproved PearsonAccess (PEMSolutions) (PEMSolutions)

Page 57: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Helpdesk number: 888/817-8658• Unlock Account• Upload Assistance• SDDV Help• Do not call the help desk to set up new

users.• STCs must assign users (system & school)• State must assign STCs

PearsonAccess HelpdeskPearsonAccess Helpdesk (PEMSolutions)(PEMSolutions)

Page 58: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Improved PearsonAccessImproved PearsonAccesswww.pearsonaccess.comwww.pearsonaccess.com

Select TN from the pull down menu.

Page 59: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Improved PearsonAccessImproved PearsonAccesswww.pearsonaccess.comwww.pearsonaccess.com

Page 60: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

RANDARANDAhttps://tdoe.randasolutions.comhttps://tdoe.randasolutions.com

Page 61: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Improved PearsonAccessImproved PearsonAccesswww.pearsonaccess.comwww.pearsonaccess.com

Page 62: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

One Step Removal • It’s now easier to remove students from your list of

registered students. • You will not have to remove the student’s test

assignment, remove their class, and then unregister the student.

• You will now be able to do these three steps with ONE click.

PearsonAccess ImprovementsPearsonAccess Improvements

One Test Assignment per student • This year, each student will be assigned ONE test

instead of four. • One test assignment will reduce work throughout the

entire process.

Page 63: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Header included with Reverse SDU File

• This year when you request a registration file

to make student demographic updates, your

file will include the header row in Row 1.

NEW Student Wizard

• When adding a new student to

PearsonAccess, the Student Wizard will walk

you through the steps, screen by screen.

PearsonAccess ImprovementsPearsonAccess Improvements

Page 64: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Organization Tab • Organization information has been moved to the front on

its own tab. • You will be able to easily access your organization

information and update contact information for report delivery.

PearsonAccess ImprovementsPearsonAccess Improvements

Planned for SDDV

Alerts vs. Warnings •Both alerts and warnings will require your attention; alerts will affect your AYP reporting if not corrected.

•Warnings will also need attention

•Your alerts and warnings will be more descriptive.

Page 65: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

All Data Errors listed• If you have a student that is in alert or warning status, you will see a list of data errors for quick resolution.

One test/One resolution•Since students will have just one test assignment in 2010 (rather than four), you will have a single resolution on an alert or warning rather than FOUR!

Pearson Access Improvements Pearson Access Improvements Planned for SDDVPlanned for SDDV

Page 66: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Pearson Access SupportPearson Access Support

Page 67: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

New Cut ScoresNew Cut Scores

• Cut scores will not be available until after

testing

• Standards Setting to be held in late June

2010

• Committees will recommend cuts

• The State Board of Education will have to

approve the cut scores

• Delayed Reporting (Fall 2010?)

Page 68: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Standards SettingStandards SettingCommitteesCommittees

Panels of educators & other stakeholders

•Math, Reading/Language Arts, & Science

•Teachers (grade/content specialists)

•Principals

•Supervisors

•Directors of Schools

Page 69: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Beginning with the 2009-2010 school year, the TCAP results will be reported based on these four

achievement levels for RLA, Math, & Science

New Achievement LevelsNew Achievement LevelsNot S

S

Page 70: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

•Available for Spring 2010 Achievement

Test

•Separate Reading Composite Score

Provided (FYI only)

•Separate Language Arts Composite

Score Provided (FYI)

•The Reading/Language Arts Scale

Score will still be the “reported” score

New Composite ScoresNew Composite Scores

Page 71: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

End of CourseEnd of Course Assessments Assessments

The “NEW” High School Transition Policy requires students to be assessed in the following end of course assessments:

Algebra I, Biology I, English I,

English II, and US History

Future Assessments:

Algebra II, English III, Geometry Chemistry, and Physics

Page 72: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

End of Course AssessmentsEnd of Course Assessments

• 2009-10 and thereafter… – Student examination requirement based on

curriculum…– The “new” curriculum with “new” instruction requires a

“new” assessment for all students in the class.• All students enrolled in Alg I, Eng II, and Bio I

classes will take the new EOC tests in 2009-10. This is regardless of grade and graduation requirement differences.

Page 73: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Entering Freshmen 2008-09 and before…• Curriculum drives instruction, test aligned to

curriculum “old” curriculum – “old” test (GWY/EOC)

• GWY/EOC test as % of student grade and must pass the three GWY assessments as additional diploma requirement

Entering Freshmen 2009-10 and thereafter…

• Curriculum drives instruction, test aligned to curriculum “new” curriculum and instruction – “new” test (EOC)

• “new” EOC test as % of student grade• No additional assessment diploma

requirement (No GWY)

GatewayGateway

NOT NOT

GatewayGateway

End of Course AssessmentsEnd of Course Assessments

Page 74: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

End of Course Assessments: End of Course Assessments: Curriculum/ClassCurriculum/Class

2009-10 English II, Algebra I, Biology I classes (enrolled for credit)

New Curriculum Standards and New EOC assessment

Mix of 9th, 10th, 11th, and 12th grade students Mix of graduation requirements: 9th new EOC,

*9th – 12th old GWY• All take the new EOC tests• All (9-12) assigned EOC grade to be used

in course %• *9th – 12th must have additional Met/Not Met

diploma information

*Entering 9th grade in or prior to 2008-09 school year

Which Which

Test Do Test Do

They They

Take?Take?

End of End of

CourseCourse

Page 75: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

End of Course AssessmentsEnd of Course Assessments

AYP EOC Assessments (administered during set window)

Spring 2010: May 4-7

– Algebra I

– English II– Biology I (55 items, untimed)

EOC Assessments (administered last 10 days of instruction)

– English I • (55 items, timed)

– US History (unchanged)

• (50 items, timed)

Page 76: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

2009-10 End of Course 2009-10 End of Course AssessmentsAssessments

• Quick Score Reporting Continues: Numeric grade, Met/Not Met Diploma Requirement – No Performance Levels in Fall or Spring– Performance Levels will be established during the June

2010 Standard Setting• ELSA – ELL simplified language form (Operational Fall 2010)• 2%: MAAS (Field Test Spring 2011 or later)• Future Assessments

– Algebra II – Field Test Spring 2010– English III – Field Test Spring 2011– Geometry, Chemistry, Physics

Page 77: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Algebra II Field TestAlgebra II Field Test

All students currently enrolled in Algebra II must participate in the field test.

Modified Versions: Only Large Print will be available for the field test; there will be no Braille version.

Test Administration Date:

May 2010 Operational: Fall 2010

Page 78: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

• Mathematics

• Language Arts

• Science

There are three administrations per year: Fall, Spring, and Summer

Gateway AssessmentsGateway Assessments

Page 79: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Gateway…2009 and thereafterGateway…2009 and thereafter

Gateway Diploma Requirement – Gateway Math, Language Arts, Science

• For students entering high school 2008-09 and before not enrolled and have earned course credit in Algebra I, English II, and Biology I but still need to pass the Gateway test to meet their “diploma” requirement…

Page 80: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Gateway Diploma Requirement – Gateway Math, Language Arts, Science

• Interventions still required• May retake this assessment as many times as

necessary• Testing now online (required)

– Quick Score: Met/Not Met Diploma

Requirement – Individual Student Report

Gateway…2009 and thereafterGateway…2009 and thereafter

Page 81: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Gateway Online TestingGateway Online Testing

• Beginning Spring 2010

• Gateway Online Testing is NOT optional.

• Gateway Online Testing Administration Window:

April 27-May 21, 2010

• Gateway Modified Tests (Large Print and Braille) must still be administered via paper/pencil (Window: May 4-7, 2010)

• Gateway Online Testing will feature options for Special Education testers, including the read aloud accommodation.

• Webinars and demos will be available in the weeks to come.

Page 82: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Gateway and End of Course Gateway and End of Course AssessmentsAssessments

• Gateway– untimed but must be completed within the same day

• AYP End of Course – untimed but must be completed within the same day

• End of Course– timed and must be completed within the same day

Currently, results of both AYP End of Course and End of Course assessments must count 20% of the second semester course grade.

Page 83: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Ordering Tests

• Tests must be ordered for each school via an order entry system.

• The on-line orders activate and populate all other databases.

• After Wednesday, February 10, 2010, email late orders to [email protected].

• Notify Assessment when a test is used for a school without a test order.

Gateway and End of Course Gateway and End of Course AssessmentsAssessments

Page 84: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Preparing for Testing

• The answer document is the beginning of all student data resulting from the test, so accuracy is of the utmost importance.

• The EOC answer document has been revised.

Gateway and End of Course Gateway and End of Course AssessmentsAssessments

Page 85: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

End of Course AssessmentsEnd of Course AssessmentsAnswer DocumentAnswer Document

Page 86: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

End of Course AssessmentsEnd of Course AssessmentsAnswer Document Changes

Unique Student ID: EIS-Generated Unique Student IDs will be captured; Social Security Numbers will no longer be recorded. Private entities will not have EIS-generated numbers.

Testing Status: First Time Taker or Repeat Taker Only

First Time Taker = Enrolled in Course for the First Time Instructional Availability: Options have been further delineated.A1 Bubble: The A1 bubble will be used to identify EOC testers for

whom a passing score will be used to satisfy the Gateway diploma requirement (only pertinent to students who entered high school prior to the 2009-10 school year). The A1 bubble will enable the reporting of met/not met status.

Title I Section: Poverty levels will no longer be captured. Title I TAS (Direct Service) has been deleted.

Page 87: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Gateway and End of Course Gateway and End of Course AssessmentsAssessments

Group Information Sheet

• The Group Information Sheet (GIS) is a scannable form which identifies a set of answer documents by system, school, and teacher name.

• The teacher licensure number will be collected.

• One GIS must be used for each teacher per class. (Class PERIOD must be coded.)

RETESTER

Page 88: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Test Administration ManualTest Administration Manual

The Test Administration Manual (TAM) contains sample forms and instructions pertaining to ordering tests, preparing scannable documents, administering the tests, preparing materials for test processing, and preparing to return test materials.

There will be a separate TAM for Gateway Online Testing.

Gateway and End of Course Gateway and End of Course AssessmentsAssessments

Page 89: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

After Testing

• Answer documents must be taken to the Field Service Center in that region for scanning.

• Prior to scanning, an appointment date and time must be scheduled.

• A student roster with ID numbers and a list of verified absences should be taken to the scan site.

Gateway and End of Course Gateway and End of Course AssessmentsAssessments

Page 90: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Release of Quick Scores

Prior to the release/posting of Quick Scores, two on-line procedures must be completed.

• Student Group List (SGL)– Teacher name and number of students

• Report of Irregularity (RI)– Must be completed even when no irregularities

took place.

Gateway and End of Course Gateway and End of Course AssessmentsAssessments

Page 91: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Medical Exemption Requests

• If an exemption is being requested for medical reasons, it must be entered via the RI, with hard copies of medical documentation to be sent to the Office of Assessment.

• Be sure to complete and scan an answer doc (bubbled absent) for each of these students.

End of Course AssessmentsEnd of Course Assessments

NOT NOT

GatewayGateway

Page 92: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Adequate Yearly Progress

Demographic Review

• An AYP form must be completed for each system, verifying that there were or were not any irregularities during that test administration.

• This form may be faxed or mailed.

End of Course AssessmentsEnd of Course Assessments

NOT NOT

GatewayGateway

Page 93: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Student Demographic Data Verification (SDDV)Student Demographic Data Verification (SDDV)• Some time after testing, systems will go

online and make a preliminary examination of the scanned student demographic data and make corrections.

• There is a specified window for this verification process.

End of Course AssessmentsEnd of Course Assessments

NOT NOT

GatewayGateway

Faculty Student DataFaculty Student Data• A bit later, systems (teachers) will be required to

again go online and claim their students to generate teacher effect. This, too, must be done within a specified process.

Page 94: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Item Item Samplers and Samplers and

Practice Practice Tests now Tests now availableavailable

End of Course AssessmentsEnd of Course Assessments

http://www.state.tn.us/education/assessment/sec_samplers.shtmlhttp://www.state.tn.us/education/assessment/sec_samplers.shtml

Page 95: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Secondary Diagnostic Secondary Diagnostic AssessmentsAssessments

• Enabling legislation enacted May 2007

• Public Chapter No. 273:– SECTION 1. Tennessee Code Annotated, Section 49-

6-6001(b), is amended by deleting the existing language and by substituting instead the following:

• As a strategy for assessing student readiness to enter and succeed in postsecondary training, every public school student shall take a series of three (3) examinations, one (1) administered at grade eight (8), one (1) administered at grade ten (10), and one (1) at grade eleven (11). These assessments shall be approved by the Commissioner of Education and provide educators with diagnostic information to assist in developing interventions for the purpose of increasing high school graduation rates and improving student preparation for postsecondary achievement. Each year, the results of such examinations shall be analyzed and reported by the Commissioner of Education to the Select Oversight Committee on Education.

– SECTION 2. This act shall take effect July 1, 2007, the public welfare requiring it.

Page 96: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACT or College Board ProductsACT or College Board Products

ACT – EPAS–ACT - 11th Grade–PLAN - 10th Grade–Explore - 8th Grade

College Board–SAT - 11th Grade–PSAT – 8th /10th Grade

Page 97: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Benefits ofBenefits of WeekdayWeekday TestTest Administration Administration

• Awareness and Exposure among all students

• Students will test in a familiar environment

• High Schools and Districts will receive comprehensive reporting

• Provides the opportunity for students to test with ACT-Approved and State-Allowed Accommodations

Page 98: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACT for Tennessee Statewide TestACT for Tennessee Statewide Test

• Weekday ACT Assessment is invoiced directly to LEAs in Mid June.

• BEP Formula funds are allocated for ACT Administration.

• Cost incurred above the BEP Formula allocation are reimbursable as defined by the TN ACT Reimbursement protocol.

Page 99: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACT Explore/Plan for Tennessee ACT Explore/Plan for Tennessee

• LEA is invoiced by ACT

• LEA pays ACT for the number of students assessed.

• LEA sends proof of payment and student roster to TDOE in Assessment and Evaluation

• LEA is reimbursed by TDOE

Page 100: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACT College Reportable ScoresACT College Reportable Scores• Students testing Standard Time or with ACT-

Approved Accommodations will receive college reportable scores 3-7 weeks following statewide test admin.

• Scores to be sent to 4 colleges or scholarship agencies at no cost to the student.

• College Reportable Scores available online 1-2 months after test date

Page 101: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACT Tennessee Statewide Test

Tuesday, March 9, 2011

Make-Up Tuesday, March 23, 2011

http://www.act.org/aap/tennesseehttp://www.act.org/aap/tennessee

2009-2010 School Year2009-2010 School Year

Page 102: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Step 4: Materials ShippedStep 4: Materials Shipped

• Test Supervisor will provide ACT with enrollment numbers and shipping information

• Pretest materials are shipped 5 weeks prior to test date to Test Supervisor

• Test materials will arrive one week prior to test date

• Accommodations materials will be sent to Test Accommodations Coordinator

Page 103: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Step 5: Test AdministrationStep 5: Test Administration• Schools conduct pretest session prior to test

day (Early February- March 8)• Test Date - March 9, 2010

Make-Up Date – March 23, 2010• ACT customer service will be available

extended hours to answer questions during the test administration

Step 6: Materials ReturnedStep 6: Materials Returned• ACT will arrange for prepaid pick-up of test

materials following the assessment. Schools do not need to arrange for shipping.

Page 104: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ReportingReporting

• Student Score Report• High School Profile Report• College Readiness Standards Report• District High School Profile Report• District College Readiness• District Student Data File

Page 105: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

ACT

Tennessee Statewide TestTuesday, March 15, 2011

Make-Up Tuesday, March 29, 2011

http://www.act.org/aap/tennesseehttp://www.act.org/aap/tennessee

2010-2011 School Year2010-2011 School Year

Page 106: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Step 1: Establishment ProcessStep 1: Establishment Process: Establishing your school as a test site for the

March 15, Make up March 29, 2011 test administration

TimelineEarly – Mid August Establishment Packets sent to

school principals

September Establishment Packets due back to ACT

October

Test Accommodations Information packet and Accommodation forms mailed to Test Accommodations Coordinator

http://www.act.org/aap/tennessee/files/ChecklistDates-StandardTimeTesting.pdf

Page 107: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Step 1: Establishment ProcessStep 1: Establishment ProcessSchool Administration Responsibilities

Principal or designee must… Consider staffing requirements and select staff to

serve as a Test Supervisor (TS), Back-Up Test Supervisor (BU), and Test Accommodations Coordinator (TAC)

Complete and return Establishment Packet Share information in Establishment Packets with

assigned staff Beginning planning for testing rooms/facilities with

Test Supervisor

http://www.act.org/aap/tennessee/

Page 108: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Step 2: Training WorkshopsStep 2: Training Workshops• All newly appointed Test Supervisors, Back-up

Test Supervisors and Test Accommodations Coordinators are required to attend a half day training workshop.

• Require one person (TS or BU) to re-attend. • The workshop address standard testing

requirements and the test administration/ test accommodations process.

http://www.act.org/aap/tennessee/

Page 109: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Step 2: Training WorkshopsStep 2: Training Workshops

Appointed staff will sign-up for a workshop online early October

http://www.act.org/aap/tennessee/files/WorkshopInvitation.pdf

Workshops conducted Mid November

Page 110: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Step 3: Request Step 3: Request AccommodationsAccommodations

• ACT-Approved Accommodations available

• A DVD provided for the Test Accommodations Coordinator

• Accommodations procedures and request forms to be mailed to schools in late fall

http://www.act.org/aap/tennessee/files/FAQ-AccommTesting.pdf

Page 111: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Questions About ACT for Tennessee Questions About ACT for Tennessee Statewide Test:Statewide Test:

TDOE: 615-741-0720

[email protected] or [email protected]

ACT: March 2010 Administration

http://www.act.org/aap/tennessee

ACT: General Information

800-553-6244 ext. 2800

[email protected]

[email protected]

Page 112: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Student Demographic Data Student Demographic Data VerificationVerification

2010 Writing Assessment SDDV

March 12th to March 25th

Measurement with send notification to Testing Coordinators via e-mail.

Page 113: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

A New Feature for the 2010 A New Feature for the 2010 Writing AssessmentWriting Assessment

• On-line reporting will be offered through Measurement Incorporated this year.

• Systems will receive one paper Individual Student Report and a cumulative record label in the spring. All other reporting will be on-line.

• Systems will not receive any CD reports from Measurement this year.

Page 114: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Fall ActivitiesFall Activities

• The Writing Assessment will pilot new prompts in the fall of 2010.

• The new Constructed Response Test is scheduled to be piloted in the fall of 2010. This test is being designed for use in the third and seventh grades.

Page 115: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

PortfolioPortfolio

• SDDV window is open March -12– Email sent to STC

• 2010-2011 Updates– Check Testing and Evaluation Sitehttp://state.tn.us/education/assessment/alt_PA.shtml

– Will need contact information for all System Portfolio Coordinators

• Name, Email Address, Phone Number• If STC also needs information, please include

Page 116: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

MAASMAAS• Eligibility

– Grade Level Standards IEP– IEP team decision based on multiple data sources

• Accommodations – Same as Ach.

• Practice Tests/Item Samplers• 2% Cap

– System level number based on total tested Gr.3-8– Just a limit on number of proficient scores to be

counted for AYP– Not a limit on number assessed

http://state.tn.us/education/assessment/alt_MAAS.shtml

Page 117: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Achievement Grades 3-8Achievement Grades 3-8• Answer document reminders:

– MAAS/Ach• Student assessed in both Ach. and MAAS will

have two answer documents– Accommodations

• Are now content area specific in EasyIEP• If an accommodation is used in any content

areas, bubble accommodation on answer doc• If Accommodation F is bubbled, need tape sent

Page 118: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

End of CourseEnd of Course• Developing three EOC modified assessments

– Algebra I– Biology I– English II

• All three will be field tested Spring 2011• Field Test Algebra II

– Spring 2010– Large Print will be included and available for

Fall 2010– Braille will not be included or available until

Spring 2011

Page 119: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

AccommodationsAccommodations

• Consult site for more informationhttp://state.tn.us/education/assessment/accommodations.shtml

• Allowable Accommodations– Based on individual student need

• Special Accommodations– Based on individual student need and listed in IEP– Not all Extended Time is created equal– Read Aloud teachers need content area vocabulary

knowledge– Unique Adaptive Accommodation Request Form

• Please email Lori Nixon prior to sending this form

Page 120: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Special Education Special Education AccommodationsAccommodations

Accommodation C: Mathematics Table/Calculators–If system allows use, do not code Accommodation C.–Achievement/MAAS: Mathematics Tables are Addition, Subtraction, Multiplication, Division

–End of Course: Mathematics Tables are Addition, Subtraction, Multiplication, Division, and Square Root Chart

Square Root Chart may be downloaded from

http://www.state.tn.us/education/assessment/secondary.shtml

Page 121: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Who takes the ELDA?Who takes the ELDA?

ALL ELL students grades K-12 are mandated by the federal government to take the ELDA. T1 and T2 students do Not take ELDA.

Page 122: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Tennessee ELDA 2010Tennessee ELDA 2010Important Test DatesImportant Test Dates

ELDA will start arriving as early as January 8th and no later than January 25th

Monday February 1 – ELDA testing window begins (Grades K-12)

Friday March 12 – ELDA testing window ends (Grades K-12)

March 19 – All materials must be picked up by Fed Ex and returned to Measurement Incorporated using the supplied shipping labels

May 31 – Assessment results back to districts and TN DOE.

September 30 – Deadline for contacting the ELDA Helpline with any reporting errors or missing reports.

Page 123: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

https://tdoe.randasolutions.com

RANDA SolutionsRANDA Solutions

Page 124: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Contact InformationContact Information

• Contact lists• Shipping

information

for your system and its schools

Page 125: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

User Management > Add New UserUser Management > Add New User

• Set Primary Roles• Customize Permissions

Page 126: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

CalendarCalendar

• Modify system testing dates

Page 127: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Processing > SGLProcessing > SGL

““Session Number” column added for Session Number” column added for Achievement assessmentAchievement assessment

Page 128: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Processing > RIProcessing > RI

Breach of Security and Medical Exemption Request Forms should be completed online.

Page 129: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Faculty/StudentFaculty/Student

• TDOE strongly encourages schools/systems to have teachers do their own claiming in FSD

• School Admin and STCs should verify accuracy of claimed students

• Help Manuals will be provided for Teacher Claiming

Page 130: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Faculty/StudentFaculty/Student

A new look for the Claiming section

Page 131: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Faculty/StudentFaculty/Student

A new look for the Claiming section

Page 132: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

To Give a Teacher Log In To Give a Teacher Log In Access for Claiming:Access for Claiming:•If a Group Information Sheet has been turned in for a teacher, they will have already been assigned a Login Name and Password.

•School Admin or Building Test Coordinator MUST click on “Login Enabled” check box to ensure that the teacher can access the website.

•Double check Teacher Licensure # for accuracy.

•Primary Role should be “Teacher (Can Claim)”

•You must do this for each teacher who will be claiming students at your school.

Page 133: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

Need Help?Need Help?

• New help manuals and webinars posted

Page 134: 2010 Spring Regional Meeting Office of Assessment, Evaluation, and Research.

2010 Spring Regional 2010 Spring Regional WebinarWebinar

Thursday, March 11 at Thursday, March 11 at 12:30 PM CST12:30 PM CST