2011 Spring TCAP Training

Jefferson County Public Schools

1

Test Security Law

T.C.A. 49-1-607 states:

Any person found not to have followed security guidelines…

immediate suspensiongrounds for dismissal, including

tenured employees revocation of state license

2

Acknowledgement of Test Security

Policy

For school/system use

All personnel involved in the testing process must be trained. Training documentation should be retained for system records

3

www.state.tn.us/education/assessment/tseoctoolresource.shtml

AER Website on Tools & Resources page

TN Test Security All test materials must be secured before

and after the test administration. Test materials should be stored in a locked

room that is inaccessible to unauthorized persons.

Handling of test materials must be restricted to authorized personnel at all times.

Return test materials immediately after each test session.

4

Test AuditsState Test Security

Measure: Conduct random

visits during testing to ensure test security and consistency of administration.

Random audits may take place during any test administration.

Test auditors show up unannounced. 5

Test MaterialsQuantity

Verification All test materials must be kept secure by implementing check-in, check-out and quantity verification procedures for all test materials at the system level, at the school level, and for each test session.

6

www.state.tn.us/education/assessment/tseoctoolresource.shtml

AER Website on Tools & Resources page

TN Test Security

Standard copyright laws must be maintained at all times.

Test items may not be reproduced or distributed in any way, for any reason, by any person.

Test content may not be paraphrased for use directly in instructional activities, study guides, or classroom resources.

7

TN Test Security

Test materials should not be read, reviewed, or analyzed before, during, or after test administration unless indicated in test instructions or special accommodations.

Discussion of test content or specific test items with students, parents, or professional colleagues is prohibited to protect the validity of the test.

8

TN Test Security

A secure environment must be ensured during testing.

Turn off all communication devices during each test session.

Maintain confidentiality of student specific accountability demographic information and test results at all times.

9

Secure Testing Environment

Any information regarding the content being measured on the test must be concealed during the test administration. Including but not limited to the following:

10

•Maps •Charts•Posters •Student Work •Bulletin Board Items•Writing Formulas •Word Lists

•Parts of Speech•Graphic Organizers•Number Lines•Definitions•Word Walls•Displays•Models

TN Test Security

Carefully adhere to all test directions and accommodation instructions.

Make sure all students receive the correct test materials.

Follow all time limits outlined in the test directions.

Follow all schedules set by the school/system. Remain with students and be observant and

non-disruptive throughout the testing session.

11

TN Test Security

Ensure that students respond to test without assistance from anyone.

Test administrators must ensure appropriate monitoring that does not include coaching or illegal assistance.

Test administrators must not read test items or passages to students unless indicated in instructions or accommodations.

12

Breach of Testing Security Report

13

Immediately report any test

security concerns to

building/system testing

coordinator.

Any breach must b

e

completed as a

Report of

Irregularity

online.

Questions???

*Use of proctors*Please have materials back to central office

as quickly as possible so that we may get them sent in on time.

14

Pearson ReportingLogistics and PrintingPearsonAccess

ETSWrite custom TN items (grades 3-8)

SASTVAAS, Teacher Effect, & Percentiles

ASSESSMENT VENDORS

RANDAOrder Entry & CommunicationReports of Irregularity (RIs)School Group Lists (SGLs)Claiming in FSDSystem Contact information

ASSESSMENT VENDORS

SPRING 2011ACHIEVEMENT REPORTS

New Quick Score Reports

In RANDA

Part of Faculty/Student Data

Will be able to review after students assigned to Teacher Roster

SPRING 2011 ACHIEVEMENTREPORTS POSTED ON

PEARSONACCESS

• IPRs & Labels

• System & School Summary Reports

• System Student Data files

PEARSONACCESS 2010-11

SAT 10 (K-2)

Achievement (3-8)

Gateway

EOC

http://www.pearsonaccess.com/tn

PEARSONACCESS 2010-11

Be sure to check out these features now available:

Dynamic Rostering EDvantage TN

http://www.pearsonaccess.com/tn

PearsonAccess SPECIAL FEATURES

Select Assessment

PearsonAccess SPECIAL FEATURES

Page 2- Edvantage User Guide

Page 1- Dynamic Rostering

PearsonAccess 2010-11

Help desk number: (888) 817-8658

Unlock Account & Upload Assistance

Do not call the help desk to set up new users.

STCs must assign users (system & school)

State assigns STCs (if it can’t be done in the school system)

NEW CUT SCORES SPRING 2011

RCPI cut scores and number of items per Reporting Category will be available after testing

New policy decision for 2011

ACHIEVEMENT LEVELS

Note: Not used for Social Studies which still retains Advanced, Proficient, and Below Proficient

TEST OPTIONS FOR SPRING 2011

Achievement Test (ACH)

Modified Academic Achievement Standards (MAAS)

English Linguistically Simplified Assessment (ELSA)

ELSA

AYP for ELL studentsSimplified languageT1 & T2 students cannot take ELSASame ELL accommodations Must take all ELSA subtestsCannot mix ACH & ELSACannot mix ACH & MAAS

ALTERNATIVE SCHOOL STUDENTS

Order materials from remanding schoolMust be coded back to the remanding school.Send answer documents back with those from remanding school.Systems/schools will not be able to complete an SGL for Alternative School Students.

LATE ACHIEVEMENT ORDERS

Double check your Braille and LP orders immediately!

PRE-ID ANSWER DOCUMENTS AND TAG FORMS

Immediately check answer documents and TAG forms to see if quantities are sufficient.Check for:

Grade level change New students- USID

Maximum 49

Bubble on Answer Doc

Select Test

TAG FORM: FORMERLY

KNOWN AS GIS

TAG: TEST ADMINISTRATION GROUP

REVISED ANSWER DOCUMENT

From TAG Header

From TAGHeader

Dark Headings not

uploaded by state

REVISED ANSWER DOCUMENT

Instructional Availability

Pre-ID Barcode area

Instructional Availability

PREID LABELS

Do NOT bubble the following on Pre-ID Answer Documents:+Name +DOB +Ethnicity+USID +Gender

PRE-ID IN PEARSONACCESS

Upload Student Demographic Data from EIS:

Last name, First nameStudent USID numberDOBGenderEthnicityGrade

www.pearsonaccess.com/tn

INSTRUCTIONAL AVAILABILITY

For Traditional schedules, select from among the following:

150 days or more 75-149 days 74 days or fewer

For Modified schedules, select from among the following:

75 days or more 38-74 days 37 days or fewer

REVISED ANSWER DOCUMENT

Teachers bubble their license numbers and select the content area(s) they teach.

If already uploaded, message will cover grids.

TEACHER LICENSE NUMBERS

www.k-12.state.tn.us/tcertinf

Use “new” number from the look-up site. It is not the Social Security Number!

2011 ACH TESTING WINDOW

April 11-April 22, 2011 April 22, 2011 is Good FridaySystems select no more than 6 consecutive school daysSystems do not have to use 6 daysSpring Break can not interrupt the test window

2011 ACH TESTING WINDOW

All schools within a system must follow the system testing windowAll students in a grade level within a school must adhere to same test schedule (EXCEPTIONS: SPED, ELL, make-up)ELL and SPED students may not be tested outside the system/state testing window

White boxes MUST be in warehouse within 3 week days after testing is complete, April 27 is last possible day

2011 ACH TESTING WINDOW

All students in grades 3 –8 must adhere to the following test schedule:

Day 1 –Reading/Lang. Arts (Parts 1 & 2)Day 2 –Mathematics (Parts 1 & 2)Day 3 –Science (Parts 1 & 2)Day 4 –Social Studies (Parts 1 & 2)

Exceptions: SPED, ELL, & make-up testing

2011 ACH TESTING WINDOW

NEW ACH LAW

Beginning with 2011-2012, ACH testing shall begin no earlier than the first Monday occurring on or after April 22Testing window for 2011-2012 to April 23 –May 4, 2012Law can be found at: http://state.tn.us/sos/acts/106/pub/pc1127.pdf

ACH tests shall not be administered prior to the completion of one hundred fifty (150) days of instruction.

LEAs with schools beginning on the second Monday in August or before shall test during the first week of the testing window.

NEW ACH LAW

Each local board of education shall develop a policy by which student scores on the ACH tests (grades 3-8) comprise a percentage of the student's final grade for the spring semester in the subject areas of mathematics, reading/language arts, science, and social studies.

The percentage shall be determined by the local board from a range of no less than 15% and no more than 25%. The policy shall utilize performance levels determined by the State Board of Education and be developed and implemented for the spring semester of 2011.

NEW ACH LAW

PLANS FOR QUICK SCORES SPRING 2011

Quick Scores:SGLs and RIs must be completed before releaseReleased before SDDV clean upWill not be released if there are duplicates or other issuesWill feature the achievement levelWill not have score to use as grade until Spring 2012

HAND SCORE REQUESTS

Hand scoring requests will only be considered for extraordinary circumstances.Must have a reason (other than a lower score than previous years) for requesting hand score.

SAT 10 (K-2)

Systems must order directly from Pearson (not on RANDA)Uploads to PearsonAccess for SAT 10SAT 10 Reports will still be in PearsonAccessDelivery of tests and reports will come directly from PearsonDirect all questions about SAT 10 (K-2) to:Vicki Gray, Pearson SAT 10 Consultant

Phone:501.332.8476 Vicki.gray@pearson.com

Secondary Diagnostic Assessments

Spring 2011

Regional Training

March 7-18

49

50

Secondary Diagnostic Assessments

• Enabling legislation enacted May 2007

• Public Chapter No. 273:– SECTION 1. Tennessee Code Annotated, Section 49-6-

6001(b), is amended by deleting the existing language and by substituting instead the following:

• As a strategy for assessing student readiness to enter and succeed in postsecondary training, every public school student shall take a series of three (3) examinations, one (1) administered at grade eight (8), one (1) administered at grade ten (10), and one (1) at grade eleven (11). These assessments shall be approved by the Commissioner of Education and provide educators with diagnostic information to assist in developing interventions for the purpose of increasing high school graduation rates and improving student preparation for postsecondary achievement. Each year, the results of such examinations shall be analyzed and reported by the Commissioner of Education to the Select Oversight Committee on Education.

– SECTION 2. This act shall take effect July 1, 2007, the public welfare requiring it.

51

Diagnostic Assessment Products

ACT – EPAS– ACT - 11th Grade– PLAN - 10th Grade– Explore - 8th Grade

College Board– SAT - 11th Grade– PSAT – 10th Grade– New Fall 2011- Readi Steps - 8th Grade

ACT Explore/Plan for Tennessee

2011 Testing Window

September 19 – November 11, 2011

52

ACT Explore/Plan for Tennessee Testing

• Testing of students does not have to be simultaneous throughout the system.

• Students may test at different times, by grade sections, etc.

• All testing must occur during the testing window.

53

ACT Explore/Plan for Tennessee

Future Testing Windows

2011 September 19 – November 11

2012 September 17 – November 9

54

College Board Fall 2011

55

New Diagnostic Products

ReadiStep is an established, valid, reliable and norm-referenced preliminary college preparation assessment instrument for eighth grade students for the purpose of diagnosing the academic strengths and deficiencies of students before entrance into high school.

Secondary Assessments

56

End-of-Course (EOC) Assessments Algebra I Biology I English II

ELSA* Algebra I (NEW) ELSA English II (NEW)

U.S. History English I Algebra II (NEW)

*English Linguistically Simplified Assessment

English III Field Test (Pilot)

o Administration Date: Tuesday, May 10 (no make-up date)o Administered only to students enrolled in English III at the time

of the field testo Materials shipped directly to public systems from Pearsono Test administration manual to be included in shipmento Not possible to pre-code/pre-slug the English III answer

documentso 12 Versions, 65 Itemso Available in large print but not brailleo Practice test and item sampler available September 2011 o Operational December 2011o Braille version available Spring 2012

58

ELSA EligibilityThe ELSA Algebra I and ELSA English II exams areappropriate for students who are eligible for English as aSecond Language (ESL) services. ELSA testers must be enrolled in Algebra I or English II.

Ineligible Students:o T1 or T2 Students o Students who have transitioned out of an ESL program

ELL Contact: Steven Nixon

ELL Assessment Consultantsteven.nixon@tn.gov

Characteristics of ELSA ExamsLanguage for an ELSA test item is simplified to assist in measuring the intended knowledge or skill; however, the knowledge or skill is NOT simplified.

Uses high-frequency (common) words Reduces wordiness Avoids words with multiple meanings Uses concrete words, not abstract Reduces complexity of sentence structure Uses the simplest verb forms Uses a context that is no more complex than required

*EOC ELSA exams are not available in large print or Braille.

Sample ELSA Algebra I Item

Gateway or AYP/EOC?

Gateway• Entered high school prior

to the 2009-10 school year

• Previously earned a credit in Algebra I, Biology I, or English II

AYP/EOC

Enrolled in Algebra I, Biology I, or English II

(Regardless of grade level or graduation requirements, a student must be administered the AYP/EOC exam if enrolled in an AYP/EOC class.)

Enrolled=EOC

Transition Scenarios

63

AYP/EOCs

AYP/EOCo Algebra I/ELSAo English II/ELSAo Biology I

(55 Operational Items, 10 Field Test Items, Untimed)

EOCo English Io Algebra II(55 Operational Items, 10 Field Test Items, Untimed)

o U.S. History(50 operational Items, 10 Field Test Items, Untimed)

EOC Exam Scores

The end-of-course test grade will count 20% of the

second semester grade for the 2009-2010 and

2010 -2011 school years and 25% of the second

semester grade in subsequent school years.

EOC Testing for AP and IB Students

A student enrolled in an Advanced Placement (AP) or International

Baccalaureate (IB) section of a course with a state end-of-course

(EOC) exam should be administered the state exam only if the

student did NOT take the state exam while enrolled in a

prerequisite course. For example, if a student did not earn a credit

in a standard US History course prior to enrolling in AP US

History, he or she would be required to take the state US History

EOC exam upon completing the AP US History course.

The purpose of this guidance is to ensure a student enrolled in an

AP or IB course is not administered a corresponding state EOC

exam twice. A student should only retake a state EOC exam if he

or she failed a course with a state EOC exam and is re-enrolled in

the course. 66

Alternative Performance-Based Assessment Rubric

The Alternative Performance-Based Assessment (APBA) Rubric may be used for any SPED student enrolled in an EOC class. The rubric may only be used to assist the student in passing the class; points may NOT be added to the student’s assessment score for the purpose of meeting the Gateway diploma requirement.

SPED Contact:Lori Nixon

Special Education Assessment Consultantlori.nixon@tn.gov

Spring 2011 Test Administration Dates

AYP/EOC and Paper-Pencil GatewayAlgebra I/ELSA- May 3English II/ELSA- May 4 Biology I- May 5Make-up Testing- May 6

EOC U.S. History, English I, and Algebra II

(last 10 instructional days)

Online Gateway

Window 1: February 28-March 11

Window 2: May 2-20

All schools in the system /district must follow the same AYP/EOC and EOC schedule.

Spring 2011 Scanning and SDDV

AYP/EOC Scan Window: May 6-16

EOC Scan Window: May 6-26

AYP/EOC SDDV Window: May 16-24

EOC SDDV Window: May 16-June 8

SDDV: Student Demographic Data Verification

69

2010-11 EOC Quick Score Reports

70

2010-11 Performance levels for Algebra II will be reported after standard setting.

With the exception of U.S. History, numeric grades will be provided for all EOC assessments; raw scores will be provided for U.S. History.

2009-10 EOC Cut Scores

2009-10 EOC Cut Scores

2011 Algebra II Standard Setting

The Algebra II standard setting will be held June 27-29.

o Committees will comprise teachers, principals, supervisors, and directors of schools.

o Said committees will recommend cut scores.

o The cut scores will be submitted to the state board of education in July for approval.

o 2010-11 Algebra II reports will be mailed to public systems and private schools in September.

Fall 2010 EOC Reports

o Reports will be shipped to public systems and private schools in late March. Algebra II reports will be provided after standard setting.

o Reports, in paper and/or electronic format, include Individual Profile Reports (IPRs), labels, and CDs (school and system reports).

EOC Met/Not Met In the Diploma Requirement field of the answer document, bubble Yes for those students for whom the EOC Algebra I, Biology I, orEnglish II assessment will be used to satisfy the students’ Gateway diploma requirement. The Yes bubble must be filled in to ensure met/not met status is reported for said students.

A1 is no longer used to identify EOC testers who have a Gateway diploma requirement.

U.S. History labels do not include scale scores.

SchoolHouse to PearsonAccess

o Student Demographic Data Verification (SDDV) is now completed in PearsonAccess.

o Training Webinars were conducted last fall. An archived Webinar and a pertinent PowerPoint are available in PearsonAccess.

o The 2009-10 EOC reports currently housed in SchoolHouse are scheduled to be moved to PearsonAccess in April.

PearsonAccess SDDV Survey

PearsonAccess Customer Satisfaction Survey

The Student Demographic Data Validation (SDDV) process was moved to PearsonAccess for the EOC Fall 2010 administration. The Tennessee Department of Education and Pearson would like to collect your feedback on this experience. 

Your input will be used to help us improve Pearson products for you and your coworkers. Your responses will be shared with the Tennessee Department of Education and the appropriate Pearson teams.  However, your identity will remain anonymous unless you choose to provide us with your e-mail address.  This survey will take approximately 5 minutes to complete.

Thank you for participating in this survey.

77

Algebra II Reference Page

Updated Reference Page Updated Reference Page

78

2010-11EOC GIS

Revised EOC Answer Document American Indian or Alaska Native

Asian

Black or African American

Hispanic/Latino

Native Hawaiian or Other Pacific Islander

White

Pearson will not pre-ID the Spring 2011 EOC answer documents.

Unique Student Identification Numbers (USIDs)

Student Unique Identification Numbers generated by

EIS (State ID) must be coded in the Unique Student ID

field. If the number has fewer than nine digits, pre-fill

the empty bubbles, using leading zeros. If a USID is not

available, an Alternative ID number must be used.

Social Security Numbers may not be used.

81

New 2010-11 EOC Resources

Gateway Exams

(Paper-Pencil and Online)

o Mathematicso Language Artso Science

– 55 Operational Items

– 7 Field Test Items

– Untimed

Online Gateway TestingGateway assessments must be taken online. Exceptions include the following:o Homebound Studentso Students requiring a modified format (i.e., large print or braille )o Students pre-approved by the Office of Assessment

Online Gateway testing features a read-aloud function for Special Education students whose IEPs allow for the read-loud orPrompting accommodation.

Before testing, students will be able to practice answering questions online either with or without the read-aloud function. Students will be able to practice as many times as needed prior to live testing.

Online Gateway Testing: Practice Items

Online Gateway Testing: Features

Online Gateway Testing: Reports

Class ReportsIndividual Profile Reports (IPRs)LabelsComprehensive Data Files (CDFs) [NEW]

All reports for online Gateway testing are

available in PearsonAccess.

Online Gateway Testing: Resources

Special Education Assessment Updates

Lori Nixon

Special Education Consultant

Office of Assessment, Evaluation, and Research

Portfolio2011-2012

Looking Ahead• Orders will be placed in September• Teacher’s Manual and activities will be revised • Portfolio Forms will remain same

– Date will not change– Form Number: ED-3089 (Updated 6/2010)

http://state.tn.us/education/assessment/TCAP-AltPortfolio.shtml

Accommodations

• Must be implemented throughout the school year on a routine basis

• Are based on individual need– Allowable– Special Education

• Special Accommodation codes were changed at beginning of year

Special Accommodation Chart

• A. Extended Time• B. Read Aloud Internal Test

Instructions/Items• C. Prompting Upon Request• D. Interpreter Signs/Cues Test• E. Manipulatives• F. Assistive Technology• G. Calculator• H. Scribe• I. Unique Accommodation

Special Accommodations

• A. Extended Time– Not applicable for any Secondary Assessment– Not all Extended Time is the same

• B. Read Aloud Internal Test Instructions/Items– Do NOT read aloud charts/graphs/timelines…

• Prompting Upon Request if student has need

• C. Prompting Upon Request– Test Administrator reads verbatim– Test Administrator may not work out problems or

explain any text

Special Accommodations

• H. Scribe– Is only Special for Writing– If used for Achievement/Secondary, student

test book must travel with student answer document

• G. Calculator– Special Accommodation for Achievement

Science– Code only if used for Ach. Science

Special Coding Issues

• Functionally Delayed

• Gifted

• Speech

Functionally Delayed and Coding

• Functionally Delayed (FD) is a TN Disability category

• Coding depends on assessment type– Assessment Type

• Alternate– Portfolio

• General – Achievement– Secondary

Functionally Delayed Alternate Assessment-Portfolio

• PRIMARY disability is Functionally Delayed code Functionally Delayed

• Do NOT code Special Education Hours for a student whose PRIMARY disability is FD

• AYP Implications– Non-Participant– Non-Proficient

Functionally Delayed General Assessments

(Achievement/Secondary)

• Consider both Primary and Secondary disability category

• Two Scenarios:– FD primary disability w/ Secondary Disability (IDEA)

• Code SPED hours and special accommodations• Do not code FD

– FD primary disability w/o Secondary Disability• Code FD and special accommodations• Do not code SPED hours

99

Online Assessment Applications

Where does the TVAAS Teacher Report data originate?

Student Takes Test, Answer Document completed (revised answer document)

Group Information Sheet (now the Test Administration Group Header) Completed

GIS(TAG) & Answer Documents Scanned

Students Claimed on TDOE Randa Solutions Website - Faculty Student Data

TVAAS Teacher Reports Delivered Electronically on The Restricted TVAAS Website

101

Faculty/Student

• TDOE strongly encourages schools/systems to have teachers do their own claiming in Faculty Student Claiming (FSD) on the TDOE Randa Solutions website

• Principals and STC’s will verify accuracy of claimed students on the TDOE Randa Solutions website

• Help Manuals and Online Training will be provided for Teacher Claiming on the Resources Tab on the TDOE Randa Solutions Website.

102

Faculty/StudentStudents who were pre-assigned either through Pearson Access or by bubbling the license number on the student answer document will appear in the roster.

Coded on Ans Doc

103

Faculty/StudentStudents who were not pre-assigned may be added to the roster by selecting them from the TAG. Schools should consider reporting & rostering when determining the organizational principle for the TAG..

Faculty/Student

Students may be added by a name search…

Once a teacher has completed the roster of ALL students for whom they have been instructionally responsible at any point in the academic year, they will verify that the roster is complete and continue to claiming for teacher effect.

Faculty/Student

106

Once a teacher has completed the roster of ALL students for whom they have been instructionally responsible at any point in the academic year, they will continue to “Edit the roster” for the TVAAS Teacher Report.

All students on a roster will default to 100% for the portion of Instruction given by teacher(s). Exclusions for SpEd and Instructional Availability will be based on coding from the answer document.

Instruction percentage and student instructional availability may be edited by the teacher.

Faculty/Student

107

Faculty/StudentA new look for Administrators – The School Level Audit

Access all reports

from the Audit Page

108

Faculty/StudentSystem Level Audit

Access all reports

from the Audit Page

109

Faculty/Student

EOC Claiming will also verify the TLN at Log In

110

Need Help?

New help manuals and

webinars posted