2005-2006 Regional Assessment Workshop Lincoln County School District.

2005-2006 Regional

Assessment Workshop

Lincoln CountySchool District

GoalOverview of New State Test Support Structures

and Test Administration

Participants will:

• Become familiar with key responsibilities and roles of District/School Test Coordinators.

• Understand changes in state testing processes and procedures.

• Understand links to Oregon EdVantage™.

• Identify future district/school training needs.

• ESD’s are involved in training and providing state assessment support.

• ODE will be providing information to ESD’s.• There will be no support staff dedicated to

answering questions at ODE as in the past.• For the questions and training the state has been

divided into three regions.

New District Support Structure

Support Regions

Region 1 Support

Important numbers to remember:

• Susan Halliday, LBL541-812-2600

• Region 1 TESA Help Desk800-970-TESA (8372)

• Vantage Learning Help Desk800-326-8328

What will your ESD partner do for you?

• Remind you of the need for consistent statewide assessment administration.

• Assist with TESA and paper/pencil test support.• Provide you additional paper/pencil testing

materials in emergency situations.• Provide e-mail updates of current news and needs.• Provide a link between you and the ODE Office of

Assessment and Information Services.

What will your ESD partner not do for you?

• Take the place of your district or school testing coordinator.

• Order your paper/pencil state test materials through the ODE site.

Administration Manual

The single Administration Manual for the 2005 – 2006 school year will ONLY be found on the web at :

http://www.ode.state.or.us/teachlearn/testing/manuals/

The Appendix for the Administration Manual for the 2005 – 2006 school year will ONLY be found on the web at :

http://www.ode.state.or.us/teachlearn/testing/manuals/

Administration Manual - Appendix

TESA User’s Guide

TESA Users Guide

2005-06

Getting Started

http://www.ode.state.or.us/search/

results/?id=164

Purposes of State Testing

• Individual student learning.

• Student performance by various groups for student learning purposes:– Cohort Data– Year-to-Year Data

• Student performance by various groups for compliance purposes.

LBL: Real Solutions for Education

Test Schedule

• Located on ODE’s Webpage– http://www.ode.state.or.us/search/results/?id=169

• Highlights include:– Writing window: January 9 – February 24– Social Sciences: Optional and Web only– Grade 3 Reading test – available in Spanish!– English Language Proficiency Assessment (ELPA)

Test Window: April 4 – June 9

Formats Number of Opportunitie

s

Gr. 3(Bnch 1)

Gr. 4 Gr. 5 (Bnch 2)

Gr. 6 Gr. 7 Gr. 8 (Bnch 3)

CIM XA

Mathematics TESA - English 3 R R R R R R R A

TESA -Spanish/English 3

Paper/Pencil – English 1

PP – Spanish/English 1

PP – Russian/English 1

Reading TESA - English 3 R R R R R R R A

Paper/Pencil – English** Grade 3 – Spanish *

11

Science TESA - English B2 & B3 (2) – CIM (3)

R R R A

TESA -Spanish/English B2 & B3 (1) – CIM (2)



PP – Russian/English 1

Social Sciences

TESA - English 2 O O O

TESA -Spanish/English 1

Writing TESA – English 1 -Seniors only R R R A



Testing Opportunities

CONTENT AREA Approximate Working Time TESA – long form (1 available)

Approximate Working Time TESA – short form (2 available)

Approximate Working Time paper/pencil

Mathematics 75 – 120 minutes 45 – 60 minutes Two 50-minute sessions

Reading/Literature 75 – 120 minutes 45 – 60 minutes Two 50-minute sessions

Science 75 – 120 minutes 45 – 60 minutes Two 50-minute sessions

Social Sciences 75 – 120 minutes N/A N/A

Writing Three 50-minute sessions Three 50-minute sessions

The Juried Assessment process is available to all students for any state tests, as are targeted assessments. http://www.ode.state.or.us/search/results/?=175

Planning Testing Times

Knowledge and Skills Testing Schedule

• TESA: September 27-May 19– Availability of test based on SSID.

• Paper/Pencil: March 13-April 21– Assessment Collection for bar code schools sent at end of

the testing window, based on tests coded. Go To: https://district.ode.state.or.us/apps/login/

• Bar Code Schools select: BCSpring2006MC

Grade LevelPerformance Standards

Performance standards for math and reading knowledge and skills tests are based on

content expectations consistent with previous benchmarks.

Final performance standards were adopted by the State Board in October 2005.

Grade Level Performance Standards

Reading and Literature:4th Grade: 223 (Exceeds) 208 (Meets)

6th Grade: 233 (Exceeds) 219 (Meets)


Mathematics:4th Grade: 223 (Exceeds) 208 (Meets)



Writing Testing Schedule

• Grades 4, 7, & CIM students: – January 9 - February 24

– Or –

• CIM students only: – April 14 - May 5.

• Senior Writing Retests on TESA– Either October 31 – November 18

(Early Graduating Seniors Only) – Or April 14 to May 5

Approved Grade LevelPerformance Standards

Writing Composite Scores:

7th Grade: 50 Exceeds 40 Meets

4th Grade: 40 Exceeds 32 Meets

A score of three or higher in each of the

Following traits:

Ideas and Content Sentence Fluency

Organization *Conventions

* Conventions score doubled for 7th grade.

• Students at Grades 9 and 11 may test once during one of the two regular windows; Grade 10 students must test once during one of the two windows

• Grade 9 students should only be tested if they are taking CIM-level classes and have produced work that shows they are capable of meeting CIM standards;

• Only early-graduating seniors may participate in the October/November window; all other seniors may re-test during either or both of the two later windows.

Writing Assessment Opportunities

ONLY those grade 9 students, receiving instruction at the CIM level, and showing CIM level proficiency, should test at the CIM level.

Using the state test as a format for “practice testing” is out of compliance with state policy.

“Practice Testing”

Accommodations Overview

Accommodation—a change in how a test is presented to or responded to by a student.

– Provides the student equal access and equal opportunity to demonstrate proficiency.

– Considered “standard administration” and have the opportunity to “meet” or “exceed” the standard.

Modification Overview

A Modification is a substantial change in the standard administration of the test.– Allows the student to engage productively in the assessment which

includes changes in the instructional level, content, and performance criteria.

– Under modified conditions scores are not considered for determining whether the student “meets” or “exceeds” the CIM benchmark.

Scores obtained under modified conditions:• Are included in AYP (“does not meet”)• Do NOT count toward meeting performance standards for

individual students• Are included in participation counts for AYP and Report Card

Other Assessments• Targeted Assessments

– Either TESA or Paper Pencil• Side-by-Side

– Spanish (Mathematics, Science, Social Sciences)– Russian (download only)

• Mathematics grades 3, 4, 5, 6, 7, 8, & CIM• Science benchmarks 2, 3, & CIM

• Career and Life Role Assessment System (CLRAS) • Extended Reading, Mathematics, Writing, and Science• Juried Assessments• Appeals• English Language Proficiency Assessment

A Targeted Assessment (formerly challenge) is from a different level than the grade of enrollment – and is consistent with the level of instruction.

A student may target a lower grade level ONLY if doing so is described in the students’ IEP.

If approved by the USDOE for 2005 – 2006, 2% of all assessments used to determine a district’s AYP may include these tests.

Targeted Assessments

The side-by-side assessments have the same items presented in both Spanish and English or in both Russian and English.

Students benefiting from seeing the items in both languages can meet standards for both the CIM and for AYP. These are “standard administration” tests.

Side – by - Side

Extended Assessments/CLRAS

What are they?– Alternatives to grade level assessments

Who takes them?– Students with significant disabilities that are unable to take

the general statewide assessment

Who gives them?– Only “qualified” assessors should administer extended

assessments

For more information about Extended Assessments & CLRAS go to:

http://www.ode.state.or.us/search/results/?id=178

Juried Assessments

What is it?– Juried Assessments are an alternative path for students who

can meet the CIM standards, but are unable to demonstrate mastery on one or more statewide assessments.

Who uses the Juried Assessment process?– Any student who has mastered grade level content, but is

unable to demonstrate the mastery on statewide assessments.– Students who have entered Oregon schools at grades 11 or 12,

and choose not to take the statewide assessments.– “Eligible” students demonstrating reading and/or writing

skills at the standard level, but in their native language.

Juried AssessmentsWhat is a Collection of Evidence?

– A set of materials gathered to show that the student is performing at the standard level on the grade level content.

– The collection must address the State Board-adopted content and performance standards

How does the Juried Assessment Process begin?– Districts are required to notify parents of the opportunity for

students to use the Juried Assessment Process

Do JA’s “count” for AYP and/or CIM?– In general, yes!

For detailed requirements and intent to submit deadlines go to: http://www.ode.state.or.us/search/results/?id=175

Writing Test Appeals

• State scores must be in the appropriate range of composite scores.– CIM: 25 – 39– 7th: 25 – 39– 4th: 20 – 31

• Trained rater re-scores paper. If score appears higher, re-submit paper.

• Attach original paper to ‘Appeals Form’.– Completely fill out form.– Local rater and district test coordinator must sign form.

• ODE must receive by May 31, 2006.• Appealed scores always replace original score.

Test SecuritySecurity procedures are designed to protect the integrity and confidentiality of those test questions, prompts, and problems that are not released for public use; the security of these materials is necessary so that they can be used in later years to measure trends in performance.

Test administration procedures are to ensure consistent statewide test administration. When this doesn’t happen:– Report to ODE Office of Assessment and Information Services– Determine an action plan– Conduct an investigation– Report the results of the investigation– If appropriate – contact TSPC re: possible loss of licensure

A PowerPoint presentation about test security is available on the ODE website.

Go to: http://www.ode.state.or.us/teachlearn/testing/admin/testsecurity.ppt

• To maintain secure and fair test administration:– Teachers and proctors must sign the Assurance of Test Security

form to communicate the importance of “standardized” administration of tests each year. These are to be kept at the district office for one year.

– Concepts that had not been taught earlier may not be introduced to students prior to giving the test (don’t give test materials out too soon)

– Proctors may not suggest which prompt a student ought to select for writing

– Unused test materials, after each testing window, must be returned to the District Test Coordinator. Schools may not keep extra booklets or copy test forms for practice or future instructional use

– Test forms have a “core” set of items that are the same year to year. This set links the current test to previous years’ tests and ensures the test is consistent and fair from year to year

– Any teacher responsible for proctoring test administration for students “must be in the room monitoring this process and be available for students who may have operational questions.”

Test Security Q/A

Online Ordering

Tests available for order online– Writing Performance Assessments

November 2 – November 23, 2005February 10 – February 24, 2006

– Knowledge and Skills TestsJanuary 10 – January 27, 2006

– Grade 3 Reading in SpanishJanuary 10 – January 27, 2005

Lincoln County School District staff will work with schools to order appropriate numbers of paper/pencil test documents.

Student Staging (formerly PADM)

Student Staging Overview:– The intent of the Student Staging web site is to make Assessment data

more complete and accurate before state-generated reports are issued.– The Student Staging web site is preloaded with the demographic portion

of student records.– Each Assessment Window is a different Student Staging database file.– One student record is displayed on the screen at a time. – Each student will have multiple records if s/he has taken more than one

test.For instructions on accessing and using the Student Staging site go to:

https://district.ode.state.or.us/docs/asmt/tststg/StudentStagingUserGuide.pdf

NOTE: TESA data updates student staging daily!

• For writing, speaking, and mathematics problem solving, students in grades 3, 4, 5, 6, 7 & 8 must complete one work sample scored with the state scoring guide.

• Students at the CIM level must complete 2 work samples from different strands (SRCs 3, 4, or 5) in mathematics problem solving; and 3 samples in writing (one persuasive, one expository AND one imaginative or narrative). In speaking, CIM students must complete 3 samples (one persuasive, one informative, and one unrehearsed).

Work Sample Requirements

• For scientific inquiry, students in grades 4 – 8 and at the CIM level must complete one work sample, scored in the required dimensions.

• For social sciences analysis, students in grades 6 – 8 and at the CIM level may complete one work sample, scored in the required dimensions, beginning in 2005 – 06.

The Overview of Oregon’s assessment system can be found at:http://www.ode.state.or.us/search/results/?id=239

The phase in schedule for science work samples can be found at:http://www.ode.state.or.us/search/results/?id=240

The phase in schedule for social science work samples can be found at:

http://www.ode.state.or.us/teachlearn/subjects/socialscience/assessment/survey

Work Sample Requirements

Districts have traditionally used one of four purchased assessments

As of 05-06, schools must use Oregon’s ELPA Assessment There are two field test opportunities: fall and spring The operational assessment will be April - June Web-Based assessment, with K-12 being assessed

Questions: please contact Elaine Hultengren at 503.378.3600 ext. 2345 or [email protected]

English Language Proficiency Assessments (ELPA)

Sample Tests• The Oregon Department of Education provides sample tests to

demonstrate the types of questions students might encounter on the Oregon Statewide Assessment.

• The sample questions were taken from previous years’ tests, are no longer secure and have been released for public use.

Sample tests are available in:– Mathematics and Reading at grades 3, 4, 5, 6, 7, 8, and CIM– Science and Social Sciences at benchmarks 2, 3, and CIM– Extended Mathematics, Reading and Writing

Sample tests can be found on TESA or

on the ODE website at:http://www.ode.state.or.us/search/results/?id=226

Bar-Coding Districts

• LBL will bar code ordered documents for the state writing test.

• LBL will be prepared to begin coding state writing test answer documents well ahead of testing window.

• School districts will be responsible for bar coding all knowledge and skills answer documents locally.

WebEx Training Available

Go tohttp://techserv.lblesd.k12.or.us/software/secure/webex/

index.php

Select:“Other Student Applications”

“OSAT”Three options are available for viewing:

“OSAT Introduction”“OSAT Secondary School Student Assignments”

“OSAT Printing”

Bar Code Availability

• Bar coding options for the Writing Performance Test will be available in early December. This will allow you to select students well ahead of testing.

• Please provide LBL with five working days of lead time for printing of answer documents.

Score Loading and Resolution

• All state test scores will be loaded into the LBL Student Information System on a weekly basis.

• For resolution of duplicates, please view option DO 155 or SO 135.

• Changes in scores may only be made through the ODE site.

TESATESA

forfor

2005-20062005-2006

A Look at What’s A Look at What’s NewNew

TESA Access

• Secure Browser (Recommended)

• TESA Web site

New for 2005-06 TESA Availability September 27-May 19

Score that “counts” The highest score on any attempt counts for AYP and Report Card.

Long vs. Short tests

At the Grade levels for Reading, Math, and CIM Science, there are three testing opportunities. Two of these are shorter tests, which provide no strand information. One of the attempts is a longer exam, providing full strand information. All tests allow students to meet the performance standard.

Delivery Method

Progressive (Math and Reading at all grade levels and Science at CIM) – Each student receives items at their ability level within grade level. Linear Test (Social Science) – Small pool of items, students will see the same questions in random order.

Sample TestsAvailable on TESA for Math, Reading, Science, and Social Sciences at grades where TESA tests are given. Students will receive the number correct at the end of their test.

Secure Browser The password to exit the secure browser has changed to tesa05.

New for 2005-06 School Name Confirmation

Screen

A ‘School Name” confirmation screen has been added. After confirming personal information students will view the School Name and ID number displayed on a separate verification page.

Subject Tabs

Click on a colored tab to see available tests. Only one test per subject can be opened at a time.

Print Reading Passage

ODE is still determining how to use this function. It will be on to start the year while we gather feedback. It may be removed if it is shown to not be helpful to students.

Reading Questions

Students may preview all questions assigned a passage before answering and submitting.

Sort Reports Reports can be sorted by clicking on each heading.

Locked out Students Teachers can reset locked out students

New for 2005-06 Administrative

Login

All District and School Usernames and Passwords have been reset since last year.

Targeted Tests

A “Grade Level Challenge Form” must be submitted for all students who will be challenging a benchmark or grade level test. See Appendix A of Administration Manual.

Access Key and Test Key During daily login the Access and Test Keys are no longer case sensitive.

Test Survey Questions

Survey questions have been embedded at the beginning of the standard tests. Students will answer the questions the first time a subject test is open.

Number of Tests Open Students may only have one test per subject open at a time.

Check system requirements

Check to see if your system meets the minimum requirements by clicking on the System Requirement Check button in the upper right corner on the TESA main screen.

Number of Opportunities

Number of TESA Opportunities for 2005-2006

Grade 3

Grade 4

Grade 5 (Benchmark 2)

Grade 6 Grade

7 Grade 8

(Benchmark 3) Grade 9-12

(CIM) Reading 3 3 3 3 3 3 3

Math 3 3 3 3 3 3 3 Spanish/English

Math 3 3 3 3 3 3 3

Science N/A N/A 2 N/A N/A 2 3 Spanish/English

Science N/A N/A 1 N/A N/A 1 2

Social Sciences N/A N/A 2 N/A N/A 2 2

Spanish/English Social Sciences

N/A N/A 1 N/A N/A 1 1

Test Names Reading Tab

Rdg. Test #1 Reg. Test #2No Strand Data

Rdg. Test #3No Strand Data

Grade 3 RLBlueGR3 RLRedGR3 RLOrangeGR3






CIM RLBlueGRCIM RLRedGRCIM RLOrangeGRCIM

Test Names Math Tab

Rdg. Test #1 Rdg. Test #2No Strand Data

Rdg. Test #3No Strand Data

Grade 3 MAKansasGR3 MAOhioGR3 MAIdahoGR3






CIM MAKansasGRCIM MAOhioGRCIM MAIdahoGRCIM

Test Names Science Tab

Grade Test 1 Test 2 Test 3(No Strands)

Test 4(No Strands)

5th SCDolphinGR5

SCRabbitGR5

8th SCDolphinGR8

SCRabbitGR8

CIM SCDolphinGRCIM

SCPigGRCIM

TBD

Test Names Social Science Tab

Grade Test 1 Test 2

5th Grade SSAsiaGR5 SSEuropeGR5

8th Grade SSAsiaGR8 SSEuropeGR8

CIM SSAsiaGRCIM SSEuropeGRCIM

Test Names Other Tab

Spanish Math Test 1 Spanish Math Test 2 Spanish Math Test 3

Grade 3 MAHawaiiGR3SPN MAMaineGR3SPN MAFloridaGR3SPN






CIM MAHawaiiGRCIMSPN MAMaineGRCIMSPN MAFloridaGRCIMSPN

Spanish Science Test 1 Spanish Science Test 2

Grade 5 SCPerroGR5SPN

Grade 8 SCPerroGR8SPN

CIM SCPerroGRCIMSPN SCGatoGRCIMSPN

Spanish Social Sciences Test 1

Grade 5 SSAfricaGR5SPN

Grade 8 SSAfricaGR8SPN

CIM SSAfricaGRCIMSPN

Considerations

• Lab Usage• Testing All Students• Testing Times• Proctoring• Computer Rights• Testing Location• Test Protocol• Etc…

Data Management

HALLIDAY, Susan ABC School

SSID: 7654321 School ID: 4321

Look for ‘access key’ and ‘test key’

for today.

Similar idea to the data card template found in your TESA Notebook.

From a From a Student’s Student’s

PerspectivePerspective

TESA 2005: Logging in as a Student

TESA 2005: Student Welcome/Confirmation Screen


Student must verify School Name and School ID

TESA 2005: Student Test Center

Click on a colored tab to see available tests. Only one test per subject can be opened at a time. Spanish tests are

located in “Other.”

TESA 2005: Starting a Test

TESA 2005: SCHOOL NAME

School name appears on screen through the entire test

ODE is still determining how to use this function. It will be on to start the year while we gather feedback. It may be removed if it is shown to not be helpful to students.

TESA 2005: Reading Passage Preview

Previews all questions within a passage.

TESA 2005: Reading Passage Preview

Accessing Accessing TESA TESA

TESA 2005: HOME PAGE

Students can take sample tests on TESA.

Check to see if your system meets the minimum

requirements.

TESA 2005: Administrator, Teacher, Proctor Log In

TESA 2005: Teacher/Proctor Welcome/Confirmation Screen

TESA 2005: Teacher Main Menu

Teachers can still reset locked out students

Access Key & Test Key are still no longer case sensitive

TESA 2005: Modify Account

TESA 2005: Group Setup

TESA 2005: Group Information

TESA 2005: Group Members

TESA 2005: Reports Menu

TESA 2005: Reports Criteria

TESA 2005: Reports

Reports can be sorted by clicking on each heading.

How to How to Test a Test a

StudentStudent

TESA 2005: HOME PAGE

Click on Student Login

TESA 2005: Logging in as a Student

Enter SSID, School ID, and Access Key.


Click on “Yes, this information is CORRECT.”

TESA 2005: Student Test Center

Select a tab to see a list of available tests.

TESA 2005: Launching a Test

Select the test you’d like to take.

TESA 2005: Launching a Test

Click OK to start the test.

TESA 2005: Enter Test Key

Enter the Test Key and click on the login button

TESA 2005: Modifying the test

If modifying the test, enter “modify” in place of the test key.

TESA 2005: Modification code screen

Click the modifications code(s) that apply for this test and enter the

teacher’s email address.

TESA 2005: Confirmation Box to Stop Test and Finish Later

TESA 2005: Resume a Test

Tests to be resumed are listed at the top of the screen.

TESA 2005: Math Item with Finish Button

The flag will appear on the last question of the test.

Click on COMMENT AND FEEDBACK to report a problem

with the question to ODE.

• Reading– 2005-2006 is implementation year for new standards.

– New Score Reporting Categories are now in effect for all grades.

– New Test Specifications and SRC Charts are now posted on the Web.

– New Sample Tests for grades 3, 5, 8, and CIM are also posted. These documents can be found at:


What’s new in...Language Arts

• Writing– 2005-2006 is implementation year for new standards.– New Test Specifications have been posted on the Web

(http://www.ode.state.or.us/search/results/?id=238).– New anchor papers/exemplars will be posted for 3, 5, 8,

and 10 by the end of October.– New process for appealing state assessment scores—

see the Administration Manual.– State tests with all 4s except for one 3 will be given a

third reading at each of the tested grades in 2005-2006.– New writing scoring guide– minimal changes.

What’s new in...Language Arts

• Knowledge and Skills:– The standards and new weighting are in effect for all

grades and are modeled in the sample tests.

– New K/S Test Specifications (for grades 3 & 4, 5 & 6, 7 & 8, and CIM) are now posted – they intentionally represent a sampling of content to be assessed at each grade level.

– Item Difficulty Charts (ranges of difficulties for ranges of grade levels by SRC) are posted.

These documents can be found at:


What’s new in...Mathematics

• Mathematics Problem Solving– At each grade level (3, 4, 5, 6, 7, 8 & at the CIM) and from each strand –

statistics/probability, algebraic relationships, and geometry – you can find a task, anchor papers/exemplars (high, medium, and low), scores and commentaries!

These can be found at either:http://www.ode.state.or.us/subjects/mathematics/resources/pssupportorhttp://www.ode.state.or.us/search/results/id=224

• OCTM Professional Development Cadre – contact:– Eastern Oregon: Molly Smith – [email protected]– Northwestern Oregon: Lynn Bonser – [email protected]– Southern : Giny Christensen – [email protected]– General Info: Phil Bartsch – [email protected]

What’s new in...Mathematics

• Three test opportunities on TESA for CIM• One Benchmark 2 and one Benchmark 3 Spanish/English

test on TESA• Scientific Inquiry work sample requirement for 10th

graders (CIM) and Benchmark 3 students now includes “Forming”

• Scientific Inquiry work sample requirements for Benchmark 2 students now includes “Analyzing”

• Scientific Inquiry Teacher Leaders available for scoring facilitation at http://www.ode.state.or.us/teachlearn/subjects/science/SciInqProfDevelopers0405.doc

What’s new in...Science

• Social Sciences Tests are on TESA – ONLY.• Two tests are available at Benchmarks 2 & 3 and

at the CIM level.• One Spanish/English test is also available at each

level.• Social Sciences Analysis Teacher Leader Cadre

available for scoring facilitation are listed at:http://www.ode.state.or.us/teachlearn/subjects/

socialscience/curriculum/teachres/leaders.aspx

What’s new in...Social Sciences

Q & A

• What did you learn?

• Other QUESTIONS you still have?

• Future training needs?

Thank You

2005-2006 Regional Assessment Workshop Lincoln County School District.

Documents

Transcript of 2005-2006 Regional Assessment Workshop Lincoln County School District.