OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTIONDivision of Assessment and Student Information

Smarter Balanced in Washington

Preparing for the Transition

Webinar #4 March 20, 2014

03/20/2014 Slide 2

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Organization of Webinars Series Future webinars are scheduled for 3:30-4:30

PM on:April 9 May 13 June 10

July 15 August 13 PowerPoints and answers to questions raised

during the webinars are posted on OSPI’s Smarter Balanced web-page http://www.k12.wa.us/smarter/default.aspx; audio recording of webinars are included.

We will minimize repeating previously provided information, so please check the webpage.

Summative Field Tests

Getting Ready for the Tests

03/20/2014

03/20/2014 Slide 4

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

NField Testing Countdown to Test Administration!

Whoa!!! The delay of one week caught everyone by surprise.

OSPI had no input on the issue, but is deeply sorry for the disruption and the late notice.

Thanks to everyone who recognized the delay was no one’s preference and would have been avoided if it were not necessary.

The first field test window opens Tuesday, March 25.

 

Scheduled Downtimes Remain the Same

Administration Downtime

Practice Test/Training Test Saturday – Sunday, May 17 and 18

Field Test

Thursday, April 10 – Sunday, April 13,

2014Thursday, May 8 – Sunday, May 11,

2014

03/20/2014 Slide 6

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Field Testing Windows and Scheduled Downtimes There are four test administration blocks:

March 25 – April 4 April 7 – April 25 April 28 – May 16 May 19 – June 6 (not for grades 9-10)

Those who got bumped from week one can test any time before June 6 EdWeek and Seattle Times mentioned an additional week of

June 9 – that was a mistake on the part of the Smarter Balanced spokesperson

03/20/2014 Slide 7

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

NField Testing Updates and the Countdown to Test Administration!

Students are permitted and encouraged to use their own ear buds or headsets, but districts and schools should also plan on having some available. USB headphones are recommended as they are typically plug-and-play devices. Districts and schools are responsible for ensuring that each participating student has a headset.   

03/20/2014 Slide 8

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Field Testing Updates Continue accessing resources and materials

for the Field Test scheduling, administration, and communication.

Ensure your district and school coordinators and teacher administrators are carefully reviewing the training modules posted on the Field Test Portal.

03/20/2014 Slide 9

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Training and Resources Field Test Portal Recent Additions

Classroom Activity and Performance Task Administration Guidelines: How to identify the performance task topic for each school and grade, download the classroom activity, and administer the classroom activity and performance task.

Keyboard Command Chart for Students: This document explains the keyboard commands that students can use to navigate between test features and tools.

Test Security Incident Log: This document provides instructions and a template of the incident log that Test Administrators, School Test Coordinators, and District Test Coordinators will use to report any Test Security Incidents that occur during testing.

03/20/2014 Slide 10

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Training and Resources Field Test Portal Recent Additions,

continued Scribing

Protocol for Smarter Balanced Assessments: This document is designed to assist staff, test administrators, educators, and scribes in ensuring scribing is standardized and contributes to valid measures of students' college and career readiness. Embedded Designated Support Glossaries:

Further information on the glossary supports that are available.

Communications Toolkit: The communications toolkit for the Field Test includes 12 documents that support communications efforts surrounding the launch of the Field Test. Materials include Field Test FAQs, talking points, parent/guardian notification letter template, and other helpful resources.

03/20/2014 Slide 11

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Training and Resources Field Test Portal Recent Additions,

continued ORS User Guide: The Online Reporting System

(ORS) enables authorized users to view test progress information for students participating in the Spring 2014 Smarter Balanced Field Test.

Field Test Portal Recent Updates Test Administrator User Guide: (Updated March 16) Guidelines: Frequently Asked Questions for the

Usability, Accessibility, and Accommodations Guidelines (Updated March 16)

Technical Specifications Manual for Online Testing (Updated March 17)

03/20/2014 Slide 12

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Pre-ID’ing and Data Topic Updates

TEST TICKETS!!! Test tickets are available in WAMS Profile

Downloads under ‘8. Smarter Balanced Field Test’

2 tickets per student: ELA and MATH For HS testing single subjects – discard extra tickets

Sorted by school name, grade, group name (if applied), student last/first/middle

Additional Test Ticket Resources: MS Access DB/Form posted to: http://

www.k12.wa.us/SMARTER/Tests.aspx Excel Student list posted in WAMS Profile

Downloads currently

03/20/2014 Slide 13

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Pre-ID’ing and Data Topic Updates Student Data TIDE tasks prior to testing:

1) Block 1 test sites must identify remaining students (“stragglers”) and enter them into TIDE prior to testing2) Correcting Demographics in TIDE

Demographic data in TIDE is used in item analysis Make corresponding updates in Local SIS’s and CEDARS

3) Uploading supports/accommodations TIDE User Guide, pages 30–35 and Test Administration

Manual, section 7.0

03/20/2014 Slide 14

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Pre-ID’ing and Data Topic Updates

New and Moved Student Files Schedule:

Will reflect students from most recent CEDARS submission

Students enrolled between most recent CEDARS submission and the start of testing must be added by a District Administrator

Test Window Window Dates

New and Moved File Extracted

New and Moved uploaded to TIDE

Window 1March 25 to April 4 3/10/2014 3/11/2014

Window 2April 7 to April 25 3/27/2014 3/28/2014

Window 3April 28 to May 16 4/17/2014 4/18/2014

Window 4May 19 to June 6 5/15/2014 5/16/2014

03/20/2014 Slide 15

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Pre-ID’ing and Data Topic Updates

New and Moved Student Files (continued) EXAMPLES

A. School is testing both ELA and Math during window 2 and most recent CEDARS submission before window 2 new and moved extract was on March 21:

Window 2 extract will include all students enrolled between February 10 (initial statewide student upload) and March 21

B. School is testing ELA in window 2 (same CEDARS date as above) and Math in window 3; most recent CEDARS prior to window 3 extract was April 7:

Window 2 new and moved includes same students as above. Window 3 new and moved includes students enrolled between February 10 and April 7 with duplicates of window 2 new and moved records removed.

03/20/2014 Slide 16

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Why Field Test?

Although this is a field test, we must have valid responses to shape our future tests.

Accurate item data will determine difficulty, bias and sensitivity, whether items are kept, and ultimately the cut scores (or what score is needed to meet standard).

Field Tests

Dry Run

Item Data

Operational Tests

03/20/2014 Slide 17

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Security Test Administrators must ensure that all

conditions of test security are maintained. Report all security incidents witnessed or

suspected. Only students who are testing can observe

assessment items. Students who are not being tested or

unauthorized staff must not be in the room where a test is being administered.

Based on the item type (i.e., performance tasks), trained TAs may also have limited exposure to assessment items in the course of properly administering the assessment; however, even TAs may not actively review or analyze

any assessment items.

03/20/2014 Slide 18

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Security TAs and SCs or other individuals who have

witnessed, been informed of, or suspect the possibility of a test security incident that could potentially affect the integrity of the tests or the data should follow the steps outlined in Appendix B of the Test Administration Manual and the TIDE User Guide located at: http://sbac.portal.airast.org/wp-content/uploads/2014/01/Smarter_TIDE_UserGuide_Spring2014.pdf

03/20/2014 Slide 19

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Security The Test Security Incident Log (on the Smarter

Balanced Portal http://sbac.portal.airast.org/field-test/resources/) is the document of record for all test security incidents.

TAs must download the template and log incidents immediately and submit via email (or alternate agreed-upon process) to their SCs and DCs.

Instructions on how to complete the Log, including a listing of the column headers and descriptions, are located within the EXLS file, under tab ‘Instructions’.

03/20/2014 Slide 20

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Security At the close of the testing window, ensure that

all test security incidents were reported in accordance with the guidelines in Appendix B in the TAM and the TIDE User Guide.

Operational Summative Assessments

03/20/2014

03/20/2014 Slide 22

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Administration Window The 2015 summative operational assessment

windows/dates are still being discussed… The complexities include:

Per Smarter Balanced Consortium: High schools need to test on Smarter Balanced w/in

final 7 weeks of school Grades 3-8 test in final 12 weeks of school

In Washington: Grade 3 results must be returned in time for principals

to meet with parents before the end of the year High school exit exams need to be scheduled as well

(ELA for 10th and EOC in math and biology) - these will be paper/pencil

Interim Assessments

We are all life long learners… patiently learning a little each month about interim assessments

03/20/2014

03/20/2014 Slide 24

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Interim Assessments No updates have been provided to states on

interim assessments. A letter will soon be sent to districts with

schools who are in Priority, Focus or Emerging status: Smarter Balanced interims will replace Reading

Benchmark and Math Benchmark assessments (RBAs and MBAs)

OSPI is still discussing appropriate interims for grades 1-2 (WaKIDS can be used in kindergarten)

Digital Library

Educator resources for formative assessment practices

to improve instruction

03/20/2014

Digital Library Basics, 2-26-14

A Balanced Assessment System

Common Core State Standards

specify K-12

expectations for college and career readiness

All students leave

high school college

and career ready

Teachers and schools have

information and tools they need

to improve teaching and

learningInterim assessments

Flexible, open, used for actionable

feedback

Summative assessments

Benchmarked to college and career readiness

Educator resources for formative assessment

practicesto improve instruction

Slide 26

Balanced Assessment

• Coverage of full breadth/depth of Common Core

• Computer Adaptive Testing (CAT)• Precise assessment of all students• More engaging assessment experience

• Performance Tasks – real world problems

Summative Assessments

for Accountability

• Optional for district, school or classroom use• Fully aligned with Common Core – same item

pool• Focus on set of standards or mirror

summative test• Teachers can review and score responses

Interim Assessments

to Signal Improvement • Digital library gives access to high-quality

resources • Tools/materials for classroom-based

assessments• Professional social networking (Web-based

PLCs)• Useful for in-service and pre-service

development

Formative Tools and

Resources for Improved

Instruction

✔

✔ ✔

Digital Library Basics, 2-26-14

Smarter Balanced Digital Library:Formative Assessment Practices and

Professional Learning – educator involvement

National Advisory Panel (NAP)

• 11-20 experts• Began December 2012• Provides policies and criteria

for resources

State Leadership Team (SLT)• 10-14 WA members• Provides support and

training for State Network of Educators

• Promote statewide communications

State Network of Educators (SNE)• 85 WA Members (1,500+

nationally)• Representation from LEAs,

AEAs, content leaders, ELL, IHE

• Serve Summer 2013 – Late Fall 2014

• Submit and review resources

Digital Library Basics, 2-26-14

Digital Library Basics• One Stop:

• Accessed through a single sign-on with user permission levels • Educators have access to all of the instructional and professional learning resources

for each grade band (Grades K-2, 3-5, 6-8, 9-12) • There will be resources that educators can share or use with students and families, but

students and families will not be able to access materials directly.

– It WILL NOT be a “bank” of formative assessment items alone. All resources will have the formative assessment process embedded within them.

• All submitted materials will be vetted through a Quality Criteria Review Process by SNEs across the nation. • Each resource will be reviewed and rated by at least 3 SNEs• If they do not meet the quality criteria, resources will not be included in the library

• Functionality• The applications uses state-of-the art tagging and search features so that educators will

be able to: Quickly find resources by CCSS, formative assessment process attributes, etc. View and download resources Rate resources Use social networking features to collaborate with other educators across

the Consortium by posting questions and sharing their knowledge.

Digital Library Basics, 2-26-14

Resources in the Digital Library

* Resources include the following file types: Video, HTML5, Audio, PPT, Excel, Word, and PDF.

• Commissioned professional development modules• Resources for students and families

• Frame formative assessment within a balanced assessment system• Articulate the formative assessment process• Highlight formative assessment practices and tools

• Commissioned professional development modules• Instructional materials for educators • Instructional materials for students

• Demonstrate/support effective implementation of the formative process• Focus on key content and practice from the Common Core State

Standards for Mathematics and English Language Arts

• High-quality vetted instructional resources and tools for educators• High-quality vetted resources and tools for students and families

• Reflect and support the formative process• Reflect and support the Common Core State Standards for Mathematics

and English Language Arts• Create Professional Learning Communities

Assessment Literacy Modules

Exemplar Instructional Modules

Education Resources

Digital Library Basics, 2-26-14

Resources in the Digital Library

Assessment Literacy Modules

Exemplar Instructional Modules

Education Resources

* Resources include the following file types: Video, HTML5, Audio, PPT, Excel, Word, and PDF.

• Not an assessment bank• Not an item bank• Not a learning management

system where educators can register for training or receive credit by completing specific online courses

• Not a library for general public (will require registration and login)

• Not a site where any resource can automatically be posted; all resources must be vetted through the Quality Criteria

Digital Library Basics, 2-26-14

Grounded in this Definition of Formative Assessment Process

• Formative Assessment is a deliberate process used by teachers and students during instruction that provides actionable feedback that is used to adjust ongoing teaching and learning strategies to improve students’ attainment of curricular learning targets/goals.

~ Compiled by the Digital Library National Advisory Panel

Digital Library Basics, 2-26-14

All Resources are Grounded in the Four Attributes of the Formative Assessment Process

and Reviewed using Quality Criteria

Clarify IntendedLearning

Elicit Evidence

Act onEvidence

Interpret Evidence

Digital Library Basics, 2-26-14

Quality Criteria for Professional Learning Resources

The resource…

1) Reflects research and/or the principles of effective professional learning

2) Incorporates formative assessment practices

3) Supports learner differences and personalized learning

4) Demonstrates utility, engagement, and user-friendliness

5) Integrates technology and media effectively

Digital Library Basics, 2-26-14

Quality Criteria for Instructional Resources

The resource…

1) Aligns with the intent of the Common Core State Standards

2) Incorporates formative assessment practices

3) Contains accurate, complete, high-quality curriculum and instruction

4) Supports learner differences and personalized learning

5) Demonstrates utility, engagement, and user-friendliness

6) Integrates technology and media effectively

Digital Library Basics, 2-26-14

SNE Resource Recommendation Options

• Recommend with distinction• Recommend• Recommend with revisions• Do not recommend

Do not recommend

Recommend with revisions

Digital Library Basics, 2-26-14

Resource Posting Work FlowStep 1:

Resource Submitted

Step 3:Quality Criteria Applied

Step 4:Decision

Step 2:Gatekeeping

Criteria Applied

SNE1

SNE2

SNE3

SNE1

Posted

Sent to SLT

Returned to Submitter

Cover Profile

03/20/2014 Slide 38

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Smarter Balanced – Who and When? OSPI staff involved in workgroups 2010-2014 WA teachers involved 2011-2014

Item and stimulus writing and review Alignment Study Achievement Level Descriptors

Pilot in spring 2013 Practice Tests widely available in May 2013 Comprehensive summative field test in 2013-14

Digital Library - State Networks of Educators began vetting resources to populate the library in Fall 2013

“Soft Launch” of the Digital Library in late Spring 2014

All components of Smarter Balanced operational in 2014-15 Full Digital Library in fall 2014 Interim assessments available late fall 2014 Summative assessments administered in spring 2015

Resources For You! For the latest news and developments on

Smarter Balanced in Washington: http://www.k12.wa.us/smarter/default.aspx

Materials for administration, as well as communication templates for parents and community: http://sbac.portal.airast.org/field-test/resources/

For questions about Smarter Balanced or the assessment system transitions, contact: Assessment@k12.wa.us 360-725-6348

03/20/2014 Slide 40

OFFI

CE O

F SU

PERI

NTEN

DENT

OF

PUBL

IC IN

STRU

CTIO

N

Happy Field Testing!!!!!

8.30.2007 | Slide 41

2007 WASL: Preparing Students to Live, Learn and Work in the 21st Century

Thank you!