BestBestAssessmentAssessment

Practices Practices

AGENDAAGENDA

Introductions & HistoryJon S. Twing, Ph.D., Pearson

Where Do We Go From Here?Lisa Ehrlich, Ph.D., Measured Progress

How To Use the Best PracticesJoe Willhoft, Ph.D., Washington DOE

Wes Bruce, Indiana DOE

Distinguished Commentary and VisionGene Wilhoit, Executive Director, Council of Chief

State School Officers (CCSSO)

2

Introductions & HistoryIntroductions & History

Jon S. Twing, Ph.D., Pearson

Long Duration-Collaborative Effort- 2007-2010- ATP, CCSSO- A lot of hard work by a lot of people

Purpose was to define and describe best practices in operational fulfillment of large-scale, high-stakes assessment- Voluntary, inclusive and non-proprietary- Tells us what to do, not how to do it- Applicable to other venues like Common Core

Process involved internal and external review, professional editing and publishing

HISTORYHISTORY 4

FORESHADOWS OF THE FORESHADOWS OF THE FUTUREFUTURE

Many requests made for the Best Practices document have already been made:

- US Inspector General

- GAO

- States for inclusion in RFP’s

- Service Providers for inclusion in Proposals

- For use as Training Materials

The need seems present and time will tell if the publication is a success

5

Where Do We Go From Where Do We Go From Here?Here?

Lisa Ehrlich, Ph.D., Measured Progress

WHERE DO WE GO FROM WHERE DO WE GO FROM HERE?HERE?

Use of Best Practices document by service providers

How do I get a copy?

Version II – yikes!

7

SERVICE PROVIDER USESERVICE PROVIDER USE

Guideline for statewide assessment programs

RFP requirement for contract work

Baseline for operational program standardsUsed to improve or refine existing procedures

or processes

Gap analysis to identify area(s) needing

attention

Training document for new employees

8

HOW DO I GET A COPY?HOW DO I GET A COPY?

To be notified when the document is on Amazon, please send an email to: operationalbestpractices@gmail.com

Complementary copies for States and ATP publishers/vendors

Posted for sale on central site linked to CCSSO and ATP sites

Comprehensive Best Practices communication plan with AAP Test Committee developed

A webinar will be held on July 28th to introduce the document, for more information please send an email to: operationalbestpractices@gmail.com

9

VERSION II OF BEST VERSION II OF BEST PRACTICESPRACTICES

Convene new working group in 2011 to begin work on Version II document.

- On line assessment expanded

- Accommodations

- Race to the Top program requirements

Want to participate? Please contact Bob Olsen (roberto@ccsso.org) or Alan Thiemann (ajthiemann@gmail.com).

10

How To Use the Best How To Use the Best PracticesPractices

Joe Willhoft, Ph.D., Washington DOE

CHANGES IN OUR WORKCHANGES IN OUR WORK

Race to the Top

- Consortia & Common Core Standards and Assessment

◦Integrated Comprehensive Assessment System

◦Developed Over Next four Years

◦Includes Summative and Formative Components

◦Includes Common Achievement Standards, Item Bank, and Reporting System

◦Computer Adaptive

12

CHANGES IN OUR WORK CHANGES IN OUR WORK (CONT’D)(CONT’D)

-Timeline

◦Proposals Due to U.S Department of Education (USED) June 23

◦USED Decision to states by end of September

◦Work Beginning October 2010

◦Assessments in place 2014-2015

13

CHANGES IN OUR WORK CHANGES IN OUR WORK (CONT’D)(CONT’D)

-Teacher Involvement Like Never Before

◦Need to Understand the Basic Process and Collaborate on the Plan

-Consortia and State Policy must follow Best Practices

◦More than ever we require common language for states, districts, teachers, and vendors

14

USING BEST PRACTICE HERE AND USING BEST PRACTICE HERE AND NOWNOW

-Near-term work for states and vendors◦Next 3-4 Years for Ongoing Activities

-Need for continuation of best practices◦New Contracts and Amendments

◦New Staff and Training

◦Online Testing

15

How To Use the Best How To Use the Best PracticesPractices

Wes Bruce, Indiana DOE

WHY STATES NEED BEST WHY STATES NEED BEST PRACTICESPRACTICES

States have much to lose when operational breakdowns occur-Direct impact on students and families- Loss of credibility for the assessment- Impact on Federal & State Accountability Systems-Provides a reason for “change”-Policy implications- Legislative/budget implications

17

WHY STATES NEED BEST WHY STATES NEED BEST PRACTICESPRACTICES (CONT’D)(CONT’D)

Capacity of SEA staffing- Turnover at SEAs- Capacity building and training

Removes some of client/service provider tensions

- Cooperation critical to success – provides common goal

- “Partnership” model can be more flexible than a strict procurement model

Helps provide metrics, success indicators and early warning mechanisms in a systemic fashion

- Helps planning and avoids reacting on short notice to unexpected events

18

HOW WILL STATES USE THE HOW WILL STATES USE THE “BEST PRACTICES”?“BEST PRACTICES”?

Professional Development

Procurement

Policy Guidance/Defense

19

PROFESSIONAL DEVELOPMENTPROFESSIONAL DEVELOPMENT

New State Assessment Director-Has an “Owner’s Manual”

New Assessment Staff Member- Specific chapters based on responsibility

Working committees

- A resource to help understand complexities and demands of large scale

20

PROCUREMENTPROCUREMENT

Inclusion in RFP

- Specific portions

- By reference

Use as a tool for proposal evaluation

- Ability to demonstrate adherence to these standards

Contract

- Establishing common expectations for quality and deliverables

21

POLICY GUIDANCE/DEFENSEPOLICY GUIDANCE/DEFENSE

Reference for policy makers, legislators and staff on the how and why of assessment practice

Use when testifying to committees

State Policy Makers

- A reference to demonstrate our estimates of time needed for quality are supported by the industry

- A demonstration of where costs come from in the assessment program

22

Distinguished Distinguished Commentary and VisionCommentary and Vision

Gene Wilhoit, Executive Director, Council of Chief State School Officers (CCSSO)