Ohhhhh, Christopher Robin, I am not the right one for this job . . .The House on Pooh Corner, A.A. Milne

The Renaissance The Renaissance GroupGroup

National consortium of National consortium of institutions with a major institutions with a major commitment to the commitment to the preparation of educatorspreparation of educators

One in every 10 teachers One in every 10 teachers in America is educated in in America is educated in Renaissance institutions.Renaissance institutions.

Operating Operating PrinciplesPrinciples

● Teacher education as an all-campus Teacher education as an all-campus responsibility.responsibility.

● Campus culture values and models quality Campus culture values and models quality teaching.teaching.

● Partnerships with practicing professionals.Partnerships with practicing professionals.

● Extensive use of field placements in Extensive use of field placements in diverse settings.diverse settings.

Operating Operating PrinciplesPrinciples

● Adherence to high standards and Adherence to high standards and accountability.accountability.

● Focus on P-12 student learning.Focus on P-12 student learning.

● Effective use of technology.Effective use of technology.

● Development of teachers as creative and Development of teachers as creative and innovative leaders.innovative leaders.

Title II grant to develop an Title II grant to develop an evidence-based model of evidence-based model of teacher preparation. 1999-teacher preparation. 1999-2005 2005 ● Engage candidates in using evidence of Engage candidates in using evidence of

student learning to guide professional student learning to guide professional practice.practice.

● Gather data to improve programs.Gather data to improve programs.

RTWS RTWS CharacteristicsCharacteristics

● Models assessment as learning (Alverno)Models assessment as learning (Alverno)

● Reflects the learning-teaching processReflects the learning-teaching process

● Includes P-12 student performancesIncludes P-12 student performances

● Engages candidates, education and arts Engages candidates, education and arts and sciences faculty, and school and sciences faculty, and school practitioners in the assessment processpractitioners in the assessment process

RTWS RTWS CharacteristicsCharacteristics● Generalizable across all content areas and Generalizable across all content areas and

grade levels, including special educationgrade levels, including special education

● Adaptable to individual institutions, programs, Adaptable to individual institutions, programs, and P-12 school contextsand P-12 school contexts

● Locally administered and scoredLocally administered and scored

● Includes strategies for standard setting Includes strategies for standard setting and gathering credibility evidenceand gathering credibility evidence

The RTWS is The RTWS is notnot a licensure a licensure test!!!!! test!!!!!

The RTWS The RTWS isis . . . . . .. .● An exhibit of teaching performance An exhibit of teaching performance

● One method of documenting the candidate’s One method of documenting the candidate’s ability to design and implement standards-ability to design and implement standards-based instruction, assess student learning, based instruction, assess student learning, and reflect on the learning-teaching processand reflect on the learning-teaching process

● Designed to be used with classroom Designed to be used with classroom observationsobservations

The RTWS TaskThe RTWS Task● Describe contextual factorsDescribe contextual factors

● Set learning goalsSet learning goals

● Design a unit of instruction, including an Design a unit of instruction, including an assessment planassessment plan

● Deliver and adjust instructionDeliver and adjust instruction

The RTWS TaskThe RTWS Task● Assess student performanceAssess student performance

● Analyze student learningAnalyze student learning

● Reflect on instruction and student learningReflect on instruction and student learning

Evidence = Written Product Evidence = Written Product and Artifactsand Artifacts

RTWS Vision of RTWS Vision of TeachingTeaching

● Contextual FactorsContextual Factors

● Learning GoalsLearning Goals

● Assessment PlanAssessment Plan

● Design for InstructionDesign for Instruction

● Instructional Decision-Instructional Decision-MakingMaking

● Analysis of Student Analysis of Student LearningLearning

● Reflection and Self-Reflection and Self-EvaluationEvaluation

Teaching Processes, Standards, Teaching Processes, Standards, IndicatorsIndicators

Washington Washington Standard 5Standard 5

● How consistent is the RTWS with How consistent is the RTWS with Standard 5 criteria?Standard 5 criteria?

● Will the instrument elicit student-Will the instrument elicit student-based evidence?based evidence?

● Does the instrument Does the instrument include opportunities for include opportunities for “student voice”?“student voice”?

Task InstructionsTask Instructions

● Performance prompt aligned Performance prompt aligned with targeted standards, with targeted standards, indicators, and scoring rubricindicators, and scoring rubric

● Manual for Student TeachersManual for Student Teachers

● Manual for MentorsManual for Mentors

Gathering Validity Gathering Validity EvidenceEvidence

Do the tasks elicit performances that Do the tasks elicit performances that represent the standards?represent the standards?

● Process based on early work of the NBPTS Process based on early work of the NBPTS (Crocker, 1997)(Crocker, 1997)

● Criticality, frequency, realism, balanceCriticality, frequency, realism, balance

● ““How To” Credibility ManualHow To” Credibility Manual

Achieving Scoring Achieving Scoring ReliabilityReliability

What is the dependability of judgments What is the dependability of judgments across different raters and scoring across different raters and scoring occasions?occasions?

● Rater Training, Training, Training Rater Training, Training, Training

● Evidence Roadmap and Scoring GuideEvidence Roadmap and Scoring Guide

Determining Determining ReliabilityReliability

To what extent is there consistency To what extent is there consistency of scoring across raters?of scoring across raters?

● Generalizability Theory (Shavelson & Generalizability Theory (Shavelson & Webb, 1991).Webb, 1991).

● ““How To” Credibility ManualHow To” Credibility Manual

UsabilityUsability● Supervisor and Cooperating Teacher Supervisor and Cooperating Teacher

Support – Manual for MentorsSupport – Manual for Mentors

● Candidate Support – Student Teacher Candidate Support – Student Teacher ManualManual

● Local and state standards & curriculumLocal and state standards & curriculum

● Compatible with P-12 policiesCompatible with P-12 policies

CostsCosts

● No cost to candidatesNo cost to candidates

● Cost to institution = Training and Cost to institution = Training and Credibility Studies + Data SystemCredibility Studies + Data System

● No equipment costsNo equipment costs

● Embedded in the work of schoolsEmbedded in the work of schools

Data ManagementData Management

What systems are in place to ensure What systems are in place to ensure routine use of assessment results as routine use of assessment results as part of a “culture of evidence.” part of a “culture of evidence.”

● Assessment databaseAssessment database

● Feedback to candidates and programFeedback to candidates and program

● Use of data for program improvementUse of data for program improvement

● Shift to instruction based on P-12 Shift to instruction based on P-12 student performance datastudent performance data

● University faculty accountable for University faculty accountable for their own teachingtheir own teaching

● Evidence-based improvements to Evidence-based improvements to teacher education programsteacher education programs

Study of RTWS consortium Study of RTWS consortium partners shows positive partners shows positive outcomes . . .outcomes . . .

● Increased faculty conversations Increased faculty conversations within and across departmentswithin and across departments

● Shared vision for teacher education Shared vision for teacher education and a common language for and a common language for discussing program improvementsdiscussing program improvements

● Program accountability systemsProgram accountability systems

Cowley, Vokel, & Finch (2005)Cowley, Vokel, & Finch (2005)Appalachia Educational Appalachia Educational LaboratoryLaboratory

The application of TWS for The application of TWS for high-stakes purposes is high-stakes purposes is being tested in three states:being tested in three states:

● OregonOregon

● KentuckyKentucky

● OklahomaOklahoma

We do not fully know We do not fully know the results of these the results of these applications.applications.More consideration More consideration must be given to issues must be given to issues associated with high-associated with high-stakes evaluation.stakes evaluation.

Access resources, Access resources, exemplars, case exemplars, case studies, publications, studies, publications, and researchand researchhttp://edtech.wku.edu/http://edtech.wku.edu/

rtwscrtwsc//