Commission on Teacher Credentialing Ensuring Educator Excellence 1 Program Assessment Technical...

11

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing

Ensuring Educator Excellence

Program AssessmentProgram AssessmentTechnical Assistance Technical Assistance

MeetingsMeetings

December 2009December 2009

22

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


AgendaAgenda

Agency OverviewAgency OverviewReview Accreditation Cycle Review Accreditation Cycle Program Assessment DocumentProgram Assessment DocumentGuidelines for SubmissionGuidelines for Submission Review, Feedback and DialogueReview, Feedback and DialogueRelationship to the Site VisitRelationship to the Site Visit

33

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Committee on AccreditationCOA Tasks in accordance with the

Accreditation Framework . . .

(1) Make decisions about the accreditation of educators’ preparation

(2) Make decisions about the initial accreditation of new programs of educator preparation

(3) Determine the comparability of standards submitted by applicants with those adopted by the Commission

44

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


COA Tasks COA Tasks (continued)(continued)

(4) Adopt guidelines for accreditation reviews, and monitor the performance of accreditation teams and other aspects of the accreditation system

(5) Report annually to the Commission

55

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Accreditation CycleAccreditation Cycle

Program Assessment (Yr 4)

Biennial Report (Yr 1)

Follow-up to Site Visit (Yr 7)



Site Visit (Yr 6)

66

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment

Year 4 of accreditation cycleYear 4 of accreditation cycle Purposes:Purposes:

– To determine To determine ifif and and howhow programs programs are aligned with program are aligned with program standardsstandards

– To aid in To aid in focusing the Site Visitfocusing the Site Visit that that will follow in Year 6.will follow in Year 6.

77

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment Program Assessment Documentation in 3 Parts Documentation in 3 Parts

Part IPart I– institutional response to institutional response to ProgramProgram

StandardsStandards Part IIPart II

– course syllabi or other evidence that course syllabi or other evidence that supports Part Isupports Part I

Part IIIPart III– assessments reported on in Biennial assessments reported on in Biennial

ReportReport

88

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part I

Initial Program Approval Initial Program Approval documentdocument– the dreamthe dream

Program Assessment documentProgram Assessment document– the realitythe reality

99

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part I - In DepthIn Depth

The Program Assessment document The Program Assessment document describes describes HOWHOW the program meets the program meets eacheach of the adopted program of the adopted program standards.standards.

1010

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



Begin by understanding the entire standard

Take the standard apart sentence by sentence

Respond to each part of the standard

Provide appropriate evidence

1111

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



Respond to key verbs or phrases from each sentence of the standard– The program provides…– The program prepares candidates

to…– Candidates have multiple,

systematic opportunities to…– Candidates are required to

demonstrate …

1212

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



Practice by reviewing some current Practice by reviewing some current program standardsprogram standards

1313

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



The program provides . . .The program provides . . .

Candidates have opportunities to . . .Candidates have opportunities to . . .

Candidates demonstrate . . .Candidates demonstrate . . .

1414

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing



The program response to each portion The program response to each portion of the standard is theof the standard is the

HOWHOWthe program meets the standardthe program meets the standard

One idea for considerationOne idea for consideration Additional ideas from participantsAdditional ideas from participants

1515

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part I - Part I - ReviewReview

Any questions about Any questions about Part IPart I??

Any ideas to share with others?Any ideas to share with others?

1616

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part II - Evidence

Provides the Provides the supporting evidencesupporting evidence for for responses to standardsresponses to standards

Ideas:Ideas:

* Copy and paste * Copy and paste examplesexamples

* Indicate in the narrative of Part I * Indicate in the narrative of Part I

specifically wherespecifically where to find the evidence to find the evidence

in Part II— tab, page numberin Part II— tab, page number

* * Hyperlink Hyperlink to the syllabusto the syllabus

1717

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part II - Evidence

If your institution uses a particular form as a template or course outline that is required as the core of each course,– you may submit that one course outline in

your Program Assessment document.

If each instructor designs their section of the course on their own, – include each course syllabi for all courses

taught in the two years prior to Program Assessment.

1818

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part II - ReviewPart II - Review

Any questions about Any questions about Part IIPart II??

Any ideas to share with others?Any ideas to share with others?

1919

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part III - Assessment Information Assessment Information

Provide the actual assessments reported in Biennial Report– Rubrics– Observation forms– Portfolio guidelines

Provide detailed information on the assessments

Readers will have copies of the Biennial Report

2020

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part III - Assessment InformationAssessment Information

How good is good enough? What does it look like?

Describe how you ensure that assessment measures are used in the same manner regardless of location, number of faculty, etc.

2121

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part III - Assessment InformationAssessment Information

MS/SS Programs do not need to include background information on the TPA model.

MS/SS Programs do need to include information on . . .– assessor training,– rescoring procedures, and – information that connect with Standards

17, 18 and 19 (formerly 19-21.)

2222

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Part III - Review

Any questions about Part III?

Any ideas to share with others?

2323

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


NEW Program StandardsNEW Program Standards

During Transition . . .Institutions have options for

responding to Program Assessment. These options will be noted as new standards are approved.

2424

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Transitioning StandardsTransitioning Standards

Education Specialist (2008-09)Education Specialist (2008-09) Multiple and Single Subject (2009)Multiple and Single Subject (2009) Preliminary Admin Services (2009)Preliminary Admin Services (2009) Career Technical Education (2008)Career Technical Education (2008) School Nurse (2008)School Nurse (2008) Bilingual Authorization (2008)Bilingual Authorization (2008)

2525

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment

Ongoing 7 year Accreditation Cycle Develop a process to continually

update program documents.

Continuous review and update of the document will save programs from having to write it all in preparation for Year 4 of the cycle.

2626

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram AssessmentGuidelines for SubmissionGuidelines for Submission

Options

– 1 CD/flash drive with all parts

– Posted on a website with on-line review

– Email submissions. Attachments larger than 10MB must be broken into multiple emails and zipped files cannot be accepted through the CTC mail server. [email protected]

– Due dates - the 15th of . . .

October, November, or December

2727

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram AssessmentGuidelines for SubmissionGuidelines for Submission

Each program selects the 15th of October, November, or December.

Deans/Directors will get a letter by the end of January asking for the date of submission each program has selected.

2828

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram AssessmentGuidelines for Submission Guidelines for Submission

E-mail:E-mail:

[email protected]@ctc.ca.gov

Mail to:Mail to:

Commission on Teacher CredentialingCommission on Teacher Credentialing1900 Capitol Avenue1900 Capitol AvenueSacramento, CA 95811Sacramento, CA 95811ATTN: PSD Program AssessmentATTN: PSD Program Assessment

2929

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram AssessmentFormatting SuggestionsFormatting Suggestions

MS Word or PDF documentMS Word or PDF document 12pt Times New Roman or Arial font12pt Times New Roman or Arial font Hyperlinks from narrative to Hyperlinks from narrative to

attachments (syllabi, assessments) attachments (syllabi, assessments) and back to the specified point in the and back to the specified point in the narrative.narrative.

Bookmarks (available in PDFs only) Bookmarks (available in PDFs only) are very useful to readers.are very useful to readers.

3030

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram AssessmentReview ProcessReview Process

Two trained readers per document Calibration of readers prior to reading first

document Each document is initially read during the

meeting Readers review

– Is the HOW described?

– Does the HOW meet the standard?

– Is there adequate supporting evidence?

3131

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Feedback and DialogueFeedback and Dialogue

Feedback will be either– Preliminarily Aligned OR– More Information is Needed

First reading opens dialogue with program that could last for 12-15 months

3232

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Examples of FeedbackExamples of Feedback

Possible Comments Specifics of HOW the standard is

addressed are needed The narrative response needs to

reflect the standard The evidence does not support the

narrative

3333

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Preliminary Report of Findings

A minimum of 3 months prior to the scheduled site visit the process comes to closure…– All standards are Preliminarily Aligned

or

– Standards not aligned focus the site visit team’s work

Or

– A program specific team member is added to the site visit team to fully review the program on site.

3434

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Preliminary Report of FindingsPreliminary Report of Findings

Report provided to– Program Contact and Dean/Director– COA– Commission Consultant assigned to

Site Visit– Site Visit Team

Final report issued three months to a year before the site visit.

3535

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Accreditation CycleAccreditation Cycle

are Common Standards and Program Standards implemented in an integrated, effective manner?

Biennial Reports

are programs effective in preparing competent educators?

are programs aligned with standards?

Site Visit

Program Assessment

3636

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram Assessment Use for Site VisitsUse for Site Visits

Prior to Site VisitResults of Program Assessment

guide selection of site visit team members

Preliminary Findings, questions and concerns are reviewed by the team

3737

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program Assessment SummaryProgram Assessment Summary

Document compiled from the Document compiled from the program narrative describing program narrative describing structure of the program with respect structure of the program with respect toto– Program Design– Curriculum– Field Experience– Candidate Competence

3838

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Use During Site VisitsUse During Site Visits

Results are confirmed, particularly through interviews

Team focuses on– Program Design– Curriculum– Field Experience– Candidate Competence

Inconsistencies with Preliminary Report of Findings may need additional review

3939

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


ResourcesResources

http://www.ctc.ca.gov/educator-prep/accred-implementation.html

Sign up for PSD News

[email protected]

4040

Co

mm

issi

on

on

Tea

cher

Cre

den

tial

ing


Program AssessmentProgram AssessmentQuestions?Questions?

Commission on Teacher Credentialing Ensuring Educator Excellence 1 Program Assessment Technical...

Documents

Transcript of Commission on Teacher Credentialing Ensuring Educator Excellence 1 Program Assessment Technical...