EVALUATOR EVALUATOR ORIENTATIONORIENTATION

Serving on Off-Site and On-Site CommitteesServing on Off-Site and On-Site Committees

OVERVIEWOVERVIEW

TYPES OF COMMITTEESTYPES OF COMMITTEES

Reaffirmation Committee (Off-Site Reaffirmation Committee (Off-Site Review Committee or On-Site Review Review Committee or On-Site Review Committee)Committee)

Substantive Change CommitteeSubstantive Change Committee Special CommitteeSpecial Committee Candidacy CommitteeCandidacy Committee Accreditation CommitteeAccreditation Committee

INVITATIONS TO SERVE AS AN INVITATIONS TO SERVE AS AN EVALUATOREVALUATOR

Invitations Come From Commission Invitations Come From Commission Staff MemberStaff Member

Usually Invitations Are By E-MailUsually Invitations Are By E-Mail Reply Promptly And Check For Conflict Reply Promptly And Check For Conflict

of Interest Because Declines Must Be of Interest Because Declines Must Be Replaced As Quickly As PossibleReplaced As Quickly As Possible

Evaluators Are Selected from Evaluators Are Selected from Evaluator Registry Evaluator Registry

EVALUATOR REGISTRYEVALUATOR REGISTRY

Arranged by level, type institution, Arranged by level, type institution, categorycategory

Contains records of visits and ratings Contains records of visits and ratings by chair and staffby chair and staff

Contains relevant comments Contains relevant comments concerning performance of concerning performance of committee memberscommittee members

Helpful InformationHelpful Information

• Handbook for Peer EvaluatorsHandbook for Peer Evaluators

• Modules which can be accessed at Modules which can be accessed at www.sacscoctraining.orgwww.sacscoctraining.org

• COC Staff and Committee ChairsCOC Staff and Committee Chairs

Logistics of VisitsLogistics of Visits

Staff Member Sends InvitationsStaff Member Sends Invitations Staff Sends Packets with Forms, Staff Sends Packets with Forms,

Handbooks, Principles, Travel Handbooks, Principles, Travel Information, Information Outline Information, Information Outline FormForm

Committee Member Arranges Travel Committee Member Arranges Travel and Submits Expense Voucher After and Submits Expense Voucher After the Visit for Expensesthe Visit for Expenses

Logistics……..Logistics……..

Institution (for On-Site Review Committees Institution (for On-Site Review Committees and other types of committees) or and other types of committees) or Commission Staff (for Off-Site Review Commission Staff (for Off-Site Review Committees meeting in Atlanta) Arranges Committees meeting in Atlanta) Arranges for Accommodations and Provides for Accommodations and Provides Information Concerning Transportation To Information Concerning Transportation To and From Airportand From Airport

Institution (for On-Site and others) Or Staff Institution (for On-Site and others) Or Staff (for Off-Site) Seeks Information on Dietary (for Off-Site) Seeks Information on Dietary Needs and Computer Needs (for On-Site)Needs and Computer Needs (for On-Site)

Staff, Chair, and Institution Communicate Staff, Chair, and Institution Communicate with Evaluatorswith Evaluators

QUALITIES OF AN EFFECTIVE QUALITIES OF AN EFFECTIVE COMMITTEE MEMBERCOMMITTEE MEMBER

Responds Promptly to InvitationsResponds Promptly to Invitations Within Reason, for On-Site Review Is Within Reason, for On-Site Review Is

Considerate of Institution in Making Considerate of Institution in Making Travel Plans and Providing Travel Plans and Providing InformationInformation

Reviews Materials Thoroughly Before Reviews Materials Thoroughly Before the Visitthe Visit

Qualities…….Qualities…….

On Time for Meetings, TransportationOn Time for Meetings, Transportation Has an Understanding of Best Has an Understanding of Best

Practices in Higher Education in Practices in Higher Education in His/Her Area of ExpertiseHis/Her Area of Expertise

Uses Professional Judgment in Uses Professional Judgment in Applying Best PracticesApplying Best Practices

Qualities…..Qualities…..

Is Fair and Objective In EvaluationIs Fair and Objective In Evaluation Is Willing To Make Difficult DecisionsIs Willing To Make Difficult Decisions Works with Other Committee Works with Other Committee

Members in Reaching Consensus Members in Reaching Consensus about Issuesabout Issues

Submits Expense Voucher Submits Expense Voucher Immediately after Visit with Immediately after Visit with Appropriate ReceiptsAppropriate Receipts

COMMONLY USED MATERIALSCOMMONLY USED MATERIALS

Principles of AccreditationPrinciples of Accreditation Handbook for Peer EvaluatorsHandbook for Peer Evaluators Training ModulesTraining Modules Review and Writing AssignmentsReview and Writing Assignments Tentative AgendaTentative Agenda Materials from Institution(s)Materials from Institution(s) Materials from Commission StaffMaterials from Commission Staff

The Review Process The Review Process for Reaffirmation of for Reaffirmation of

AccreditationAccreditationOVERVIEWOVERVIEW

Review of Compliance by Off-Site Review of Compliance by Off-Site Review CommitteeReview Committee

Report of Report of Off-Site Review CommitteeOff-Site Review Committee Shared with InstitutionShared with Institution

The Review Process…..The Review Process…..

Review by On-Site CommitteeReview by On-Site Committee of Quality of Quality Enhancement Plan and Compliance Issues Enhancement Plan and Compliance Issues (as identified by Off-Site Review (as identified by Off-Site Review CommitteeCommittee or which arise during On-Siteor which arise during On-Site visit) visit)

Report Completed by On-Site Review Report Completed by On-Site Review CommitteeCommittee Sent to Institution and Sent to Institution and Commission as Basis on which Action Is Commission as Basis on which Action Is TakenTaken

EVALUATOR EVALUATOR ORIENTATIONORIENTATION

The Off-Site ReviewThe Off-Site Review

SERVING AS AN EVALUATOR SERVING AS AN EVALUATOR ON AN OFF-SITE COMMITTEEON AN OFF-SITE COMMITTEE

OFF-SITE REVIEW COMMITTEEOFF-SITE REVIEW COMMITTEE7-9 MEMBERS7-9 MEMBERS

ChairChair Finance EvaluatorFinance Evaluator Institutional Institutional

Effectiveness Effectiveness EvaluatorEvaluator

Organization and Organization and Administration Administration EvaluatorEvaluator

Student Support Student Support EvaluatorEvaluator

Learning Support Learning Support EvaluatorEvaluator

Educational Program Educational Program Evaluators (Number Evaluators (Number Varies Depending on Varies Depending on Complexity of Complexity of Cluster Institutions)Cluster Institutions)

OFF-SITE REVIEW COMMITTEEOFF-SITE REVIEW COMMITTEETASKS Phase ITASKS Phase I

Phase I: Phase I: Each Committee Member Receives Each Committee Member Receives

Materials and Reviews Compliance in Materials and Reviews Compliance in Assigned Area(s) for Each of the Three or Assigned Area(s) for Each of the Three or

Four Institutions in the Four Institutions in the Cluster(approximately Cluster(approximately six to eight weeks six to eight weeks before meeting in Atlanta)before meeting in Atlanta)

Each Committee Member Completes a Each Committee Member Completes a Draft Draft Report for His/Her Review Report for His/Her Review Assignments for Assignments for Each Institution in the Each Institution in the Cluster and Cluster and Sends It Sends It to the Chairto the Chair

Phase IIPhase II

Phase II: Phase II:

Committee Meets in Atlanta for Committee Meets in Atlanta for Parts of Parts of Three Days to Review, Three Days to Review, Discuss and Discuss and Determine Compliance Determine Compliance for Each for Each Institution in the ClusterInstitution in the Cluster

Committee Completes a Report Committee Completes a Report for for Each Institution in the ClusterEach Institution in the Cluster

WHAT ARE CLUSTERS?WHAT ARE CLUSTERS?

A Group of Three or Four Institutions A Group of Three or Four Institutions Sharing Similar Characteristics Sharing Similar Characteristics

Assigned to an Assigned to an Off-Site ReviewOff-Site Review CommitteeCommittee for Review (Called a for Review (Called a Cluster Committee)Cluster Committee)

THE OFF-SITE REVIEWTHE OFF-SITE REVIEWPurposePurpose

Provide Assessment of ComplianceProvide Assessment of Compliance Core Requirements 1-11Core Requirements 1-11 Comprehensive Standards and Federal Comprehensive Standards and Federal

RequirementsRequirements

Provide Advice To Staff as Provide Advice To Staff as Appropriate Concerning Make-Up of Appropriate Concerning Make-Up of On-Site CommitteeOn-Site Committee

THE OFF-SITE REVIEWTHE OFF-SITE REVIEWPROCESSPROCESS

“Key Players”“Key Players”

InstitutionInstitution Commission StaffCommission Staff Off-Site Review CommitteeOff-Site Review Committee

Role of InstitutionRole of Institution

Conducts Compliance ReviewConducts Compliance Review Completes Compliance CertificationCompletes Compliance Certification Submits Compliance Certification Submits Compliance Certification

and Materials Demonstrating and Materials Demonstrating Compliance To Off-Site Review Compliance To Off-Site Review Committee Members (Hard Copy or Committee Members (Hard Copy or Transmitted Electronically)Transmitted Electronically)

MATERIALS SENT BY MATERIALS SENT BY INSTITUTIONINSTITUTION

HARD COPYHARD COPY

Compliance CertificationCompliance Certification

Summary Form (with identification of Summary Form (with identification of technical support person if some of technical support person if some of materials have been sent electronically)materials have been sent electronically)

CatalogCatalog

Financial Audit and Management Letter Financial Audit and Management Letter and Financial Aid Auditand Financial Aid Audit

Materials Sent by Materials Sent by Institution…Institution…

HARD COPY OR ELECTRONICALLY HARD COPY OR ELECTRONICALLY TRANSMITTEDTRANSMITTED

Institutional Effectiveness MaterialsInstitutional Effectiveness Materials

By-Laws, Minutes, Make-Up of BoardBy-Laws, Minutes, Make-Up of Board

Faculty Roster Denoting QualificationsFaculty Roster Denoting Qualifications

Policy ManualsPolicy Manuals

Other Materials Demonstrating Other Materials Demonstrating ComplianceCompliance

Role of Commission StaffRole of Commission Staff

Select and Invite Chair and Members of Select and Invite Chair and Members of Off-Site Review Committee for Each ClusterOff-Site Review Committee for Each Cluster

Send Roster and Pertinent Information to Send Roster and Pertinent Information to Chair and Committee MembersChair and Committee Members

Send Roster of Off-Site Review Committee Send Roster of Off-Site Review Committee to Institutions in Clusterto Institutions in Cluster

Role of Staff……..Role of Staff……..

Make Arrangements for Meeting in Make Arrangements for Meeting in AtlantaAtlanta

Communicate with Chair and Communicate with Chair and Committee Members and Institutions Committee Members and Institutions in the Clusterin the Cluster

Provide Support during Meeting in Provide Support during Meeting in AtlantaAtlanta

Materials Sent to Chair and Materials Sent to Chair and Committee Members by StaffCommittee Members by Staff

Roster of Off-Site Review CommitteeRoster of Off-Site Review Committee Handbook for Peer EvaluatorsHandbook for Peer Evaluators Principles of AccreditationPrinciples of Accreditation Blank Report of Report of the Blank Report of Report of the

Reaffirmation CommitteeReaffirmation Committee

Materials Sent by Staff…..Materials Sent by Staff…..

Review Assignments for Each Review Assignments for Each Committee MemberCommittee Member

Review Schedule for Institutions in Review Schedule for Institutions in ClusterCluster

Information Concerning Travel and Information Concerning Travel and Housing for the Meeting in AtlantaHousing for the Meeting in Atlanta

Expense VouchersExpense Vouchers

THE OFF-SITE REVIEW PRIOR TO THE THE OFF-SITE REVIEW PRIOR TO THE

MEETING IN ATLANTA (PHASE I)MEETING IN ATLANTA (PHASE I)

Review the Principles of AccreditationReview the Principles of Accreditation Review the Handbook for Review CommitteesReview the Handbook for Review Committees Review List of Institutions in the ClusterReview List of Institutions in the Cluster Contact Staff IMMEDIATELY if you discover a Contact Staff IMMEDIATELY if you discover a

conflict of interest with any of the institutions conflict of interest with any of the institutions in the Clusterin the Cluster

Check the List of Materials Sent by the Check the List of Materials Sent by the Institution and by StaffInstitution and by Staff

Call the Staff Member if an Item Is Call the Staff Member if an Item Is MissingMissing

Call the Technical Support Person at the Call the Technical Support Person at the Institution If You Cannot Access Institution If You Cannot Access Materials Sent ElectronicallyMaterials Sent Electronically

Do Not Otherwise Contact the InstitutionDo Not Otherwise Contact the Institution Familiarize Yourself With the InstitutionFamiliarize Yourself With the Institution

TASKSTASKS

Scan the Compliance Certification Scan the Compliance Certification DocumentDocument

Review Your Assignment (For Institutional Review Your Assignment (For Institutional Effectiveness Evaluators, Primarily Core Effectiveness Evaluators, Primarily Core Requirements 4 and 5 and Section 3).Requirements 4 and 5 and Section 3).

Review the Institution’s Compliance in the Review the Institution’s Compliance in the Area(s) of Your AssignmentArea(s) of Your Assignment

Communicate with Other Committee Communicate with Other Committee Members and the Chair as AppropriateMembers and the Chair as Appropriate

TasksTasks

Complete a Draft Report Reflecting Complete a Draft Report Reflecting Preliminary Assessment and Send It Preliminary Assessment and Send It to the Chair, Other Committee to the Chair, Other Committee Members, and StaffMembers, and Staff

Chair Will Compile Drafts Into One Chair Will Compile Drafts Into One Draft Report and Will Send It To Draft Report and Will Send It To Committee Members and StaffCommittee Members and Staff

Assessing ComplianceAssessing ComplianceInstitutional EffectivenessInstitutional Effectiveness

Familiarize yourself with mission of Familiarize yourself with mission of the institutionthe institution

Familiarize yourself with size of Familiarize yourself with size of institutions and programs offeredinstitutions and programs offered

Review institutional effectiveness Review institutional effectiveness documents provided by institutiondocuments provided by institution

Assessing Compliance……..Assessing Compliance……..

Read the narrative provided by the Read the narrative provided by the institution describing its processinstitution describing its process

Determine who is responsible for the Determine who is responsible for the process at the institutionprocess at the institution

Determine whether there is a Determine whether there is a timeline provided by which process timeline provided by which process functionsfunctions

Assessing compliance……Assessing compliance……

Is the process ongoing?Is the process ongoing? Is there evidence that it functions? Is there evidence that it functions?

What evidence might signal a What evidence might signal a functioning process?functioning process?

Is the process integrated? Is there Is the process integrated? Is there evidence that all areas of the evidence that all areas of the institution are engaged in planning institution are engaged in planning and evaluation?and evaluation?

Assessing compliance……Assessing compliance……

Is there evidence that the process is Is there evidence that the process is research-based?research-based?

Does it appear that meaningful goals Does it appear that meaningful goals and objectives are set by various units?and objectives are set by various units?

Are there various types of assessment Are there various types of assessment means used?means used?

Is there evidence that results of Is there evidence that results of assessment are used for improvement?assessment are used for improvement?

Assessing compliance……Assessing compliance……

Are there representative samples Are there representative samples from various units indicating that from various units indicating that student learning outcomes have student learning outcomes have been identified and that they are been identified and that they are assessed on a regular basis?assessed on a regular basis?

Is there evidence of improvement in Is there evidence of improvement in the various units?the various units?

COMMUNICATE WITH OTHER COMMUNICATE WITH OTHER COMMITTEE MEMBERSCOMMITTEE MEMBERS

Throughout the process of off-site Throughout the process of off-site evaluation, it is crucial that Committee evaluation, it is crucial that Committee members communicate with each other.members communicate with each other.

Communication is especially important Communication is especially important for the institutional effectiveness for the institutional effectiveness evaluator.evaluator.

The roster of Committee members will The roster of Committee members will contain e-mail addresses for assistance contain e-mail addresses for assistance in communication.in communication.

Communicate…Communicate…

Committee members should monitor Committee members should monitor e-mail frequently during the time of e-mail frequently during the time of review and respond as quickly as review and respond as quickly as possible.possible.

Staff and Chair should be copied on Staff and Chair should be copied on all e-mail so that they can render all e-mail so that they can render assistance and be aware of concerns.assistance and be aware of concerns.

WRITE A DRAFT REPORTWRITE A DRAFT REPORT

For each institution in the Cluster, For each institution in the Cluster, mark Compliance, Non-Compliance, mark Compliance, Non-Compliance, or Did Not Review for each of your or Did Not Review for each of your assigned Core Requirement(s), assigned Core Requirement(s), Comprehensive Standard(s), and/or Comprehensive Standard(s), and/or Federal Requirements.Federal Requirements.

Write narrative explaining specifically Write narrative explaining specifically why you made the determination of why you made the determination of compliance or non-compliancecompliance or non-compliance

Draft………Draft………

Make suggestions to staff as Make suggestions to staff as appropriate concerning the On-Site appropriate concerning the On-Site Review CommitteeReview Committee

Send your draft electronically to the Send your draft electronically to the Chair and other Committee members Chair and other Committee members and Staffand Staff

COMPLETING THE OFF-SITE COMPLETING THE OFF-SITE REVIEW IN ATLANTA (Phase II)REVIEW IN ATLANTA (Phase II)

Orientation Meeting of CommitteeOrientation Meeting of Committee The Committee, Led by the Chair and The Committee, Led by the Chair and

With Discussion by All Committee With Discussion by All Committee Members, Determines Compliance of Members, Determines Compliance of Each Institution in the ClusterEach Institution in the Cluster

The Committee Produces a The Committee Produces a ReportReport for for Each Institution in the ClusterEach Institution in the Cluster

Completing the Review in Completing the Review in Atlanta…Atlanta…

The Committee Agrees on All Areas The Committee Agrees on All Areas Marked Compliance or Non-Marked Compliance or Non-Compliance and Agrees on Narrative Compliance and Agrees on Narrative Supporting Each (Both Compliance Supporting Each (Both Compliance and Non-Compliance)and Non-Compliance)

THE FINAL REPORT OF THE THE FINAL REPORT OF THE OFF-SITE COMMITTEEOFF-SITE COMMITTEE

Compliance: The Committee has Compliance: The Committee has determined that the institution has determined that the institution has presented acceptable narrative and presented acceptable narrative and documentation demonstrating compliance.documentation demonstrating compliance.

Non-Compliance:Non-Compliance: The Committee has The Committee has determined, after review of the narrative determined, after review of the narrative and documentation presented by the and documentation presented by the institution, that the institution is not in institution, that the institution is not in compliance.compliance.

Completion of WorkCompletion of Work

The Committee’s Work Is Finished The Committee’s Work Is Finished After the Report Is CompletedAfter the Report Is Completed

The Committee Has No Contact with The Committee Has No Contact with Institutions Following Off-Site ReviewInstitutions Following Off-Site Review

A Special NoteA Special NoteCONFIDENTIALITYCONFIDENTIALITY

Maintain Confidentiality At All TimesMaintain Confidentiality At All Times Discuss the Institutions in the Cluster Discuss the Institutions in the Cluster

ONLY with Other Committee ONLY with Other Committee Members, Chair of the Committee, Members, Chair of the Committee, and Commission Staffand Commission Staff

Do Not Contact the Institution Do Not Contact the Institution (except tech support) Before, During, (except tech support) Before, During, or After the Review Activitiesor After the Review Activities

CHALLENGES OF THE OFF-SITE CHALLENGES OF THE OFF-SITE REVIEWREVIEW

Difficulty in assessing compliance Difficulty in assessing compliance only on paperonly on paper

Sometimes problems in accessing Sometimes problems in accessing materials (especially electronically)materials (especially electronically)

Amount of time needed to review Amount of time needed to review three or four institutionsthree or four institutions

EVALUATOR EVALUATOR ORIENTATIONORIENTATION

The On-Site VisitThe On-Site Visit

THE ON-SITE REVIEWTHE ON-SITE REVIEW

The Make-Up of the On-Site CommitteeThe Make-Up of the On-Site Committee The Tasks of the On-Site CommitteeThe Tasks of the On-Site Committee Preparing for the VisitPreparing for the Visit Conducting the VisitConducting the Visit

Reviewing ComplianceReviewing ComplianceReviewing the QEPReviewing the QEPWriting the ReportWriting the Report

Make-Up of the On-Site Make-Up of the On-Site CommitteeCommittee

ChairChair CEOCEO Institutional EffectivenessInstitutional Effectiveness Educational Programs and FacultyEducational Programs and Faculty Learning or Student Support ServicesLearning or Student Support Services Quality Enhancement Plan EvaluatorQuality Enhancement Plan Evaluator Others as NecessaryOthers as Necessary

TASKS OF ON-SITE TASKS OF ON-SITE COMMITTEECOMMITTEE

Review of Quality Enhancement Plan (Core Review of Quality Enhancement Plan (Core Requirement 12)Requirement 12)

Review Areas of Non-Compliance Cited by Review Areas of Non-Compliance Cited by Off-Site CommitteeOff-Site Committee

Consider Any Other Areas of Non-Consider Any Other Areas of Non-Compliance which Come to its AttentionCompliance which Come to its Attention

Refine or Revise Narrative Provided by Off-Refine or Revise Narrative Provided by Off-Site Committee for Compliance Site Committee for Compliance

Write a Report To Be Sent to Committees Write a Report To Be Sent to Committees on Compliance and Reportson Compliance and Reports

Conduct an Exit ConferenceConduct an Exit Conference

PREPARING FOR VISITPREPARING FOR VISIT

Make Arrangements (Communicate with Make Arrangements (Communicate with Staff, Chair, Institution as Appropriate)Staff, Chair, Institution as Appropriate) Travel—Arrive by first meeting timeTravel—Arrive by first meeting time See Handbook concerning preparationsSee Handbook concerning preparations

Review Materials ThoroughlyReview Materials Thoroughly

Off-Site Committee ReportOff-Site Committee Report

Institution’s Focused ReportInstitution’s Focused Report

Quality Enhancement PlanQuality Enhancement Plan

Review/Writing AssignmentsReview/Writing Assignments

Preparing for Visit……Preparing for Visit……

Determine Interviews Desired and Determine Interviews Desired and Communicate to ChairCommunicate to Chair

Make Notes and Be Prepared To Make Notes and Be Prepared To Discuss Compliance Issues and QEP Discuss Compliance Issues and QEP Observations during a Conference Observations during a Conference Call (if the chair arranges one) and at Call (if the chair arranges one) and at the Orientation Meeting of the the Orientation Meeting of the CommitteeCommittee

CONDUCTING THE VISITCONDUCTING THE VISIT

Visit Takes Place Over Parts of Three Visit Takes Place Over Parts of Three DaysDays

Review Compliance Issues (Arrive at Review Compliance Issues (Arrive at Consensus Regarding Consensus Regarding Recommendations)Recommendations)

Review Quality Enhancement Plan Review Quality Enhancement Plan (Determine Acceptability Consistent (Determine Acceptability Consistent With Core Requirement 12)With Core Requirement 12)

Conducting the Visit……….Conducting the Visit……….

Complete Report (Indicate Compliance or Non-Complete Report (Indicate Compliance or Non-Compliance and Write Narrative as Appropriate) Compliance and Write Narrative as Appropriate)

QEP recommendations are placed under Core QEP recommendations are placed under Core Requirement 12.Requirement 12.

QEP supporting narrative is under Part III of the QEP supporting narrative is under Part III of the reportreport

Conduct an Exit ConferenceConduct an Exit Conference

Discussion of Findings (Staff, Chair, On-Site Discussion of Findings (Staff, Chair, On-Site Committee, Institution’s Leadership Team)Committee, Institution’s Leadership Team)

COMPLIANCE ISSUESCOMPLIANCE ISSUES

Consider Best Practices and Apply Consider Best Practices and Apply Professional Judgment in Determining Professional Judgment in Determining ComplianceCompliance

Draft Recommendations for Areas Where the Draft Recommendations for Areas Where the Institution Appears To Be Out of ComplianceInstitution Appears To Be Out of Compliance

Draft Narrative Explaining Specifically Why Draft Narrative Explaining Specifically Why There Is Non-ComplianceThere Is Non-Compliance

Reach Consensus with Entire Committee Reach Consensus with Entire Committee Concerning Compliance or Non-Compliance, Concerning Compliance or Non-Compliance, the Wording of Recommendations, and the the Wording of Recommendations, and the Narrative for All Requirements and StandardsNarrative for All Requirements and Standards

Compliance Issues….Compliance Issues….

Compliance Issues Not Cited by the Compliance Issues Not Cited by the Off-Site Committee May Come To the Off-Site Committee May Come To the Attention of the On-Site CommitteeAttention of the On-Site Committee

EVALUATING THE ACCEPTABILITY EVALUATING THE ACCEPTABILITY OF THE QEPOF THE QEP

Part of the Planning and Evaluation Part of the Planning and Evaluation Process?Process?

Focused (significant and manageable)Focused (significant and manageable) Institutional CapacityInstitutional Capacity Institutional Assessment ProvisionsInstitutional Assessment Provisions Broad-BasedBroad-Based Linked to Student Learning OutcomesLinked to Student Learning Outcomes Provide Input to Two Quality Enhancement Provide Input to Two Quality Enhancement

EvaluatorsEvaluators

SUMMARYSUMMARYTASKS OF ON-SITE EVALUATORTASKS OF ON-SITE EVALUATOR Prior to visit reviews Off-Site Report, Prior to visit reviews Off-Site Report,

Focused Report of Institution, and QEPFocused Report of Institution, and QEP During visit reviews any compliance issuesDuring visit reviews any compliance issues

Reviews documentsReviews documents

Interviews as necessaryInterviews as necessary

During visit assists in reviewing QEPDuring visit assists in reviewing QEP

Writes for assigned areas Writes for assigned areas (recommendations and/or narrative)(recommendations and/or narrative)

A Special NoteA Special NoteCONFIDENTIALITYCONFIDENTIALITY

Maintain Confidentiality At All TimesMaintain Confidentiality At All Times Discuss the Institution ONLY with Discuss the Institution ONLY with

Other Committee Members, Chair of Other Committee Members, Chair of the Committee, and Commission the Committee, and Commission StaffStaff

Do Not Contact the Institution After Do Not Contact the Institution After the Review Activitiesthe Review Activities

EVALUATOR EVALUATOR ORIENTATIONORIENTATION

Using Professional Judgment Using Professional Judgment and Applying Best Practicesand Applying Best Practices

Evaluating InstitutionsEvaluating Institutions

An Evaluator An Evaluator must consider what are best practices in must consider what are best practices in

any given areaany given area must carefully consider the institution’s must carefully consider the institution’s

“case” that it complies with a “case” that it complies with a requirement or standardrequirement or standard

must apply professional judgment in must apply professional judgment in determining compliancedetermining compliance

EXERCISING PROFESSIONAL EXERCISING PROFESSIONAL JUDGMENT IN DETERMINING JUDGMENT IN DETERMINING

COMPLIANCECOMPLIANCEExercised by peers during Exercised by peers during

evaluationevaluation

Based on your study in higher Based on your study in higher educationeducation

Based on your experiencesBased on your experiences

Based on your expertise in dealing Based on your expertise in dealing with with particular issues in higher particular issues in higher educationeducation

Professional Judgment…….Professional Judgment…….

Based on your understanding and Based on your understanding and application of Principles of application of Principles of AccreditationAccreditationBased on your evaluation of the Based on your evaluation of the soundness of the institution’s soundness of the institution’s analysis analysis relating to compliancerelating to complianceBased on your evaluation of the Based on your evaluation of the cogency cogency of the evidence of the evidence presented by the presented by the institutioninstitution

Evidence should be….Evidence should be….ReliableReliable The evidence is consistent The evidence is consistent

throughout the compliance throughout the compliance certification.certification.

CurrentCurrent The information supports an The information supports an assessment of the current assessment of the current status of the institution.status of the institution.

VerifiableVerifiable The evidence can be The evidence can be corroborated.corroborated.

CoherentCoherent The evidence is logical and The evidence is logical and consistent with other consistent with other patterns of evidence patterns of evidence presented.presented.

Evidence….Evidence….

ObjectiveObjective The evidence is based on The evidence is based on observable data and observable data and information.information.

RelevantRelevant The evidence directly The evidence directly addresses the requirement addresses the requirement or standard under or standard under consideration and should consideration and should provide the basis for the provide the basis for the institution’s actions institution’s actions designed to achieve designed to achieve compliance.compliance.

Evaluating the “Case” for Evaluating the “Case” for ComplianceCompliance

Reviewers ascertain Reviewers ascertain accuracy and adequacy of summaries and accuracy and adequacy of summaries and interpretations of the data to which they interpretations of the data to which they refer and whether the narratives and the refer and whether the narratives and the data combined support the institution’s data combined support the institution’s claim of compliance.claim of compliance.

As a reviewer on-site, you may wish to As a reviewer on-site, you may wish to examine documents and identify a group examine documents and identify a group of persons whom you wish to interview to of persons whom you wish to interview to gain additional insight.gain additional insight.

Conducting the ReviewConducting the Review

For Committees reviewing a cluster of For Committees reviewing a cluster of institutions during an Off-Site Review, each institutions during an Off-Site Review, each institution should be reviewed separately, institution should be reviewed separately, taking into consideration the mission of the taking into consideration the mission of the institution. institution.

Avoid “comparative compliance,” i.e., Avoid “comparative compliance,” i.e., determining compliance based on whether an determining compliance based on whether an institution is “at least more in compliance than institution is “at least more in compliance than another one.” Avoid comparing the institution another one.” Avoid comparing the institution to your institution.to your institution.

Conducting the Review….Conducting the Review….

On-Site evaluators should likewise avoid On-Site evaluators should likewise avoid “comparative compliance.”“comparative compliance.”

Remember that it is the responsibility of Remember that it is the responsibility of the institution to establish compliance. the institution to establish compliance. It is the Committee’s responsibility to It is the Committee’s responsibility to determine whether the institution has determine whether the institution has established compliance or not.established compliance or not.

Conducting the Review…..Conducting the Review…..

Look first at the “case” the institution Look first at the “case” the institution makes for compliance.makes for compliance.

Then assess whether you think the Then assess whether you think the institution’s “case” and the institution’s “case” and the documents which it provides in documents which it provides in support of its “case” are sufficient.support of its “case” are sufficient.

Conducting the Review….Conducting the Review….

Review components of your Review components of your assignment which can be quickly assignment which can be quickly determineddetermined

Then review components of your Then review components of your assignment which may require assignment which may require discussion with other Committee discussion with other Committee members and more in-depth analysismembers and more in-depth analysis

PEER EVALUATIONPEER EVALUATION

Integrity of Accreditation Depends on Integrity of Accreditation Depends on the Willingness of Peer Evaluators to the Willingness of Peer Evaluators to Make Fair, Well-Thought-Out, Objective, Make Fair, Well-Thought-Out, Objective, and Sometimes Difficult Decisionsand Sometimes Difficult Decisions

Decisions about Compliance Are Made Decisions about Compliance Are Made To Assist Institutions in Improving the To Assist Institutions in Improving the Quality of Their Operations and Quality of Their Operations and ServicesServices