Standard 1Standard 1

The institution’s mission and goals define The institution’s mission and goals define the institutionthe institution

……evaluation proceeds from the evaluation proceeds from the institution’s own definition of its mission institution’s own definition of its mission and goals.and goals.

The institution engages in ongoing The institution engages in ongoing planning to achieve its mission and goals.planning to achieve its mission and goals.

Standard 1Standard 1

The institution’s mission and goals The institution’s mission and goals widely understood by, the campus widely understood by, the campus are periodically reexaminedare periodically reexaminedappears in appropriate institutional publications appears in appropriate institutional publications give direction to all its give direction to all its

» educational activities, educational activities, » to its admission policies, to its admission policies, » selection of faculty, selection of faculty, » allocation of resources, allocation of resources, » and to planning.and to planning.

Standard 1Standard 1

The institution reviews with the The institution reviews with the Commission Commission changes that would alter its mission changes that would alter its mission intention to offer a degree at a higher level than intention to offer a degree at a higher level than

is included in its present accreditation is included in its present accreditation

[Policy A-2 [Policy A-2 Substantive ChangeSubstantive Change]]

Standard 1Standard 1

Through its planning process, the Through its planning process, the institution asks questions, seeks answers, institution asks questions, seeks answers, analyzes itself, and revises its goals, analyzes itself, and revises its goals, policies, procedures, and resource policies, procedures, and resource allocation.allocation.

clearly defines its evaluation and planning clearly defines its evaluation and planning processes processes

engages in systematic planning engages in systematic planning process is participatory process is participatory

Faculty Data

Qualifications: degrees, sources of degrees, experience

Faculty Rank Salaries and Benefits. Comparison data, e.g. from

the College and University Personnel Association (CUPA)

Number, sufficient for the mission

Faculty Data

Workload Retention data Exit interview data Student survey data on faculty advising, etc. Standard faculty surveys with comparisons

Policies and Implementation

Academic planning, curriculum development and review

Academic advising Faculty role in governance

Give examples and data about how policies are applied.

Policies and Implementation

Salaries and Benefits Workload: amount and the procedure for

assignment Systematic faculty evaluation (See 4.1) Personnel policies and procedures Recruitment and appointment

Standard 4.B

ScholarshipResearchArtistic Creation

Time to Catch Up

If data is not available, make a plan to collect pertinent information.

If policies are not in place or outdated, inform decision makers and get moving!

Faculty Evaluation, 4.1

Clear proceduresOngoing, regularBased on the institution’s

SizeComplexityMission

Faculty Evaluation, 4.1

Multiple indices that may include Annual merit salary evaluations Promotions Tenure reviews Post-tenure reviews Student/peer/administrator evaluations of teaching and

service Peer review of scholarship

Faculty Evaluation, 4.1

A comprehensive evaluation of each faculty member at least once every five years.

A policy that addresses concerns that may arise between regular evaluations

Standard 9Standard 9

adheres to the highest ethical standards adheres to the highest ethical standards in its representationin its representation

advocates high ethical standards in the advocates high ethical standards in the management and operations management and operations

policy defines and prohibits conflict of policy defines and prohibits conflict of interest interest

commitment to the free pursuit and commitment to the free pursuit and dissemination of knowledge consistent with dissemination of knowledge consistent with the institution’s mission the institution’s mission

Data CollectionData Collection

Implement Trustworthy Methods Implement Trustworthy Methods

ReliabilityReliability Carry out systematic, well-defined processesCarry out systematic, well-defined processes Use well-designed instrumentsUse well-designed instruments

ValidityValidity Measure the right thingMeasure the right thing Minimize sources of contamination and biasMinimize sources of contamination and bias

SufficiencySufficiency Use multiple methodsUse multiple methods Think of how findings are supportedThink of how findings are supported

SamplingSampling Use proper sampling (mostly random)Use proper sampling (mostly random) Think of sample sizeThink of sample size

PROCESS & INPUT

DESCRIPTIONS

ANECDOTES & WAR STORIES

REPUTATIONFEELING & IMPRESSIONS

Data CollectionData Collection

Select MethodsSelect Methods

Embedded test questionsEmbedded test questions Capstone projectsCapstone projects Portfolio evaluationPortfolio evaluation Nationally normed testsNationally normed tests Focus groups , interviewsFocus groups , interviews Pre- and post-testingPre- and post-testing VideotapesVideotapes Outside expertsOutside experts Licensure and qualifying Licensure and qualifying

examinations.examinations. Research/creative projectsResearch/creative projects Review boardsReview boards

Telephone surveysTelephone surveys Internships, practicaInternships, practica Exit interviewsExit interviews Data from past reports and Data from past reports and

studiesstudies Narrative descriptionsNarrative descriptions SurveysSurveys Formal studiesFormal studies Interviews, focus groupsInterviews, focus groups Multiple sourcesMultiple sources Expert judgmentExpert judgment And many others . . . And many others . . .

Data Collection Data Collection

Get the data you need.Get the data you need.

““Mountains of data that never get Mountains of data that never get digested or used to improve programs digested or used to improve programs represent a monumental waste of represent a monumental waste of faculty/staff energy and good will.”faculty/staff energy and good will.”

Task Force on Assessment, Willamette U.Task Force on Assessment, Willamette U.

Data you need (part 1)Data you need (part 1)

For each Commission standard:For each Commission standard: Do we comply?Do we comply? What evidence do we have to show What evidence do we have to show

compliance?compliance? If we don’t have evidence, how will we get If we don’t have evidence, how will we get

it?it? If we don’t comply, what is our plan to If we don’t comply, what is our plan to

comply?comply?

RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action

Standards Analysis Worksheet

Data you need (part 1)Data you need (part 1)

Accreditation Standards WorksheetStandard One – Institutional Mission and Goals, Planning and EffectivenessStandard 1.A – Mission and Goals

RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action

1.A.1 1.A.1 Widely understoodWidely understood

Adopted by Board; Adopted by Board; Periodically reexaminedPeriodically reexamined

??????

YESYES

None.None.

Memo from board or Memo from board or other public statementother public statementMeeting minutes, Meeting minutes, agendas.agendas.

Conduct survey. Conduct survey. Interview students and Interview students and faculty.faculty.

Acquire memo or Acquire memo or statement. Acquire statement. Acquire minutes, agendas;minutes, agendas;Generate narrative of Generate narrative of outcomes assessment outcomes assessment activity & provide results.activity & provide results.

1.A.2 Mission published1.A.2 Mission published YESYES Catalog, Student Catalog, Student handbook, display handbook, display plaquesplaques

Collect books, sample Collect books, sample plaque. Identify location plaque. Identify location of plaquesof plaques

1.A.3 Documented 1.A.3 Documented progressprogress

YESYES Indicators of Indicators of institutional institutional effectiveness effectiveness

Summarize indicators and Summarize indicators and institutional effectiveness institutional effectiveness studies.studies.

Accreditation Standards WorksheetStandard One – Institutional Mission and Goals, Planning and EffectivenessStandard 1.A – Mission and Goals

RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action

1.A.4 Mission/goals 1.A.4 Mission/goals consistent with resourcesconsistent with resources

YESYES Human – faculty needs Human – faculty needs study; workload study; workload assessments. assessments.

Financial – analyses. Financial – analyses.

Physical – ????Physical – ????

Acquire studies and Acquire studies and analyses.analyses.

Gather/generate financial Gather/generate financial statisticsstatistics

Summarize information Summarize information about physical resources about physical resources from unit self-studies.from unit self-studies.

Data you need (part 1)Data you need (part 1)

Data you need (part 2)Data you need (part 2)

Institutional level performanceInstitutional level performance College/department level performanceCollege/department level performance Program level outcomesProgram level outcomes Course level outcomesCourse level outcomes

MISSIONMISSION INDICATORSINDICATORS SOURCESOURCE METHODMETHOD

Maintain a Maintain a wholesome wholesome academic, academic, cultural, cultural, social, and social, and spiritual spiritual environment.environment.

Low crime rateLow crime rate Campus policeCampus police Obtain annual Obtain annual reportreport

Low rate of Low rate of Honor Code Honor Code infractionsinfractions

Dean of Dean of Students, Students, ecclesiastical ecclesiastical leadersleaders

Obtain annual Obtain annual report from Dean of report from Dean of Students OfficeStudents Office

High High adherence to adherence to "higher "higher principles"principles"

Students Students (former, (former, current)current)

SurveySurvey Focus groupFocus group

Positive Positive attitude and attitude and perception of perception of Honor Code and Honor Code and environmentenvironment

Students Students (former, (former, current)current)

Analysis of Mission Worksheet

Data Analysis and SynthesisData Analysis and Synthesis

The KEY:The KEY:Adhering to the templates and Adhering to the templates and

guidelines set at the beginning of the guidelines set at the beginning of the process.process.

Data analysis/synthesisData analysis/synthesis

Bolster your analysis with …Bolster your analysis with …

Statistical simplicityStatistical simplicity Visual materialVisual material

Well labeled and neatly organized tablesWell labeled and neatly organized tables Charts, graphs, and other visual imagesCharts, graphs, and other visual images

Electronic versionsElectronic versions Web documentsWeb documents Drill-downDrill-down

ANALYSISANALYSIS

JUDGMENTJUDGMENT

ACTION

Data analysis/synthesisData analysis/synthesis

Show judgment and actionShow judgment and action

Data analysis/synthesisData analysis/synthesis

Establish benchmarksEstablish benchmarks

Expert judgmentExpert judgment Comparison with past performanceComparison with past performance Comparison with other groups Comparison with other groups

(controls, peers)(controls, peers) Cut points generated from the dataCut points generated from the data

Data Analyses & SynthesesData Analyses & Syntheses

If data are organized, collected, and analyzed If data are organized, collected, and analyzed by Standard, how are data analyses by Standard, how are data analyses synthesized across the institution?synthesized across the institution?

THANK YOU!!!THANK YOU!!!