Standard 1 The institution’s mission and goals define the institution The institution’s mission...

31

Transcript of Standard 1 The institution’s mission and goals define the institution The institution’s mission...

Page 1: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.
Page 2: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Standard 1Standard 1

The institution’s mission and goals define The institution’s mission and goals define the institutionthe institution

……evaluation proceeds from the evaluation proceeds from the institution’s own definition of its mission institution’s own definition of its mission and goals.and goals.

The institution engages in ongoing The institution engages in ongoing planning to achieve its mission and goals.planning to achieve its mission and goals.

Page 3: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Standard 1Standard 1

The institution’s mission and goals The institution’s mission and goals widely understood by, the campus widely understood by, the campus are periodically reexaminedare periodically reexaminedappears in appropriate institutional publications appears in appropriate institutional publications give direction to all its give direction to all its

» educational activities, educational activities, » to its admission policies, to its admission policies, » selection of faculty, selection of faculty, » allocation of resources, allocation of resources, » and to planning.and to planning.

Page 4: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Standard 1Standard 1

The institution reviews with the The institution reviews with the Commission Commission changes that would alter its mission changes that would alter its mission intention to offer a degree at a higher level than intention to offer a degree at a higher level than

is included in its present accreditation is included in its present accreditation

[Policy A-2 [Policy A-2 Substantive ChangeSubstantive Change]]

Page 5: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Standard 1Standard 1

Through its planning process, the Through its planning process, the institution asks questions, seeks answers, institution asks questions, seeks answers, analyzes itself, and revises its goals, analyzes itself, and revises its goals, policies, procedures, and resource policies, procedures, and resource allocation.allocation.

clearly defines its evaluation and planning clearly defines its evaluation and planning processes processes

engages in systematic planning engages in systematic planning process is participatory process is participatory

Page 6: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Faculty Data

Qualifications: degrees, sources of degrees, experience

Faculty Rank Salaries and Benefits. Comparison data, e.g. from

the College and University Personnel Association (CUPA)

Number, sufficient for the mission

Page 7: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Faculty Data

Workload Retention data Exit interview data Student survey data on faculty advising, etc. Standard faculty surveys with comparisons

Page 8: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Policies and Implementation

Academic planning, curriculum development and review

Academic advising Faculty role in governance

Give examples and data about how policies are applied.

Page 9: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Policies and Implementation

Salaries and Benefits Workload: amount and the procedure for

assignment Systematic faculty evaluation (See 4.1) Personnel policies and procedures Recruitment and appointment

Page 10: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Standard 4.B

ScholarshipResearchArtistic Creation

Page 11: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Time to Catch Up

If data is not available, make a plan to collect pertinent information.

If policies are not in place or outdated, inform decision makers and get moving!

Page 12: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Faculty Evaluation, 4.1

Clear proceduresOngoing, regularBased on the institution’s

SizeComplexityMission

Page 13: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Faculty Evaluation, 4.1

Multiple indices that may include Annual merit salary evaluations Promotions Tenure reviews Post-tenure reviews Student/peer/administrator evaluations of teaching and

service Peer review of scholarship

Page 14: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Faculty Evaluation, 4.1

A comprehensive evaluation of each faculty member at least once every five years.

A policy that addresses concerns that may arise between regular evaluations

Page 15: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Standard 9Standard 9

adheres to the highest ethical standards adheres to the highest ethical standards in its representationin its representation

advocates high ethical standards in the advocates high ethical standards in the management and operations management and operations

policy defines and prohibits conflict of policy defines and prohibits conflict of interest interest

commitment to the free pursuit and commitment to the free pursuit and dissemination of knowledge consistent with dissemination of knowledge consistent with the institution’s mission the institution’s mission

Page 16: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data CollectionData Collection

Implement Trustworthy Methods Implement Trustworthy Methods

ReliabilityReliability Carry out systematic, well-defined processesCarry out systematic, well-defined processes Use well-designed instrumentsUse well-designed instruments

ValidityValidity Measure the right thingMeasure the right thing Minimize sources of contamination and biasMinimize sources of contamination and bias

SufficiencySufficiency Use multiple methodsUse multiple methods Think of how findings are supportedThink of how findings are supported

SamplingSampling Use proper sampling (mostly random)Use proper sampling (mostly random) Think of sample sizeThink of sample size

Page 17: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

PROCESS & INPUT

DESCRIPTIONS

ANECDOTES & WAR STORIES

REPUTATIONFEELING & IMPRESSIONS

Page 18: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data CollectionData Collection

Select MethodsSelect Methods

Embedded test questionsEmbedded test questions Capstone projectsCapstone projects Portfolio evaluationPortfolio evaluation Nationally normed testsNationally normed tests Focus groups , interviewsFocus groups , interviews Pre- and post-testingPre- and post-testing VideotapesVideotapes Outside expertsOutside experts Licensure and qualifying Licensure and qualifying

examinations.examinations. Research/creative projectsResearch/creative projects Review boardsReview boards

Telephone surveysTelephone surveys Internships, practicaInternships, practica Exit interviewsExit interviews Data from past reports and Data from past reports and

studiesstudies Narrative descriptionsNarrative descriptions SurveysSurveys Formal studiesFormal studies Interviews, focus groupsInterviews, focus groups Multiple sourcesMultiple sources Expert judgmentExpert judgment And many others . . . And many others . . .

Page 19: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data Collection Data Collection

Get the data you need.Get the data you need.

““Mountains of data that never get Mountains of data that never get digested or used to improve programs digested or used to improve programs represent a monumental waste of represent a monumental waste of faculty/staff energy and good will.”faculty/staff energy and good will.”

Task Force on Assessment, Willamette U.Task Force on Assessment, Willamette U.

Page 20: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data you need (part 1)Data you need (part 1)

For each Commission standard:For each Commission standard: Do we comply?Do we comply? What evidence do we have to show What evidence do we have to show

compliance?compliance? If we don’t have evidence, how will we get If we don’t have evidence, how will we get

it?it? If we don’t comply, what is our plan to If we don’t comply, what is our plan to

comply?comply?

Page 21: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action

Standards Analysis Worksheet

Data you need (part 1)Data you need (part 1)

Page 22: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Accreditation Standards WorksheetStandard One – Institutional Mission and Goals, Planning and EffectivenessStandard 1.A – Mission and Goals

RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action

1.A.1 1.A.1 Widely understoodWidely understood

Adopted by Board; Adopted by Board; Periodically reexaminedPeriodically reexamined

??????

YESYES

None.None.

Memo from board or Memo from board or other public statementother public statementMeeting minutes, Meeting minutes, agendas.agendas.

Conduct survey. Conduct survey. Interview students and Interview students and faculty.faculty.

Acquire memo or Acquire memo or statement. Acquire statement. Acquire minutes, agendas;minutes, agendas;Generate narrative of Generate narrative of outcomes assessment outcomes assessment activity & provide results.activity & provide results.

1.A.2 Mission published1.A.2 Mission published YESYES Catalog, Student Catalog, Student handbook, display handbook, display plaquesplaques

Collect books, sample Collect books, sample plaque. Identify location plaque. Identify location of plaquesof plaques

1.A.3 Documented 1.A.3 Documented progressprogress

YESYES Indicators of Indicators of institutional institutional effectiveness effectiveness

Summarize indicators and Summarize indicators and institutional effectiveness institutional effectiveness studies.studies.

Page 23: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Accreditation Standards WorksheetStandard One – Institutional Mission and Goals, Planning and EffectivenessStandard 1.A – Mission and Goals

RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action

1.A.4 Mission/goals 1.A.4 Mission/goals consistent with resourcesconsistent with resources

YESYES Human – faculty needs Human – faculty needs study; workload study; workload assessments. assessments.

Financial – analyses. Financial – analyses.

Physical – ????Physical – ????

Acquire studies and Acquire studies and analyses.analyses.

Gather/generate financial Gather/generate financial statisticsstatistics

Summarize information Summarize information about physical resources about physical resources from unit self-studies.from unit self-studies.

Data you need (part 1)Data you need (part 1)

Page 24: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data you need (part 2)Data you need (part 2)

Institutional level performanceInstitutional level performance College/department level performanceCollege/department level performance Program level outcomesProgram level outcomes Course level outcomesCourse level outcomes

Page 25: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

MISSIONMISSION INDICATORSINDICATORS SOURCESOURCE METHODMETHOD

Maintain a Maintain a wholesome wholesome academic, academic, cultural, cultural, social, and social, and spiritual spiritual environment.environment.

Low crime rateLow crime rate Campus policeCampus police Obtain annual Obtain annual reportreport

Low rate of Low rate of Honor Code Honor Code infractionsinfractions

Dean of Dean of Students, Students, ecclesiastical ecclesiastical leadersleaders

Obtain annual Obtain annual report from Dean of report from Dean of Students OfficeStudents Office

High High adherence to adherence to "higher "higher principles"principles"

Students Students (former, (former, current)current)

SurveySurvey Focus groupFocus group

Positive Positive attitude and attitude and perception of perception of Honor Code and Honor Code and environmentenvironment

Students Students (former, (former, current)current)

Analysis of Mission Worksheet

Page 26: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data Analysis and SynthesisData Analysis and Synthesis

The KEY:The KEY:Adhering to the templates and Adhering to the templates and

guidelines set at the beginning of the guidelines set at the beginning of the process.process.

Page 27: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data analysis/synthesisData analysis/synthesis

Bolster your analysis with …Bolster your analysis with …

Statistical simplicityStatistical simplicity Visual materialVisual material

Well labeled and neatly organized tablesWell labeled and neatly organized tables Charts, graphs, and other visual imagesCharts, graphs, and other visual images

Electronic versionsElectronic versions Web documentsWeb documents Drill-downDrill-down

Page 28: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

ANALYSISANALYSIS

JUDGMENTJUDGMENT

ACTION

Data analysis/synthesisData analysis/synthesis

Show judgment and actionShow judgment and action

Page 29: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data analysis/synthesisData analysis/synthesis

Establish benchmarksEstablish benchmarks

Expert judgmentExpert judgment Comparison with past performanceComparison with past performance Comparison with other groups Comparison with other groups

(controls, peers)(controls, peers) Cut points generated from the dataCut points generated from the data

Page 30: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

Data Analyses & SynthesesData Analyses & Syntheses

If data are organized, collected, and analyzed If data are organized, collected, and analyzed by Standard, how are data analyses by Standard, how are data analyses synthesized across the institution?synthesized across the institution?

Page 31: Standard 1 The institution’s mission and goals define the institution The institution’s mission and goals define the institution …evaluation proceeds.

THANK YOU!!!THANK YOU!!!