Program Review Overview
description
Transcript of Program Review Overview
Program ReviewOverview
October 19, 2007
• To improve the quality of teaching and learning by systematically reviewing goals, priorities,
activities and outcomes. Continual improvement requires a review process that evaluates progress toward goal achievement and assists in refinement of goals and objectives.
• It allows faculty and administrators to assess the program’s contribution to BCTC’s mission, values, and goals
Purpose
Program Review
• Reorganized under broad concepts that demonstrate program vitality (and currency), effectiveness, and efficiency
• Incorporates annual program review summaries
• Eliminates unnecessary or duplicative elements
Revised – What’s New?
Program Review
• All academic programs/areas are reviewed on a 5-year summative cycle
Cycle of Review
Program Review
2002-03 2003-04 2004-05 2005-06 2006-07
IMDRCPRADBT
NursingDental HygieneEnvironmentalDental LabNuclear Medicine
ArchitectureGen. Ed.Electrical CIT (deferred)ECE (deferred)
CIT (deferred from 03-04)Industrial maintenanceHVACWelding
Civil Eng.IECERCPCollision RepairCarpentryAuto. Tech
2007-08 2008-09 2009-10 2010-11 2011-12IMD/ITCADRADMachine ToolBUSMed. Assist.
Surg. TechDental HygieneDental LabDental AssistNMTEnv. Science
ArchitectureGen. Ed. Electrical Tech. ParaeducatorFire RescueEng. Tech.
Cosmetology/Esth.Industrial Maint.CITHVACWeldingRNLPNNurse Aide
IECECivil Eng.RCPCollision RepairCarpentryAuto Tech
• Currency/Vitality?• Students• Alumni• Advisory Committees• Employers
• Effectiveness• Quality• Measures
• Efficiency• Program Cost• Space Utilization• Full-time to Adjunct Faculty• Space Utilization• Course Section Capacity
Are our programs viable and improving?
Program Review
Annual Program Review Summary - Quality of Education
Program Review
Program Name:
EffectivenessIndicators
PerformanceStandard
Measurement/ Data Source
Responsiblefor collecting data
2001- 2002
2002- 2003 AP2 2003-
2004 AP2 2004-2005 AP2 2005-
2006 AP2 2006-2007 AP2
I. Effectiveness A. Quality of Education
StudentSatisfaction
At least 85% of AAS graduates will indicate they are satisfied with the quality of their education.
Exit and Alumni Surveys
IEP
ProfessionalLicensure
Graduates will successfully pass professional licensure exams at or above available norms (national or state).
Board and/or Certification Exam Scores
ProgramCoordinator
Employer Satisfaction
At least 85% of employers will indicate graduates are academically prepared for employment.
Employer Survey IEP
At least 85% of employers will indicate graduates are competent in general education.
Employer Survey IEP
Faculty Credentials
100% of faculty must meet SACS criteria.
Faculty Credential File
AcademicAffairs
100% of faculty must meet external accreditation standards
Faculty Credential File
Program Coordinator
Annual Program Review Summary - Vitality
Program Review
Program Name:
EffectivenessIndicators
PerformanceStandard
Measurement/ Data Source
Responsiblefor collecting data
2001- 2002 2002- 2003 AP* 2003- 2004 AP* 2004-
2005 AP* 2005- 2006 AP* 2006-2007 AP*
B. Vitality
Job Placement
At least 90% of graduates will secure employment in their field of study within six months of graduation.
Exit and Alumni Surveys
IEP
Annual Unduplicated Headcount of Program Majors
At least 12 students enrolled in program in most recent full term. (Fall)
IPEDSCPE
IEP
Advisory Committee Participation
At least 75% of external members will attend one meeting within the Academic year.
Advisory Committee Members
Program Coordinator
Advisory Committee
At least 85% of Advisory Committee survey respondents will indicate they agree or strongly agree with survey items.
Program Advisory Committee Survey1
IEP
GraduatesAt least 12 graduates per year (CPE).
CPE Data IEP
Student Retention
Adequate to ensure program efficiency (excludes graduates from retention %).
Fall to fall retention data excluding transfers and readmits
IEP
Annual Program Review Summary - Efficiency Program Review
Program Name:
EffectivenessIndicators
PerformanceStandard
Measurement/ Data Source
Responsiblefor collecting data
2001- 2002
2002- 2003 AP* 2003-
2004 AP* 2004-2005 AP* 2005-
2006 AP* 2006-2007 AP*
II. Efficiency
Annual Program Costs Annual Program Efficiency Report
IEP
Space Utilization Annual Program
Efficiency ReportIEP
Full-Time to Adjunct Faculty
Course Capacity Report
IEP
Average Course Section Capacity
Course Capacity Report
IEP
1More information available on request 2Action Plans - All effectiveness indicators not meeting performance standards must be addressed by Action Plans. Action Plans must indicate action(s) to be implemented to eliminate the deficiency(ies) to allow for meeting the performance standard. This is a program responsibility requiring immediate attention with the development of a detailed plan effect positive change in meeting the performance standard. Any action required will be incorporated into the following year's program planning. The overall responsibility will be that of the Program Coordinator and Division Chair.
Program Coordinator Date
Division Chair Date
• Annual Program Review Summary/Action Plans• Review of Annual Action Plans by Deans of Academic
Affairs• Preparation of Self-Study (5-Year)• Evaluation by External Review Team• Vice President’s Leadership Team reviews Team
Report and Action Plan
Components of Periodic Review Process
Program Review
• How does this relate to the annual program review?
• Data collection on cycles
• Established performance standards
• On-going annual analysis at program level
• Relevance to goal-planning
Desired Institutional Outcomes
Program Review
• Program Description and Information
• Quality of Education
• Vitality
• Efficiency
• Summary and Recommendations
Format
Program Review
Calendar -
Program Review
Bluegrass Community and Technical CollegeProgram Review Distribution of Activities Calendar
Date Institutional Effectiveness and Planning OfficeOngoing IE provides the Area/Program Coordinator with all necessary data to complete the program review
Academic Affairs OfficeMay 07 AA provides orientation to the Area/Program CoordinatorMay 07 AA provides Program Review Guide and the Program Review Report template to the Area/Program CoordinatorSept 07 AA recruits external and student review team members and finalizes team membershipOct 07 AA arranges for official appointment letters to be sent to review team membersDec 07 AA schedules orientation for review team chairs Dec 07 AA distributes the Program Review Guide and completed Program Review Report to review team chairsJan 08 AA coordinates dates for availability of the LCC President, Academic Dean, and conference room and sends these dates to team
chairs and coordinatorsJan 08 AA arranges food for site-visit daysJan 08 AA schedules laptop computer for use in conference room on the site-visit dayFeb 08 AA provides an onsite evaluation survey to be completed by review team members at the end of site-visitMar 08 AA monitors the submission of the Program Review Report and the Program’s Action Plan to Academic Council by the appropriate
deadlineSum 08 AA assembles and maintains a notebook as a permanent record for each program review that includes all key features of the
review processSum 08 AA compiles surveys and makes necessary adjustments to the process for the following year
Calendar-Continued
Program Review
Area/Program CoordinatorFall 07 Coordinator works with program members to prepare report
Jan 08 Coordinator submits reports to the Division Assistant Dean and Deans of Academic Affairs for review and signaturesFeb 08 Coordinator works with the Review Team Chair to determine the site-visit date and agenda and communicates this
information to the Academic Affairs OfficeFeb 08 Coordinator schedules students, advisory board, and faculty presence on the site-visit dayFeb 08 Coordinator arranges for advisory board parkingFeb 08 Coordinator provides any supplementary information/documentation needed by review team membersFeb 08 Coordinator confirms student, faculty, and advisory committee member attendance prior to site-visitApril 08 Coordinator makes any factual corrections to the final draft of the site-visit reportApril 08 Coordinator begins meeting with program faculty to prepare an action plan addressing any program
recommendations identified in the preliminary site-visit report including who is responsible for the action and the date of e expected completion
April 08 Coordinator sends one electronic and one hardcopy of the action plan to the Academic Affairs Office by the appropriate deadline
Review Team ChairJan 08 Chair attends the program review orientation
Feb 08 Chair arranges first meeting with review team members and schedules future meetings as necessaryFeb 08 Chair distributes the Program Review Guide and the completed Program Review Report to all review team members Feb 08 Chair establishes review team member’s responsibilities/dutiesMar 08 Chair leads review team activities during site-visit and assumes responsibility for team’s preliminary reportMar 08 Chair reports preliminary findings to the President and Academic Dean at the end of the site-visit dayMar 08 Chair sends a final draft of the preliminary site-visit report to the other review committee members and the Coordinator to make any factual corrections necessaryMar 08 Chair confirms accuracy of the report and submits one electronic and two hardcopies of the final report to the Academic Affairs Office by the appropriate deadline
Note: Exact dates will be established and provided for critical steps in the process.
• Purpose• Provide program/area with an external perspective
of quality and effectiveness of educational outcomes
• Composition of Review Team – 5 members(2 past or present program/area coordinators from outside the division, 1 faculty member from within the program, 1 member from outside the college, 1 student)
External Review Team
Program Review
• Reorganized under broad concepts that demonstrate program vitality (and currency), effectiveness, and efficiency
• Incorporates annual program review summaries
• Eliminates unnecessary or duplicative elements
Revised – What’s New?
Program Review
• Program Coordinator and Review Team Chair select site visit date and develop agenda in coordination with dates from Academic Affairs and president’s Office
• Review Team conducts site visit and develops report
• Review Team report distributed to Program/Area Coordinators
External Review Team
Program Review
Agenda
Program Review
Time Description8:00-8:15 a.m. Introduction and Overview-Meeting with the President, VP and Deans of Academic
Affairs, Program Coordinator, Division Assistant Dean
8:15-8:45 a.m. Meeting, VP and Deans of Academic Affairs
9:00-9:45 a.m. Meeting with Program Advisory Committee
9:45-10:00 a.m. Break
10:00-11:00 a.m. Meeting with program faculty (full-time, part-time, voluntary)
11:00-11:15 a.m. Tour of educational facilities
11:15 a.m-12:00 p.m. Meeting with currently enrolled students
12:00-3:00 p.m. Working lunch-Team discuss findings and prepare report
3:15-4:00 p.m. Presentation of preliminary findings-President, VP and Deans of Academic Affairs, Program Coordinator, Division Assistant Dean, program faculty
• Programs develop Action Plans
• CRC, Faculty Senate and Vice President of Academic Affairs Leadership Team review Site Team Report and Action Plan
• President prepares an Executive Summary Report
College Roles
Program Review
• Program Review Document will be in a form with expandable text boxes
• Pre-set tables
Fall 2007
Program Review
It’s about students…….
Questions??