Southeastern Association for Community College Research 2008 Conference

Southeastern Association for Community College Research

2008 Conference

Using Technology to Efficiently and Effectively Gather Information from

Recent Alumni and Employers

August 2008

http://www.spcollege.edu/

August 6, 2008 Southeastern Association for Community College Research 2

SACCR 2008 Conference August 2008

Alumni and Employer Surveys

Presenters

Dr. James Coraggio, Director of Institutional Research and Effectiveness

Maggie Tymms, Assessment Coordinator for Academic Programs



SPC Background

SPC, established in 1927, is the oldest 2-year college in Florida First Community College in Florida to offer

4 year degrees (2002) 9 Campuses throughout the county 2007-08 FTE: 16,086 (LD), 1,338 (UD) Opening Spring 2008 headcount: 25,754 Annual 2007-08 enrollment: 62,200



Institutional Effectiveness

“Institutional Effectiveness is the integrated, systematic, explicit, and documented processes of measuring performance against the SPC mission for purposes of continuous improvement of academic programs, administrative services, and educational services offered by the college.”

Operating ResultsBudget PlanningStrategic & Unit

PlanningEvaluations/ AssessmentsMission

“Closing the Loop”



Performance Improvement

From Compliance to Performance Improvement

Data Information ImprovementKnowledge

Improved OutcomesSPCReportsAssessment Data

CommunityCollege LeadershipProgram Directors

FacultyStudents



Agenda

Student Assessment Points Purpose of Follow-up Surveys Alumni/Employer Survey Process Dissemination of Survey Results and

Reports



Student Assessment Points

Students surveyed multiple times



Purpose of Follow-up Surveys

Recent Alumni Survey was designed to: Gain insight into alumni’s perceptions of

the quality of general education and career preparation

Determine the current activities of former students such as employment information and educational status




Employer Survey was designed to: Gain insight into an employer’s perceptions of

hired SPC graduates in the areas of key general education competencies and foundational skills

Provide the employee’s major job responsibilities and wage information, as well as employer’s willingness to hire another SPC graduate

Identify employer’s willingness to support various college activities




State Requirements Survey data are also collected for state

required annual Placement & Follow-up Report (FETPIP: Florida Education Training Placement Information Program) and supplemental information to meet workforce criteria



Alumni/Employer Survey Process

Previous model Labor intensive Manually tabulated paper surveys Telephone interviews conducted

using overtime hours




Issues with previous model Costly survey process Declining college budget Increasing demand for accountability Outdated contact information Students over-surveyed Declining response rates Conducted in isolation




Goals of new survey processA. Improve data collection processB. Enhance quality of survey formsC. Include program specific

informationD. Increase response rates



A. Improve Data Collection Process

Data Collection Process Eliminated telephone calls Automated the process (email merge) Employ online survey submission

(Zoomerang) Obtain accurate email addresses Use multiple points of contact




Survey Schedule Recent Alumni Survey

Graduates surveyed six months after the end of session (Three times per year)

Employer Survey Employer of graduates surveyed at the

end of academic year (Once per year)




First email Second email Third email

First mailing Second mailing

2 weeks

2 weeks

2 weeksMultiple Points of Contact

2 weeks



B. Enhance Quality Of Survey Forms

Improved Survey Forms Better “look and feel” of survey format Developed scannable paper forms Use online branching models to reduce

survey length Design items to gather only pertinent

data



Online Survey: Email and Form



Paper Survey: Letter and Form



C. Include Program Specific Information

Program specific information Meet with PDs Discuss requirements for program

accreditation and timelines Include their necessary program specific

items



D. Increase Response Rates

Create awareness and convey importance Involve program faculty in the process Request faculty assistance to inform students Include a flyer with graduation materials Coordinate with programs that hand-carry

surveys to local employers



Response Rates

Summer 07



Response Rates

Fall 07



Response Rates

6.3%

9.1%8.3%

5.2%

11.2%

10.1%

4.2%

9.0%

5.3%

7.6%

5.6%

4.4%

6.4%

0.00%

2.00%

4.00%

6.00%

8.00%

10.00%

12.00%

1st E-mail 2nd E-mail 3rd E-mail 1st Mailing 2nd Mailing

Summer & Fall 06 Spring 07 Summer 07 Fall 07



Response Rates

Overall Response Rate

13.7%

21.2%23.4%

19.0%

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

Summer & Fall 06 Spring 07 Summer 07 Fall 07



Response Rates - Employer

OtherResponses

Recent Alumni Surveys Sent

Employer Surveys Sent

Is a 44% Employer Response Rate Good?

COE Responses

With Permission Responses

Without Permission



Disseminating Information

College wide access to reports http://www.spcollege.edu/Central/Surveys/SurveyList.htm

Program Specific Reports Published on the Educational Outcomes

website http://it.spcollege.edu/edoutcomes

http://www.spcollege.edu/Central/Surveys/SurveyList.htm



Program Specific Reports



SPC IE Website



Lessons Learned

Do not expect that students remember their ID#

Administer the survey soon after the end of the session (six months)

Use multiple points of contact (two weeks) Find the most recent contact information Make students aware of the importance of

the survey process (survey announcements)



Lessons Learned

Partner with programs to acquire up-to-date information

Provide updates to college data systems (PeopleSoft, Alumni Foundation)

Monitor results and make changes as necessary

More accurate data (quicker turn around of results) with automated processes



Future Direction

Ultimate goal is to provide Provosts (Deans) and Program Directors ‘timely’, ‘relevant’ ‘accurate’, and ‘interpretable’ information regarding their programs and their performance outcomes Multi-measure ‘Dashboard’ style reports

(Business Intelligence/Performance Measurement)



Questions/Next Steps

Southeastern Association for Community College Research

2008 Conference

Using Technology to Efficiently and Effectively Gather Information from

Recent Alumni and Employers

August 2008

http://www.spcollege.edu/

Southeastern Association for Community College Research 2008 Conference

Documents

Transcript of Southeastern Association for Community College Research 2008 Conference