ASSESSMENT OF STUDENT SUPPORT SERVICES
description
Transcript of ASSESSMENT OF STUDENT SUPPORT SERVICES
![Page 1: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/1.jpg)
ASSESSMENT OF STUDENTSUPPORT SERVICES
Kimberly Gargiulo, Coordinator of AssessmentOffice of Institutional Research and Assessment
![Page 2: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/2.jpg)
Cycle of Assessment
II. Administrative Goals
V. Use of ResultsTo Implement
Change orImprovement
I. Institutional& Unit
Mission/Goal Reference
IV. Summary of
DataCollected
III. Means Of Assessment
And CriteriaFor Success
![Page 3: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/3.jpg)
5 Column Model*
*: Adapted from Institutional Effectiveness Associates
InstitutionalMission
Unit Mission
AdministrativeGoals
Means of Assessment& Criteria for Success
Results UseOfResults
![Page 4: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/4.jpg)
Cycle of Assessment
II. Administrative Goals
V. Use of ResultsTo Implement
Change orImprovement
I. Institutional& Unit
Mission/Goal Reference
IV. Summary of
DataCollected
III. Means Of Assessment
And CriteriaFor Success
![Page 5: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/5.jpg)
Administrative Goals
Linked to Unit MissionRealisticLimited in number (3-5 per
assessment period)Measurable
![Page 6: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/6.jpg)
Interconnectedness:
Administrative Goals- Related to the mission and goals of
the college Supports Unit’s mission
![Page 7: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/7.jpg)
Deciding on Goals-Short & Long List
Short List: What currently is
being assessed Can be assessed
within one assessment period
Linked to Unit’s Mission
Long List: Other important
goals – input from staff
Refer back to every year
Cycle into Short List
![Page 8: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/8.jpg)
Outcome, Process or Satisfaction?
Outcome: “Students who meetwith advisors will graduate faster…”
Process: “The AATC will increase the number of students served…”
Satisfaction: “Students will be satisfied with our services…”
![Page 9: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/9.jpg)
Principles of good goals:
Singular Measurable Observable Use action words Reasonable
![Page 10: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/10.jpg)
Observable Use action words
Students WILL:“be satisfied”
“be aware”“demonstrate”
“understand”
![Page 11: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/11.jpg)
Working Example:
Freshmen will be satisfied with AATC advising services.
![Page 12: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/12.jpg)
Cycle of Assessment
II. Administrative Goals
V. Use of ResultsTo Implement
Change orImprovement
I. Institutional& Unit
Mission/Goal Reference
IV. Summary of
DataCollected
III. Means Of Assessment
And CriteriaFor Success
![Page 13: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/13.jpg)
Means of Assessment & Criteria for Success:
How do you know: Students met the goals?
And to what extent?
![Page 14: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/14.jpg)
Examples of Assessment-Direct Evidence
Surveys Focus Groups Student Interviews Suggestion Boxes 1 minute paper
![Page 15: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/15.jpg)
SURVEYS
Measures attitudes about service Measures satisfaction Can measure knowledge too (quiz) Determine weak areas Quick feedback Open-ended or multiple choice Created locally or standardized
![Page 16: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/16.jpg)
FOCUS GROUPS
Questions asked to a group 7-12 participants Attain qualitative data Could be video or audio taped or
notes can be taken during session Facilitator needed
![Page 17: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/17.jpg)
Indirect Evidence
Examples: GPA of students who
attend AATC workshops or advisement
Graduation Rates Retention Rates Transfer Rates
Compare participants versus non-participants
![Page 18: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/18.jpg)
Criteria for Success
Overall Primary total rating
ComponentSecondary, more
detailed. Identify scores
which would elicit further review
![Page 19: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/19.jpg)
Establishing Criteria for Success
Reasonable expectation of responses Expressed in specific terms
(overall) “The average rating of the workshop will be at least 4.0”
(overall) “At least 75% of respondents will be satisfied or very satisfied with their advisement session.”
(component) “No more than 5% of respondents will be very dissatisfied with their advisement session.”
![Page 20: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/20.jpg)
REMEMBER
Means of Assessment must be directly linked to goals Make sure instrument will give you the
answers you need Criteria for Success
Check wording in tool and in criteria for success (rating scale, what rating scale??)
![Page 21: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/21.jpg)
Working Example-Means of Assessment
Goal: Freshmen will be satisfied with AATC advising services.
Means of Assessment: 1) Survey administered to freshmen
immediately following their advisement session will ask students about their level of satisfaction with the session.
![Page 22: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/22.jpg)
Working Example- Criteria for Success
Assessment Tool 1) Survey
Criteria for Success1) At least 80% of the
respondents will be satisfied or very satisfied with their advisement session; no more than 5% of respondents will state they left the session still unclear about graduation requirements.
![Page 23: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/23.jpg)
Cycle of Assessment
II. Administrative Goals
V. Use of ResultsTo Implement
Change orImprovement
I. Institutional& Unit
Mission/Goal Reference
IV. Summary of
DataCollected
III. Means Of Assessment
And CriteriaFor Success
![Page 24: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/24.jpg)
Summary of Data Collected
What were your results? Did you meet, exceed or fall below
your target? What do the results tell you?
Hypothesize
![Page 25: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/25.jpg)
Results Should:
Show to what extent goals were accomplished
Be linked to assessment means used
Be detailed to show the assessment took place
Justify the “use of results”
![Page 26: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/26.jpg)
Results Should Not:
Be statistically unlikely Match criteria of success exactly NOT BE USED!
![Page 27: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/27.jpg)
Working Example- Summary of Data Collected
Criteria for Success 1) At least 80% of the
respondents will be satisfied or very satisfied with their advisement session; no more than 5% of respondents will state they left the session still unclear about graduation requirements.
Summary of Data Collected1) 82% of respondents
stated they were at least satisfied with their advisement session
2) 10% of respondents answered they left the session unclear about graduation requirements
3) The average rating of the session was a 3.5 out of 5.0
4) Response rate: 30%
![Page 28: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/28.jpg)
Cycle of Assessment
II. Administrative Goals
V. Use of ResultsTo Implement
Change or Improvement
I. Institutional& Unit
Mission/Goal Reference
IV. Summary of
DataCollected
III. Means Of Assessment
And CriteriaFor Success
![Page 29: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/29.jpg)
Using Results
-Are the use of results substantive enough?
-Detailed enough?-Do you need to modify your
services, goals, targets or assessment tools?
-Communicated to the appropriate parties?
![Page 30: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/30.jpg)
Working Example- Using Results to Implement Change
Summary of Data Collected1) 82% of respondents
stated they were at least satisfied with their advisement session
2) 10% of respondents answered they left the session unclear about graduation requirements
3) The average rating of the session was a 3.5 out of 5.0
4) Response rate: 30%
Use of Results1) Target of 80% was met; add a fill
in question asking to detail why they answered this question as they did
2) Target of less than 5% not met; hold training for advisors about graduation requirements for incoming freshmen
3) Hold brainstorming sessions with staff about how to improve advising sessions (new goal to cycle in?)
4) Review mode of administration of survey, think about ways to increase rate.
![Page 31: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/31.jpg)
If Results are Positive:
Celebrate your successes! Let colleagues know! Cycle in new goals?
![Page 32: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/32.jpg)
If Results are Not So Positive:
What needs to be modified? Work with colleagues Don’t get discouraged!
![Page 33: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/33.jpg)
Next Steps:
Continue the assessment cycle Share with department Create an assessment process Visit Office of Institutional Research
& Assessment with any questions!
![Page 34: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/34.jpg)
EXERCISE
1) Two goals for the AATC.
2) Means of Assessment & Criteria for Success for these goals.
![Page 35: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/35.jpg)
Assessment Time!
Please take a moment to fill out a brief survey.
Thank You!
![Page 36: ASSESSMENT OF STUDENT SUPPORT SERVICES](https://reader036.fdocuments.net/reader036/viewer/2022081517/56816804550346895ddd8465/html5/thumbnails/36.jpg)
Questions?
Kimberly Gargiulo, Coordinator of AssessmentOffice of Institutional Research and AssessmentS [email protected]