Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information...
-
Upload
abigail-stevenson -
Category
Documents
-
view
218 -
download
2
Transcript of Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information...
![Page 1: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/1.jpg)
Effectiveness ASAP
(As Simple As Possible)
David EubanksDir. Planning, Assessment, and Information Services
Coker College
![Page 2: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/2.jpg)
Coker College
• Hartsville, South Carolina
• Independent Liberal Arts college
• About 1200 students
• Traditional and Non-traditional programs
• On and off-campus locations
• Reaffirmed 2005
![Page 3: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/3.jpg)
My background
• Math PhD from Southern Illinois
• Institutional researcher
• Institutional effectiveness chair
• SACS liaison
• Library and IT responsibilities
![Page 4: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/4.jpg)
Why isn’t IE easy?
![Page 5: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/5.jpg)
People!
![Page 6: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/6.jpg)
Being Realistic
MoreWork
High Motivation
Less Work
Anti-Motivation
No Motivation
![Page 7: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/7.jpg)
Motivation Strategies
• Cultivate existing motivation
• Create new motivation– Incentives– Punishments– Temporary– May have unpleasant side effects
![Page 8: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/8.jpg)
Making it Easier
• Make the project simple to understand– Use familiar language or gently introduce new
language
• Use electronic systems to minimize effort
• Don’t duplicate effort– Use existing information where possible
![Page 9: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/9.jpg)
Case Study: Writing Assessment
How can we gather authentic samples?
![Page 10: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/10.jpg)
Situation
Student → email → instructor
• Emails get lost
• Papers vanish after term is over
![Page 11: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/11.jpg)
Solution
Student → portfolio → instructor
• Dependable repository saves trouble
• Papers are saved for later assessment
• Adds a new form of communication
![Page 12: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/12.jpg)
![Page 13: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/13.jpg)
![Page 14: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/14.jpg)
Case Study: Documentation
Keeping track of documents is time-consuming, so many people don’t bother.
This is a problem in creating a compliance certification, for example.
![Page 15: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/15.jpg)
![Page 16: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/16.jpg)
Searching
![Page 17: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/17.jpg)
Search results
![Page 18: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/18.jpg)
Use in Certification
![Page 19: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/19.jpg)
Case Study: Building Plans
“Solution”: give staff and faculty the SACS Principles and ask them to make it so!
![Page 20: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/20.jpg)
Section 3.3.1
The institution identifies expected outcomes for its educational programs and its administrative and educational support services; assesses whether it achieves these outcomes; and provides evidence of improvement based on analysis of those results.
![Page 21: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/21.jpg)
What does it mean?
… provides evidence of improvement based on analysis of those results.
![Page 22: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/22.jpg)
It sounds like:
1. Set a goal
2. Measure attainment of the goal and do some analysis
3. Provide evidence that the goal is now being attained better
![Page 23: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/23.jpg)
The missing links
1. Set a goal.
2. Measure attainment of the goal and do some analysis.
* Take actions that may lead to improvement.
** Measure goal attainment again, and compare to the first time you did it.
3. Provide evidence that the goal is now being attained better.
![Page 24: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/24.jpg)
“Ideal” Example
1. Goal: reduce attrition
2. Measurement: currently the 5 yr grad rate is 60%
* Take action: raise admission standards
** Measure again: now the 5 yr rate is 62%
3. Evidence: before and after rates constitute evidence of improvement
![Page 25: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/25.jpg)
What’s more important?
• Taking informed ACTION?– Practical—we can act– Immediate—we can act NOW
• Show evidence of IMPROVEMENT?– May be impractical– Takes time
![Page 26: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/26.jpg)
Standardizing 3.3.1
1. General Objective
2. Outcomes statement
3. Assessment method
4. Results and analysis
5. Actions and improvements
Which do people care more about?
![Page 27: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/27.jpg)
![Page 28: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/28.jpg)
![Page 29: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/29.jpg)
Case Study: General Ed
How can we increase motivation and decrease new requirements in assessing general education objectives?
![Page 30: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/30.jpg)
Assessing the Elephant
![Page 31: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/31.jpg)
Longitudinal
Core Skills Over Four Years
1.0
1.2
1.4
1.6
1.8
2.0
2.2
1 2 3 4 5 6 7 8
Semester
Assessed
Level
Writing
Speaking
![Page 32: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/32.jpg)
Distribution
2005-6 FACS Average Distribution
0%
5%
10%
15%
20%
25%
30%
35%
40%
45%
50%
Performance level
Fra
ctio
n o
f cl
ass
Fresh
Soph
Jr
Sr
![Page 33: Effectiveness ASAP (As Simple As Possible) David Eubanks Dir. Planning, Assessment, and Information Services Coker College.](https://reader036.fdocuments.net/reader036/viewer/2022062515/56649cc95503460f94991c8e/html5/thumbnails/33.jpg)
GPA
FACS Composite by GPA
0.5
0.7
0.9
1.1
1.3
1.5
1.7
1.9
03FA 04SP 04FA 05SP 05FA 06SP
Semester
FA
CS
Co
mp
osi
te A
vera
ge
GPA > 3
2 < GPA < 3
GPA < 2