LEARNING TOGETHER AND THE STUDENT EXPERIENCESTRATEGIES TO ACHIEVE OUTCOMES Student Inquiry...

LEARNING TOGETHER AND THE STUDENT EXPERIENCE:

Institutions Embracing Data to Help More Students Start, Stay & Finish Strong

Mark David Milliron CIVITAS LEARNING® COPYRIGHT © 2018 [email protected]

mailto:[email protected]

http://www.toddrose.com/endofaverage/

http://www.slate.com/blogs/the_eye/2013/10/18/creative_confidence_a_new_book_from_ideo_s_tom_and_david_kelley.html

ISSUES DRIVING CHANGE

• Success Indicators

✓ Completion, on-time completion, transfer,

equity gaps, STEM, career success, thriving

• Enrollment

• Affordability

• Initiative Fatigue

• Resource Optimization

• Personalization

DATA IMPACT MATRIX A THEORY OF WORK

INSI

GH

T

INTELLECTUALLY CURIOUS

Late Signal

STATUS QUO

No/Wrong Signal

BEST PRACTICISM

Weak Signal

STUDENT

SUCCESS

SCIENTISTS

Strong Signal

ACTION

THE OPPORTUNITY FOR GREATER IMPACT

ONBOARDING GET ON PATH STAY ON PATH Successful Transition from Developing an Educational Ongoing Ed Plan and Admission to Enrollment Plan for Success Retention Management

STUDENT JOURNEY

of students fail to enroll

Up to 40% 42% of students are leaving

16% of students leave with enough

within their first 3 terms credits, but no credential

27

$16K CIVITAS LEARNING® COPYRIGHT © 2018

Average excess credits earned without clear path progression

Average additional debt for every year at a two-year college

Tuition revenue lost $$$ due to attrition

CCA, Time is the Enemy | Harvard University, SDP Summer Melt | CCRC, Early Momentum Metrics

CIVITAS LEARNING – DATA TO POWER OUTCOMES

40% OF ACTIVE U.S. STUDENTS

7M ENROLLED STUDENTS

20M STUDENT RECORDS

200M COURSE

ENROLLMENTS

~2K PREDICTIVE

MODELS

CIVITAS LEARNING® COPYRIGHT © 2018

STRATEGIES TO ACHIEVE OUTCOMES

CareerStudent Inquiry Persistence & Graduation

MILESTONE DECISIONS

MAJORS

SECTIONS

OPPORTUNITIES

TO ENGAGE & SUCCESS SUPPORT

COACHING

MINDSET NUDGING

CAREERS

COURSES

SCHEDULE

PRECISION OUTCOMES • ENROLLMENT • EQUITY • PERSISTENCE • COMPLETION • WORKFORCE • PLACEMENT COURSE

ENCOURAGEMENT

RESOURCES & PROGRAMS

POLICY EVALUATION

Civitas Learning® Copyright ©2018

BRINGING THE WORK TOGETHER

Personalized Precision Engagement Pathways

Student Success Intelligence Platform


CIVITAS LEARNING® COPYRIGHT © 2017 | CONFIDENTIAL

TIMELY, RELEVANT INSIGHTS – EMERGING TRENDS, STUDENT-LEVEL SCORES

SIGNAL INTELLIGENCE

O U T C O M E S PERSONALIZED PATHWAYS PRECISION ENGAGEMENT

PE R S O N A L IZ E D IN S I G H TS D R I VE A C T IO N A C R O S S T H E S T U D E N T L I F E C Y C L E

PREDICTIVE

INSTITUTION-SPECIFIC APPROACH – 2000+ PREDICTIVE MODELS IN PRODUCTION

MODELS

DEPTH OF DATA – 95% OF PREDICTIVE POWER COMES FROM DERIVATIVES

ENGAGEMENT ACADEMIC LIFE & LOGISTICS ● LMS activity streak ● Modality features ● Degree program alignment scores ● LMS relative-to-section average ● GPA consistency ● Credits withdrawal patterns

● Terms attempted/completed ratio ● Financial aid change variables DERIVATIVES

BREADTH OF DATA – CROSS-SYSTEM & CROSS-INITIATIVE

DATA SIS LMS FINANCIAL AID CRM ADMISSIONS TUTORING


Exemplar Signals across the Civitas:

OVERVIEW: ILLUME COURSES

YELLOW FLAG SIGNAL Course where even students with a C who persist may be at risk of not graduating.

CHALLENGE SIGNAL (GATEKEEPER/GATEWAY) A significantly above average percentage of students earn Ds, Fs or withdraw and have a lower likelihood of graduating compared to students who earn As, Bs or Cs.

QUALIFIER SIGNAL Only an A improves a student’s likelihood of graduating, where typically an A, B or C all improve graduation likelihood. In addition, students who earn a B are at least 15% less likely to graduate than those who earn an A.

LATE HURDLE SIGNAL Students most commonly take this course three or more years into their career, and student performance is significantly more predictive than other courses taken in the same year.



GRADE SIGNALSOVERVIEW: GRADE SIGNALS

YELLOW FLAG SIGNAL Students who earn “C” in an early term courses tend to persist but not graduate when compared to other courses taken in the same year.

In this English Composition and Rhetoric Course, students that receive a C are 94.4% likely to persist, but are only 52% likely to graduate, compared to an average graduation rate of 70%.

The graduation rate of students with a grade better than a C is 80%.


7.62

IMPACT ON STUDENT OUTCOMES

11.1 percentage points

P E

R S

I S

T E

N C

E

19.0 percentage points

on average and up to

with most challenged


-

-

-

-


COLLEGE SCHEDULER IMPACT ON PERSISTENCE

+2.4pp AVERAGE FOR

FALL 15 16 TERMS

+4.1pp AVERAGE FOR

SPRING 15 16 TERMS

+120 ADDITIONAL STUDENTS

+4.8pp AVERAGE FOR

FALL 15 16 TERMS



+1.7pp AVERAGE FOR

SPRING 15 16 TERMS

3X GREATER FOR STEM STUDENTS



20% increase

in retention

53% more degrees

& credentials awarded

35% more graduates


COMMUNITY INSIGHT 2

GAINING DEEPER UNDERSTANDING OF HIGH GPA DEPARTURES

98% of institutions in this study are losing more students above 2.0 GPA than below it.

This benchmark is based on a data set of 4 million students from 62 institutions.



CAMPAIGN: HIGH GPA, LOW-MODERATE PERSISTENCE

Outreach Goal • Come to advising, persistence

Students Targeted • Undergraduate, GPA 3.0-4.0 w/

low persistence likelihood

Outreach Owner

• Illume Working Group pulls student list, creates case for advisors

Strategy • Sent before spring midterms

Sample Email: We’re Proud of You!

Hi <student first name>,

I wanted to send you a note to see how your semester is going. College can be challenging this time of year and even the most successful students can struggle. Common challenges for students include job commitments, family responsibilities, financial pressures, transportation issues, or a combination of these and other issues. Do any of these sound familiar to you?

If you are experiencing any of these issues, or other things, I am here to help!

I am proud of your progress and excited to support your continued success.

Sincerely,

<Advisor Name>



CAMPAIGN: NEAR-COMPLETERS & THE FINISH LINE

Outreach Goal

• Catalyze completion among students more than 75% of way

Students Targeted

• Students who had accumulated 75% of credits on ANY degree path, segmented by persistence likelihood

Outreach Owner

• Student success team

Strategy

• Identify optimal student group, segment outreach by persistence quartile – top/email, middle/calls, lowest/face to face


http://www.ccdaily.com/2017/06/nudge-campaign-yields-big-jumps-del-mar/?utm_content=56398593&utm_medium=social&utm_source=twitter

CIVITAS LEARNING® COPYRIGHT © 2017 | CONFIDENTIAL

31% increase in graduates in one year

38% increase in credentials awarded


COMMUNITY INSIGHTS REPORT ISSUE 4

FOCUSING ON THE FINISH LINE

COMING SOON



COMMUNITY INSIGHT 1

ONE-MORE COURSE INSIGHT

Differences in persistence rates between number of sections

(courses) attempted, according to institution type.

This benchmark is based on data across 57 institutions (34 community colleges and 23 4-year institutions).

Persistence may be increased with increased course load for some students.

• One more course

Largest increase (14.91 pp) for community

college students taking one course per

term versus two

• Continued, but declining, value

with each increase

Adding even one more course will not

be a reality for all students

• Education is not one-size-fits-all

Need to make realistic recommendations

to help all students


C H I C A G O R E G I O N A L W O R K S H O P

THE PROGRAM

CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION

UNIFIED DATA LAYER

Target Audience: Students in good standing, enrolled in fewer than six hours for Spring 2018

Goal: Students enroll in just one more class, which may put them over the 5.14 credit hour tipping point indicated as a “top perseverance indicator” by Illume

Messaging: Taking one more class will help you achieve your goal faster

C H I C A G O R E G I O N A L W O R K S H O P

OUTCOME

UNIFIED DATA LAYER

2,036 emails

1,053 opens (52% open rate)

199 students added courses

289

Overall 1 percentage point lift in the percent of students taking 7 or more credit hours Spring ‘18 compared to Spring ’17.

CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION


COMMUNITY INSIGHT 1

PARTNER INSIGHT


https://civitaslearning.zoom.us/webinar/register/2415204871497/WN_GrUC-V34T6yG3euld9-mYw


Measure the impact of programs, policy changes & interventions

• Identify comparable control groups

• Leverage prediction-based propensity score matching

• Measure true intervention efficacy

• Meets What Works Clearinghouse guidelines


Hi Sam,

Welcome to the university. Congratulations again on your

scholarship! We’re so happy to have you as a student. It was great

meeting you at our advising session last week.

Did you know our most successful students the real rock stars

visit the Writing Center an average of 6 times the first semester

their junior year. Let’s make sure you’re a rock star too! I can arrange

for you to meet up with another student to show you around the

center. Let’s talk.

The Writing Center

here


Sam Jones

Hi Sam…wanted to let you

know that the Writing

Center is a big part of doing

well in your major. The

majority of students using

the writing center are

achieving A’s in their courses. Come see what’s available and how we can

support you! The Writing

Center is located in Goodall

Hall Room 223.

There is a meet-up at the

Writing Center for new

students at 7pm on Thursday.

Can you commit to going?

Maybe

Would you like a reminder on

Wednesday?

Yes

Hi Sam – Here is your

reminder that there is a

meet-up tomorrow at 7pm

for new students at the

Writing Center. 10 new

students are planning to

attend. Are you in?

– –

Matt Champion, Advisor

-


A CLEAR PATH – FROM START TO FINISH

Start Strong

● Easily manage critical onboarding tasks

● Develop a deeper sense of belonging through personalized engagement

Stay on the Path to Success

● Follow course a roadmap, track progress, understand requirements, and evaluate potential plan changes

● Align degree and career, gain insight to job demand

● Quickly find the best fit schedule and enroll for classes

SCHEDULING

PLANNING

ONBOARDING & STUDENT

ENGAGEMENT



THE CIVITAS: A COMMUNITY LEARNING TOGETHER

RESOURCES & RESEARCH

Tools & guidance to start stronger

& learn faster together

● Webinars on tactics & learnings

● Nudge hub

● Playbooks

● User guides

● Civitas Learning Space

● Community Insights Reports

● Podcasts on trends & tactics

● Additional support services

COMMUNITY OF PRACTICE

Networking & opportunities to learn from

other Civitas Partners & industry experts

● National Advisory Board (NAB): Dr. Vince Tinto, Dr. Linda Baer, Dr. Davis Jenkins

● Mission-aligned Investors: Lumina Foundation, ReThink, Valhalla

● Annual Summit: 250+ Partner attendees

● Regional Workshops: Throughout US each year

● Research Partnerships

The Civitas

Representing 300+ Partners


https://www.amazon.com/dp/B073TJBYTB/ref=dp-kindle-redirect?_encoding=UTF8&btkr=1

April 2nd – 4th civitaslearning.com/summit

UNITE AT


LEARNING TOGETHER AND THE STUDENT EXPERIENCESTRATEGIES TO ACHIEVE OUTCOMES Student Inquiry...

Documents

Transcript of LEARNING TOGETHER AND THE STUDENT EXPERIENCESTRATEGIES TO ACHIEVE OUTCOMES Student Inquiry...