Ideas42 Webinar - Behavioral Insights and Interventions in Postsecondary Ed

8/10/2019 Ideas42 Webinar - Behavioral Insights and Interventions in Postsecondary Ed

1/50

Behavioral Insights and

Interventions in PostsecondaryEducation

October 23, 2014

2012 ideas42


2/50

22012 ideas42

TODAYS SPEAKERS

Anthony BarrowsVice President

Lori KnappSenior Associate

SF State Project Lead

Dan ConnollyAssociate

LAGCC Project Lead


3/50

32012 ideas42

This webinar is being recorded and will beavailable online

All webinar attendees are muted to ensure

sound quality

Ask questions through the question or chat

windows on the right, or e-mail them [email protected]

HOUSEKEEPING
mailto:[email protected]:[email protected]


4/50

42012 ideas42

I. About ideas42

II. ideas42 and Postsecondary Education

III.LaGuardia Community College

IV.San Francisco State University

V. Next Steps

VI. Q&A

WEBINAR OVERVIEW


5/50

52012 ideas42

I. About ideas42


6/50

6

Sendhil Mullainathan

Harvard University

Antoinette Schoar

MIT Sloan

Eldar Shafir

Princeton University

board

advisors

affiliates

Todd Rogers

Harvard University

Geoff Cohen

Stanford University

Ben Castleman

University of Virgina

2012 ideas42

FOUNDED BY VISIONARY ACADEMICS

WITH GUIDANCE AND SUPPORT


7/50

APPLY ACADEMIC

THEORIES

A deep understandingof human behavior

from research in

behavioral economics

and psychology.

TO HELP MILLIONS

OF PEOPLE

TO SOLVE HARD

PROBLEMS IN:

EducationConsumer Finance

Economic Mobility

Health

Energy Consumption

72012 ideas42

FOR AN AMBITIOUS GOAL


8/5072012 ideas42

BEHAVIORAL ECONOMICS

Decision Action Outcomes

Choice 1 Action 1 Outcome 1

Choice 2

Choice 3

Choice 4

Action 2


9/5072012 ideas42

Focus on context

BE TEACHES US IMPORTANT LESSONS


10/5072012 ideas42

BE TEACHES US IMPORTANT LESSONS


11/50112012 ideas42

DEFINE DIAGNOSE DESIGN TEST

ACTIONABLE

BOTTLENECKS

SCALABLE

INTERVENTION

DEFINED

PROBLEM

REDEFINE

PROBLEM

FIND ANOTHER

BOTTLENECK

STATED

PROBLEM

DISENTANGLE

PRESUMPTIONS

CAPACITY AND

SCALABILITY

INTERVENTION

CONCEPT

CONTEXT

RECONNAISSANCE

BEHAVIORAL

MAP

HYPOTHESIZED

BOTTLENECKS

POLISH

INTERVENTION

DETERMINE

FEASIBILITY

CLARIFY

OUTCOMES

IDENTIFY

SIDE EFFECTS

ROBUST

EXPERIMENT

ideas42 partner sequential iterative as necessaryconsumer

OUR APPROACH


12/50

122012 ideas42

II. ideas42

andPostsecondary Education


13/50

132012 ideas42

Behavioral design has already shown the potential to

improve outcomes in postsecondary education.

(Bettinger, Long, Oreopoulos,

& Sanbonmatsu, 2009)

Financial Aid Access

(Castleman & Page, 2013)

Summer Melt

$7 per student

+3-7% in

college

enrollment

+8% in

college

enrollment

BEHAVIORAL RESEARCH AND POSTSECONDARY ED


14/50

142012 ideas42

IDEAS42 AND POSTSECONDARY ED

Hosted aConvening

Produced awhite paper

FieldBuilding

Request for

Problems

Two-dayMasterclass

Partner

Selection Selected partners Executed diagnosis

and design process

Assist

Projects


15/50

152012 ideas42

Improve postsecondary outcomes

POSTSECONDARY ED PROJECTS


16/50

162012 ideas42

Matriculation

Retention

LAGCC AND SF STATE


17/50

172012 ideas42

III. LaGuardia Community College(LAGCC)


18/50

182012 ideas42

2-year community

college in Queens, NYC

Current enrollment:

19,000 students

CUNY system

BACKGROUND


19/50

192012 ideas42

65% live in Queens (local)

57% born outside the US

163 countries

129 languages

46% Hispanic, 20% Asian,

19% African American

80% of first-time, full

time students on

financial aid

BACKGROUND

Student Body


20/50

Problem Redefined

Students avoid attending

new student orientation.We would like the

administration to design

an orientation that all new

students will attend.

202012 ideas42

Students are accepted to

LaGuardia but do notenroll. We want them to

complete the enrollment

process and begin classes.

DEFINE

DEFINE


21/50

212012 ideas42

BACKGROUND

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Rank 1

(highest)

Rank 2-5

(averaged)

Rank 6

(lowest)

Student Registration Outcomes by LAGCC Ranking

Nowhere

Elsewhere

LAGCC

DIAGNOSEDEFINE


22/50

222012 ideas42

DIAGNOSE

Testing

DIAGNOSEDEFINE


23/50

232012 ideas42

DIAGNOSE

New

Student

Advising &Registration

DIAGNOSEDEFINE


24/50

242012 ideas42

DIAGNOSE

DIAGNOSEDEFINE


25/50

252012 ideas42

Students admitted to LAGCC in Fall 12 & 13

Dont test

anywhere

Dont register

anywhere

Elsewhere

BACKGROUND

6,000

7,000Register

12,000 19,000

DIAGNOSEDEFINE

32,000 13,00044,000


26/50

262012 ideas42

DIAGNOSE

1. Hassles

2. Lack of studentidentity

3. Non-academic

lives are status quo

4. Aversive stimuliin environment

5. Long enrollmenttime periods

DIAGNOSEDEFINE


27/50

1. Hassles

2. Lack of studentidentity

3. Non-academic

lives are status quo

4. Aversive stimuliin environment

5. Long enrollmenttime periods

272012 ideas42

Design Concept #1:Simplification and

salience

Design Concept #2:

Induce the student

self-concept

DIAGNOSE

DIAGNOSEDEFINE


28/50

282012 ideas42

DESIGN REVISED COMMUNICATION

DIAGNOSE DESIGNDEFINE


29/50

292012 ideas42

DESIGN REVISED COMMUNICATION



30/50

302012 ideas42

Hi [#First Name#],

Were excited to welcome you to the LaGuardia family. Here are some ways to

celebrate the start of your LaGuardia college career:

1) Tell us why youre excited to attend

Help us paint a picture of the incoming class by replying to this e-mail with a short

message about why youre attending LaGuardia. Well post your message (with just

your first name) along with your classmates messages on our website.

2) Update Facebook to show that youre a student at LaGuardia

Click Update Info on your profile and add LaGuardia Community College under

Where did you go to college? You can also like us on Facebook to stay on top of

upcoming events and activities.

3) Tweet your great news

Just click here to let everyone know youre coming to LaGuardia this fall. You can

also follow us @LaGuardiaCC to join the conversation.

We look forward to seeing you soon! Congratulations again.

Sincerely,

Loretta CapuanoDirector, Student Information Center

DESIGN NEW COMMUNICATION

http://www.laguardia.cuny.edu/home/https://www.facebook.com/help/276177272409629https://www.facebook.com/LaGuardiaCChttp://twitter.com/home?status=Excited%20to%20attend%20@LaGuardiaCC%20in%20the%20fall!http://twitter.com/home?status=Excited%20to%20attend%20@LaGuardiaCC%20in%20the%20fall!https://www.facebook.com/LaGuardiaCChttps://www.facebook.com/help/276177272409629http://www.laguardia.cuny.edu/home/


31/50

312012 ideas42

Designs are live Approx. 3000 students (Spring 2015)

Students paying attention and acting

E-mail open & click-through rates

Administrative data

Goal:To increase student matriculation

TESTING

DIAGNOSE DESIGN TESTDEFINE


32/50

322012 ideas42

IV. San Francisco State University(SF State)


33/50

332012 ideas42

Four-year state university in

San Francisco, CA

Current enrollment:

27,000 undergraduates

CSU system

BACKGROUND


34/50

342012 ideas42

90% of students are from

California

More than 70% of

undergraduate students

represent minority

groups

63% receive financial aid

BACKGROUND

Student Body


35/50

352012 ideas42

BACKGROUND

At-Risk Groups

Students from

Southern

California

Underrepresented

Minorities

Students with

a Low GPA

San Francisco


36/50

362012 ideas42

Problem:

Approximately 18% of eligible first-time freshmen fail

to return to SF State for their third semester, wewould like them to continue their enrollment.

DEFINE

DEFINE


37/50


38/50

382012 ideas42

DIAGNOSE STUDENT INTERVIEWS

DIAGNOSEDEFINE

If I didnt know people

from high school,I would be alone.

Out-of-Area Freshman

In high school I had a designated

counselor. At SFSU, I dont even

know who my counselor is.

Freshman Commuter Student

I kept reminding myself that Im

halfway there, why turn backaround?

Fifth-year Senior

Im not stressed about

academics, but Im stressed

about other stuff

Freshman Student


39/50

392012 ideas42

~3,500 FTF in Fall 11

DIAGNOSE

DIAGNOSEDEFINE

Do not return

for Term 2

Do not return

for Term 3

82%95%


40/50

402012 ideas42

1: Difficulty gettinginvolved and feeling partof SF State community

2: Academic,

administrative, andsocial obstacles

3. Lack of positivefeedback or progress

report

DIAGNOSE

DIAGNOSEDEFINE


41/50

1: Difficulty getting

involved and feeling partof SF State community

2: Academic,administrative, and

social obstacles

3. Lack of positivefeedback or progress

report

412012 ideas42

Design Concept #1:Re-framing Norms

and Narratives

Design Concept #2:Affirmation and

Reminders

DIAGNOSE

DIAGNOSEDEFINE


42/50

422012 ideas42

DESIGN VIDEO



43/50

432012 ideas42

DESIGN VIDEO



44/50

442012 ideas42

DESIGN SURVEY DESIGN


ReinforceKey Messages

Briefly explain a school-related challenge that you

overcame, and how you did it. How did you grow

from that experience?

EncourageAction

One strategy students find useful in the transition to

college is finding ways to get involved on campus.

Please select a type of activity or event youd be

interested in.

ProvideAffirmation

Take this opportunity to send your future self

some advice for the year ahead.


45/50

452012 ideas42

DESIGN EXAMPLE E-MAIL AND TEXT

Email Text Message

Most SF State first years join

clubs in the 1st few weeks

come to the quad this week,

or check out the full list of

orgs at http://bit.ly/1qyMJyl"



46/50

462012 ideas42

Designs are live ~6000 students in Randomized Control Trial

Preliminary Indicators:

- Completion rate of video and survey (95%)

- Email open-rates (>60%)

Goal:Increase retention (enrollment), GPA, Credits

Attempted/Completed

TESTING

DIAGNOSE DESIGN TESTDEFINE


47/50

472012 ideas42

V. Next Steps


48/50

482012 ideas42

NEXT STEPS

LAGCC: Intervention live. Tracking results

through 2015.

SF State: Intervention live. Tracking results

through 2015.

Sinclair Community College: Currently

diagnosing the problem. (2014-2015)

Youth Policy Institute: Work will begin in

early 2015.


49/50

492012 ideas42

VI. Q & A

Q&A


50/50

Q&A

E-mail any remaining questions to

[email protected]

Anthony Barrows

Vice President

Dan Connolly

Associate

LAGCC Project Lead

Lori Knapp

Senior Associate

SF State Project Lead

David Mungua Gmez

Associate

Webinar Organizer
mailto:[email protected]:[email protected]

Ideas42 Webinar - Behavioral Insights and Interventions in Postsecondary Ed

Documents

Transcript of Ideas42 Webinar - Behavioral Insights and Interventions in Postsecondary Ed