Multiple Approaches to Multiple Measures:

Four Three Approaches to Improving Student Achievement Through More Holistic, Evidence-

Based Multiple Measures Assessment and Placement

RP Conference April 8, 2015

• Janet Fulks• Dean of Student Success & Precollegiate Director of Making

it Happen, Bakersfield College

• Erik Cooper• Dean, Planning, Research, and Resource DevelopmentSierra

College

• Andrew Fuenmayor• Senior Research Analyst, Long Beach City College

• John Hetts• Senior Director of Data Science, Educational Results

Partnership and CalPASS Plus

Student transitions to CC• Community colleges rely nearly entirely on

standardized assessment• Increasingly, students placed below college-level

• Significant barrier (Bailey, Jeong, and Cho, 2010)

• First interaction• Imply that most students are not ready for college and

are likely to fail• Convinces many, including our students

• Multiple measures (esp. GPA) hold substantial promise for fairer and more accurate predictor of college performance/graduation• Challenges to implementation, ROI, second order effects

Four reimaginations of that front-door interaction in CCCs

• Bakersfield College• Sierra College• Long Beach City College

• Rio Hondo College

Bakersfield College

Overview of Intervention• Multiple measures placement• Testing changes: test and location• Student Support• Mentors• Summer Bridge• Convocation Ceremony• Classroom Interventionists

Key Data Issues for BC

Completion Data

Basic Skills Progress

Data

CCSSE – Perception

Data

Equity Data

SSSP-Student

Service Data40.5%

33.5% 31.7%

57.2%

44.1%

34.7%

43.6%

34.8%30.8%

33.3%

51.5%

42.9%

30.3%

40.7%

Completion Unprepared Students Statewide and Bakersfield College

Statewide Rate BC Rate

Goals of MIH Make a difference in the number of students who succeed

By connecting earlier in the pipelineProviding timely information and guidance at BC

Increase Student engagementclassroom interventions, SARS, Habits of the Mind and mentors

Decrease Student time to completionBetter placement –multiple measures, new placement testFaster remediation2 years to complete the degree - when college ready

Assess Learning outcomes (Think, Communicate, Demonstrate, Engage)Pilot with 500; Scale up to all students

Achieving the Dream Summit

4 levels below three levels below two levels below one level below Transfer level

2013 Writing (n=2171) 11% 37% 6% 17% 29%

2014 Writing (n=2175) 8% 35% 6% 19% 31%

Series3 NaN NaN NaN NaN NaN

2013 Math (n=2581) 35% 35% 21% 6% 3%

2014 Math (n=2489) 33% 18% 30% 7% 12%

3%

8%

13%

18%

23%

28%

33%

38%

11%

37%

6%

17%

29%

8%

35%

6%

19%

31%

35% 35%

21%

6%

3%

33%

18%

30%

7%

12%

Placement Changes as a Result of Multiple Measures Implementation 2013 compared to 2014

Perc

ent

Plac

ed a

t tr

ansf

er le

vel a

nd b

elow

for

Mat

h an

d W

ritin

g

Placement Test Results Jan 2013-December 2013

4 Levels below

3 Levels below

2 Levels below

1 Levels below

Transfer Level

Total tested

Math 2684 2034 2359 732 325 8134

English 659 2710 513 1318 2124 7323

Reading 509 799 727 872 4359 7265

The Pathway by Placement in course load and price

Math 16 units $736.00

14 units $644.00

10 units $460.00

5 units $230.00

English no class offered

10 units $460.00

8 units $368.00

4 units $184.00

Reading no class offered

10 units $460.00

7 units $322.00

3 units $138.00

Cost in Dollars from levels below to transfer

Math $ 1,975,585 $1,309,574 $1,085,075 $168,373 Math $ 4,538,609

English no class offered

$1,246,374 $ 188,640 $242,537 English $ 1,677,552

Reading no class offered

$367,609 $233,933 $120,308 Reading $ 721,850

If all who tested were remediated $6,938,012

School Multiple Measured up

Accelerated Compressed Not Moved

Success No Success No Success No Success No

HS#1 16 4 7 3 33 12

HS#2 11 13 4 7 1 3 34 31

HS#3 13 7 11 3 6 0 11 8

HS#4 8 10 3 6 0 0 15 18

HS#5 4 1 2 0 0 0 2 0

HS#6 0 0 0 0 0 0 2 2

HS#7 24 19 11 12 1 1 29 31

HS#8 0 0 0 0 0 0 2 3

HS#9 11 8 9 4 0 0 32 14

HS#10 6 8 3 9 0 0 27 32

HS#11 19 2 6 0 2 0 36 19

Total 112 72 56 44 10 4 223 170

Treatment success rate

61% 56% 71% 57%

Treatment Results and Success Data by High School

12

What we have learned from the data

2014 MIH Cohort (n=467)

Previous 3 Cohorts (n=326)

Enrolled 70% (326) 58% (264) Percent with Multiple Measures Placement

100% 0

Enrolled in English first semester 76% (248) 38% (100) Enrolled in ENSL first semester 10% (32) 28% (75) Enrolled in Math first semester 75% (246) 41% (108)

GPA and Unit ceiling???????

13

What we have learned from the dataMIH Group Math

(college-wide)

English (college-wide)

Reading (college-wide)

Total students enrolled from each cohort

2011 64% (50.5%)

57% (57.4%)

62% (59.3%)

73

2012 59% (52.7%)

64% (61%)

75% (60.8%)

92

2013 64% (53.1%)

61% (61.8%)

59% (61.6%)

99

2014 47% 60% 62% 326

English 1A Transfer, Degree and Certificate

29% placed

English (7323 placed)

English 50 4 units

18% placed

English 60 4 units

7% placed

ACDV 65 2 units

37% placed

Academic Development

ACDV 201 9% placed

ENGLISH PLACEMENT 7323 STUDENTS PLACED 2012-13

18%

Academic Development

ACDV 201 (9%)

English 60 & English 50 Compressed Learning Community

25% placed into this series 8 units in one semester

ACDV 65 2 units

37% placed

29%

Academic Development

ACDV 201 (9%)

English 53 Accelerated 25% placed into this series

4 units in one semester

ACDV 65 2 units

37% placed

New Placement based on HS GPA and HS

English Grades

English 53 Accelerated 65% placed into this series

4 units in one semester

Potential UNITS Cost to

get all to English 1A

$1,677,552 3 semesters 10

units

Potential UNITS Cost to

get all to English 1A $1,084,682

2 semesters 6 units

Potential UNITS Cost to

get all to English 1A $208,851

1 semester 4 units

Negative

Positive1. Correction of institutional barriers2. A learning institution (president &

classified)3. Analysis of this group compared

to overall4. Equity insights5. Improvements to bridge and

summer6. Improvements to other support

services and instruction7. Partners – high schools,

community groups, CalPASS, CalSOAP

1. Inability to use many college services

2. Problems with communicating through email

– Email address– Not using email – texting– No computers

3. Messaging and culture (financial aid & early alert)

4. Overall Math + English + Reading + 12 + units were too much all together

5. Learned about unit ceiling for this cohort

Lessons Learned and Unintended Consequences

Our president and her mentee

Sierra College

Long Beach City College