Implementation and Outcomes of High‐ Impact Practices across STEM

Disciplines at an HBCU

Andrew D. Lloyd, Associate Professor Department of Biological Sciences

Cynthia van Golen, Associate Professor Department of Biological Sciences

Margie Vela, SMILE Project Assistant DirectorRashida Davis, RISE Program Coordinator

Delaware State University, Dover, DE

Delaware State University

• Founded in 1891, Land Grant institution

• 75% African-American enrollment

• Enrollment is currently 4178 students; primarily from the Mid-Atlantic region

• 52 undergraduate degree programs, 25 master’s degree programs and five doctoral degree programs

• STEM focus

Core FeaturesSMILE

NSF - funded

• Mentoring – Peer/academic focus

• Research Scholars – Faculty-focused

• Peer-led Team-Learning - Math

RISE

NIH - funded

• Mentoring - Leadership focus

• Research Scholars – Student-focused

• Peer-led Team-Learning - General Biology

RISE - Mentorship

• Individual mentorship– Individual meetings

– Resume/CV prep

– Research mentor/student matching

• RISE Library

• Professional development seminars

• Graduate student/undergraduate researcher pairing, mentorship lunches

SMILE Project - Mentorship

• Incoming first-year students

• Mentored by successful sophomores and juniors

• Students attend one-week summer training camp before classes begin

• Mandatory weekly contact with peer mentor

• Mandatory weekly study hall

SMILE Mentoring Program Planning Cycle

Prelaunch Preparation

Clarifying Institutional Needs

Spring

Prelaunch Preparation

Assess level of training needs for mentors

Summer

Prelaunch Preparation

Train Mentors and Protégés

Summer

Program Launch

Pairing Mentors and Protégés

Late Summer

Program Support

Mentor Weekly meetings

Academic Year

Program Support

Weekly Group Debriefing Session

Academic Year

Program Evaluation

Mid Term and End of Year

Report

Mid Term and End of Year Report

End Fall Term, End Spring Term

Program Evaluation

Measuring, Adjusting, and Sustaining

Mid Term

Program Evaluation

Refining Goals and Strategies

End of Academic Year

Prelaunch Preparation

Recruit mentors

April

Prelaunch Preparation

Identifying and Validating Protégés Needs

Spring

• Skill Building Sessions – Mathematics, Problem Solving, &

Analytical Reading– Foster Higher-level Thinking– Instill a “Growth-model” mindset

• Science lab activities– Carry out a group research project in their

major• Motivational Speakers– Instill positive self-beliefs

• Team-Building Exercises

SMILE Project - Freshmen Training Camp

SMILE – Mentoring Impact

• No overall improvement in GPA

• Impact on retention in the major unclear

• Significant impact on credit-hours earned

• Impact on pass rates in selected gatekeeper courses inconsistent

• Protégés self-report improved academic focus, time management and interpersonal communication

Implementation - RISE Scholars

• Chosen through application during the fall semester of freshman year

• Two academic years of funding ($2400/semester), two summers of funding ($3600/summer), although encouraged to apply offsite after sophomore year

• Presentation of research required

• One-semester class - Research Operations

Outcomes: RISE Scholars

GPA- RISE SCHOLARS

RISENon-RISE,

STEMNon-RISE, left

STEMNon-RISE,

Overall

Cohort 1 3.52 (N=7) 2.26 (N=80) 2.35 (N=66) 2.30 (N=146)

Cohort 2 3.23 (N=10) 2.32 (N=89) 2.56 (N=43) 2.40 (N=132)

Cohort 3 3.78 (N=8) 2.38 (N=125) 2.42 (N=24) 2.38 (N=149)

Effects of Research Operations Course

• Proposal written by faculty member; must contain professional development plan for student researcher

• A $3600 over the summer and $1500/per semester stipend for a year-long commitment to a research project with a faculty member.

• Up to $4000 for equipment and supplies to the PI to support the research.

• Presentation of research at the Emerging Researchers National (ERN) Meeting.

• Presentation of research at DSU’s Undergraduate Research Symposium and during Honors Day.

SMILE Project Undergraduate Research – Organization

SMILE Project Undergraduate Research - Implementation

• Eight to ten projects funded each year

• Students gained experience presenting their work

• One challenge was maintaining student involvement in one project for an entire year

• Several student research presentations won awards at ERN and other conferences

RISE – Peer-Led Team-Learning (PLTL) in General Biology

• RISE trained and supervised peer leaders for PLTL workshops in General Biology

• Peer leaders paid by RISE

• Utilized instructor-developed problems

• Added two additional contact hours to the course for a total of 9 hours/week

• Implemented in all sections starting Fall 2011

RISE PLTL - Implementation

• Year 1: One section (out of 3); 1 leader per workshop, workshop size 6-16 students

• Year 2: All three sections; 2 leaders per workshop, workshop size 24 students; leader coordinator

• Year 3: All three sections; 2 leaders per workshop, workshop size 24 students; leader coordinator

RISE Outcomes - Peer-led Team Learning

SMILE Project – PLTL Organization

• College Algebra, Trigonometry and Calculus I• Initially implemented as stand-alone workshop

class linked to math course (Fall 2010)• Changed in Fall 2011 by adding one hour

(Trigonometry) or two hours (College Algebra and Calculus I) to courses

• Time split between class material and problem-solving using “Problem of the Week” format developed by the Math Forum at Drexel University

Overall PLTL Impact

• Some apparent improvement in pass rates in General Biology

• No effect in College Algebra grades, but do see improved pass rates in Trigonometry

• Analysis of grades in subsequent Biology courses is planned

• Change in Biology curriculum has disrupted continued PLTL implementation

SMILE Project – Summer Online Math Classes

• Math placement procedure changed for the class matriculating in Fall 2011

– Cut scores for College Algebra placement raised

• Nearly 90% of incoming STEM majors placed into non-credit developmental math (Intro. to Algebra)

• SMILE developed and offered online version of Intro. to Algebra in the Summer of 2012 to SMILE students placing into that course

– Contracted with outside developer

SMILE Project – Summer Online Math Classes

Results for Summer 2012:

•Of 26 SMILE students, 21 passed the summer online Intro. to Algebra course (80.8%)

•These students were able to take College Algebra in their first semester

•This could potentially increase their credit-hours earned compared to non-SMILE STEM students

•Analyzed this cohort’s performance on the Fall 2012 College Algebra common departmental final exam

SMILE Project – Summer Online Math Classes Summer 2013

• Positive results encouraged us to expand project to online College Algebra

• All incoming SMILE students were placed in either College Algebra or Intro. to Algebra

• Used modified placement procedure for College Algebra

– For all placed into Intro. to Algebra reviewed math SAT and HS math classes

– Ten students were moved up to College Algebra

Impact of Taking Summer Online Math Course

Fall Math Course Initial Math PlacementEnrollment After

Participating in Summer Online Math Course

Trigonometry or higher 2 21

College Algebra 12 21

Introduction to Algebra 35 7

Summer 2013 Online Math Classes - Impact

• Pass rate for online Intro. to Algebra similar to 2012 (75%)

• Students in the online College Algebra class outperformed students in the same course taught in person by the same instructor

• The number of SMILE students who started Fall 2013 semester in non-credit developmental math reduced from 35 to 7

• Performance in Trigonometry this fall will be assessed.

Overall Lessons Learned

• Be flexible

• However, structure and organization is key

• Train, train, train

• Set up systems to ensure accountability

• Make use of external and internal evaluation

• Know your population and its needs

Acknowledgements

The SMILE Project was supported by the National Science Foundation Grant – HRD 0928404

RISE is supported by the National Institute Of General Medical Sciences of the National Institutes of Health

under Award Number R25GM089669

The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health

Now it’s your turn!

• What is feasible in your institution?

• What support is available?

• What are your students’ greatest needs?