Learning Analytics Fellows Program Center for Learning Analytics and Student Success

Introduction

In 2015, the Office of the Vice Provost for Undergraduate Education initiated

the Learning Analytics Fellows Program (Fellows), a multidisciplinary Community

of Transformation1 made up of faculty from across the Bloomington Campus.

Faculty engage in scholarly research that uses learning analytics to analyze student

success in their courses, curriculum, and programs to advance IUB’s strategic plan and

its commitment to improved student success. Participating faculty gain the knowledge

and skills necessary to use learning analytics to make data-guided decisions about

student success at the course, program, and university levels1.

Since 2015, forty-two faculty members:

• participated from 22 different

disciplines

• conducted 33 unique research

projects

• studied 110,000 individual

students

• analyzed 3.8 million student

recordsDistribution of fellows by academic field

1 Rehrey, G., Groth, D., Shepard, L., Fiorini, Stefano, & Hostetter, Carol. (2018). Implementation of a Student Learning Analytics Fellows Program. In

A. Pardo, K. Bartimote, G. Lynch, S. Buckingham Shum, R. Ferguson, A. Merceron, & X. Ochoa (Eds.), Companion Proceedings of the 8thInternational Conference on Learning Analytics & Knowledge. Sydney, Australia: Society for Learning Analytics Research.

Seventeen faculty fellows returned for second and third years to

continue researching student success.

QUICK FACTS Academic

Support 10%

STEM 23%

Arts & Humanities 27%

Social Sciences 23%

Professional Schools 17%

Learning Analytics Fellows Program Center for Learning Analytics and Student Success

“Research Interests

Empowering faculty to use learning analytics requires administrative

support and collaborations with institutional data experts. In conducting

their research LA Fellows:

• identify meaningful questions

• operationalize those questions with data

• reflect upon data analysis

• design interventions

• access results before going public with their results

In general, faculty research has focused on four broad categories of

factors that influence student success: choice, demographics,

performance and preparation. Studies analyzed these factors to varying

degrees at the course, program and university levels.

My

participation in the Fellows program completely transformed me and turned me into a bit of a zealot for student success.

—IUB Faculty Fellow, 2015

Data-Informed Culture

Early adoption by Fellows to use analytical data, and their ongoing research about

student success, will continue to contribute to institutional efforts to create a culture

and campus citizenry at IUB that values data-informed decision making, with the

ultimate goal of improving success for all students .2

2 Rehrey, G., Groth, D., Hostetter, C., & Shepard, L. (2019). The scholarship of teaching, learning, and student success: Big data and the landscape of new opportunities. In J. Friber & K. McKinney (Eds.), Conducting and applying the scholarship of teaching and learning beyond the individual classroom level. Bloomington, IN: IU Press.

27.0% 17.0% 10.0%

27.0% 28.0% 14.0%

31.0% 15.0% 10.0%

31.0% 14.0% 12.0%

Choice: Major(s), inflect ion points,

graduat ion pathways

Demographics: Race, ethnicity, class

standing, economic status

Performance: persistence, retent ion,

graduat ion rates, GPA

Preparation: Pre-college courses,

curricula, remedial educat ion

programs

0% 10% 20% 30% 40% 50% 60% 70%

Course Level Program Level University Level

Learning Analytics Fellows Program Center for Learning Analytics and Student Success

Student Learning Analytics Projects

Project abstracts, full proposals and completion reports are available at the Center for Learning Analytics and Students Success http://go.iu.edu/1SVy

2015

Beyond Surveys and Data Mining: Searching for New and Potentially More Useful Indicators of Student Engagement

Principal Investigator: Daniel Hickey (Education Counseling & Psychology)

Finding the Keys to Success Proposal for Learning Analytics Fellowship for Business X201

Principal Investigator: Kari Johnson (Business)

An Inquiry into Student Purpose and Motivation as Catalysts for Retention

Principal Investigator: Molly Burke (The Student Academic Center)

Learning Analytics in RPTS: The Impact of Two Courses on Student Performance, Major Selection, and Degree Completion

Principal Investigator: Jared Allsop Co- Investigators: Julia Knapp, Rasul Mowatt, Sarah Young (Recreation, Park, and Tourism Studies)

Undergraduate Legal System Courses and Where They Fit in the Curriculum for Best Learning Outcomes

Principal Investigator: Shannon Martin (The Media School—Journalism)

2016

Analyzing the Transition from Developmental to Supplemental Education

Principal Investigator: Daniel Hickey (Education Counseling & Psychology)

Ethical Innovations: Exploring How Moral Reflection Benefits Learning Analytics Development

Principal Investigators: James Willis, III & Joshua Quick (Education Counseling &

Psychology)

The HumAn Learning Project Phase II Principal Investigator: Jennifer Robinson (Anthropology)

Do general or specific characteristics of E201 and E202 affect the Principal Investigator: Paul Graf number of Economics majors? (Economics)

Principal Investigator: Jennifer Robinson (Anthropology)

The HumAn Learning Project: Humanities, Analytics, & Learning in a Multi-Section General-Education Course

Principal Investigator: Adam Maltese (Education—Curriculum & Instruction)

An Investigation of Factors Related to Student Choice of Academic Major at IUB

Principal Investigator: Katy Börner (Information & Library Science)

MOOC Visual Analytics Tools

Principal Investigator: Michael Kaganovich (Economics)

Determinants of Students’ Choices of Undergraduate Majors and the Program Strategies

Principal Investigator: Andrew Asher (Library Academic Services)

Evaluating the Effect of Course-Specific Library Instruction on Student Success

Learning Analytics Fellows Program Center for Learning Analytics and Student Success

Student Learning Analytics Projects

2016 (cont.)

Impact of the “Becoming the Best Student” and “You@IU”

Courses

Principal Investigator: Anthony Guest-Scott

(Academic Center)

Role of Peer Networks in Student Choice of Academic Major at IUB Principal Investigator: Adam Maltese

(Education—Curriculum & Instruction)

Using Analytics to Compare Student Demographics for Different Delivery Methods (Face to Face, Hybrid, Online) of AMST-A 100 What is America?

Principal Investigator: Vivian Nun Halloran (English & American Studies)

2017

Evaluating and Optimizing Homework and Quizzes to Increase Learning Outcomes in the Information Visualization MOOC

Principal Investigator: Katy Börner (Information & Library Science)

Evaluating the Impact of the Intensive English Program on Student Success at IU

Principal Investigator: Leslie Gabriele (Second Language Studies)

Evaluating the Teaching Effectiveness of Principles of Micro- economics Instruction at the IU Bloomington Campus Relative to Other Institutions

Principal Investigator: Paul Graf, Co-Investigator Gerhard Glomm (Economics)

Exploring relationships Between the New Indiana Academic English Test (IAET) and External Measures

Principal Investigator: Sun-Young Shin (Second Language Studies)

The Factors of Differential Grading Standards Across Academic Units

Principal Investigator: Michael Kaganovich

(Economics)

The Factors to and Impact of K303 Success Principal Investigator: Jie Li

(Business)

Human Expertise, Analytics, & Student Learning in Multi- Section General-Education Courses at Indiana University

Principal Investigators: Jennifer Meta Robinson (Anthropology), Co-Investigators: John Arthos (English), and Jill K. Robinson (Chemistry)

Learning Analytics for Students Majoring in Healthcare Management and Policy

Principal Investigator: Terri Renner

(School of Public & Environmental Affairs)

Measuring the Impact of Information Literacy Instruction on Assignment-Level Learning Outcomes

Principal Investigator: Andrew Asher (Anthropology & Library Academic Services)

Principal Investigator: Paul Graf (Economics)

Inflection Points of Economics Majors: A Closer Look at Enrollments in Intermediate Microeconomics (E321)

Principal Investigator: Kalani Craig (History)

S&H Fulfillment Patterns and Their Effect on Student Retention

Learning Analytics Fellows Program Center for Learning Analytics and Student Success

2018

Using Analytics to Evaluate Influences on Student Learning Outcomes in a GenEdScience Course

Principal Investigator: Simon Brassell (Geology)

Using Analytics to Evaluate Influences on Student Learning Outcomes in a GenEd Science Course

Principal Investigator: Simon Brassell (Geological Sciences)

Evaluating the Teaching Effectiveness of Principles of Microeconomics Instruction at IU Bloomington Campus Relative to Other Institutions

Principal Investigator: Gerhard Glomm, Co-Investigator, Paul Graf (Economics)

Determinants of Student Attrition Principal Investigator: Michael Kaganovich (Economics)

How Does the Sequencing of Major Courses Influence Student Success?

Principal Investigator: Jie Li

(Business)

Evaluating Student Performance in C118 and N330 Based on Prior Academic Performance

Principal Investigator: Meghan Porter

(Chemistry)

Learning Analytics for Students Majoring in Healthcare Management and Policy

Principal Investigator: Terri Renner (School of Public & Environmental Affairs)

Mitigating Grade Surprise: A Study of Students’ Grade Expectations Using Learning Analytics and Assignment Performance in General Education Courses at Indiana University

Principal Investigator: Jennifer Robinson. Co-Investigators: Jill Robinson, John Arthos, Nina Onesti, Logan Paul, Chung-chieh Shan and Sam Tobin-Hochstadt (Anthropology, Chemistry, English, Informatics and Computer Science)

Evaluating the Effectiveness of Integrated Information Literacy Instruction on Student Outcomes in the English W131 Multilingual Curriculum

Principal Investigators: Katherine Silvester and Andrew Asher (English and Anthropology)

Tracking Student Movement in the SPHB through Learning Analytics Principal Investigator: Sarah Young. Co-Investigators: Jarod Allsop, William Ramos, Donetta Cothran, Maresa Murray and Dohyun Lee

(Recreation, Park, and Tourism Studies)

For more information about the Learning Analytics Fellows Program

please contact George Rehrey, Director, The Center for Learning Analytics and Student Success

classiub@indiana.edu

812-856-4231