Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

30
http://www.flickr.com/photos/standhere/3870316206/ Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention Steven Lonn @stevelonn Stephen Aguilar @stephenaguilar Stephanie D. Teasley @stephteasley USE Lab University of Michigan USE Lab www.umich.edu/~uselab slideshare.net/stevelonn

description

Steven Lonn, Stephen Aguilar, Stephanie D Teasley This paper describes an intra-institutional partnership between a research team and a technology service group that was established to facilitate the scaling up of a learning analytics intervention. Our discussion focuses on the benefits and challenges that arose from this partnership in order to provide useful information for similar partnerships developed to support scaling up learning analytics interventions. Paper Link: http://dl.acm.org/citation.cfm?id=2460343&CFID=274779637&CFTOKEN=44349477&conferenceID=112

Transcript of Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Page 1: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/standhere/3870316206/

Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Steven Lonn@stevelonn

Stephen Aguilar@stephenaguilar

Stephanie D. Teasley@stephteasley

USE LabUniversity of Michigan

USE Labwww.umich.edu/~uselab

slideshare.net/stevelonn

Page 2: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/standhere/3870316206/

On the “road” to scale...

USE Labwww.umich.edu/~uselab

Page 3: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jmr-holdit/8158512809/ USE Labwww.umich.edu/~uselab

Page 4: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Goal: Help “at risk” engineering students succeed

Problem: Advisors can’t help until it’s “too late”

Solution: Early warning system for advisors

USE Labwww.umich.edu/~uselab

Page 5: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jmr-holdit/8158512809/http://www.flickr.com/photos/dominicmeily/7056121879/

USE Labwww.umich.edu/~uselab

Page 6: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jmr-holdit/8158512809/http://www.flickr.com/photos/dominicmeily/7056121879/

USE Labwww.umich.edu/~uselab

Page 7: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jmr-holdit/8158512809/http://www.flickr.com/photos/dominicmeily/7056121879/

USE Labwww.umich.edu/~uselab

Page 8: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jmr-holdit/8158512809/

STUDENTEXPL RER

USE Labwww.umich.edu/~uselab

Page 9: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jmr-holdit/8158512809/

STUDENTEXPL RER

How do we scale?

USE Labwww.umich.edu/~uselab

Page 10: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/29233640@N07/5473068648/ USE Labwww.umich.edu/~uselab

Page 11: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/worldmirror/4696444162/ USE Labwww.umich.edu/~uselab

Page 12: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/worldmirror/4696444162/

New DatabaseExtract, Transform, and

Load (ETL)Presentation Layer

USE Labwww.umich.edu/~uselab

Page 13: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jan_k/428083570/

Usability Gaps

USE Labwww.umich.edu/~uselab

Page 14: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab

Page 15: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab

Page 16: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab

Page 17: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab

Page 18: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/jan_k/428083570/ USE Labwww.umich.edu/~uselab

Page 19: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Calculation Gaps

http://www.flickr.com/photos/kag2u/3731515838/ USE Labwww.umich.edu/~uselab

Page 20: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/kag2u/3731515838/ USE Labwww.umich.edu/~uselab

Page 21: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/kag2u/3731515838/ USE Labwww.umich.edu/~uselab

Page 22: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/ideanorth/3772047574/

Access Gaps

USE Labwww.umich.edu/~uselab

Page 23: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/ideanorth/3772047574/USE Labwww.umich.edu/~uselab

Page 24: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Performance Gaps

http://www.flickr.com/photos/veggiefrog/3435380297/ USE Labwww.umich.edu/~uselab

☞ Crashing the LMS is not so good

Page 25: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Automatization Gaps

http://www.flickr.com/photos/iowahighways/8028390293/ USE Labwww.umich.edu/~uselab

☞Advisor = Student / Cohort data needs to be added to data warehouse

Page 26: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Alternate Routes

http://www.flickr.com/photos/ncreedplayer/6232200657/ USE Labwww.umich.edu/~uselab

Page 27: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/standhere/3870316206/

Challenge(s) Possible Solution(s)

Institutional Governance & Resources

Benefits all partnersKeep communicating

Usability Gaps Flexibility & TrainingModifications where poss.

Calculation Gaps Nimble tweaksSoftware adjustments

Automatization Gaps New auto processes with new data fields

Access Gaps Work-aroundsData / Policy changes

Performance Gaps Accurate load testing w/peak scenarios

USE Labwww.umich.edu/~uselab

Page 28: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

http://www.flickr.com/photos/standhere/3870316206/

Lessons fromOur Road

Lessons forYour Road?

USE Labwww.umich.edu/~uselab

Page 29: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Acknowledgements

http://www.flickr.com/photos/acmace/4519643728/

Student Explorer TeamAmine BoudaliaAndrew KrummGierad LaputSungJin NamR. Joseph Waddington

M-STEM Academies Partners

LSA Academic File Partners

USE Labwww.umich.edu/~uselab

Page 30: Issues, Challenges, and Lessons Learned When Scaling Up a Learning Analytics Intervention

Contacts

http://www.flickr.com/photos/acmace/4519643728/

Steven [email protected]@stevelonn

Stephen [email protected]@stephenaguilar

Stephanie D. [email protected]@stephteasley

USE Labwww.umich.edu/~uselab

Slides: slideshare.net/stevelonn