Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration...

45
7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527) http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 1/45  Analytics Readiness: Is Your Institution Primed for Success? 4 February 2013 Kimberly Arnold, University of Wisconsin--Madison Steven Lonn, University of Michigan Matthew D. Pistilli, Purdue University

Transcript of Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration...

Page 1: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 1/45

 Analytics Readiness: Is Your Institution Primed for Success?

4 February 2013

Kimberly Arnold, University of Wisconsin--Madison

Steven Lonn, University of Michigan

Matthew D. Pistilli, Purdue University

Page 2: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 2/45

•  Who we (and you) are

•  Introduction

•  Whatarewedoinghere?

•  Analy2csreadinesscomponents

•  Whoshouldcompletethereadinessinstrument?

•  Group work/Break/Report out

•  Next steps

•  How to keep the conversation going

Page 3: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 3/45

IntroductionWho we (and you) are

Page 4: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 4/45

Page 5: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 5/45

Page 6: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 6/45

Institution Types

§  No community colleges represented§  40% four-year institutions

§  80% PhD granting

§  53% public

§  20% private

Page 7: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 7/45

Primary Roles

14%

14%

14%

36%

21%

Admin

Faculty

InstDesign

IT

Research

Page 8: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 8/45

Time in Higher Education

0%

33%

67%

Lessthan5years

5to10years

Morethan10years

Page 9: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 9/45

Learning Analytics Familiarity

53%

27%

20%

Novice

Immediate

Expert

Page 10: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 10/45

Learning Analytics Experience

§   Attending presentations, readings –Most of us

§  Campus/national discussions (50%)

§  Small scale exploration (40%)§   Application (30%)

Page 11: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 11/45

Why are you here?

§  Interest in learning analytics (33%)§  Institutional directive (26%)

§  Learn more about learning analytics (63%)

§  Gather resources/network (26%)

Page 12: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 12/45

IntroductionWhat are we doing here?

Page 13: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 13/45

What brought us here?

§  Semantic bickering§  Surveying the landscape of LA

§  Institutional capacity (Norris and Baer)

§  ECAR State of Analytics at your Institution(Bischell)

§  Funding streams want to invest wisely

§  Time for action

Page 14: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 14/45

IntroductionThe analytics readiness components

Page 15: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 15/45

 Analytics Readiness Components

§  Components to base on research/experience§  Stakeholders

§  Technical infrastructure

§  Institutional support§  Strategic

§  Financial

§  Human capital

§  Model building

Page 16: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 16/45

 Analytics Readiness Components

§  Components to discuss today§  Intent and goal of initiative

§  Data

§   Assessment and evaluation§  Human capital

Page 17: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 17/45

IntroductionWho should complete the instrument?

Page 18: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 18/45

So, who do you involve?

§  Institutional leadership§  Faculty

§  Student affairs

§  Business staff §  Students (yes, students!)

Page 19: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 19/45

Create focus

§  What problem do you want to address?§  What data/information is available?

§  Who on campus needs to provide input?

§  How can you provide leadership to movethis effort forward?

§  What will success look like in the end?

Page 20: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 20/45

 Analytics Readiness – Is Your Institution Primed for Success?

Group Work I

Page 21: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 21/45

Group Work

§  30 minutes§  Google docs

§  Given component--details

§  what are the individual pieces§  context specific criteria

§  where best source for accurate

information about that component 

Page 22: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 22/45

Group Brainstorming Activity

§  Intent & Goals / Outcomes§  bit.ly/lar_intent

§  Data

§  bit.ly/lar_data§   Assessment & Evaluation

§  bit.ly/lar_assessment

§  Human Capital§  bit.ly/lar_human

Page 23: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 23/45

Report Out I

Page 24: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 24/45

Break

Page 25: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 25/45

Group Work II

Page 26: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 26/45

Group Work

§  20 minutes§  Google docs

§  Given component--details

§  What measures can be used?§  How do we gauge an institution's

preparedness 

Page 27: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 27/45

Report Out II

Page 28: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 28/45

Next Steps

Page 29: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 29/45

Next Steps 

§  Build the instrument§  Pilot and validate

§  Refine

Page 30: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 30/45

How to Keep the Conversation Going

Page 31: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 31/45

Overview

§  Leaders – who & how to connect§   Activities & Events

§  Initial Actions – Setting the Stage

§  Mapping the Current Data§  Connecting with External Organizations

Page 32: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 32/45

Who are the local Analytics Leaders?

§  Faculty who are interested in theintersection of “big data” and educationalsuccess / impact

§ Administrators interested in topic and seelong-term potential

§  Staff who maintain institutional data andare actively looking for ways to leverage it

§  Students who are interested in statistics for education, applications for “big data”, etc.

Page 33: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 33/45

How to Connect the Leaders?

§  Special Interest Group (SIG)§  Send to conference & report back

§  Speaker series / symposium

§  Special event§  Others?

Page 34: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 34/45

Example: Symposium Series

§  Symposium on Learning Analytics at Michigan

§  Internal & External Speakers

§ sitemaker.umich.edu/slam 

Page 35: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 35/45

Example: Symposium Series

External Speakers:§  John Campbell – Signals

§  David Pritchard – MITCognitive Tutors

§  John Fritz – Check my Activity§  George Siemens – Multi-

Directional Analytics

§  Krishna Madhaven – Socialmedia & visualization

§  Marsha Lovett – LearningDashboard

§  Tristan Denley – DegreeeCompass

§  David Niemi - Kaplan

Internal Speakers:§  Physics success

§  Chemistry concurrentenrollment

§  Writing – quantitativeassessment

§  Quai-experimentalmethodology in Education

§  Summer Bridge program

§  Engineering advising§  Psychology student

success

§  Student effort -LectureTools

Page 36: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 36/45

From Leaders to Action

§  Example: University of MichiganLearning Analytics Taskforce

§  Provost charged leaders with 3-year charge

and $2 million budget.1.  Explore the UM information environment and

build a learning analytics community

2.  Fund a series of the best proposed LA

projects at UM3.  Review the metrics used to assess teaching

and learning at UM

Page 37: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 37/45

Learning analytics' "goal is to deploytechnology to collect and collate the richestpossible portrait of the progress of students, tomine this data for new insights into what

affects student success, and to support anarray of interventions aimed at optimizingteaching and learning. ... To help theUniversity of Michigan take advantage of thisnew opportunity, the Learning Analytics Task

Force (is) charged with designing a programof activities to draw out, support, and

execute the best ideas in learning analytics atMichigan."

UMLATFWebsite:

hps://sites.google.com/a/umich.edu/um-la/home

Page 38: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 38/45

Example LA Activtieis

§  Exploring Learning Analytics Grants§  Financial & Technical assistance

($50-100K per year)

§ LA Fellows Program (Winter 2013)§  Projects & Training – 17 senior & 15 junior fellows

§  Subcommittees

§  Information environment

§  Teaching & Learning metrics (incl. course evals)

Page 39: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 39/45

Mapping the Data

§  What data is currently available at your institution?

§  Who controls it?

§ What reports are already generated?

§  What tools are already available?

Page 40: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 40/45

Mapping the Data

HR/Benefits Payroll/Time&Labor Financials

Development

Student

Space/Asset

Management

Research

Etc.

Page 41: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 41/45

Example: Existing Tools

Page 42: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 42/45

External Organization Connections

§  LAK Conference§   Also ICLS, CSCL, CHI, etc.

§  Local “Flares”

§ Summer Institute

§  Webinars

§  Listserve / Mailing List

§  Twitter #learninganalytics

Page 43: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 43/45

Recap

§  Leaders – who & how to connect§   Activities & Events

§  Initial Actions – Setting the Stage

§  Mapping the Current Data§  Connecting with External Organizations

Page 44: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 44/45

Wrap Up

Page 45: Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

7/29/2019 Seminar 04A-Analytics Readiness: Is Your Institution Primed for Success? (separate registration required) (166237527)

http://slidepdf.com/reader/full/seminar-04a-analytics-readiness-is-your-institution-primed-for-success-separate 45/45

 Analytics Readiness: Is Your Institution Primed for Success?

[email protected] 

[email protected] 

[email protected]