ANZLTC14: Bb Analytics - Chris Eske

Data Analy)cs: Insight for Bright Futures

Chris Eske Analytics Specialist Blackboard International

Not a Des)na)on but a Journey!

Chris Eske Analytics Specialist Blackboard International

Agenda •  The Theory •  The Solu)on •  The Reality •  Discussion

Data is not informa)on, informa)on is not knowledge, knowledge is not understanding, understanding is not wisdom.

Clifford Stoll

6

Using Analytics As a Catalyst For Change

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

7

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

Dr Freeman Hrabowski – President UMBC

Four Dimensions of Educational Analytics

Student Learning •  How can I easily find students who are at-risk?

•  Who are the most innovative instructors?

•  How are students performing on learning outcomes over time?

•  Which instructional strategies & tools are being used in courses the most? The least? Which are most effective to enhance student engagement & success?

Student Learning Accountability

•  What strategies to improve the quality of course design and instruction result in better student performance and course evaluations?

•  How many logins, time on task, and other metrics have occurred over time?

•  What student activities are correlated to desired outcomes, grades and course completion?

“Given accurate and timely normed feedback, most

populations will self correct or improve with little or no direct

intervention”

Student at a Glance (student compared to class average)

Does When MaRer?

Aligning Breadth and Depth with Repor)ng Objec)ves

Students Teachers L&T Support

Student Support IT Support Execu7ve

Opera7onal ✓

Tac7cal ✓ ✓

Strategic ✓

17

-‐ Students-‐At-‐Risk

-‐ Course Evalua)on

-‐ Effec)ve Course Design

-‐ Increased Use of Learning Techs

-‐ Scholarship -‐ Resourcing (Personnel)

Reten)on

-‐ Resourcing (Hardware) -‐ Resourcing (Support)

-‐ Reten)on -‐ Benchmarking

-‐ Trends -‐ Resourcing -‐ Audi)ng

Self Efficacy

Information Access

The Reporting Queue

Data Genius

SIS

Select * from Source.PS_STDNT_CAR_TERM stdnt_car_term inner join Student.DimTerm dim_term on

stdnt_car_term.STRM = dim_term.SourceKey and dim_term.IncludeTermInLoad = 1 le` join Source.PS_ACAD_PROG acad_prog on

stdnt_car_term.EMPLID = acad_prog.EMPLID and stdnt_car_term.ACAD_CAREER = acad_prog. stdnt_car_term.STDNT_CAR_NBR = acad_prog and acad_prog.EFFDT <= dim_ter

Analy7cs Solu7on Overview

Student Management Finance Human

Resources Financial

Aid Advancement

PeopleSo`

Datatel

SunGard Banner

Blackboard Learn

Mappings from ERP

& Other Sources

Data Transformation

Data Model Relational & OLAP

Front-End Reporting

• Best Practices • Metrics • Business Rules • Derived Data

A Comprehensive Suite of Packaged Analy:c Applica:ons

Learn

Your Data

Grade & Outcome Results

Course AFributes

Student AFributes

Final Grades

Student Information

System

Performance Analyses Best Practices Analyses

Trend Analyses

Instructor AFributes User

Ac7vity Data Course

Item Data

Metrics

• Gradebook • Possible Score • Score • Weight • Grade Pct • Weighted • Element Count • Highest Score • Lowest Score • Improvement • Average Score • Attempts • Days To Grade

• Goals • TBD

• Course Design • Item Count • Files Attached • VTBE Objects • VTBE Characters • File Size • Folder Depth • Links • Folders

• Course Section • Subject • Department • College • Class Number • Term • Course Career/Level • Instruction Method

• Students • Birthdate • Gender • Ethnicity • Citizenship • Current Term • Primary Major • Career/Level • Academic Level • Current Academic Standing • Primary College

• Instructors • Gender • Ethnicity • Highest Education Level • Faculty Rank • Tenure Status • Primary Department

• User Activity • Sessions

• Logins • Session Minutes • Courses • Content Items • Tools • Modules • Clicks • Pages

• Course Activity • Courses Accessed • Course Access Minutes • Session Course Sequence • Content Items • Pages

• Content Activity • Content Items Accessed • Content Item Hits • Content Access Minutes • Session Sequence • Folder (or Content) Depth

• Submissions • TBD

Learn Metrics Key SIS

Elements

Integrated in Learn

Menu-Based Reports

Self-Service Data Exploration and

Dashboards

Three Ways to Explore Data

Learn Report for Students

Learn Reports for Instructors

Instructors (Lecturer) Course at a Glance

Course Avg.

Advisor – Parameterized Grade Center Excep)on Report

Dean Dashboard

Dean Dashboard (Change delivery method using Slicers)

Direct Costs

Faculty Salary

Taxes, Health Insurance & Other Benefits

Instruc)on-‐Related Opera)ng Expenses

Revenues

Student Tui)on

Other Fees

Outcomes

Academic Performance

Reten)on & Gradua)on Rates

A4SIS: Cost of Instruc7on

Instructional Costs by Course Department

A4SIS: Risk Factor Distribu7on Report

37

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

38

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

39

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

Project Plan – Planning & Set up

1.   Environment Setup •  Server Configura)on

•  Remote Server Access •  Checklist document

2.   Choose BB Learn Source Environment •  UAT/Prod etc

3.   Learn Integra7on •  Install Analy)cs for Learn Building Block

•  Enable the Building Block on the system

•  Select the execu)on )me for the background Data Integra)on Task (which runs once a day)

•  Verify connec)vity between Analy)cs Server and Learn Stats schema

“If data is cool & analysis is powerful,

“If data is cool, & analysis is powerful,

then ac)on driven by analysis is transforma)ve.”

Thank You

Chris Eske [email protected]

ANZLTC14: Bb Analytics - Chris Eske

Education

Transcript of ANZLTC14: Bb Analytics - Chris Eske