Lak12 learning designs and learning analytics workshop

50
Where Learning Analytics meets Learning Design Lori Lockyer, University of Wollongong [email protected] Shane Dawson, University of British Columbia [email protected]

description

This workshop was presented at the Second International Conference on Learning Analytics and Knowledge (LAK12) by Lori Lockyer & Shane Dawson.

Transcript of Lak12 learning designs and learning analytics workshop

Page 1: Lak12 learning designs and learning analytics workshop

Where Learning Analytics meets Learning Design

Lori Lockyer, University of Wollongong

[email protected]

Shane Dawson, University of British Columbia

[email protected]

Page 2: Lak12 learning designs and learning analytics workshop

Workshop Overview• 1.00 – 1.15 : Introductions • 1.15 – 1.50: Learning Design• 1.50 – 2.30: Learning Analytics • 2.30 – 3.00: Break• 3.00 – 3.30: Identifying Analytics to support

designs• 3.30 – 4.00: Group reports and Conclusion

Page 3: Lak12 learning designs and learning analytics workshop

Introductions

• Who you are?• Where you are?• What you do?• Where are you with learning designs and/or

learning analytics

Page 4: Lak12 learning designs and learning analytics workshop

Learning Design

Concept evolved soon after the ‘learning object’ concept

Building on ideas of packaging, describing, storing, sharing, reusability

Who, what, where, when, how of teaching and learning

Page 5: Lak12 learning designs and learning analytics workshop

Internationally

Terminology: pedagogical models, pedagogical patterns…

IMSLD http://www.imsglobal.org/learningdesign/

Different frameworks to describe learning designs

Different tools and strategies to create and adapt learning designs

Page 6: Lak12 learning designs and learning analytics workshop
Page 7: Lak12 learning designs and learning analytics workshop

learningdesigns.uow.edu.au (2000)

Page 8: Lak12 learning designs and learning analytics workshop

Based on: Oliver, R. (1999). Exploring strategies for online teaching and learning. Distance Education, 20(2), 240-254.

Page 9: Lak12 learning designs and learning analytics workshop
Page 10: Lak12 learning designs and learning analytics workshop

The Learning Design Journey Language for resources, activities, supports

Tools to translate between teacher language, IMSLD, and LMSs

How do teachers use and interpret LDs

How can LD be used as for review/reflection

LD web 2.0 tool - http://needle.uow.edu.au/ldt/

How do teachers design?

Page 11: Lak12 learning designs and learning analytics workshop

How do teachers design?

• Iterative process• Macro to micro views• Differential considerations and constraints• Inspired by others – regardless of discipline

Page 12: Lak12 learning designs and learning analytics workshop

Activity:Interpreting Designs…

Page 13: Lak12 learning designs and learning analytics workshop

Learning Analytics Overview

1. Learning analytics

2. What data?

3. Case Studies

4. Aligning data with design

Page 14: Lak12 learning designs and learning analytics workshop

Background

Learning Analytics:

is the collection, collation, analysis and reporting of data about learners and their contexts, for the purposes of understanding and optimizing learning

Page 15: Lak12 learning designs and learning analytics workshop

Most important educational movement of the last 100 years.

Do not under estimate

Siemens, G. (2011). An introduction to the role of learning and knowledge analytics in education. Invited presentation, Lisbon, Learning Analytics

Page 16: Lak12 learning designs and learning analytics workshop

Background

Ed theory, Ed practice, SNA, Data mining, Machine learning, semantic, data visualisations, psychology (social, cognitive, organisational)

Page 17: Lak12 learning designs and learning analytics workshop

Large data sets – mine for trends/ patterns or anomalies.• Creatures of habit (Study,

communication, search patterns, networks, credit card security, Movies)

What do patterns indicate and what do changes in habit indicate?

Page 18: Lak12 learning designs and learning analytics workshop

What data do you have access to?

• Online/Offline• Individual/Course/ Program/

Faculty or institutional• Psych based surveys?

Activity

Page 19: Lak12 learning designs and learning analytics workshop

Relationship between grades and online activity

Performance and Behaviour

What data?

Page 20: Lak12 learning designs and learning analytics workshop

Yes there is relationship!

Performance and Behaviour

Frequency of loginsDiscussion activity

Influenced by context

Page 21: Lak12 learning designs and learning analytics workshop

An online world

Concerns with Attrition• Motivation the issue

• Achievement orientations

Page 22: Lak12 learning designs and learning analytics workshop

Achievement orientations

Learning or performing• Carol Dweck• Jen Tan

I just failed my essay. Maybe it was a mistake to text it to my English teacher

Page 23: Lak12 learning designs and learning analytics workshop

Study

Grad School of Medicine• PBL centric• Well integrated OLE

Page 24: Lak12 learning designs and learning analytics workshop

Study

OLE• LMS – clinical cases, content, virtual patients• Learning forum• Admin forum

Page 25: Lak12 learning designs and learning analytics workshop

Study

Learning analytics- Tracking data

Page 26: Lak12 learning designs and learning analytics workshop

Study

Learning analytics• Time online• Forum postings• Sessions• Content• Files• SNA

Learning dispositions• 5 factors

• Learning Goals• Performance Goals• Personal Innovativeness• Cognitive playfulness –

curiosity• Cognitive Playfulness -

creativity

Page 27: Lak12 learning designs and learning analytics workshop

Results

Where to post?• LG = Learning and sharing forum• PG = Admin forum

Page 28: Lak12 learning designs and learning analytics workshop

High users of Admin forum - performance driven

Predicting motivation

High users of learning forum – learning driven

Page 29: Lak12 learning designs and learning analytics workshop

Monitor student participation for understanding motivation – reduce attrition?

So what? Predicting motivation

Better develop and personalise student learning support

Context related

Page 30: Lak12 learning designs and learning analytics workshop

What about social networks?

Student social network data as measures of student learning

Page 31: Lak12 learning designs and learning analytics workshop

Ties = interaction between 2 students

Node = student

Page 32: Lak12 learning designs and learning analytics workshop

Social Networks Adapting Pedagogical Practice

SNAPP

Page 33: Lak12 learning designs and learning analytics workshop

SNAPP

Page 34: Lak12 learning designs and learning analytics workshop

SNAPP

Page 35: Lak12 learning designs and learning analytics workshop

Instructor – subject aim to generate a student community through the online discussion activities

Disconnected students

SNAPP

Page 36: Lak12 learning designs and learning analytics workshop

Instructor – using SNAPP over the course

SNAPP

Signature pedagogy?

Page 37: Lak12 learning designs and learning analytics workshop

Indicators of Academic Success

Engagement in discussion forums

Page 38: Lak12 learning designs and learning analytics workshop

Individual NetworksDisconnected students

Network density

Page 39: Lak12 learning designs and learning analytics workshop

Individual Networks

Ego-networks• Top 10%• Bottom 10%

Page 40: Lak12 learning designs and learning analytics workshop

Individual Networks

Top 10% student located in network

Low 10% network example

Student with a passing grade

Page 41: Lak12 learning designs and learning analytics workshop

Individual Networks

High 10% network example(>90% grade score)

Low 10% student located in network

Students with a grade >75% < 90%

Page 42: Lak12 learning designs and learning analytics workshop

Teacher presence

• Staff intervention• High – 70% of networks• Low – 10% of networks• Why?• Developing community

Blind pursuit of communityModify context

Page 43: Lak12 learning designs and learning analytics workshop

Monitoring online networks – not just participation

- Academic performance- Networking skills- Communication- Creative capacity

Learning analytics – Creativity?

Page 44: Lak12 learning designs and learning analytics workshop

Ronald Burt

“…see early and more broadly”

Communication

Problem solving

Translators of information

Burt, R. (1992). Structural holes: The social structure of competition. Cambridge, Mass: Harvard University Press.

Learning analytics – Creativity?

Page 45: Lak12 learning designs and learning analytics workshop

Bridging structural holes

Learning analytics – Creativity?

Page 46: Lak12 learning designs and learning analytics workshop

Student cognitive playfulness and creativity

Mapping network centrality measures- Betweenness- Closeness- Degrees

Learning analytics – Creativity?

Page 47: Lak12 learning designs and learning analytics workshop

Learning analytics – Creativity?

Very complex

Page 48: Lak12 learning designs and learning analytics workshop

Bringing design and analytics together

Analytics to inform design decisions

Just-in-time analytics to understand learner activity and experience during implementation

Recommendations for action

Analytics for post-implementation reflection and revision

Page 49: Lak12 learning designs and learning analytics workshop

Activity

Learning Design:

What are the core interaction types and why? (engagement, community, independent study, knowledge recall)

What data can you access? Where is this located?

What data will inform these?

What patterns do you anticipate?

Page 50: Lak12 learning designs and learning analytics workshop

Thank you – Questions?