Big Data in Learning Analytics - Analytics for Everyday Learning
Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design...
Transcript of Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design...
![Page 1: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/1.jpg)
Visualizing Interaction: Learning analytics to improve online discourse
![Page 2: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/2.jpg)
Agenda
• Online discourse and collaboration
• Social Network Analysis
• Action Research Project with SNAPP
• Future of discourse learning analytics
• Q and A
Online Evaluation: bit.ly/nercomp_NERLA13
![Page 3: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/3.jpg)
Discourse & Online Collaboration
• What is the value of collaboration in an online environment?
• What are the challenges & opportunities do instructors face in facilitating online collaboration?
• To what extent have the roles of instructor and student changed?
![Page 4: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/4.jpg)
The Importance of Collaboration
• To refine and confirm personal understanding with a community of learners
• To develop, foster, and practice higher-order thinking skills
• To share and co-construct knowledge to support emerging collectives
![Page 5: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/5.jpg)
Online Collaboration
Challenges
• Increased Workload
• Difficulty of Encouraging and Sustaining High-Level Discourse
• Asynchronous Interactions
• Lack of F2F Connections
• Challenge of Self-Motivation
• Technical Difficulties
Opportunities
• Time Allocated for Thoughtful and Reflective Dialogue
• Permanency of the Written Word
• Tools Available to Facilitate Interaction and Engagement
• Opportunities for Student Agency and Efficacy
![Page 6: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/6.jpg)
Making the Shift in Roles from…
… Traditional Instructor to Guide and Facilitator
… Presumed Authority to Collective Credibility
… Student as Passive Recipient to Active Producer and Co-Creator
![Page 7: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/7.jpg)
“Learning is in social relationships – situations of cooperation with others…
Both the learner and the community in which they participate are transformed by the
community as a complementary unit that work in harmony to promote learning…”
(Dooley, Lindner, Dooley, & Murphy, 2005, p. 49)
![Page 8: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/8.jpg)
![Page 9: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/9.jpg)
SNA Concepts: Centrality
![Page 10: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/10.jpg)
Centrality
Source: http://socialmedialab.ca/wp-content/uploads/2011/02/Fig.1.jpg
![Page 11: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/11.jpg)
Frequency of Interaction between specific users
![Page 12: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/12.jpg)
Information Brokers
![Page 13: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/13.jpg)
http://katelivesonamat.wordpress.com/
![Page 14: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/14.jpg)
SNA and Online Discourse
• Very little SNA research on online learning and discourse
SNA/Online Discussion: General Findings:
• More evenly distributed activity beneficial
• Low hierarchical structures better (groups interacting, teacher not playing central role)
• More interaction not necessarily better (density)
Toikkanen , T. & Lipponen, L. (2011). The applicability of social network analysis to the study of networked learning. The Journal of Interactive Learning Environments, 19 (4), 365-379
![Page 15: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/15.jpg)
Social Networks Adapting Pedagogical Practice (SNAPP)
![Page 16: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/16.jpg)
![Page 17: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/17.jpg)
What SNAPP can tell you
Dawson, S., Bakharia, A., Lockyer, L., & Heathcote, E. (2011). ‘Seeing’ Networks: Visualising and evaluating student learning networks. Australian Learning and Teaching Council, Canberra, Australia.
![Page 18: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/18.jpg)
Other SNAPP metrics
![Page 19: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/19.jpg)
Dawson et al findings: Instructor use
“extremely effective in promoting reflection on teaching activities and rapidly assessing overall effectiveness..”
“However, teachers require additional support and training to better understand the relationship between their implemented online learning activities and the resultant online student behavior…”
Dawson, S., Bakharia, A., Lockyer, L., & Heathcote, E. (2011). ‘Seeing’ Networks: Visualising and evaluating student learning networks. Australian Learning and Teaching Council, Canberra, Australia.
![Page 20: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/20.jpg)
Interpretation and Learning Design
“Future research and professional development should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning design principles will greatly assist academics in better interpreting the learning analytics data into informed pedagogical action”.
![Page 21: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/21.jpg)
Research Questions
1. How does SNAPP fit within a model of faculty professional development around online teaching and course design?
2. Diagram patterns compare with Dawson et al?
3. Other methods to determine interaction quality?
![Page 22: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/22.jpg)
Action Research Steps
1. Create visual taxonomy
2. Choose instructors
3. Collect data
4. Send “Visual Key” and “Custom Report”
5. Interview instructors
6. Follow- up with instructors
![Page 23: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/23.jpg)
Visual Taxonomy
![Page 24: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/24.jpg)
Instructor-Led
![Page 25: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/25.jpg)
Learning Community
![Page 26: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/26.jpg)
Combined Patterns
![Page 27: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/27.jpg)
Learning Community with strong instructor presence
![Page 28: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/28.jpg)
Emerging Learning Community
![Page 29: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/29.jpg)
Emerging Learning Community with strong instructor presence
![Page 30: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/30.jpg)
Weak Learning Community
![Page 31: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/31.jpg)
Learning Community Development
![Page 32: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/32.jpg)
Two Facilitation Styles
![Page 33: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/33.jpg)
Facilitator Role: Central vs Peripheral
Instructors critical to success of discussion • Blignaut & Trollip, 2003; Ferdig & Roehler, 2004; Greenlaw & DeLoach,
2003; Love, 2002; Roblyer & Wiencke, 2003; Kearsley, 2000; Arnold & Ducate, 2006; Darabi etal., 2011; Ertmer et al., 2011; Liu & Yang, 2012;
Instructors should take a back seat, let students construct own knowledge • Burstall, 2000; Li, 2003; Mazzolini & Maddison, 2003; Poole, 2000; Rourke
& Anderson, 2002; Paloff & Pratt, 2001; Wang & Chen, 2010, Baram & Correia, 2009
![Page 34: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/34.jpg)
Learner Population: Undergraduate Business
Typical Pattern: Learning Community with strong instructor presence
Intervention Suggestions: Reduce/eliminate instructor postings, add summary or “weave” following discussion, use student-led facilitation, organize discussions with use of titled posts.
Intervention Plans: Reduce instructor posting in some discussions and better organize initial posts.
![Page 35: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/35.jpg)
d
Instructor: High Centrality, Low In-Degree
![Page 36: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/36.jpg)
Lessons Learned
• Potential of SNAPP
• Discourse tools
• Focus on design
![Page 37: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/37.jpg)
#??
• What human infrastructure support do you need to consider when implementing L.A.?
• Which departments or support personnel should be involved?
• What types of expertise are required?
• How can we extract value from LMS systems data to improve learning?
![Page 38: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/38.jpg)
Future of discourse learning analytics
Source: http://www.studentsoftheworld.info/sites/people/32917.php
![Page 39: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/39.jpg)
Meerkat-ED
![Page 40: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/40.jpg)
Centrality : Two Views
![Page 41: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/41.jpg)
Group interaction over time
![Page 42: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/42.jpg)
Term Network
![Page 43: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/43.jpg)
![Page 44: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/44.jpg)
Individual Discussion Thread: Click on edges
![Page 45: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/45.jpg)
Natural Language Processing Dan Jurafsky, Professor. Christopher Manning, Associate Professor
https://www.coursera.org/course/nlp
![Page 46: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/46.jpg)
Automated Analysis of discourse
Learning Analytics: Notes On the Future of Learning Analytics, Buckingham, S.
![Page 47: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/47.jpg)
- 1st International Workshop on Discourse-Centric Learning Analytics (2013), Society for Learning Analytics Research
“…a major class of learning analytic will emerge at the intersection of research into learning dynamics, deliberation platforms, and computational linguistics.
…these learning analytics… generate information displays that help learners and/or educators to understand where significant discourse patterns are happening and that support interventions to improve discourse for learning.”
![Page 48: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/48.jpg)
Student Success System: Desire2Learn
![Page 49: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/49.jpg)
![Page 50: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/50.jpg)
#
• How should you prepare to deal with Learning Analytics tools appearing in new systems?
• Are off-the-shelf tools appropriate for your institution?
![Page 51: Visualizing Interaction: Learning analytics to improve ... · should seek to merge learning design with learning analytics and data interpretation. A sound understanding of learning](https://reader033.fdocuments.net/reader033/viewer/2022060523/605279f1ed95c0254a702f81/html5/thumbnails/51.jpg)
`
“The ties between people make the whole greater than the sum of its parts”
Nicholas Kristof, Sociologist
Online Evaluation: bit.ly/nercomp_NERLA13