Eli 2012 Sensemaking Analytics
description
Transcript of Eli 2012 Sensemaking Analytics
![Page 1: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/1.jpg)
Sensemaking: Beyond analytics as a technical activity
George Siemens
April 11, 2012
![Page 2: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/2.jpg)
“The world is one big data problem”Gilad Elbaz
![Page 3: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/3.jpg)
NYTimes 2012
![Page 4: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/4.jpg)
Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs.
![Page 5: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/5.jpg)
Focus of analytics Who Benefits?
Course-level: social networks, conceptual development, language analysis
Learners, faculty
Aggregate (big data) predictive modeling, patterns of success/failure
Learners, faculty
Institutional: learner profiles, performance of academics, resource allocation
Administrators, IR, funders, marketing
Regional & National (state/provincial): comparisons between systems
Governments, administrators
International: ‘world class universities’ National governments (OECD),
![Page 6: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/6.jpg)
Are learning analytics new?
No: testing, assessment, institutional research, retention
Yes: data quantity, models, personalization, adaptivity, techniques, data sources, processing power
![Page 7: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/7.jpg)
![Page 8: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/8.jpg)
![Page 9: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/9.jpg)
![Page 10: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/10.jpg)
![Page 11: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/11.jpg)
![Page 12: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/12.jpg)
![Page 13: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/13.jpg)
![Page 14: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/14.jpg)
![Page 15: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/15.jpg)
The tools and techniques of analytics are often seen as the intent of analytics
![Page 16: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/16.jpg)
CCK08: Introduction forum
Limited interaction. Most are isolated
http://www.snappvis.org/
![Page 17: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/17.jpg)
Introduction forum posts: CCK08
Dialogue limited: Group too large?
![Page 18: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/18.jpg)
Analytics should lead to new ways of thinking and acting
![Page 19: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/19.jpg)
To avoid getting lost in the “mass of inconsequential”
(Bush, 1945)
We still need control, but the points are different than where the education system has assigned them in the past.
![Page 20: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/20.jpg)
But, analytics are not (should not be) primarily a technical activity…
![Page 21: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/21.jpg)
All the important stuff with analytics happens…after we’ve done the analytics
![Page 22: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/22.jpg)
i.e. the social processes
Educator intervention
Learner self-regulation
Rethinking teaching
Evaluating learning design
![Page 23: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/23.jpg)
Why is sensemaking (and social processes) so important?
Multiple data sets/sources Learning is a complex social activity (technical
methods do not capture the full scope and nuanced nature of learning)
Integrated social and technical systems provide diverse and nuanced approaches
![Page 24: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/24.jpg)
Complex systems:
“a set of diverse actors who dynamically interact with one another awash in a sea of feedbacks.”
Miller and Page, 2007
![Page 25: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/25.jpg)
Complexity:
“disturbing traits of mess, of the inextricable, or disorder, of ambiguity, or uncertainty”
Morin, 2008
![Page 26: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/26.jpg)
Coherence is the thing…
![Page 27: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/27.jpg)
Sensemaking
“Sensemaking is a motivated, continuous effort to understand connections . . . in order to anticipate their trajectories and act effectively”
(Klein et al. 2006)
![Page 28: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/28.jpg)
or
“Sensemaking is about labeling and categorizing to stabilize the streaming of experience”
(Weick et al. 2005: 411)
![Page 29: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/29.jpg)
We are skilled at sensemaking in social systems
![Page 30: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/30.jpg)
But we easily acquiesce to technical systems
![Page 31: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/31.jpg)
Less skilled at sensemaking through technology (data can be kinda unsettling)
Target Utah spy center Military
![Page 32: Eli 2012 Sensemaking Analytics](https://reader035.fdocuments.net/reader035/viewer/2022062512/55492fd4b4c9059f4c8c12b0/html5/thumbnails/32.jpg)
Focusing analytics
On the end user experience & related social cognitive/learning needs
(most end users will not be skilled in analytics…the human intervention/social systems need to be reflected in analytics)