Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ •...
Transcript of Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ •...
![Page 1: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/1.jpg)
Developing an Analy.cs Dashboard for Coursera MOOC Discussion Forums
CNI Fall 2014 Membership Mee.ng
Bill Parod Northwestern University Informa7on Technology
![Page 2: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/2.jpg)
Northwestern University
• Private / Big Ten • Campuses in Evanston, Chicago, Qatar
• 12 Schools and Colleges
• 19,000 Students • 2,500 Full-‐7me Faculty • $1.9B Budget • $7B Endowment
![Page 3: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/3.jpg)
Northwestern Coursera MOOCs
![Page 4: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/4.jpg)
Coursera Analy7cs Dashboard
![Page 5: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/5.jpg)
Coursera Data Exports
• 48 Tables: • Structure & Content • Users • Permissions • Assessments • Forums • Quiz Submissions • Lecture Views
ER Diagram from University of Michigan
![Page 6: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/6.jpg)
Ini.al Analysis Efforts
• Past Project Experience – Humani7es Compu7ng – Corpus Linguis7cs – Repository Applica7ons
• Discussion Forum Analysis and Visualiza7on – Topic Analysis – Sen7ment Analysis – Geo-‐loca7on – Data Model Simplifica7on – Dis7nguishing Group Sta7s7cs – Visualiza7on Techniques
![Page 7: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/7.jpg)
Top 18 Topics and their Keywords
Topic Modeling UMass Mallet
![Page 8: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/8.jpg)
TOPIC: news ar7cles sources local newspaper story newspapers …
Topic Modeling UMass Mallet
![Page 9: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/9.jpg)
Gephi
Topics / Posts Network Graph
![Page 10: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/10.jpg)
Gephi
Topics / Posts Network Graph
![Page 11: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/11.jpg)
Sen.ment Analysis AlchemyAPI
![Page 12: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/12.jpg)
IP-‐Address Geoloca.on
GeoLite2 + KML + Google Earth
![Page 13: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/13.jpg)
MOOC Sta.s.cal Analysis
Dis.nguishing Groups All Homeworks Done /
Post Votes
![Page 14: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/14.jpg)
Bubble Graph of MOOC Components
Assignments
Forums Quizzes Video Lectures
![Page 15: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/15.jpg)
… but what are people saying in the Forums? Well, let’s search them!
![Page 16: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/16.jpg)
Full-‐text search with faceted browsing
![Page 17: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/17.jpg)
Faceted Browse Applica.on Framework
• Drupal Interface Components • Drupal and LDAP Iden7ty and Access Management (IAM) • Solr Indexing and Discovery • Google Charts and D3 Visualiza7on
• … but can we offer more facets?
![Page 18: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/18.jpg)
Metadata Enhancement Services
• Named En7ty Recogni7on (Stanford NLPG NER) – People – Place Names – Organiza7ons
• Keyword Extrac7on (topia.termextract) • Sen7ment Analysis (local impl. of Narayanan et al) • Topical Analysis (DMOZ “Open Directory Project”) • IP Address to Geographic Loca7on (MaxMind) • Place Name to Geographic Loca7on (GeoNames)
![Page 19: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/19.jpg)
Enterprise SOA Meets Humani.es Compu.ng
• Enterprise Service Bus and Registry – Porkolio of services – Reuse locally developed solware – Leverage growing abundance of external services
• Flexible Service Orchestra7on – Compose and orchestrate services for specific needs – Obtain low incremental cost for new projects – Used for Metadata Enhancement & Indexing Pipeline – Leverage Apache Camel / Fuse / JMS Messaging
![Page 20: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/20.jpg)
Service Orchestra.on
En7ty Extrac7on
Topic Analysis
Sen7ment Analysis
Event Aggrega7on
Keyword Extrac7on
Geo Loca7on
Metadata Enhancement Pipeline
Metadata Enhancement Services
![Page 21: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/21.jpg)
Visualiza.on Graphics for Result Sets
![Page 22: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/22.jpg)
Streamgraph of Learner Country
United States
![Page 23: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/23.jpg)
Streamgraph of OrganizaBons MenBoned
YouTube Facebook
![Page 24: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/24.jpg)
LaBtude / Longitude Heatmap
![Page 25: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/25.jpg)
Geographic Coverage by Country
![Page 26: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/26.jpg)
Pie Chart for any Facet Learner City Pivot on Learner Country (India)
![Page 27: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/27.jpg)
Word Cloud on Keyword Facet
![Page 28: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/28.jpg)
Word Cloud on Keyword Facet
![Page 29: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/29.jpg)
Word Cloud on Places MenBoned Facet
![Page 30: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/30.jpg)
Remove, Pivot, and Inspect Posts
![Page 31: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/31.jpg)
3 Ideas…
• Rou7nize Analysis Services with SOA – Text analysis services – Geographic lookup services – Sen7ment analysis
• Leverage Analysis Services with Orchestra7on Layer – Metadata enhancement – Metadata and full text indexing
• Applica7on Framework with Visualiza7on Graphics – Full Text and Faceted Discovery – Result Set Visualiza7on
next steps…
![Page 32: Mon Parod DevMOOCDashboard · NorthwesternUniversity • Private$/$Big$Ten$ • Campuses$in$Evanston,$ Chicago,$Qatar$ • 12$Schools$and$Colleges$ • 19,000$Students$](https://reader033.fdocuments.net/reader033/viewer/2022042416/5f31c63e8ca11107562edde6/html5/thumbnails/32.jpg)
Next Steps
• Faculty Feedback – More demographic fields (skill level, educa7on, 7me expecta7on, etc…) – Train classifiers for various types of interac7on – Alert systems for “On Demand” courses? – Geoloca7on for Place Names – … gather more feedback – We just recently launched
• Applica7on Framework – Evolve applica7on plakorm (instead of Drupal) – Evaluate other “noSQL” indexing solu7ons (instead of Solr)
• Learning Analy7cs – LTI Apps for Instructure Canvas Transi7on Repor7ng – Early Discussions at NU and CIC about Learning Analy7cs