Exploring the potential of badging: Badges = engagement + data

78
Badges = Engagement + Data Exploring the Potential of Badging Kelvin Thompson, Ed.D University of Central Florida This work is licensed under a Creative Commons Attribution- NonCommercial - ShareAlike 3.0 Unported License #FDLAconf13 #badgify @kthompso

description

Listen to session audio: http://bit.ly/audio_fdla2013 Slidecast of invited spotlight session at Florida Distance Learning Association 2013 Annual Conference

Transcript of Exploring the potential of badging: Badges = engagement + data

Page 1: Exploring the potential of badging: Badges = engagement + data

Badges = Engagement + DataExploring the Potential of Badging

Kelvin Thompson, Ed.DUniversity of Central Florida

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License

#FDLAconf13 #badgify@kthompso

Page 2: Exploring the potential of badging: Badges = engagement + data

A BADGING STORY IN 8 TWEETS

Page 3: Exploring the potential of badging: Badges = engagement + data
Page 4: Exploring the potential of badging: Badges = engagement + data
Page 5: Exploring the potential of badging: Badges = engagement + data
Page 6: Exploring the potential of badging: Badges = engagement + data
Page 7: Exploring the potential of badging: Badges = engagement + data
Page 8: Exploring the potential of badging: Badges = engagement + data
Page 9: Exploring the potential of badging: Badges = engagement + data
Page 10: Exploring the potential of badging: Badges = engagement + data
Page 11: Exploring the potential of badging: Badges = engagement + data
Page 12: Exploring the potential of badging: Badges = engagement + data

WHAT ARE BADGES?

Page 13: Exploring the potential of badging: Badges = engagement + data

Badges Are…

“visual representations of 21st century skills and achievements”- Open Badges Initiative of the Mozilla Foundationhttps://wiki.mozilla.org/Badges/About

Page 14: Exploring the potential of badging: Badges = engagement + data

Badges Are…

“a validated indicator of accomplishment, skill, quality or interest that can be earned in [diverse] learning environments”- Macarthur Foundation on behalf of Digital Media + Learning Digital Badges for Life Competitionhttp://www.macfound.org/media/files/BadgesforLifelongLearning_Info.pdf

Page 15: Exploring the potential of badging: Badges = engagement + data

WHAT CAN I READ?

Page 16: Exploring the potential of badging: Badges = engagement + data

http://bit.ly/CT_badges

Page 17: Exploring the potential of badging: Badges = engagement + data

http://bit.ly/7things_badges

Page 18: Exploring the potential of badging: Badges = engagement + data

WHO IS BADGING?

Page 19: Exploring the potential of badging: Badges = engagement + data

https://play.rit.edu

Page 20: Exploring the potential of badging: Badges = engagement + data

http://bit.ly/shu_badges

Page 21: Exploring the potential of badging: Badges = engagement + data

http://bit.ly/eli_badges

Page 22: Exploring the potential of badging: Badges = engagement + data

HOW CAN I BADGE?Badging Platforms

Page 23: Exploring the potential of badging: Badges = engagement + data

http://openbadges.org

Page 24: Exploring the potential of badging: Badges = engagement + data

http://bit.ly/purdue_badges

Page 25: Exploring the potential of badging: Badges = engagement + data

https://credly.com

Page 26: Exploring the potential of badging: Badges = engagement + data

STUDENT ENGAGEMENTBadging = Engagement + Data

Page 27: Exploring the potential of badging: Badges = engagement + data

Student Engagement

…two critical features…

The first is the amount of time and effort students put into their studies and other educationally purposeful activities. The second is how the institution deploys its resources and organizes the curriculum and other learning opportunities to get students to participate in activities that decades of research studies show are linked to student learning.

National Survey of Student

Engagement web site

http://nsse.iub.edu

http://bit.ly/QrbLuF

Page 28: Exploring the potential of badging: Badges = engagement + data

Student Engagement

… such activities as student-faculty interaction, peer-to-peer collaboration, and active learning…

Chen, Gonyea, and Kuh (2008)

http://bit.ly/MyZZv1

Page 29: Exploring the potential of badging: Badges = engagement + data

DATABadging = Engagement + Data

Page 30: Exploring the potential of badging: Badges = engagement + data

BADGING = ENGAGEMENT + DATA

Page 31: Exploring the potential of badging: Badges = engagement + data

CASE STUDY: UCF’S INFO LIT MODSAn Institution-Scale Pilot

Page 32: Exploring the potential of badging: Badges = engagement + data

UCF’s InfoLitMods

Subject Information Literacy

Type Academic-supporting

Level Undergrad & grad

Size Institutional scale

Badge Source Graphic designer

Badge Platform UCF Middleware + Credly

Focus Competencies

Grades/Badges Badges… (but)

List/Easter Eggs Badge list

Viewable By Self or Public

Status Underway

Page 33: Exploring the potential of badging: Badges = engagement + data

http://infolit.ucf.edu

Page 34: Exploring the potential of badging: Badges = engagement + data
Page 35: Exploring the potential of badging: Badges = engagement + data

• 13,840 assessment completions by

• 4,433 students in

• 422 course sections taught or led by

• 94 faculty members who created

• 430 instances of

• 4 information literacy modules with an average score of

• 85.30% across all modules' summative assessments.

InfoLitMods Year One (2008-2009)

Page 36: Exploring the potential of badging: Badges = engagement + data

• 38,423 assessment completions by

• 8,082 students in

• 159 unique courses taught or led by

• 160 faculty members who created

• 1275 instances of

• 13 information literacy modules with an average score of

• 85.19% across all modules' summative assessments.

InfoLitMods Year Four (2011-2012)

Page 37: Exploring the potential of badging: Badges = engagement + data

How Does It Work?Structure of Pilot Project

Page 38: Exploring the potential of badging: Badges = engagement + data
Page 39: Exploring the potential of badging: Badges = engagement + data

http://credly.com

Page 40: Exploring the potential of badging: Badges = engagement + data
Page 41: Exploring the potential of badging: Badges = engagement + data
Page 42: Exploring the potential of badging: Badges = engagement + data
Page 43: Exploring the potential of badging: Badges = engagement + data
Page 44: Exploring the potential of badging: Badges = engagement + data
Page 45: Exploring the potential of badging: Badges = engagement + data

CDL Developers

Support

Page 46: Exploring the potential of badging: Badges = engagement + data

So How’s It Going?Initial Findings (as of 9/3/2013)

Page 47: Exploring the potential of badging: Badges = engagement + data

Initial Data

4082 - assessments that should have delivered a badge

4062 - badges sent via institutional email addresses

2154 - individual students who’ve earned badges

14 - students earning badges from non-assigned mods

4 (1 student) - Number of badges claimed via Credly

Page 48: Exploring the potential of badging: Badges = engagement + data

Badging @ UCF Next Steps

• InfoLitMods

– Earners driven by assignment (currently)

– Watching for student-driven uptick later

– Troubleshoot module-to-middleware process

• Phase II: “Gold Seal” Badges for FacDev

• Beyond: Multiple conversations re: badging

Page 49: Exploring the potential of badging: Badges = engagement + data

BADGING = ENGAGEMENT + DATA

Page 50: Exploring the potential of badging: Badges = engagement + data

CASE STUDY: BLENDKIT2012

Page 51: Exploring the potential of badging: Badges = engagement + data

BlendKit2012

Subject Blended learning

Type Professional Development

Level

Size 1230 enrolled

Badge Source Graphic designer

Badge Platform Developer + Mozilla Framework

Focus Competencies

Grades/Badges Badges only

List/Easter Eggs Badge list

Viewable By Self

Status Complete

Page 52: Exploring the potential of badging: Badges = engagement + data
Page 53: Exploring the potential of badging: Badges = engagement + data

BlendKit2011

• Open readings, document templates, how-tos

+• Five weeks of facilitation:

– Weekly encouraging messages

– Weekly 30 min. webinars featuring guest blended learning instructors & discussion with others

– Weekly reading/activity reflection prompts for blogging (more interaction with others).

– Social networking opportunities for more interaction

• Participants choose with which of these to engage!

Page 54: Exploring the potential of badging: Badges = engagement + data

BlendKit2012 Modifications

• an LMS-based communications hub for registered participants

• three participant roles for registrants:

1) completer, 2) participant, and 3) auditor

• online badges for completion of course activities

• certificates for successful completers of BlendKit2012

• new guest faculty for weekly webinars

• additional faculty case study audio interviews

Page 55: Exploring the potential of badging: Badges = engagement + data
Page 56: Exploring the potential of badging: Badges = engagement + data
Page 57: Exploring the potential of badging: Badges = engagement + data
Page 58: Exploring the potential of badging: Badges = engagement + data
Page 59: Exploring the potential of badging: Badges = engagement + data
Page 60: Exploring the potential of badging: Badges = engagement + data
Page 61: Exploring the potential of badging: Badges = engagement + data

BlendKit2012 Badges Data

• Participants may be engaging with materials in isolation

• Badges based upon evidence• Individual engagement more evident• Example

Reading Reaction on public blog (fewer) v. entry on Reading Reaction Form (more)Paragraphs of personal reflection made evident!

Page 62: Exploring the potential of badging: Badges = engagement + data

BlendKit Next Steps

• Build upon successes (yes, we had some!)

• Use UCF middleware + Credly• Consider streamlining/automating without

sacrificing rich qualitative data• Integrate with LMS (Instructure Canvas)

grade book

Page 63: Exploring the potential of badging: Badges = engagement + data

BADGING = ENGAGEMENT + DATA

Page 64: Exploring the potential of badging: Badges = engagement + data

CASE STUDY: EME5050

Page 65: Exploring the potential of badging: Badges = engagement + data

EME5050

Subject Ed Tech

Type Academic

Level Grad

Size 25

Badge Source Purdue Passport

Badge Platform Credly

Focus 2nd level Competencies

Grades/Badges Grades + Badges

List/Easter Eggs Easter Eggs

Viewable By Class

Status 2nd Iteration Underway

Page 66: Exploring the potential of badging: Badges = engagement + data
Page 67: Exploring the potential of badging: Badges = engagement + data

Full Text at: http://bit.ly/badge_intro

Page 68: Exploring the potential of badging: Badges = engagement + data
Page 69: Exploring the potential of badging: Badges = engagement + data
Page 70: Exploring the potential of badging: Badges = engagement + data
Page 71: Exploring the potential of badging: Badges = engagement + data
Page 72: Exploring the potential of badging: Badges = engagement + data

EME5050 Next Steps

• Evaluate current design/modify• Maintain student notifications• Maintain badge leaderboard• Consider re-making more attractive

badges• Study perceived value-add for students

Page 73: Exploring the potential of badging: Badges = engagement + data

BADGING = ENGAGEMENT + DATA

Page 74: Exploring the potential of badging: Badges = engagement + data

Badging Lessons Learned

Clear criteria (announced or not)

Visible evidence

Verification

Badge

Page 75: Exploring the potential of badging: Badges = engagement + data

Badging Observations

• Each stakeholder determines value

o Issuer, Earner, “Observer,” (Displayer)

• Potential value in each phase of badging:

o Underlying data/record

o Notification email

o Claiming (“Save and Share”)

o Making public

o Linking to specific badges

Page 76: Exploring the potential of badging: Badges = engagement + data

Unanswered Questions to Ponder

• Why do badges appeal to some but not others?• Does badging really engage the unengaged?• What is the right balance of automation and

personal attention for course badging?• What is the relationship between badges and

formal credentials?• What is the right balance of curricular and co-

curricular badging at an institution?

Page 77: Exploring the potential of badging: Badges = engagement + data

Questions/Comments

Page 78: Exploring the potential of badging: Badges = engagement + data

Contact

Dr. Kelvin Thompson

[email protected]

@kthompsohttp://bit.ly/kelvin_info

http://bit.ly/fdla13slides_thompson