Digging Deeper: Discovering how and why faculty use Blackboard Learn

Slidesavailableatfacdev.niu.edu/bbworld17

DiggingDeeperDiscoveringhowandwhyfacultyuseBlackboardLearn

JasonRhodeDirector

[email protected]@JasonRhode

PeterGowenOnlineAnalyticsCoordinator

[email protected]@petergowen

[email protected]

@slrichter

Presenters

Context– AboutNIU

• MaincampusinDeKalb,ILlocated65milesWestofChicago

• Totalenrollment:19,015

• 1,174Instructionalfaculty• Studenttoinstructor/facultyratio:15:1

NorthernIllinoisUniversityOverview

64%ofcreditcoursesusedBlackboardinfall2016

95%ofstudentsusedBlackboardinfall2016

88%offacultyusedBlackboardinfall 2016

FacultyDevelopmentofferstraining&supportforfaculty

Facultyadoptionhasalwaysbeenvoluntary

Blackboardclientforover15years

BlackboardUseatNIU

Viewthefullinfographicatfacdev.niu.edu/bbstats2016

LearnMore

• HowarefacultyusingBlackboard?•WhattoolsarefacultyusinginBlackboard?

•WhyarefacultyusingBlackboard?

• Howcanweimproveoursupport?

WeHadMoreQuestions

(Al-Busaidi &Al-Shihi,2010)

TechnologyAcceptanceModel

Phase2• Whatfactorsimpactfacultydecisionstoadopt,continuetouse,orabandontheLMS?

Phase1• WhatarethemostusedtoolsintheLMS?

• Howhastoolusagechanged?• Whatfactorsimpacttoolusage?

ResearchQuestions

Phase2• DistributedasurveytoallNIU“instructorsofrecord”• AskedaboutreasonsforusingBb,Toolsused,andsatisfaction/easeofuse• Codedqualitativedatawithmultiplereviewers• 25%responserate

Phase1• SysAdminqueriesdatabase• Refinedsearchesovertimebasedonobservation• Dummy-codedtoolusageaspresentorabsent(whetheritwasusedvs.howmuchitwasused)• Comparedwithcoursemodality(e.g.,onlinevs.face-to-face)

Methods

Phase1

• SQLqueryofOpenDatabase• AdaptedfromScottKodai’s (2013)BbWorldpresentationslideshare.net/skodai/bb-w-skodai

Ourqueriesavailablebyrequest–[email protected]

Queries

Queries

• Run~2weeksafterasemesterends

• Countsthenumberoftimesatoolisusedinacourse

• ReturnsaCSVfile

Sampledata

MostlyCOUNTsofreferencestoagiventoolcnthndlr_handleforagivencoursecrsmain_pk1,inthecourse_contents table

OccasionallynecessarytoJOINanothertableforcertainstats

Examples• Howmanytestsdeployed?• Howmanyitemsposted?• Howmanyfolderscreated?• Howmanygradecolumns?• Howmanyannouncements?

TechnicalDetails

Verifyyourdata!

DataTransformationandAnalysis

• Ifatoolwasusedatleastonce,wecounteditas“used”

• Recodeddatato1or0• Aggregatedwheredesiredorneededex:SafeAssign istracked2ways

• CombinedwithdatafromSISforcoursemodality

Howdoyouknowthatatoolisused?

DataDictionaryandKeyDefinitions

• Whateachdatapointmeasures

• Nuancesinitsmeasurement

• Howthemethodofmeasurementhaschangedovertime

Discussions

Countofreplies,separateforCourseandGroupdiscussionboards

MEDIAL

Countofdiscretepiecesofcoursecontentwhichcontaineitheratext-basedlinktoMEDIALvideos,orMEDIALvideosembeddedviatheMashuptool

testsdiscussionrepliesplagiarismdetectionweblinks

assignmentsfilesfoldersgradesitemsannouncements

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Results– Usage



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Usagehasbeenincreasingforalltools



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

SharperincreasesstartinginFall2015



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Peakedbehavioreverysummer

ToolUseforAllCourses



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

ToolUseforIn-PersonCourses

testsdiscussionreplies

plagiarismdetectionweblinks


plagiarismdetection

weblinksfiles

tests

discussionrepliesgradesassignmentsfoldersannouncementsitems

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

ToolUseforOnlineCourses

Phase2

TechnologyAcceptanceModel• BasedontheTechnologyAcceptanceModel

• Questionsvalidatedbyanexternalexpert

• Senttoallinstructorsofrecordviaemail

Viewthesurveyatfacdev.niu.edu/lmsusagesurvey

SurveyDetails

Samplesurveyquestions

MotivationforadoptingtheLMS

95%offacultyrespondinghadadoptedBlackboard

PerceivedasRequired

PerceivedValue

PerceivedEaseofUse

MotivationforadoptingtheLMS

5%offacultyrespondinghadnoteveradoptedBlackboard

Perceivedlackofneed

UseofAlternativeTool

PerceivedLackofTraining

PerceivedDifficultyofUse

LackofNeed2%offacultyhadstoppedusingBlackboard

MotivationforabandoningtheLMS

DiscussionandInterpretation

Usageisincreasing

• Considertoolsinadditiontooverallusage

• Usageseems tobedifferentbasedonmodality

LMSisvaluedbyfacultyandstudents

• Perceptionthatitisrequired

• Helpsfacultybemoreeffectiveandefficient

Facultystillneedsupport

• PerceptionthatBlackboardisdifficult

• Numberoffeaturescanbeoverwhelming

• Lackofself-confidenceinusingBlackboard

Weneedtoknowmore!

• Furtheranalysisofourexistingdata• Additionaldata,fromothercontexts

Letusknowifyou’dliketopartnertoofferthesurveyatyourowninstitution–

[email protected]

JasonRhodeDirector

[email protected]@JasonRhode

PeterGowenOnlineAnalyticsCoordinator

[email protected]@petergowen

[email protected]

@slrichter

Questions?

Don’tforgettoratethissessionintheBbWorldapp.

Digging Deeper: Discovering how and why faculty use Blackboard Learn

Education

Transcript of Digging Deeper: Discovering how and why faculty use Blackboard Learn