Openness, Analytics, and Continuous Quality Improvement

David Wiley, PhDDepartment of Instructional Psychology & Technology

Brigham Young University

Download These Slides

http://slideshare.net/opencontent/

http://www.flickr.com/photos/gls-conference/4687537285/

If the Book Didn’t Change Schools

Can the computer?Can the internet?

Openness… In Education?

Let’s begin by defining terms

Open, adj.

Describes educational artifacts

Open Textbooks

Open Educational Resources

Open Courseware

(Open Source Software)

Open, adj.

Teaching materials freely shared with permissions to engage in the “4R” activities

The 4Rs

Reuse – copy verbatimRedistribute – share with others

Revise – adapt and improveRemix – combine with others

Communicate 4Rs Permissions

Since this overrides default copyright,you must use a copyright license

Offers easy to use 4R’s licenses

While Nouns Differ…

The operationalizing actions are the same

Open, adj.

Generous, sharing, giving

Open, adj.

Providing (1) access and (2) local control

Your Inner Two-year Old

Overcoming the impulse to scream“Mine!”

Law and Policy “Enable” Us

To shout “Mine!” ever more loudly,convulse ever more uncontrollably,

and hit each other with ever larger toys

Society’s Siren Song

“Be selfish. Keep it to yourself. It’s legal. It’s ok.”

Education Is Not Immune

This kind of thinking is accepted

Role of Openness in Education?

A terrible, insidious question

Openness is the only means of doing education.

If There Is No Sharing

There is no education

Successful Educators

Share most thoroughly with the most students

Expertise Is Nonrivalrous

Can be given without being given away

“He who receives ideas from me, receives instruction himself without lessening mine; as he who lights his taper at mine receives light without darkening me.”

Thomas Jefferson

Expressions Are Different

To give a book you must give it away

Expressions Are Different

To give a book you must give it away

Expressions Are Different

Digital expressions are nonrivalrous

n’t^

E.g., Online Book

We can all read simultaneously

An Indescribable Advance

The first time in human history

Expertise and Its Expressions

Give without giving away

Unprecedented Capacity

We can share as never before

Unprecedented Capacity

We can educate as never before

Stewardship

For which we are accountable

Open Educational Resources

Open Course Ware

Open Course Ware

Open Courses

Open Courses

Open Textbooks

Open Textbooks

Repository Examples

OpenCourseWare Examples

Open Courses Examples

Open Textbook Examples

Expanded Funding

Department of Labor

$2 Billion for high-demand two year programs

Not Just Foundation Funding

Accreditation

Get credit for what you know

University of the People

OER University

Mozilla Badge Lab

Practical Analytics

Making use of data

Each and Every Interaction

Recorded and stored for analysis

If Only We Could Get Data!

We could do analyses (aka research) too

Canvas

Even the Grocer!

Almost every industry (1) gathers and (2) uses data more effectively than we do

What Kind of Data?

Assessment dataConstruct-relevant behavioral data

Assessment Data

Difficulty estimatesDiscrimination estimates

Per standard expertise estimates(Not just “grades”)

Behavioral Data

When they logged in, read, and workedHow long they logged in, read, and worked

Pathway informationSocial network analysis

&c.

What If You Could Know

Which students need the most help?Specifically what those students need help on

(academic or behavioral)?The least effective parts of you curriculum?

Which parts of your tests are malfunctioning?

Teaching as Science

With sufficient amounts of data,and appropriate commitment, it’s possible

Learning Analytics

Can tell us who and what needs help

Openness

Gives us permission to make changes / adaptations / improvements

Pointless

Knowing what needs fixed, when you don’t have permission to fix it

Pointless

Having permission to fix things,when you don’t know where to start

Openness + Analytics

Enable Continuous Quality Improvement

Curriculum Use

Curriculum Redesign

StudentPerformance

Data

Data Describing Curriculum

Performance

Data Supporting Strategic Tutoring

TheLoop

“Strategic Tutoring?”

What if we could do one-on-one tutoring just-in-time and just-on-topic?

You Would Have to Know

Who needs help right now?What do they need help on?

Strategic Tutoring

1. Online curriculum teaches as much as possible

2. Teachers do proactive, data-based, one-on-one outreach

Teacher Becomes Tutor

Has the computer replaced the teacher?

As broadcast machinery, yes.

The Loop and Conjoint CQI

Student learning AND curriculum effectivenessgrow simultaneously

But Tutoring Data are Out-of-Band!

Where does the data go?

If the Book Didn’t Change Schools

Can openness?Can analytics?

Can openness + analytics?

Reconsider Your Stewardship

CQI is possible today

Do you have an ethical or moral responsibility to engage?

Thank You

david.wiley@byu.edu@opencontent

http://davidwiley.org/