3D Virtual Reality Using Oculus to Teach Complicated 3D Structures in Healthcare

21
Bradley Tanner, MD 2017 Serious Play Conference Hylton Performing Arts Center Manassas, VA July 19, 2018 HealthImpact.studio 101 Market Street, Suite A Chapel Hill, NC http://healthimpact.studio 3D Virtual Reality Using Oculus To Teach Complicated 3D Structures

Transcript of 3D Virtual Reality Using Oculus to Teach Complicated 3D Structures in Healthcare

Bradley Tanner, MD

2017 Serious Play Conference

Hylton Performing Arts Center

Manassas, VA

July 19, 2018

HealthImpact.studio

101 Market Street, Suite A

Chapel Hill, NC

http://healthimpact.studio

3D Virtual Reality Using Oculus To Teach

Complicated 3D Structures

Goal and Disclosure

Goal: Gain an understanding of the strengths and limitations of

VR technology as it applied to the challenge of teaching

students about complicated 3D structures

Disclosure: President, Clinical Tools Inc. HealthImpact.studio is

the game development division of Clinical Tools.

The Question To Ask

Have used Oculus 3D immersive

headsets or headsets from Vive?

Ask this question

Don’t accept vague answers.

Watching is not doing. In this case

“see one” is meaningless.

How Different is Immersive VR?

The VR Hardware Options - Cardboard

The VR Hardware Options - Samsung VR

The VR Hardware Options - Google's Pixel

Phone and Daydream

The VR Hardware Options - PlayStation VR

More Cables

You can’t move

Limited Hand Controllers

The VR Hardware Options – Oculus

The VR Hardware Options – Cables!

The VR Hardware Options – HTC Vive

Future VR Hardware Options – Mixed Reality

Building a VR Solution for a Broad Audience

Lessons from creating a

three-dimensional

experience for the user

for educational purposes

The challenge of

learning complicated 3D

structures in the brain

Building an Internal

Memory Map

Lesson #1 – Building 3D Structures

Users without

experience in VR

Users unfamiliar with

how Oculus works

Lack of experience

manipulating controllers

– every driving a rental

car where all the

controls were different?

Lesson #2 – Building 3D Structures

User

Expectations

Need

Sufficient

Complexity

Lesson #3 – Building 3D Structures

Is it fun?

A VR game is

not a task to

be mastered

Difficult? Yes

Dull? No

Imaging a 3D World

Building an internal memory

map of a 3D object or space

Memories of past houses.

When you need to build

one

Buying or renting a new

house

Using 2D to Create 3D

Does 2D

work?

Real World

Building

What if you

could view

houses in

VR?

The Potential of VR to Learn 3D Structures

Perhaps the Brain isn’t the place to start.

Fantastic Voyage?

Better than Reality

Presenting Data

Hiding and Showing

Structures

Showing and Hiding Labels

Coloring

Showing Motion

Building a VR Future

Learn the New VR

Technology

Teach the New VR

Technology

Explain it’s value

Dream up a solution

Make it good enough

to show what the

technology is capable of

Make sure it is fun!