3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure...

21
Bradley Tanner, MD 2017 Serious Play Conference Hylton Performing Arts Center Manassas, VA July 19, 2018 HealthImpact.studio 101 Market Street, Suite A Chapel Hill, NC http://healthimpact.studio 3D Virtual Reality Using Oculus To Teach Complicated 3D Structures

Transcript of 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure...

Page 1: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Bradley Tanner, MD2017 Serious Play ConferenceHylton Performing Arts Center

Manassas, VA

July 19, 2018

HealthImpact.studio101 Market Street, Suite A

Chapel Hill, NChttp://healthimpact.studio

3D Virtual Reality Using Oculus To Teach Complicated 3D Structures

Page 2: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Goal and Disclosure

✔ Goal: Gain an understanding of the strengths and limitations of VR technology as it applied to the challenge of teaching students about complicated 3D structures

✔ Disclosure: President, Clinical Tools Inc. HealthImpact.studio is the game development division of Clinical Tools.

Page 3: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The Question To Ask

✔ Have used Oculus 3D immersive headsets or headsets from Vive?

✔ Ask this question✔ Don’t accept vague answers.✔ Watching is not doing. In this case “see

one” is meaningless.

Page 4: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

How Different is Immersive VR?

Page 5: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The VR Hardware Options - Cardboard

Page 6: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The VR Hardware Options - Samsung VR

Page 7: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The VR Hardware Options - Google's Pixel Phone and Daydream

Page 8: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The VR Hardware Options - PlayStation VR

✔ More Cables✔ You can’t move✔ Limited Hand Controllers

Page 9: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The VR Hardware Options – Oculus

Page 10: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The VR Hardware Options – Cables!

Page 11: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The VR Hardware Options – HTC Vive

Page 12: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Future VR Hardware Options – Mixed Reality

Page 13: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Building a VR Solution for a Broad Audience

✔ Lessons from creating a three-dimensional experience for the user for educational purposes

✔ The challenge of learning complicated 3D structures in the brain

✔ Building an Internal Memory Map

Page 14: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Lesson #1 – Building 3D Structures

✔ Users without experience in VR

✔ Users unfamiliar with how Oculus works

✔ Lack of experience manipulating controllers – every driving a rental car where all the controls were different?

Page 15: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Lesson #2 – Building 3D Structures

✔ User Expectations

✔ Need Sufficient Complexity

Page 16: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Lesson #3 – Building 3D Structures

✔ Is it fun?✔ A VR game is

not a task to be mastered

✔ Difficult? Yes✔ Dull? No

Page 17: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Imaging a 3D World

✔ Building an internal memory map of a 3D object or space

✔ Memories of past houses.✔ When you need to build

one✔ Buying or renting a new

house

Page 18: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Using 2D to Create 3D

✔ Does 2D work?

✔ Real WorldBuilding

✔ What if you could view houses in VR?

Page 19: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

The Potential of VR to Learn 3D Structures

✔ Perhaps the Brain isn’t the place to start.✔ Fantastic Voyage?

Page 20: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Better than Reality

✔ Presenting Data✔ Hiding and Showing

Structures✔ Showing and Hiding Labels✔ Coloring✔ Showing Motion

Page 21: 3D Virtual Reality Using Oculus To Teach Complicated 3D … · 2017-09-08 · Goal and Disclosure Goal: Gain an understanding of the strengths and limitations of VR technology as

Building a VR Future

✔ Learn the New VR Technology

✔ Teach the New VR Technology

✔ Explain it’s value✔ Dream up a solution✔ Make it good enough

to show what the technology is capable of

✔ Make sure it is fun!