State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality,...

of 24 /24
Pongsagon Vichitvejpaisal, Ph.D. [email protected] Faculty of Science and Technology, Thammasat University. State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One]

Transcript of State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality,...

Page 1: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Pongsagon Vichitvejpaisal, [email protected] of Science and Technology, Thammasat University.

State of Augmented Reality,

Virtual Reality and Mixed Reality

[Microsoft Hololen] [Ready Player One]

Page 2: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Interactive experience of a real-world environment

where the objects that reside in the real-world are

enhanced by computer-generated image

[arreverie.com] [Houzz]

Page 3: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Virtual Reality

• Virtual Reality (VR) is the use of computer technology to create a simulated

environment. Unlike traditional user interfaces, VR places the user inside an

experience. Instead of viewing a screen in front of them.

[Hacker Noon]

Page 4: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality & Virtual Reality

Page 5: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Interactive Product [LEGO]

• Games [Pokemon]

Page 6: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Big screen AR

[indestry.com]

Page 7: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Broadcast AR

[Weather Channel] [NFL broadcast]

Page 8: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Understanding real-world environment

• Using known markers

• Image features

[Dieter Schmalstie, Augmented Reality: Principles and Practice]

Page 9: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Understanding real-world environment

• Using known 3D models

[Vuforia]

Page 10: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Wearable AR

[Dieter Schmalstie, Augmented Reality: Principles and Practice][Microsoft Hololen]

Page 11: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Augmented Reality

• Wearable AR

[Microsoft Hololen]

Page 12: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Challenging aspects of AR

• Understanding environment (Computer vision, 3D scan)

• Realistic rendering of Computer Generated Images

• Wearable hardware (Field of View, Resolution)

Page 13: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Virtual Reality

• Head mounted 3D display

[Google cardboard, Oculus Go, HTC Vive, RoboRecall]

Page 14: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Virtual Reality

• Tracking users in 6 Degree-of-Freedom

Sensor arrangement: outside-in vs inside-out [HTC Vive] [Oculus Quest]

Page 15: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Virtual Reality

• Large scale VR

[Zero latency][Globascore]

[OptiTrack]

Page 16: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Virtual Reality

• Using VR with some physical props.

[Audi]

[RobotVR]

Page 17: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Pongsagon Vichitvejpaisal, [email protected] of Science and Technology, Thammasat University.

Examples of AR and VR in

Medical education in Thailand

Page 18: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

AR in Medical education

THE EFFECTIVENESS OF SELF-DIRECTED LEARNING AUGMENTED REALITY

HANDOUTS FOR LEARNING MEDICAL MICROBIOLOGY AND INFECTIOUS

DISEASES IN MEDICAL STUDENTS

Nuntra Suwantarat, MD, D(ABMM), Mahidol University, Thammasat University Hospital

Page 19: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

AR in Medical education

THE EFFECTIVENESS OF SELF-DIRECTED LEARNING AUGMENTED REALITY

HANDOUTS FOR LEARNING MEDICAL MICROBIOLOGY AND INFECTIOUS

DISEASES IN MEDICAL STUDENTS

Nuntra Suwantarat, MD, D(ABMM), Mahidol University, Thammasat University Hospital

• The difference of pre-test and post-test scores in the AR handout group was no difference compared to the traditional handout group (means 6.2 vs 5.5).

• The motivation scores (MSLQ) in the topic of intrinsic motivation and task values was significantly higher in the AR handout group

Page 20: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Intelligent Clinical Training SystemsSiriwan Suebnukarn DDS, PhD

Page 21: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

VR Childbirth Simulation

Page 22: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Defibrillation Simulation

Page 23: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

VR Photo hunt Game forAmblyopia Patients

Page 24: State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality

Current Research• Volumetric rendering, MRI scan