Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen...

51
Dr. Ajune Wanis Ismail [email protected] Senior Lecturer, School of Computing, Universiti Teknologi Malaysia

Transcript of Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen...

Page 1: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Dr. Ajune Wanis Ismail [email protected]

Senior Lecturer,School of Computing, Universiti Teknologi Malaysia

Page 2: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

One two hour lecture a week Monday - 2:00 pm – 5:00 pm

After the session, students will be able to: Describe the different between Virtual Reality,

Mixed Reality and Augmented Reality technologies.

Identify the concept of Augmented Reality and its applications.

EXPERIENTIAL DEMO VR PROJECT

Page 3: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

What terms you know to define VR?

What terms you know to define AR?

What the characteristic of real-time?

Page 4: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Help desk – hologram avatar

Page 5: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Brunei Malaysia

Teaching / Conferencing

Page 6: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Star Wars had always pushed the technological side to what they saw would be the future and these have finally caught up by world researchers to make it possible.

Page 7: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 9: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 10: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 11: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 12: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Separation between real and digital worlds

Page 13: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Moving from lab to any where Make the interface invisible What’s Next?

Page 14: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 15: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 16: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

“This is so real..” https://www.youtube.com/watch?v=pAC5Se

NH8jw

FULLY IMMERSIVEHead mounted display, gloves- Separation from the real world

Page 17: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Visual Display Stimulate visual sense

Audio/Tactile Display Stimulate hearing/touch

Tracking Changing viewpoint User input

Input Devices Supporting user interaction

Page 18: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Combines Real and Virtual Images Both can be seen at the same time

Interactive in real-time The virtual content can be interacted with

Registered in 3D Virtual objects appear fixed in space

Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.

Page 19: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Virtual Reality (VR) – replace reality Augmented Reality (AR) – enhance reality

Fully immersive Partially immersive

Senses are under control of system Sense of presence in real world

Need mechanical to feed virtual to user Need mechanical to merge virtual and real world

Hard to make virtual world realistic Hard to register virtual world onto real world

Page 20: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Video stream from camera / HMDs

Page 21: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Needs a gear to display the 3D content

1838

Needs lights to display the 3D content

1947

Needs a gear and a marker to display the 3D content

1960

Page 22: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 23: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 24: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 25: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Mixed reality defined by Milgram et al, 1994

Page 26: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 27: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 29: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

How you can get ready to experience a new reality for yourself?

Page 30: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

OCULUS GOOGLE GLASS HOLOLENS

VIRTUAL REALITY AUGMENTED REALITY MIXED REALITY

Page 31: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 32: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 33: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 34: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 35: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 36: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

- teleport across the globe using touch controller to travel

HOLOTOWN VR PROTOTYPE

Page 37: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

To preserve our culture heritage – old building, places, monuments. – appealing visual

VR technologies to help our travel and tourism industry? – since industries driven by VR today.

Page 38: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 39: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 40: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Scientists at NASA’s Jet Propulsion Laboratory will soon be exploring Mars using holograms of Mars Rover images.

Page 41: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Multi-sensory imposes multi-layers of virtual content on the real environment and provides a live view of a real world environment.

Uses the camera to capture what the user sees and enhances it with virtual objects.

ARTIFICIAL

Page 42: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Cultural heritage on-site guide or museum

Page 43: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 44: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 45: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 46: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 47: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 48: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 49: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted

Visit www.trylive.com

Page 50: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted
Page 51: Dr. AjuneWanis Ismail ajune@utm · 2018-12-10 · Combines Real and Virtual Images Both can be seen at the same time Interactive in real-time The virtual content can be interacted