Augmented Reality - UniBG · Augmented Reality – Giandomenico Caruso AR Display Technologies 8...

Augmented Reality

Mechanical Department

Augmented Reality – Giandomenico Caruso

Outline 2

• Introduction on AR

• AR Technologies

• Visualization

• Interaction

• Tracking

• The role of AR in industrial product development

• Our Applications


What is Augmented Reality?

3

1994 - Milgram’s definition:

“An AR system supplements the real world with virtual (computer – generated) object that appear to coexist in the

same space as the real world.”

Milgram’s Virtuality Continuum (1994 )


What is Augmented Reality?

4

1997 - Azuma’s definition:

“Augmented Reality is a technology which:

1. Combines real and virtual imagery

2. Is interactive in real time

3. Registers the virtual imagery with the real world”

Display System

Interaction System

Tracking System


The simplest AR application: Equipments 5

Marker

Computer

Monitor

Camera

Display System

Interaction System

Tracking System


The simplest AR application: Architecture 6

Graphics System

Video Merging

Video of Real Scene

Camera Position

Virtual Objects

Augmented Environment

Real Environment

Augmented Video

Virtual

Real


Sensor - Based

Vision - Based

Hybrid

See-through HMDs

Projection-Based Displays

Handheld Displays

Tangible AR

Collaborative AR

Hybrid AR Interface

Augmented Reality Technologies 7

Tracking Interaction Display


AR Display Technologies 8

•Monitor Based

• Head Mounted Displays:

•Video see-through

•Optical see-through

•Retinal Systems

• Projectors (SAR)

See-through HMDs

Projection-Based Displays

Handheld Displays

Display


Monitor Based Display 9

•Simplest available

• Little feeling of being immersed in environment


Handled Display 10

Mobile phone Tablet PC

PDA


Head Mounted Displays Optical See-Through

11

• Simplicity

• Resolution

• No eye offset


Head Mounted Displays Video See-Through HMD

12

• Flexibility in composition strategies

• Wide field of view

• Real and virtual view delays can be matched


VST-HMD AR System

WiiMote Control

Functionalities

•Stereoscopic visualization

•Controlled cameras

•WiiMote control

•Texture manager

•Virtual light manager

servos

cameras

marker

13


VST-HMD AR System: Video

14


VST-HMD AR System: video 15


Head Mounted Displays Retinal Systems

16

• High-quality image

• Monochromatic

• No eye offset


Projection Display Systems

17

Projector Based AR uses real world objects as the projection surface for the virtual environment.


AR Interaction Techniques 18

AR User interfaces issues

• User precision in 3D space

• reduced perception along depth direction

• attention allocation

• human skill

• visual occlusion

• Lack of force feedback

• low presence

• no collision perception

• difficult selection

Tangible AR

Collaborative AR

Hybrid AR Interface

Interaction


Tangible AR 19

Tangible AR means interacting with Tracked Tangible Objects.

Tangible interfaces are powerful because the physical objects have familiar properties, physical constraints, and affordances, making them easy to use.


Tangible AR: Sample 20

Personal Interaction Panel

1997 – Z. Szalavári

Pad Pen



2000 - H. Kato

VOMAR application

ARToolkit pattern



2005 - W. Lee

Augmented Foam


Collaborative AR: sample 23

1996 – D. Shmalstieg

Studierstube


Collaborative AR: trend 24

Mobile AR


Hybrid AR Interface: trend 25

A hybrid user interface combines a variety of different, but complementary interfaces.

Data glove:

•Gesture recognition Headphones-mic:

•Speech recognition

•Speech synthesis

Haptic device:

•Force feedback


AR Tracking Technologies 26

Sensor - Based

Vision - Based

Hybrid

Tracking AR tracking issues

• Precision and accuracy

• Latency

• Setup complexity


Sensor Based Tracking 27

Optical Magnetic

Inertial


Computer Vision Based Tracking 28

• Marker based

• Feature based

• Markerless


Marker Based Tracking 29

Marker-based tracking work flow


Feature Based Tracking 30


Markerless Tracking 31


Hybrid Tracking 32

Sensors Computer

Vision

•Improve tracking precision


AR application fields

Military

Scientific visualization

Medical

Maintenance

Cultural Heritage

33


AR for industrial product development

Virtual

Prototype

Numerical Analyses

CAE

Physical

Prototype

Documentation CAD Modeling

CAS/CAD

Reconstruction RE

Visualization CG

Manufacturing CAM, RP Interactive

Simulation VR/AR

Interactive Simulation

VR/AR

34


Interactive Simulation 35

• Design review

• Product evaluation with final users

Yesterday Today Tomorrow

Real Virtual Mixed


From Virtual to Mixed Prototype 36

Mixed Prototype Framework

Mixed prototype supports direct interaction and allows users to interact with a mixture of virtual and real objects

This practice takes advantage from a combination of benefits of both virtual and physical prototyping:

• the interaction with real prototypes allows users to better feel and perceive the object

• the interaction with virtual prototypes allows an early evaluation based on digital models before the product is really built and available for testing


AR for numerical analysis

Functionalities

•Boundary conditions control

•Structural and CFD analyses

•Results manager

•Vibration feedback

WiiMote

37


Mixed Reality Seating Buck 38

Structure

User’s point of view (rendering)


Mixed Reality Seating Buck: Equipments 39

Markers

Seating Buck

OST-HMD

RP dashboard

Haptic knob

Robotic arm


Mixed Reality Seating buck: Video 40


Optical See Through issue 41

Virtual

Real


Tangible AR dashboard 42


Mixed Reality Washing Machine 43


Space Planning AR 44


Conclusion

• AR technology creates opportunities for the exploring new ways to interact between the physical and virtual world.

• AR represent a useful technology for product development.

45

Augmented Reality - UniBG · Augmented Reality – Giandomenico Caruso AR Display Technologies 8...

Documents

Transcript of Augmented Reality - UniBG · Augmented Reality – Giandomenico Caruso AR Display Technologies 8...