426 lecture2: AR Technology
-
Upload
mark-billinghurst -
Category
Technology
-
view
1.046 -
download
1
description
Transcript of 426 lecture2: AR Technology
![Page 1: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/1.jpg)
COSC 426: Augmented Reality
Mark Billinghurst
July 18th 2012
Lecture 2: AR Technology
![Page 2: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/2.jpg)
Key Points from Lecture 1
![Page 3: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/3.jpg)
Augmented Reality Definition Defining Characteristics [Azuma 97]
Combines Real and Virtual Images - Both can be seen at the same time
Interactive in real-time - Virtual content can be interacted with
Registered in 3D - Virtual objects appear fixed in space
![Page 4: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/4.jpg)
What is not Augmented Reality?
Location-based services Barcode detection (QR-codes) Augmenting still images Special effects in movies … … but they can be combined with AR!
![Page 5: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/5.jpg)
Milgram’s Reality-Virtuality Continuum
Mixed Reality
Reality - Virtuality (RV) Continuum
Real Environment
Augmented Reality (AR)
Augmented Virtuality (AV)
Virtual Environment
![Page 6: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/6.jpg)
Metaverse
![Page 7: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/7.jpg)
AR History Summary 1960’s – 80’s: Early Experimentation 1980’s – 90’s: Basic Research
Tracking, displays
1995 – 2005: Tools/Applications Interaction, usability, theory
2005 - : Commercial Applications Games, Medical, Industry
![Page 8: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/8.jpg)
Applications
Medicine Manufacturing Information overlay Architecture Museum Marketing Gaming
![Page 9: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/9.jpg)
AR Technology
![Page 10: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/10.jpg)
“The product is no longer the basis of value. The
experience is.”
Venkat Ramaswamy The Future of Competition.
![Page 11: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/11.jpg)
experiences
services
products
components
Valu
e
Sony CSL © 2004
Gilmore + Pine: Experience Economy
Function
Emotion
![Page 12: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/12.jpg)
![Page 13: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/13.jpg)
experiences
applications
tools
components
Building Compelling AR Experiences
Tracking, Display
Authoring
Interaction
Usability
![Page 14: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/14.jpg)
experiences
applications
tools
components
Sony CSL © 2004
Building Compelling AR Experiences
Display, Tracking
![Page 15: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/15.jpg)
AR Technology Key Technologies
Display Tracking Input Processing
Display
Processing
Input
Tracking
![Page 16: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/16.jpg)
AR Displays
![Page 17: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/17.jpg)
AR Displays
e.g. window reflections
Virtual Images seen off windows
e.g. Reach-In
Projection CRT Display using beamsplitter
Not Head-Mounted
e.g. Shared Space Magic Book
Liquid Crystal Displays LCDs
Head-Mounted Display (HMD)
Primarily Indoor Environments
e.g. WLVA and IVRD
Cathode Ray Tube (CRT) or Virtual Retinal Display (VRD)
Many Military Applications & Assistive Technologies
Head-Mounted Display (HMD)
e.g. Head-Up Display (HUD)
Projection Display Navigational Aids in Cars
Military Airborne Applications
Not Head Mounted (e.g. vehicle mounted)
Primarily Outdoor (Daylight) Environments
AR Visual Displays
![Page 18: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/18.jpg)
Head Mounted Displays
![Page 19: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/19.jpg)
Head Mounted Displays (HMD) - Display and Optics mounted on Head - May or may not fully occlude real world - Provide full-color images - Considerations
• Cumbersome to wear • Brightness • Low power consumption • Resolution limited • Cost is high?
![Page 20: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/20.jpg)
Key Properties of HMD Field of View
Human eye 95 degrees horizontal, 60/70 degrees vertical
Resolution > 320x240 pixel
Refresh Rate Focus
Fixed/manual
Power Size
![Page 21: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/21.jpg)
Types of Head Mounted Displays
The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.
The image cannot be displayed. Your computer
Occluded See-thru
Multiplexed
![Page 22: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/22.jpg)
Immersive VR Architecture
Head!Tracker
Host !Processor
Data Base!Model
Rendering!Engine Frame!
Buffer
head position/orientation
to network Display!Driver
Non see-thru!Image source
& optics
virtual object
Virtual World
![Page 23: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/23.jpg)
See-thru AR Architecture
Head!Tracker
Host !Processor
Data Base!Model
Rendering!Engine Frame!
Buffer
head position/orientation
to network Display!Driver
see-thru!combiner
Virtual Image superimposed!over real world object
real world
Image source
![Page 24: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/24.jpg)
Optical see-through head-mounted display
Virtual images from monitors
Real World
Optical Combiners
![Page 25: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/25.jpg)
Optical See-Through HMD
![Page 26: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/26.jpg)
Optical see-through HMDs
Sony Glasstron
Virtual Vision VCAP
![Page 27: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/27.jpg)
View Through Optical See-Through HMD
![Page 28: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/28.jpg)
DigiLens
www.digilens.com
Compact HOE Solid state optics Switchable Bragg Grating Stacked SBG Fast switching Ultra compact
![Page 29: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/29.jpg)
Google Glasses
![Page 30: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/30.jpg)
The Virtual Retinal Display
Image scanned onto retina Commercialized through Microvision
Nomad System - www.mvis.com
![Page 31: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/31.jpg)
Strengths of optical AR Simpler (cheaper) Direct view of real world
Full resolution, no time delay (for real world) Safety Lower distortion
No eye displacement but COASTAR video see-through avoids this
![Page 32: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/32.jpg)
Video AR Architecture
Head!Tracker
Host !Processor
Graphics!renderer
Digital!Mixer Frame!
Buffer
head position/orientation
to network Display!Driver
Non see-thru!Image source
& optics
Head-mounted camera aligned to
display optics
Video!Processor
Video image of real world
Virtual image inset into video of real world
![Page 33: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/33.jpg)
Video see-through HMD Video cameras
Monitors
Graphics
Combiner
Video
![Page 34: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/34.jpg)
Video See-Through HMD
![Page 35: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/35.jpg)
Video see-through HMD
MR Laboratory’s COASTAR HMD (Co-Optical Axis See-Through Augmented Reality) Parallax-free video see-through HMD
![Page 36: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/36.jpg)
TriVisio www.trivisio.com Stereo video input
PAL resolution cameras
2 x SVGA displays 30 degree FOV User adjustable convergence
$6,000 USD
![Page 37: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/37.jpg)
View Through a Video See-Through HMD
![Page 38: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/38.jpg)
Vuzix Display
www.vuzix.com Wrap 920 $350 USD Twin 640 x 480 LCD displays 31 degree diagonal field of view Weighs less than three ounces
![Page 39: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/39.jpg)
Strengths of Video AR True occlusion
Kiyokawa optical display that supports occlusion
Digitized image of real world Flexibility in composition Matchable time delays More registration, calibration strategies
Wide FOV is easier to support
![Page 40: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/40.jpg)
Optical vs. Video AR Summary Both have proponents Video is more popular today?
Likely because lack of available optical products
Depends on application? Manufacturing: optical is cheaper Medical: video for calibration strategies
![Page 41: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/41.jpg)
Eye multiplexed AR Architecture
Head!Tracker
Host !Processor
Data Base!Model
Rendering!Engine Frame!
Buffer
head position/orientation
to network Display!Driver
Virtual Image inset into!real world scene
real world
Opaque!Image source
![Page 42: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/42.jpg)
Virtual Image ‘inset’ into real
![Page 43: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/43.jpg)
Virtual Vision Personal Eyewear
![Page 44: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/44.jpg)
Virtual image inset into real world
![Page 45: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/45.jpg)
Spatial/Projected AR
![Page 46: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/46.jpg)
Spatial Augmented Reality
Project onto irregular surfaces Geometric Registration Projector blending, High dynamic range
Book: Bimber, Rasker “Spatial Augmented Reality”
![Page 47: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/47.jpg)
Projector-based AR
Examples: Raskar, MIT Media Lab Inami, Tachi Lab, U. Tokyo
Projector
Real objects with retroreflective covering
User (possibly head-tracked)
![Page 48: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/48.jpg)
Example of projector-based AR
Ramesh Raskar, UNC, MERL
![Page 49: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/49.jpg)
Example of projector-based AR
Ramesh Raskar, UNC Chapel Hill
![Page 50: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/50.jpg)
The I/O Bulb
Projector + Camera John Underkoffler, Hiroshi Ishii MIT Media Lab
![Page 51: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/51.jpg)
Head Mounted Projector
Head Mounted Projector Jannick Rolland (UCF)
Retro-reflective Material Potentially portable
![Page 52: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/52.jpg)
Head Mounted Projector
NVIS P-50 HMPD 1280x1024/eye Stereoscopic 50 degree FOV www.nvis.com
![Page 53: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/53.jpg)
HMD vs. HMPD
Head Mounted Display Head Mounted Projected Display
![Page 54: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/54.jpg)
Pico Projectors
Microvision - www.mvis.com 3M, Samsung, Philips, etc
![Page 55: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/55.jpg)
MIT Sixth Sense
Body worn camera and projector http://www.pranavmistry.com/projects/sixthsense/
![Page 56: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/56.jpg)
Other AR Displays
![Page 57: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/57.jpg)
Video Monitor AR
Video cameras Monitor
Graphics Combiner
Video
Stereo glasses
![Page 58: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/58.jpg)
Examples
![Page 59: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/59.jpg)
Virtual Showcase
Mirrors on a projection table Head tracked stereo Up to 4 users Merges graphic and real objects Exhibit/museum applications
Fraunhofer Institute (2001) Bimber, Frohlich
![Page 60: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/60.jpg)
Augmented Paleontology
Bimber et. al. IEEE Computer Sept. 2002
![Page 61: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/61.jpg)
Alternate Displays
LCD Panel Laptop PDA
![Page 62: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/62.jpg)
Handheld Displays Mobile Phones
Camera Display Input
![Page 63: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/63.jpg)
Display Taxonomy
![Page 64: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/64.jpg)
Other Types of AR Display Audio
spatial sound ambient audio
Tactile physical sensation
Haptic virtual touch
![Page 65: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/65.jpg)
Haptic Input
AR Haptic Workbench CSIRO 2003 – Adcock et. al.
![Page 66: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/66.jpg)
Phantom
Sensable Technologies (www.sensable.com) 6 DOF Force Feedback Device
![Page 67: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/67.jpg)
AR Haptic Interface
Phantom, ARToolKit, Magellan
![Page 68: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/68.jpg)
AR Tracking and Registration
![Page 69: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/69.jpg)
Registration Positioning virtual object wrt real world
Tracking Continually locating the users viewpoint
- Position (x,y,z) - Orientation (r,p,y)
![Page 70: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/70.jpg)
Registration
![Page 71: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/71.jpg)
Spatial Registration
![Page 72: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/72.jpg)
The Registration Problem Virtual and Real must stay properly aligned If not:
Breaks the illusion that the two coexist Prevents acceptance of many serious applications
![Page 73: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/73.jpg)
Sources of registration errors Static errors
Optical distortions Mechanical misalignments Tracker errors Incorrect viewing parameters
Dynamic errors System delays (largest source of error)
- 1 ms delay = 1/3 mm registration error
![Page 74: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/74.jpg)
Reducing static errors Distortion compensation Manual adjustments View-based or direct measurements Camera calibration (video)
![Page 75: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/75.jpg)
View Based Calibration (Azuma 94)
![Page 76: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/76.jpg)
Dynamic errors
Total Delay = 50 + 2 + 33 + 17 = 102 ms 1 ms delay = 1/3 mm = 33mm error
Tracking Calculate Viewpoint Simulation
Render Scene
Draw to Display
x,y,z r,p,y
Application Loop
20 Hz = 50ms 500 Hz = 2ms 30 Hz = 33ms 60 Hz = 17ms
![Page 77: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/77.jpg)
Reducing dynamic errors (1)
Reduce system lag Faster components/system modules
Reduce apparent lag Image deflection Image warping
![Page 78: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/78.jpg)
Reducing System Lag
Tracking Calculate Viewpoint Simulation
Render Scene
Draw to Display
x,y,z r,p,y
Application Loop
Faster Tracker Faster CPU Faster GPU Faster Display
![Page 79: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/79.jpg)
Reducing Apparent Lag
Tracking Update
x,y,z r,p,y
Virtual Display
Physical Display
(640x480)
1280 x 960
Last known position
Virtual Display
Physical Display
(640x480)
1280 x 960
Latest position
Tracking Calculate Viewpoint Simulation
Render Scene
Draw to Display
x,y,z r,p,y
Application Loop
![Page 80: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/80.jpg)
Reducing dynamic errors (2) Match input streams (video)
Delay video of real world to match system lag
Predictive Tracking Inertial sensors helpful
Azuma / Bishop 1994
![Page 81: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/81.jpg)
Predictive Tracking
Time
Position
Past Future
Can predict up to 80 ms in future (Holloway)
Now
![Page 82: 426 lecture2: AR Technology](https://reader035.fdocuments.net/reader035/viewer/2022062307/5558e645d8b42ab8168b4dbf/html5/thumbnails/82.jpg)
Predictive Tracking (Azuma 94)