Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems

Problem: Building mobile AR apps that work in realistic environments is too hard One key problem: spatial and temporal errors

Project: Develop techniques/toolkits for building AR interfaces that adapt to changing errors Enable more complex/realistic AR

applications to be built

Scientific Issues

Quantify error in a way that is useful to toolkit and application programmers

Develop techniques to adapt interfaces based on these errors

Define a useful programming model for AR interfaces Framework + components

Challenges

Understanding error of various tracking technologies a complete AR system (e.g., latency,

calibration)

Developing a robust AR system Calibration, performance

Developing realistic test applications

Technical Approach

Interative DesignStandard HCI Methodology

Repeat: {Design, Prototype, Generalize}Simultaneous activities

Model error, augmentation characteristics Design, build toolkit APIs Develop prototype applications,

infrastructureTest and extend toolkits

Accomplishments:Presenting Error To Programmers

Compute registration error (pixels) for 3D locations

Provide appcontinuousvalue of reg. error

Distance to point

Pose

Erro

r of V

iew

er’s

Head

AccomplishmentsAPI for Dealing with Changing Error

Low-level API: Level-of-Error (LOE) Analogous to LOD

Change augmentation based on registration error

Low Reg. Error(accurate outline)

Larger Reg. Error(coarse outline)

Large Reg. Error(refer to object,

no outline)

AccomplishmentsIntegrating Video Actors in 3D AR

Tool to support complex content for AR Integrate actions of video narrator (ie.

tutor, guide) with real and virtual 3D objects

Synchronize videopitcher’s throw with

virtual ball

Synchronize videopoet’s words withcreation of falling

virtual words

Video editor for specifying actions

FY01 Goals

Develop a prototype of a complete toolkit All components in place, most simplified

Develop better error models Trackers (incl. vision-based), application

dataContinue application development