Augmented Reality

125
AUGMENTED REALITY FOR PROGRAMMERS Andrew Bibichev 2010, September

description

Presentation for ADD-2010 conference: "Augmented Reality for Programmers"

Transcript of Augmented Reality

Page 1: Augmented Reality

AUGMENTED REALITYFOR PROGRAMMERS

Andrew Bibichev

2010, September

Page 2: Augmented Reality

AR AR

AR

AR

ARAR

AR

AR

AR

AR

AR

Page 7: Augmented Reality
Page 8: Augmented Reality
Page 11: Augmented Reality
Page 12: Augmented Reality
Page 13: Augmented Reality
Page 14: Augmented Reality
Page 15: Augmented Reality

VIRTUAL REALITY

Real Life Context

Generated Content

Page 16: Augmented Reality

AUGMENTED REALITY

Real Life Context

Generated Content

Page 17: Augmented Reality

VR

AR

Real Life Context

Generated Content

Page 18: Augmented Reality

INPUTdevice

INNOVATIONS IN

ProcessingOUTPUTdevice

Rendering

AR VR

Page 19: Augmented Reality
Page 20: Augmented Reality

EARLY 1970s:FIRST ELECTRONIC KEYBOARD

Page 21: Augmented Reality

1977: TOUCH SCREEN

Page 22: Augmented Reality

1981: Xerox Star mouse

Page 23: Augmented Reality
Page 24: Augmented Reality

EARLY 1990s: WEBCAM

Page 25: Augmented Reality

1995: Genius EasyScroll mouse

Page 26: Augmented Reality
Page 27: Augmented Reality

2007: multi touch (iPhone)

Page 28: Augmented Reality

2007: WII REMOTE (accelerometer)

Page 29: Augmented Reality

JUNE, 2009: WII MOTION+ (gyro)

Page 30: Augmented Reality

2010: smart phoneswith gyro, accel, GPS, video camera, …

Page 31: Augmented Reality
Page 32: Augmented Reality
Page 33: Augmented Reality

SEP, 2010: SONY MOVE

Page 34: Augmented Reality
Page 36: Augmented Reality

NOV, 2010: MS KINECT

Page 38: Augmented Reality
Page 39: Augmented Reality

1984: Apache

Page 41: Augmented Reality
Page 42: Augmented Reality
Page 43: Augmented Reality

Spec. sensors

Cameras

markers

structured light

Z-cameras / Z-sensors

True Optical:several cameras

True Optical:one moving camera

GPS, accelerometer, gyro, magnetic compass

Page 44: Augmented Reality
Page 45: Augmented Reality
Page 46: Augmented Reality
Page 47: Augmented Reality
Page 48: Augmented Reality
Page 49: Augmented Reality

MICROMECHANICAL GYROSCOPE

Page 50: Augmented Reality
Page 51: Augmented Reality
Page 52: Augmented Reality
Page 53: Augmented Reality

OUTPUT IS ANGULAR VELOCITY

Page 54: Augmented Reality
Page 55: Augmented Reality

ERROR ACCUMULATION =>=> DRIFT == LOW-FREQUENCY NOISE

Page 57: Augmented Reality
Page 58: Augmented Reality
Page 59: Augmented Reality
Page 60: Augmented Reality

g

a

g-a

Output is (g-a) in coordinate system of device

Page 61: Augmented Reality

g

Case: 1d, a 0

x

y

gy

gx

Page 62: Augmented Reality

Accelergx, gy

Angle

Gyro

?

Magic==

Kalman Filter

Complementary Filter

Page 63: Augmented Reality

KALMAN FILTER IS BASED ON MODELS

Link

Page 65: Augmented Reality
Page 66: Augmented Reality

COMPLEMENTARY FILTER

Link

amplitude

frequency

Page 67: Augmented Reality

HOW TO CHOOSE VALUE OF COEFF.?

Page 69: Augmented Reality
Page 70: Augmented Reality
Page 72: Augmented Reality

g

drift

Page 73: Augmented Reality
Page 74: Augmented Reality
Page 75: Augmented Reality

g

drift

B

Page 76: Augmented Reality
Page 77: Augmented Reality

Spec. sensors

Cameras

markers

structured light

Z-cameras / Z-sensors

True Optical:several cameras

True Optical:one moving camera

GPS, accelerometer, gyro, magnetic compass

Page 78: Augmented Reality

L

W

H

D

FOV

d

Page 79: Augmented Reality

L

W

H

D

FOV

d

Page 80: Augmented Reality
Page 81: Augmented Reality
Page 82: Augmented Reality
Page 83: Augmented Reality

HOW TO DETECT MARKER(S) ON IMAGE

Threshold

Page 84: Augmented Reality
Page 86: Augmented Reality

N CAMERAS X M MARKERS

Page 87: Augmented Reality

VICON

Page 89: Augmented Reality

OPTITRACK

Page 90: Augmented Reality

Spec. sensors

Cameras

markers

structured light

Z-cameras / Z-sensors

True Optical:several cameras

True Optical:one moving camera

GPS, accelerometer, gyro, magnetic compass

Page 91: Augmented Reality
Page 92: Augmented Reality
Page 95: Augmented Reality

Spec. sensors

Cameras

markers

structured light

Z-cameras / Z-sensors

True Optical:several cameras

True Optical:one moving camera

GPS, accelerometer, gyro, magnetic compass

Page 96: Augmented Reality
Page 98: Augmented Reality
Page 99: Augmented Reality
Page 100: Augmented Reality
Page 101: Augmented Reality
Page 102: Augmented Reality

Link

ABOUT USING OF DATABASES

Page 103: Augmented Reality

Camera input Tiny image

Database nearest neighbors

Blended pose of

nearest neighbors

Link

Page 105: Augmented Reality

Spec. sensors

Cameras

markers

structured light

Z-cameras / Z-sensors

True Optical:several cameras

True Optical:one moving camera

GPS, accelerometer, gyro, magnetic compass

Page 106: Augmented Reality

ORGANIC MOTION

Link

Page 107: Augmented Reality
Page 109: Augmented Reality

IPISOFT DESKTOP MOCAP

Page 111: Augmented Reality

Spec. sensors

Cameras

markers

structured light

Z-cameras / Z-sensors

True Optical:several cameras

True Optical:one moving camera

GPS, accelerometer, gyro, magnetic compass

Page 114: Augmented Reality
Page 115: Augmented Reality

AUGMENTED REALITY REVENUE

0

50

100

150

200

250

300

350

400

2008 2014

millions of USD

Link

Page 116: Augmented Reality
Page 117: Augmented Reality

robustness сущ.

общ. здоровье; сила; здравомыслие; трудность; эксплуатационная

надёжность; прочность

автом. надёжность

безоп. способность системы восстанавливать работоспособность при

возникновении ошибочных ситуаций

воен. жёсткость; защищённость

выч. устойчивость (к нарушениям исходных

предпосылок); "выносливость"; живучесть; устойчивость к

нарушениям исходных предпосылок

комп. ошибкоустойчивость

контр.кач. прочность (конструкции)

Макаров робастность (оценки в статистике); устойчивость (к

нежелательным, но возможным воздействиям)

матем. корректность (метода)

рбт. грубость (напр. системы управления)

редк. грубость

тех. выносливость (к нежелательным, но возможным

воздействиям); робастность

Page 118: Augmented Reality
Page 119: Augmented Reality
Page 120: Augmented Reality
Page 121: Augmented Reality
Page 122: Augmented Reality
Page 125: Augmented Reality