h 18s|\P<Ackj"jF#Xqgq@88 (2013/ 9n)

BD-HN3DrM87?$h=,bGkNBLzrh|XN

EvKhksV`nYg79F`NsF

Pathfinder Vision: Future Prediction Augmented Reality Interface for Vehicle Operation Using Past Images

0D>H 1)$y\cy 1)

Naoya MAEDA and Maki SUGIMOTO

1) DfANgXgX!!})X&fJ

J) 223 @`n)#MTALh|H 3-14-1, nmaeda@imlab.ics.keio.ac.jpK

5W: MVN)A~lJ$ljGnHdps}8rT&m\CH,?/hv7F*j$m\CHNsV

`n$s?U'<9N&fb?/TolF-F$k.\&fGO=_N`nuVH~OD-NpsKpE

-*}*J3DrM87?h|rs(9k3HG$`nTN$h=,rYg7$`n-N~erB=9

k$s?U'<9rsF9k%\j!GO|T-+aiKhCFj"k?$`KBD-bNu7rh@

7$c2*bGkHm\CHN=,bGkNVG*}7_el<7gsrT&3HKhj3DrM87$

tCeKm\CH,INLVK$k+r=,7?$h=,h|rBLzrh|eK8.&s(9k%

-<o<I' m\CH`n, Re<^s$s?U'<9$H%=B6, $h=,

1. O8aK

R2=lJINMVN)A~lJ$ljGMVNeoj

KnHdps}8rT&R2Ygm\CH,?/hv7F

$k%=lK<$R2Ygm\CHN`n$s?U'<9N

&fb?/TolF-F$k%m\CHN`nK*$FE

WJ3HOm\CH+HNLVHm\CHrhj,/BD

-ND.G"j$=_Nm\CHNLVH~OD-r]<

k+aid_Qh|H CG bGkrQ$F0t+iNRQ

h|r8.9k3HG`n-N~erWk&f,TolF

$k%l}G$RQh|rQ$k3HG=_Nu7D.O

FWKJkbNN`nr31?lgKINh&Ju7,/

89k+r=,9klgKO$`nTNP3,,WH5l$

,ZJ`nN?aN=G,T$,?$lg,"C?%=3

G\&fGO=_N`nuVH~OD-NpsKpE-*

}*J3DrM87?=,h|r8.&s(9k3HG$`

nTN$h=,rYg7$`n-N~erB=9k$s?

U'<9rsF9k%^ 1 K\&fGHQ9k\0m\C

Hr(9%

^ 1: \0m\CH

2. X"&f

3sTe<?S8gsrQ$?\0m\CHN`nYg

O?/N&f,TolF$k%y\iO#F5l?G|N

zr+i,ZJUl<`r*r7$=Nanh|bK=_

Nm\CHNLVQ*rM87?bGkrEv9k3HG

P<AckJ0MNk@r8.9kj!rsF7F$k [1]%

eDiOBD-br4}Lh|Hw%h|;s5Khj@

ilk0!5@2rQ$F+3k@h|8.7`nYgr

T&j!rsF7? [2]%7+7$>h&fGOm\CHN

=_NuVH~OND-NX8-N'1O~15lkbN

N`nr31?lgKm\CHH~OND-,INh&J

j_nQr/39+O@(5lF$J+C?%

`nTNa$-hKP9k=Grdu9k$s?U'<

9H7FO$B]N0nr31?lgN-hN`nP]Nb

Gkrs(9k}!,+/5lF$k%lcH7FO$+0

V,\07?lg$-hKINMJLVK\09k+r+

0VNV}K~8?~rEv9k3HG(9j"Se<+

aiKhk+0VNsVYg79F`,s2ilk [3]%^

?$6\iO+aiG|K`nP]N CG r+aih|b

NB]N`nP]KEv7$CG KP7-hNLVQ*r

X(9k3HG$`nrT&$s?U'<9rsF7? [4]%

3liN79F`GO=_ND-HNj_nQrM87F

*i:$INh&K`nP]H~OND-,3D9kN+

rDk=9k3HOTCF$J$%

l}G$$s?i/F#V79F`N&fNfGO$-h

NuVK*$F*N,INh&K3D9kN+r*}7_e

138

This article is a technical report without peer review, and its polished and/or extended version may be published elsewhere.

l<7gsrQ$kj!,"k%EDiO$-MF#C/

"<HnJN_WK*$F$dN*}7_el<7gs(

s8srAu_WQN79F`KH_~`3HG$ANT

8nHNGfK$*}*Js0rV~K=,$s(9k$

s?U'<9r+/7? [5]%

3Nj!Khj$~VPaK<CFQ=9k*NNLV

d0-rb.K+Df<6Ko+jd9/s(9k3H,

D=G"k%\&fGO$hT&fGsF5lF$k-h

NuVr=(7F`nrdu9kj!KP7F$j"k?

$`N`npsKP~9k*}7_el<7gsr3~7

FDk=7?$hr`nTKs(9k$s?U'<9r=

[9k%

3. sF79F`

3.1 $h=,h|N5W

f<6Xs(9kh|H7FO$lL*Km\CH+H

NcH7Fk\7?0tr#|9k+ai+iNVgQh

|WH$D-NG|eK`nP]NbGkrEv7?j$̀

nP]G"km\CHQ!QKhjU1?+aiG#|7

?j9k3HGM@G-kVRQh|W,Q$ilk%#

sO=_NLVpsGRQk@h|rP<AckuVeK

<w*KRQh|r8.7F$k%\&fK*$1kV$

h=,h|WHORQk@GA+l? CGN\0m\CH

,\07?lg$3ND-bG-hINLVK"kN+r

=,78.5l?\0m\CHHc2*N3Dr==7?

h|rX9%Fs(h|N50^,^ 2$s(9k$h=,

h|,^ 3G"k%

^ 2: Fs(h|N50^

^ 3: $h=,h|

3.2 sF79F`N.l

sF79F`N.lr^ 4K(9%79F`NfGO\

0m\CHHh|Nh}r1~KTCF$k%\0m\CH

Nh}O\0m\CHN.5${sJIN?arm\CHK

k\7F$k PCK UDPrQ$FAw9k.h|h}N7

9F`K*$FO RGB N+i<h|HGW9h|N 2 o

`rQ$k%GW9+aiNh|hjF+i<h|eNh

GN 3!5psrh@7$h}rT& PCK 2DNh|r

UDPKhCFAw9k%3!5psrbHK$c2*N!

PrT&%m\CHKP7F0n?a,Tol?lg$c

2*H7FjP5l? 3!5psN@2r8.9k%^?$

=lH1~K~O5l?.5r5K=,bGkHJk\0

m\CHr8.7F*/%8.5l?=,bGkHc2*

,$s?i/7gsrT&$$h=,h|rs(9k3H

G$`nYgrT&%0n?a,J+C?lgKOm\CH

Od_NuVG"j$c2*HN\(OToJ$?a$R

Qh|N_rs(9k%

^ 4: sF79F`N.l

3.3 BD-bNAu==

c2*Hm\CHN3Drs(9k?aKOc2*Hm

\CHN 3 !5*JAurD.7J1lPJiJ$%\0

m\CHO#sHQ7?m\CHNC-e$>B 34cm$b

5 30cm N_lH7FawrTC?%l}$BD-bNc

2*Oc2*N+aiGGkt,N=LpsN_Gc2*

NAurM87?%h}Nj"k?$`-rM87F$A

ur>B 2cmNeNH7F 3!5Auraw7?%w%h

|+ai+ih@7?D-Nh|r^ 5 K(9%^?$3

Nh|bNc2*rjP7$Auaw7?bGkr^ 6K

(9%

^ 5: BD-h| ^ 6: Auawh|

3.4 m\CHHc2*N3DN7_el<7gs

BD-bG\07?lg$c2*Kv?C?\0m\C

HOJT}~r82il$WM7F0;,QoCF\0}~

,Qoklg,"k%-hNm\CHNLVd0-rf<6

Ko+jd9/s(9k?aK#sO*}7_el<7gs

Ni$VijG"k Bullet PhysicsrQ$F$*}7_e

139

l<7gsrTC?%*}7_el<7gs,Q0$,Qe

N$h=,h|r=l>l^ 7K(9%

^ 7: *}7_el<7gsN3~ (8:,Q0, &:,Qe)

4. Bu

4.1 BuD-

\&fNBuD-r= 1K(9.

= 1: BuND-_j

h|r|Y 640_ 480 ! pixel

RGB-D+ai Kinect for Xbox360

CPU AMD Athlon(tm) II X4 640 3.00GHz

abj 4GB

GPU ATI Radeon HD 4250

OS Windows 7 Professional 64bit

\0m\CH iRobotR iRobot Create

4.2 $h=,h|Ns(

f<6KP7F$h=,h|rs(9k?$_s0O$

f<6N\0N~O,"C?lgN 1 CeG"j$$h=

,h|H7Fs(9kh|O 1Ce+is 8Ce^GN\

0m\CHNf4LVNB8H$1Ce+i 5Ce^GN\

0m\CHN\07?lgN 1CVVGN=,LVr 3C

Vs(9k%

5. B3

5.1 B3_j

sF79F`N-Q-r4Yk?aKBD-bG=wB

3rTC?%BD-bG_W7?P)O^ 8G"k%P)

br\07F$/&(GNroOJ<NH*jG"k%

• A'C/]$sH 3@r,:Lj$4<kO@Gd_

• 2<HO 4D"j$=l>lLaN-5r,:=G

• LaDN=GNlg$La%TDNlg$*s

• 2<HLa~KLaTDH=G7?lg$*s

• WMOJkY/sr9kh&o3TKA(k%

^ 8: B3wJ

=wB3GOgQh|$gQh|HRQk@h|$gQ

h|HRQk@h|H$hh|N 3 o`Nh|s(j!K

hk`n$s?U'<9rfS7?%s(Nc$KhkfS

OB3P)NWMst$=GNm'(K*$FTC?%2<

HO 4o`Ng-5,"j$=l>l 30cm$34cm$40cm$

45cm GLaTD=J2<HO 30cm$34cm G"j$La

D=J2<HO 40cm$45cmG"k%`n$s?U'<9

H7FO8g$QCIrQ$?%o3TO 8>J20e 7>$

30e 1>KG"C?%f<6KOB3P)rvT9k0K

B3P)$m\CHN`n}!Nb@rTC?%3o`Ns

(9kh|O^ 9G"k%

^ 9: Fs(h| (8:gQ, f:RQ,& :=,)

5.2 B3kL

5.2.1 WMstNfS

3o`Nh|s(}!Khk4o3TN?QWMst$8

`P9r=7?0iU,^ 10 G"k% B3kLhjsF

^ 10: 3o`Ns(}!Khk?QWMst

j!OgQh|$gQh|\RQh|Nj!hjb?QW

Mst,/J/$`DN-Jr~e9kNK-zG"k%^

?$8`P9GfS7?lg$sFj!O8`P9,Gb

.5/$#sNB3N`nTNDM9KX8J/-zG"

kHM(ilk%

5.2.2 m'1(NfS

3o`Nh|s(}!LNf<64NNm'1(r^ 11

K(9%^?$4o`N2<HLNLa$*sN'1K*$

F`nTNm'1Ndgr 3 o`Nh|s(}!GfS7

?kLr^ 12K(9%

^ 11: 3o`Ns(}!K*1km'1(

^ 12: 3o`Ns(}!K*1k2<HLm'1(

140

B3kLhj$sFj!OgQh|$gQh|\RQh|

Nj!hjb2<HN}Nm'(,<,CF$?%7?,C

F$sFj!,B4JP)*rK-zG"k%^?$2<

HN}LNm'(r+?lg$gQh|$gQh|\RQ

h|Nh|s(Nlg$LaG-J$2<HrLaG-k

H'17?H-Nm'9kMKfY$LaTD=~NsF

j!Nm'(,.5$%7?,CF$sFj!O`nTN

D-H`nP]N3DN=,KW%7$z(*JP)_W

K-zG"k3HrN'G-?HM(k%

6. M!

`nTNWMsrKP7F-zG"kH$&kLG"C

?,$B3P)N2<HrLa7?>eK`nT,J,m

&H7?lgKWM7F$k3H,?t+u1il?%3

lO$+ai,m\CH0}N_G"j$+D#sQ$?G

W9+aiNC-e$+aik~}~j0 50cm Ow%N

;s7s0,G-J$?a$BD-N=[,G-J$?a

G"k%

7. BLzrh|XN$h=,h|NEv

BD-ND.rT&&(G$GW9+aiKhCF 3!

5AuNh@G-J$t,rd09k,W,"k%;s7

s0G-J$t,rd&?aK>hj!G"k$BLzr

h|K=_Nm\CHNLVrCGGEv9kj! [1]rh

j~l?%BLzrh|NfK$h=,bGkrPO9k

lgN50^,^ 13G"k%3Nj!GO$=_NLVp

sN_GRQk@h|rt!<AckuVeK<w*K8

.9kNGOJ/$m\CHN\0fKh@7F-?an

tCVNh|+`nTKP7F$G,K+(kh&KRQ

k@h|r8.9kj!G"k.

BLzrh|HO\0fKh@7F-?zrh|N3H

G"k. BLzrh|K=_NljrEv9k3HKhj$

P<AckuVGO==G-J+C?$+ai0}Nh@

G-J+C?c2*NpsrRQk@h|KIC7$=_

Nm\CH+HNLVrFWKD.9k3H,D=HJk%

3Nj!rhj~l?$s?U'<9,^ 14HJCF$k%

l}G$BLzrh|rQ$?lg$`nfKm\CH

Nzrh|e+i=_Nm\CH,EvG-J$LVK"

klgdm\CHN=,bGk,hL0KPO5lklg

,"k%3lKX7FO$antCVNBLzrh|r]8

7$BD-N 3 !5psHm\CHNjXX8+i=Nf

+i=_Nm\CHNLVd$h=,bGk,`nTKP

7FG,Js(,D=HJkh&KBurT&=jG"k.

^ 13: zrh|XNEv

^ 14: zrh|XN$h=,h|N,Q

8. ^Ha

\@8GOBD-H\0m\CHN=,bGkrM87

?$hh|r8.7\0m\CHN`nYgrTC?%B

D-Oj"k?$`Gh@7$=lK<$c2*N!Pr

TC?%=,bGkKOBD-rF=7?P<AckuV

bK CGG\0m\CHrAh7$*}7_el<7gs

r,Q9k3HG$hh|r8.7?%

sF79F`N-Q-rN'9k?a$=wB3rTC

?%3o`Nh|s(j!Khk`n$s?U'<9rWM

st$=GNm'(Khj>A7?%sF79F`Khj

WMst$m'N=G(K~e,+il$sF79F`N

-Q-rZ@7?l}G$Auh@Ndj@r+D1~1

9kj!r,Q7?%#eO=,h|s(}!NG,=r

T$$`n-N>ANB3rT&=jG"k%

2M8%

[1] Maki Sugimoto, et al: Time Follower’s Vision: a

teleoperation interface with past images, Computer

Graphics and Applications, IEEE 25.1, pp.54-63,

2005.

[2] eD %R, gR K8, 4# RB, #p >B: H%+3k

@h|8.rQ$?sV\0m\CH`D$s?U'<

9,ERpsL.Xq;Q&fsp, MVE2012-73, Jan.

2013.

[3] $sFj8'sHQ<-s0"79H79F`$Hh?,

http://www.toyota.co.jp/jpn/tech/safety/technology/

parking/

[4] Sunao Hashimoto, Akihiko Ishida, Masahiko Inami,

Takeo Igarashi: TouchMe: An Augmented Reality

Based Remote Robot Manipulation, The 21st In-

ternational Conference on Artificial Reality and !

Telexistence, Proceedings of ICAT2011, Osaka, Nov.

28-30, 2011.

[5] Yohsuke Furuta, et al. Kinetic art design system com-

prising rigid body simulation. Computer-Aided De-

sign and Applications, CAD in the Arts Special7 : 4,

2010.

141