Structure from Category: A Generic and Prior-less Approach...

1
Structure from Category: A Generic and Prior-less Approach Chen Kong, Rui Zhu, Hamed Kiani, Simon Lucey {chenk, rz1, hamedk, slucey}@andrew.cmu.edu This material is based upon work supported by the National Science Foundation Graduate Research Fellowship under Grant No. 1526033. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors(s) and do not necessarily reflect the views of the National Science Foundation. Experiments 3D Inversion Overview Introduction t 1 t 2 t 3 t 4 t 5 ··· ··· Non-rigid Structure from Motion: Inferring the camera motion and shape of non-rigid objects + additional constraints (e.g. temporal order.) Structure from Category: Inferring the camera motion and shape of objects in the same object category (aeroplanes, chairs, buses and etc.) Assume the 3D shape of instance , can be well-approximated as a linear combination of a set of rotated 3D bases : To estimate the 3D shape, we minimize the re-projection error: which can be solved by ADMMs. f S f {B l } L l=1 relax Synthetic Experiments Noise performance PASCAL with ground truth keypoints PASCAL with detected keypoints PASCAL with ground truth keypoints PASCAL with detected keypoints Keypoint Detection 3D Inversion Carnegie Mellon University

Transcript of Structure from Category: A Generic and Prior-less Approach...

Page 1: Structure from Category: A Generic and Prior-less Approach ...ci2cv.net/media/papers/Kong_3DV_2016_poster.pdf · Structure from Category: A Generic and Prior-less Approach Chen Kong,

Structure from Category: A Generic and Prior-less ApproachChen Kong, Rui Zhu, Hamed Kiani, Simon Lucey{chenk, rz1, hamedk, slucey}@andrew.cmu.edu

This material is based upon work supported by the National Science Foundation Graduate Research Fellowship under Grant No. 1526033. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors(s) and do not necessarily reflect the views of the National Science Foundation.

Experiments

3D Inversion

Overview

Introductiont1 t2 t3 t4 t5 · · ·

· · ·

Non-rigid Structure from Motion: Inferring the camera motion and shape of non-rigid objects + additional constraints (e.g. temporal order.)

Structure from Category:Inferring the camera motion and shape of objects in the same object category(aeroplanes, chairs, buses and etc.)

Assume the 3D shape of instance , can be well-approximated as a linear combination of a set of rotated 3D bases :

To estimate the 3D shape, we minimize the re-projection error:

which can be solved by ADMMs.

f Sf

{Bl}Ll=1

relax

Synthetic Experiments Noise performance

PASCAL with ground truth keypoints PASCAL with detected keypoints

PASC

AL w

ith g

roun

d tru

th k

eypo

ints

PASC

AL w

ith d

etec

ted

keyp

oint

s

Keypoint Detection 3D Inversion

Carnegie Mellon University