Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI...
Transcript of Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI...
![Page 1: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/1.jpg)
YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI
PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES
Tour Into the Picture
![Page 2: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/2.jpg)
What is TIP?
Input: a single picture
![Page 3: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/3.jpg)
What is TIP?
Output: a 3D-like animation
![Page 4: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/4.jpg)
Why TIP?
Reconstruct detailed 3D model from the picture?Very difficult, even by manually calibration.
One picture is not sufficiently informative.
TIP supplies a much simplified 3D model (Box).
![Page 5: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/5.jpg)
Process Flow
![Page 6: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/6.jpg)
Process Flow
(a) Get the input image
(b) Define the background and extract the foreground mask.
(c) Inpaint the background to make it complete.We can use several image inpainting techniques today.
![Page 7: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/7.jpg)
Process Flow
(d) Build the spidery mesh by user input.
(e) Modeling the 3D background.
![Page 8: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/8.jpg)
The Method in the Original Paper
In the original paper, the authors didn’t really even reconstruct the 3D box model.
![Page 9: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/9.jpg)
The Method in the Original Paper
Interactive controlling of spidery mesh.
![Page 10: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/10.jpg)
The Method in the Original Paper
Generate the new background
![Page 11: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/11.jpg)
Current Method
If we know the vanishing point and the assumed 3D structure, we can estimate the camera.
Refer to §8.9 Single view reconstruction, Multiple View Geometry in Computer Vision.
![Page 12: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/12.jpg)
Process Flow
Attach foreground object to the model
![Page 13: Tour Into the Picture - Computer Sciencelazebnik/research/fall08/haohan...YOUICHI HORRY, KEN-ICHI ANJYO, KIYOSHI ARAI PROCEEDINGS OF THE 24TH ANNUAL CONFERENCE ON COMPUTER GRAPHICS](https://reader034.fdocuments.net/reader034/viewer/2022042107/5e8619618e950b2b37653959/html5/thumbnails/13.jpg)
Process Flow
Final Result