© 2006 Autodesk1 Image-processing Technologies for Digital Content Creation...
-
Upload
chrystal-park -
Category
Documents
-
view
216 -
download
0
Transcript of © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation...
![Page 2: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/2.jpg)
© 2006 Autodesk 2
CORPORATE INFORMATION
REALVIZ: Founded March 98
Exclusive technology from INRIA Sophia-Antipolis Technology from the Robotvis group
Headquarters and R&D in Sophia Antipolis, Southern France
90% of revenue outside France, 50% in the USA
Just acquired by Autodesk (PSEB division)
![Page 3: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/3.jpg)
© 2006 Autodesk 3
MISSION
Image-based technologies empower designers and graphic
artists to efficiently create the most effective visual content
based on digital photographs and videos.
Post-production
Architecture
Digital Imaging
Multimedia
CAD
Video GamesDinotopia - Courtesy of Framestore CFC
Monkey – Courtesy of Quiet Man
![Page 4: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/4.jpg)
© 2006 Autodesk 4
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
![Page 5: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/5.jpg)
© 2006 Autodesk 5
PANORAMIC PHOTOGRAPHY
Panoramic Photography
![Page 6: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/6.jpg)
© 2006 Autodesk 6
Creation of panoramic images up to full spheres (360° horizontal by 180° vertical) – fully automatic
Thousands users : professional photographers, digital imaging hobbyists, multimedia & web designers, architects, post-production artists
IMAGE STITCHING
![Page 7: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/7.jpg)
© 2006 Autodesk 7
Click inside to see the full screen, full spherical QuickTime VR PanoramaCourtesy of VR Way
FULL SPHERICAL PANORAMAS
![Page 8: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/8.jpg)
© 2006 Autodesk 8
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
![Page 9: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/9.jpg)
© 2006 Autodesk 9
IMAGE BASED MODELINGBridging the gap between 2D and 3D
Image Based Modeling
![Page 10: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/10.jpg)
© 2006 Autodesk 10
IMAGE BASED MODELING
Creation of 3D photo-textured objects from photographs
(1 to many)
Applications Virtual reality: 3D Simulation/Storytelling Urban planning & perspective matching for 3D CAD models Photogrammetry Video games 3D animation & special effects
![Page 11: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/11.jpg)
© 2006 Autodesk 11
IMAGE BASED MODELING
From stills…… calibrated in 3D from the manual placement
of matching points …
… for photo-realistic 3D models !
![Page 12: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/12.jpg)
© 2006 Autodesk 12
IMAGE BASED MODELING
From a panorarma or a still picture…
… to a photo-realistic
3D environment !
… more demos
![Page 13: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/13.jpg)
© 2006 Autodesk 13
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
USE CASES
![Page 14: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/14.jpg)
© 2006 Autodesk 14
SPECIAL EFFECTS
SFX Solutions
![Page 15: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/15.jpg)
© 2006 Autodesk 15
CAMERA TRACKING
Click inside to see the movie. Courtesy of Platige Image 2005
Click inside to see the movie. Courtesy of Platige Image 2005
Camera path
& 3D points extracted
with MatchMover
3D contentRendered in
3D animation software
Click inside to see the movie. Click inside to see the movie.
Before… … After
![Page 16: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/16.jpg)
© 2006 Autodesk 16
CAPTURING 3D RIGID MOTION- Feature points are extracted and tracked across sequences
- Based on parallax and rigidity (epipolar geometry), the algorithm extracts:
- Camera path and parameters (zoom, distortion) over time
- 3D point coordinates
- Ready for 2D/3D video-montage… all in one click!
![Page 17: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/17.jpg)
© 2006 Autodesk 17
SOME MOVIES
![Page 18: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/18.jpg)
© 2006 Autodesk 18
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
![Page 19: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/19.jpg)
© 2006 Autodesk 19
MOTION CAPTURE
Motion Capture
![Page 20: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/20.jpg)
© 2006 Autodesk 20
VIDEO-BASED MOCAP
Capture non-rigid 3D motion from several videos
![Page 21: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/21.jpg)
© 2006 Autodesk 21
VIDEO-BASED MOCAP
Video-based motion capture solution
Applications: animation, bio-medical, ergonomy…etc
Covering facial, full body, and on-set mocap
Total flexibility From 2 cameras to as many as needed Cameras can fixed or moving. Cameras can be of different frame rate and different definitions. No need for a motion capture studio
Computed data Tracked 3D points Camera data
![Page 22: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/22.jpg)
© 2006 Autodesk 22
VIDEO-BASED MOCAP
![Page 23: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/23.jpg)
© 2006 Autodesk 23
MATCHMOVINGOne moving camera observing a rigid scene : Parallax (i.e relative 2D image motion) allows recovering 3D camera motion and scene structure
1N
..t..
FROM RIGID MOTION…
![Page 24: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/24.jpg)
© 2006 Autodesk 24
… TO NON-RIGID MOTION- Several synchronous cameras are used
- Same geometric problem as matchmoving at each time
Cam1Cam2
Cam3
Time 1
Cam1Cam2
Cam3
Time N
- Bonus: We can handle camera motion as well!
![Page 25: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/25.jpg)
© 2006 Autodesk 25
VIDEO-BASED MOCAP
…Result
![Page 26: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/26.jpg)
© 2006 Autodesk 26
ON-SET MOCAP-All sequences shot with
-- 2 fixed cameras: HD digital (1920x1080)
- 1 mobile camera (the main shooting cam): film, scanned at 2048x1536
…Result
![Page 27: © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649db25503460f94aa211d/html5/thumbnails/27.jpg)
© 2006 Autodesk 27
Q&A