Image Primitives and Correspondence
description
Transcript of Image Primitives and Correspondence
![Page 1: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/1.jpg)
Image Primitives and Correspondence
Jana KoseckaGeorge Mason University
![Page 2: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/2.jpg)
ICRA 2003 2
Given an image point in left image, what is the (corresponding) point in the rightimage, which is the projection of the same 3-D point
Image Primitives and Correspondence
![Page 3: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/3.jpg)
ICRA 2003 3
Correspondence
Lambertian assumption
Rigid body motion
Matching - Correspondence
![Page 4: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/4.jpg)
ICRA 2003 4
Translational model
Affine model
Transformation of the intensity values and occlusions
Local Deformation Models
![Page 5: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/5.jpg)
ICRA 2003 5
• Translational model
• RHS approx. by first two terms of Taylor series
• Small baseline
• Brightness constancy constraint
Feature Tracking and Optical Flow
![Page 6: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/6.jpg)
ICRA 2003 6
• Normal flow
Aperture Problem
![Page 7: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/7.jpg)
ICRA 2003 7
• Integrate around over image patch
• Solve
Optical Flow
![Page 8: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/8.jpg)
ICRA 2003 8
rank(G) = 0 blank wall problemrank(G) = 1 aperture problem rank(G) = 2 enough texture – good feature candidates
Conceptually:
In reality: choice of threshold is involved
Optical Flow, Feature Tracking
![Page 9: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/9.jpg)
ICRA 2003 9
• Qualitative properties of the motion fields
• Previous method - assumption locally constant flow
• Alternative regularization techniques (locally smooth flow fields, integration along contours)
Optical Flow
![Page 10: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/10.jpg)
ICRA 2003 10
Feature Tracking
![Page 11: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/11.jpg)
ICRA 2003 11
3D Reconstruction - Preview
![Page 12: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/12.jpg)
ICRA 2003 12
• Compute eigenvalues of G• If smalest eigenvalue of G is bigger than - mark pixel as candidate feature point
• Alternatively feature quality function (Harris Corner Detector)
Point Feature Extraction
![Page 13: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/13.jpg)
ICRA 2003 13
Harris Corner Detector - Example
![Page 14: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/14.jpg)
ICRA 2003 14
Wide Baseline Matching
![Page 15: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/15.jpg)
ICRA 2003 15
• Sum of squared differences
• Normalize cross-correlation
• Sum of absolute differences
Region based Similarity Metric
![Page 16: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/16.jpg)
ICRA 2003 16
• Compute image derivatives • if gradient magnitude > and the value is a local maximum along gradient direction – pixel is an edge candidate
Canny edge detectorgradient magnitudeoriginal image
Edge Detection
![Page 17: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/17.jpg)
ICRA 2003 17
x
y
• Edge detection, non-maximum suppression (traditionally Hough Transform – issues of resolution, threshold selection and search for peaks in Hough space)• Connected components on edge pixels with similar orientation - group pixels with common orientation
Non-max suppressed gradient magnitude
Line fitting
![Page 18: Image Primitives and Correspondence](https://reader035.fdocuments.net/reader035/viewer/2022081513/56816849550346895dde32a6/html5/thumbnails/18.jpg)
ICRA 2003 18
• Line fitting Lines determined from eigenvalues and eigenvectors of A• Candidate line segments - associated line quality
second moment matrixassociated with eachconnected component
Line Fitting