SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of...
Transcript of SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of...
![Page 1: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/1.jpg)
FACE DETECTIONLab on Project Based Learning
May 2011
Xin Huang, Mark Ison, Daniel Martínez
Visual Perception
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 2: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/2.jpg)
Contents
• Introduction
• Exploration into local invariant features
• The final method
• Results
• Conclusions
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 3: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/3.jpg)
Contents
• Introduction
• Exploration into local invariant features
• The final method
• Results
• Conclusions
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 4: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/4.jpg)
Introduction• Karlos Arguiñano’s TV show.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 5: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/5.jpg)
Introduction
Which is our goal?
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 6: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/6.jpg)
Introduction• Which is our goal? -> Detect presence of a face.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 7: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/7.jpg)
Introduction
Problem definition
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 8: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/8.jpg)
Introduction• Problem definition:
• How can we use local invariant feature descriptors to detect Arguinano’s face.
• Use MATLAB programming language.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 9: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/9.jpg)
Introduction• Constraints of the project:
• Use local invariant features descriptors.
• Use MATLAB programming language.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 10: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/10.jpg)
Contents
• Introduction
• Exploration into local invariant features
• The final method
• Results
• Conclusions
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 11: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/11.jpg)
Exploration into local invariant features
First approaches:1. SURF matching.
2. Template database SURF matching.
3. Clustering
4. Filtering best features.
5. SIFT matching
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 12: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/12.jpg)
Exploration into local invariant features
First approaches:1. SURF matching.
2. Template database SURF matching.
3. Clustering
4. Filtering best features.
5. SIFT matching
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 13: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/13.jpg)
1. SURF matching:
• Speeded up robust features.
• Simplification of SIFT.
• Fast.
• “Combination of novel detection, description, and matching steps.” [ETH Swiss Federal Institute of Technlogy]
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 14: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/14.jpg)
1. SURF matching
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 15: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/15.jpg)
1. SURF matchingResult with a rigid feature:
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 16: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/16.jpg)
1. SURF matchingResult (no more fancy glasses):
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 17: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/17.jpg)
Exploration into local invariant features
First approaches:1. SURF matching.
2. Template database SURF matching.
3. Clustering
4. Filtering best features.
5. SIFT matching.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 18: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/18.jpg)
2. Template database SURF matching.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Test imageClassifier
(NN)Output image
with matchings
FACE/NON FACE templates
(SURF descriptors)
Exploration into local invariant features
![Page 19: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/19.jpg)
2. Template database SURF matching
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
+
Exploration into local invariant features
![Page 20: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/20.jpg)
2. Template database SURF matching Result A
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 21: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/21.jpg)
2. Template database SURF matching Result B
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 22: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/22.jpg)
Exploration into local invariant features
First approaches:1. SURF matching.
2. Template database SURF matching.
3. Clustering
4. Filtering best features.
5. SIFT matching.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 23: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/23.jpg)
3. Clustering:
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
Test imageClassifier
(NN)Output image
with matchings
FACE/NON FACE Clusters of SURF
descriptors
Clustering!
![Page 24: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/24.jpg)
3. Clustering:
Ideal Reality
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 25: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/25.jpg)
Exploration into local invariant features
First approaches:1. SURF matching.
2. Template database SURF matching.
3. Clustering
4. Filtering best features.
5. SIFT matching.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 26: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/26.jpg)
4. Filtering best features:
• Find the extreme ratios.
• Two separate databases.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 27: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/27.jpg)
4. Filtering best features:
Blue BAD, Orange GOOD
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 28: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/28.jpg)
SURF FAILS
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 29: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/29.jpg)
SURF FAILS
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
But...WHY?
![Page 30: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/30.jpg)
SURF FAILS
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
[REF] [A Comparison of SIFT, PCA-SIFT and SURF - Luo Juan, Oubong Gwun- International Journal of Image Processing-2010]
![Page 31: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/31.jpg)
Exploration into local invariant features
First approaches:1. SURF matching.
2. Template database SURF matching.
3. Clustering
4. Filtering best features.
5. SIFT matching.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 32: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/32.jpg)
5. SIFT Matching:
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
Test imageClassifier
(NN)Output image
with matchings
FACE/NON FACE Clusters of SIFT
descriptors SIFT!
![Page 33: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/33.jpg)
5. SIFT Matching:
• Bringing in SIFT.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 34: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/34.jpg)
5. SIFT Matching:
• We should do anything else...
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Exploration into local invariant features
![Page 35: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/35.jpg)
Contents
• Introduction
• Exploration into local invariant features
• The final method
• Results
• Conclusions
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 36: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/36.jpg)
1. Skin detection:
• Help SIFT as much as possible.
• Make the ROI of skin color regions.
• Methodology:
• Extract skin segments: find the mean and covariance between CrCb.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
The final method
![Page 37: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/37.jpg)
1. Skin detection:
• Methodology:
• Obtain the Gaussian probabilities of skin color pixels for the input image.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
The final method
![Page 38: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/38.jpg)
2. Skin detection:
• Methodology:
• Apply an adaptive threshold.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
The final method
![Page 39: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/39.jpg)
2. Skin detection:
• Methodology:
• Avoid region without holes and apply morphological operation over the binary image.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
The final method
![Page 40: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/40.jpg)
3. Face detection:
• Filtering best features.
• Finding matches between each skin region and each template.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
The final method
• D.Lowe
![Page 41: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/41.jpg)
3. Face detection:
• Check if each skin region is a face.
• Threshold = Face matches / No facematches
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
The final method
![Page 42: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/42.jpg)
Contents
• Introduction
• Exploration into local invariant features
• The final method
• Results
• Conclusions
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 43: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/43.jpg)
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Resultsans =
TestImage_num: 1Regioin_num: 1Keypoint_num: 1135
TotalFaceMatch_num: 99TotalNoFaceMatch_num: 14
TemplateMatchNum: [2x37 double]
ans =
TestImage_num: 1Regioin_num: 2Keypoint_num: 74
TotalFaceMatch_num: 3TotalNoFaceMatch_num: 2
TemplateMatchNum: [2x37 double]
![Page 44: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/44.jpg)
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Results
![Page 45: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/45.jpg)
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Results
![Page 46: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/46.jpg)
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
Results
![Page 47: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/47.jpg)
Contents
• Introduction
• Exploration into local invariant features
• The final method
• Results
• Conclusions
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 48: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/48.jpg)
Conclusions• We have implement a face-detection method based on feature descriptors with a lot of help.
• SIFT over SURF
• QUALITY OF THE FEATURES over QUANTITY
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez
![Page 49: SIFT FLOW: Dense Correspondence across Scenes and Its ... · SIFT matching Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez. Exploration](https://reader034.fdocuments.net/reader034/viewer/2022050419/5f8efba371dc364cdf3d0e59/html5/thumbnails/49.jpg)
Conclusions•How can be improved?
• Use shape characteristics.
• A larger template database and a more robust classifier.
• Use morphology advantages.
• Apply other methods instead of feature description (i.e: HAAR).
• Use previous frames information.
Master Erasmus Mundus of Science in Vision and Robotics (VIBOT) - X.Huang, M.Ison, D.Martínez