Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape...
-
date post
20-Jan-2016 -
Category
Documents
-
view
218 -
download
2
Transcript of Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape...
![Page 1: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/1.jpg)
Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models
Utsav Prabhu, Keshav Seshadri, Marios Savvides
報告人 : 李治衡 2011/06/08
![Page 2: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/2.jpg)
Outline• Background
- ASM
- Kalman Filter • Tracking Methods
- Purely ASM
- Kalman Filter Assisted ASM• Experiments and Results• Conclusions and Future Work
![Page 3: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/3.jpg)
Background – ASM Active Shape Model
1) Generate facial model using training images
2) Detect face in test image
3) Deform model to fit face in test image
![Page 4: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/4.jpg)
Background – ASM • Active Shape Model
- Any Facial Shape
- Mean Shape
P - Eigenvector matrix
b - Projection coefficients
![Page 5: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/5.jpg)
Background – Kalman FilterEstimate optimal state at time t
with a measurement given by
Prediction Stage
Correction Stage
![Page 6: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/6.jpg)
Tracking MethodsPurely ASM Based Approaches• ASM on individual frames• ASM on individual frames with correction• ASM with initialization using previous frame
Kalman Filter Assisted ASM• Tracking landmark coordinates across frames• Tracking parameters that affect landmark positions
![Page 7: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/7.jpg)
Tracking Methods – Kalman Filter Assisted
![Page 8: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/8.jpg)
Experiments and Results
(a) (b) (c)
(a) Initialization provided by face detection(b) Initialization provided by using ASM results of previous frame(c) Initialization provided by prediction step of Kalman filter
![Page 9: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/9.jpg)
Experiments and Results
(a) (b) (c) (d) (e)
(a) ASM on individual frames(b) ASM on individual frames with correction(c) ASM initialized using results of previous frame(d) ASM with Kalman filtering of landmark coordinates(e) ASM with Kalman filtering of parameters affecting landmark locations
![Page 10: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/10.jpg)
Methods Result Comparison
![Page 11: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/11.jpg)
Experiments and Results
![Page 12: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/12.jpg)
Conclusion & Future Work • Experiments on 3 videos confirm our Kalman based
approaches enable better ASM initialization and lower
fitting errors• Background subtraction and re‐initialization of ASM to deal
with scene changes, zooming in of subject etc.• Speed optimizations for our ASM and Kalman tracking
implementations• Benchmark our approach on publicly available datasets/more
challenging datasets
![Page 13: Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.](https://reader036.fdocuments.net/reader036/viewer/2022081520/56649d5d5503460f94a3cfbb/html5/thumbnails/13.jpg)
Thank you for your attention!