Advisor: Prof. Zaniolo Hung-chih Yang Ling-Jyh Chen XML Query Language.
Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei...
-
Upload
allyson-morgan -
Category
Documents
-
view
227 -
download
1
Transcript of Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei...
![Page 1: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/1.jpg)
Robust Object Tracking with Online Multiple Instance Learning
Advisor: Sheng-Jyh WangStudent: Pei Chu
Boris Babenko, Ming-Hsuan Yang, Serge Belongie. Robust Object Tracking with Online Multiple Instance Learning. IEEE Trans. on PAMI , 2011.
![Page 2: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/2.jpg)
Outline
• Introduction• Tracking by Detection( Related Work)• Multiple Instance Learning (MIL)• Online MILboost• Experiments• Conclusion
![Page 3: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/3.jpg)
Introduction: Tracking
• Problem: track arbitrary object in video given location in first frame
• Typical Tracking System:• Appearance Model
• Color , subspaces, feature,etc• Optimization/Search
• Greedy local search, etc
[Ross et al. ‘07]
![Page 4: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/4.jpg)
Tracking by Detection
• Recent tracking work• Focus on appearance model• Borrow techniques from object detection
• Slide a discriminative classifier around image
[Collins et al. ‘05, Grabner et al. ’06, Ross et al. ‘08]
![Page 5: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/5.jpg)
Tracking by Detection: Online AdaBoost
• Grab one positive patch, and some negative patch, and train/update the model.
negative
positive
Classifier Online classifier (i.e. Online AdaBoost)
![Page 6: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/6.jpg)
Tracking by Detection
• Find max response
negative
positive old location
new location
XX
ClassifierClassifier
![Page 7: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/7.jpg)
Tracking by Detection
• Repeat…
negative
positive
negative
positive
ClassifierClassifier
![Page 8: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/8.jpg)
Problems
• What if classifier is a bit off?• Tracker starts to drift
• How to choose training examples?
![Page 9: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/9.jpg)
Multiple Instance Learning (MIL)
• Instead of instance, get bag of instances• Bag is positive if one or more of it’s members is positive
[Keeler ‘90, Dietterich et al. ‘97] [Viola et al. ‘05]
Positive
Negative
![Page 10: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/10.jpg)
Multiple Instance Learning (MIL)
• MIL Training Input
• The bag labels are defined as:
![Page 11: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/11.jpg)
Online MILBoostFrame t Frame t+1
Get data (bags)
Update all M classifiersin pool
Greedily add best K tostrong classifier
![Page 12: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/12.jpg)
Boosting
• Train classifier of the form:
where is a weak classifier• Can make binary predictions using
[Freund et al. ‘97]
![Page 13: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/13.jpg)
Online MILBoost
• At t frame, Update all M candidate classifiers
• Pick best K in a greedy fashion (M>>K)
[Grabner et al. ‘06]
![Page 14: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/14.jpg)
Online MILBoost
• Objective to maximize: Log likelihood of bags:
where:
[Viola et al. ’05, Friedman et al. ‘00]
Noisy-OR Model, The bag probability
The instance probability
![Page 15: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/15.jpg)
Online MILBoost( OMB)
M>K,
M :is total weak classifier candidates
K : is choosing the best K classifiers
![Page 16: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/16.jpg)
Online MILBoost VS Online Adaboost
![Page 17: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/17.jpg)
System Overview: MILtrack
![Page 18: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/18.jpg)
Experiments
• Compare MILTrack to:• OAB1 = Online AdaBoost w/ 1 pos. per frame• OAB5 = Online AdaBoost w/ 45 pos. per frame• SemiBoost = Online Semi-supervised Boosting• FragTrack = Static appearance model
[Grabner ‘06, Adam ‘06, Grabner ’08]
![Page 19: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/19.jpg)
Results
![Page 20: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/20.jpg)
Results
![Page 21: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/21.jpg)
ResultsBestSecond Best
![Page 22: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/22.jpg)
Conclusions
• Proposed Online MILBoost algorithm• Using MIL to train an appearance model results
in more robust tracking
![Page 23: Robust Object Tracking with Online Multiple Instance Learning Advisor: Sheng-Jyh Wang Student: Pei Chu Boris Babenko, Ming-Hsuan Yang, Serge Belongie.](https://reader031.fdocuments.net/reader031/viewer/2022032200/56649f4d5503460f94c6d3cf/html5/thumbnails/23.jpg)