ICCES 2017 - Crowd Density Estimation Method using Regression Analysis
Transcript of ICCES 2017 - Crowd Density Estimation Method using Regression Analysis
![Page 1: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/1.jpg)
Crowd Density Estimation Using Multiple Feature
Categories and Multiple Regression ModelsPresented By
Ahmed F. Gad
Menoufia UniversityFaculty of Computers and InformationInformation Technology Department
Co-AuthorsAssoc. Prof. Khalid M. Amin
Dr. Ahmed M. Hamad
20 December 2017
PID 107
12th IEEE International Conference on Computer Engineering and Systems (ICCES 2017), Cairo, Egypt
![Page 2: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/2.jpg)
Index
• Introduction
• Challenges• Perspective Distortion• Non-Linearity
• Proposed Method
• Experimental Results
20 December 2017 1
![Page 3: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/3.jpg)
Problem DefinitionCrowd Counting – Crowd Density Estimation
CountEstimation
Counting
Regression20 December 2017
Introduction Challenges Proposed Method Experimental Results
2
![Page 4: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/4.jpg)
Crowd Counting ApproachesDetection-Based Crowd Counting
Holistic Partial
Test
Classifier
OcclusionOvercrowded
Scenes
20 December 2017
Introduction Challenges Proposed Method Experimental Results
3
![Page 5: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/5.jpg)
Crowd Counting ApproachesRegression
• Solves the requirements to detect and track objects.
• Counting based on groups not individuals.
• Depends on qualitative measures from the ability of humansto count people in crowded scenes.
Scene Analysis Features
Count
X
Y20 December 2017
Introduction Challenges Proposed Method Experimental Results
4
![Page 6: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/6.jpg)
Perspective DistortionWhy Perspective Distortion is a Problem?
• Crowd counting in regression uses pixel count to find the people count in a region.
• Due to perspective distortion, the same areas with the same size can have different people count.
P, X
P
20 December 2017
Introduction Challenges Proposed Method Experimental Results
5
![Page 7: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/7.jpg)
Perspective Normalization
20 December 2017
Introduction Challenges Proposed Method Experimental Results
6
Zhang, Li, et al. "Crowd density estimation based on convolutional neural networks with mixed pooling." Journal of ElectronicImaging 26.5 (2017): 051403-051403.
Xu, Xiaohang, Dongming Zhang, and Hong Zheng. "Crowd Density Estimation of Scenic Spots Based on Multifeature Ensemble Learning." Journal of Electrical and Computer Engineering 2017 (2017).
![Page 8: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/8.jpg)
Non-LinearityRegion Pixels and People Count Relationship
20 December 2017
Introduction Challenges Proposed Method Experimental Results
7
![Page 9: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/9.jpg)
Proposed Method
20 December 2017
Introduction Challenges Proposed Method Experimental Results
8
![Page 10: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/10.jpg)
Features per Segmented Region
Image Foreground Region
Working locally per segmented regions allows capturing variance between each two regions.
20 December 2017
Introduction Challenges Proposed Method Experimental Results
9
![Page 11: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/11.jpg)
Proposed Feature Vector Proposed
Feature
Vector
• Region
• GLCM
• GLGCM
• HOG
• LBP
• SIFT
• Edge Strength
20 December 2017 10
![Page 12: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/12.jpg)
Regression Modelling
Features CountRegression Model
Independent Dependent
GPR
RF
RPF
LASSO
KNN
20 December 2017
Introduction Challenges Proposed Method Experimental Results
11
![Page 13: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/13.jpg)
UCSD Crowd Counting Dataset
4,000 Image20,000 Region
Plenty of Data
Pedestrian LocationLabeled Regions
Strong GT
1220 December 2017
Introduction Challenges Proposed Method Experimental Results
![Page 14: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/14.jpg)
UCSD Glitches
20 December 2017
Core i7 – 16 GB RAM – scikit learn
Introduction Challenges Proposed Method Experimental Results
13
![Page 15: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/15.jpg)
ResultsTraining 5 regression models with all features
Evaluation Metrics: MSE, MAE, and MRE
20 December 2017
Introduction Challenges Proposed Method Experimental Results
14
![Page 16: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/16.jpg)
Comparison with Previous Works
20 December 2017
Introduction Challenges Proposed Method Experimental Results
15
![Page 17: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/17.jpg)
Unbalanced Training & Testing Sets
Without CVJust 35 level
With CVAll Levels
20 December 2017
Introduction Challenges Proposed Method Experimental Results
16
![Page 18: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/18.jpg)
Cross ValidationWise Training & Testing Samples Selection
20 December 2017
Introduction Challenges Proposed Method Experimental Results
17
![Page 19: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/19.jpg)
Partial Features Training & TestingMSE
20 December 2017
Introduction Challenges Proposed Method Experimental Results
18
![Page 20: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/20.jpg)
Conclusion
• New crowd density estimation method based on multiplefeatures and multiple regression models.
• Edge strength is a newly used features in crowd densityestimation.
• Three experiments conducted:1. Less error compared to recent works using all features.2. Enhanced results using cross validation.3. Ranking features based on their accuracy in prediction.
(Edge strength, SIFT, and LBP are the best).
20 December 2017 19
![Page 21: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/21.jpg)
References
1. C. C. Loy, K. Chen, S. Gong, and T. Xiang, "Crowd counting and profiling: Methodology and evaluation," Modeling, Simulation and Visual Analysis of Crowds,Springer, pp. 347-382, 2013.
2. W. Zhen, L. Mao, and Z. Yuan, "Analysis of trample disaster and a case study–Mihong bridge fatality in China in 2004," Safety Science, vol. 46, pp. 1255-1270, 2008.
3. D. Helbing, A. Johansson, and H. Z. Al-Abideen, "Dynamics of crowd disasters: An empirical study," Physical review E, vol. 75, p. 046109, 2007.
4. B. Krausz and C. Bauckhage, "Loveparade 2010: Automatic video analysis of a crowd disaster," Computer Vision and Image Understanding, vol. 116, pp. 307-319, 2012.
5. B. Wu and R. Nevatia, "Detection and tracking of multiple, partially occluded humans by bayesian combination of edgeletbased part detectors," International Journal of Computer Vision, vol. 75, pp. 247-266, 2007.
6. D. Ryan, S. Denman, S. Sridharan, and C. Fookes, "An evaluation of crowd counting methods, features and regression models," Computer Vision and Image Understanding, vol. 130, pp. 1-17, 2015.
7. A. B. Chan, Z.-S. J. Liang, and N. Vasconcelos, "Privacy preserving crowd monitoring: Counting people without people models or tracking,". IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-7, 2008.
8. A. B. Chan and N. Vasconcelos, "Counting people with low-level features and Bayesian regression," IEEE Transactions on Image Processing, vol. 21, pp. 2160-2177, 2012.
9. L. Dong, V. Parameswaran, V. Ramesh, and I. Zoghlami, "Fast crowd segmentation using shape indexing,". IEEE 11th International Conference on Computer Vision (ICCV), pp. 1-8, 2007.
10. Z. Q. Al-Zaydi, D. L. Ndzi, M. L. Kamarudin, A. Zakaria, and A. Y. Shakaff, "A robust multimedia surveillance system for people counting," Multimedia Tools and Applications, pp. 1-28, 2016.
20 December 2017 20
![Page 22: ICCES 2017 - Crowd Density Estimation Method using Regression Analysis](https://reader030.fdocuments.net/reader030/viewer/2022021507/5a67794c7f8b9a656a8b558f/html5/thumbnails/22.jpg)
References
11. R. Liang, Y. Zhu, and H. Wang, "Counting crowd flow based on feature points," Neurocomputing, vol. 133, pp. 377-384, 2014.
12. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," International journal of computer vision, vol. 60, pp. 91-110, 2004.
13. K. Chen, C. C. Loy, S. Gong, and T. Xiang, "Feature Mining for Localised Crowd Counting," BMVC, p. 3, 2012.
14. B. Xu and G. Qiu, "Crowd density estimation based on rich features and random projection forest,"IEEE Winter Conference onApplications of Computer Vision (WACV), pp. 1-8, 2016.
15. D. Kong, D. Gray, and H. Tao, "A viewpoint invariant approach for crowd counting," 18th International Conference on in Pattern Recognition (ICPR). pp. 1187-1190, 2006.
16. Zeng, Xinchuan, and Tony R. Martinez. "Distributed-balanced stratified cross-validation for accuracy estimation." Journal of Experimental & Theoretical Artificial Intelligence vol. 12, pp. 1-12, 2000.
17. Ojala, Timo, Matti Pietikainen, and Topi Maenpaa. "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns." IEEE Transactions on pattern analysis and machine intelligence, vol. 24, pp. 971-987, 2002.
18. S. L. Kukreja, J. Löfberg, and M. J. Brenner, "A least absolute shrinkage and selection operator (LASSO) for nonlinear system identification," IFAC Proceedings Volumes, vol. 39, pp. 814-819, 2006.
19. D. Kang, D. Dhar, and A. B. Chan, "Crowd Counting by Adapting Convolutional Neural Networks with Side Information," arXivpreprint arXiv:1611.06748, 2016.
20. C. Zhang, H. Li, X. Wang, and X. Yang, "Cross-scene crowd counting via deep convolutional neural networks," IEEE Conference on Computer Vision and Pattern Recognition, pp. 833-841, 2015.
20 December 2017 21