Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset...
Transcript of Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset...
![Page 1: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/1.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Cricket Activity Detection
Ashok Kumar(11164)Javesh Garg(11334)
IIT Kanpur
March 4, 2014
![Page 2: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/2.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Introduction
In this project we aim to classify different types of cricket shots played during thematch.The agent learns the various shots by some video clips of particular shots and thentries to identify a shot played in a similar clip.
ExamplesPull shot, Cover drive, Straight drive.
![Page 3: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/3.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Introduction
In this project we aim to classify different types of cricket shots played during thematch.The agent learns the various shots by some video clips of particular shots and thentries to identify a shot played in a similar clip.
ExamplesPull shot, Cover drive, Straight drive.
![Page 4: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/4.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Introduction
InputVideo File
..Our System
OutputCover Drive
Types of shots
![Page 5: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/5.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Introduction
InputVideo File
..Our System
OutputCover Drive
Types of shots
![Page 6: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/6.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Introduction
InputVideo File
..Our System
OutputCover Drive
Types of shots
![Page 7: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/7.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Introduction
InputVideo File
..Our System
OutputCover Drive
Types of shots
![Page 8: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/8.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Human Pose Estimation
Human pose estimation task is widely studied in computer vision. These are manyways to solve this problem.Most of the pose estimation work uses a tree structure of the human body.
![Page 9: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/9.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Human pose estimation(Examples)Input Output
OutputInput
Codehttp : //groups.inf .ed .ac.uk/calvin/articulated human poseestimation code/
![Page 10: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/10.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Human pose estimation(Examples)Input Output
OutputInput
Codehttp : //groups.inf .ed .ac.uk/calvin/articulated human poseestimation code/
![Page 11: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/11.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Human pose estimation(Examples)Input Output
OutputInput
Codehttp : //groups.inf .ed .ac.uk/calvin/articulated human poseestimation code/
![Page 12: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/12.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Our Approach
We intend to use the work from [1] to our use in video analysis, to identify andclassify the cricket shot.We will analyse the different frames in a clip and find the correct human pose in aframe (batsman) and then by similarity analysis and movement of the object (bat)in the different frames classify the shot played in that clip.The correct human pose in the frame will (hopefully) help us in tracking themotion of the bat in the clip with better accuracy and thus greater precision inidentfying the cricket shot.
![Page 13: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/13.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Tree Structure(Step 1)
Divide video clip into frames and analyse each frame of video.Convert human pose into tree structure, and label all body parts(hands, legs), andbat with different labels.
![Page 14: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/14.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Tracking tree structure(Step 2)
Create a model(Feature Vector) by tracking the tree structure.
![Page 15: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/15.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Multiclass classification(Step 3)
Classification problem can be solved using different type of Machine learningalgorithms.
Adaptive Boosting(AdaBoost)support vector machines(SVM)k-Nearest Neighbors algorithm(k-NN)
![Page 16: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/16.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Our Approach
Step 1(Input: video clip)Divide video into a set of images.Create tree structure of human posecorresponding to each image.
Step 2Create on model based on treestructure obtained in step 1.
Step 3Use Machine learning algorithms forclassification(AdaBoost, SVM,k-NN).
Step 4Output: Type of shot played bybatsman.
![Page 17: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/17.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Our Approach
Step 1(Input: video clip)Divide video into a set of images.Create tree structure of human posecorresponding to each image.
Step 2Create on model based on treestructure obtained in step 1.
Step 3Use Machine learning algorithms forclassification(AdaBoost, SVM,k-NN).
Step 4Output: Type of shot played bybatsman.
![Page 18: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/18.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Our Approach
Step 1(Input: video clip)Divide video into a set of images.Create tree structure of human posecorresponding to each image.
Step 2Create on model based on treestructure obtained in step 1.
Step 3Use Machine learning algorithms forclassification(AdaBoost, SVM,k-NN).
Step 4Output: Type of shot played bybatsman.
![Page 19: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/19.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Our Approach
Step 1(Input: video clip)Divide video into a set of images.Create tree structure of human posecorresponding to each image.
Step 2Create on model based on treestructure obtained in step 1.
Step 3Use Machine learning algorithms forclassification(AdaBoost, SVM,k-NN).
Step 4Output: Type of shot played bybatsman.
![Page 20: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/20.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Cricket Dataset
We do not have a standard dataset available for the various shot types in a video clipformat. We plan to create a dataset of a cricket match live recorded (without ads) sothat we can get the small clips for various shots as well as full match for trainingpurposes with various camera angles.
![Page 21: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/21.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
Future Work
This work if proves to be accurate enough, can be taken further for automaticcommentry for a whole match duration.
![Page 22: Cricket Activity Detection · 2014-03-04 · Cricket Dataset We do not have a standard dataset available for the various shot types in a video clip format. We plan to create a dataset](https://reader030.fdocuments.net/reader030/viewer/2022040802/5e3bf00b25ed4f2b30231ca7/html5/thumbnails/22.jpg)
AI Project Introduction Our Approach Dataset Collection Future Work References
References
yao-fei-fei-10-cvpr human-object-interaction-in-activities, Modeling mutualcontext of object and human pose in human-object interaction activitieshttp : //groups.inf .ed .ac.uk/calvin/articulated human pose estimation code/
M.Andriluka,S.Roth,andB.Schiele.Pictorial structures revisited: People detectionand articulated pose estimation. In CVPR, 2009