Video interaction through finger tips

WELCOME

VIDEO INTERACTION THROUGH FINGER

TIPS

Coined By:

Nithin Prince JohnRoll No : 11M.Tech CSESBCE, Pattoor

Guided By:

Keerthi A S PillaiAssistant ProfessorDept of CSESBCE, Pattoor

CONTENTS

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

MODULES OF THE SYSTEM

RESULT

CONCLUSION

5/23/2016 Computer Science & Engg 3

OBJECTIVE

Leverage existing content, turn them into transactional content marketing

5/23/2016 4Computer Science & Engg

“4 in 10 shoppers visited a store in person or online as a direct result of watching a video”


INTRODUCTION

Today online videos provide a passive user-experience for users

Interactive video enables users to take actions right within the video content

Interruption is the core issue

Developed a technique to blend interaction with any video, new or existing


Contd...

Interactivity makes videos more engaging and immersive

On the back end, items are tracked and hand-programmed to link out to their relative features

Creates new levels of interactivity, allowing users to view the product details using swipe motion gesture

Revolutionize, how companies market, advertise, and sell their products


Contd...

In a nutshell, the future of digital marketing


PROPOSED SYSTEM

Consist of following modules :


Swipe Motion Gesture Technique

Video Post-processing

Video Pre-processing

Contd...

Video Pre –processing Module

Tracking – Learning – Detection (TLD) : A framework designed for long-term tracking of an unknown object in a video stream

ROI is defined by a bounding box in a single frame

TLD simultaneously tracks the object, learns its appearance and detects it whenever it appears in the video


Contd...


Contd...

Choosing the video to be pre-processed


Contd...

Input : Frames of the chosen video


Contd...

Apply TLD to track interesting objects ( dress, shoes, etc... ) from it


Contd...

Output : Provides us the locations of the selected objects in each frame


Contd...

Video Post –processing Module

Input : Output of the TLD algorithm which contains the tracking information

Use that position information to focus the object of interest in each frame

Before the viewer, these frames appear in a rate more than our perception of vision, gives a sensation of moving of the object


Product Selection Technique

Difficulty of selecting moving objects


Swipe Motion Gesture

For selecting product, we want to use simple swipe of the color card in front of the webcam


Contd...

Implementation of swipe motion gesture technique

Take each frame of the video

Smooth the frame using Gaussian blur

Convert frame from BGR to HSV color-space

Extract the specified colored object alone using HSV control panel

Threshold the HSV image for a range of chosen color


Contd...

Track the colored object and calculate the co-ordinates of the position of the center of the blobs as follows

𝑚𝑝𝑞 = 𝑥=0𝑀−1 𝑦=0

𝑁−1 𝑥𝑝𝑦𝑞𝑓 𝑥, 𝑦

𝑥 = 𝑚10 𝑚00

𝑦 = 𝑚01 𝑚00


Contd...

Find the distance traveled by the object in first 15 frames

𝑑 = 𝑥2 − 𝑥12 + 𝑦2 − 𝑦1

2

Find velocity of the object

𝑣 = 𝑑 𝑡

If velocity > threshold and the gesture made is a swipe gesture, then the corresponding action is triggered


Contd...

Identification of blue color card


RESULT

Output of the proposed system


CONCLUSION

Uses computer vision technology, TLD algorithm to track unknown objects throughout the video

Employed swipe motion gesture for real time interaction experience

Solution to “How can we increase sales and engagement through traditional video mediums?”


REFERENCES

[1] Khalad Hasan, Yang Wang, Wing Kwong and Pourang Irani. Enabling User Interactions with Video Contents, 2013[2] Z. Kalal, K. Mikolajczyk, J. Matas, J. Tracking-Learning- Detection. IEEE Transactions on PAMI, vol.34, no.7, pp.1409-1422, July 2012[3] Z. Kalal, J. Matas, and K. Mikolajczyk. P-N Learning: Boot-strapping Binary Classifiers by Structural Constraints. IEEE Confer. on Computer Vision and Pattern Recognition, 2010.[4] Z. Kalal, K. Mikolajczyk, and J. Matas. Forward-Backward Error: Automatic Detection of Tracking Failures, Proc. IAPR International Conference on Pattern Recognition, pp. 23-26,2010.[5] Saikat Basak and Arundhuti Chowdhury . A Vision Interface Framework for Intuitive Gesture Recognition using Color based Blob Detection. International Journal of Computer Applications, vol.90, no.15, March 2014


ACHIEVEMENTS

Won Best Paper Award for the paper entitled“Video Interaction Through Finger Tips” in theIEEE International Conference on Circuit, Powerand Computing Technologies (ICCPCT-2015),Kanyakumari, Tamilnadu, on March, 2015

Selected to present paper entitled “Turning Existing Video Contents IntoTransactional Content Marketing” at IEEE and SPRINGER Technically Co-Sponsored Science and Information Conference 2015, LONDON , UK



Thank you for your attention !Questions ?

Video interaction through finger tips

Technology

Transcript of Video interaction through finger tips