A VIRTUAL TOUCH EVENT METHOD USING SCENE RECOGNITION FOR DIGITAL TELEVISION

ABSTRACT

Because of rich applications, smart operating systems on cell phones are now being

migrated to home appliances like televisions. However, applications that are originally

designed to be operated by touch screen are not suitable for televisions with these systems.

This paper presents a method to manipulate applications with infrared remote control instead

of touch screen on televisions without rewriting the code of these applications or adding extra

expense on hardware. The principle of the method is to map keystroke events on the remote

control to virtual touch-based events according to specific mapping relationship

corresponding to each application. Since the mapping relationship is various in each scene

within one application, scenes should be recognized with feature information before the

mapping process. The feature information and the mapping relationship in each scene have

been set up prior to running of the application. When one application is running, the current

scene of the application could be identified by scene recognition algorithm, the mapping

relationship related to the current scene is able to be acquired, and then keystrokes on the

remote control would be mapped to touch based events. The proposed method is tested on a

smart television platform, and the result indicates the method can operate most applications

by remote control, while the input response delay brought by the event mapping is negligibly

less one than millisecond1.

EXISTING SYSTEM

Recently the portable devices, the smart operating systems have been migrated to

household appliances like digital televisions. However, these systems and their applications

which are originally designed to be controlled through touch screen are difficult to be

operated by the traditional remote control of televisions. Most of theapplications need to be

rewritten in order to adapt to remote controls, some methods are devised to enhance the

function of remote controls so that they could simulate the operation of touch user interface

such as Touchpad into a remote control to commit commands and select items on a screen

and atouch screen and a dial knob to a remote control for easy-to-control. Other methods on

the haptic interface on the handheld devices. Furthermore, several studies renovate remote

controls with entirely new forms are a the laser pointer and a camera to simulate the

movement of the cursor and the operation of mouse in interaction with the target device and

The pen-like device uses a 6-axis accelerometer inside the device to detect hand movements

and thereby to cast the pointing event to the object.Furthermore, several studies of hand

gestures to control televisions or other electric appliances were conducted and thus a remote

control was replaced by hand. However, both the enhancements and the entirely new forms of

the remote control will not only increase hardware cost and energy consumption, but also

relatively lower precision of manipulation of the target device.

PROPOSED SYSTEM

In this paper, a cost-effective method reusing traditional infrared remote controls for

digital televisions is proposed. The method maps keystrokes of a remote control to the virtual

touch-based operations like slide and touch on the applications as if they were operated via

touch screen. The virtual touch-based operations are produced by passing commands to the

input subsystem.As a remote control is a kind of keyboard device with limited amount of the

keystrokes, it could not be mapped to every operation of touch available on screen, but it can

be mapped to several touch operations which is sufficient to manipulate applications.By

setting up two kinds of information sets, the keystrokes on the remote control would be

capable of mapping to the touch-based method such as touch, slide, pinch-to-zoom, etc.,

according to the recognition algorithm. This method has a better performance on the

applications related to game than others, because the touch operation on scenes in the game is

relatively simple, and is easy to be simulated with the keystroke events.We implemented our

proposed system through Virtual Button implementation and Notification in Microcontroller

LCD with Home Appliances Control.

BLOCK DIAGRAM

HARDWARE REQURIMENT

ZIGBEEMOTOR DRIVER(L293D)

PC with OpenCV and Dotnet

ZIGBEE

Web Camera

ZIGBEE

MOTOR DRIVER (L293D)

PC WITH OPEN CV

WEB CAMERA

SOFTWARE REQURIMENT

VISUAL STUDIO

X-CTU