This document proposes a method to allow applications originally designed for touchscreens to be operated using infrared remote controls on televisions. The method maps keystrokes on the remote to virtual touch events according to scene recognition of the application. Scene recognition identifies the current part of the application and acquires the corresponding mapping relationship between remote keys and touch events. When tested on a smart TV, the method allowed most apps to be used via remote with input delay of less than one millisecond.

1. A VIRTUAL TOUCH EVENT METHOD USING SCENE
RECOGNITION FOR DIGITAL TELEVISION
ABSTRACT
Because of rich applications, smart operating systems on cell phones are now being
migrated to home appliances like televisions. However, applications that are originally
designed to be operated by touch screen are not suitable for televisions with these systems.
This paper presents a method to manipulate applications with infrared remote control instead
of touch screen on televisions without rewriting the code of these applications or adding extra
expense on hardware. The principle of the method is to map keystroke events on the remote
control to virtual touch-based events according to specific mapping relationship
corresponding to each application. Since the mapping relationship is various in each scene
within one application, scenes should be recognized with feature information before the
mapping process. The feature information and the mapping relationship in each scene have
been set up prior to running of the application. When one application is running, the current
scene of the application could be identified by scene recognition algorithm, the mapping
relationship related to the current scene is able to be acquired, and then keystrokes on the
remote control would be mapped to touch based events. The proposed method is tested on a
smart television platform, and the result indicates the method can operate most applications
by remote control, while the input response delay brought by the event mapping is negligibly
less one than millisecond1.
EXISTING SYSTEM
Recently the portable devices, the smart operating systems have been migrated to
household appliances like digital televisions. However, these systems and their applications
which are originally designed to be controlled through touch screen are difficult to be
operated by the traditional remote control of televisions. Most of theapplications need to be
rewritten in order to adapt to remote controls, some methods are devised to enhance the
function of remote controls so that they could simulate the operation of touch user interface
such as Touchpad into a remote control to commit commands and select items on a screen
and a touch screen and a dial knob to a remote control for easy-to-control. Furthermore,
several studies renovate remote controls with entirely new forms are a the laser pointer and a
camera to simulate the movement of the cursor and the operation of mouse in interaction with

2. the target device and The pen-like device uses a 6-axis accelerometer inside the device to
detect hand movements and thereby to cast the pointing event to the object. Furthermore,
several studies of hand gestures to control televisions or other electric appliances were
conducted and thus a remote control was replaced by hand. However, both the enhancements
and the entirely new forms of the remote control will not only increase hardware cost and
energy consumption, but also relatively lower precision of manipulation of the target device.
PROPOSED SYSTEM
In this paper, a cost-effective method reusing traditional infrared remote controls for
digital televisions is proposed. The method maps keystrokes of a remote control to the virtual
touch-based operations like slide and touch on the applications as if they were operated via
touch screen. The virtual touch-based operations are produced by passing commands to the
input subsystem. As a remote control is a kind of keyboard device with limited amount of the
keystrokes, it could not be mapped to every operation of touch available on screen, but it can
be mapped to several touch operations which is sufficient to manipulate applications. By
setting up two kinds of information sets, the keystrokes on the remote control would be
capable of mapping to the touch-based method such as touch, slide, pinch-to-zoom, etc.,
according to the recognition algorithm. This method has a better performance on the
applications related to game than others, because the touch operation on scenes in the game is
relatively simple, and is easy to be simulated with the keystroke events. We implemented our
proposed system through Virtual Button implementation and Notification in Microcontroller
LCD with Home Appliances Control.
HARDWARE REQURIMENT
ZIGBEE
MOTOR DRIVER (L293D)
PC WITH OPEN CV
WEB CAMERA
SOFTWARE REQURIMENT
VISUAL STUDIO
X-CTU

3. BLOCK DIAGRAM
ZIGBEE
MOTOR
DRIVER
(L293D)
ZIGBEE
PC with OpenCV and
Dotnet
Web Camera