This paper proposes a method to allow applications originally designed for touchscreens to be controlled using infrared remote controls on televisions. The method maps keystrokes on the remote to virtual touch events according to scene recognition of the application. Scene recognition identifies the current part of the application and acquires the corresponding mapping relationship between remote keys and touch events. When tested on a smart TV, the method allowed most applications to be operated remotely with negligible input delay of less than one millisecond.