FPGA-based Hardware Prediction Rendering for Low-Latency Touch Platform

Abstract

The delay between input action and visual interface feedback ("Latency") in a touchscreen inking task reduces the user's performance. When the latency is less than 2.38ms, the user cannot perceive the latency in dragging task. This value is difficult to achieve on recent touchscreens and general purpose computers. So, methods of predicting touch points to reduce perceptible latency has been proposed. In general, touch points prediction is not perfect. When using point prediction, feedback of the predicted points is displayed on the screen, after a while, erased when the actual points are displayed. When this task is implemented by software, it causes additional latency to work to erase predicted points feedback. It therefore propose a platform for rendering point prediction feedback without additional latency by the FPGA. This platform transmits input points and HDMI signals rendering feedback of input points to the FPGA. The FPGA draws the feedback of points predicted based on the input points on the HDMI and displays the screen. Since hardware rendering changes the HDMI signal every frame, it does not require erasing work and rendering can be done within an early time regardless of the amount of rendering, so we will reduce the latency.

Fig. 1. System configuration diagram.

Fig. 2. Software rendering.

Fig. 3. Software rendering and hardware prediction rendering.

Fig. 4. Touch point predict algorithm.

Table. 1. Latency differences between hardware prediction line rendering and software prediction line rendering.