Browse > Article
http://dx.doi.org/10.3837/tiis.2015.01.023

Implementation of Gesture Interface for Projected Surfaces  

Park, Yong-Suk (Contents Convergence Research Center, Korea Electronics Technology Institute)
Park, Se-Ho (Contents Convergence Research Center, Korea Electronics Technology Institute)
Kim, Tae-Gon (Contents Convergence Research Center, Korea Electronics Technology Institute)
Chung, Jong-Moon (School of Electrical and Electronic Engineering, Yonsei University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.9, no.1, 2015 , pp. 378-390 More about this Journal
Abstract
Image projectors can turn any surface into a display. Integrating a surface projection with a user interface transforms it into an interactive display with many possible applications. Hand gesture interfaces are often used with projector-camera systems. Hand detection through color image processing is affected by the surrounding environment. The lack of illumination and color details greatly influences the detection process and drops the recognition success rate. In addition, there can be interference from the projection system itself due to image projection. In order to overcome these problems, a gesture interface based on depth images is proposed for projected surfaces. In this paper, a depth camera is used for hand recognition and for effectively extracting the area of the hand from the scene. A hand detection and finger tracking method based on depth images is proposed. Based on the proposed method, a touch interface for the projected surface is implemented and evaluated.
Keywords
Interactive surface; natural user interface; gesture recognition; finger tracking; image projector; depth camera;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. P. Kumar and O. Pandithurai, "Sixth sense technology," in Proc. of 2013 Int. Conf. on Information Communication and Embedded Systems (ICICES), pp. 947-953, February 21-22, 2013.
2 P. Song, S. Winkler, S. O. Gilani and Z. Zhou, "Vision-based projected tabletop interface for finger interactions," in Proc. of IEEE Int. Workshop Human-Computer Interaction (HCI) 2007, pp. 49-58, October 20, 2007.
3 M. Lech and B. Kostek, "Gesture-based computer control system applied to the interactive whiteboard," in Proc. of 2010 2nd Int. Conf. on Information Technology (ICIT), pp. 75-78, June 28-30, 2010.
4 H. Goto, Y. Kawasaki and A. Nakamura, "Development of an information projection interface using a projector-camera system," in Proc. of 19th IEEE Int. Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 50-55, September 13-15, 2010.
5 S. A. H. Shah, A. Ahmed, I. Mahmood and K. Khurshid, "Hand gesture based user interface for computer using a camera and projector," in Proc. of 2011 IEEE Int. Conf. on Signal and Image Processing Applications (ICSIPA), pp. 168-173, November 16-18, 2011.
6 B. Zeng, G. Wang and X. Lin, "A hand gesture based interactive presentation system utilizing heterogeneous cameras," Tsinghua Science and Technology, vol. 17, no. 3, pp. 329-336, June, 2012.   DOI
7 J. Hu, G. Li, X. Xie, Z. Lv and Z. Wang, "Bare-fingers touch detection by the button's distortion in a projector-camera system," IEEE Trans. on Circuits and Systems for Video Technology, pp. 566-575, vol. 24, no. 4, April, 2014.   DOI
8 H. Tang, P. Chiu and Q. Liu, "Gesture viewport: Interacting with media content using finger gestures on any surface," in Proc. of 2014 IEEE Int. Conf. on Multimedia and Expo Workshops (ICMEW), pp. 1-2, July 14-18, 2014.
9 A. Rosenfeld and J. Pfaltz, "Sequential operations in digital picture processing," Journal of the ACM, vol. 13, no. 4, pp. 471-494, October, 1966.   DOI
10 K. Wu, E. Otoo, and K. Suzuki, "Optimizing two-pass connected-component labeling algorithms," Pattern Analysis and Applications, vol. 12, no. 2, pp. 117-135, June, 2009.   DOI
11 A. Rosenfeld and E. Johnson, "Angle detection on digital curves," IEEE Transactions on Computers, vol. C-22, no. 9, pp. 875-878, September, 1973.   DOI
12 M. A. Fischler and R. C. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography," Comm. of the ACM, vol. 24, no. 6, pp. 381-395, June, 1981.   DOI
13 J. Dai and C. R. Chung, "Touchscreen everywhere: on transferring a normal planar surface to a touch-sensitive display," IEEE Trans. on Cybernetics, pp. 1383-1396, vol. 44, no. 8, August, 2014.   DOI
14 H. Xu, D. Iwai, S. Hiura and K. Sato, "User interface by virtual shadow projection," in Proc. of SICE-ICASE International Joint Conference 2006, pp. 4814-4817, October 18-21, 2006.