Browse > Article
http://dx.doi.org/10.5392/JKCA.2011.11.10.001

Skin Color Based Hand and Finger Detection for Gesture Recognition in CCTV Surveillance  

Kang, Sung-Kwan (인하대학교 정보공학과)
Chung, Kyung-Yong (상지대학교 컴퓨터정보공학부)
Rim, Kee-Wook (선문대학교 컴퓨터정보공학부)
Lee, Jung-Hyun (인하대학교 컴퓨터정보공학부)
Publication Information
The Journal of the Korea Contents Association / v.11, no.10, 2011 , pp. 1-10 More about this Journal
Abstract
In this paper, we proposed the skin color based hand and finger detection technology for the gesture recognition in CCTV surveillance. The aim of this paper is to present the methodology for hand detection and propose the finger detection method. The detected hand and finger can be used to implement the non-contact mouse. This technology can be used to control the home devices such as home-theater and television. Skin color is used to segment the hand region from background and contour is extracted from the segmented hand. Analysis of contour gives us the location of finger tip in the hand. After detecting the location of the fingertip, this system tracks the fingertip by using only R channel alone, and in recognition of hand motions to apply differential image, such as the removal of useless image shows a robust side. We explain about experiment which relates in fingertip tracking and finger gestures recognition, and experiment result shows the accuracy above 96%.
Keywords
Fingetip Detection; Ubiquitous Computing; Interaction; CCTV Surveillance;
Citations & Related Records
연도 인용수 순위
  • Reference
1 W. Z. Gang and Z. D. Fang1, "Application of Visualization Technology in Spatial Data Mining," Computer Engineering, Vol.33, No.18, pp.67-71, 2009.
2 Argus Center for Information Architecture, http://argus-acia.com/strange_connections/.
3 N. Shimada, K. Kimura, and Y. Shirai, "Real-Time 3D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera," In Proc. of Int. WS on RATFG-RTS, pp.23-30, 2001.
4 K. G. Derpanis, "A Review of Vision-Based Hand Gestures," Report, York Univ, 2004
5 Z. Jin, Visualization for Information Retrieval, Springer, 2008.
6 A. Jaimes and N. Sebe, "Multimodal Human Computer Interaction: A Survey," Computer Vision and Image Understanding, Vol.108, Issue1-2, pp.116-134, 2007.   DOI   ScienceOn
7 M. Cabral, M. Zuffo, S. Ghirotti, O. Belloc, L. Nomura, M. Nagamura, F. Andrade, R. Faria, and L Ferraz, "An Experience using X3D for Virtual Cultural Heritage," In Proc. of the Int. Conference on 3D Web Technology, pp.161-164, 2007.
8 A. Jaimes and N. Sebe, "Multimodal Human-Computer Interaction," Computer Vision and Image Understanding, Vol.108, pp.116-134, 2007.   DOI   ScienceOn
9 K. Y. Jung and J. H. Lee, "User Preference Mining through Hybrid Collaborative Filtering and Content-based Filtering in Recommendation System," IEICE Tran. on Information and Systems, Vol.E87-D, No.12, pp.2781-2790, 2004.
10 P. A. Chirita, A. Damian, W. Nejdi, and W. Siberski, "Search Strategies for Scientific Collaboration Networks," In Proc. of the ACM Workshop on Information Retrieval in Peer-to-Peer Networks, 2005.
11 Y. Wu and T. S. Huang, "Hand Modeling, Analysis and Recognition," IEEE Signal Processing Magazine, Vol. 18, Issue 3, pp.51-60, 2001.   DOI   ScienceOn
12 Y. Wu, T. S. Huang, "Vision-Based Gesture Recognition: A Review," In Proc. of the Int. Workshop on Gesture-Based Communication in HCI, pp.103-115, Springer, 1999.
13 R. C. Gonzalez and R. E. Woods, Digital Image Processing, Prentice Hall, pp.168-201, 2001.
14 J. Lee and T. Kunii, "Model-based Analysis of Hand Posture," IEEE Comput. Graph. Appl., Vol.15, No.5, pp.77-86, 1995.   DOI   ScienceOn
15 C. Vogler and D. Metaxas, "Towards scalability in ASL Recognition: Breaking Down Signs into Phonemes," in Gesture Workshop, pp.17-99, 1999.
16 Y. Wu and T. S. Huang, "Capturing Articulated Human Hand Motion: A Divide-Andconquer approach," In Proc. IEEE Int. Conf. Computer Vision, Corfu, Vol.1, pp.606-611, 1999.   DOI
17 H. Fillbrandt, S. Akyol, and K. F. Kraiss, "Extraction of 3D Hand Shape and Posture from Image Sequences for Sign Language Recognition," IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, Vol.17, No.10, pp.181-186, 2003.   DOI
18 C. H. The and R. T. Chin, "On Image Analysis by the Methods of Moments," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.10, No.4, pp.496-513, 1988.   DOI   ScienceOn
19 J. Davis, M. Shah, "Visual Gesture Recognition," In Proc. of Vision, Image, and Signal, Vol.141, No.8, pp.101-106, 1994.   DOI   ScienceOn
20 B. A. Meza, M. Nagarajan, C. Ramakrishnan, L. Ding, P. Kolari, A. P. Sheth, I. B. Arpinar, A. Joshi, and T. Finin, "Semantic Analytics on Social Networks: Experiences in Addressing the Problem of Conflict of Interest Detection," In Proc. of the International Conference on World Wide Web, 2006.
21 T. Pavlidis. Algorithms for Graphics and Image Processing, Computer Science, pp.143-160, 1982.
22 V. I. Pavlovic, R. Sharma, and T. S. Huang, "Visual Interpretation of Hand Gestures for Human Computer Interaction," IEEE Trans. on Pattern Recognition and Machine Intelligence, Vol.19 issue7, pp.677-695, 1997.   DOI   ScienceOn