Browse > Article
http://dx.doi.org/10.7583/JKGS.2012.12.5.79

A Real-time Hand Pose Recognition Method with Hidden Finger Prediction  

Na, Min-Young (Dept. of Computer Engineering, SeoKyeong University)
Choi, Jae-In (Dept. of Computer Engineering, SeoKyeong University)
Kim, Tae-Young (Dept. of Computer Engineering, SeoKyeong University)
Publication Information
Journal of Korea Game Society / v.12, no.5, 2012 , pp. 79-88 More about this Journal
Abstract
In this paper, we present a real-time hand pose recognition method to provide an intuitive user interface through hand poses or movements without a keyboard and a mouse. For this, the areas of right and left hands are segmented from the depth camera image, and noise removal is performed. Then, the rotation angle and the centroid point of each hand area are calculated. Subsequently, a circle is expanded at regular intervals from a centroid point of the hand to detect joint points and end points of the finger by obtaining the midway points of the hand boundary crossing. Lastly, the matching between the hand information calculated previously and the hand model of previous frame is performed, and the hand model is recognized to update the hand model for the next frame. This method enables users to predict the hidden fingers through the hand model information of the previous frame using temporal coherence in consecutive frames. As a result of the experiment on various hand poses with the hidden fingers using both hands, the accuracy showed over 95% and the performance indicated over 32 fps. The proposed method can be used as a contactless input interface in presentation, advertisement, education, and game applications.
Keywords
Hand Pose Recognition; Hand-based User Interface; Hand Model;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 V.I. Pavlovic, R. Sharma, T.S. Huang, "Visual Interpretation of Hand Gestures for Human-Computer Interaction A Review", IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 677-695, 1997.   DOI   ScienceOn
2 D.Geer, "Will gesture recognition technology point the way", IEEE Computer, vol. 37, no. 10, pp. 20-23, 2004.   DOI
3 M. Tosas and B. Li, "Virtual Touch Screen for Mixed Reality", Proc. European Conference on Computer Vision, Lecture Notes in Computer Science, Prague, Czech Republic, vol. 3058, pp. 48-59, May 2004.
4 B. Stenger, A. Thayananthan, P. Torr, and R. Cipolla, "Hand Pose Estimation Using Hierarchical Detection", Proc. European Conference on Computer Vision, Lecture Notes in Computer Science, Prague, Czech Republic, vol. 3058, pp. 105-116, May 2004.
5 M. Tang. "Hand Gesture Recognition Using Microsoft Kinect", CS228, 2010.
6 S. Mitra and T. Acharya, "Gesture Recognition: A Survey", IEEE Trans. on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 37, no. 3, pp. 311-324, 2007   DOI   ScienceOn
7 Min-su Ko, Ji-sang Yoo, "Histogram Based Hand Recognition System for Augmented Reality", KIICE, vol. 15, no. 7, pp. 1564-1572, 2011.   과학기술학회마을   DOI
8 Min-Young Na, Hyun-Jung Kim, Tae-Young Kim, "An Illumination and Background-Robust Hand Image Segmentation Method Based on the Dynamic Threshold Values", KMMS, vol. 14, no. 5, pp. 607-613, 2011.   과학기술학회마을   DOI
9 S. Malassiotis and M. G. Strintzis, "Real-time hand posture recognition using range data," Image Vision Comput., vol. 26, no. 7, pp. 1027-1037, 2008   DOI   ScienceOn
10 J. Deutscher, A. Blake, and I. Reid, "Articulated Body Motion Capture by Annealed Particle Filtering," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol.2, pp.126-133, June 2000.
11 Martin A. Fischler, Robert C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography", Comm of the ACM vol. 24, no. 6, pp. 381-395, 1981.   DOI   ScienceOn
12 Li Sun, "Hand tracking based on the combination of 2D and 3D model in gaze-directed video", Multimedia and Expo (ICME), pp. 1-6, 2011.
13 Liu Yun, Zhang Lifeng, Zhang Shujun, "A Hand Gesture Recognition Method Based on Multi-Feature and Template Matching", Procedia Engineering vol. 29, pp. 1678-1684, 2012.   DOI