Browse > Article
http://dx.doi.org/10.3837/tiis.2015.02.016

A Novel Method for Hand Posture Recognition Based on Depth Information Descriptor  

Xu, Wenkai (Department of Information Communications and Engineering, University of Tongmyong)
Lee, Eung-Joo (Department of Information Communications and Engineering, University of Tongmyong)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.9, no.2, 2015 , pp. 763-774 More about this Journal
Abstract
Hand posture recognition has been a wide region of applications in Human Computer Interaction and Computer Vision for many years. The problem arises mainly due to the high dexterity of hand and self-occlusions created in the limited view of the camera or illumination variations. To remedy these problems, a hand posture recognition method using 3-D point cloud is proposed to explicitly utilize 3-D information from depth maps in this paper. Firstly, hand region is segmented by a set of depth threshold. Next, hand image normalization will be performed to ensure that the extracted feature descriptors are scale and rotation invariant. By robustly coding and pooling 3-D facets, the proposed descriptor can effectively represent the various hand postures. After that, SVM with Gaussian kernel function is used to address the issue of posture recognition. Experimental results based on posture dataset captured by Kinect sensor (from 1 to 10) demonstrate the effectiveness of the proposed approach and the average recognition rate of our method is over 96%.
Keywords
Hand posture recognition; 3-D information; coding facet; pooling facets; SVM;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Brandon Paulson, Danielle Cummings and Tracy Hammond, "Object interaction detection using hand posture cues in an office setting," International Journal of Human-Computer Studies, vol. 69, issues.1-2, pp. 19-29, 2011.   DOI
2 N. Pugeault and R. Bowden, "Spelling it out: Real-time ASL fingerspelling recognition," in Proc. of IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 1114-1119, 2011.
3 Ravikiran J., Kavi Mahesh, SuhasMahishi , Dheeraj R., Sudheender S., Nitin V.Pujari, "Finger detection for sign language recognition," in Proc. of International MultiConference of Engineers & Computer Scientists,pp. 18-20, January 2009.
4 G. Murthy and R. Jadon, "Hand gesture recognition using neural networks," in Proc. of IEEE Advance Computing Conference, pp. 134-138, Feb. 19-20, 2010.
5 E. Sanchez-Nielsen, L. Anton-Canalis and M. Hernandez-Tejera, "Hand gesture recognition for human-machine interaction," Journal of WSCG, vol. 12, no. 1-3, pp. 2-6, 2004.
6 WenkaiXu and EungJoo Lee, "Continuous Gesture Trajectory Recognition System based on Computer Vision," International Journal of Applied Mathematics & Information Science, vol.6, no.2S, pp.339s-346s, 2012.
7 N. Silberman, D. Hoiem, P. Kohil and R. Fergus, "Indoor Segmentation and Support Inference from RGBD Image," in Proc. of 12th European Conference on Computer Vision, pp. 746-760, 2012.
8 X. Liu and K. Fujimura, "Hand Gesture Recognition using Depth Data," in Proc. of International Conference on Automatic Face and Gesture Recognition, pp. 529-534, 2004.
9 Myung-CheolRoh, Ho-Keun Shin and Seong-Whan Lee, "View-independent human action recognition with Volume Motion template on single stereo camera," Patter Recognition Letter, vol. 31, no. 7, pp. 639-647, May 2010.   DOI
10 Z. Ren, J. Yuan and Z. Zhang, "Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera," in Proc. of 19th ACM International Conference on Multimedia, pp. 1093-1096, 2011.
11 Z. Ren, J. Yuan, C. Li and W. Liu, "Minimum near-convex decomposition for robust shape representation," in Proc. of IEEE International Conference on Computer Vision, pp. 303-310, 2011.
12 M. Van den Bergh and L. Van Gool, "Combining RGB and ToF cameras for real-time 3-D hand gesture interaction," in Proc. of IEEE Workshop on Applications of Computer Vision, pp. 66-72, 2011.
13 P. Garg, N. Aggarwal and S. Sofat, "Vision based hand gesture recognition," World Academy of Science, Engineering and Technology, vol. 3, pp. 972-977, January 28, 2009.
14 C. Shan, T. Tan and Y. Wei, "Real-time hand tracking using a mean shift embedded particle filter," Pattern Recognition, vol. 40, no. 7, pp. 1958-1970, 2007.   DOI
15 P. Breuer, C. Eckes and S. Muller, "Hand Gesture Recognition with a novel IR Time-of-Flight Range Camera-A pilot study," in Proc. of 3rdInternational Conference of MIRAGE, France, pp. 247-260, March 28-30, 2007.
16 G. Murthy and R. Jadon, "A review of vision based hand gestures recognition," in Proc. of International Journal of Information Technology, vol. 2, no. 2, pp. 405-410, 2009.
17 Shikha Gupta, JafreezalJaafar, Wan Fatimah Wan Ahmad, "Static Hand Gesture Recognition Using Local Gabor Filter," Procedia Engineering, vol. 41, pp. 827-832, 2012.   DOI
18 Y. Li, "Hand gesture recognition using Kinect," in Proc. of IEEE 3rd International Conference on Software Engineering and Service Science, pp. 196-199, June 22-24, 2012.
19 Z. Ren, J. Yuan and Z. Zhang, "Robust gesture based on finger-earth mover's distance with a commodity depth camera," in Proc. of the 19th ACM International Conference on Multimedia, pp. 1093-1096, 2011.
20 C.J. C. Bruges, "A Tutorial on Support Vector Machines for Pattern Recognition," Data Mining and Knowledge Discovery, vol. 2, Issue 2, pp. 121-167, 1998.   DOI
21 X. Yang, C. Zhang and Y. Tian, "Recognizing Actions Using Depth Motion Maps-based Histograms of Oriented Gradients," in Proc. of International Conference on ACM Multimedia, pp. 1057-1060, 2012.
22 Hui Li, "Static Hand Gesture Recognition Based on HOG with Kinect," in Proc. of 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics, Nanchang, China, pp. 271-273, 26-27 Aug. 2012.
23 B.Stenger, "Template-based hand pose recognition using multiplecues," in the Proc. of 7th Asian Conference on Computer Vision, pp. 551-560, January 13-16, 2006.