Browse > Article
http://dx.doi.org/10.9717/kmms.2013.16.12.1393

A Decision Tree based Real-time Hand Gesture Recognition Method using Kinect  

Chang, Guochao (Department of Electronics Computer Engineering, Chonnam National University)
Park, Jaewan (Department of Electronics Computer Engineering, Chonnam National University)
Oh, Chimin (Department of Electronics Computer Engineering, Chonnam National University)
Lee, Chilwoo (Department of Electronics Computer Engineering, Chonnam National University)
Publication Information
Abstract
Hand gesture is one of the most popular communication methods in everyday life. In human-computer interaction applications, hand gesture recognition provides a natural way of communication between humans and computers. There are mainly two methods of hand gesture recognition: glove-based method and vision-based method. In this paper, we propose a vision-based hand gesture recognition method using Kinect. By using the depth information is efficient and robust to achieve the hand detection process. The finger labeling makes the system achieve pose classification according to the finger name and the relationship between each fingers. It also make the classification more effective and accutate. Two kinds of gesture sets can be recognized by our system. According to the experiment, the average accuracy of American Sign Language(ASL) number gesture set is 94.33%, and that of general gestures set is 95.01%. Since our system runs in real-time and has a high recognition rate, we can embed it into various applications.
Keywords
Hand Gesture Recognition; vision-based; Kinect; Decision tree; HCI;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Starner and A. Pentland, "Real-time American Signlanguage Recognition from Video using Hidden Markov Models," IEEE International Symposium on Computer Vision, pp. 265-270, 1995.
2 F. Ullah, "American Sign Language Recognition System for Hearing Impaired People Using Cartesian Genetic Programming," Proc. the 5th International Conference on Automation, Robotics and Applications, pp. 96-99, 2011.
3 R.Y. Wang and J. Popović, "Real-Time Hand- Tracking with a Color Glove," ACM Transaction on Graphics, Vol. 28, Issus 3, pp. 1-8, 2009.
4 L. Brethes, P. Menezes, F. Lerasle, and J. Hayet, "Face Tracking And Hand Gesture Recognition for Human-Robot Interaction," International Conference on Robotics and Automation, Vol. 2, pp. 1901-1906, 2004.
5 M. Van den Bergh and L. Van Gool, "Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction," Applications of Computer Vision, 2011 IEEE Workshop on, pp. 66-72, 2011.
6 J.M. Rehg and T. Kanade, "Visual Tracking of High DOF Articulated Structures: An Application to Human Hand Tracking," European Conference on Computer Vision, Vol 801, pp. 35-46, 1994.
7 J. PARK and Y.L. YOON, "LED-glove based Interactions in Multi-modal Displays for Teleconferencing," International Conference on Artificial Reality and Telexistence- Workshops, pp. 395-399, 2006.
8 X. Liu and K. Fujimura, "Hand Gesture Recognition using Depth Data," Proc. of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 529-534, 2004.
9 H.J. An, J.S. Lee, and D.J. Kim, "Hand Gesture Recognition System using TOF Camera," HCI Korea, pp. 531-534, 2011.
10 H. Li, L. Yang, X.Y. Wu, S.M. Xu, and Y.W. Wang, "Static Hand Gesture Recognition Based on HOG with Kinect," 4th International Conference on Intelligent Human-Machine Systems and Cybernetic, pp. 271- 273, 2012.
11 l.L. Raheja, A. Chaudhary, and K. Singal, "Tracking of Fingertips and Centers of Palm using KINECT," Third International Conference on Computational Intelligence Modelling Simulation, pp. 248-252, 2011.
12 Z. Ren, J. Yuan, and Z. Zhang, "Robust Hand Gesture Recognition Based on Finger- Earth Mover's Distance with a Commodity Depth Camera," Proc. the 19th ACM International Conference on Mulitimedia, pp. 1093-1096, 2011.
13 H. Zhou and T.S. Huang, "Tracking Articulated Hand Motion with Eigen Dynamics Analysis," Proc. International Conference on Computer Vision, Vol. 2, pp. 1102-1109, 2003.
14 S.S. Rautaray and A. Agrawal, "Vision based Hand Gesture Recognition for Human Computer Interaction: A Survey," Artificial Intelligence Review, pp.1-54, 2012.
15 G. Simion, V. Gui, and M. Otesteanu, "Vision Based Hand Gesture Recognition: A Review," International Journal of Circuits Systems and Signal Processing, Vol. 6, Issue 4, pp. 275-282, 2012.
16 J. Suarea and R.R. Murphy, "Hand Gesture Recognition with Depth Images: A Review," The 21st International Symposium on Robot and Human Interactive Communication, pp. 411-417, 2012.
17 R.L. Graham, "An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set," Information Processing Letters, Vol. 1, No. 4, pp. 132-133, 1972.   DOI   ScienceOn