Browse > Article
http://dx.doi.org/10.3745/KTSDE.2013.2.3.199

An Implementation of Real-Time Numeral Recognizer Based on Hand Gesture Using Both Gradient and Positional Information  

Kim, Ji-Ho ((주)JVM 연구소)
Park, Yang-Woo (경운대학교 모바일공학과)
Han, Kyu-Phil (금오공과대학교 컴퓨터공학과)
Publication Information
KIPS Transactions on Software and Data Engineering / v.2, no.3, 2013 , pp. 199-204 More about this Journal
Abstract
An implementation method of real-time numeral recognizer based on gesture is presented in this paper for various information devices. The proposed algorithm steadily captures the motion of a hand on 3D open space with the Kinect sensor. The captured hand motion is simplified with PCA, in order to preserve the trace consistency and to minimize the trace variations due to noises and size changes. In addition, we also propose a new HMM using both the gradient and the positional features of the simplified hand stroke. As the result, the proposed algorithm has robust characteristics to the variations of the size and speed of hand motion. The recognition rate is increased up to 30%, because of this combined model. Experimental results showed that the proposed algorithm gives a high recognition rate about 98%.
Keywords
Kinect; Principal Component Analysis; HMM; Numeral Recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 D. Hong, W. Woo, "Recent Research Trend of Gesture-based User Interfaces," Telecommunications Review, Vol.18, No.3, pp.403-413, 2008.
2 A. Sears, J. Feng, K. Oseitutu, and C.-M. Karat, "Hands-Free, Speech-Based Navigation During Dictation: Difficulties, Consequences, and Solutions," Human-Computer Interaction Journal, Vol.18, No.3, pp.229-257, 2003.   DOI   ScienceOn
3 D. J. Sturman and D. Zeltzer, "A Survey of Glove-based Input," IEEE Computer Graphics and Applications, Vol.14, No.1, pp.30-39, 1994.   DOI   ScienceOn
4 T. B. Moeslund and E. Granum, "A Survey of Computer Vision-Based Human Motion Capture," Computer Vision and Image Understanding, Vol.81, No.3, pp.231-268, 2001.   DOI   ScienceOn
5 J. Yun, C. Lee, "Design of Computer Vision Interface by Recognizing Hand Motion," Journal of IEEK, Vol.47, No.3, pp.256-265, 2010.
6 http://www.xbox.com/ko-KR/Kinect
7 http://www.openni.org/
8 Y. Jang, J. Park, "A Development on Gesture Recognition Interface System and Non-Contact Mouse Device Using a Stereo Camera," Journal of KIIT, Vol.7 No.3, pp.244-252, 2009.
9 L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, Vol.77, No.2, pp.257-286, Feb., 1989.   DOI   ScienceOn
10 M. Elmezain, A. Al-Hamadi, B. Michaelis, "Hand Trajectory-based Gesture Spotting and Recognition Using HMM," IESK Conference, pp.3577-3580, 2009.
11 H. Yoon, J. Soh, B. Min, "Alphabetical Gesture Recognition using HMM," KIISE, Vol.25, No.2, pp.384-386, 1998.
12 A. Weingessel and K. Hornik, "Local PCA Algorithms," IEEE Transactions on Neural Networks, Vol.11, No.6, pp.1242-1250, Nov., 2000.   DOI   ScienceOn
13 A. M. Martinez and A. C. Kak, "PCA versus LDA", IEEE Trans. on PAMI, Vol.23, No.2, pp.228-233, Feb., 2001.   DOI   ScienceOn
14 H. Lee, J. Kim, "An HMM-based threshold model approach for gesture recognition," IEEE Trans. on PAMI, Vol.21, pp.961-973, 1999.   DOI   ScienceOn
15 D. Kim, J. Song, and D. Kim, "Simultaneous Gesture Segmentation and Recognition Based on Forward Spotting Accumlative HMMs," Pattern Recognition, Vol.40, pp.3012-3026, 2007.   DOI   ScienceOn
16 T. Wakahara and H. Murase, "On-Line Handwriting Recognition," Proceedings of the IEEE, Vol.80, No.7, pp.1181-1194, July, 1992.   DOI   ScienceOn
17 http://web.mit.edu/-rsalakhu/www/DBM.html, Matlab source code provided by Ruslan Salakhutdinov
18 http://www.ee.columbia.edu/-dpwe/resources/matlab/dtw/, Matlab source code provided by Dan Ellis