DOI QR코드

DOI QR Code

Hierarchical Hidden Markov Model for Finger Language Recognition

지화 인식을 위한 계층적 은닉 마코프 모델

  • Kwon, Jae-Hong (Graduate School of Advanced Image Science, Multimedia, and Film, Chung-Ang University) ;
  • Kim, Tae-Yong (Graduate School of Advanced Image Science, Multimedia, and Film, Chung-Ang University)
  • 권재홍 (중앙대학교 첨단영상대학원 영상학과) ;
  • 김태용 (중앙대학교 첨단영상대학원 영상학과)
  • Received : 2015.05.12
  • Accepted : 2015.09.03
  • Published : 2015.09.25

Abstract

The finger language is the part of the sign language, which is a language system that expresses vowels and consonants with hand gestures. Korean finger language has 31 gestures and each of them needs a lot of learning models for accurate recognition. If there exist mass learning models, it spends a lot of time to search. So a real-time awareness system concentrates on how to reduce search spaces. For solving these problems, this paper suggest a hierarchy HMM structure that reduces the exploration space effectively without decreasing recognition rate. The Korean finger language is divided into 3 categories according to the direction of a wrist, and a model can be searched within these categories. Pre-classification can discern a similar finger Korean language. And it makes a search space to be managed effectively. Therefore the proposed method can be applied on the real-time recognition system. Experimental results demonstrate that the proposed method can reduce the time about three times than general HMM recognition method.

지화(finger language)는 수화(sign language)에 포함되며, 손의 제스쳐로 한글의 모음, 자음을 표현하는 언어 체계이다. 한글 지화는 총 31 제스쳐로 구성되어 있으며, 정확한 인식을 위해서는 하나의 제스쳐에 대해 학습 모델이 많이 필요로 하게 된다. 대량의 학습 모델이 존재할 경우, 입력 데이터는 많은 공간을 탐색하는데 시간을 소비하게 된다. 따라서 실시간 인식 시스템은 이러한 탐색 공간을 줄이는 것이 가장 중요한 문제로 인식되고 있다. 본 논문에서는 이러한 문제를 해결하기 위해 인식률 저하 없이 탐색 공간을 효율적으로 줄이는 계층적 HMM 구조를 제안하였다. 지화는 손목의 방향성에 따라 총 3개의 범주로 설정, 입력 데이터는 이 범주 안에서 모델을 검색하게 된다. 이러한 사전 분류를 진행하여 비슷한 한글 지화의 분별력을 확립하게 되며 탐색 공간 또한 효율적으로 관리되므로 실시간 인식 시스템에 적용 가능하다. 실험 결과, 제안된 방법은 일반적인 HMM 인식 방법보다 평균 3배 정도의 시간을 단축할 수 있있고, 비슷한 한글 지화 제스쳐에 대해 오인식 또한 감소하였다.

Keywords

References

  1. Kazuyuki Imagawa, Shan Lu, "Color-Based Hands Tracking System for Sign Language Recognition", Automatic Face and Gesture Recognition IEEE International Conference, pp. 462-467, 1998.
  2. Ji-Hwan Kim, Tae-Seong Kim, "3-D Hand Motion Tracking and Gesture Recognition Using a Data Glove", IEEE International Symposium on Industrial Electronics, pp. 1013-1018, 2009.
  3. Jakub segen, Senthil Kumar, "Shadow Gestures:3D Hand Pose Estimation Using a Single Camera,", IEEE Computer Society Conference on, Vol. 1, pp. 479-485, 1999.
  4. Manjula, Waldron, Soowon Kim, "Isolated ASL Sign Recognition System for Deaf persons", Rehabilitation Engineering, IEEE Transactions on, Vol. 3, pp. 261-271, 1995. https://doi.org/10.1109/86.413199
  5. Yamaguchi, "Japanese sign language recognition system using information infrastructure", International Joint Conference of the Fourth IEEE International Conference on Fuzzy Systems and The Second International Fuzzy Engineering Symposium, Vol. 5, pp. 65-66, 1995.
  6. Seungki Min, Sanghyeok Oh, Gyoryeong Kim, Taehyun Yoon, Chungyu Lim, Yunli Lee, Keechul Jung, "Optimize Data Glove-based System for Korean Finger Spelling Recognition", Korea Computer Congress, Vol. 34, pp. 237-241, 2007.
  7. Yang HeeDeok, Lee Seong-Whan, "Automatic Spotting of Sign and Fingerspelling for Continuous Sign Language Recognition", The Korean Institute of Information Scientists and Engineers, Vol. 38, pp 102-107, 2011.
  8. Min-Ji Kang, Eun-Sook Choi, Sohn Young-Sun, "The Study on Dynamic Images Processing for Finger Languages", Korean Institute of Intelligent Systems, Vol 14, pp. 184-189, 2004. https://doi.org/10.5391/JKIIS.2004.14.2.184
  9. Frank Weichert, "Analysis of the Accuracy and Robustness of the Leap Motion Controller", Sensors, Vol. 13, pp. 6380-6393, 2013. https://doi.org/10.3390/s130506380
  10. Lawrence Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition." Proceedings of the IEEE, Vol 77, pp. 257-286, 1989. https://doi.org/10.1109/5.18626
  11. Yoon, H. S., Soh, J., Bae, Y. J., & Yang, H. S. "Hand gesture recognition using combined features of location, angle and velocity." Pattern recognition, Vol. 34, pp. 1491-1501, 2001. https://doi.org/10.1016/S0031-3203(00)00096-0
  12. Lee Hyung-Ji, Woo-Kyu Lee, Jae-Ho Chung, "Extracting feature vectors for hand gesture recognition of sign language", The Institute of Electronics and Information Engineers, Vol. 11, pp. 895-898, 1998.
  13. Nianjun Liu, Brian C. Lovel, Peter J, Kootsookos, Richard I.A. Davis, "Model structure selection & training algorithms for an HMM gesture recognition system.", Frontiers in Handwriting Recognition, Ninth International Workshop on. IEEE, pp. 100-105, 2004.
  14. Oh Il-Seok, "Pattern Recognition", Kyobo library, pp. 349-354, 2008.