Journal of the Korean Institute of Intelligent Systems (한국지능시스템학회논문지)

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Recognition of Natural Hand Gesture by Using HMM

HMM을 이용한 자연스러운 손동작 인식

  • Received : 2012.04.20
  • Accepted : 2012.08.18
  • Published : 2012.10.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a method that gives motion command to a mobile robot to recognize human being's hand gesture. Former way of the robot-controlling system with the movement of hand used several kinds of pre-arranged gesture, therefore the ordering motion was unnatural. Also it forced people to study the pre-arranged gesture, making it more inconvenient. To solve this problem, there are many researches going on trying to figure out another way to make the machine to recognize the movement of the hand. In this paper, we used third-dimensional camera to obtain the color and depth data, which can be used to search the human hand and recognize its movement based on it. We used HMM method to make the proposed system to perceive the movement, then the observed data transfers to the robot making it to move at the direction where we want it to be.

본 논문에서는 모바일 로봇이 자연스러운 손동작을 은닉 마르코프 모델(HMM: hidden markov model)을 이용하여 인식해 원하는 명령을 수행하는 방법을 제안한다. 기존의 손동작 기반 로봇 제어 방식은 정해진 몇 종류의 제스처를 사용했었고, 따라서 지시동작이 자연스럽지 않았다. 또한 정해진 제스처를 미리 공부해야하여 불편했었다. 이러한 문제를 해결하기 위해 손동작을 인식하는 방법에 대한 많은 연구가 활발히 진행되고 있다. 본 논문에서는 3차원 카메라를 사용해 색상 데이터와 깊이 데이터를 얻어서, 사람의 손을 검색하고 그 동작을 인식한다. 여기서 동작을 인식하는 방법으로 HMM을 사용하였으며, 인식된 결과를 로봇에게 전달하여 원하는 방향으로 이동시킨다.

Keywords

References

  1. Youngrae Kim, Eun Yi Kim, Jae Sik Chang, and Se Hyun Park, "Mobile Robot Control using Hand Shape Recognition," Journal of Korean Electrical Engineering, vol. 45, no. 4, pp. 34-40, 2008.
  2. In Cheol Kim, "Recognition of 3D gesture using partially tuned composited hidden Markov models," International Journal of Fuzzy Logic and Intelligent Systems, vol. 4, no. 2, pp. 236-240, 2004. https://doi.org/10.5391/IJFIS.2004.4.2.236
  3. Seok-Ju Hong, and Chil-Woo Lee, "Human-Computer Interaction Survey for Intelligent Robot," The Korea Contents Society, vol. 4, no. 2, pp. 507-511, 2006.
  4. Jong-Ho Kim, Yo-Seop Yun, Tae-Young Kim and Cheol-Su Lim, "Human Primitive Motion Recognition Based on the Hidden Markov Models." Journal of Korea Multimedia Society, vol. 12, no. 4, 2009.
  5. Il-Myung Kim, Wan-Cheol Kim, Kyoung-Sil Yun and Jang-Myung Lee, "Navigation of a Mobile Robot Using Hand Gesture Recognition," Journal of Control, Automation and Systems Engineering, vol. 8, no. 7, pp. 599-606, 2002. https://doi.org/10.5302/J.ICROS.2002.8.7.599
  6. Chang-Duck Lee, Chil-Sung Im, Young-Taek Shim and Jin-Sook Won, Narration Research for Happy Life, 2000.
  7. Sang-Kyoon Kim, "Gesture Recognition using MHI Shape Information," Korean Society of Computer Information, vol. 16, no. 4, pp. 1-13, 2011. https://doi.org/10.9708/jksci.2011.16.4.001
  8. Hee-Deok Yang, A-Yeon Park, and Seong-Whan Lee, "Gesture Spotting and Recognition for Human -Robot Interaction," IEEE Transactions on Robots, vol. 23, no. 2, pp. 256-270, 2007. https://doi.org/10.1109/TRO.2006.889491
  9. Akihiro Mimura, Shinichi Nishibe and Shohei Kato, "Kinetic Chained Throwing Humanoid Robots using Reinforcement Learning," Proceedings of 12th International Symposium on Advanced Intelligent Systems, pp. 188-191, 2011.
  10. Akinori Wakabayashi, Satona Motomura and Shohei Kato, "Body Movement Control System for Humanoid Robot Based on Associative Motion Generation," Proceedings of 12th International Symposium on Advanced Intelligent Systems, pp. 192-195, 2011.
  11. M. Elmezain, A. Al-Hamadi, J. Appenrodt and B. Michaelis, "A Hidden Markov Model-Based Continuous Gesture Recognition System for Hand Motion Trajectory," ICPR 2008, pp. 1-4, 2008.

Cited by

  1. A Study on Hand Region Detection for Kinect-Based Hand Shape Recognition vol.18, pp.3, 2013, https://doi.org/10.5909/JBE.2013.18.3.393
  2. Robust Video-Based Barcode Recognition via Online Sequential Filtering vol.14, pp.1, 2014, https://doi.org/10.5391/IJFIS.2014.14.1.8
  3. 8-Straight Line Directions Recognition Algorithm for Hand Gestures Using Coordinate Information vol.13, pp.9, 2015, https://doi.org/10.14400/JDC.2015.13.9.259
  4. Interface Correction Method for Motion Recognition Game using Kinect vol.15, pp.3, 2015, https://doi.org/10.7583/JKGS.2015.15.3.135
  5. Development of a Robotic Hand using Shape Memory Alloy Actuators vol.26, pp.2, 2016, https://doi.org/10.5391/JKIIS.2016.26.2.147