DOI QR코드

DOI QR Code

Implementation of Game Interface using Human Head Motion Recognition

사람의 머리 모션 인식을 이용한 게임 인터페이스 구현

  • 이사무엘 (군산대학교 컴퓨터정보공학과) ;
  • 이창우 (군산대학교 컴퓨터정보공학과)
  • Received : 2014.09.16
  • Accepted : 2014.10.16
  • Published : 2014.10.30

Abstract

Recently, various contents using human motion are developed in computer vision and game industries. If we try to apply human motion to application programs and contents, users can experience a sense of immersion getting into it so that the users feel a high level of satisfaction from the contents. In this research, we analyze human head motion using images captured from an webcam and then we apply the result of motion recognition to a game without special devices as an interface. The proposed method, first, segments human head region using an image composed of MHI(Motion History Image) and the result of skin color detection, and then we calculate the direction and distance by the MHI sequence. In experiments, the proposed method for human head motion recognition was tested for controlling a game player. From the experimental results we proved that the proposed method can make a gammer feel more immersed into the game. Furthermore, we expect the proposed method can be an interface of a serious game for medical or rehabilitation purposes.

최근 컴퓨터 비젼이나 게임과 같은 분야에서 사람의 모션을 이용한 다양한 콘텐츠들이 개발되고 있다. 모션을 이용하여 콘텐츠를 제작하거나 응용프로그램을 개발하게 되면, 사용자는 게임이나 콘텐츠에 더욱 몰입감을 느낄 수 있고, 그에 따른 콘텐츠 사용의 만족도가 향상된다. 본 논문에서는 웹 카메라를 이용해서 캡처한 영상으로부터 모션을 인식하고, 이를 별도의 장비 없이 게임의 인터페이스로 활용할 수 있는 방법을 개발한다. 제안된 방법은 MHI(Motion History Image)와 피부색 검출 결과를 결합하여 입력영상으로부터 사람의 머리 부분을 분할하고, MHI 시퀀스(Sequence)를 이용하여 방향과 이동거리를 계산한다. 실험결과에서 제안된 사람의 머리 모션 인식 결과를 실제 게임에 적용하여 게임 캐릭터를 제어하기 위해 사용하였다. 제안된 방법은 사용자의 몰입감 정도를 향상시킬 수 있음을 증명하였고, 그로인해 기능성 게임의 사용자 인터페이스로의 가능성을 확인하였다.

Keywords

References

  1. J. Pyy, "Applicability of Web Camera and Motion Detection for Controlling Computer Games," Master Thesis, AALTO University, 2010.
  2. H. Perttu, "Novel Applications of Real-Time AudioVisual Signal Processing Technology for Art and Sports Education and Entertainment," Doctoral Dissertation, Helsinki University of Technology, 2007.
  3. Wikipedia, "Wii Remote," http://en.wikipedia.org/wiki/Wii_Remote, 2009 Available.
  4. L. Lanningham-Foster, R. C. Foster, S. K. McCrady, T. B. Jensen, N. Mitre, J. A. Levine, "Activity-Promoting Video Games and Increased Energy Expenditure," the Journal of Pddiatrics, Vol. 154, Issue 6, 2009.
  5. Micordoft, Xbox.com, http://www.xbox.com/en-US/live/projectnatal/, available 2009.
  6. C. G. Kim, B. S. Song, "Development of Home Tranining Syustem with Selft-Controlled Feedback for Stroke Patients," KSIIS, Vol. 18, No. 1, pp. 37-46, 2013.
  7. Sony Computer Entertainment Inc. "Motion Controller for PlayStation 3," available 2010.
  8. A. Bobick, J. Davis, "The recognition of human movement using temporal templates," IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 23, No. 3, pp.257-267, 2001. https://doi.org/10.1109/34.910878
  9. Md. Atiqur Rahman Ahad, J. K. Tan, H. Kim, S. Ishikawa, "Motion history image: its variants and applications," Machine Vision and Applications, Vol. 23, Issue 2, pp 255-281, March 2012. https://doi.org/10.1007/s00138-010-0298-4
  10. R. L. HSU, M. ABDEL-MOTTALEB, and A. K. JAIN, "Face detection in color images," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, 696-706, 2002. https://doi.org/10.1109/34.1000242
  11. P. Kakumanu, S. Makrogiannis, and N. Bourbakis, "A survey of skin-color modeling and detection methods," Pattern Recognition, Vol. 40, pp. 1106-1122, 2007. https://doi.org/10.1016/j.patcog.2006.06.010
  12. A. Conci, E Nunes, J. J. Pantrigo, A. Sanchez, "Comparing color and texture-based algorithms for human skin detection", Computer Interaction, Vol. 5, pp. 168-173, 2008.
  13. http://opencv.org/
  14. S. Lee, Y. W. Rhee, C. W. Lee, "Motion Detection using Image Segmentation," Proc. of KSIIS Spring Conference, pp. 112-114, June 2014.