Journal of the Ergonomics Society of Korea (대한인간공학회지)

Ergonomics Society of Korea (대한인간공학회)
권호 표지
DOI QR코드

DOI QR Code

Design of Contactless Gesture-based Rhythm Action Game Interface for Smart Mobile Devices

  • Ju, Da-Young (Yonsei Institute of Convergence Technology, Yonsei University)
  • Received : 2012.07.20
  • Accepted : 2012.08.01
  • Published : 2012.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: The aim of this study is to propose the contactless gesture-based interface on smart mobile devices for especially rhythm action games. Background: Most existing approaches about interactions of smart mobile games are tab on the touch screen. However that way is such undesirable for someone or for sometimes, because of the disabled person, or the inconvenience that users need to touch/tab specific devices. Moreover more importantly, new interaction can derive new possibilities from stranded game genre. Method: In this paper, I present a smart mobile game with contactless gesture-based interaction and the interfaces using computer vision technology. Discovering the gestures which are easy to recognize and research of interaction system that fits to game on smart mobile device are conducted as previous studies. A combination between augmented reality technique and contactless gesture interaction is also tried. Results: The rhythm game allows a user to interact with smart mobile devices using hand gestures, without touching or tabbing the screen. Moreover users can feel fun in the game as other games. Conclusion: Evaluation results show that users make low failure numbers, and the game is able to recognize gestures with quite high precision in real time. Therefore the contactless gesture-based interaction has potentials to smart mobile game. Application: The results are applied to the commercial game application.

Keywords

References

  1. Billon, R., Nedelec, A. and Tisseau, J., "Gesture Recognition in Flow based on PCA Analysis using Multiagent System", In Proceedings of ACE. 2008.
  2. Blain, T., "The convergence of alternate controllers and musical interfaces in interactive entertainment", In Proc. of the 2005 international conf. on new interfaces for musical expression (NIME05), p.27-33, 2005.
  3. Elmezain, M., Al-Hamadi, A., Appenrodt, J. and Michaelis, B., A Hidden Markov Model-Based Continuous Gesture Recognition System for Hand Motion Trajectory. In Proceedings of 19th International Conference on Pattern Recognition, p.1-4, 2008.
  4. He, G. F., Park, J. W., Kang, S. K. and S. K. ung, S. K., "Development of Gesture Recognition-Based 3D Serious Games", Journal of Korea game society, p.103-114, 2011.
  5. Hoysniemi, J., "Design and evaluation of physically interactive games", PhD thesis, University of Tampere, 2006.
  6. Ju, D. Y., "Contactless gesture-based interaction for smart mobile games.", In Proc. of ESK Spring conf. & 14th Korea-Japan joint symposium, 2012.
  7. Lee, Y. C., Oh, C. M. and Lee, C. W., "Mobile Game Control Using Gesture Recognition", Journal of the Korea contents association, p.629-638, 2011.
  8. Liu, J., Zhong, L., Wickramasuriya, J. and Vasudevan, V., "uWave: Accelerometer-based personalized gesture recognition and its applications", Pervasive Mob. Comput., 5(6), 657-675, 2009. https://doi.org/10.1016/j.pmcj.2009.07.007
  9. Mistry, K. and Zhang, L., "Gesture Recognition Exploration using Haartraining and KNN in a 3D Racing Game", In proceedings of MIAA. p.37-40, 2011.
  10. Mitra, S. and Acharya, T., "Gesture recognition: A survey. IEEE Trans. Syst.", Man and Cybern., 37(3), 311-324, 2007. https://doi.org/10.1109/TSMCC.2007.893280
  11. Park, J. Y., Kim, G. C., Park, J. W. and Lee, J. H., "Interactive Boxing Game Based on Computer Vision", Sungkyunkwan University, p.35-51, 2005.
  12. Park, Y. and Kihl, T., "A study for the user interface of rhythm action games on smart device", In Proc. of Korea game society p.191-197, 2011.
  13. Pavlovic, V. I., Sharma, R. and Huang, T. S., "Visual interpretation of hand gestures for human-computer interaction: A review". PAMI, 19(7), 677-695, 1997. https://doi.org/10.1109/34.598226
  14. Westerman, W. C. and Elias, J. G., "System and method for packing multitouch gestures onto a hand", April 2006.
  15. Wilson, A. and Shafer, S., "XWand: UI for intelligent spaces". In Proc. SIGCHI conf. Human factors in computer system, pages 545-552, 2003.
  16. Wobbrock, J. O., Wilson, A. D. and Li, Y., "Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes", In Proc. ACM UIST, pages 159-168, 2007.
  17. Yang, M. H., Ahuja, N. and Tabb, M., "Extraction of 2D motion trajectories and its application to hand gesture recognition", IEEE Trans. Pattern Anal. Mach. Intell., 24(8), 1061-1074, 2002. https://doi.org/10.1109/TPAMI.2002.1023803
  18. Yuk, H., "A study on the types of interactive motions in mobile touch interface", PhD thesis, Hongik University, 2009.