Browse > Article
http://dx.doi.org/10.5143/JESK.2012.31.4.585

Design of Contactless Gesture-based Rhythm Action Game Interface for Smart Mobile Devices  

Ju, Da-Young (Yonsei Institute of Convergence Technology, Yonsei University)
Publication Information
Journal of the Ergonomics Society of Korea / v.31, no.4, 2012 , pp. 585-591 More about this Journal
Abstract
Objective: The aim of this study is to propose the contactless gesture-based interface on smart mobile devices for especially rhythm action games. Background: Most existing approaches about interactions of smart mobile games are tab on the touch screen. However that way is such undesirable for someone or for sometimes, because of the disabled person, or the inconvenience that users need to touch/tab specific devices. Moreover more importantly, new interaction can derive new possibilities from stranded game genre. Method: In this paper, I present a smart mobile game with contactless gesture-based interaction and the interfaces using computer vision technology. Discovering the gestures which are easy to recognize and research of interaction system that fits to game on smart mobile device are conducted as previous studies. A combination between augmented reality technique and contactless gesture interaction is also tried. Results: The rhythm game allows a user to interact with smart mobile devices using hand gestures, without touching or tabbing the screen. Moreover users can feel fun in the game as other games. Conclusion: Evaluation results show that users make low failure numbers, and the game is able to recognize gestures with quite high precision in real time. Therefore the contactless gesture-based interaction has potentials to smart mobile game. Application: The results are applied to the commercial game application.
Keywords
Game; Gesture recognition; Contactless interaction; Smart mobile device; User interfaces;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Elmezain, M., Al-Hamadi, A., Appenrodt, J. and Michaelis, B., A Hidden Markov Model-Based Continuous Gesture Recognition System for Hand Motion Trajectory. In Proceedings of 19th International Conference on Pattern Recognition, p.1-4, 2008.
2 He, G. F., Park, J. W., Kang, S. K. and S. K. ung, S. K., "Development of Gesture Recognition-Based 3D Serious Games", Journal of Korea game society, p.103-114, 2011.   과학기술학회마을
3 Hoysniemi, J., "Design and evaluation of physically interactive games", PhD thesis, University of Tampere, 2006.
4 Ju, D. Y., "Contactless gesture-based interaction for smart mobile games.", In Proc. of ESK Spring conf. & 14th Korea-Japan joint symposium, 2012.
5 Lee, Y. C., Oh, C. M. and Lee, C. W., "Mobile Game Control Using Gesture Recognition", Journal of the Korea contents association, p.629-638, 2011.
6 Liu, J., Zhong, L., Wickramasuriya, J. and Vasudevan, V., "uWave: Accelerometer-based personalized gesture recognition and its applications", Pervasive Mob. Comput., 5(6), 657-675, 2009.   DOI
7 Mistry, K. and Zhang, L., "Gesture Recognition Exploration using Haartraining and KNN in a 3D Racing Game", In proceedings of MIAA. p.37-40, 2011.
8 Mitra, S. and Acharya, T., "Gesture recognition: A survey. IEEE Trans. Syst.", Man and Cybern., 37(3), 311-324, 2007.   DOI
9 Park, J. Y., Kim, G. C., Park, J. W. and Lee, J. H., "Interactive Boxing Game Based on Computer Vision", Sungkyunkwan University, p.35-51, 2005.
10 Park, Y. and Kihl, T., "A study for the user interface of rhythm action games on smart device", In Proc. of Korea game society p.191-197, 2011.
11 Pavlovic, V. I., Sharma, R. and Huang, T. S., "Visual interpretation of hand gestures for human-computer interaction: A review". PAMI, 19(7), 677-695, 1997.   DOI   ScienceOn
12 Westerman, W. C. and Elias, J. G., "System and method for packing multitouch gestures onto a hand", April 2006.
13 Wilson, A. and Shafer, S., "XWand: UI for intelligent spaces". In Proc. SIGCHI conf. Human factors in computer system, pages 545-552, 2003.
14 Billon, R., Nedelec, A. and Tisseau, J., "Gesture Recognition in Flow based on PCA Analysis using Multiagent System", In Proceedings of ACE. 2008.
15 Wobbrock, J. O., Wilson, A. D. and Li, Y., "Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes", In Proc. ACM UIST, pages 159-168, 2007.
16 Yang, M. H., Ahuja, N. and Tabb, M., "Extraction of 2D motion trajectories and its application to hand gesture recognition", IEEE Trans. Pattern Anal. Mach. Intell., 24(8), 1061-1074, 2002.   DOI   ScienceOn
17 Yuk, H., "A study on the types of interactive motions in mobile touch interface", PhD thesis, Hongik University, 2009.
18 Blain, T., "The convergence of alternate controllers and musical interfaces in interactive entertainment", In Proc. of the 2005 international conf. on new interfaces for musical expression (NIME05), p.27-33, 2005.