Browse > Article
http://dx.doi.org/10.7583/JKGS.2017.17.6.113

Virtual Block Game Interface based on the Hand Gesture Recognition  

Yoon, Min-Ho (Department of Computer Engineering, Seo-Kyeong University)
Kim, Yoon-Jae (Department of Computer Engineering, Seo-Kyeong University)
Kim, Tae-Young (Department of Computer Engineering, Seo-Kyeong University)
Publication Information
Journal of Korea Game Society / v.17, no.6, 2017 , pp. 113-120 More about this Journal
Abstract
With the development of virtual reality technology, in recent years, user-friendly hand gesture interface has been more studied for natural interaction with a virtual 3D object. Most earlier studies on the hand-gesture interface are using relatively simple hand gestures. In this paper, we suggest an intuitive hand gesture interface for interaction with 3D object in the virtual reality applications. For hand gesture recognition, first of all, we preprocess various hand data and classify the data through the binary decision tree. The classified data is re-sampled and converted to the chain-code, and then constructed to the hand feature data with the histograms of the chain code. Finally, the input gesture is recognized by MCSVM-based machine learning from the feature data. To test our proposed hand gesture interface we implemented a 'Virtual Block' game. Our experiments showed about 99.2% recognition ratio of 16 kinds of command gestures and more intuitive and user friendly than conventional mouse interface.
Keywords
Hand Gesture Recognition; Interaction; Leap Motion; Support Vector Machine;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 R. Aigner, D. Wigdor, H. Benko, M. Haller, D. Lindlbauer, A. Ion, S.Zhao et al, "Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for HCI", Microsoft Research TechReport. MSR-TR-2012-111, 2012.
2 Jung-Ho Ahn, Jae-pil Ko, "A Study on Tangible Gesture Interface Prototype Development of the Quiz Game", Journal of Digital Contents Society 13(2), 235-245, 2012.06.   DOI
3 Ki-Chang Park, Seong-Chae Seo, Seung-Moon Jeong, Im-Cheol Kang, Byung-Gi Kim, "Design of Gesture based Interfaces for Controlling GUI Applications", Journal of the Korea Contents Association 13(1), 55-63, 2013.1.   DOI
4 https://developer.leapmotion.com/documentation/csharp/devguide/Leap_Overview.html
5 Min-Sam Ko, Kwang-Hee Lee, Chang-woo Kim, Jun-Ho Ahn, In-Jung Kim, "An Implementation of User Interface Using Vision-based Gesture Recognition", Korea Information Science Society 35(1C), 507-511, 2008.6.
6 Ji-Seong Jeong, Jong-Oh Kim, Do-Hyeong Kim, Sun-Ock Kwon, Seong-Yeon Ju, Won-Keun Oh, Kwan-Hee Yoo, "A Hand Gesture Interface for Controlling 3D e-Books", Korean Society For Computer Game, Volume.25, No.4 December 2012.
7 Pankoo Kim, "Hand Gesture and Character Recognition Based on Kinect Sensor", Hindawi Publishing Corporation International Journal of Distributed Sensor Networks, Vol. 2014, Article ID 278460, pp. 6, 2014.
8 Z. Ren, J. Meng, J. Yuan, Z. Zhang, "Robust hand gesture recognition with Kinect sensor", Proc. 19th ACM Int. Conf. Multimedia, pp. 759-760, 2011.
9 In-ho Shin, Dong-hun Cheon, Han-hoon Park, "Implementing Leap-Motion-Based Interface for Enhancing the Realism of Shooter Games", Journal of the HCI Society of Korea No.1, May 2016.
10 Hyang-han Joo, Min-soo Cho, Seung-Kyo In, Kyu-won Cho, Jun-Ki Min, "Development of Baseball Game Using Leap Motion Controllers", KIISE Transactions on Computing Practices, 21(5), 343-350. 2015.   DOI
11 Jae-Hyun Nam, Seung-Hun Yang, Woong Hu, Byung-Gyu Kim, "A new study on hand gesture recognition algorithm using leap motion system", Journal of Korea Multimedia Society Vol. 17, No. 11, November 2014.
12 Min-Jae Kim, Jeong-man Heo, Jin-Hyoung Kim, So-Young Park, Juno Chang, "Development and Evaluation of Leapmotion-based Game Interface Considering Intuitive Hand Gestures", Korean Society For Computer Game 27(4), 69-75. 2014.
13 Bassem Khelil, Hamid Amiri, "Hand Gesture Recognition Using Leap Motion Controller for Recognition of Arabic Sign Language", Proceedings of Engineering & Technology (PET), Vol. 3, pp. 233-238, 2016.