Browse > Article
http://dx.doi.org/10.7583/JKGS.2015.15.1.27

A Gesture Interface based on Hologram and Haptics Environments for Interactive and Immersive Experiences  

Pyun, Hae-Gul (Global School of Media, Soongsil University)
An, Haeng-A (Global School of Media, Soongsil University)
Yuk, Seongmin (Global School of Media, Soongsil University)
Park, Jinho (Global School of Media, Soongsil University)
Abstract
This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.
Keywords
Gesture Recognition; Hologram; Haptics; User Interaction; Immersion;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 http://www.microsoft.com/en-us/kinectforwind ows
2 https://www.leapmotion.com
3 P. Garg, N. Aggarwal, S. Sofat, "Vision Based Hand Gesture Recognition", World Academy of Science, Engineering and Technology, Vol. 49, pp. 972-977, 2009.
4 S. Mitra and T. Acharya, "Gesture Recognition: A Survey", IEEE Trans. Systems, Man, and Cybernetics, Part C: Applications and Rev., vol. 37, no. 3, pp. 311-324, May 2007.   DOI
5 C. Manresa et al., "Hand Tracking and Gesture Recognition for Human-Computer Interaction", Electronic Letters on Computer Vision and Image Analysis, vol. 5, no. 3, pp. 96-104, May 2005.
6 T. Schlomer, B. Poppinga, N. Henze, S. Boll, "Gesture Recognition with a Wii Controller", Proceedings of the Second International Conference on Tangible and Embedded Interaction (TEI'08), Feb. 18-20, 2008.
7 K. K. Biswas, S.K. Basu, "Gesture Recognition using Microsoft Kinect", IEEE, Automation, Robotics and Applications (ICARA), 2011 5th International Conference on, pp. 100-103, Dec. 6-8, 2011.
8 J.L. Raheja, A. Chaudhary, K. Singal, "Tracking of Fingertips and Centres of Palm using Kinect", In proceedings of the 3rd IEEE International Conference on Computational Intelligence, Modelling and Simulation, Malaysia, Sept. 20-22, pp. 248-252, 2011.
9 K. Khoshelham, "Accuracy Analysis of Kinect Depth Data", International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XXXVIII-5/W12, 2011 ISPRS Calgary Workshop, pp. 29-31, Calgary, Canada, August 2011.
10 V. Frati, D. Prattichizzo, "Using Kinect for hand tracking and rendering in wearable haptics", IEEE World Haptics Conference (WHC), Istanbul, pp. 317-321, June 21-24, 2011.
11 Guan-Feng He, Jin-Woong Park, Sun-Kyung Kang, Sung-Tae Jung, "Development of Gesture Recognition-Based 3D Serious Games", Journal of Korea Game Society, Vol. 11, No. 6, pp.103-114, 2011.
12 Chang-Ik Jang, "A Study of the Physical Experience Using Serious Game Design Traffic Safety Education for Children applied using 3D Depth Gesture Recognition Technology", Journal of Korea Game Society, Vol. 12, No. 6, pp.5-14, 2012.   DOI
13 Super Nova team, Bronze prize, https://www.leap-motion.kr/index.php/contestfinalresult