• Journal of Korea Multimedia Society
• /
• v.17 no.11
• /
• pp.1263-1269
• /
• 2014

As rapid development of new hardware control interface technology, new concepts have been being proposed and emerged. In this paper, a new approach based on leap motion system is proposed. While we employ a position information from sensor, the hand gesture recognition is suggested with the pre-defined patterns. To do this, we design a recognition algorithm with hand gesture and finger patterns. We apply the proposed scheme to 3-dimensional avatar controling and editing software tool for making animation in the cyber space as a representative application. This proposed algorithm can be used to control computer systems in medical treatment, game, education and other various areas.

• Journal of the HCI Society of Korea
• /
• v.11 no.1
• /
• pp.5-10
• /
• 2016

This paper aims at providing a shooter game interface which enhances the game's realism by recognizing user's hand gestures using the Leap Motion. In this paper, we implemented the functions such as shooting, moving, viewpoint change, and zoom in/out, which are necessary in shooter games, and confirmed through user test that the game interface using familiar and intuitive hand gestures is superior to the conventional mouse/keyboard in terms of ease-to-manipulation, interest, extendability, and so on. Specifically, the user satisfaction index(1~5) was 3.02 on average when using the mouse/keyboard interface and 3.57 on average when using the proposed hand gesture interface.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.2
• /
• pp.159-169
• /
• 2016

In order to realize the virtual prototyping (VP) of digital products, it is important to provide the people involved in product development with the appropriate visualization and interaction of the products, and the vivid simulation of user interface (UI) behaviors in an interactive 3D virtual environment. In this paper, we propose an approach to web-based 3D virtual experience using Unity and Leap Motion. We adopt Unity as an implementation platform which easily and rapidly implements the visualization of the products and the design and simulation of their UI behaviors, and allows remote users to get an easy access to the virtual environment. Additionally, we combine Leap Motion with Unity to embody natural and immersive interaction using the user's hand gesture. Based on the proposed approach, we have developed a testbed system for web-based 3D virtual experience and applied it for the design evaluation of various digital products. Button selection test was done to investigate the quality of the interaction using Leap Motion, and a preliminary user study was also performed to show the usefulness of the proposed approach.

• Journal of Korea Entertainment Industry Association
• /
• v.14 no.3
• /
• pp.133-138
• /
• 2020

Interaction is an important component in the sense of immersion in augmented reality. However, the function of interaction in augmented reality contents is very weak. Bringing a lot of real environmental information is one of the ways to develop augmented reality, and interaction will naturally develop. In this paper, Leap Motion was used for natural interaction in augmented reality environment through the hand widely used as an interface tool, and extended more from the limited interaction of conventional display touch methods to create a natural interaction. This development of interaction will contribute to the development of various contents as well as augmented reality later.

• Journal of Korea Game Society
• /
• v.15 no.1
• /
• pp.27-34
• /
• 2015

This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.

• Journal of Korea Game Society
• /
• v.16 no.4
• /
• pp.69-78
• /
• 2016

With the development of game technology, the realistic game graphics, interface technology, and various content services with immersion are being required in the content area. NUI has been developed through CLI and GUI. Unlike the conventional methods, it is an interface that could be the intuitive and realistic interface for human as a natural action realized. we propose a boxing simulation game using leap motion of it. Providing a realistic 3D experimental environment through VR headsets game, we also propose a method that can be calculated the scores if the user-controlled interface (fist) could be to punch the target (sandbag) of the internal in accordance with changes of the angle of target impact with the physical characteristics.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.1
• /
• pp.20-30
• /
• 2016

Recently immersive virtual reality (VR) becomes popular due to the advanced development of I/O interfaces and related SWs for effectively constructing VR environments. In particular, natural and intuitive manipulation of 3D virtual objects is still considered as one of the most important user interaction issues. This paper presents a comparative study on the manipulation and interaction of 3D virtual objects using different interfaces and interactions in three VR environments. The comparative study includes both quantitative and qualitative aspects. Three different experimental setups are 1) typical desktop-based VR using mouse and keyboard, 2) hand gesture-supported desktop VR using a Leap Motion sensor, and 3) immersive VR by wearing an HMD with hand gesture interaction using a Leap Motion sensor. In the desktop VR with hand gestures, the Leap Motion sensor is put on the desk. On the other hand, in the immersive VR, the sensor is mounted on the HMD so that the user can manipulate virtual objects in the front of the HMD. For the quantitative analysis, a task completion time and success rate were measured. Experimental tasks require complex 3D transformation such as simultaneous 3D translation and 3D rotation. For the qualitative analysis, various factors relating to user experience such as ease of use, natural interaction, and stressfulness were evaluated. The qualitative and quantitative analyses show that the immersive VR with the natural hand gesture provides more intuitive and natural interactions, supports fast and effective performance on task completion, but causes stressful condition.

• The Journal of the Acoustical Society of Korea
• /
• v.36 no.2
• /
• pp.130-135
• /
• 2017

In this paper, we propose an interface for interactive sound experience in the virtual concert hall. The proposed interface consists of two systems, called 'virtual acoustic position' and 'virtual active listening'. To provide these systems, we applied an artificial reverberation algorithm, multi-channel source separation and head-related transfer function. The proposed interface was implemented by using Unity. The interface provides the virtual concert hall to user through Oculus Rift, one of the virtual reality headsets. Moreover, we used Leap Motion as a control device to allow a user experience the system with free-hand. And user can experience the sound of the system through headphones.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2016.10a
• /
• pp.768-770
• /
• 2016

현재 NUI(Natural User Interface)는 차세대 입력 방식으로 주목을 받고 있다. 이미 한글 입력에 관한 NUI가 다양하게 연구 및 개발되고 있지만, 한글 입력 NUI는 직관성과 정확도의 부족과 불완전한 인식률 등의 한계점이 존재한다. 본 연구에서는 사용자의 핸드 제스처를 인식하기 위해 Leap Motion 장치를 사용하고, 한글의 글자 조합 원리를 바탕으로 자음과 모음 입력의 제스처를 분리하여 인식의 정확도를 높인다. 그리고 모음의 방향성을 참고하여 한글 입력에 직관성을 향상할 수 있는 핸드 제스처를 연구한다. 이를 통해 사용자가 NUI 환경의 디바이스를 좀 더 정확하고 빠르게 조작할 수 있도록 돕는다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2013.11a
• /
• pp.1649-1652
• /
• 2013

최근 정보기술의 발전에 가속화되면서 기존의 키보드나 마우스 같은 전통적인 제어장치들과는 달리 새로운 하드웨어 인터페이스들이 등장하고, 그에 따른 새로운 시각에서의 제어 방법들 등장하고 있다. 본 논문에서는 Leap Motion이라는 새로운 하드웨어 인터페이스를 사용할 때 제공되는 단순한 위치 정보만 쓰는 것이 아니라 어떠한 위치에 있는지, 특정 동작을 취했을 때 모션 등과 같은 정보들도 함께 사용하기 위해 손과 손가락을 인식할 수 있도록 모션 인식방법을 제안하고, 제안된 기술을 기반으로 3D Avatar를 제어 및 편집 후 애니메이션을 만들어 공유할 수 있는 모션제어 저작SW를 개발하였다. 본 기술은 의료, 게임, 교육 등 다양한 분야에서 새로운 제어 기술로서 활용될 수 있으며, 기존의 공간 터치 기술과는 다른 장점을 제공할 것으로 예상된다.