• The Journal of the Korea institute of electronic communication sciences
• /
• v.12 no.6
• /
• pp.1127-1134
• /
• 2017

In this study, the robot arm control system was implemented that is operated by human hands, which can be used in environments that are inaccessible to humans. This function has to be sent to the robot's arms after extracting coordinates of human hands. Through mapping and bluetooth communication we use a leap motion sensor with infrared light and Image recognition sensor.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.333-334
• /
• 2018

This is a study on controlling a drone (DJI Mavic Air) with simple hand gesture using Leap Motion controller. Four component involve are MacBook, Leap Motion controller, Android device, and DJI Mavic Air. All of this component are connected through USB, Bluetooth, and Wi-Fi technology. The studies main purpose are to show that by controlling a drone through Leap Motion, drone amateur user can easily learn how to control a drone, and because of longer drone control range can be archived things such as search and rescue mission will be possible.

• ETRI Journal
• /
• v.46 no.2
• /
• pp.250-262
• /
• 2024

Air-writing recognition is relevant in areas such as natural human-computer interaction, augmented reality, and virtual reality. A trajectory is the most natural way to represent air writing. We analyze the recognition accuracy of words written in air considering five features, namely, writing direction, curvature, trajectory, orthocenter, and ellipsoid, as well as different parameters of a hidden Markov model classifier. Experiments were performed on two representative datasets, whose sample trajectories were collected using a Leap Motion Controller from a fingertip performing air writing. Dataset D₁ contains 840 English words from 21 classes, and dataset D₂ contains 1600 English words from 40 classes. A genetic algorithm was combined with a hidden Markov model classifier to obtain the best subset of features. Combination ftrajectory, orthocenter, writing direction, curvatureg provided the best feature set, achieving recognition accuracies on datasets D₁ and D₂ of 98.81% and 83.58%, respectively.

• Journal of Korea Game Society
• /
• v.15 no.1
• /
• pp.27-34
• /
• 2015

This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.

• Journal of Biomedical Engineering Research
• /
• v.42 no.4
• /
• pp.186-192
• /
• 2021

In this paper, we evaluated prediction accuracy of Euler angle spectrograph classification method using a convolutional neural networks (CNN) for hand gesture recognition in augmented reality (AR) cognitive rehabilitation system based on Leap Motion Controller (LMC). Hand gesture recognition methods using a conventional support vector machine (SVM) show 91.3% accuracy in multiple motions. In this paper, five hand gestures ("Promise", "Bunny", "Close", "Victory", and "Thumb") are selected and measured 100 times for testing the utility of spectral classification techniques. Validation results for the five hand gestures were able to be correctly predicted 100% of the time, indicating superior recognition accuracy than those of conventional SVM methods. The hand motion recognition using CNN meant to be applied more useful to AR cognitive rehabilitation training systems based on LMC than sign language recognition using SVM.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.1
• /
• pp.20-30
• /
• 2016

Recently immersive virtual reality (VR) becomes popular due to the advanced development of I/O interfaces and related SWs for effectively constructing VR environments. In particular, natural and intuitive manipulation of 3D virtual objects is still considered as one of the most important user interaction issues. This paper presents a comparative study on the manipulation and interaction of 3D virtual objects using different interfaces and interactions in three VR environments. The comparative study includes both quantitative and qualitative aspects. Three different experimental setups are 1) typical desktop-based VR using mouse and keyboard, 2) hand gesture-supported desktop VR using a Leap Motion sensor, and 3) immersive VR by wearing an HMD with hand gesture interaction using a Leap Motion sensor. In the desktop VR with hand gestures, the Leap Motion sensor is put on the desk. On the other hand, in the immersive VR, the sensor is mounted on the HMD so that the user can manipulate virtual objects in the front of the HMD. For the quantitative analysis, a task completion time and success rate were measured. Experimental tasks require complex 3D transformation such as simultaneous 3D translation and 3D rotation. For the qualitative analysis, various factors relating to user experience such as ease of use, natural interaction, and stressfulness were evaluated. The qualitative and quantitative analyses show that the immersive VR with the natural hand gesture provides more intuitive and natural interactions, supports fast and effective performance on task completion, but causes stressful condition.

• Journal of the Korea Convergence Society
• /
• v.7 no.3
• /
• pp.45-51
• /
• 2016

The development of advanced technology gives us many problems. In mentally view point, the major one is depression. Depression appears in various forms. In worst case, it leads into suicide. This study designs and develops a new type of healing content which the convergence in the virtual space, Movement of Thought, Head Mounted Display, Leap Motion, Color Therapy, Music Therapy methods in order to improve the symptoms of depression. The developed convergence content will be effective in healing methods instead of the existing medication relieve depression and improve self-esteem of patients with depression. Future research will try to apply the clinical development of a prototype content.

• Journal of Digital Contents Society
• /
• v.17 no.4
• /
• pp.287-293
• /
• 2016

Some studies require sufficient amount of time, spaces, and financial condition for practical exercises and training. In particular for the Medical education, time and space limitation is very high and difficulties occurs, since the practices are done with cadavers (deceased human body). Many alternate 3D Virtual surgery training system exist currently, however the burdensome of obtaining those costly equipments is problematic. Providing the surgical environment as similar to real as possible using 3D Virtual Reality can be a solution to current problems. The effectiveness of training could be maximized with minimized costs without the general interfaces such as keyboard and mouse, but with Oculus Rift and Leap Motion. This paper will develop and practice the 3D Virtual Operation System with two devices to investigate the possibility and expand to other Simulation fields.

• Journal of the HCI Society of Korea
• /
• v.11 no.1
• /
• pp.5-10
• /
• 2016

This paper aims at providing a shooter game interface which enhances the game's realism by recognizing user's hand gestures using the Leap Motion. In this paper, we implemented the functions such as shooting, moving, viewpoint change, and zoom in/out, which are necessary in shooter games, and confirmed through user test that the game interface using familiar and intuitive hand gestures is superior to the conventional mouse/keyboard in terms of ease-to-manipulation, interest, extendability, and so on. Specifically, the user satisfaction index(1~5) was 3.02 on average when using the mouse/keyboard interface and 3.57 on average when using the proposed hand gesture interface.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2013.11a
• /
• pp.1649-1652
• /
• 2013

최근 정보기술의 발전에 가속화되면서 기존의 키보드나 마우스 같은 전통적인 제어장치들과는 달리 새로운 하드웨어 인터페이스들이 등장하고, 그에 따른 새로운 시각에서의 제어 방법들 등장하고 있다. 본 논문에서는 Leap Motion이라는 새로운 하드웨어 인터페이스를 사용할 때 제공되는 단순한 위치 정보만 쓰는 것이 아니라 어떠한 위치에 있는지, 특정 동작을 취했을 때 모션 등과 같은 정보들도 함께 사용하기 위해 손과 손가락을 인식할 수 있도록 모션 인식방법을 제안하고, 제안된 기술을 기반으로 3D Avatar를 제어 및 편집 후 애니메이션을 만들어 공유할 수 있는 모션제어 저작SW를 개발하였다. 본 기술은 의료, 게임, 교육 등 다양한 분야에서 새로운 제어 기술로서 활용될 수 있으며, 기존의 공간 터치 기술과는 다른 장점을 제공할 것으로 예상된다.