• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.10a
• /
• pp.231-232
• /
• 2014

We develop a remote control system of a walking robot using a Leap motion sensor. Hand gestures and the position of fingers are provided from the Leap motion sensor. We use Processing and the LeapMotionP5 library for the development software.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2016.10a
• /
• pp.726-728
• /
• 2016

In this paper, a realtime MIDI controller is designed using leap motion. The controller makes virtual MIDI port on Windows that it is connected to the port and protocol for communication with DAW or VST. It is converted MIDI data when it is detected a real time the position and shape of hand. This converted data transfer MIDI port by MIDI CC(Control Change). Therefore this controller has the purpose to support flexible MIDI input function than existed MIDI controller.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.2
• /
• pp.159-169
• /
• 2016

In order to realize the virtual prototyping (VP) of digital products, it is important to provide the people involved in product development with the appropriate visualization and interaction of the products, and the vivid simulation of user interface (UI) behaviors in an interactive 3D virtual environment. In this paper, we propose an approach to web-based 3D virtual experience using Unity and Leap Motion. We adopt Unity as an implementation platform which easily and rapidly implements the visualization of the products and the design and simulation of their UI behaviors, and allows remote users to get an easy access to the virtual environment. Additionally, we combine Leap Motion with Unity to embody natural and immersive interaction using the user's hand gesture. Based on the proposed approach, we have developed a testbed system for web-based 3D virtual experience and applied it for the design evaluation of various digital products. Button selection test was done to investigate the quality of the interaction using Leap Motion, and a preliminary user study was also performed to show the usefulness of the proposed approach.

• Journal of the Korean Society of Industry Convergence
• /
• v.26 no.3
• /
• pp.463-470
• /
• 2023

In this study, an electronic parts assembly training system using Leap Motion was developed in consideration of the processes actually operated in the assembly process of electronic products. Based on Leap Motion and Oculus VR equipment, the system was developed to transfer user's hand movement data in real time and convert it into hand movement in virtual space so that electronic parts assembly simulation can be performed step by step. Through this, it was confirmed that the user can obtain an experience similar to the actual electronic parts assembly work, prevent errors that may occur during the assembly process, and improve proficiency. It is expected that this thesis will provide directions for the quality improvement and development of various education and training programs for virtual reality-based manufacturing processes.

• KIISE Transactions on Computing Practices
• /
• v.21 no.5
• /
• pp.343-350
• /
• 2015

While many games have been published that are used with input-devices such as a mouse and keyboard, the number of games that can recognize the behavior of a human utilizing devices such as Kinect and Wii has increased. In this paper, we present the development of a baseball game that utilizes a Leap Motion Controller. A Leap Motion Controller recognizes accurately the movement of a user's fingers. Our implemented game consists of characters, a background and animation. It is a moving animated game in which the users play a game in point of view of a third person. The major feature of our game is that the game players can enjoy the game using a Leap Motion Controller.

• Journal of Korea Multimedia Society
• /
• v.17 no.11
• /
• pp.1263-1269
• /
• 2014

As rapid development of new hardware control interface technology, new concepts have been being proposed and emerged. In this paper, a new approach based on leap motion system is proposed. While we employ a position information from sensor, the hand gesture recognition is suggested with the pre-defined patterns. To do this, we design a recognition algorithm with hand gesture and finger patterns. We apply the proposed scheme to 3-dimensional avatar controling and editing software tool for making animation in the cyber space as a representative application. This proposed algorithm can be used to control computer systems in medical treatment, game, education and other various areas.

• Journal of Digital Contents Society
• /
• v.19 no.2
• /
• pp.319-325
• /
• 2018

The general public's interest in dementia has increased recently as dementia has become a social issue due to its rapid aging. Several dementia prevention and rehabilitation programs are being carried out at the dementia rehabilitation center and at the old welfare center depending on the number of dementia patients. In this paper, a 3 dimensional finger and motion search of the leap motion is utilized and combined with dementia preventive and cognitive rehabilitation programs at various facilities. We suggest technologies that can provide both fun and effective treatment and rehabilitation content for rehabilitation therapists. A variety of cognitive enhancement content is designed using finger tracking and configured to be recorded in the database for rehabilitation programmes to increase the effectiveness of management.

• Journal of Korea Entertainment Industry Association
• /
• v.14 no.3
• /
• pp.133-138
• /
• 2020

Interaction is an important component in the sense of immersion in augmented reality. However, the function of interaction in augmented reality contents is very weak. Bringing a lot of real environmental information is one of the ways to develop augmented reality, and interaction will naturally develop. In this paper, Leap Motion was used for natural interaction in augmented reality environment through the hand widely used as an interface tool, and extended more from the limited interaction of conventional display touch methods to create a natural interaction. This development of interaction will contribute to the development of various contents as well as augmented reality later.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.11
• /
• pp.51-57
• /
• 2021

In this paper, we propose a new framework that calculates the user's hand motions using a Leap Motion device, and uses this to practice and analyze arm muscles as well as juggling motions. The proposed method can map the movement of the ball in a virtual environment according to the user's hand motions in real time, and analyze the amount of exercise by visualizing the relaxation and contraction of the muscles. The proposed framework consists of three main parts : 1) It tracks the user's hand position with the Leap Motion device. 2) As with juggling, the action pattern of the user throwing the ball is defined as an event. 3) We propose a parabola-based particle method to map the movement of a juggling shape to a ball based on the user's hand position. As a result, using the our framework, it is possible to play a juggling game in real-time.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2017.11a
• /
• pp.1041-1044
• /
• 2017

말하기와 듣기가 불가능한 언어장애인들은 수화를 통하여 그들끼리 혹은 일반인과 의사소통을 해야 한다. 수화 또한 공용어이기에 전문통역사 없이도 서로간의 의사소통이 원활해야 하지만, 현실은 그렇지 않다. 이 시스템은 LeapMotion장비를 연결 및 각종 손동작을 인식 받아 데이터 세트 내에서 처리하여 이를 자연어로 변환함으로써 의사소통의 불편함을 해소할 수 있다. 또한 머신러닝을 이용하여 반복 학습할 수 있게 설계함으로써 처리율 향상을 기대할 수 있다.