• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.24 no.6
• /
• pp.703-709
• /
• 2015

In this work, a robot aimed at grapping and delivering an object by using a simple finger-pointing command from a hand- or arm-handicapped person is introduced. In this robot system, a Leap Motion sensor is utilized to obtain the finger-motion data of the user. In addition, a Kinect sensor is also used to measure the 3D (Three Dimensional)-position information of the desired object. Once the object is pointed at through the finger pointing of the handicapped user, the exact 3D information of the object is determined using an image processing technique and a coordinate transformation between the Leap Motion and Kinect sensors. It was found that the information obtained is transmitted to the robot controller, and that the robot eventually grabs the target and delivers it to the handicapped person successfully.

• Journal of Korea Game Society
• /
• v.15 no.1
• /
• pp.27-34
• /
• 2015

This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.

• Journal of Broadcast Engineering
• /
• v.22 no.1
• /
• pp.87-94
• /
• 2017

This paper presents a prototype for virtual reality operating system (VR OS) concept with head mount display (HMD) and hand gesture recognition technology based on game engine (Unity3D). We have designed and implemented simple multitasking thread mechanism constructed on the realtime environment provided by Unity3D game engine. Our virtual reality operating system receives user input from the hand gesture recognition device (Leap Motion) to simulate mouse and keyboard and provides output via head mount display (Oculus Rift DK2). As a result, our system provides users with more broad and immersive work environment by implementing 360 degree work space.

• Journal of Korea Game Society
• /
• v.17 no.3
• /
• pp.53-62
• /
• 2017

VR content manipulation equipment is not easy for individuals to access because it requires high prices. Especially, in the case of a system for tracking the motion of the user among the VR contents, a separate optical sensor device using an infrared camera is generally used. The disadvantage of the optical sensor equipment is that the measurable range is dependent on the measurement direction when tracking the rotation motion when using only a single device. In order to solve the above problems, this paper shows that the inertial sensor of the smartphone, which is generally owned by the public, can track the rotational motion of the user regardless of the measurement direction . The system using the LeapMotion is used as the reference system, and the system using the smart phone is defined as the evaluation system, and the usability of the evaluation system is verified by comparing the user satisfaction of the two systems.

• Journal of the Korea Computer Graphics Society
• /
• v.24 no.3
• /
• pp.93-100
• /
• 2018

This paper proposes a small-scale rehabilitation system that allows stroke patients to perform daily rehabilitation training in a virtual home. Stroke patients have limited activities of daily living due to paralysis, and there are many rehabilitation exercises for them to reproduce activities that take place in the house, such as turning lights on and off, door opening and closing, gas valve locking. In this paper, we have implemented a virtual home with the above mentioned daily rehabilitation training elements, by using virtual reality technology. We use Leap Motion, a hand motion recognition device, for rehabilitation of hands and fingers. It is expected that stroke patients can rehabilitate small muscles without having to visit the clinic with uncomfortable body, and will be able to get interesting rehabilitation training by avoiding monotony of existing rehabilitation tools.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.19 no.9
• /
• pp.2006-2013
• /
• 2015

Deaf are it is difficult to communicate to represent the voice heard, so theay use mostly using the speech, sign language, writing, etc. to communicate. It is the best way to use sign language, in order to communicate deaf and normal people each other. But they must understand to use sign language. In this paper, we designed and implementated finger language translation system to support communicate between deaf and normal people. We used leap motion as input device that can track finger and hand gesture. We used raspberry pi that is low power sing board computer to process input data and translate finger language. We implemented application used Node.js and MongoDB. The client application complied with HTML5 so that can be support any smart device with web browser.

• Journal of the Korea Society of Computer and Information
• /
• v.19 no.8
• /
• pp.129-137
• /
• 2014

The patients who have illness of hand and upper limb should be received rehabilitation treatment to recover such illness. The rehabilitation treatments is a treatments designed to facilitate the process of recovery from injury, illness, or disease to as normal a condition as possible. This should be done continuously and repeatedly. In this paper, we describe hand-rehabilitation system which provides a treatment method improving and recovering the function of injured hands. Expecially, this system is using a leap motion device which can easily and properly identify and trace a hand motion and provide six treatment patterns for hand rehabilitation. By using this system, the patients can do rehabilitation treatment easily and continuously in their daily life and in result, the achievement of treatment will be improved.

• The Journal of the Acoustical Society of Korea
• /
• v.36 no.2
• /
• pp.130-135
• /
• 2017

In this paper, we propose an interface for interactive sound experience in the virtual concert hall. The proposed interface consists of two systems, called 'virtual acoustic position' and 'virtual active listening'. To provide these systems, we applied an artificial reverberation algorithm, multi-channel source separation and head-related transfer function. The proposed interface was implemented by using Unity. The interface provides the virtual concert hall to user through Oculus Rift, one of the virtual reality headsets. Moreover, we used Leap Motion as a control device to allow a user experience the system with free-hand. And user can experience the sound of the system through headphones.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.552-554
• /
• 2019

Deaf mutism (a hearing-impaired person and speech disorders) communicates using sign language. There are difficulties in communicating by voice. However, sign language can only be limited in communicating with people who know sign language because everyone doesn't use sign language when they communicate. In this paper, a finger language translation system is proposed and implemented as a means for the disabled and the non-disabled to communicate without difficulty. The proposed algorithm recognizes the finger language data by leap motion and self-learns the data using machine learning technology to increase recognition rate. We show performance improvement from the simulation results.

• Journal of Korea Multimedia Society
• /
• v.24 no.10
• /
• pp.1435-1448
• /
• 2021

Recent years, due to the direct or indirect damages caused by meteorological disasters more and more attention have been paid to natural disasters. At same time, diversified and multi-sensory interactive meteorological services is increasingly demanded. In this study, novel interactive meteorological service was compared with the traditional communication methods. Combining with case studies and systems creation, a virtual reality weather simulation framework was proposed, and a realistic virtual game environment providing real-time and historical weather information was created. The primary goal of this study is to build a weather display cabinet game system by using virtual reality technology, and promoting public's understanding of the principles of weather changes. With the interactive games in realistic scenarios, public's awareness for disasters prevention could be promoted. It is helping to change public's traditional understanding of meteorological theories, and will provide a more convenient way for the public to explore more effective weather forecasts. The simulation system is supported by VR technology. It was combined with Leap Motion interactive equipment to make popularization games for weather science. T-test data analysis showed that the application of VR technology in weather games has strong operability and interactivity.