• The Journal of the Korea Contents Association
• /
• v.19 no.11
• /
• pp.270-277
• /
• 2019

These days, with the advent of digital broadcasting, media environment offers users an opportunity to enjoy differentiated contents in a more aggressive fashion through user-media interactions based on computer technology. In fact, the development of contents which can induce spontaneous acts from users such as outdoor ads which use certain sensors and devices and exhibition halls has been active. With the development of low-price motion recognition devices, people have been able to enjoy diverse interaction-applied media by recognizing users' motion data without body contact. In this paper, we developed an interactive media player that can recognize the user's motion and control the video in the web service environment without installing a specific program. In addition, we set user motion recognition range and developed a user motion recognition algorithm suitable for the Leap Motion equipment installed in the kiosk. The results of this study can be experienced by various interactive media such as interactive tourism, education, and movie contents in kiosks that can be installed in public places.

• Journal of Broadcast Engineering
• /
• v.22 no.1
• /
• pp.87-94
• /
• 2017

This paper presents a prototype for virtual reality operating system (VR OS) concept with head mount display (HMD) and hand gesture recognition technology based on game engine (Unity3D). We have designed and implemented simple multitasking thread mechanism constructed on the realtime environment provided by Unity3D game engine. Our virtual reality operating system receives user input from the hand gesture recognition device (Leap Motion) to simulate mouse and keyboard and provides output via head mount display (Oculus Rift DK2). As a result, our system provides users with more broad and immersive work environment by implementing 360 degree work space.

• Journal of Korea Game Society
• /
• v.16 no.4
• /
• pp.69-78
• /
• 2016

With the development of game technology, the realistic game graphics, interface technology, and various content services with immersion are being required in the content area. NUI has been developed through CLI and GUI. Unlike the conventional methods, it is an interface that could be the intuitive and realistic interface for human as a natural action realized. we propose a boxing simulation game using leap motion of it. Providing a realistic 3D experimental environment through VR headsets game, we also propose a method that can be calculated the scores if the user-controlled interface (fist) could be to punch the target (sandbag) of the internal in accordance with changes of the angle of target impact with the physical characteristics.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.19 no.9
• /
• pp.2006-2013
• /
• 2015

Deaf are it is difficult to communicate to represent the voice heard, so theay use mostly using the speech, sign language, writing, etc. to communicate. It is the best way to use sign language, in order to communicate deaf and normal people each other. But they must understand to use sign language. In this paper, we designed and implementated finger language translation system to support communicate between deaf and normal people. We used leap motion as input device that can track finger and hand gesture. We used raspberry pi that is low power sing board computer to process input data and translate finger language. We implemented application used Node.js and MongoDB. The client application complied with HTML5 so that can be support any smart device with web browser.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.53 no.12
• /
• pp.169-174
• /
• 2016

In this study, we evaluated the virtual reality model for dental implant surgery and discussed about the method to make the surgical environment for virtual reality with practical patient data. The anatomical model for patient face was fabricated by facial and oral scan data based on CT data. The simulation scenario was composed step by step fashion with Unity3D. From incision and sinus bone graft procedure which is needed to this patient model to implant installation and bone graft was included in this scenario. We used the HMD and leap motion for immersiveness and feeling of real operation. Twenty training doctor was attended this simulation study, and surveyed their satisfactory results by questionnaire. Implant surgery education program was showed the possibilities of educational tool for dental students and training doctors. Virtual reality for surgical education with HMD and leap motion had advantages, in terms of cheap prcie, easy access.

• Journal of Korea Game Society
• /
• v.17 no.3
• /
• pp.53-62
• /
• 2017

VR content manipulation equipment is not easy for individuals to access because it requires high prices. Especially, in the case of a system for tracking the motion of the user among the VR contents, a separate optical sensor device using an infrared camera is generally used. The disadvantage of the optical sensor equipment is that the measurable range is dependent on the measurement direction when tracking the rotation motion when using only a single device. In order to solve the above problems, this paper shows that the inertial sensor of the smartphone, which is generally owned by the public, can track the rotational motion of the user regardless of the measurement direction . The system using the LeapMotion is used as the reference system, and the system using the smart phone is defined as the evaluation system, and the usability of the evaluation system is verified by comparing the user satisfaction of the two systems.

• The Journal of Society for e-Business Studies
• /
• v.21 no.2
• /
• pp.97-119
• /
• 2016

Motion-sensing interface enhances the sense of reality of user experience in virtual reality context. This study analyzes the innovation resistance and adoption structure for Leap Motion, which provides a motion-sensing function, primarily considering the theory of perceived risk. Previous research regarding innovation resistance and adoption mainly addressed the resultant aspects of perceived risk, or the impact of perceived value on the adoption intention. This study synthetically reviews previous studies from a multi-dimensional view considering both resistance- and adoption-perspective. To do so, we identified important antecedents that affect perceived risk and value, and we analyzed the compound dynamics of perceived risk and value towards innovation resistance. As a result, we found that the antecedents included in the existent acceptance models from adoption-perspective can help reduce the level of perceived risk, and that higher perceived value leads to lower innovation resistance. Additionally, trialability can rather foster the perceived risk.

• Journal of the Korea Convergence Society
• /
• v.10 no.11
• /
• pp.111-116
• /
• 2019

With recent rapid development of computer capabilities, various technologies that can facilitate the interaction between humans and computers are being studied. The paradigm tends to change to NUI using the body such as 3D motion, haptics, and multi-touch with GUI using traditional input devices. Various studies have been conducted on transferring human movements to computers using sensors. In addition to the development of optical sensors that can acquire 3D objects, the range of applications in the industrial, medical, and user interface fields has been expanded. In this paper, I provide a model that can execute other programs through gestures instead of the mouse, which is the default input device, and control Windows based on the lip motion. To propose a model which converges with an Android application and can be controlled by various media and voice instruction functions using voice recognition and buttons through connection with a main client. It is expected that Internet media such as video and music can be controlled not only by a client computer but also by an application at a long distance and that convenient media viewing can be performed through the proposal model.

• The Journal of the Acoustical Society of Korea
• /
• v.36 no.2
• /
• pp.130-135
• /
• 2017

In this paper, we propose an interface for interactive sound experience in the virtual concert hall. The proposed interface consists of two systems, called 'virtual acoustic position' and 'virtual active listening'. To provide these systems, we applied an artificial reverberation algorithm, multi-channel source separation and head-related transfer function. The proposed interface was implemented by using Unity. The interface provides the virtual concert hall to user through Oculus Rift, one of the virtual reality headsets. Moreover, we used Leap Motion as a control device to allow a user experience the system with free-hand. And user can experience the sound of the system through headphones.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.552-554
• /
• 2019

Deaf mutism (a hearing-impaired person and speech disorders) communicates using sign language. There are difficulties in communicating by voice. However, sign language can only be limited in communicating with people who know sign language because everyone doesn't use sign language when they communicate. In this paper, a finger language translation system is proposed and implemented as a means for the disabled and the non-disabled to communicate without difficulty. The proposed algorithm recognizes the finger language data by leap motion and self-learns the data using machine learning technology to increase recognition rate. We show performance improvement from the simulation results.