• The Journal of the Korea institute of electronic communication sciences
• /
• v.12 no.6
• /
• pp.1127-1134
• /
• 2017

In this study, the robot arm control system was implemented that is operated by human hands, which can be used in environments that are inaccessible to humans. This function has to be sent to the robot's arms after extracting coordinates of human hands. Through mapping and bluetooth communication we use a leap motion sensor with infrared light and Image recognition sensor.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.10a
• /
• pp.231-232
• /
• 2014

We develop a remote control system of a walking robot using a Leap motion sensor. Hand gestures and the position of fingers are provided from the Leap motion sensor. We use Processing and the LeapMotionP5 library for the development software.

• KIISE Transactions on Computing Practices
• /
• v.21 no.5
• /
• pp.343-350
• /
• 2015

While many games have been published that are used with input-devices such as a mouse and keyboard, the number of games that can recognize the behavior of a human utilizing devices such as Kinect and Wii has increased. In this paper, we present the development of a baseball game that utilizes a Leap Motion Controller. A Leap Motion Controller recognizes accurately the movement of a user's fingers. Our implemented game consists of characters, a background and animation. It is a moving animated game in which the users play a game in point of view of a third person. The major feature of our game is that the game players can enjoy the game using a Leap Motion Controller.

• Journal of the Korea Convergence Society
• /
• v.10 no.11
• /
• pp.111-116
• /
• 2019

With recent rapid development of computer capabilities, various technologies that can facilitate the interaction between humans and computers are being studied. The paradigm tends to change to NUI using the body such as 3D motion, haptics, and multi-touch with GUI using traditional input devices. Various studies have been conducted on transferring human movements to computers using sensors. In addition to the development of optical sensors that can acquire 3D objects, the range of applications in the industrial, medical, and user interface fields has been expanded. In this paper, I provide a model that can execute other programs through gestures instead of the mouse, which is the default input device, and control Windows based on the lip motion. To propose a model which converges with an Android application and can be controlled by various media and voice instruction functions using voice recognition and buttons through connection with a main client. It is expected that Internet media such as video and music can be controlled not only by a client computer but also by an application at a long distance and that convenient media viewing can be performed through the proposal model.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2015.10a
• /
• pp.1019-1022
• /
• 2015

사회적 약자인 청각장애인들의 수화통역 서비스가 대체로 만족스럽게 제공되고 있지 않다. 또한 청각 장애인수 대비 수화통역가의 부족과 일반인과의 즉각적인 소통이 어려워 일상생활에 불편함을 느끼는 청각장애인들이 많다. 이의 문제점을 착안하여 본 연구에서는 청각장애인들이 휴대할 수 있는 수화 통역기를 개발하고자 한다. 청각장애인들의 손동작을 인식할 수 있는 3D센서 립모션(Leap-Motion)을 통해 수화를 인식한다. 립모션 센서와 안드로이드 스마트폰 및 태블릿과 연결하여 손 데이터 값을 분석했다. 분석한 손 데이터 값과 특정 지화(자음, 모음)와 간단한 인사말의 수화동작을 취할 때, 트래킹되는 데이터 값을 비교하여 수화를 인식하고 수화와 인식된 지화의 자음과 모음을 글자로 완성시켜, 텍스트와 음성으로 출력한다. 또한 립모션이 부착된 하드케이스 안에 스마트기기 탈착이 가능한 실용성 있는 수화통역기 제품 개발에 대한 연구를 목표로 하고 있다.

• Journal of Korea Game Society
• /
• v.17 no.3
• /
• pp.53-62
• /
• 2017

VR content manipulation equipment is not easy for individuals to access because it requires high prices. Especially, in the case of a system for tracking the motion of the user among the VR contents, a separate optical sensor device using an infrared camera is generally used. The disadvantage of the optical sensor equipment is that the measurable range is dependent on the measurement direction when tracking the rotation motion when using only a single device. In order to solve the above problems, this paper shows that the inertial sensor of the smartphone, which is generally owned by the public, can track the rotational motion of the user regardless of the measurement direction . The system using the LeapMotion is used as the reference system, and the system using the smart phone is defined as the evaluation system, and the usability of the evaluation system is verified by comparing the user satisfaction of the two systems.

• The Journal of the Korea Contents Association
• /
• v.19 no.11
• /
• pp.270-277
• /
• 2019

These days, with the advent of digital broadcasting, media environment offers users an opportunity to enjoy differentiated contents in a more aggressive fashion through user-media interactions based on computer technology. In fact, the development of contents which can induce spontaneous acts from users such as outdoor ads which use certain sensors and devices and exhibition halls has been active. With the development of low-price motion recognition devices, people have been able to enjoy diverse interaction-applied media by recognizing users' motion data without body contact. In this paper, we developed an interactive media player that can recognize the user's motion and control the video in the web service environment without installing a specific program. In addition, we set user motion recognition range and developed a user motion recognition algorithm suitable for the Leap Motion equipment installed in the kiosk. The results of this study can be experienced by various interactive media such as interactive tourism, education, and movie contents in kiosks that can be installed in public places.

• Journal of Digital Contents Society
• /
• v.19 no.2
• /
• pp.319-325
• /
• 2018

The general public's interest in dementia has increased recently as dementia has become a social issue due to its rapid aging. Several dementia prevention and rehabilitation programs are being carried out at the dementia rehabilitation center and at the old welfare center depending on the number of dementia patients. In this paper, a 3 dimensional finger and motion search of the leap motion is utilized and combined with dementia preventive and cognitive rehabilitation programs at various facilities. We suggest technologies that can provide both fun and effective treatment and rehabilitation content for rehabilitation therapists. A variety of cognitive enhancement content is designed using finger tracking and configured to be recorded in the database for rehabilitation programmes to increase the effectiveness of management.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.11a
• /
• pp.39-41
• /
• 2018

본 논문은 본인이 제작한 라는 인터랙티브 미디어 아트 작품에 관련한 글이다. 발전하는 디지털 기술 안에서 아날로그 감성을 이끌어내기 위한 작품 제작 방법으로 손으로 그린 나뭇잎을 입자로 사용한 파티클 시스템을 이용하였다. 그리고 NUI 인터페이스인 립모션 센서를 사용해 자연스러운 손 동작 인식을 하여 파티클 시스템과 연동하였다. 관람자는 바람을 일으키는 손 동작을 하며 가을 풍경과 같은 나뭇잎 파티클의 변화를 느끼게 되고, 계속되는 손동작에 따라 나타난 새로운 동영상을 감상하며 잃어버린 감성을 느끼게 된다. 아날로그 컨텐츠와 디지털 기술의 융합은 관람자에게 친근한 접근과 감성을 자극함으로써 인터렉티브 미디어 아트의 새로운 확장의 가능성을 보여준다.

• Journal of Biomedical Engineering Research
• /
• v.42 no.4
• /
• pp.186-192
• /
• 2021

In this paper, we evaluated prediction accuracy of Euler angle spectrograph classification method using a convolutional neural networks (CNN) for hand gesture recognition in augmented reality (AR) cognitive rehabilitation system based on Leap Motion Controller (LMC). Hand gesture recognition methods using a conventional support vector machine (SVM) show 91.3% accuracy in multiple motions. In this paper, five hand gestures ("Promise", "Bunny", "Close", "Victory", and "Thumb") are selected and measured 100 times for testing the utility of spectral classification techniques. Validation results for the five hand gestures were able to be correctly predicted 100% of the time, indicating superior recognition accuracy than those of conventional SVM methods. The hand motion recognition using CNN meant to be applied more useful to AR cognitive rehabilitation training systems based on LMC than sign language recognition using SVM.