• Journal of the Korea Society of Computer and Information
• /
• v.29 no.5
• /
• pp.47-53
• /
• 2024

In this paper, we propose applying interactive technology in virtual environments to enhance interaction and immersion by inducing more natural movements in the gesture recognition process through the concept of affordance. A technique is proposed to recognize gestures most similar to actual hand movements by applying a line segment recognition algorithm, incorporating sampling and normalization processes in the gesture recognition process. This line segment recognition was applied to the drawing of magic circles in the <VR Spell> game implemented in this paper. The experimental method verified the recognition rates for four line segment recognition actions. This paper aims to propose a VR game that pursues greater immersion and fun for the user through real-time hand tracking technology using affordance Elements, applied to immersive content in virtual environments such as VR games.

• Journal of Advanced Navigation Technology
• /
• v.13 no.2
• /
• pp.262-271
• /
• 2009

The purpose of this study was to propose the method to recognize gestures based on inertia sensor which recognizes the movements of the user using inertia sensor and lets the user enjoy the game by comparing the recognized movements with the pre-defined movements for the game contents production. Additionally, it was tried to provide users with various data entry methods by letting them wear small controllers using three-axis accelerator sensor. Users can proceed the game by moving according to the action list printed on the screen. They can proceed the experiential games according to the accuracy and timing of their movements. If they use multiple small wireless controllers together wearing them on the major parts of hands and feet and utilize the proposed methods, they will be more interested in the game and be absorbed in it.

• Journal of Korea Game Society
• /
• v.19 no.3
• /
• pp.87-100
• /
• 2019

Serious games based on VR(Virtual Reality) and motion recognition technologies have been studied in physical therapy and have shown significant positive effects. These existing systems have focused on measuring performance for the general public rather than patients which need rehabilitation. In the paper, We propose a serious game of self-rehabilitation that measures the patient's current physical state to generate appropriate difficulty levels to aid patients with shoulder injury.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.11a
• /
• pp.154-157
• /
• 2011

인간의 동작 인식은 가상 현실 시스템 및 게임 등에 적용할 수 있는 컴퓨터 비전 분야의 요소 기술 중 하나로써, 최근까지 그 연구과 활발히 진행되고 있다. 본 논문에서는 빠르고 정확한 동작 인식을 위해, 실루엣과 모션 특징이 결합된 방법을 제안한다. 제안하는 방법은 전역 특징을 이용한 후보 동작 선정 및 지역 특징을 이용한 검증 2 단계로 구성된다. 전역 특징은 Motion History Image의 Hu 모멘트를 이용해 계산되며, 후보 동작의 선정은 이들의 통계치를 이용해 결정한다. 한정된 후보 동작들 중 입력 동작을 정확히 인식하기 위해, 공간 및 방향성 비닝 기법으로 추출된 광류와 실루엣 특징을 지역 특징으로 이용한다. 최종 인식 결과는 Hu 모멘트 통계치와의 유사도 및 지역 특징의 학습을 통해 생성된 Support Vector Machine의 결과를 고려하여 결정된다. 제안하는 방법의 성능을 평가하기 위해, 실세계에서 사용 빈도가 높으며 동작의 변화가 큰 13 개의 제스처를 선정하여 데이터 셋을 구성하였다. 실험 결과 제안하는 방법의 연산 시간은 50 ms, 인식 정확도는 95%임을 확인하였다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2012.06a
• /
• pp.361-363
• /
• 2012

Social Network Service는 웹상에서 인맥관계를 강화시키고 새로운 인맥을 쌓으며 폭넓은 인적 네트워크를 형성할 수 있도록 해주는 서비스로 지금 현재 사람들끼리 빠르게 많은 정보를 공유할 수 있고, 많은 사람들을 사귈 수 있다는 점에서 각광을 받고 있다. 키넥트는 센서를 통해 사용자의 동작을 인식하는 기계로 별개의 컨트롤러 없이 사용자의 신체만을 이용하여 다양한 게임과 엔터테인먼트를 경험할 수 있기 때문에 남녀노소 모두가 쉽게 즐길 수 있다는 장점이 있다. 또한 동작인식이라는 기능 때문에 본래의 목적인 게임용이 아닌 다른 여러 분야에서 응용되어 사용되고 있다. 본 논문에서는 소셜 네트워크 서비스에서 할 수 있는 정보공유와 인맥강화를 키넥트를 이용하여 보다 동적인 소셜 네트워크 서비스를 구축하는 것을 목적으로 한다. 키넥트의 동작인식 센서와 음성인식 센서를 이용하여 소셜 네트워크 서비스 중의 하나인 페이스북의 기능을 사용할 수 있게 한다.

• Journal of the Korea Society of Computer and Information
• /
• v.25 no.8
• /
• pp.111-117
• /
• 2020

Recently, with the high interest of machine learning, the need for educational controllers to interface with physical devices has increased. However, existing controllers are limited in terms of high cost and area of utilization for educational purposes. In this paper, motion control controllers using brain waves are proposed for the purpose of students' machine learning applications. The brain motion that occurs when imagining a specific action is measured and sampled, then the sample values were learned through Tensor Flow and the motion was recognized in contents such as games. Movement variation for motion recognition consists of directionality and jump motion. The identification of the recognition behavior is sent to a game produced by an Unreal Engine to operate the character in the game. In addition to brain waves, the implemented controller can be used in various fields depending on the input signal and can be used for educational purposes such as machine learning applications.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.20 no.12
• /
• pp.2297-2304
• /
• 2016

In this study, we designed and developed the virtual reality Exergame using the smart mat and the camera sensor for exercises in indoor environments. For detecting the gestures of a upper body of users, the KINECT camera based the gesture recognition algorithm used angles between user's joint information system was adopted, and the smart mat system including a LED equipment and Bluetooth communication module was developed for user's stepping data during the exercises that requires the gestures and stepping of users. Finally, the integrated virtual reality Exergame system was implement along with the Unity 3D engine and different kinds of user' virtual avatar characters with entertainment game contents such as displaying gesture guideline and a scoring function. Therefore, the designed system will useful for elders who need to improve cognitive ability and sense of balance or general users want to improve exercise ability and the indoor circumstances such home or wellness centers.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.13 no.4
• /
• pp.903-910
• /
• 2018

The necessary rehabilitation training for patients with disability currently does not match the actual amount of training conducted, which requires interest in rehabilitation treatment, continued investment and infrastructure for rehabilitation contents, while the most common forms of rehabilitation treatment comprises of art, music, and play treatments. In this paper, we provide a game-style rehabilitation program including audio and visual elements through motion detection process on the patient and design a digital game rehabilitation program that allows different level of management for various categories of disabled people.

• Journal of Korea Game Society
• /
• v.14 no.1
• /
• pp.49-58
• /
• 2014

We have developed a serious game for the elderly named 'Paldokangsan3' as a next version of 'Paldokangsan2' which was a walking game with memorization in shopping streets using controllers of hand buttons and foot boards with PC developed in 2012. The interface of had buttons and food boards were changed into the interface of motion capture with the aid of Kinect. The expected effects are improvement of memorization, improvement of concentration ability to find out items in the vision, improvement of vitality through physical walking actions, as well as improvement of mental health through entertainment activities of game play. We have tested 25 volunteers of more than 65 years old in Cheonan city community center for the elderly for 2 weeks. We got the result that the game play was showing positive effectiveness on memorization, physical exercise and self-esteem in mental health area of the elderly.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2014.11a
• /
• pp.1113-1115
• /
• 2014

본 프로젝트팀에서 개발한 'VTK'(Virtual Training by Kinect)는 아이부터 노인까지 모든 연령이 이용 가능한 기능성 게임으로써 동작인식 컨트롤러인 키넥트를 이용하여 불필요한 장비가 없이 동작인식을 통해 인터페이스가 가능하게 했다. 주요기능은 평가와 트레이닝, 통계분석 세 가지로 이루어져 있다. 사용자는 6분 걷기와 폐안시 외발서기를 통해 개인별 심폐지구력과 평형감각 수준을 알 수 있으며 조깅과 인라인 스케이트를 통해 기능 향상을 위한 트레이닝을 할 수 있다. 통계분석은 별도의 용용프로그램을 통해 확인 할 수 있다. 성장하고 있는 기능성 게임 시장에 새로운 방향성 제시를 목표로 하였다.