• Journal of Broadcast Engineering
• /
• v.25 no.3
• /
• pp.405-417
• /
• 2020

Due to the popularization of the Extended Reality, research is actively underway to implement human motion in real-time 3D animation. In particular, Microsoft developed Kinect cameras for 3D motion information can be obtained without the burden of facilities and with simple operation, real-time animation can be generated by combining with 3D formats such as FBX. Compared to the marker-based motion capture system, however, Kinect has low accuracy due to its lack of estimated performance of joint information. In this paper, two algorithms are proposed to correct joint estimation errors in order to realize natural human motion in motion capture animation system in Kinect camera-based FBX format. First, obtain the position information of a person with a Kinect and create a depth map to correct the wrong joint position value using the human body segment length constraint information, and estimate the new rotation value. Second, the pre-set joint motion range constraint is applied to the existing and estimated rotation value and implemented in FBX to eliminate abnormal behavior. From the experiment, we found improvements in human behavior and compared errors between algorithms to demonstrate the superiority of the system.

• KIPS Transactions on Software and Data Engineering
• /
• v.2 no.10
• /
• pp.723-730
• /
• 2013

This paper presents the design of an arm gesture recognition system using Kinect sensor. A variety of methods have been proposed for gesture recognition, ranging from the use of Dynamic Time Warping(DTW) to Hidden Markov Models(HMM). Our system learns a unique HMM corresponding to each arm gesture from a set of sequential skeleton data. Whenever the same gesture is performed, the trajectory of each joint captured by Kinect sensor may much differ from the previous, depending on the length and/or the orientation of the subject's arm. In order to obtain the robust performance independent of these conditions, the proposed system executes the feature transformation, in which the feature vectors of joint positions are transformed into those of angles between joints. To improve the computational efficiency for learning and using HMMs, our system also performs the k-means clustering to get one-dimensional integer sequences as inputs for discrete HMMs from high-dimensional real-number observation vectors. The dimension reduction and discretization can help our system use HMMs efficiently to recognize gestures in real-time environments. Finally, we demonstrate the recognition performance of our system through some experiments using two different datasets.

• Journal of Engineering Education Research
• /
• v.17 no.4
• /
• pp.15-20
• /
• 2014

The non-contact easy detecting system of nursing person's body vital information and their behaviors monitoring system are developed, which consist of "Kinect" sensor and thermography camera. The "Kinect" sensor can catch the body contour and the body moving behavior, and output their imaging data realtime. The thermography camera can detect respiration state and body temperature, etc. In this study, the practicability of this system was verified.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2015.07a
• /
• pp.309-310
• /
• 2015

본 연구는 뇌졸중 등의 상지 기능 손상에 대하여 원격지에 위치하는 환자에게 치료와 진단을 포함하는 재활 콘텐츠를 제공하는 시스템을 개발하기 위한 설계를 목적으로 하고 있다. 설계 콘텐츠의 구조는 가상현실로 재활과 관련된 상지의 움직임을 제시하고 실제 움직임을 키넥트 센서를 이용하여 추적하여, 시각/청각/촉각 피드백을 제시함으로써 재활 치료 효과와 몰입감을 높이고 상지 운동 기능을 평가하는 것으로 구성된다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.05a
• /
• pp.596-598
• /
• 2019

손동작 인식을 기반으로 한 Virtual fitting 시스템은 Kinect Sensor 를 사용하여 자연스러운 Fitting 을 구현할 수 있다. Kinect Sensor 를 이용한 Pose estimation, Gesture recognition, Virtual fitting 을 구현함으로써 가상으로 의복을 착용하는 소프트웨어를 소개한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• fall
• /
• pp.268-269
• /
• 2021

본 논문에서는 RGB이미지와 Depth 이미지를 촬영할 수 있는 촬영 장비인 Azure Kinect를 사용해 다시점 촬영 시스템 구성을 위한 카메라 동기화 시스템을 제안한다. 제안한 시스템에는 8대의 Azure Kinect 카메라를 사용하고 있으며 각 카메라는 3.5-mm 오디오 케이블로 연결되어 외부동기화 신호를 전달한다. 그리고 이미지를 저장할 때 발생하는 메모리에서의 병목현상을 최소화하기 위해 촬영 시스템의 동작을 16개의 버퍼로 나누어 병렬 컴퓨팅으로 진행한다. 이후 동기화 여부에 따른 차리를 디바이스 타임스탬프를 기준으로 하여 비교한다.

• Journal of Korea Game Society
• /
• v.16 no.5
• /
• pp.149-158
• /
• 2016

This research is about development and usability test of 'Paldokangsan4' which is a serious game for the elderly to improve their physical and mental health. This game is the next version of last 'Paldokangsan3' developed in 2013. Its motion capture interface 'Kinect' has been stopped for production that we have to develop the next version with 'Kinect2'. We added a personal ID system to accumulate palyers' game histories, and let the player know the the current score comparing to the personal average score every time. Also we added real mart background to the traditional old market background of the game as well as a tutorial level to learn how to play the game personally. In 2016 Play Expo, we have installed and demonstrated it and gathered opinions of 40 volunteers in questionnaire. The result of their analysis showed that we could find the possibility of beneficial effects for the elderly following the last version.

• Journal of Broadcast Engineering
• /
• v.18 no.3
• /
• pp.380-392
• /
• 2013

A method to classify a golf swing motion into 7 sections using a Kinect sensor and a fuzzy system is proposed. The inputs to the fuzzy logic are the positions of golf club and its head, which are extracted from the information of golfer's joint position and color information obtained by a Kinect sensor. The proposed method consists of three modules: one for extracting the joint's information, another for detecting and tracking of a golf club, and the other for classifying golf swing motions. The first module extracts the hand's position among the joint information provided by a Kinect sensor. The second module detects the golf club as well as its head with the Hough line transform based on the hand's coordinate. Using a fuzzy logic as a classification engine reduces recognition errors and, consequently, improves the performance of robust classification. From the experiments of real-time video clips, the proposed method shows the reliability of classification by 85.2%.

• Journal of the Korea Computer Graphics Society
• /
• v.22 no.4
• /
• pp.1-9
• /
• 2016

In this paper we present a projection mapping system onto human's moving hand by a projector as information delivery media and Kinect to recognize hand motion. Most traditional projection mapping techniques project a variety of images onto stationary objects, however, our system provides new user experience by projecting images onto the center of the moving palm. We explain development process of the system, and production of content as applications on our system. We propose hardware organization and development process of open software architecture based on object oriented programming approach. For stable image projection, we describe a device calibration method between the projector and Kinect in three dimensional space, and a denoising technique to minimize artifacts from Kinect coordinates vibration and unstable hand tremor.

• Journal of Broadcast Engineering
• /
• v.17 no.3
• /
• pp.447-458
• /
• 2012

We present a method to recognize hand gestures using skeletal joint data obtained from Microsoft's Kinect sensor. We propose a combination feature of multi-angle histograms robust to orientation variations to represent the observation sequence of skeletons. The proposed feature efficiently represents the orientation variations of gestures that can be occurred according to person or environment by combining the multiple angle histograms with various angular-quantization levels. The gesture represented as combination of multi-angle histograms and random decision forest classifier improve the recognition performance. We conduct the experiments in hand gesture dataset obtained from a kinect sensor and show that our method outperforms the other methods by comparing the recognition performance.