• The Journal of the Korea Contents Association
• /
• v.20 no.5
• /
• pp.69-78
• /
• 2020

K/DA is a K-pop virtual idol based on the game character. This study analyzed the creation process, characteristics and existential meaning of virtual idols from the perspective of Pataphysics. K/DA is a character with both characteristics of game character and K-pop girl group. Also, virtual character and real idol share the body through motion capture and augmented reality(AR). As a result, K/DA crosses virtual and reality, and at the same time becomes a pataphysical subject that does not belong to either virtual or reality. K/DA is suggested a third zone where digital subjects will be located in the future.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2019.05a
• /
• pp.160-161
• /
• 2019

As a method for modeling a three-dimensional object, there are a method using a 3D scanner, a method using a motion capture system, and a method using a Kinect system. Through this method, a portion that is not captured due to occlusion occurs in the process of creating a three-dimensional object. In order to implement a perfect three-dimensional object, it is necessary to arbitrarily fill the obscured part. There is a technique to fill the unexposed part by various image processing methods. In this study, we propose a method using GANs, which is the latest trend of unsupervised machine learning, as a method for more natural hole-filling.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.05a
• /
• pp.5-7
• /
• 2021

Motion capture data files for pose estimation may have inaccurate data depending on the surrounding environment and the degree of movement, so it is necessary to correct it. In the past, inaccurate data was restored with post-processing by people, but recently various kind of neural networks such as LSTM and R-CNN are used as automated method. However, since neural network-based data restoration methods require a lot of computing resource, this paper proposes a method that reduces computing resource and maintains data restoration rate compared to neural network-based method. The proposed method automatically restores inaccurate motion capture data by using posture measurement data (c3d). As a result of the experiment, data restoration rates ranged from 89% to 99% depending on the degree of inaccuracy of the data.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2010.04a
• /
• pp.150-153
• /
• 2010

본 연구에서는 적외선 카메라를 이용하는 모션캡처 시스템에서의 전통적인 문제인 마커의 손실과 스왑을 해결할 수 있는 방법에 대해 제안한다. 기본적으로 적외선 센서를 이용하여 마커의 위치를 계산하여 모션을 캡처하는 방식을 사용한다. 여기에 각 마커에 식별이 가능한 고유한 아이디를 지정할 수 있게 하기 위해 적외선 반사판의 색깔을 다르게 제작하였다. 적외선 카메라를 이용하여 마커에서 반사되는 적외선의 좌표를 촬영하고 일반 카메라를 이용하여 마커의 위치와 색깔을 구별한다. 실험 결과 각 마커의 식별이 가능했으며 카메라를 들고 이동하면서도 정확하고 빠르게 모션을 캡처할 수 있음을 실험을 통해 증명하였다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2022.05a
• /
• pp.236-238
• /
• 2022

VR/AR(가상현실/증강현실) 디바이스 기술 진보가 가속화되고 관련 시장이 확대되면서 메타버스 플랫폼이 최근 많은 주목을 받고 있다. 하지만 새로운 플랫폼 개발에도 불구하고 사용자를 인증하는 방식은 기존의 PC와 모바일 플랫폼의 인증방식을 따라가고 있다. 본 논문에서 우리는 메타버스에서 기존 PC/모바일 인증 방식을 그대로 적용했을 때 발생할 수 있는 문제점을 제기하고, 모션캡처를 이용하여 사용자의 모션을 입력 받아 메타버스플랫폼에서 활용할 수 있는 사용자 인증방식을 제안한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.07a
• /
• pp.461-462
• /
• 2023

많은 사람이 사회적 문제로 인하여 대두되고 있는 스트레스 및 정신질환 문제를 해소하기 위하여 다양한 문화생활을 선택하고 있다. 그중 휴식을 제외하면 취미, 오락, 스포츠가 가장 큰 비중을 가지고 있다. 본 논문에서는 모션 캡처를 활용하여 움직임의 변화를 인식하고 이에 따라 신디사이저 사운드를 발생시키는 시스템을 제작하였다. 해당 시스템은 악기를 대신하여 연주와 춤이 동시에 이루어져 취미와 스포츠가 결합 된 새로운 여가 활동의 가능성을 제기하며, 공연 및 아이들의 교육적 목적으로 활용되는 등 교육적, 신체적, 심리적 건강을 위하여 활용될 수 있다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.19 no.5
• /
• pp.1199-1206
• /
• 2015

This paper introduces an algorithm for computing similarity between two poses in the motion capture data with different scale of skeleton, different number of joints and different joint names. The proposed algorithm first performs the topological analysis on the skeleton hierarchy for classifying the joints into more meaningful groups. The global joints positions of each joint group then are aggregated into a point cloud. The number of joints and their positions are automatically adjusted in this process. Once we have two point clouds, the algorithm finds an optimal 2D transform matrix that transforms one point cloud to the other as closely as possible. Then, the similarity can be obtained by summing up all distance values between two points clouds after applying the 2D transform matrix. After some experiment, we found that the proposed algorithm is able to compute the similarity between two poses regardless of their scale, joint name and the number of joints.

• Journal of IKEEE
• /
• v.23 no.4
• /
• pp.1295-1301
• /
• 2019

In this paper, we propose a novel method of denoising human motion using a bidirectional recurrent neural network (BRNN) with an attention mechanism. The corrupted motion captured from a single 3D depth sensor camera is automatically fixed in the well-established smooth motion manifold. Incorporating an attention mechanism into BRNN achieves better optimization results and higher accuracy than other deep learning frameworks because a higher weight value is selectively given to a more important input pose at a specific frame for encoding the input motion. Experimental results show that our approach effectively handles various types of motion and noise, and we believe that our method can sufficiently be used in motion capture applications as a post-processing step after capturing human motion.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.47 no.6
• /
• pp.39-47
• /
• 2010

A research of image-based articulated pose estimation has some problems such as detection of human feature, precise pose estimation, and real-time performance. In particular, various methods are currently presented for recovering many joints of human body. We propose the novel numerical inverse kinematics improved with the UKF(unscented Kalman filter) in order to estimate the human pose in real-time. An existing numerical inverse kinematics is required many iterations for solving the optimal estimation and has some problems such as the singularity of jacobian matrix and a local minima. To solve these problems, we combine the UKF as a tool for optimal state estimation with the numerical inverse kinematics. Combining the solution of the numerical inverse kinematics with the sampling based UKF provides the stability and rapid convergence to optimal estimate. In order to estimate the human pose, we extract the interesting human body using both background subtraction and skin color detection algorithm. We localize its 3D position with the camera geometry. Next, through we use the UKF based numerical inverse kinematics, we generate the intermediate joints that are not detect from the images. Proposed method complements the defect of numerical inverse kinematics such as a computational complexity and an accuracy of estimation.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.6
• /
• pp.41-49
• /
• 2009

In this paper, the multi-camera calibration algorithm for optical motion capture system is proposed. This algorithm performs 1st camera calibration using DLT(Direct linear transformation} method and 3-axis calibration frame with 7 optical markers. And 2nd calibration is performed by waving with a wand of known length(so called wand dance} throughout desired calibration volume. In the 1st camera calibration, it is obtained not only camera parameter but also radial lens distortion parameters. These parameters are used initial solution for optimization in the 2nd camera calibration. In the 2nd camera calibration, the optimization is performed. The objective function is to minimize the difference of distance between real markers and reconstructed markers. For verification of the proposed algorithm, re-projection errors are calculated and the distance among markers in the 3-axis frame and in the wand calculated. And then it compares the proposed algorithm with commercial motion capture system. In the 3D reconstruction error of 3-axis frame, average error presents 1.7042mm(commercial system) and 0.8765mm(proposed algorithm). Average error reduces to 51.4 percent in commercial system. In the distance between markers in the wand, the average error shows 1.8897mm in the commercial system and 2.0183mm in the proposed algorithm.