• Journal of Internet Computing and Services
• /
• v.21 no.3
• /
• pp.113-121
• /
• 2020

Human Pose Estimation (HPE) which localizes the human body joints becomes a high potential for high-level applications in the field of computer vision. The main challenges of HPE in real-time are occlusion, illumination change and diversity of pose appearance. The single RGB image is fed into HPE framework in order to reduce the computation cost by using depth-independent device such as a common camera, webcam, or phone cam. However, HPE based on the single RGB is not able to solve the above challenges due to inherent characteristics of color or texture. On the other hand, depth information which is fed into HPE framework and detects the human body parts in 3D coordinates can be usefully used to solve the above challenges. However, the depth information-based HPE requires the depth-dependent device which has space constraint and is cost consuming. Especially, the result of depth information-based HPE is less reliable due to the requirement of pose initialization and less stabilization of frame tracking. Therefore, this paper proposes a new method of HPE which is robust in estimating self-occlusion. There are many human parts which can be occluded by other body parts. However, this paper focuses only on head self-occlusion. The new method is a combination of the RGB image-based HPE framework and the depth information-based HPE framework. We evaluated the performance of the proposed method by COCO Object Keypoint Similarity library. By taking an advantage of RGB image-based HPE method and depth information-based HPE method, our HPE method based on RGB-D achieved the mAP of 0.903 and mAR of 0.938. It proved that our method outperforms the RGB-based HPE and the depth-based HPE.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.3
• /
• pp.45-52
• /
• 2022

A tangible sports game is an exercise game that uses sensors or cameras to track the user's body movements and to feel a sense of reality. Recently, VR indoor sports room systems installed to utilize tangible sports game for physical activity in schools. However, these systems primarily use screen-touch user interaction. In this research, we developed a V-Catch Vision system that uses AI image recognition technology to enable tracking of user movements in three-dimensional space rather than two-dimensional wall touch interaction. We also conducted a usability evaluation experiment to investigate the exercise effects of this system. We tried to evaluate quantitative exercise effects by measuring blood oxygen saturation level, the real-time ECG heart rate variability, and user body movement and angle change of Kinect skeleton. The experiment result showed that there was a statistically significant increase in heart rate and an increase in the amount of body movement when using the V-Catch Vision system. In the subjective evaluation, most subjects found the exercise using this system fun and satisfactory.

• International Journal of Internet, Broadcasting and Communication
• /
• v.12 no.1
• /
• pp.122-129
• /
• 2020

The circumference of the body is not only an indicator in order to buy clothes in our life but an important factor which can increase the effectiveness healing properly after figuring out the shape of body in a hospital. There are several measurement tools and methods so as to know this, however, it spends a lot of time because of the method measured by hand for accurate identification, compared to the modern advanced societies. Also, the current equipments for automatic body scanning are not easy to use due to their big volume or high price generally. In this papers, OpenPose model which is a deep learning-based Skeleton Tracking is used in order to solve the problems previous methods have and for ease of application. It was researched to find joints and an approximation by applying the data of the deep camera via reference data of the measurement parts provided by the hospitals and to develop a program which is able to measure the circumference of the body lighter and easier by utilizing the elliptical circumference formula.

• Journal of the Korea Society of Computer and Information
• /
• v.18 no.5
• /
• pp.53-60
• /
• 2013

This paper proposed visualization tool for motion of snowboarding using Skeleton data obtained by the Microsoft's Kinect sensor. The BBP(Balanced Body Position) posture is a most basic motion in the Snowboarding. This posture is the primary technology for stable turns. The implementation of visualization tool to analyse the BBP posture of snowboard. comparative analysis with standard postures to the ankles, knees, hips and spine angle of joints and body tracking using coordinate information obtained by the Kinect Sensor. Analysis of the final results of the screen through the OpenGL library. This research result could be used to analysis for turn postures of snowboarding.

• Journal of the Korea Computer Graphics Society
• /
• v.27 no.5
• /
• pp.1-11
• /
• 2021

The purpose of our research is to efficiently deform a 3D models which is composed of a triangular mesh and a skeleton. We designed a novel inverse kinematics (IK) solver that calculates the updated positions of mesh vertices with fewer computing operations. Through our user interface, one or more markers are selected on the surface of the model and their target positions are set, then the system updates the positions of surface vertices to construct a deformed model. The IK solving process for updating vertex positions includes many computations for obtaining transformations of the markers, their affecting joints, and their parent joints. Many of these computations are often redundant. We precompute those redundant terms in advance so that the 3-nested loop computation structure was improved to a 2-nested loop structure, and thus the computation time for a deformation is greatly reduced. This novel IK solver can be adopted for efficient performance in various research fields, such as handling 3D models implemented by LBS method, or object tracking without any markers.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.3
• /
• pp.1-8
• /
• 2017

In this paper, we introduce a technique to retarget human motion data to the humanoid body in a constrained environment. We assume that the given motion data includes detailed interactions such as holding the object by hand or avoiding obstacles. In addition, we assume that the humanoid joint structure is different from the human joint structure, and the shape of the surrounding environment is different from that at the time of the original motion. Under such a condition, it is also difficult to preserve the context of the interaction shown in the original motion data, if the retargeting technique that considers only the change of the body shape. Our approach is to separate the problem into two smaller problems and solve them independently. One is to retarget motion data to a new skeleton, and the other is to preserve the context of interactions. We first retarget the given human motion data to the target humanoid body ignoring the interaction with the environment. Then, we precisely deform the shape of the environmental model to match with the humanoid motion so that the original interaction is reproduced. Finally, we set spatial constraints between the humanoid body and the environmental model, and restore the environmental model to the original shape. To demonstrate the usefulness of our method, we conducted an experiment by using the Boston Dynamic's Atlas robot. We expected that out method can help the humanoid motion tracking problem in the future.