• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.1
• /
• pp.47-54
• /
• 2024

With the rapid development of 3D animation, MetaHuman is widely used in film production, game development and VR production as a virtual human creation platform.In the animation production of virtual humans, motion capture is usually used.Since different motion capture solutions use different skeletons for motion recording, when the skeleton level of recorded animation data is different from that of MetaHuman, the animation data recorded by motion capture cannot be directly used on MetaHuman. This requires Reorient the skeletons of both.This study explores an efficient skeleton reorientation method that can maintain the accuracy of animation data by reducing the number of bone chains.In the experiment, three skeleton structures, Rokoko, Mixamo and Xsens were used for efficient redirection experiments, to compare and analyze the adaptability of different skeleton structures to the MetaHuman skeleton, and to explore which skeleton structure has the highest compatibility with the MetaHuman skeleton.This research provides an efficient skeleton reorientation idea for the production team of 3D animated video content, which can significantly reduce time costs and improve work efficiency.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.19 no.3
• /
• pp.61-75
• /
• 2023

In this paper, we design and experiment a 5G-based metaverse motion synchronization system with configuration of a mobile motion capture studio that has not been commercialized at home and abroad. As a result of the experiment, the average value of the latency test measurement using Wi-Fi is 0.134 seconds faster than the average latency test measurement value using the 5G network. Existing motion capture studios have spatial limitations as the motion capture range is limited to the Wi-Fi communication range. However, the 5G-based metaverse motion synchronization system configures a mobile motion capture studio so that motion performers can solve the spatial limitations by expanding the motion capture communication range indefinitely regardless of time and place. Therefore, it is possible to implement realistic metaverse contents by displaying a realistic and natural digital human because it is free from spatial constraints. The system which was tested in this paper can create a new business model by converging next-generation technologies that are receiving attention related to the digital virtual world, such as motion capture + 5G + digital human twin + metaverse. And it allows for research and develop a next-generation metaverse-based broadcasting solution at a recent time when the business value of digital human and metaverse technologies and functions has been proven and related sales are growing in earnest.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.1625-1628
• /
• 2003

Recently the VR technique has evolved into a mixed reality (MR) technique, in which a user can observe a real world in front of him/her as well as virtual objects displayed. This has been realized by the employment of a see-through type HMD (S-HMD). We have been developing a mixed reality space employing the MR technique. The objective of our study is to realize a virtual human that acts as a man-machine interface in the real space. It is important in the study to create a virtual human acting naturally in front of a user. In order to give natural motions to the virtual human, we employ a developed motion capture technique. We have already created various 3-D human motion models by the motion capture technique. In this paper, we present a technique for creating a virtual human using a human model provided by a computer graphics software, 3D Studio Max(C). The main difficulty of this issue is that 3D Studio Max(C) claims 28 feature points for describing a human motion, but the used motion capture system assumes less number of feature points. Therefore a technique is proposed in the paper for producing motion data of 28 feature points from the motion data of less number of feature points or from incomplete motion data. Performance of the proposed technique was examined by observing visually the demonstration of some motions of a created virtual human and overall natural motions were realized.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.6
• /
• pp.44-56
• /
• 2008

Previous hardware devices to capture human motion have many limitations; expensive equipment, complexity of manipulation or constraints of human motion. In order to overcome these problems, real-time motion capture algorithms based on computer vision have been actively proposed. This paper presents an efficient analysis method of multiple view images for real-time motion capture. First, we detect the skin color regions of human being, and then correct the image coordinates of the regions by using camera calibration and epipolar geometry. Finally, we track the human body part and capture human motion using kalman filter. Experimental results show that the proposed algorithm can estimate a precise position of the human body.

• Journal of Computational Design and Engineering
• /
• v.1 no.1
• /
• pp.1-12
• /
• 2014

In this paper, we propose a new method of reconstructing the hand models for individuals, which include the link structure models, the homologous skin surface models and the homologous tetrahedral mesh models in a reference posture. As for the link structure model, the local coordinate system related to each link consists of the joint rotation center and the axes of joint rotation, which can be estimated based on the trajectories of optimal markers on the relative skin surface region of the subject obtained from the motion capture system. The skin surface model is defined as a three-dimensional triangular mesh, obtained by deforming a template mesh so as to fit the landmark vertices to the relative marker positions obtained motion capture system. In this process, anatomical dimensions for the subject, manually measured by a caliper, are also used as the deformation constraints.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.9
• /
• pp.4624-4644
• /
• 2019

With the development of films, games and animation industry, analysis and reuse of human motion capture data become more and more important. Human motion segmentation, which divides a long motion sequence into different types of fragments, is a key part of mocap-based techniques. However, most of the segmentation methods only take into account low-level physical information (motion characteristics) or high-level data information (statistical characteristics) of motion data. They cannot use the data information fully. In this paper, we propose an unsupervised framework using both low-level physical information and high-level data information of human motion data to solve the human segmentation problem. First, we introduce the algorithm of CFSFDP and optimize it to carry out initial segmentation and obtain a good result quickly. Second, we use the ACA method to perform optimized segmentation for improving the result of segmentation. The experiments demonstrate that our framework has an excellent performance.

• The Journal of the Korea Contents Association
• /
• v.7 no.4
• /
• pp.160-169
• /
• 2007

Main problem in the domestic motion capture type production is that motion data are used even in the case when the human sensibility is needed. In other words it fails to give human images to the work, and production method only use motion capture data unconditionally and impetuously. Even though motion capture is effective and are various and applicable to various areas, it would cause enormous lose of capital and manual labor if these problems are not solved. In the present study, we compare motion capture with key animation production and analyze the merits and short comings of them. Also, we analyze them through the actual production and present the efficient method of key animation production when the expensive motion capturing devices are not available.

• Proceedings of the Korea Contents Association Conference
• /
• 2006.11a
• /
• pp.824-828
• /
• 2006

Introduction of motion capture system to the field of digital entertainment paved the way to accelerate the development of 3D character animation all the more. Motion capture system has been developed of the level that it can capture the fierce motions of character particularly in the digital game image and improve the dynamic characteristics by capturing the movement of human muscle or express the human's true emotion by capturing wrinkles and expression on face. Such an extension of realistic expression enables them to be used increasingly in movie, TV, advertisement, music video, etc centering around the game industry in the field of digital entertainment. The fact is, however, that many difficulties are held in the image production process compared with the competing countries such as USA and Japan, owing to inferiorities in technical expertise and capital in the image production process using the local motion capture, insufficient professional human resources of motion capture and small size of local motion capture image market. Hence, this study intends to suggest the plan to improve the technical problems in terms of integrated motion capture system, motion capture professional human resources and motion capture in-house program development in the production process of digital entertainment image using the motion capture system by surveying local and overseas examples of image production.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.2
• /
• pp.87-92
• /
• 2024

The rapid development of artificial intelligence technology in recent years is evident, from the emergence of ChatGPT to innovations like Midjourney, Stable Diffution, and the upcoming SORA text-to-video technology by OPENai. Animation capture technology, driven by the AI technology trend, is undergoing significant advancements, accelerating the progress of the animation industry. Through an analysis of the current application of DEEPMOTION, this paper explores the development direction of AI motion capture technology, analyzes issues such as errors in multi-person object motion capture, and examines the vast prospects. With the continuous advancement of AI technology, the ability to recognize and track complex movements and expressions faster and more accurately, reduce human errors, enhance processing speed and efficiency. This advancement lowers technological barriers and accelerates the fusion of virtual and real worlds.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.2126-2131
• /
• 2005

Interactions of a humanoid with a human are important, when the humanoid is requested to provide people with human-friendly services in unknown or uncertain environment. Such interactions may require more complicated and human-like behaviors from the humanoid. In this work the arm motions of a human are discussed as the early stage of human motion imitation by a humanoid. A motion capture system is used to obtain human-friendly arm motions as references. However the captured motions may not be applied directly to the humanoid, since the differences in geometric or dynamics aspects as length, mass, degrees of freedom, and kinematics and dynamics capabilities exist between the humanoid and the human. To overcome this difficulty a method to adapt captured motions to a humanoid is developed. The geometric difference in the arm length is resolved by scaling the arm length of the humanoid with a constant. Using the scaled geometry of the humanoid the imitation of actor's arm motions is achieved by solving an inverse kinematics problem formulated using optimization. The errors between the captured trajectories of actor arms and the approximated trajectories of humanoid arms are minimized. Such dynamics capabilities of the joint motors as limits of joint position, velocity and acceleration are also imposed on the optimization problem. Two motions of one hand waiving and performing a statement in sign language are imitated by a humanoid through dynamics simulation.