• Journal of the Korea Computer Graphics Society
• /
• v.18 no.3
• /
• pp.9-16
• /
• 2012

In this paper, we present a new method for reconstructing detailed facial expression from roughly captured data with a small number of markers. Because of the difference in the required capture resolution between the full-body capture and the facial expression capture, they hardly have been performed simultaneously. However, for generating natural animation, a simultaneous capture for body and face is essential. For this purpose, we provide a method for capturing the detailed facial expression only with a small number of markers. Our basic idea is to build a database for the facial expressions and apply the principal component analysis for reducing the dimensionality. The dimensionality reduction enables us to estimate the full data from a part of the data. We justify our method by applying it to dynamic scenes to show the viability of the method.

• Smart Structures and Systems
• /
• v.19 no.6
• /
• pp.679-694
• /
• 2017

The complexity, enlargement and irregularity of structures and multi-directional dynamic loads acting on the structures can lead to unexpected structural behavior, such as torsion. Continuous torsion of the structure causes unexpected changes in the structure's stress distribution, reduces the performance of the structural members, and shortens the structure's lifespan. Therefore, a method of monitoring the torsional behavior is required to ensure structural safety. Structural torsion typically occurs accompanied by displacement, but no model has yet been developed to measure this type of structural response. This research proposes a model for measuring dynamic torsional response of structure accompanied by displacement and for identifying the torsional modal parameter using vision-based displacement measurement equipment, a motion capture system (MCS). In the present model, dynamic torsional responses including pure rotation and translation displacements are measured and used to calculate the torsional angle and displacements. To apply the proposed model, vibration tests for a shear-type structure were performed. The torsional responses were obtained from measured dynamic displacements. The torsional angle and displacements obtained by the proposed model using MCS were compared with the torsional response measured using laser displacement sensors (LDSs), which have been widely used for displacement measurement. In addition, torsional modal parameters were obtained using the dynamic torsional angle and displacements obtained from the tests.

• Journal of Broadcast Engineering
• /
• v.11 no.4 s.33
• /
• pp.533-540
• /
• 2006

In this study we propose to use a facial motion capture technique to track facial motions and expressions effectively by using the stereo vision module, which has two CMOS IMAGE SENSORS. In the proposed tracking algorithm, a center point tracking technique and correlation tracking technique, based on neural networks, were used. Experimental results show that the two tracking techniques using stereo vision motion capture are able to track general face expressions at a 95.6% and 99.6% success rate, for 15 frames and 30 frames, respectively. However, the tracking success rates(82.7%,99.1%) of the center point tracking technique was far higher than those(78.7%,92.7%) of the correlation tracking technique, when lips trembled.

• Smart Structures and Systems
• /
• v.18 no.3
• /
• pp.625-642
• /
• 2016

The rapid technology developments in smartphones have created a significant opportunity for their use in structural live load measurements. This paper presents extensive experiments conducted in two stages to investigate this opportunity. Shaking table tests were carried out in the first stage using selected popular smartphones to measure the sinusoidal waves of various frequencies, the sinusoidal sweeping, and earthquake waves. Comparison between smartphone measurements and real inputs showed that the smartphones used in this study gave reliable measurements for harmonic waves in both time and frequency domains. For complex waves, smartphone measurements should be used with caution. In the second stage, three-dimensional motion capture technology was employed to explore the capacity of smartphones for measuring the movement of individuals in walking, bouncing and jumping activities. In these tests, reflective markers were attached to the test subject. The markers' trajectories were recorded by the motion capture system and were taken as references. The smartphone measurements agreed well with the references when the phone was properly fixed. Encouraged by these experimental validation results, smartphones were attached to moving participants of this study. The phones measured the acceleration near the center-of-mass of his or her body. The human-induced loads were then reconstructed by the acceleration measurements in conjunction with a biomechanical model. Satisfactory agreement between the reconstructed forces and that measured by a force plate was observed in several instances, clearly demonstrating the capability of smartphones to accurately assist in obtaining human-induced load measurements.

• Journal of Internet Computing and Services
• /
• v.24 no.4
• /
• pp.47-56
• /
• 2023

This paper presents an approach to exercise that utilizes motion capture through the Rokoko Smart Suit. With the emergence of Covid-19, physical fitness levels have declined due to restrictions on in-person fitness classes and gym closures. To maintain physical activity, many individuals have turned to mobile applications and streaming videos. However, home workouts often lack the motivation and experience found in gyms, classes, or community centers, particularly with the presence of coaches and instructors. Additionally, instructors find it challenging to convey precise postures to their online students, and vice versa. To address this issue, the researchers propose the use of a full-body tracking suit like the Rokoko Smart Suit, which enables instructors to present a more realistic approach to physical activity. The Rokoko Smart Suit offers a 3D view of the instructor, eliminating the limitations of camera scope when streaming on platforms like Zoom or MS Teams. This technology enhances the at-home workout experience, and the incorporation of 3D virtual reality features can further elevate the realism of a workout.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.2481-2485
• /
• 2003

In this paper novel concept of real reality robot game controlled by a mobile server robot is proposed. Real reality robot game means that two real robots controlled by two human operator through the internet are playing a boxing game. The mobile server robot captures playing images of the boxing game and send them to GUI on the screen of human operators’ PC. The human operator can login to boxing game from any computer in any place if he/she is permitted. Remote control of boxing robot by a motion capture system through network is implemented. Successful motion control of a boxing robot remotely controlled by a motion capture system through network can be achieved.

• Journal of Institute of Control, Robotics and Systems
• /
• v.11 no.12
• /
• pp.977-983
• /
• 2005

In this paper, novel ubiquitous concept of real reality robot game controlled by a mobile server robot is proposed. Real reality robot game means that two real robots controlled by humans/computers through the internet are playing a boxing game. The mobile server robot captures playing images of the boxing game and sends them to GUI on the screen of human operators' PC. The human operator can login to the boxing game from any computer in any place if he/she is permitted. Remote control of a boxing robot by a motion capture system through network is implemented. Successful motion control of a boxing robot remotely controlled by a motion capture system through network can be achieved. In addition, real boxing games between a human and a computer are demonstrated.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.1075-1080
• /
• 2007

본 논문에서는 댄스를 디지털콘텐츠와 접목시켜 누구나 쉽고 재미있게 즐길 수 있는 체험형 콘텐츠를 개발하고자 한다. 개발된 콘텐츠에서는 마우스나 키보드 등의 정적 입력 인터페이스를 벗어나 체험자의 능동적 참여를 위해 영상처리기술을 통해 PC 카메라로부터 얻은 영상에서 체험자의 모습을 분리하고 댄스 모션이 적용된 3D 모델과 같은 공간에 출력하여 두 모델간의 동작을 비교함으로써 같은 동작을 취하고 있는지를 판단하게 된다. 이때 체험자에게 어떠한 센서나 마커도 부착하지 않고 강건한 환경에서의 체험자 영상만을 추출하기 위한 방법과 댄스 모델과 체험자의 움직임 비교 방법을 새로이 제안하였다.

• Proceedings of the IEEK Conference
• /
• 2008.06a
• /
• pp.1025-1026
• /
• 2008

This paper describes a monocular PSD-based motion capture sensor to employ with commercial video game systems such as Microsoft's XBOX and Sony's Playstation II. The system includes a PSD(Position Sensitive Detector) and active infrared (IR) LED markers that are placed on the object to be tracked. The micro-controller calculates the 3D position of the markers using only the measured intensity and the 2D position on the PSD. A series of experiments were performed to evaluate the performance of our prototype system. From the experimental results we see that the proposed system has the advantages of the compact size, the low cost, the easy installation, and the high frame rates to be suitable for high speed motion tracking in games.

• Proceedings of the KSME Conference
• /
• 2003.04a
• /
• pp.805-809
• /
• 2003

We developed a human-sized BWR(biped walking robot) named KUBIR1 driven by a new actuator based on the ball screw which has high strength and high gear ratio. KUBIR1 was developed to walk autonomously such that it is actuated by small torque motors and is boarded with DC battery and controllers. To utilize the information on the human walking motion and to analyze the walking mode of robot, a motion capture system was developed. The system is composed of the mechanical and electronic devices to obtain the joint angle data. By using the obtained data, a 3-D graphic interface was developed based on the OpenGL tool. Through the graphic interface, the control input of KUBIR1 is performed.