• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.2
• /
• pp.173-178
• /
• 2005

This paper focuses on the use of the virtual dialog system whose aim is to build more convenient living environments. In order to realize this, the main emphasis of the paper lies on the description of the multimedia signal processing on the basis of the technologies such as speech recognition, speech synthesis, video, or sensor signal processing. For essential modules of the dialog system, we incorporated the real-time speech recognizer based on HM-Net(Hidden Markov Network) as well as speech synthesis into the overall system. In addition, we adopted the real-time motion detector based on the changes of brightness in pixels, as well as the touch sensor that was used to start system. In experimental evaluation, the results showed that the proposed system was relatively easy to use for controlling electric appliances while sitting in a sofa, even though the performance of the system was not better than the simulation results owing to the noisy environments.

• Journal of the Institute of Convergence Signal Processing
• /
• v.8 no.4
• /
• pp.285-292
• /
• 2007

SoC which deploys software modules as well as hardware IPs on a single chip is a major revolution taking place in the implementation of a system design, and high-level synthesis is an important process of SoC design methodology. Recently, SPARK parallelizing high-level synthesis software tool has been developed. It takes a behavioral ANSI-C code as an input, schedules it using code motion and various code transformations, and then finally generates synthesizable RTL VHDL code. Although SPARK employs various loop transformation algorithms, the synthesis results generated by SPARK are not acceptable for basic signal and image processing algorithms with nested loop. In this paper we propose a SoC platform with an application-specific PLD targeting local operations which are feature of many loop algorithms used in signal and image processing, and demonstrate design process which maps behavioral specification with nested loops written in a high-level language (ANSI-C) onto 2D systolic array. Finally the derived systolic array is implemented on the proposed application-specific PLD of SoC platform.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.1
• /
• pp.33-38
• /
• 2017

In this paper, we suggest a method to simulate high-quality iguana animation by using low-quality motion capture data. Iguana motion data captured using a small number of markers cannot express its movement precisely, and even with a realistic skin mesh, it shows unnatural movement because of limited degrees of freedom. In order to solve this problem, we propose to simulate a natural and flexible movement by applying a soft-body simulation technique which models the movement of an iguana according to muscle forces and body's elastic forces. We construct a motion graph from the motion capture data to describe the iguana's various movements, and utilize it to select appropriate movements when the iguana moves. A target point on a terrain is set from the user's input, and a graph path is planned based on it. As a result, the input movement of iguana walking on a flat ground transforms to a movement that is adapted in an online manner to the irregular heights of the terrain. Such a movement is used to calculate the ideal muscle lengths that are needed for soft-body simulation. Lastly, a tetrahedral mesh of the iguana is physically simulated to adapt to various situations by applying a soft-body simulation technique.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.3
• /
• pp.105-113
• /
• 2017

This paper presents a novel on-line trajectory optimization framework based on automatic time warping, which performs the time warping of a reference motion while optimizing character motion control. Unlike existing physics-based character animation methods where sampling times for a reference motion are uniform or fixed during optimization in general, our method considers the change of sampling times on top of the dynamics of character motion in the same optimization, which allows the character to effectively respond to external pushes with optimal time warping. In order to do so, we formulate an optimal control problem which takes into account both the full-body dynamics and the change of sampling time for a reference motion, and present a model predictive control framework that produces an optimal control policy for character motion and sampling time by repeatedly solving the problem for a fixed-span time window while shifting it along the time axis. Our experimental results show the robustness of our framework to external perturbations and the effectiveness on rhythmic motion synthesis in accordance with a given piece of background music.

• Journal of the Korea Computer Graphics Society
• /
• v.26 no.4
• /
• pp.1-8
• /
• 2020

Motion synthesis using physics-based controllers can generate a character animation that interacts naturally with the given environment and other characters. Recently, various methods using deep neural networks have improved the quality of motions generated by physics-based controllers. In this paper, we present a control policy learned by deep reinforcement learning (DRL) that enables Luxo, the mascot character of Pixar animation studio, to run towards a random goal location while imitating a reference motion and maintaining its balance. Instead of directly training our DRL network to make Luxo reach a goal location, we use a reference motion that is generated to keep Luxo animation's jumping style. The reference motion is generated by linearly interpolating predetermined poses, which are defined with Luxo character's each joint angle. By applying our method, we could confirm a better Luxo policy compared to the one without any reference motions.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.1
• /
• pp.106-123
• /
• 2024

This article takes the talk show "Beast Town" as an example to introduce the overall technical solution, technical difficulties and countermeasures for the combination of cartoon virtual characters and virtual studio technology, providing reference and experience for the multi-scenario application of digital humans. Compared with the live broadcast that combines reality and reality, we have further upgraded our virtual production technology and digital human-driven technology, adopted industry-leading real-time virtual production technology and monocular camera driving technology, and launched a virtual cartoon character talk show - "Beast Town" to achieve real Perfectly combined with virtuality, it further enhances program immersion and audio-visual experience, and expands infinite boundaries for virtual manufacturing. In the talk show, motion capture shooting technology is used for final picture synthesis. The virtual scene needs to present dynamic effects, and at the same time realize the driving of the digital human and the movement with the push, pull and pan of the overall picture. This puts forward very high requirements for multi-party data synchronization, real-time driving of digital people, and synthetic picture rendering. We focus on issues such as virtual and real data docking and monocular camera motion capture effects. We combine camera outward tracking, multi-scene picture perspective, multi-machine rendering and other solutions to effectively solve picture linkage and rendering quality problems in a deeply immersive space environment. , presenting users with visual effects of linkage between digital people and live guests.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.439-444
• /
• 2008

The techniques, which locate example motions in abstract parameter space and interpolate them to generate new motion with given parameters, are widely used in real-time animation system for its controllability and efficiency However, as the dimension of parameter space increases for more complex control, the number of example motions for parameterization increases exponentially. This paper proposes a method that uses two different parameter spaces to obtain decoupled control over upper-body and lower-body motion. At each frame time, each parameterized motion space produces a source frame, which satisfies the constraints involving the corresponding body part. Then, the target frame is synthesized by splicing the upper body of one source frame onto the lower body of the other. To generate corresponding source frames to each other, we present a novel scheme for time-warping. This decoupled parameterization alleviates the problems caused by dimensional complexity of the parameter space and provides users with layered control over the character. However, when the examples are parameterized based on their upper body's spatial properties, the parameters of the examples are varied individually with every change of its lower body. To handle this, we provide an approximation technique to change the positions of the examples rapidly in the parameter space.

• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2005.11a
• /
• pp.282-285
• /
• 2005

This paper discusses the interactive system for smart home environments. In order to realize this, the main emphasis of the paper lies on the description of the multiple signal processing on the basis of the technologies such as fingerprint recognition, video signal processing, speech recognition and synthesis. For essential modules of the interactive system, we adopted the motion detector based on the changes of brightness in pixels as well as the fingerprint identification for adapting home environments to the inhabitants. In addition, the real-time speech recognizer based on the HM-Net(Hidden Markov Network) and the speech synthesis were incorporated into the overall system for interaction between user and system. In experimental evaluation, the results showed that the proposed system was easy to use because the system was able to give special services for specific users in smart home environments, even though the performance of the speech recognizer was not better than the simulation results owing to the noisy environments.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.20 no.6
• /
• pp.1882-1892
• /
• 1996

This paper is concerned with the position control of the ond degree-of freedom manipulator using pneumatic artificial muscle actuator which is built to have a proper compliance. For t his pneumatic artificial muscle actuator though, it is difficult to make an effective control scheme due to the nonlinearity and uncertainties on the dynamics of the actuator. In this paper, a third-order equation of motion is derived for the actuator including the dynamics of the pneumatic servovalve. Later, various modeling uncertainties due to the nonlinearity and unmodeled dynamics of the servo vlave and the actuator are taken care of, as a trade-off between the closed-loop performance of the controlled system and its robustness to uncertainties. A controller using .mu. synthesis thchnique is designed, and robust performance against measurement noise, various modeling uncertainties due to the dynamics of the servo valve and actuator is achieved. The effectiveness of the proposed control methods is illustrated through simulations and experiments.

• Journal of the Korea Computer Graphics Society
• /
• v.26 no.3
• /
• pp.49-59
• /
• 2020

In this paper, we propose a speech animation synthesis specialized in Korean through a rule-based co-articulation model. Speech animation has been widely used in the cultural industry, such as movies, animations, and games that require natural and realistic motion. Because the technique for audio driven speech animation has been mainly developed for English, however, the animation results for domestic content are often visually very unnatural. For example, dubbing of a voice actor is played with no mouth motion at all or with an unsynchronized looping of simple mouth shapes at best. Although there are language-independent speech animation models, which are not specialized in Korean, they are yet to ensure the quality to be utilized in a domestic content production. Therefore, we propose a natural speech animation synthesis method that reflects the linguistic characteristics of Korean driven by an input audio and text. Reflecting the features that vowels mostly determine the mouth shape in Korean, a coarticulation model separating lips and the tongue has been defined to solve the previous problem of lip distortion and occasional missing of some phoneme characteristics. Our model also reflects the differences in prosodic features for improved dynamics in speech animation. Through user studies, we verify that the proposed model can synthesize natural speech animation.