• Title/Summary/Keyword: Text-To-Animation

Search Result 138, Processing Time 0.022 seconds

Synthesis of Expressive Talking Heads from Speech with Recurrent Neural Network (RNN을 이용한 Expressive Talking Head from Speech의 합성)

  • Sakurai, Ryuhei;Shimba, Taiki;Yamazoe, Hirotake;Lee, Joo-Ho
    • The Journal of Korea Robotics Society
    • /
    • v.13 no.1
    • /
    • pp.16-25
    • /
    • 2018
  • The talking head (TH) indicates an utterance face animation generated based on text and voice input. In this paper, we propose the generation method of TH with facial expression and intonation by speech input only. The problem of generating TH from speech can be regarded as a regression problem from the acoustic feature sequence to the facial code sequence which is a low dimensional vector representation that can efficiently encode and decode a face image. This regression was modeled by bidirectional RNN and trained by using SAVEE database of the front utterance face animation database as training data. The proposed method is able to generate TH with facial expression and intonation TH by using acoustic features such as MFCC, dynamic elements of MFCC, energy, and F0. According to the experiments, the configuration of the BLSTM layer of the first and second layers of bidirectional RNN was able to predict the face code best. For the evaluation, a questionnaire survey was conducted for 62 persons who watched TH animations, generated by the proposed method and the previous method. As a result, 77% of the respondents answered that the proposed method generated TH, which matches well with the speech.

A basic study on mathematics telelearning system (수학과 원격 수업 체제 기초 연구)

  • Kang Wan;Chang Kyung Yoon;Lew Hee Chan;Paik Seok Yoon
    • Journal of Elementary Mathematics Education in Korea
    • /
    • v.2 no.1
    • /
    • pp.61-80
    • /
    • 1998
  • Whereas research on telelearning in educational technology area is lively done, that in mathematics education area is not. Related to the open education, telelearning has 4 models: the distance classroom model, the front-end system design, the knowledge construction model, and the teaching model based on data. S/W, C/W, and H/W are the components of telelearning system. For an effective mathematics telelearning system, H/W and S/W which use multimedia with complex multimode information such as text, graphics, animation, video, and audio are necessary. Examples of telelearning systems on going are MIPOS, SDS telelearning system, telelearning system of the Naechon Elementary School, and Doorae Multimedia Application Development Platform.

  • PDF

Design and Implementation of a Web Courseware Based on Simulation for Learning the Computer Network (컴퓨터 네트워크 학습을 위한 시뮬레이션형 웹 코스웨어 설계 및 구현)

  • Jeong, Sang-Wook;Song, Tae-Ok;Kim, Tae-Young
    • The Journal of Korean Association of Computer Education
    • /
    • v.3 no.2
    • /
    • pp.39-46
    • /
    • 2000
  • This courseware includes multimedia elements such as graphic, voice and provides simulation learning and animation learning environment. Therefore, a learner can have various learning opportunities, be encouraged learning motivation, and be improved learning outcome. The content of the implemented program in this thesis provides voice and text basically. In addition to simulation learning and animation learning are provided appropriately by the type of content. Specially by using simulation implemented from simple subjects to more complicate subjects, a learner can select the most appropriate learning course and learn the simulation step by step. Through this courseware, a learner can learn more easily and excitedly.

  • PDF

Facial Animation Generation by Korean Text Input (한글 문자 입력에 따른 얼굴 에니메이션)

  • Kim, Tae-Eun;Park, You-Shin
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.4 no.2
    • /
    • pp.116-122
    • /
    • 2009
  • In this paper, we propose a new method which generates the trajectory of the mouth shape for the characters by the user inputs. It is based on the character at a basis syllable and can be suitable to the mouth shape generation. In this paper, we understand the principle of the Korean language creation and find the similarity for the form of the mouth shape and select it as a basic syllable. We also consider the articulation of this phoneme for it and create a new mouth shape trajectory and apply at face of an 3D avatar.

  • PDF

Analysis of Chinese Video Website Barrage Language Based On the Influence Of The ACGN Culture

  • Yan, JiHui;Pan, Yang;Yun, Taesoo
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.13 no.2
    • /
    • pp.195-207
    • /
    • 2021
  • In recent years, with the rapid growth of China's animation industry, the two-dimensional culture and consumption have been immersed in the daily lives of young people. The two-dimensional culture that mainly exists on young people is gradually entering the public's field of vision, making the two-dimensional culture not It is only restricted to the fixed fan circle, but is known to more people outside the circle. At the same time, the "barrage" (screen text) cultures in video websites has become popular with some film and television works, Internet terms, etc., and has attracted the attention on mainstream culture. On the one hand, its cultural products have appeared on traditional mainstream video websites and advertisements on provincial satellite TV. And in the program, on the other hand, a small part of the screen text and cultural terms are also used by some celebrities and other ordinary people who don't understand the meaning of the terms at all, and have caused widespread dissemination. Sometimes the video website itself is also mentioned, which obviously shows a difference. The tendency towards a kind of screen texts subculture to penetrate the mainstream culture.

Detecting Rectangular Image Regions in a Window Image for 3D Conversion (3D 변환을 위한 윈도우영상에서 사각 이미지 영역 검출)

  • Gil, Jong In;Lee, Jun Seok;Kim, Manbae
    • Journal of Broadcast Engineering
    • /
    • v.18 no.6
    • /
    • pp.795-807
    • /
    • 2013
  • In recent years, 2D-to-3D conversion techniques have gained much attraction. Most of conventional methods focused on natural images such as movie, animation and so forth. However, it is difficult to apply these techniques to window images mixed with text, image, logo, and icon. Also, different depth values of text pixels will cause distortion and a proper 3D image can not be delivered in some situations. To solve this problem, we propose a method to classify a given image into either a window or a natural image. For the window image, only rectangular image regions (RIR) are detected and converted in 3D. Other text and background are displayed in 2D. The proposed method was performed on more than 10,000 test images. In the experimental results, the detection ratio of window image reaches 97% and RIR detection ratio is 87%.

A Study on the integrated art & culture education using short animations of Korea (한국단편애니메이션을 활용한 주제중심 통합교육 모형 연구)

  • Kim, Jae-Woong;Ko, Min-Jung
    • Cartoon and Animation Studies
    • /
    • s.20
    • /
    • pp.15-29
    • /
    • 2010
  • Art & Culture Education for improving quality of life and cultural empowerment through the enjoyment of culture and the arts has spread as a variety of programs. However, Art & Culture Education in school has problems in the aspect of functional and superficial contents and ways of class. To achieve the ultimate purpose of Art & Culture Education and to take place as a effective education, quantitative growth in addition to qualitative depth should be considered. The purpose of this study is to develop the integrated Art & Culture Education model in elementary school curriculum using short animations of Korea, for improving the quality and vitalization of Art & Culture Education. For the interdisciplinary education short animation can be an effective asthetical teaching material, which transmits the world view, personality, social and historical reflection of the director. (2003) is a modern interpretation of a myth, which is Woncheongang Bonfuri from Cheju, and folkore paintings. This film can be such a stuff for the interdisciplinary class Korean and Ethics that language intellect and reflection intellect can be motivated. Moreover the thoughts and feelings about the film can be formulated in text, toon, painting that students can extend their language intellect and space intellect. communicates typically korean emotion and nature with its rural atmosphere and boy figure. With this film we can deliver a interdisciplinary class of science and art.

  • PDF

MPEG-4TTS 현황 및 전망

  • 한민수
    • The Magazine of the IEIE
    • /
    • v.24 no.9
    • /
    • pp.91-98
    • /
    • 1997
  • Text-to-Speech(WS) technology has been attracting a lot of interest among speech engineers because of its own benefits. Namely, the possible application areas of talking computers, emergency alarming systems in speech, speech output devices for speech-impaired, and so on. Hence, many researchers have made significant progresses in the speech synthesis techniques in the sense of their own languages and as a result, the quality of current speech synthesizers are believed to be acceptable to normal users. These are partly why the MPEG group had decided to include the WS technology as one of its MPEG-4 functionalities. ETRI has made major contributions to the current MPEG-4 775 appearing in various MPEG-4 documents with relatively minor contributions from AT&T and NW. Main MPEG-4 functionalities presently available are; 1) use of original prosody for synthesized speech output, 2) trick mode functions for general users without breaking synthesized speech prosody, 3) interoperability with Facial Animation(FA) tools, and 4) dubbing a moving/anlmated picture with lip-shape pattern informations.

  • PDF

Ubiquitous Car Maintenance Services Using Augmented Reality and Context Awareness (증강현실을 활용한 상황인지기반의 편재형 자동차 정비 서비스)

  • Rhee, Gue-Won;Seo, Dong-Woo;Lee, Jae-Yeol
    • Korean Journal of Computational Design and Engineering
    • /
    • v.12 no.3
    • /
    • pp.171-181
    • /
    • 2007
  • Ubiquitous computing is a vision of our future computing lifestyle in which computer systems seamlessly integrate into our everyday lives, providing services and information in anywhere and anytime fashion. Augmented reality (AR) can naturally complement ubiquitous computing by providing an intuitive and collaborative visualization and simulation interface to a three-dimensional information space embedded within physical reality. This paper presents a service framework and its applications for providing context-aware u-car maintenance services using augmented reality, which can support a rich set of ubiquitous services and collaboration. It realizes bi-augmentation between physical and virtual spaces using augmented reality. It also offers a context processing module to acquire, interpret and disseminate context information. In particular, the context processing module considers user's preferences and security profile for providing private and customer-oriented services. The prototype system has been implemented to support 3D animation, TTS (Text-to-Speech), augmented manual, annotation, and pre- and post-augmentation services in ubiquitous car service environments.

A Implementation of Web-based Education Contents for 8051 MicroController

  • Kim Hyun Keu;Jun Heung Gu;Choi Kwan Sun
    • Proceedings of the IEEK Conference
    • /
    • 2004.08c
    • /
    • pp.690-692
    • /
    • 2004
  • This paper describes Web based education technique. We implemented a remote compile system with 8051 micro controller. It implemented the system in this paper so that a learner compiled 8051 control programs to the remote. Most big restriction subject is the control of the hardware in an engineering field even though it implements a remote education system. We download the Java Application to Java Web Start and execute in this system. In this paper the learner controls 8051 executions in Web to the remote and implemented so that we confirmed the action. The supplementary problem will be the construction of a remote education system which offeres existing text and sound information, flash animation.

  • PDF