• Title/Summary/Keyword: Synch

Search Result 30, Processing Time 0.023 seconds

Natural 3D Lip-Synch Animation Based on Korean Phonemic Data (한국어 음소를 이용한 자연스러운 3D 립싱크 애니메이션)

  • Jung, Il-Hong;Kim, Eun-Ji
    • Journal of Digital Contents Society
    • /
    • v.9 no.2
    • /
    • pp.331-339
    • /
    • 2008
  • This paper presents the development of certain highly efficient and accurate system for producing animation key data for 3D lip-synch animation. The system developed herein extracts korean phonemes from sound and text data automatically and then computes animation key data using the segmented phonemes. This animation key data is used for 3D lip-synch animation system developed herein as well as commercial 3D facial animation system. The conventional 3D lip-synch animation system segments the sound data into the phonemes based on English phonemic system and produces the lip-synch animation key data using the segmented phoneme. A drawback to this method is that it produces the unnatural animation for Korean contents. Another problem is that this method needs the manual supplementary work. In this paper, we propose the 3D lip-synch animation system that can segment the sound and text data into the phonemes automatically based on Korean phonemic system and produce the natural lip-synch animation using the segmented phonemes.

  • PDF

Support Vector Machine Based Phoneme Segmentation for Lip Synch Application

  • Lee, Kun-Young;Ko, Han-Seok
    • Speech Sciences
    • /
    • v.11 no.2
    • /
    • pp.193-210
    • /
    • 2004
  • In this paper, we develop a real time lip-synch system that activates 2-D avatar's lip motion in synch with an incoming speech utterance. To realize the 'real time' operation of the system, we contain the processing time by invoking merge and split procedures performing coarse-to-fine phoneme classification. At each stage of phoneme classification, we apply the support vector machine (SVM) to reduce the computational load while retraining the desired accuracy. The coarse-to-fine phoneme classification is accomplished via two stages of feature extraction: first, each speech frame is acoustically analyzed for 3 classes of lip opening using Mel Frequency Cepstral Coefficients (MFCC) as a feature; secondly, each frame is further refined in classification for detailed lip shape using formant information. We implemented the system with 2-D lip animation that shows the effectiveness of the proposed two-stage procedure in accomplishing a real-time lip-synch task. It was observed that the method of using phoneme merging and SVM achieved about twice faster speed in recognition than the method employing the Hidden Markov Model (HMM). A typical latency time per a single frame observed for our method was in the order of 18.22 milliseconds while an HMM method applied under identical conditions resulted about 30.67 milliseconds.

  • PDF

Implementation of Text-to-Audio Visual Speech Synthesis Using Key Frames of Face Images (키프레임 얼굴영상을 이용한 시청각음성합성 시스템 구현)

  • Kim MyoungGon;Kim JinYoung;Baek SeongJoon
    • MALSORI
    • /
    • no.43
    • /
    • pp.73-88
    • /
    • 2002
  • In this paper, for natural facial synthesis, lip-synch algorithm based on key-frame method using RBF(radial bases function) is presented. For lips synthesizing, we make viseme range parameters from phoneme and its duration information that come out from the text-to-speech(TTS) system. And we extract viseme information from Av DB that coincides in each phoneme. We apply dominance function to reflect coarticulation phenomenon, and apply bilinear interpolation to reduce calculation time. At the next time lip-synch is performed by playing the synthesized images obtained by interpolation between each phonemes and the speech sound of TTS.

  • PDF

Korean Phonological Viseme for Lip Synch Based on Phoneme Recognition (음소인식 기반의 립싱크 구현을 위한 한국어 음운학적 Viseme의 제안)

  • Joo Heeyeol;Kang Sunmee;Ko Hanseok
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • spring
    • /
    • pp.70-73
    • /
    • 1999
  • 본 논문에서는 한국어에 대한 실시간 음소 인식을 통한 Lip Synch 구현에 필수요소인 Viseme(Visual Phoneme)을 한국어의 음운학적 접근 방법을 통해 제시하고, Lip Synch에서 입술의 모양에 결정적인 영향을 미치는 모음에 대한 모음 인식 실험 및 결과 분석을 한다.모음인식 실험에서는 한국어 음소 51개 각각에 대해 3개의 State로 이루어진 CHMM (Continilous Hidden Makov Model)으로 모델링하고, 각각의 음소가 병렬로 연결되어진 음소네트워크를 사용한다. 입력된 음성은 12차 MFCC로 특징을 추출하고, Viterbi 알고리즘을 인식 알고리즘으로 사용했으며, 인식과정에서 Bigrim 문법과 유사한 구조의 음소배열 규칙을 사용해서 인식률과 인식 속도를 향상시켰다.

  • PDF

Conception Rate of Ovulation-Estrus Synchronization Method in Hanwoo (한우에 있어서 발정ㆍ배란 동기화법에 의한 수태율)

  • 박정준;임석기;이명식;전기준;박수봉;정영훈;우제석;나기준
    • Korean Journal of Animal Reproduction
    • /
    • v.27 no.3
    • /
    • pp.207-213
    • /
    • 2003
  • This objective of this experiment were to evaluate the effect of various estrus synchronization programs on estrus detection rate and pregnancy rate in Hanwoo. After Postpartum 60 Days, a total of 150 cows divided into 2 groups. Cows Group 1 were treated with one luteolytic dosage of PGF$_2$$\alpha$(25 mg, im; lutalyse. USA) on Day 0, and with a second dosage 14 d later; cows in Group 2 were treated with GnRH(l00 $\mu\textrm{g}$, im; Conceral. Korea) on Day 0, PGF$_2$$\alpha$ 7 d later, GnRH 2 d later, and then time-inseminated approximately 16 h after this second treatment with GnRH. Ovarian morphology was monitored cows by trans-rectal ultrasonography from 24 hr to 32 hrs after second GnRH injection. The result obtained summarized as follows: 1. Cows synchronization of estrus with GnRH+PGF$_2$$\alpha$+GnRH(Ov-synch) and PGF$_2$$\alpha$ were 91.3 and 40.0%, respectively. 2. Induced ovulation were 24 to 32hr after the second GnRH injection, but high induced ovulation was 28hr. 3. High conception rate were 24hr insemination after the second GnRH injection. 4. Conception rate with PGF$_2$$\alpha$, CIDR and GnRH treatment were 50.0, 36.0 and 76.9%, respectively.

The segmentation of Korean word for the lip-synch application (Lip-synch application을 위한 한국어 단어의 음소분할)

  • 강용성;고한석
    • Proceedings of the IEEK Conference
    • /
    • 2001.09a
    • /
    • pp.509-512
    • /
    • 2001
  • 본 논문은 한국어 음성에 대한 한국어 단어의 음소단위 분할을 목적으로 하였다. 대상 단어는 원광대학교 phonetic balanced 452단어 데이터 베이스를 사용하였고 분할 단위는 음성 전문가에 의해 구성된 44개의 음소셋을 사용하였다. 음소를 분할하기 위해 음성을 각각 프레임으로 나눈 후 각 프레임간의 스펙트럼 성분의 유사도를 측정한 후 측정한 유사도를 기준으로 음소의 분할점을 찾았다. 두 프레임 간의 유사도를 결정하기 위해 두 벡터 상호간의 유사성을 결정하는 방법중의 하나인 Lukasiewicz implication을 사용하였다. 본 실험에서는 기존의 프레임간 스펙트럼 성분의 유사도 측정을 이용한 하나의 어절의 유/무성음 분할 방법을 본 실험의 목적인 한국어 단어의 음소 분할 실험에 맞도록 수정하였다. 성능평가를 위해 음성 전문가에 의해 손으로 분할된 데이터와 본 실험을 통해 얻은 데이터와의 비교를 하여 평가를 하였다. 실험결과 전문가가 직접 손으로 분할한 데이터와 비교하여 32ms이내로 분할된 비율이 최고 84.76%를 나타내었다.

  • PDF

A New Synchronization Scheme for Parallel Processing of Loop with Constant and Variable Dependence Distance (불변 및 가변 종속거리를 갖는 루프의 병렬처리를 위한 새로운 동기화 기법)

  • 이광형;황종선;박두순
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.5
    • /
    • pp.693-701
    • /
    • 1995
  • In most application programs, loops usually comprise most of the computation in a program and are the most important source of parallelism. When loops are executed on multiprocessors, the cross iteration data dependences need to be enforced by synchronization between processors. Existing synchronization schemes have been studied mainly on the loop with constant dependence distance. When these schemes are applied to the loop with variable dependence distance, there exists lots of overhead by the use of unnecessary synchronization variables and execution of unuseful synchronization instructions. Even though there exist various variable synchronization schemes, they have a lot of run-time overhead to compute synchronization information. In this paper, we present a new synchronization scheme, Synch-Free/Synch-Hold for managing synchronization efficiently on the loop with constant and variable dependence distance.

  • PDF

Changes of Estrus Status and Follicle Development on the Ov-Synch Treatment for Timed Artificial Insemination of Deer (Elk)

  • Lee, J. H.;Park, S. J.;I. S. Ryu;G. Y. Chung;D. Y. Ji;J. W. Ryu;Kim, C. K.;S. H. Baek
    • Proceedings of the KSAR Conference
    • /
    • 2004.06a
    • /
    • pp.249-249
    • /
    • 2004
  • This study was conducted to investigate optimal insemination timming as a scanning changes of follicular development by synchronization of ovulation(Ov-synch.) treatment for timed artificial insemination of deer. Sixty-nine elk does were inserted CIDR into virginia for 14 days from 16 to 29 September(breeding season). (omitted)

  • PDF

Synchronization Rate, Size of the Ovulatory Follicle, and Pregnancy Rate after Synchronization of Ovulation Method in Hanwoo (한우에 Ov-synch 처리시 배란시기와 수태율 구명에 관한 연구)

  • 박정준;이명식;박수봉;임석기;전기준;정영훈;우제석;나기준;고대환
    • Journal of Embryo Transfer
    • /
    • v.18 no.3
    • /
    • pp.187-193
    • /
    • 2003
  • Recently a protocol was developed that precisely synchronizes the time of ovulation in Hanwoo. Cows were treated with GnRH on Day 0, PGF$_2$$\alpha$ 7 d later, GnRH 2 d later, and then time-inseminated approximately 24 h after this second treatment with GnRH. Ovarian morphology was monitored cows by trans-rectal ultrasonography 6.5MHz linear transrectal probe(Sonovet - 600., Medison co. Korea) from 24 hr to 31 hrs after second GnRH injection. The result obtained summarized as follows - 1. Induced ovulation were 24 to 31hr after the second GnRH injection, but high induced ovulation was 28hr. 2. Conception rate with HML(High meat lin) and HIL(High milk lin) treatment were 48.1%(38/79) and 43.9%(40/91), respectively. 3. Conception rate of 1∼2 parity and 3∼4 parity was 44.3% and 55%, respectively. 4. Conception rate of spring, autumn was more increased, 47.3% than summer.