• Title/Summary/Keyword: Bidirectional Decode

Search Result 3, Processing Time 0.019 seconds

Synthesis of Expressive Talking Heads from Speech with Recurrent Neural Network (RNN을 이용한 Expressive Talking Head from Speech의 합성)

  • Sakurai, Ryuhei;Shimba, Taiki;Yamazoe, Hirotake;Lee, Joo-Ho
    • The Journal of Korea Robotics Society
    • /
    • v.13 no.1
    • /
    • pp.16-25
    • /
    • 2018
  • The talking head (TH) indicates an utterance face animation generated based on text and voice input. In this paper, we propose the generation method of TH with facial expression and intonation by speech input only. The problem of generating TH from speech can be regarded as a regression problem from the acoustic feature sequence to the facial code sequence which is a low dimensional vector representation that can efficiently encode and decode a face image. This regression was modeled by bidirectional RNN and trained by using SAVEE database of the front utterance face animation database as training data. The proposed method is able to generate TH with facial expression and intonation TH by using acoustic features such as MFCC, dynamic elements of MFCC, energy, and F0. According to the experiments, the configuration of the BLSTM layer of the first and second layers of bidirectional RNN was able to predict the face code best. For the evaluation, a questionnaire survey was conducted for 62 persons who watched TH animations, generated by the proposed method and the previous method. As a result, 77% of the respondents answered that the proposed method generated TH, which matches well with the speech.

Error Detection and Correction of Prefix Codes using Bidirectionally Decodable bit Streams (양방향 디코딩이 가능한 비트열을 이용한 앞자리 부호의 오차 검출과 정정)

  • Park, Sang-Ho
    • Convergence Security Journal
    • /
    • v.7 no.2
    • /
    • pp.129-134
    • /
    • 2007
  • This paper proposes multiple burst error detection and correction scheme for transmission of Huffman coded string. We use bidirectionally decodable codes and introduce insertion of forbidden symbol to find errors. Additional bits are added to original bit streams to correct errors. The total file size id increased but it can detect errors and recover errors real time.

  • PDF

Resource Allocation Schemes for Legacy OFDMA Systems with Two-Way DF Relay (양방향 복호전달 릴레이를 사용하는 레거시 OFDMA 시스템에서의 자원 할당 기법)

  • Seo, Jongpil;Han, Chulhee;Park, Seongho;Chung, Jaehak
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.39A no.10
    • /
    • pp.593-600
    • /
    • 2014
  • OFDMA systems solves frequency selective fading problem and provides improved performance by optimal allocation of subcarriers and transmit power. Two-way relay systems provide improved spectral efficiency compared to that of the conventional half-duplex relay using bidirectional communications. In legacy OFDMA system such as WiBro, two-way DF relay utilization causes pilot re-assignment and impossibility of channel estimation and decoding at relay nodes by self-interference. In this paper, resource allocation schemes for legacy OFDMA systems with two-way DF relay are proposed. The proposed schemes allocate subcarriers considering destinations nodes which are connected to relay nodes as individual nodes which are directly connected to a base station. Subsequently, the proposed schemes compensate bandwidth loss due to orthogonal allocations by overlapped allocating unused subcarriers at other noes. Numerical simulations show that the proposed resource allocation schemes provide improved performance compared with orthogonal allocation.