Robustness of Bimodal Speech Recognition on Degradation of Lip Parameter Estimation Performance

음성인식에서 입술 파라미터 열화에 따른 견인성 연구

  • 김진영 (전남대학교 전자공학과) ;
  • 신도성 (전남대학교 전자공학과) ;
  • 최승호 (동신대학교 정보통신공학과)
  • Published : 2002.11.01

Abstract

Bimodal speech recognition based on lip reading has been studied as a representative method of speech recognition under noisy environments. There are three integration methods of speech and lip modalities as like direct identification, separate identification and dominant recording. In this paper we evaluate the robustness of lip reading methods under the assumption that lip parameters are estimated with errors. We show that the dominant recording approach is more robust than other methods with lip reading experiments. Also, a measure of lip parameter degradation is proposed. This measure can be used in the determination of weighting values of video information.

Keywords