Browse > Article

Improvement of Lipreading Performance Using Gabor Filter for Ship Environment  

Shin, Do-Sung (목포대학교 정보산업연구소)
Lee, Seong-Ro (경원대학교 컴퓨터공학과)
Kwon, Jang-Woo (목포대학교 정보전자공학과)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.35, no.7C, 2010 , pp. 598-603 More about this Journal
Abstract
In this paper, we work for Lipreading using visual information for ship environment. Lipreading is studied for using image information including lips of a speaker at the existing speech recognition system. This technique is a compensation method to increase recognition rate decreasing remarkably in noisy circumstances. Proposed way improved the rate of recognition improving methode of preprocessing using the Gabor Filter for Ship Environment. The experiment were carried out under changing of light with time in the ship environment with lip image. For Comparing with recognition, make a compare with between method of lip region of interest (ROI) before Gabor filtering and after Gabor filtering. In the case of using method of lip ROI before Gabor filtering, the result of the experiments applying to the proposed ways recognition resulting in 44% of recognition.
Keywords
Lip-reading; Gabor filter; speech recognition; visual-audio; multimodal; ship;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 P. L. Silsbee and A. C. Bovik, "Computer lipreading for improved accuracy in automatic speech recognition," IEEE Trans. Speech, Audio Process., Vol.4 No.5, pp.337-351, Sep. 1996.   DOI   ScienceOn
2 신도성, 김진영, 최승호, "시간영역 필터를 이용한 립리딩 성능향상에 관한 연구", 한국음향학회지, 제22권, 제5호, pp.375-382, 달 2003.   과학기술학회마을
3 신도성, 김진영, 이주현, "동적 환경에서의 립리딩 인식성능저하 요인분석에 대한 연구, 한국음향학회지", 제21권, 제5호, pp.471-477, 달 2002.   과학기술학회마을
4 G. Potamianos, H. P. Graf, and E.Cosatto. "An image transform approach for HMM based automatic lipreading." Proc. Int. Conf. Image Process, Chicago, USA, pp.173-177, 달, 1998.
5 한학용, 패턴인식 개론: MATLAB 실습을 통한 입체적 학습, 한빛미디어, pp.247-250, 2009.
6 J. R. Movellan, Tutorial on Gabor Filters, http://mplab.ucsd.edu/wordpress/tutorials/gabor.pdf.
7 R. S., V. L. Pavlovic, and T. S, Huang, "Toward Multimodal Human Computer Interface", Proc. IEEE, Vol.85, No.5, pp. 853-869, May 1998.