한국어 입술 독해에 적합한 시공간적 특징 추출

Experiments on Various Spatial-Temporal Features for Korean Lipreading

Visual speech information improves the performance of speech recognition, especially in noisy environment. We have tested the various spatial-temporal features for the Korean lipreading and evaluated the performance by using a hidden Markov model based classifier. The results have shown that the direction as well as the magnitude of the movement of the lip contour over time is useful features for the lipreading.