• Title/Summary/Keyword: lip information

Search Result 195, Processing Time 0.026 seconds

A Study on Speechreading about the Korean 8 Vowels (한국어 8모음 자동 독화에 관한 연구)

  • Lee, Kyong-Ho;Yang, Ryong;Kim, Sun-Ok
    • Journal of the Korea Society of Computer and Information
    • /
    • v.14 no.3
    • /
    • pp.173-182
    • /
    • 2009
  • In this paper, we studied about the extraction of the parameter and implementation of speechreading system to recognize the Korean 8 vowel. Face features are detected by amplifying, reducing the image value and making a comparison between the image value which is represented for various value in various color space. The eyes position, the nose position, the inner boundary of lip, the outer boundary of upper lip and the outer line of the tooth is found to the feature and using the analysis the area of inner lip, the hight and width of inner lip, the outer line length of the tooth rate about a inner mouth area and the distance between the nose and outer boundary of upper lip are used for the parameter. 2400 data are gathered and analyzed. Based on this analysis, the neural net is constructed and the recognition experiments are performed. In the experiment, 5 normal persons were sampled. The observational error between samples was corrected using normalization method. The experiment show very encouraging result about the usefulness of the parameter.

Improvement of Lipreading Performance Using Gabor Filter for Ship Environment (선박 환경에서 Gabor 여파기를 적용한 입술 읽기 성능향상)

  • Shin, Do-Sung;Lee, Seong-Ro;Kwon, Jang-Woo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.7C
    • /
    • pp.598-603
    • /
    • 2010
  • In this paper, we work for Lipreading using visual information for ship environment. Lipreading is studied for using image information including lips of a speaker at the existing speech recognition system. This technique is a compensation method to increase recognition rate decreasing remarkably in noisy circumstances. Proposed way improved the rate of recognition improving methode of preprocessing using the Gabor Filter for Ship Environment. The experiment were carried out under changing of light with time in the ship environment with lip image. For Comparing with recognition, make a compare with between method of lip region of interest (ROI) before Gabor filtering and after Gabor filtering. In the case of using method of lip ROI before Gabor filtering, the result of the experiments applying to the proposed ways recognition resulting in 44% of recognition.

A Study on Spatio-temporal Features for Korean Vowel Lipreading (한국어 모음 입술독해를 위한 시공간적 특징에 관한 연구)

  • 오현화;김인철;김동수;진성일
    • The Journal of the Acoustical Society of Korea
    • /
    • v.21 no.1
    • /
    • pp.19-26
    • /
    • 2002
  • This paper defines the visual basic speech units, visemes and investigates various visual features of a lip for the effective Korean lipreading. First, we analyzed the visual characteristics of the Korean vowels from the database of the lip image sequences obtained from the multi-speakers, thereby giving a definition of seven Korean vowel visemes. Various spatio-temporal features of a lip are extracted from the feature points located on both inner and outer lip contours of image sequences and their classification performances are evaluated by using a hidden Markov model based classifier for effective lipreading. The experimental results for recognizing the Korean visemes have demonstrated that the feature victor containing the information of inner and outer lip contours can be effectively applied to lipreading and also the direction and magnitude of the movement of a lip feature point over time is quite useful for Korean lipreading.

Synchronizationof Synthetic Facial Image Sequences and Synthetic Speech for Virtual Reality (가상현실을 위한 합성얼굴 동영상과 합성음성의 동기구현)

  • 최장석;이기영
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.35S no.7
    • /
    • pp.95-102
    • /
    • 1998
  • This paper proposes a synchronization method of synthetic facial iamge sequences and synthetic speech. The LP-PSOLA synthesizes the speech for each demi-syllable. We provide the 3,040 demi-syllables for unlimited synthesis of the Korean speech. For synthesis of the Facial image sequences, the paper defines the total 11 fundermental patterns for the lip shapes of the Korean consonants and vowels. The fundermental lip shapes allow us to pronounce all Korean sentences. Image synthesis method assigns the fundermental lip shapes to the key frames according to the initial, the middle and the final sound of each syllable in korean input text. The method interpolates the naturally changing lip shapes in inbetween frames. The number of the inbetween frames is estimated from the duration time of each syllable of the synthetic speech. The estimation accomplishes synchronization of the facial image sequences and speech. In speech synthesis, disk memory is required to store 3,040 demi-syllable. In synthesis of the facial image sequences, however, the disk memory is required to store only one image, because all frames are synthesized from the neutral face. Above method realizes synchronization of system which can real the Korean sentences with the synthetic speech and the synthetic facial iage sequences.

  • PDF

Cryotherapy for Treatment of a Mucocele on Lower Lip (냉동요법(Cryotherapy)을 이용한 점액낭종(Mucocele)의 치료)

  • 박혜숙;최종훈;김종열
    • Journal of Oral Medicine and Pain
    • /
    • v.23 no.3
    • /
    • pp.249-255
    • /
    • 1998
  • Mucoceles of the minor salivary glands are the most common cystic lesions affected the oral mucosa. They are believed to be the result of trauma to the salivary duct caused, for example, by biting the lip, cheek, or tongue. Surgical excision has been the most common treatment for these lesions, but occasional recurrences develop after excision because surgical trauma may damage the surrounding minor salivary glands Although various alternative nonsurgical approaches, such as steroid infection, application of gamma-linolenic acid, have also been reported, they are not used routinely, Lasers, particularly the carbon dioxide laser, have been used in the management of mucoceles. Although this treatment requires specialized equipment. Cryotherapy is another effective nonsurgical method for treating mucoceles. Clinically, cryotherapy has primarily been applied to the treatment of leukoplakia and hyperplastic, granulomatous, vascular, and pigmented lesions. Limited information, however, is available on the application of cryotherapy in salivary gland lesions, including mucoceles. A simple and easy cryotherapy to treat a mucocele on the lower lip is described. A 25 years old female patient with a mucocele on the lower lip was treated by direct application of liquid nitrogen with a cotton swab. The lesion was exposed to 4 or 5 cycles composed of freezings of 10-30 s and thawings of double the freezing times. No anesthesia was required. The lesion nearly disappeared without scar 10 days after the cryotherapy. Cryotherapy has become an established nonsurgical method, characterized by its simple application, therapeutic effectiveness, painless during the procedure and low incidence of secondary infection and hemorrhage.

  • PDF

A Segmented Model with Upside-Down Bathtub Shaped Failure Intensity (Upside-Down 욕조 곡선 형태의 고장 강도를 가지는 세분화 모형)

  • Park, Woo-Jae;Kim, Sang-Boo
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.23 no.6_2
    • /
    • pp.1103-1110
    • /
    • 2020
  • In this study, a segmented model with Upside-Down bathtub shaped failure intensity for a repairable system are proposed under the assumption that the occurrences of the failures of a repairable system follow the Non-Homogeneous Poisson Process. The proposed segmented model is the compound model of S-PLP and LIP (Segmented Power Law Process and Logistic Intensity Process), that fits the separate failure intensity functions on each segment of time interval. The maximum likelihood estimation is used for estimating the parameters of the S-PLP and LIP model. The case study of system A shows that the S-PLP and LIP model fits better than the other models when compared by AICc (Akaike Information Criterion corrected) and MSE (Mean Squared Error). And it also implies that the S-PLP and LIP model can be useful for explaining the failure intensities of similar systems.

A Study on Lip-reading enhancement using RATSTA fileter (RASTA 필터를 이용한 립리딩 성능향상에 관한 연구)

  • Shin Dosung;Kim Jinyoung;Choi Seungho;Kim Sanghun
    • Proceedings of the KSPS conference
    • /
    • 2002.11a
    • /
    • pp.191-194
    • /
    • 2002
  • Lip-reading technology that is studied them is used to compensate speech recognition degradation in noise environment in bi-modal's form. The most important thing is that search for correct lips area in this lip-reading. But, it is hard to forecast stable performance in dynamic environment. Used RASTA filter that show good performance to remove noise in the speech to compensate. This filter shows that improve performance of using time domain of digital filter. To this experiment observes performance of speech recognition only using image information, service chooses possible 22 words and did recognition experiment in car. We used hidden Markov model by speech recognition algorithm to compare this words' recognition performance.

  • PDF

Voice Coding Using Mouth Shape Features (입술형태 특성을 이용한 음성코딩)

  • Jang, Jong-Hwan
    • The Journal of Engineering Research
    • /
    • v.1 no.1
    • /
    • pp.65-70
    • /
    • 1997
  • To transmit the degraded voice signal within various environment surrounding acoustic noises, we extract lip i the face and then compare lip edge features with prestoring DB having features such as mouth height, width, area, and rate. It provides high security and is not affected by acoustic noise because it is not necessary to transmit the actual utterance.

  • PDF

Face Identification Using Topological Relationship between Lips′ Axes and Eyes (입술의 기울기특징과 눈과의 위상관계를 이용한 얼굴확인기법)

  • 김민석;한헌수
    • Proceedings of the IEEK Conference
    • /
    • 2003.07e
    • /
    • pp.2028-2031
    • /
    • 2003
  • This paper proposes a face identification algorithm, robust on lighting condition and complex background. The proposed method estimates facial area under bad light condition by expanding face color boundaries and then finds a lip using the templates for lips. Then the eyes are found using their topological relationship with the long and short axes of lip area. The experimental results have shown that the proposed algorithm is robust on lighting conditions and complex background.

  • PDF

Photogrammetric Study of Lip in Young Population in Korean (한국 청년층 구순의 사진 계측학적 연구)

  • Kim, Woo Seob;Hong, Jung Soo;Kim, Han Koo;Kim, Seung Hong
    • Archives of Plastic Surgery
    • /
    • v.32 no.2
    • /
    • pp.155-160
    • /
    • 2005
  • The aim of this study is to establish anatomical dimension of the lip in young population in Korean, using specially designed soft ware with photographic image. We measure 13 anatomical dimensions of lips in 2,229 young people. (917 male, 1312 female, Aged from 18-33 years. Average age 19.7). Statistical analysis of these measurements of large population could offer useful information in facial plastic surgery. The mean measurements are as follows 1. Lengths (male/female) Widths of philtrum: $1.11{\pm}0.19cm/1.02{\pm}0.21cm$ Heights of philtrum: $1.6{\pm}0.24cm/1.47{\pm}0.21cm$ Heights of cupid bow: $0.88{\pm}0.16cm/0.83{\pm}0.16cm$ Height of upper vermilion: $0.74{\pm}0.16cm/0.70{\pm}0.15cm$ Height of lower vermilion: $1.08{\pm}0.17cm/1.02{\pm}0.15cm$ Height of upper lip(Rt.): $1.24{\pm}0.2cm/1.23{\pm}0.2cm$ Height of upper lip(Lt.): $1.24{\pm}0.2cm/1.17{\pm}0.19cm$ Half horizontal length of lip: $2.2{\pm}0.26cm/2.11{\pm}0.2cm$ Horizontal length of lip: $4.41{\pm}0.4cm/4.25{\pm}0.36cm$ Height of lower face: $7.1{\pm}0.58cm/6.52{\pm}0.6cm$ 2. Angles Nasolabial angle: $97.77{\pm}11.97^{\circ}/95.5{\pm}11.34^{\circ}$ Mentolabial angle: $133.88{\pm}14.65^{\circ}/129.27{\pm}13.67^{\circ}$ Angle of Cupid's bow: $111.65{\pm}13.99^{\circ}/116.75{\pm}16.2^{\circ}$ Previous reported photogrammetric measurements was difficult to implement to surgical practice. Because these were printed photographies of the same size. Therefore, in this study, we can measure a lot of objects and items more conveniently and correctly by using proportional program on computer after taking a digital photograph. Consequently, proportional measurements with photogrammetry of lip could be useful and corrective substitute for anthropometrical measuring. These data could be useful reference for preoperative consultation, surgical planning and learning anatomical measurement of lips and adjacent structures.