• Journal of Intelligence and Information Systems
• /
• v.8 no.1
• /
• pp.75-85
• /
• 2002

In this paper, we propose an efficient method for recognizing lip. Lip is localized by using the shape of lip and the pixel values around lip contour. The shape of lip is represented by a statistically based active shape model which learns typical lip shape from a training set. Because this model is affected by the initial position, we use a boundary between upper and lower lip as initial position for searching lip. The boundary is localized by using a weighted vector based on lip's shape. The experiments have been performed for many images, and show very encouraging result.

• Journal of Navigation and Port Research
• /
• v.27 no.5
• /
• pp.487-492
• /
• 2003

The paper describes on the implementation of marine casualty prediction model that is one of the main part of Korean MArine Casualty FOrecasting System (K-MACFOS). In this work, Cell Distributed Linear-In-the-Parameter (CD-LIP) model is proposed and discussed its usability with comparing Baltic model and revised LIP model. As evaluation results by regression analysis of variance, it is known that the CD-LIP model gives best performance to the marine casualty numerical D/B of the target sea area.

• Journal of Korea Multimedia Society
• /
• v.6 no.6
• /
• pp.1000-1007
• /
• 2003

In this paper, we propose an efficient method for locating lip. The lip shape is represented as a set of points based on Point Distribution Model. We use the Isodata clustering algorithm to find clusters for all training data. For each cluster, a lip shape model is calculated using principle component analysis. For all training data, a lip boundary model is calculated based on the pixel values around the lip boundary. To decide whether a recognition result is correct, we use a cost function based on the lip boundary model. Because of using different models according to the lip shapes, our method can localize correctly the flu far from the mean shape. The experiments have been performed for many images, and show correct recognition rate of 92%.

• Journal of Korea Multimedia Society
• /
• v.7 no.11
• /
• pp.1531-1539
• /
• 2004

In this paper, we propose an efficient method for locating human lips. Based on Point Distribution Model and Principle Component Analysis, a lip shape model is built. Lip boundary model is represented based on the concatenated gray level distribution model. We calculate the distribution of shape parameters using Gaussian mixture. The problem to locate lip is simplified as the minimization problem of matching object function. The Down Hill Simplex Algorithm is used for the minimization with Gaussian Mixture for setting initial condition and refining estimate of lip shape parameter, which can refrain iteration from converging to local minima. The experiments have been performed for many images, and show very encouraging result.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2003.05a
• /
• pp.60-65
• /
• 2003

The paper describes on the implementation of marine casualty prediction model that is one of the main part of Marine Casualty Forecasting System (MCFS). In this work, Cell Distributed Linear-In-the Parameter (CD-LIP) model is developed and compared with Baltic model using regression analysis of variance. As comparing, it is known that the proposed CD-LIP model has less residual than the Baltic model and, it gives best performance to the marine casualty numeric D/B of target area.

• Journal of Korea Multimedia Society
• /
• v.6 no.6
• /
• pp.968-976
• /
• 2003

In this paper, we propose a novel method for lip recognition. Lip model is built based on the concatenated gray level distribution model, and the recognition problem is simplified as the minimization problem of matching object function. The Down Hill Simplex Algorithm is used for the minimization with the proposed novel method for setting initial condition, which can refrain Iteration from converging to local minima. The proposed algorithm shows extracting lip shape from the test image where Active Shape Model fails.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.27 no.2
• /
• pp.167-176
• /
• 2024

Lip-reading is the task of inferring the speaker's utterance from silent video based on learning of lip movements. It is very challenging due to the inherent ambiguities present in the lip movement such as different characters that produce the same lip appearances. Recent advances in deep learning models such as Transformer and Temporal Convolutional Network have led to improve the performance of lip-reading. However, most previous works deal with English lip-reading which has limitations in directly applying to Korean lip-reading, and moreover, there is no a large scale Korean lip-reading dataset. In this paper, we introduce the first large-scale Korean lip-reading dataset with more than 120 k utterances collected from TV broadcasts containing news, documentary and drama. We also present a preprocessing method which uniformly extracts a facial region of interest and propose a transformer-based model based on grapheme unit for sentence-level Korean lip-reading. We demonstrate that our dataset and model are appropriate for Korean lip-reading through statistics of the dataset and experimental results.

• Journal of KIISE:Software and Applications
• /
• v.30 no.5_6
• /
• pp.454-460
• /
• 2003

In this paper, we propose an efficient method for recognizing human lips. Based on Point Distribution Model, a lip shape is represented as a set of points. We calculate a lip model and the distribution of shape parameters using Principle Component Analysis and Gaussian mixture, respectively. The Expectation Maximization algorithm is used to determine the maximum likelihood parameter of Gaussian mixture. The lip contour model is derived by using the gray value changes at each point and in regions around the point and used to search the lip shape in a image. The experiments have been performed for many images, and show very encouraging result.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.29 no.6C
• /
• pp.834-841
• /
• 2004

There can be lips transformed geometrically in the lip images according to the location or the pose of camera and speaker. This transformation of the lip images changes geometric information of original lip phases. Therefore, for enhancing global lip information by using partial information of lips to correct lip phases transformed geometrically, in this paper we propose a method that can geometrically correct lips. The method is composed of two steps - the feature-deciding step and the correcting step. In the former, it is for us to extract key points and features of source image according to the its lip model and to create that of target image according to the its lip model. In the latter, we decide mapping relation after partition a source and target image based on information extracted in the previous step into each 4 regions. and then, after mapping, we unite corrected sub-images to a result image. As experiment image, we use fames that contain pronunciation on short vowels of the Korean language and use lip symmetry for evaluating the proposed algorithm. In experiment result, the correcting rate of the lower lip than the upper lip and that of lips moving largely than little was highly enhanced.

• Molecules and Cells
• /
• v.40 no.12
• /
• pp.935-944
• /
• 2017

More than 50% of sepsis cases are associated with pneumonia. Sepsis is caused by infiltration of bacteria into the blood via inflammation, which is triggered by the release of cell wall components following lysis. However, the regulatory mechanism of lysis during infection is not well defined. Mice were infected with Streptococcus pneumoniae D39 wild-type (WT) and lipase mutant (${\Delta}lipA$) intranasally (pneumonia model) or intraperitoneally (sepsis model), and survival rate and pneumococcal colonization were determined. LipA and autolysin (LytA) levels were determined by qPCR and western blotting. S. pneumoniae Spd_1447 in the D39 (type 2) strain was identified as a lipase (LipA). In the sepsis model, but not in the pneumonia model, mice infected with the ${\Delta}lipA$ displayed higher mortality rates than did the D39 WT-infected mice. Treatment of pneumococci with serum induced LipA expression at both the mRNA and protein levels. In the presence of serum, the ${\Delta}lipA$ displayed faster lysis rates and higher LytA expression than the WT, both in vitro and in vivo. These results indicate that a pneumococcal lipase (LipA) represses autolysis via inhibition of LytA in a sepsis model.