• The Journal of the Korea Contents Association
• /
• v.4 no.4
• /
• pp.79-87
• /
• 2004

In this paper, we propose a probability map based genetic algorithm to detect lips from portrait image. The existing genetic algorithm used to get an optimal solution is modified in order to get multiple optimal solutions for lips detection. Each individual consists of two chromosomes to represent coordinates x, y in space. Also the algorithm introduce a preserving zone in the population, a modified uniform crossover, a selection without individual duplication. Using probability map of H, 5 components, the proposed algorithm has adaptability in the segmentation of objects with similar colors. In experiments, we analyzed relationships of primary parameters and found that the algorithm can apply to the detection of other ROIs easily

• Journal of Korea Multimedia Society
• /
• v.20 no.2
• /
• pp.108-114
• /
• 2017

Lip reading is a field of image processing to assist the process of sound recognition. In some environment, the capture of sound signal usually has significant noise and therefore, the recognition rate of sound signal decreases. Lip reading can be a good feature for the increase of recognition rates. Conventional lip extraction methods have been proposed widely. Maia et. al. proposed a method by the sum of Cr and Cb. However, there are two problems as follows: the point with maximum saturation is not always regarded as lips region and the inner part of lips such as oral cavity and teeth can be classified as lips. To solve these problems, this paper proposes a method which adopts the histogram-based classifier for the extraction of lips region. The proposed method consists of two stages, learning and test. The amount of computation is minimized because this method has no color conversion. The performance of proposed method gives 66.8% of detection rate compared to 28% of conventional ones.

• Proceedings of the Korea Contents Association Conference
• /
• 2003.11a
• /
• pp.271-275
• /
• 2003

In this paper, we propose a method that corrects the geometric distortion of mouth in an image. the method is composed of two steps - detecting key points and correcting geometric distortion. First, key points of lips in source and destination images are found by using lips detection algorithm. Then, the two images are mapped by using affine transformation and information found in first step. In experiment result for various mouths with different geometric distortion, we found that the proposed method have satisfactory efficiency.

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.5
• /
• pp.361-367
• /
• 2003

We propose an algorithm to detect the face region using a variable ellipsoidal mask and a neural network. Since outlines of human faces are similar to ellipsoid, the ellipsoidal mask that has the fixed ratio of major and minor axis can be used to detect the candidate area. The positions of eyes and lips are extracted in this candidate area, and then the morphological analysis is applied to make features which are consist of six parameters, such as the geometrical ratio of eyes and lips. A back-propagation neural network is used as a classifier to determine the most possible face region. The experimental result is conducted to verify its efficiency compared with those of previous works.

• The KIPS Transactions:PartB
• /
• v.16B no.4
• /
• pp.299-308
• /
• 2009

AAM(Active Appearance Model) is an algorithm to extract face feature points with statistical models of shape and texture information based on PCA(Principal Component Analysis). This method is widely used for face recognition, face modeling and expression recognition. However, the detection performance of AAM algorithm is sensitive to initial value and the AAM method has the problem that detection error is increased when an input image is quite different from training data. Especially, the algorithm shows high accuracy in case of closed lips but the detection error is increased in case of opened lips and deformed lips according to the facial expression of user. To solve these problems, we propose the improved AAM algorithm using lip feature points which is extracted based on a new lip detection algorithm. In this paper, we select a searching region based on the face feature points which are detected by AAM algorithm. And lip corner points are extracted by using Canny edge detection and histogram projection method in the selected searching region. Then, lip region is accurately detected by combining color and edge information of lip in the searching region which is adjusted based on the position of the detected lip corners. Based on that, the accuracy and processing speed of lip detection are improved. Experimental results showed that the RMS(Root Mean Square) error of the proposed method was reduced as much as 4.21 pixels compared to that only using AAM algorithm.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.11 no.8
• /
• pp.3028-3035
• /
• 2010

This paper propose a genetic method based on probability map to detect region of the lips on a natural image with the faces. The method has many solutions in order to detect regions such as the lips instead of one optimal solution of existing methods. To do this, it represents a pair of spatial coordinates as a chromosome, and introduces genetic operations like conservation interval, the number of generations and non-overlapping selection. By using the probability map of the HS in HSV color space, it increases adaptability to similar color that is a property of genetic algorithm. In our experiments, the optimal value of the important parameter $\beta$ was analyzed, which was used as the condition of an ending function and affected performance of the proposed algorithm. Also the algorithm was analyzed on what performance it has when its mating methods are different. The results of the experiment showed that our algorithm could be flexibly adapted for detecting other ROIs.

• Journal of Advanced Navigation Technology
• /
• v.15 no.4
• /
• pp.672-679
• /
• 2011

In this paper, detection algorithm of face region based on skin color of in the TV images is proposed. In the first, reference image is set to the sampled skin color, and then the extracted of face region is candidated using the Euclidean distance between the pixels of TV image. The eye image is detected by using the mean value and standard deviation of the component forming color difference between Y and C through the conversion of RGB color into CMY color model. Detecting the lips image is calculated by utilizing Q component through the conversion of RGB color model into YIQ color space. The detection of the face region is extracted using basis of knowledge by doing logical calculation of the eye image and lips image. To testify the proposed method, some experiments are performed using front color image down loaded from TV color image. Experimental results showed that face region can be detected in both case of the irrespective location & size of the human face.

• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• v.26 no.4
• /
• pp.310-322
• /
• 2022

In this report, we apply an anomaly detection algorithm to a mobile oral health care application. In particular, we have investigated one class YOLOv3 as an anomaly detection model to classify pictures of mouths which will be used as inputs in the following machine learning model. We have achieved outstanding performances by proposing appropriate annotation strategies for our data sets and modifying the loss function. Moreover, the model can classify not only oral and non-oral pictures but also output preprocessed pictures that only contain the area around the lips by using the predicted bounding box. Thus, the model performs prediction and preprocessing simultaneously.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.48 no.6
• /
• pp.479-487
• /
• 2020

A new double-pulse laser system that combines Raman and laser induced plasma spectroscopy (LIPS) in a single unit is proposed. The study attempts to enhance the laser induced plasma signals while simultaneously extracting the desired molecular signals from Raman spectroscopy. In low pressure conditions such as the lunar atmosphere, the measuring of plasma emission is hard because of the low electron density and short persistence time causing a rapid plasma expansion. Furthermore, in the integration of the detecting system aimed at space exploration, the minimization of laser system is important in terms of the payload mass. Simultaneous molecular and atomic detection that gave highly resolved spectral data at pressure below 0.07 torr is demonstrated amongst eight rock samples test. The plasma stacking produced from the double-pulse laser enhanced the signal intensity of calcium and oxygen lines in calcite matrix by twofold, compared to a conventional LIPS.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.4
• /
• pp.39-46
• /
• 2009

Many lip region detection methods have been developed in PC environment. But the existing methods are difficult to run on real-time in resource limited mobile devices. To solve the problem, this paper proposes a real-time lip region detection method for lipreading in Mobile device. It detects face region by using adaptive face color information. After that, it detects lip region by using geometrical relation between eyes and lips. The proposed method is implemented in a smart phone with Intel PXA 270 embedded processor and 386MB memory. Experimental results show that the proposed method runs at the speed 9.5 frame/see and the correct detection rate was 98.8% for 574 images.