• KIPS Transactions on Software and Data Engineering
• /
• v.9 no.12
• /
• pp.431-438
• /
• 2020

In this paper, the method to extract lip contour by multiple threshold is proposed. Spyridonos et. el. proposed a method to extract lip contour. First step is get Q image from transform of RGB into YIQ. Second step is to find lip corner points by change point detection and split Q image into upper and lower part by corner points. The candidate lip contour can be obtained by apply threshold to Q image. From the candidate contour, feature variance is calculated and the contour with maximum variance is adopted as final contour. The feature variance 'D' is based on the absolute difference near the contour points. The conventional method has 3 problems. The first one is related to lip corner point. Calculation of variance depends on much skin pixels and therefore the accuracy decreases and have effect on the split for Q image. Second, there is no analysis for color systems except YIQ. YIQ is a good however, other color systems such as HVS, CIELUV, YCrCb would be considered. Final problem is related to selection of optimal contour. In selection process, they used maximum of average feature variance for the pixels near the contour points. The maximum of variance causes reduction of extracted contour compared to ground contours. To solve the first problem, the proposed method excludes some of skin pixels and got 30% performance increase. For the second problem, HSV, CIELUV, YCrCb coordinate systems are tested and found there is no relation between the conventional method and dependency to color systems. For the final problem, maximum of total sum for the feature variance is adopted rather than the maximum of average feature variance and got 46% performance increase. By combine all the solutions, the proposed method gives 2 times in accuracy and stability than conventional method.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.10 no.10
• /
• pp.1891-1896
• /
• 2006

In this paper, we propose an improved Active Shape Model for extracting lip contour. Lip deformation is modeled by a statistically deformable model based Active Shape Model. Because each point is moved independently using local profile information in Active Shape Model, many error may happen. To use a global information, we define an energy function similar to an energy function in Active Contour Model, and points are moved to positions at which the total energy is minimized. The experiments have been performed for many lip images of Tulip 1 database, and show that our method extracts lip shape than a traditional ASM more exactly.

• The Journal of the Acoustical Society of Korea
• /
• v.21 no.1
• /
• pp.19-26
• /
• 2002

This paper defines the visual basic speech units, visemes and investigates various visual features of a lip for the effective Korean lipreading. First, we analyzed the visual characteristics of the Korean vowels from the database of the lip image sequences obtained from the multi-speakers, thereby giving a definition of seven Korean vowel visemes. Various spatio-temporal features of a lip are extracted from the feature points located on both inner and outer lip contours of image sequences and their classification performances are evaluated by using a hidden Markov model based classifier for effective lipreading. The experimental results for recognizing the Korean visemes have demonstrated that the feature victor containing the information of inner and outer lip contours can be effectively applied to lipreading and also the direction and magnitude of the movement of a lip feature point over time is quite useful for Korean lipreading.

• Phonetics and Speech Sciences
• /
• v.13 no.1
• /
• pp.73-79
• /
• 2021

This study investigated the change in lip movement during speech according to aging. For the study, 15 elderly women with an average of 69 years and 15 young women with an average of 22 years were selected. To measure the movement of the lips, the ratio between the minimum point and the maximum point of movement when pronouncing a double vowel was analyzed in pixel units using image analysis software. For clinical utility, the software was produced by applying an automated algorithm and compared with the results of handwork. This study found that the range of the width and length of lips in double vowel tasks was smaller for the elderly than that of the young. A strong positive correlation was found between manual and automated methods, indicating that both methods are useful for extracting lip contours. Based on the above results, it was found that the range of the lips decreased when ignited as aging progressed. Therefore, monitoring the condition of lip performance by simply measuring the movement of lips before aging progresses, and performing exercises to maintain lip range, will prevent pronunciation problems caused by aging.

• Journal of Korea Multimedia Society
• /
• v.6 no.6
• /
• pp.968-976
• /
• 2003

In this paper, we propose a novel method for lip recognition. Lip model is built based on the concatenated gray level distribution model, and the recognition problem is simplified as the minimization problem of matching object function. The Down Hill Simplex Algorithm is used for the minimization with the proposed novel method for setting initial condition, which can refrain Iteration from converging to local minima. The proposed algorithm shows extracting lip shape from the test image where Active Shape Model fails.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.37 no.5
• /
• pp.105-114
• /
• 2000

In this paper, we concentrate on an efficient method to decrease a lot of pixel data to be processed with an Image transform based automatic lipreading It is reported that the image transform based approach, which obtains a compressed representation of the speaker's mouth, results in superior lipreading performance than the lip contour based approach But this approach produces so many feature parameters of the lip that has much data and requires much computation time for recognition To reduce the data to be computed, we propose a simple method folding at the vertical center of the lip-image based on the symmetry of the lip In addition, the principal component analysis(PCA) is used for fast algorithm and HMM word recognition results are reported The proposed method reduces the number of the feature parameters at $22{\sim}47%$ and improves hidden Markov model(HMM)word recognition rates at $2{\sim}3%$, using the folded lip-image compared with the normal method using $16{\times}16$ lip-image.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.1
• /
• pp.110-115
• /
• 2005

This paper proposes the method to detect contours of a face, eyes and a mouth in a color image for making an avatar automatically. First, we use the HSI color model to exclude the effect of various light condition, and we find skin regions in an input image by using the skin color is defined on HS-plane. And then, we use deformable templates and Genetic Algorithm(GA) to detect contours of a face, eyes and a mouth. Deformable templates consist of B-spline curves and control point vectors. Those can represent various shape of a face, eyes and a mouth. And GA is very useful search procedure based on the mechanics of natural selection and natural genetics. Second, an avatar is created automatically by using contours and Fuzzy C-means clustering(FCM). FCM is used to reduce the number of face color As a result, we could create avatars like handmade caricatures which can represent the user's identity, differing from ones generated by the existing methods.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.14 no.8
• /
• pp.1827-1835
• /
• 2010

In this paper, facial feature areas in user picture are created by facial feature points extracted by ASM(Active Shape Model). In a existing virtual make-up application, users manually select a few features that are exactly. Users are uncomfortable with this method. We propose a virtual makeup application using ASM that does not require user input. In order to express a natural makeup, the modified alpha blendings for each cosmetic are used to blend skin color with cosmetic color. The Virtual makeup application was implemented to apply Foundation, Blush, Lip Stick, Lip Liner, Eye Pencil, Eye Liner and Eye Shadow.

• Journal of Korean Society of Archives and Records Management
• /
• v.4 no.1
• /
• pp.67-85
• /
• 2004

Four volumes of the script of the Avatamska Sutra written with golden paste on dark blue papers manufactured in Koryo Dynasty which are collected or deposited in every museum of Japan show specific features on their cover paintings. In general 3 or 4 lotus flowers are wound by arabesque patterns in zigzag on the cover paintings of Koryo scripts, whereas 10 lotus flowers painted with golden paste on the 4 volumes of these scripts are same in their style. Though there is no prayer sentences in 4 volumes of the script, it is possible to know that they should belong to a set of 80 Avatamska Sutra by the results of above studies. In this study the contents of Byunsangwha of the script of 4 volumes of the Avatamska Sutra were discussed at first and their manufactured era should be postulated by the results of style analysis of cover paintings and Byunsangwha. First thing that saint hair of Buddha was painted with cobalt color is same as that of Byunsangwha of Munsuchoisangsungmusenggebueob prayed in Tejeong 3rd year, king Chungsuk 13th year(AD 1326). Second thing that the beads in topknot of saint hair and lips were painted completely with pink color, and ears, face outline as well as bosom outline disclosed through monk's cloth were also painted with pink color, furthermore the last thing is that Buddha's face was coated with golden paste. All of these things are same as shown in the characteristics of Byunsangwha of the scripts of Kanezawa Daishoji, Matsue Tenrinji and Haga Tera collection in Japan. However, since the cloud pattern style of Byunsangwha of the script is similar to that of the Byunsangwha manufactured in reinstatement era of king Chungsuk, it is possible to say that these 4 volumes of script should be manufactured in the reinstatement era of king Chungsuk.

• Journal of Dental Rehabilitation and Applied Science
• /
• v.33 no.4
• /
• pp.314-320
• /
• 2017

In the treatment of esthetically important areas such as maxillary anterior teeth, they should be corresponded with surrounding tissues, and shape of the smile line, soft tissue, and hard tissue, also the anatomical shape and proportion of the teeth should be considered as well. Esthetic analysis includes facial analysis which evaluates the proper parallelism between the occlusal plane and the horizontal reference line, dentolabial analysis which assesses the position of the incisal edge and the coherence between the occlusal plane and the commissural line, tooth analysis which evaluates not only esthetics but also morphology and appearance for proper function, and gingival analysis which forms ideal outline of gingival margins. A maxillary anterior diastema can be esthetically restored through the systematic diagnostic approach and treatment planning, and orthodontic, prosthetic, and conservative treatment can be applied for the treatment.