Browse > Article
http://dx.doi.org/10.9717/kmms.2014.17.7.806

Extraction of Lip Region using Chromaticity Transformation and Fuzzy Clustering  

Kim, Jeong Yeop (School of Undeclared Majors, Youngsan University)
Publication Information
Journal of Korea Multimedia Society / v.17, no.7, 2014 , pp. 806-817 More about this Journal
Abstract
The extraction of lip region is essential to Lip Reading, which is a field of image processing to get some meaningful information by the analysis of lip movement from human face image. Many conventional methods to extract lip region are proposed. One is getting the position of lip by using geometric face structure. The other discriminates lip and skin regions by using color information only. The former is more complex than the latter, however it can analyze black and white image also. The latter is very simple compared to the former, however it is very difficult to discriminate lip and skin regions because of close similarity between these two regions. And also, the accuracy is relatively low compared to the former. Conventional analysis of color coordinate systems are mostly based on specific extraction scheme for lip regions rather than coordinate system itself. In this paper, the method for selection of effective color coordinate system and chromaticity transformation to discriminate these two lip and skin region are proposed.
Keywords
Lip/Skin Color Analysis; Lip Region Extraction;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Y. Wu, R. Ma, W. Hu, T. Wang, Y. Zhang, J. Cheng, and H. Lu, "Robust Lip Localization On Multi-view Faces In Video," Proceeding of IEEE International Conference on Image Processing, pp. 481-484, 2007.
2 S. Sridharan S. Lucey, and V. Chandran, "Adaptive Mouth Segmentation using Chromatic Features," Pattern Recognition Letters, Vol. 23, No. 11, pp. 1293-1302, 2002.   DOI
3 O. Erol, Y. Berkay, K. Harun, E. Hakan, and U. Mustafa, "Lip Segmentation using Adaptive Color Space Training," Proceeding of the International Conference on Auditory- Visual Speech Processing, pp. 219-222, 2008.
4 R. Rohani, F. Sobhanmanesh, S. Alizadeh, and R. Boostani, "Lip Processing and Modeling based on Spatial Fuzzy Clustering in Color Images," International Journal of Fuzzy Systems, Vol. 13, No. 2, pp. 65-73, 2011.
5 K. S. Jang and I. Lee, "Lip Shape Representation and Lip Boundary Detection Using Mixture Model of Shape," Journal of Korea Multimedia Society, Vol. 7, No. 11, pp. 1531- 1539, 2004.   과학기술학회마을
6 G. Wyszecki and W.S. Stiles, Color Science: Concepts and Methods, Quantitative Data and Formulae, John Wiley&Sons, New York, 1982.
7 MIT Facerec Database, http://cbcl.mit.edu/ softwaredatasets/heisele/facerecognition-database. html (accessed April, 15, 2014).
8 R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, 2nd edition, Wiley-Interscience, Hoboken, NJ, 2000.
9 California Institute of Technology Face Database, http://www.vision.caltech.edu/Image_ Datasets/faces/faces.tar (accessed April, 15, 2014).
10 M. Nilsson, "Face Detection using Local SMQT Features and Split up Snow Classifier, www.mathworks.fr (accessed April, 15, 2014).
11 A.L. Yuille, P.W. Hallinan, and D.S. Cohen, "Feature Extraction from Faces using Deformable Templates," International Journal of Computer Vision, Vol. 8, No. 2, pp. 99-111, 1992.   DOI   ScienceOn
12 T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Grahan, "Active Shape Models: Their Training and Application," Computer Vision and Image Understanding, Vol. 61, No. 2, pp. 38-59, 1995.   DOI   ScienceOn
13 C. Bregler and Y. Konig, "Eigenlips for Robust Speech Recognition," Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 669-672, 1994.
14 D. Sanger, Y. Miyake, H. Haneishi, and N. Tsumura "Algorithm for Face Extraction Based on Lip Detection," Journal of Imaging and Science and Technology, Vol. 41, No. 1, pp. 71-80, 1997.
15 G.I. Chiou and J.N. Hwang, "Lipreading from Color Video," IEEE Transactions on Image Processing, Vol. 6, No. 8, pp. 1192-1195, 1997.   DOI   ScienceOn
16 M. Vogt, "Fast Matching of a Dynamic Lip Model to Color Video Sequences under Regular Illumination Conditions," NATO ASI Series F, Vol. 150, D. G. Stork, M. E. Hennecke (Eds.), pp. 399-407, 1996.
17 M.U.R. Sanchez, J. Matas, and J. Kittler, "Statistical Chromaticity-based Lip Tracking with B-Splines," Proceeding of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2973-2976, 1997.
18 T. Wark, S. Sridharan, and V. Chandran, "An Approach to Statistical Lip Modelling for Speaker Identification via Chromatic Feature Extraction," Proceeding of the 14th International Conference on Pattern Recognition, Vol. 1, pp. 123-125, 1998.
19 T.W. Lewis and D.M.W. Powers, "Lip Feature Extraction using Red Exclusion," Proceeding of Pan-Sydney Workshop on Visual Information Processing, Vol. 2, pp. 61-67, 2001.
20 V. Vezhnevets, S. Soldatov, A. Degtiareva, and I.K. Park, "Automatic Extraction of Frontal Facial Features," Proceeding of 6th Asian Conference on Computer Vision, Vol. 2, pp. 1020-1025, 2004.
21 M. Wimmer and B. Radig, "Adaptive Skin Color Classificator," Proceeding of the first ICGST International Conference on Graphics, Vision and Image Processing, Vol. 1, pp. 324-327, 2005.
22 A.W. Liew, S.H. Leung, and W.H. Lau, "Segmentation of Color Lip Images by Spatial Fuzzy Clustering," IEEE Transactions on Fuzzy Systems, Vol. 11, No. 4, pp. 542-549, 2003.   DOI   ScienceOn
23 W. Wenchao, W. Shilin, K.E. Engin, M. Xiaoli, L. Shenghong, L. Jianhua, and L.M. Ni, "Optimization of Lip Contour Estimation," Chinese Journal of Electronics, Vol. 23, No. 2, pp. 341-347, 2014.
24 G. Potamianos, C. Neti, J. Luettin, and I. Matthews, Audio-Visual Automatic Speech Recognition: An Overview, In: G. Bailly, E. Vatikiotis-Bateson and P. Perrier (Ed.), Issues in Audio-Visual Speech Processing, MIT Press, 2004.