Browse > Article
http://dx.doi.org/10.9717/kmms.2011.14.4.494

Development of Recognition Application of Facial Expression for Laughter Theraphy on Smartphone  

Kang, Sun-Kyung (원광대학교 컴퓨터공학과)
Li, Yu-Jie (원광대학교 컴퓨터공학과)
Song, Won-Chang (원광대학교 컴퓨터공학과)
Kim, Young-Un (원광대학교 컴퓨터공학과)
Jung, Sung-Tae (원광대학교 컴퓨터공학과)
Publication Information
Journal of Korea Multimedia Society / v.14, no.4, 2011 , pp. 494-503 More about this Journal
Abstract
In this paper, we propose a recognition application of facial expression for laughter theraphy on smartphone. It detects face region by using AdaBoost face detection algorithm from the front camera image of a smartphone. After detecting the face image, it detects the lip region from the detected face image. From the next frame, it doesn't detect the face image but tracks the lip region which were detected in the previous frame by using the three step block matching algorithm. The size of the detected lip image varies according to the distance between camera and user. So, it scales the detected lip image with a fixed size. After that, it minimizes the effect of illumination variation by applying the bilateral symmetry and histogram matching illumination normalization. After that, it computes lip eigen vector by using PCA(Principal Component Analysis) and recognizes laughter expression by using a multilayer perceptron artificial network. The experiment results show that the proposed method could deal with 16.7 frame/s and the proposed illumination normalization method could reduce the variations of illumination better than the existing methods for better recognition performance.
Keywords
Facial Expression Recongnition; Three Step Block Matching; PCA; Multilayer Perceptron Artificial Neural Network;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 한수정, 곽근창, 고현주, 김승석, 전명근, "ICA-factorial 표현법을 이용한 얼굴감정인식," 한국퍼지 및 지능시스템학회 논문지, 제13권, 제3호, pp. 371-376, 2003.
2 이옥걸, 강선경, 김용운, 정성태, "웃음 치료 훈련을 위한 웃음 표정 인식 시스템 개발," 한국컴퓨터 정보학회 논문지, 제15권, 제4호, pp. 47-55, 2010.
3 T. Koga, K. Linuma, A. Hirano, Y. Iijima, and T. Ishiguro, "Motion-Compensated Interframe Coding for Video Conference," in Proc. NTC 81, pp. C961-965, 1981.
4 J. R. Jain and A. K. Jain, "Displacement Measurement and Its Application in Interframe image Coding," IEEE Trans. on Communications, Vol.COM-33, pp. 1011-1014, 1985.
5 Th. Zahariadis and D. Kalivas, "A Spiral Search Algorithm For Fast Estimation Of Block Motion Vectors," Signal Processing VIII , theories and applications. Proceedings of the EUSIPCO 96., Vol.2, pp. 1079-1082.
6 M.Ghanbari, "The Cross Search Algorithm for Motion Estimation," IEEE Transactions on Communications, Vol.38, No.7 pp. 950-3, 1990.   DOI   ScienceOn
7 Kwon Moon Nam, Joon-Seek Kim, and Rae-Hong Park, "A Fast Hierarchical Motion Vector Estimation Algorithm Using Mean Pyramid," IEEE Transactions on Circuits and Systems for Video technology, Vol.5, No.4, pp. 344-351, 1995.   DOI   ScienceOn
8 J. Lien, T. Kanade and C. Li, "Detection, Tracking, and Classification of Action Units in Facial Expression," Journal of Robotics and Autonomous Systems, Vol.31, No.3, pp. 131-146, 2000   DOI   ScienceOn
9 C. Padgett and G. Cottrell, "Representing Face Images for Emotion Classification," Advances in Neural Information Processing Systems. Vol. 9, MIT Press. 1997.
10 김호덕, 양현창, 박창현, 심귀보, "PCA을 이용 한 얼굴 표정의 감정인식 방법," Proceedings of KFIS Autumn Conference, 제16권, 제2호, pp. 772-776, 2006.
11 신영숙 "PCA 표정을 이용한 강인한 얼굴 표정인식," 한국인지과학회 논문지, 제16권, 제4호, pp. 323-331, 2005.
12 이우주, 김진철, 이배호, " AdaBoost 알고리즘을 이용한 실시간 얼굴 검출 및 추적," 한국멀티미디어학회논문지, Vol.9, No.10, pp. 1266-1275, 2006.
13 Lienhart R, and Maydt J, "An extended Set of Harr-Like Features for Rapid Object Detection," Proceedings of International Conference on Image Processing, Vol.1, pp. I-900-I-903, 2002.
14 Viola P and Jones M, "Rapid Object Detection Using a Boosted Cascade of Simple Features," Computer Vision and Pattern Recognition, CVPR 2001. Vol.1, pp. I-511-I-518, 2001.