Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Analysis and Synthesis of Facial Expression using Base Faces

기준얼굴을 이용한 얼굴표정 분석 및 합성

  • 박문호 (연세대학교 컴퓨터과학과, 한국과학기술연구원 영상미디어연구센터) ;
  • 고희동 (한국과학기술원 영상미디어연구센터) ;
  • 변혜란 (연세대학교 컴퓨터과학과)
  • Published : 2000.08.15
Download PDF
⟨ Previous Next ⟩

Abstract

Facial expression is an effective tool to express human emotion. In this paper, a facial expression analysis method based on the base faces and their blending ratio is proposed. The seven base faces were chosen as axes describing and analyzing arbitrary facial expression. We set up seven facial expressions such as, surprise, fear, anger, disgust, happiness, sadness, and expressionless as base faces. Facial expression was built by fitting generic 3D facial model to facial image. Two comparable methods, Genetic Algorithms and Simulated Annealing were used to search the blending ratio of base faces. The usefulness of the proposed method for facial expression analysis was proved by the facial expression synthesis results.

본 논문에서는 인간의 중요한 감정표현 수단인 얼굴표정을 분석하는 방법을 제시하였다. 제안된 방법에서는 기준얼굴과 그의 혼합 비율의 관점에서 얼굴표정을 분석한다. 기준얼굴은 인간의 대표적인 얼굴표정인 놀람, 두려움, 분노, 혐오, 행복, 슬픔, 그리고 무표정으로 설정하였다. 얼굴 모델의 생성을 위해 일반 얼굴 모델이 얼굴영상으로 정합하는 방법을 사용하였다. 기준얼굴의 혼합 비율을 구하기 위해 유전자 알고리즘과 Simulated Annealing 방법을 사용하였고 탐색된 얼굴표정 정보를 이용한 얼굴표정 생성 실험을 통해 제안된 방법의 유용성을 입증하였다.

Keywords

References

  1. P. Gosselin, G. Kirouac and F. Y. Dore, Components and Recognition of Facial Expression in the Communication of Emotion by Actors, Journal of Personality and Social Psychology, Vol.68, pp.83-96, 1995
  2. Darrel, T., and Pentland, A., 'Attention-driven Expression and Gesture Analysis in an Interactive Environment,' Proc. of International Workshop on Automatic Face and Gesture Recognition, pp.135-140, Zurich, Switzerland, 1995
  3. Li, H., Roivainen, P., and Forchheimer, R., '3-D Motion Estimation in Model-Based Facial Image Coding,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.15, No.6, pp.545-555, 1993 https://doi.org/10.1109/34.216724
  4. Choi, C. S., Aizawa, K., Harashima, H., and Takebe, T., 'Analysis and Synthesis of Facial Image Sequences in Model-Based Image Coding,' IEEE Trans. Circuits and Systems for Video Technology, Vol.4, No.3, pp.257-275, 1994 https://doi.org/10.1109/76.305871
  5. Reinders, M. J. T., van Beek, P. J. L., Sankur, B., and van der Lubbe, J. C. A., 'Facial feature localization and adaptation of a generic face model for model-based coding,' Signal Processing: Image Communication, Vol.7, pp.57-74, 1995 https://doi.org/10.1016/0923-5965(94)00042-H
  6. Ko, H. and Kim, J. H., 'Searching for Facial Expression by Genetic Algorithm,' Proc. of the 2nd Eurographics Workshop on Virtual Environments, Monte Carlo, Monaco, 1995
  7. Yacoob, Y., and Davis, L. S., 'Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.18, No.6, pp.636-642, 1996 https://doi.org/10.1109/34.506414
  8. Essa, I., and Pentland, A., 'Coding, Analysis, Interpretation, and Recognition of Facial Expressions,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.19, pp.757-763, 1997 https://doi.org/10.1109/34.598232
  9. Lanitis, A., Taylor, C. J., and Cootes, T. F., 'Automatic Interpretation and Coding of Face Images Using Flexible Models,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.19, pp.743-756, 1997 https://doi.org/10.1109/34.598231
  10. Kimura, S., and Yachida, M., 'Facial Expression Recognition and Its Degree Estimation,' Proc. of CVPR'97, pp.295-300, San Juan, Puerto Rico, June 1997 https://doi.org/10.1109/CVPR.1997.609338
  11. Parke, F. I., 'Parameterized Model for Facial Animation,' IEEE Computer Graphics and Applications, Vol.2, No.9, pp.61-68, 1982
  12. Williams, L., 'Performance-based Facial Animation,' Proc. of ACM SIGGRAPH, pp.235-242
  13. Waters, K., 'A Muscle Model for Animating Three-Dimensional Facial Expression,' Proc. of ACM SIGGRAPH, pp.17-24, 1987 https://doi.org/10.1145/37401.37405
  14. Lee, Y., Terzopoulos, D., and Waters, K., 'Realistic Modeling for Facial Animation,' Proc. of ACM SIGGRAPH, pp.55-62, 1995 https://doi.org/10.1145/218380.218407
  15. Ekman, P., and Friesen, W. V., Unmasking the Face, A Guide to Recognizing Emotions from Facial Clues, England Cliffs, Prentice-Hall, New Jersey, 1975
  16. Ekman, P., and Friesen, W. V., Facial Action Coding System, A Technique for the measurement of facial movement, Palo Alto, Calif.: Consulting Psychologists Press, 1978
  17. Ko, H., Kim, M. S., Park, H. G., and Kim, S. W., 'Face sculpturing robot with recognition capability,' CAD, Vol.26, No.11, pp.814-821, 1994
  18. Goldberg, D. E., Genetic Algorithms in search, optimization & Machine Learning, Addison-Wesley, 1989
  19. Davis, L., Handbook of Genetic Algorithms, Van Nostrand Reinhold, 1991
  20. Michalewicz, Z., Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, 1994
  21. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. N. and Teller, E., 1953, 'Equation of State Calculation by Fast Computing Machine,' J. of Chem. Phys, Vol. 21, pp. 299-322 https://doi.org/10.1063/1.1699114
  22. Kirkpatrick, S., Gellatt, C. D., and Vecchi, M. D., 'Optimization by Simulated Annealing,' Science, Vol.220, No.4598, pp.671-680, 1983 https://doi.org/10.1126/science.220.4598.671