The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Recognition of Facial Expressions of Animation Characters Using Dominant Colors and Feature Points

주색상과 특징점을 이용한 애니메이션 캐릭터의 표정인식

  • 장석우 (안양대학교 디지털미디어학과) ;
  • 김계영 (숭실대학교 IT대학 컴퓨터학부) ;
  • 나현숙 (숭실대학교 IT대학 컴퓨터학부)
  • Received : 2011.05.23
  • Accepted : 2011.09.06
  • Published : 2011.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper suggests a method to recognize facial expressions of animation characters by means of dominant colors and feature points. The proposed method defines a simplified mesh model adequate for the animation character and detects its face and facial components by using dominant colors. It also extracts edge-based feature points for each facial component. It then classifies the feature points into corresponding AUs(action units) through neural network, and finally recognizes character facial expressions with the suggested AU specification. Experimental results show that the suggested method can recognize facial expressions of animation characters reliably.

본 논문에서는 사람의 표정이 아닌 애니메이션 캐릭터의 표정을 주색상과 특징점을 효과적으로 분석하여 인식하는 방법을 제안한다. 제안된 방법에서는 먼저 캐릭터의 특성에 맞게 간략화한 메쉬모델을 정의하고 캐릭터 얼굴과 얼굴의 구성요소를 주색상을 이용하여 검출한 후 각 구성요소의 에지를 활용하여 표정인식을 위한 특징점을 추출한다. 그런 다음, 각 특징점의 위치와 모양 정보를 신경망 학습을 통해 해당 AU로 분류하고, 제안된 표정 AU 명세서를 이용해 최종적으로 표정을 인식한다. 실험에서는 제안된 애니메이션 캐릭터의 표정인식 방법이 무표정을 포함하여 기쁨, 슬픔, 놀람, 화남, 공포의 6가지 표정을 비교적 신뢰성 있게 인식함을 애니메이션 영상을 이용한 실험을 통해 보여준다.

Keywords

References

  1. J.-H. Kim, "A Study on the Key Elements for Facial Expression in Animation Character," In Proceedings of the Spring Conference of the Korea Institute of Design, pp.268-269, 2006.
  2. P. Ekman, W. V. Friesen, and S. Ancoli, "Facial Signs of Emotional Experience," Journal of Personality and Social Psychology, Vol.39, No.6, pp.1125-1134, 1980. https://doi.org/10.1037/h0077722
  3. Y.-I. Tian. T. Kanade, and J. F. Cohn, "Recognizing Action Units for Facial Expression Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.23, No.2, pp.97-115, 2001. https://doi.org/10.1109/34.908962
  4. G. Donato, M. S. Bartlett, J. C. Hager, P. Ekman, and T. J. Sejnowski, "Classifying Facial Actions," IEEE Transactions on Multimedia, Vol.4, No.1, pp.23-37, 2002. https://doi.org/10.1109/6046.985551
  5. Y. Wang, H. Ai, B. Wu, and C. Huang, "Real Time Facial Expression Recognition with Adaboost," In Proceedings of the IEEE International Conference on Pattern Recognition, Vol.3, pp.926-929, 2004.
  6. R. Min and H. D. Cheng, "Effective Image Retrieval Using Dominant Color Descriptor and Fuzzy Support Vector Machine," Pattern Recognition, Vol.42, No.1, pp.147-157, 2009. https://doi.org/10.1016/j.patcog.2008.07.001
  7. B. S. Manjunath, J.-R. Ohm, V. V. Vasudevan, and A. Yamada, "MPEG-7 Color and Texture Descriptors," IEEE Transactions on Circuits, Systems and Video Technology, Vol.11, pp.703-715, 2001. https://doi.org/10.1109/76.927424
  8. M. A. Cobb, F. E. Petry, and K. B. Shaw, "Fuzzy Spatial Relationship Refinements Based on Minimum Bounding Rectangle Variations," Fuzzy Sets and Systems, Vol.113, No.1, pp.111-120, 2000. https://doi.org/10.1016/S0165-0114(99)00015-9
  9. Z. Lin, J. Jiang, and Z. Wang, "Edge Detection in the Feature Space," Image and Vision Computing, Vol.29, No.2-3, pp.142-154, 2011. https://doi.org/10.1016/j.imavis.2010.08.008
  10. P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," In Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp.511-518, 2001.

Cited by

  1. Synthesizing Faces of Animation Characters Using a 3D Model vol.17, pp.8, 2012, https://doi.org/10.9708/jksci.2012.17.8.031