Browse > Article
http://dx.doi.org/10.9717/kmms.2014.17.9.1076

3D Emotional Avatar Creation and Animation using Facial Expression Recognition  

Cho, Taehoon (Department of Computer Engineering, Sejong University)
Jeong, Joong-Pill (Department of Computer Engineering, Sejong University)
Choi, Soo-Mi (Department of Computer Engineering, Sejong University)
Publication Information
Journal of Korea Multimedia Society / v.17, no.9, 2014 , pp. 1076-1083 More about this Journal
Abstract
We propose an emotional facial avatar that portrays the user's facial expressions with an emotional emphasis, while achieving visual and behavioral realism. This is achieved by unifying automatic analysis of facial expressions and animation of realistic 3D faces with details such as facial hair and hairstyles. To augment facial appearance according to the user's emotions, we use emotional templates representing typical emotions in an artistic way, which can be easily combined with the skin texture of the 3D face at runtime. Hence, our interface gives the user vision-based control over facial animation of the emotional avatar, easily changing its moods.
Keywords
Emotional Avatars; 3D Facial Animation Facial Expression Analysis; Appearance Augmentation;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 C. Cao, Y. Weng, S. Lin, and K. Zhou, "3D Shape Regression for Realtime Facial Animation," ACM Transactions on Graphics, Vol. 32, No. 4, pp. 41:1-41:10, 2013.
2 T. Beeler, B. Bickel, G. Noris, P. Beardsley, S. Marschner, R.W. Sumner, et al., "Coupled 3D Reconstruction of Sparse Facial Hair and Skin," ACM Transactions on Graphics, Vol. 31, No. 4, pp. 117:1-117:10, 2012.
3 P. Ekman, W.V. Friesen, and J. Hager, Facial Action Coding System: Research Nexus, Network Research Information, 2002.
4 T. Cootes, G. Edwards, and C. Taylor, "Active Appearance Models," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, pp. 681-685, 2001.   DOI   ScienceOn
5 I. Kotsia and I. Pitas, "Facial Expression Recognition in Image Sequences using Geometric Deformation Features and Support Vector Machines," IEEE Transactions on Image Processing, Vol. 16, No. 1, pp. 172-187, 2007.   DOI
6 C.-C. Chang and C.-J. Lin, "LIBSVM: A Library for Support Vector Machines," ACM Transactions on Intelligent Systems and Technology, Vol. 2, No. 3, pp. 27:1-27:27, 2011.
7 J. Ahlberg, CANDIDE-3-An Updated Parameterised Face, LiTH-ISY-R-2326, Deptartment of Electrical Engineering, Linkooping University, 2001.
8 B. Bickel, M. Lang, M. Botsch, M. Otaduy, and M. Gross, "Pose-space Animation and Transfer of Facial Details," Proceeding of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 57-66, 2008.
9 M. B. Stegmann, B. K. Ersboll, and R. Larsen, "FAME-a Flexible Appearance Modelling Environment," IEEE Transaction on Medical Imaging, Vol. 22, No. 10, pp. 1319-1331, 2003.   DOI   ScienceOn
10 P. Lucey, F. J. Cohn, T. Kanade, J. Sarahih, and Z. Ambadar, "The Extended Cohn-Kanade Dataset(CK+): A Complete Dataset for Action Unit and Emotion-specified Expression," Computer Vision and Pattern Recognition Workshops, pp. 94-101, 2010.
11 T. Cootes, An Introduction to Active Shape Models, Image Processing and Analysis, Oxford University Press, New York, NY, 2000.
12 R.W. Picard, Affective Computing, MIT Press, Cambridge, Mass., 2000.
13 H. Byun, "Real-time Facial Modeling and Animation based on High Resolution Capture," Journal of Korea Multimedia Society, Vol. 11, No. 8, pp. 1138-1145, 2008.   과학기술학회마을