Browse > Article

Synthesis of Realistic Facial Expression using a Nonlinear Model for Skin Color Change  

Lee Jeong-Ho (Dept. of Computer Science and Engineering, Hanyang University)
Park Hyun (Dept. of Computer Science and Engineering, Hanyang University)
Moon Young-Shik (Dept. of Computer Science and Engineering, Hanyang University)
Publication Information
Journal of the Institute of Electronics Engineers of Korea CI / v.43, no.3, 2006 , pp. 67-75 More about this Journal
Abstract
Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance. Since it is difficult to generate realistic facial expressions by using only geometric deformations, detailed features such as textures should also be deformed to achieve more realistic expression. The existing methods such as the expression ratio image have drawbacks, in that detailed changes of complexion by lighting can not be generated properly. In this paper, we propose a nonlinear model for skin color change and a model-based synthesis method for facial expression that can apply realistic expression details under different lighting conditions. The proposed method is composed of the following three steps; automatic extraction of facial features using active appearance model and geometric deformation of expression using warping, generation of facial expression using a model for nonlinear skin color change, and synthesis of original face with generated expression using a blending ratio that is computed by the Euclidean distance transform. Experimental results show that the proposed method generate realistic facial expressions under various lighting conditions.
Keywords
Facial Expression; Nonlinear Skin Color Change Model;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Coates, G. J. Edwards, and C. J. Taylor. Active appearance models. In H.Burkhardt and B. Neumann, editors, 5th European Conference on Computer Vision, volume 2, pages 484-498. Springer, 1998
2 Z. Liu, Y. Shan, Z. Zhang, 'Expressive Expression Mapping with Ratio Images', Proc. SIGGRAPH01, pp.271-276, 2001   DOI
3 T. Riklin-Raviv and A. Shashua. 'The quotient image: Class based re-rendering and recongnition with varying illuminations.' In IEEE Conference on Computer Vision and Pattern Recognition, pages 566.571, June 1999   DOI   ScienceOn
4 H. Breu, J. Gil, D. Kirkpatrick and M. Weman, 'Linear Time Euclidean Distance Transform Algorithrn,' IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 17, No. 5, pp.529-533, May 1995   DOI   ScienceOn
5 S. R. Marschner and D. P. Greenberg. Inverse lighting for photography. In IST/SID Fifth Colort Imaging Conference, November 1997
6 P. E. Debevec. Rendering synthetic objects into real scenes: Bridging traditional and imagebased graphics with global illumination and high dynamic range photography. In Computer Graphics, Annual Conference Series, pages 189.198. Siggraph, July 1998   DOI
7 F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin. 'Synthesizing realistic facial expressions from photographs.' In Computer Graphics, Annual Conference Series, pages 75.84. Siggraph, July 1998   DOI
8 D. Terzopoulos and K. Waters. 'Physically-based facial modeling and animation.' Journal of Visualization and Computer Animation, 1(4):73.80, March 1990   DOI
9 T. Beier and S. Neely. 'Feature-based image metamorphosis.' In Computer Graphics, pages 35.42. Siggraph, July 1992   DOI
10 K. Waters. 'A muscle model for animating three-dimensional facial expression.' In Computer Graphics, 22(4):17.24, 1987   DOI
11 Hyun Park, Kee Wook Rim, and Young Shik Moon, 'An Efficient Aesthetic Surgery Model Based on 2D Color Photograph', In PCM 2005, Part II, LNCS 3768, pp.865-876, 2005   DOI   ScienceOn
12 N. Badler and S. Platt. 'Animating facial expressions.' In Computer Graphics, pages 245.252. Siggraph, August 1981   DOI