Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

3D Facial Synthesis and Animation for Facial Motion Estimation

얼굴의 움직임 추적에 따른 3차원 얼굴 합성 및 애니메이션

  • 박도영 (육군사관학교 전산학과) ;
  • 심연숙 (연세대학교 인지과학 협동과정) ;
  • 변혜란 (연세대학교 컴퓨터학과)
  • Published : 2000.06.15
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we suggest the method of 3D facial synthesis using the motion of 2D facial images. We use the optical flow-based method for estimation of motion. We extract parameterized motion vectors using optical flow between two adjacent image sequences in order to estimate the facial features and the facial motion in 2D image sequences. Then, we combine parameters of the parameterized motion vectors and estimate facial motion information. We use the parameterized vector model according to the facial features. Our motion vector models are eye area, lip-eyebrow area, and face area. Combining 2D facial motion information with 3D facial model action unit, we synthesize the 3D facial model.

본 논문에서는 2차원 얼굴 영상의 움직임을 추출하여 3차원 얼굴 모델에 합성하는 방법을 연구하였다. 본 논문은 동영상에서의 움직임을 추정하기 위하여 광류를 기반으로 한 추정방법을 이용하였다. 2차원 동영상에서 얼굴요소 및 얼굴의 움직임을 추정하기 위해 인접한 두 영상으로부터 계산된 광류를 가장 잘 고려하는 매개변수화된 움직임 벡터들을 추출한다. 그리고 나서, 이를 소수의 매개변수들의 조합으로 만들어 얼굴의 움직임에 대한 정보를 묘사할 수 있게 하였다. 매개변수화 된 움직임 벡터는 눈 영역, 입술과 눈썹 영역, 그리고 얼굴영역을 위한 서로 다른 세 종류의 움직임을 위하여 사용하였다. 이를 얼굴 모델의 움직임을 합성할 수 있는 단위행위(Action Unit)와 결합하여 2차원 동영상에서의 얼굴 움직임을 3 차원으로 합성한 결과를 얻을 수 있다.

Keywords

References

  1. M. Kass., A. Witkin., and D. Terzopoulos, 'Snakes: Active contour models.' In Proc. of First International Conference on Computer Vision. pp259-268, 1987
  2. D. Terzopoulos., and K. Water., 'Analysis and synthesis of facial image sequences using physical and anatomical models.' IEEE Transactions on Pattern Analysis and Machine Intelligence. 15(6):569-579, 1993 https://doi.org/10.1109/34.216726
  3. I. Essa., T. Darrel., and A. Pentland., 'Tracking facial motion,' In Proc. of the Workshop on Motion of Non-rigid and Articulated Objects, Austin, Texas, pp36-42, 1994 https://doi.org/10.1109/MNRAO.1994.346257
  4. A. Azarbayejani, B. Horowits, and A. Pentland, 'Recursive estimation of structure and motion using the relative orientation constraint,' In Proc. of the Computer Vision and Pattern Recognition Conference, 1993 https://doi.org/10.1109/CVPR.1993.340966
  5. I. A. Essa, and A. Pentland, 'A vision system for observing and extracting facial action parameters,' In Proc. of Computer Vision and Pattern Recognition, Seattle, WA, pp.76-83, 1994 https://doi.org/10.1109/CVPR.1994.323813
  6. J. Bergen, P. Anadan, K. J. Hanna, and R. Hingorani, 'Hierarchical model-based motion estimation,' In Proc. of Second European Conference on Computer Vision, ECCV-92, G.Sandini(Ed.), Springer-Verlag, vol 588 of LNCS-Series, pp237-252, 1992
  7. Y. Yacoob, and L. S. Davis, 'Labeling of human face components from range data,' In Proc. of Computer Vision and Pattern Recognition, New York, pp. 592-593, 1993 https://doi.org/10.1109/CVPR.1993.341070
  8. A. L. Yuille, and D. S. Cohen, and P. W. Hallinan, 'Feature extraction from faces using deformable templates,' In Proc. of Computer Vision and Pattern Recognition, pp.104-109, 1989 https://doi.org/10.1109/CVPR.1989.37836
  9. Ajit Singh, Optic Flow Computation : A Unified Perspective, IEEE Computer Society Press, 1991
  10. 심연숙,박도영,변혜란.'휴먼 인터페이스를 위한 얼굴 합성 및 표정합성', 한국정보과학회 HCI '98학술대회 발표논문집', 1998. 2
  11. 심연숙,박도영,전원종,변혜란. '표준 한국인 얼굴 모델링 및 얼굴의 표정합성', 한국인지과학회 춘계학술발표논문집, 1998
  12. P. Ekman, and W. V. Friesen, 'Facial Action Coding System,' Palo Alto, CA, Consulting-Psychologist Press, 1978
  13. William H. Press, Brian P. Flannery, Saul A. Teukoisky, and William T. Vetterling, Numerical Recipes in C: The Art of Scientific Computing, Cambridge University Press, 1988
  14. J. J. Koenderink, and A. J. van Doorn, 'Invariant properties of the motion parallel field due to the movement of rigid bodies relative to an observer,' Optica Acta, 22(9):773-791, 1975 https://doi.org/10.1080/713819112
  15. M. J. Black, and Y. Yaccob, 'Tracking and recognizing rigid and non-rigid facial motions using local parameteric model of image motion,' In Proc. of the International Conference on Computer Vision, pp. 374-381, IEEE Computer Society, 1995 https://doi.org/10.1109/ICCV.1995.466915
  16. R. Cipolla, and A. Blake, 'Surface orientation and time to contact from image divergence and deformation,' In Proc. of ECCV-92, G.Sndini, Springer_Verlag, vol 588 of LNCS-Series, pp. 187-202, 1992
  17. J. V. Beck, and K. J. Arnold, 'Parameter estimation in engineering and science'. John Wiley, New York, 1977
  18. A. Ralston, and P. Rabionwitz, A First Course in Numerical Analysis, McGraw-Hill, New-York, 1978
  19. F. I. Parke. 'Computer generated animation of faces,' Master's thesis, University of Utah, Salt Lake City, UT, UTEC-CSc-72-120, 1972
  20. F. I. Parke. 'A Parameteric Model for Human Faces,' PhD thesis, Univirsity of Utah, Salt Lake City, UT, December UTEC-CSs-72-120, 1974
  21. S. M. Platt, 'A system for computer simulation of the human face' Master's thesis, The Moore School, University of Pensylvania, Philadelphia, 1980
  22. P. Bergeron and P. Lachapelle, 'Controlling facial expression and body movements,' In Advanced Computer Animation, SIGGRAPH'85 Tutorials, Volum2, pages 61-79. ACM, New York, 1985
  23. K. Waters. 'A muscle model for animating three-dimensional facial expressions,' Computer Graphics (SIGGRAPH '87),21(4):17-24, July 1987 https://doi.org/10.1145/37401.37405
  24. Y. Lee, D. Terzopoulos, and K. Waters, 'Realistic modelng for facial animation,' Computer Graphics, 29(4):55-62, August 1995 https://doi.org/10.1145/218380.218407
  25. M. Black, Y. Yacoob, 'Recognizing facial expressions in image sequences using local parameterized models of image motion,' International Journal of Computer Vision,25(1),23-48, 1997 https://doi.org/10.1023/A:1007977618277