The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

Realistic individual 3D face modeling

사실적인 3D 얼굴 모델링 시스템

  • 김상훈 (제주한라대학교 방송영상과)
  • Received : 2013.06.24
  • Accepted : 2013.08.23
  • Published : 2013.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we present realistic 3D head modeling and facial expression systems. For 3D head modeling, we perform generic model fitting to make individual head shape and texture mapping. To calculate the deformation function in the generic model fitting, we determine correspondence between individual heads and the generic model. Then, we reconstruct the feature points to 3D with simultaneously captured images from calibrated stereo camera. For texture mapping, we project the fitted generic model to image and map the texture in the predefined triangle mesh to generic model. To prevent extracting the wrong texture, we propose a simple method using a modified interpolation function. For generating 3D facial expression, we use the vector muscle based algorithm. For more realistic facial expression, we add the deformation of the skin according to the jaw rotation to basic vector muscle model and apply mass spring model. Finally, several 3D facial expression results are shown at the end of the paper.

본 논문은 사실적인 3D 얼굴 모델링과 얼굴 표정 생성 시스템을 제안한다. 사실적인 3D 얼굴 모델링 기법에서 개별적인 3D 얼굴 모양과 텍스쳐 맵을 만들기 위해 Generic Model Fitting 기법을 적용하였다. Generic Model Fitting에서 Deformation Function을 계산하기 위해 개별적인 얼굴과 Generic Model 사이의 대응점을 결정하였다. 그 후, Calibrated Stereo Camera로부터 캡쳐 된 영상들로부터 특징점을 3D로 복원하였다. 텍스쳐 매핑을 위해 Fitted된 Generic Model을 영상으로 Projection하였고 사전에 정의된 Triangle Mesh에서 텍스쳐를 Generic Model에 매핑 하였다. 잘못된 텍스쳐 매핑을 방지하기 위해, Modified Interpolation Function을 사용한 간단한 방법을 제안하였다. 3D 얼굴 표정을 생성하기 위해 Vector Muscle기반 알고리즘을 사용하고, 보다 사실적인 표정 생성을 위해 Deformation 과 vector muscle 기반의 턱 rotation을 적용하였다.

Keywords

References

  1. D.Terzopoulos and K.Waters, "Physically-based facial modeling, analysis, and animation", The Journal of Visualization and Computer Animation, Vol. 1, No. 4, pp. 73-80, 1990. https://doi.org/10.1002/vis.4340010208
  2. V.Blanz, T.Vetter, "A morphable model for the synthesis of 3D faces", in SIGGRAPH 99 Conference Proceedings, ACM SIGGRAPH, pp. 187-194. 1999.
  3. N.Ersotelos, F.Dong, "Building highly realistic facial modeling and animation: Asurvey", Visual Computer, Vol. 24, issue 1, pp. 13-30. 2008.
  4. Tae-eun Kim, You-Shin Park, "Facial Animation Generation by Korean Text Input", The Journal of the Korea Institute of Electronic Communication Sciences, Vol. 4, No. 2, pp. 116-122, 2009.
  5. Sang-Hoon Kim, Tae-eun Kim, "A study on underwater 3D contents production", The Journal of the Korea Institute of Electronic Communication Sciences, Vol. 7, No. 3, pp. 529-536, 2012.
  6. Seung-Il Cho, Jong-Chan Kim, Kyeong-Jin Ban, Eung-Kon Kim, "A Study on 3D Panoramic Generation using Depth-map", The Journal of the Korea Institute of Electronic Communication Sciences, Vol. 6, No. 6, pp. 831-838, 2011.
  7. Y.Lee, D.Terzopoulos, and K.Waters, "Realistic modeling for facial animation," SIGGRAPH conference proceedings, pp. 55-62, ACM SIGGRAPH, August 1995.
  8. W.S.Lee, N.M.Thalmann, "Generating a population of animated faces from pictures," IEEE International workshop on model people, pp. 62-69. 1999.
  9. F.I.Parke, "Computer generated animation of faces," Proceedings of ACM conference, Vol. 1, pp. 451-457, 1972.
  10. R.Hartley and A.Zisserman, "Multiple view geometry in computer vison," Cambridge university press, 2000.
  11. T.F.Cootes,G.Edwards and C.Taylor, "Active apperance models," IEEE Trans. Pattern Anal.Mach.Inell. Vol. 23, No. 6, pp. 681-685, 2001. https://doi.org/10.1109/34.927467
  12. T.Cootes, D.Cooper, C.Taylor, and J. Graham, "Active shape models- their training and application," Computer Vision and Image Understanding, Vol. 61, No.1, pp. 38-59, 1995. https://doi.org/10.1006/cviu.1995.1004
  13. F.I.Parke, K.Waters, "Computer facial animation," 2ndedition,AKPeters,Ltd., 1996.
  14. K.Waters, "A muscle model for animating three-dimensional facial expression", IGGRAPH 87 Conference proceedings, Vol. 21, pp. 17-24, ACM SIGGRAPH, 1987.
  15. F.Pighin, J.Heckeer, D.Lischinski, P.Szeliski, D.H.Salesin", nthesizing realistic facial expressions from photographs," Proceedings of ACM Computer Graphics (SIGGRAPH '98), pp. 55-66, 1998.
  16. W.Press, B.Flanney, S.Teukolsky, and W.Verttering. "Numerical Recipes: The Art of scientific computing", ambridge university press, 1986.