Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Facial Texture Generation using an Image Registration Algorithm based on Ellipsoidal Prototype Model

타원체형 모델 기반의 영상정렬 알고리즘을 이용한 얼굴 텍스쳐 생성

  • Published : 2005.01.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper. we propose an image registration algorithm based on variable-sized blocks of ellipsoidal prototype model which is similar in shape to human face. While matching blocks, the existing cylindrical prototype model which only takes into account left and right curvature can accomplish a correct alignment on left and right images. But, registration errors are produced from up and down images because the cylindrical prototype model not reflects characteristics of head shape and jaw structure of human. The proposed method is a block matching algorithm which uses variable-sized blocks with considering left-right and up-down curvature of ellipsoidal face model and can correctly align images by using the correlation between them. We then adapt image mosaic technique to generate a face texture from aligned images. For this purpose, we stitch them with assigning linear weights according to the overlapped region and remove ghost effects to make more realistic facial texture.

본 논문에서는 얼굴 형태와 유사한 타원체형 모델의 가변적 블록크기를 기반으로 하는 영상정렬 알고리즘을 제안한다. 블록정합 수행 시 좌우 곡률만을 고려한 기존의 실린더형 원형모델 방법은 좌우 영상에 대하여 정확한 정렬을 수행하지만 상하 영상에 대해서는 사람의 두상모양이나 턱 구조의 특징을 반영하지 않았기 때문에 정렬오류가 발생한다. 본 논문에서 제안한 알고리즘은 타원체형 얼굴 모델의 상하 좌우의 곡률에 따라 가변적인 블록크기를 사용하는 블록정합 알고리즘으로서 영상의 상관관계를 이용하여 정확한 정렬을 할 수 있다. 그리고 정렬된 영상으로부터 얼굴 텍스쳐 영상을 생성하기 위하여 영상 모자익 기법을 사용한다. 이때 중첩된 영역에 따라 선형적인 가중치를 부여하여 영상을 스티칭하고 부분적으로 나타나는 고스트 효과를 제거함으로써 더 실감 있는 텍스쳐를 생성한다.

Keywords

References

  1. Y. Lee, D. Terzopoulos, K. Waters, 'Realistic Modeling for Facial Animation,' In Computer Graphics, SIGGRAPH Proceedings, pp.191-198, Los Angeles, CA, August 1995 https://doi.org/10.1145/218380.218407
  2. W.-S. Lee, N. Magnenat-Thalmann, 'Fast head modeling for animation,' Image and Computing, Vol.18, pp.355-364, March 2000 https://doi.org/10.1016/S0262-8856(99)00057-8
  3. V. Lempitsky, D. Ivanov, Ye. Kuzmin, 'Texturing Calibrated Head Model from Images,' EG'2002, September 2002
  4. Frederic H. Pighin, Richard Szeliski, David Salesin, 'Modeling and Animating Realistic Faces from Images,' International Journal of Computer Vision 50(2), pp.143-169, 2002 https://doi.org/10.1023/A:1020393915769
  5. B. Tiddeman, N. Duffy, G. Rabey, 'Construction and visualization of thee- dimensional facial statistics,' Computer Methods and Programs in Biomedicine, Vol.63, pp.9-20, September 2000 https://doi.org/10.1016/S0169-2607(00)00072-9
  6. Y. J. Chang, Y. C. Chen, 'Facial model adaptation from a monocular image sequence using a textured polygonal model,' Signal Processing: Image Communication, Vol.17, pp.373-392, 2002 https://doi.org/10.1016/S0923-5965(02)00008-5
  7. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, D. Salesin, 'Synthesizing Realistic Facial Expressions from Photographs,' SIGGRAPH98 Proceedings, pp.75-84, 1998 https://doi.org/10.1145/280814.280825
  8. Han Tae-Woo, '3D face modeling system for realistic facial expression animation,' MD Thesis, Department of Computer Science, Korea Advanced Institute of Science Technology, 1998
  9. Joongjae Lee, Hyungil Choi, 'An Image Registration Algorithm Based on Cylindrical Prototype Model,' Lecture Notes in Computational Science-ICCS2001, pp.37-43, 2001
  10. Ryosuke Motani, 'Estimating body mass from silhouette: testing the assumption of elliptical body cross-sections,' Paleobiology, 27, pp.735-750, 2001 https://doi.org/10.1666/0094-8373(2001)027<0735:EBMFST>2.0.CO;2
  11. Luis Torres, Jean-Yves Reutter, Luis Lorente, 'The Importance of the Color Information in Face Recognition,' Proceedings of the 1999 International Conference on Image Processing (ICIP '99), Kobe, Japan, pp.627-631, October 1999 https://doi.org/10.1109/ICIP.1999.817191
  12. B. S. Manjunath, W. Y. Ma, 'Texture Features for Browsing and Retrieval of Image Data,' IEEE Transactions on pattern analysis and machine intelligence, Vol.18, No.8, August 1996 https://doi.org/10.1109/34.531803
  13. R. T. Whitaker, 'A level-set approach to image blending,' Image Processing, IEEE Transactions on, Vol.9, Issue.11, pp.1849-1861, Nov 2000 https://doi.org/10.1109/83.877208
  14. Hendrik P. A. Lensch, W. Heidrich, Hans-Peter Seidel, 'A Silhouette-Based Algorithm for Texture Registration and Stitching,' Graphical Models, Vol.63, Issue.4, pp.245-262, July 2001 https://doi.org/10.1006/gmod.2001.0554
  15. W. J. Gordon and J. A. Wixom. 'Shepard's method of Metric Interpolation to bivariate and multivariate interpolation,' Mathematics of Computation, vol.32, pp.253-264, 1978 https://doi.org/10.2307/2006273
  16. C. Rocchini, P. Cignoni, C. Montani, R. Scopigno, 'Multiple Textures Stitching and Blending on 3D Objects,' 10th Eurographics Workshop on Rendering, G. Ward and D. Lischinsky ed., Granada(E), pp.127-138, June 21-23 1999
  17. M. Uyttendaele, A. Eden, R. Szeliski, 'Eliminating Ghosting and Exposure Artifacts in Image Mosaics,' Computer Vision and Pattern Recognition, Proceedings of the 2001 IEEE Computer Society Conference on, Vol.2, pp.519-516, 2001 https://doi.org/10.1109/CVPR.2001.991005