Browse > Article

A 3D Face Reconstruction Based on the Symmetrical Characteristics of Side View 2D Face Images  

Lee, Sung-Joo (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center)
Park, Kang-Ryoung (Division of Electronics and Electrical Engineering, Dongguk University, Biometrics Engineering Research Center)
Kim, Jai-Hie (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.48, no.1, 2011 , pp. 103-110 More about this Journal
Abstract
A widely used 3D face reconstruction method, structure from motion(SfM), shows robust performance when frontal, left, and right face images are used. However, this method cannot reconstruct a self-occluded facial part correctly when only one side view face images are used because only partial facial feature points can be used in this case. In order to solve the problem, the proposed method exploit a constrain that is bilateral symmetry of human faces in order to generate bilateral facial feature points and use both input facial feature points and generated facial feature points to reconstruct a 3D face. For quantitative evaluation of the proposed method, 3D faces were obtained from a 3D face scanner and compared with the reconstructed 3D faces. The experimental results show that the proposed 3D face reconstruction method based on both facial feature points outperforms the previous 3D face reconstruction method based on only partial facial feature points.
Keywords
3D Face reconstruction; Structure from motion; side view images;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 H. Zabrodsky and D. Weinshall, "Using bilateral symmetry to improve 3D reconstruction from image sequences," Computer Vision and Image Understanding, Vol. 67, No. 1, pp. 48-57, 1997.   DOI   ScienceOn
2 R. Szeliski and S. B. Kang, "Shape ambiguities in structure from motion", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, No. 5, pp. 506-512, 1997.   DOI   ScienceOn
3 U. Park, A. K. Jain, "3D model-based face recognition in video," Lecture Notes in Computer Science, Vol. 4642, pp. 1085-1094, 2007.
4 C. Tomasi and T. Kanade, "Shape and motion from image streams under orthography: a factorization method," International Journal of Computer Vision, Vol. 9, No. 2, pp. 137-154, 1992.   DOI   ScienceOn
5 M. Marques, J. Costeira, "Estimating 3D shape from degenerate sequences with missing data," Computer Vision and Image Understanding, Vol. 113, pp. 261-272, 2009.   DOI   ScienceOn
6 T.Wiberg, "Computation of principal components when data are missing," in: Proceedings Symposium of Computational Statistics, pp. 229-326, 1976.
7 U. Park and A. K. Jain, "3D face reconstruction from stereo video," in: Proceedings of the 3rd Canadian Conference on Computer and Robot Vision, pp. 41, 2006.
8 A. M. Buchanan, A. W. Fitzgibbon, "Damped Newton algorithms for matrix factorization with missing data," in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 2, pp.316-322, 2005.
9 Scanner specification, available at http://www.cyberware.com/products/pdf/headFace.pdf.
10 S. Baker, R. Gross, I. Matthews, "Lucas-Kanade 20 years on: a unifying framework: part 3," Technical Report CMU-RI-TR-03-35, Carnegie Mellon University Robotics Institute, 2003.
11 손광훈, 신형철, 양욱일, "[특집]3차원 얼굴인식 기술 현황 및 전망," 대한전자공학회 전자공학회지, 제33권, 제1호, 46-56쪽, 2006년.
12 양욱일, 손광훈, "방사 기저 함수 신경망을 이용한 3차원 얼굴인식," 전자공학회논문지, 제44권 SP편, 제 2호, 82-92쪽, 2007년.
13 B. Gokberk, A. A. Salah, N. Alyuz, and L. Akarun, "3D face recognition: technology and applications," in: Handbook of Remote Biometrics for Surveillance and Security, Springer, pp. 217-246, 2009.
14 F. Pighin, R. Szeliski and D. H. Salesin, "Modeling and animating realistic faces from images," International Journal of Computer Vision, Vol. 50, No. 2, pp. 143-169, 2002.   DOI   ScienceOn