Browse > Article

A 3D Face Reconstruction Method Robust to Errors of Automatic Facial Feature Point Extraction  

Lee, Youn-Joo (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center)
Lee, Sung-Joo (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center)
Park, Kang-Ryoung (Division of Electronics and Electrical Engineering, Dongguk University, Biometrics Engineering Research Center)
Kim, Jai-Hie (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.48, no.1, 2011 , pp. 122-131 More about this Journal
Abstract
A widely used single image-based 3D face reconstruction method, 3D morphable shape model, reconstructs an accurate 3D facial shape when 2D facial feature points are correctly extracted from an input face image. However, in the case that a user's cooperation is not available such as a real-time 3D face reconstruction system, this method can be vulnerable to the errors of automatic facial feature point extraction. In order to solve this problem, we automatically classify extracted facial feature points into two groups, erroneous and correct ones, and then reconstruct a 3D facial shape by using only the correctly extracted facial feature points. The experimental results showed that the 3D reconstruction performance of the proposed method was remarkably improved compared to that of the previous method which does not consider the errors of automatic facial feature point extraction.
Keywords
3D face reconstruction; 3D morphable shape model; facial feature point extraction errors;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 S. Baker, R. Gross, I. Matthews, "Lucas-Kanade 20 years on: a unifying framework: part 3," Technical Report CMU-RI-TR-03-35, Carnegie Mellon University Robotics Institute, 2003.
2 S. Lee, K. Park, J. Kim, "A comparative study of facial appearance modeling methods for active appearance models," Pattern Recognition Letters, Vol. 30, Iss. 14, pp. 1335-1346, Oct. 2009.   DOI   ScienceOn
3 L. Liang, R. Xiao, F. Wen and J. Sun, "Face alignment via component-based discriminative search," LNCS on European Conference on Computer Vision, 5303, pp. 72-85, 2008.
4 3D Scanner specification [Online] http://www.cyberware.com/products/pdf/headFace.pdf
5 S. Wang, and S. Lai, "Efficient 3D face reconstruction from a single 2D image by combining statistical and geometrical information," LNCS on Asian Conference on Computer Vision, 3852, pp. 427-436, 2006.
6 C. Wang, S. Yan, H. Li, H. Zhang, M. Li, "Automatic, effective, and efficient 3D face reconstruction from arbitrary view image," LNCS on Advances in Multimedia Information Processing, 3332, pp. 553-560, 2004.
7 Xinbo Gao, Ya Su, Xuelong Li and Dacheng Tao, "A Review of Active Appearance Models," IEEE Transactions on System, Man, And Cybernetics-Part C: Applications and Reviews, Vol. 40, No. 2, pp. 145-158, 2010.   DOI
8 T. F. Cootes and C. J. Taylor, "Active Shape Models - 'Smart Snakes'," British Machine Vision Conference, pp. 266-275, 1992.
9 E. Murphy-Chutorian, A. Doshi, and M. M. Trivedi, "Head pose estimation for driver assistance systems: a robust algorithm and experimental evaluation," Proceedings of the 2007 IEEE Intelligent Transportation Systems Conference, pp. 709 - 714, 2007.
10 SVM [Online] http://www.cs.ucl.ac.uk/staff/M.Sewell/winsvm/
11 B. Gokberk, A. A. Salah, N. Alyuz, and L. Akarun, "3D face recognition: technology and applications," in Handbook of Remote Biometrics for Surveillance and Security, Springer, pp. 217-246, 2009.
12 Example of game character generation [Online]http://fightnight.easports.com/featureFrame.action?id=FeatureTBA1&fType=
13 U. Park, Y. Tong, and A. K. Jain, "Face recognition with temporal invariance: a 3D aging model," Proceedings of International Conference on Automatic Face and Gesture Recognition, pp. 1-7, 2008.
14 X. Zhang, and Y. Gao, "Face recognition across pose: a review," Pattern Recognition, Vol. 42, pp. 2876-2896, 2009.   DOI   ScienceOn
15 V. Blanz, and T. Vetter, "A morphable model for the synthesis of 3D faces," Proceedings of Computer Graphics Proc. SIGGRAPH, pp. 187-194, 1999.
16 김병우, 유선진, 이상윤, "단일 투사 절대 코드 패턴을 이용한 3차원 얼굴 데이터의 유클리디안 복원," 전자공학회논문지, 제42권 SP편, 제6호, 133-140쪽, 2005년.
17 손광훈, 신형철, 양욱일, "[특집]3차원 얼굴인식 기술 현황 및 전망", 대한전자공학회 전자공학회지, 제33권, 제1호, pp. 46-56, 2006.