Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2011.18B.1.021

A 3D Face Reconstruction and Tracking Method using the Estimated Depth Information  

Ju, Myung-Ho (가톨릭대학교 컴퓨터공학과)
Kang, Hang-Bong (가톨릭대학교 디지털미디어학부)
Publication Information
The KIPS Transactions:PartB / v.18B, no.1, 2011 , pp. 21-28 More about this Journal
Abstract
A 3D face shape derived from 2D images may be useful in many applications, such as face recognition, face synthesis and human computer interaction. To do this, we develop a fast 3D Active Appearance Model (3D-AAM) method using depth estimation. The training images include specific 3D face poses which are extremely different from one another. The landmark's depth information of landmarks is estimated from the training image sequence by using the approximated Jacobian matrix. It is added at the test phase to deal with the 3D pose variations of the input face. Our experimental results show that the proposed method can efficiently fit the face shape, including the variations of facial expressions and 3D pose variations, better than the typical AAM, and can estimate accurate 3D face shape from images.
Keywords
3D AAM; Face Modeling; 3D Face Shape;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. F. Cootes, G. J. Edwards, and C. J. Taylor. “Active Appearance Models”, IEEE Transactionis on Pattern Analysis and Machine Intelligence, 23(6):681-685, 2001.   DOI   ScienceOn
2 C.-W. Chen, and C.-C. Wang. “3D Active Appearance Model for Aligning Faces in 2D Images”, Proceedings of the IEEE/RS International Conference on Intelligent Robots and Systems, 3133-3139, 2008.
3 J. Xiao, S. Baker, I. Matthews, and T. Kanade. “Real-Time Combined 2D+3D Active Appearance Models”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 535-542, 2004.
4 J. Heo, and M. Savvides. “In Between 3D Active Appearance Models and 3D Morphable Models”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 20-26, 2009.
5 M. Brown, and D. G. Lowe. “Automatic Panoramic Image Stitching using Invariant Features”, International Journal of Computer Vision, 74(1):59-73, 2007.   DOI
6 M. D. Cordea, and E. M. Petriu. “A 3-D Anthropometric-Muscle-Based Active Appearance Model,” IEEE Transactions on Instrumentation and Measurement, 55(1):91-98, 2006.   DOI   ScienceOn
7 R. Hartley, and A. Zisserman. “Multiple View Geometry in Computer Vision,” Cambridge University Press, ISBN:0521540518, second edition, 2004.
8 N. Faggian, A. P. Paplinski, and J. Sherrah. "Active Appearance Models for Automatic Fitting of 3D Morphable Models". IEEE International Conference on Video and Signal Based Surveillance, 90, 2006.
9 Skoglund. “Three-dimensional face modeling and analysis”, M.S. thesis, Informatics and Mathematical Modelling, Tech. Univ. Denmark, Lyngby, Denmark, 2003.
10 K.-J. Yoon, and I. S. Kweon. “Adaptive Support-Weight Approach for Correspondence Search”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(4):650-656, 2006.   DOI   ScienceOn
11 J. Sung, and D. Kim. “Pose-Robust Facial Expression Recognition Using View-Based 2D+3D AAM”, IEEE Transactions On Systems, Man and Cybernetics, Part A: SYSTEMS AND HUMANS, 38(4):852-866, 2008.   DOI   ScienceOn