Browse > Article

3D Face Alignment and Normalization Based on Feature Detection Using Active Shape Models : Quantitative Analysis on Aligning Process  

Shin, Dong-Won (금오공과대학교 기계공학부)
Park, Sang-Jun (금오공과대학교 자동차공학과)
Ko, Jae-Pil (금오공과대학교 컴퓨터공학과)
Publication Information
Korean Journal of Computational Design and Engineering / v.13, no.6, 2008 , pp. 403-411 More about this Journal
Abstract
The alignment of facial images is crucial for 2D face recognition. This is the same to facial meshes for 3D face recognition. Most of the 3D face recognition methods refer to 3D alignment but do not describe their approaches in details. In this paper, we focus on describing an automatic 3D alignment in viewpoint of quantitative analysis. This paper presents a framework of 3D face alignment and normalization based on feature points obtained by Active Shape Models (ASMs). The positions of eyes and mouth can give possibility of aligning the 3D face exactly in three-dimension space. The rotational transform on each axis is defined with respect to the reference position. In aligning process, the rotational transform converts an input 3D faces with large pose variations to the reference frontal view. The part of face is flopped from the aligned face using the sphere region centered at the nose tip of 3D face. The cropped face is shifted and brought into the frame with specified size for normalizing. Subsequently, the interpolation is carried to the face for sampling at equal interval and filling holes. The color interpolation is also carried at the same interval. The outputs are normalized 2D and 3D face which can be used for face recognition. Finally, we carry two sets of experiments to measure aligning errors and evaluate the performance of suggested process.
Keywords
3D face; ASMs; Alignment; Pose Variation; Rotational Transform; Normalization; Interpolation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Pentland, B. Moghaddam, T. Starner, O. Oliyide, and M. Turk, "View-Based and Modular Eigenspaces for Face Recognition," Technical Report 245, MIT Media Lab (1993)
2 Hu, Y., Jiang, D., Yan, S., Zhang, L., Zhang, H., Automatic 3D reconstruction for Face Recognition Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, pp.843-850, 2000
3 Morphable Face Model by Using Thin Plate Splines for Face Reconstruction, LNCS 3338, 258-267, 2004
4 X. Lu and A. K. Jain, Multimodal facial feature extraction for automatic 3D face recognition, Technical Report MSU-CSE-05-22, Department of Computer Science, Michigan State University, East Lansing, Michigan, August (2005).
5 송환종, 양욱일, 이용욱, 손광훈, "포즈 변화에 강인한 3차원 얼굴인식," 대한전자공학회 하계종합학술대회, 제26권, 제1호 pp.2000-2003, 2003
6 T. Cootes, D. Cooper, C. Taylor and J. Graham, "Active Shape Models-Their Training and Application," Computer Vision and Image Understanding, Vol. 61, No. 1, pp.38-59, 1995   DOI   ScienceOn
7 C. Kotropoulos and I. Pitas, Rule-Based Face Detection in Frontal Views, IEEE Int'l Conf. on Acoustics, Speech and Signal Processing, pp.2537-2540, 1997
8 S. Romdhani, S. Gong and A. Psarrou, A Multi-View Nonlinear Active Shape Model using Kernel PCA, British Machine Vision Conf., pp.483-492, 1999
9 T. Cootes, K. Walker, and C. Taylor, "View-Based Active Appearance Models," IEEE Int'l Conf. on A FGR, 272-232, 2000
10 M. Kirby and L. Sirovich, "Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces," IEEE Trans. on PAMI, Vol. 12, No. 1, pp.103-108, 1990   DOI   ScienceOn
11 B. Gokberk, A. A. Salah, and L. Akarun, "Rankbased decision fusion for 3D shape-based face recognition," LNCS 3546: International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA2005), pp.1019-1028, July, 2005
12 C. Boehnen and T. Russ, A fast multi-modal approach to facial feature detection, In Proc. 7th IEEE WACV, Breckenridge, CO, Jan. 135-142, 2005
13 손광훈, 산형철, 양욱일, "3차원 얼굴인식 기술 현황 및 전망" 전자공학회지, 제33권, 제1호, pp.46-55, 2006
14 A. Colombo, C. Cusano, R. Schettini, Tri-dimensional face detection and localization Proc. Internet imaging VI, Vol. SPIE 5670 (S. Santini, R. Schettini, T. Gevers eds, 68-75, 2005
15 A. Mian, M. Bennamoun and R. Owens, Automatic 3D Face Detection, Normalization and Recognition, 3DPVT, 2006
16 Bowyer, K.W., Chang, Flynn, P.J., "A survey of 3D and multi-modal 3d+2d face recognition," Proceedings of International Conference Pattern Recognition, pp.358-361 (2004)