Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2002.9B.5.563

Facial Features and Motion Recovery using multi-modal information and Paraperspective Camera Model  

Kim, Sang-Hoon (국립한경대학교 제어계측공학과)
Publication Information
The KIPS Transactions:PartB / v.9B, no.5, 2002 , pp. 563-570 More about this Journal
Abstract
Robust extraction of 3D facial features and global motion information from 2D image sequence for the MPEG-4 SNHC face model encoding is described. The facial regions are detected from image sequence using multi-modal fusion technique that combines range, color and motion information. 23 facial features among the MPEG-4 FDP (Face Definition Parameters) are extracted automatically inside the facial region using color transform (GSCD, BWCD) and morphological processing. The extracted facial features are used to recover the 3D shape and global motion of the object using paraperspective camera model and SVD (Singular Value Decomposition) factorization method. A 3D synthetic object is designed and tested to show the performance of proposed algorithm. The recovered 3D motion information is transformed into global motion parameters of FAP (Face Animation Parameters) of the MPEG-4 to synchronize a generic face model with a real face.
Keywords
face detection; skin-color transform; range segmentation; FAP; perspective camera model;
Citations & Related Records
연도 인용수 순위
  • Reference
1 MPEG-4 System Sub-group, 'MPEG-4 System Methodology and Work Plan for Scene Description,' ISO/IEC/JTC1/ SC29/WG11/N1786, Jul, 1997
2 A. Pentland and B. Horowitz. 'Recovery of Non-rigid Motion and Structure,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.13, No.7, pp.730-742, 1991   DOI   ScienceOn
3 M. J. Black and Y. Yaccob, 'Tracking and Recognizing Rigid and Non-rigid Facial Motion using Local Parametric Model of Image Motion,' Proc. Intl Conf. Computer Vision, pp.374-381, 1995   DOI
4 A. Azarbayejani and A. Pentland, 'Recursive Estimation of Motion, Structure and Focal Length,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.7, No.6, pp.562-575, Jun., 1995   DOI   ScienceOn
5 H. Gharavi and Mike Mills 'Blockmatching Motion Estimation Algorithm-New Results,' IEEE Trans. Circuits and System, No.5, Vol.37, 1990
6 S. H. Kim, H. G. Kim and K. H. Tchah, 'Object-oriented Face Detection using Colour Transformation and Range Segmentation,' IEE Electronics Letters, 14th, Vol.34, No.10, pp.979-980, May, 1998   DOI   ScienceOn
7 D. reisfild, 'Detection and Interest Points using Symmetry,' Proc. Intl Conf. Computer Vision, Vol.E8I-D, pp.62-65, Dec., 1990   DOI
8 MPEG-4 SNHC Group, 'Face and Body Definition and Animation Parameter,' ISO/IEC JTC1/SC29/WG11 N2202, March, 1998
9 R. C. Gonzalez and R. E. Woods, 'Digital Image Processing,' Addison-Wesley, pp.225-238, 1992
10 S. H. Kim and H. G. Kim. 'Face Detection using Multi-Modal Information,' Proc. Intl Conf. Face and Gesture Recognition, France, March, 2000   DOI
11 B. 0. Jung, 'A Sequential Algorithm for 3-D Shape and Motion Recovery from Image Sequences,' Thesis for the degree of master, Korea University, Jun., 1997
12 J. Weng, N. Ahuja and T. S. Huang, 'Optimal Motion and Structure Estimation,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.15, No.9, Sept., 1993   DOI   ScienceOn
13 T. S. Huang and O. D. Faugeras, 'Some Properties of the E-matrix in Two-view Motion Estimation,' IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.11, No.12, pp.1310-1312, Dec., 1989   DOI   ScienceOn
14 C. J. Poelman and T. Kanade, 'A Paraperspective Factorization Method for Shape and Motion Recovery,' Technical Report CMU-CS-93-219, Carnegie Mellon University, 1993
15 Jibe Yang and Alex Waybill, 'Tracking Human Faces in Real Time,' Technical Report CMU-CS-95-210, Carnage Melon University, 1995