Browse > Article

Region-Based Reconstruction Method for Resolution Enhancement of Low-Resolution Facial Image  

Park, Jeong-Seon (전남대학교 멀티미디어)
Publication Information
Journal of KIISE:Software and Applications / v.34, no.5, 2007 , pp. 476-486 More about this Journal
Abstract
This paper proposes a resolution enhancement method which can reconstruct high-resolution facial images from single-frame, low-resolution facial images. The proposed method is derived from example-based reconstruction methods and the morphable face model. In order to improve the performance of the example-based reconstruction, we propose the region-based reconstruction method which can maintain the characteristics of local facial regions. Also, in order to use the capability of the morphable face model to face resolution enhancement problems, we define the extended morphable face model in which an extended face is composed of a low-resolution face, its interpolated high-resolution face, and the high-resolution equivalent, and then an extended face is separated by an extended shape vector and an extended texture vector. The encouraging results show that the proposed methods can be used to improve the performance of face recognition systems, particularly to enhance the resolution of facial images captured from visual surveillance systems.
Keywords
Face recognition; Extended morphable face model; Region-based reconstruction; Face resolution enhancement;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Vetter and N. E. Troje, 'Separation of Texture and Shape in Images of Faces for Image Coding and Synthesis,' Journal of the Optical Society of America A, Vol. 14, No. 9, pp. 2152-2161, 1997   DOI   ScienceOn
2 H. Sato, W. Freeman and A. Onozawa, 'Quality Improvement for Intermediate Views Using Example-Based Super-Resolution,' NTT Technical Review, Vol. 1, No. 6, pp. 44-47, September 2003
3 C. Liu, H.-Y. Shum and C.-S. Zhang, 'A Two-Step Approach to Hallucinating Faces: Global Parametric Model and Local Nonparametric Model,' IEEE Conf. on Computer Vision and Pattern Recognition, Vol. 1, pp. 192-198, December 2001   DOI
4 Y. Li and X. Lin, 'An Improved Two-Step Approach to Hallucinating Faces,' IEEE Conf. on Image and Graphics, pp. 298-301, December 2004   DOI
5 R. C. Hardie, K. J. Barnar, and E. E. Armstrong, 'Joint Map Registration and High-Resolution Image Estimation Using a Sequence of Under-sampled Images,' IEEE Trans. on Image Processing, Vol. 6, No. 12, pp. 1621-1633, 1997   DOI   ScienceOn
6 W. T. Freeman, T. R. Jones, and E. C. Pasztor, 'Example-based Super-Resolution,' Technical Report 2001-30, MERL - A Mitsubishi Electric Research Laboratory, August 2001
7 S.C. Park, M.K. Park, and M.G. Kang, 'Super-Resolution Image Reconstruction: A Technical Overview,' IEEE Signal Processing Magazine, Vol. 20, No. 3, pp. 21-36, 2003   DOI   ScienceOn
8 B. K. Gunturk, A. U. Batur, Y. Altunbasak, M. H. Hayes, and R. M. Mersereau, 'Eigenface-Domain Super-Resolution for Face Recognition,' IEEE Trans. on Image Processing, Vol. 12, No. 5, pp. 597 -606, 2003   DOI   ScienceOn
9 F. Dekeyser, P. Perez, and P. Bouthemy, 'Restoration of Noisy, Blurred, Undersampled Image Sequences Using Parametric Motion Model,' Int. Symposium on Image/Video Communications over Fixed and Mobile Networks, ISIVC 2000, Rabat, Morocco, pp. 1071-1073, April 2000
10 G. Dedeoglu, T. Kanade, and J. August, 'High-Zoom Video Hallucination by Exploiting SpatioTemporal Regularities,' IEEE Conf. on Computer Vision and Pattern Recognition, Vol. 2, pp. 151-158, 2004   DOI
11 X. Wang and X. Tang, 'Hallucinating Face by Eigentransform,' IEEE Trans. on Systems, Man and Cybernetics-Part C: Applications and Reviews, Vol. 35, No. 3, pp. 425-434, 2005   DOI   ScienceOn
12 T. A. Stephenson and T. Chen, 'Adaptive Markov Random Fields for Example-based Super-Resolution of Faces,' EURASIP Journal on Applied Signal Processing. Vol. 2006, Article ID 31062, pp. 1-11, 2006   DOI
13 S. Baker and T. Kanade, 'Limits on Super-Resolution and How to Break Them,' IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 24, No. 9, pp. 1167-1183, 2002   DOI   ScienceOn
14 http://www.ee.surrey.ac.uk/CVSSP/xrn2vtsdb/
15 W. Liu, D. Lin, and X. Tang, 'Neighbor Combination and Transformation for Hallucinating Faces,' IEEE Conf. on Multimedia and Expo, pp. 145-148, July 2005   DOI
16 B.-W. Hwang, M.-C. Roh, and S.-W. Lee, 'Performance Evaluation of Face Recognition Algorithms on Asian Face Recognition,' IEEE Int. Conf. on Automatic Face and Gesture Recognition, Seoul, Korea, pp. 278-283, May 2004   DOI
17 B. Tom and A. Katsaggelos, 'Resolution Enhancement of Monochrome and Color Video Using Motion Compensation,' IEEE Trans. on Image Processing, Vol. 10, No. 2, pp. 278-287,2001   DOI   ScienceOn
18 B.-W. Hwang and S.-W. Lee, 'Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model,' IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 25, No. 3, pp. 365-372, 2003   DOI   ScienceOn
19 V. Blanz and T. Vetter, 'Face Recognition Based on Fitting a 3D Morphable Model,' IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 25, No. 9, pp. 1063-1074, 2003   DOI   ScienceOn