Browse > Article

Viewpoint interpolation of face images using an ellipsoid model  

Yoon, Na-Ree (이화여자대학교 정보통신학과 영상처리연구실)
Lee, Byung-Uk (이화여자대학교 정보통신학과)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.32, no.6C, 2007 , pp. 572-578 More about this Journal
Abstract
To establish eye contact in video teleconferencing, it is necessary to synthesize a front view image by viewpoint interpolation. We can find the viewing direction of a user, and interpolate an image seen from that viewpoint, which will result in a face image observed from the front. There are two categories of previous research: image based method and model based method. The former is simple to calculate, however, it shows limited performance for complex objects. And the latter is robust to noise while it is computationally expensive. We propose to approximate face images as ellipses and match them to build an ellipsoid and then synthesize a new image from a given virtual camera position. We show that it is simple and robust from various experiments.
Keywords
Viewpoint interpolation; Eye contact; Ellipsoid head model;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 D. W. Hanson, 'Eye typing off the shelf,' IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 159- 164, Washington D.C., U.S.A., Jul. 2004
2 P. Aschwanden and W. Guggenbuhl, 'Experimental Results from a comparative study on correlation-type registration algorithm,' Robust Computer Vision, Forstner and Ruwiedel, Eds., pp. 268-289, Wickmann, 1993
3 V. Venkateswar and R. Chellappa, 'Hierarchical Stereo and Motion Correspondence Using Feature Groupings,' Int'l J. Computer Vision, Vol. 15, pp. 245-269, 1995   DOI
4 C. Tomasi and R. Manduchi, 'Stereo without Search,' Technical Report STAN-CSTR-95-1543, Stanford Univ., 1995
5 T. H. Cormen, C. E. Leiserson, and R. L. Rivest, Introduction to Algorithms. New York, McGraw-Hill, 1990
6 R. Yang, Z. Zhang, 'Eye gaze correction with stereovision for video-teleconferencing,' IEEE transaction on Pattern Analysis and Machine Intelligence, Vol. 26, No. 7, pp. 956-960, Jul. 2004   DOI   ScienceOn
7 J. Yin, and J. R. Cooperstock, 'Improving depth maps by nonlinear diffusion,' 12th International Conference on Computer Graphics, Visualization and Computer Vision, Feb. 2004
8 R. Tsai, 'A versatile Camera Calibration Technique for high accuracy 3D machine vision metrology using off the shelf TV cameras and lenses,' IEEE Journal of Robotics and Automation, Vol. 3, No. 4, pp. 323-344, 1987   DOI   ScienceOn
9 S. A. MacKay, M. J. Potel, and J. M. Rubin, 'Graphics Methods for Tracking Three-Dimensional Heart Wall Motion,' Computers and Biomedical Research, Vol. 15, pp. 455-473, 1982   DOI   ScienceOn
10 R. Jain, R. Kasturi, B. G. Schunck, 'Machine Vision,' McGraw-Hill, 1995
11 A. M. K. Siu and R. W. H. Lau, 'Image Registration for Image-Based Rendering,' IEEE Trans. on Image Processing, Vol. 14, No. 2, pp. 241-252, Feb. 2005   DOI   ScienceOn
12 Z. Liu, Z. Zhang, C. Jacobs, and M. Cohen, 'Rapid modeling of animated faces from video,' Journal of Visualization and Computer Animation, Vol. 12, No. 4, pp. 227-240, 2001   DOI   ScienceOn
13 M. H. Yang, D. Kriegman, N. Ahuja, 'Detecting Faces in Images: A Survey,' IEEE Trans. on Pattern Analysis and Machine Vision, Vol. 24, No. 1, pp. 34-58, Jan. 2004
14 장세훈, 한충신, 배진우, 유지상, '깊이 정보를 이용한 실시간 다시점 스테레오 영상 합성,' 한국통신학회논문지, Vol. 30, No. 4C, pp. 239-246, Apr. 2005   과학기술학회마을
15 S. Birchfield and C. Tomasi, 'Depth discontinuities by Pixel-to-Pixel Stereo,' Proceedings of the Sixth IEEE international Conference on Computer Vision, Mumbai, India, pp. 1073-1080, Jan. 1998
16 S. Birchfield and C. Tomasi, ' Multiway cut for stereo and motion with slanted surfaces,' Proc. Int'l Conf. Computer Vision, Vol. 1, pp. 489-495, 1999
17 박창주, 고정환, 김은수, '스테레오 영상 보정 알고리즘에 기반한 새로운 중간시점 영상합성 기법,' 한국통신학회논문지, Vol. 29, No.. 5C, pp. 632-641, May. 2004
18 H. Saito, M. Kimura, S. Yaguchi, N. Inamoto, 'View interpolation of multiple cameras based on projective geometry,' IPSJ Transactions on Computer Vision and Image Media, Vol.43, No. SIG 11, 2002
19 M. Kass, A. Witkin, and D. Terzopoulos, 'Snake : Active Countour models,' Int'l J. Computer Vision, Vol. 1, No. 4, pp. 321-331, 1987
20 조상규, 황치규, 황재정, 'PC 카메라를 이용한 실시간 동공 검출,' 한국통신학회논문지, Vol. 29, No.. 8C, pp. 1184-1192, Aug. 2004
21 박호식, 배철수, '휴먼 컴퓨터 인터페이스를 위한 실시간 시선 식별,' 한국통신학회논문지, Vol. 30, No. 3C, pp. 125-132, Mar. 2005   과학기술학회마을
22 M. Z. Brown, D. Burschka, G. D .Hager, 'Advanced in computational stereo,' IEEE transaction on pattern analysis and machine intelligence, Vol. 25, No. 8, pp. 993-1008, Aug. 2003   DOI   ScienceOn
23 R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision, Cambridge University Press, 2000