Browse > Article

Face Tracking for Multi-view Display System  

Han, Chung-Shin (광운대학교 전자공학과 디지털 미디어 연구실)
Jang, Se-Hoon (광운대학교 전자공학과 디지털 미디어 연구실)
Bae, Jin-Woo (광운대학교 전자공학과 디지털 미디어 연구실)
Yoo, Ji-Sang (광운대학교 전자공학과 디지털 미디어 연구실)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.30, no.2C, 2005 , pp. 16-24 More about this Journal
Abstract
In this paper, we proposed a face tracking algorithm for a viewpoint adaptive multi-view synthesis system. The original scene captured by a depth camera contains a texture image and 8 bit gray-scale depth map. From this original image, multi-view images can be synthesized which correspond to viewer's position by using geometrical transformation such as a rotation and a translation. The proposed face tracking technique gives a motion parallax cue by different viewpoints and view angles. In the proposed algorithm, tracking of viewer's dominant face initially established from camera by using statistical characteristics of face colors and deformable templates is done. As a result, we can provide motion parallax cue by detecting viewer's dominant face area and tracking it even under a heterogeneous background and can successfully display the synthesized sequences.
Keywords
Face Tracking; Multi-view synthesis; statistical characteristics of face colors;
Citations & Related Records
연도 인용수 순위
  • Reference
1 ATTEST, European 1ST Project http://www.iti.gr/db.php/en/projects/ATTEST.html 2002-2004
2 J. R Ohm, K. Grueneberg, E. Hendriks, M. E. Izquierdo, D. Kalivas,M. Karl, D. Papadimatos, and A. Redert, 'A realtime hardware system for stereoscopic video-conferencing with viewpoint adaptation,' Signal Processing: Image Commun., vol. 14, pp. 147-171, 1998   DOI   ScienceOn
3 G. D. Hager and P. N. Belhumeur, 'Realtime tracking of image regions with changes in geometry and illumination,' Proc. Computer Vision and Pattern Recognition, pp.403-410, 1996
4 Jin Woo Bae, Hyok Song and Ji Sang Yoo, 'An object based multi-viewpoint image synthesis using depth camera', ITC-CSCC 2004, Sendai, Japen, July. 5-8, 2004
5 Rao, R.R.; Mersereau, R.M.;' On merging hidden markov models with deformable templates' Image Processing, 1995. Proceedings., International Conference on , Volume: 3 , 23-26 Oct. 1995 Pages:556 - 559 vol.3
6 J. Serra and P. Soille(eds.), Mathematical Morphology Its Applications to Image Processing, pp. 69-76, Kluwer Academic Publishers in the Netherlands, 1994
7 I. Sexton and P. Surman, 'Stereoscopic and autostereoscopic display systems,' IEEE Signal Processing Mag., vol. 16, pp. 85-99, 1999   DOI   ScienceOn
8 C. Wang and M. S. Brandstein 'A Hubrid Real-Time Face Tracking System', Proc. Acoustics, Speech, and Signal Processing Volume 6, 1998
9 S. J. Mckenna and S. Gong, 'Tracking Faces',Proc. Inernational conference on Face and Gesture Recongnition. pp.271-276 1996
10 Heinrich-Hertz-Institut, Human Factors Dept., Berlin, Germany. (1999). 3D-displays. [Online]. Available: http://atwww.hhi.de/3D_displays
11 Jei Yang, Alex Waibel, 'A real-time Face Tracker', Proceeding of WACV, pp142-147, 1996
12 R. J. Qian, M. I. Sezan, K, E. Matthews, 'A robust Real-time Face Tracking Algorithm', Proc International Conference on Image Processing, Vol. 1, page(S):131-135, 1998