Browse > Article

Mutual Gaze Correction for Videoconferencing using View Morphing  

Baek, Eu-Tteum (광주과학기술원 정보통신공학부)
Ho, Yo-Sung (광주과학기술원 정보통신공학부)
Publication Information
Smart Media Journal / v.4, no.1, 2015 , pp. 9-15 More about this Journal
Abstract
Nonverbal communications such as eye gazing, posture, and gestures send forceful messages. In regard to nonverbal communication, eye gazing is one of the most strong forms that an individual can use. However, lack of mutual gazing occurs when we use video conferencing system. The displacement between locations of the eyes and a camera gets in the way of eye contact. The lack of eye gazing can give unapproachable and unpleasant feeling. In this paper, we propose an eye gazing correction for video conferencing. We use two cameras installed at the top and the bottom of the television. The captured two images are rendered with 2D warping at virtual position. We implement view morphing to the detected face, and synthesize the face and the warped image. The result shows that eye gazing is corrected and correctly preserved and the image was synthesized seamlessly.
Keywords
Eye contact; Warping; Face morphing; Object extraction; Image synthesis;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Cemmell, C.L. Zitnick, T. Kang, K. Toyama, and S. Seitz, "Gaze-awareness for Videoconferencing: A Software Approach," IEEE Multimedia, pp. 26-35, Oct. 2000.
2 M. Ott, J. Lewis, and I. Cox, "Teleconferencing Eye Contact Using a Virtual Camera," In INTERCHI'93, pp. 119-110, 1993.
3 R. Yang and Z. Zhang, "Eye gaze correction with stereovision for video tele-conferencing," In Proc. Europ. Conf. Computer Vision, volume 2, pp. 479-494, Copenhagen, Denmark, May 2002.
4 X. Ma and Z. Deng. "Natural eye motion synthesis by modeling gaze-head coupling," In IEEE VR 2009, pp. 143-150, 2009.
5 C. Kuster, T. Popa, J.-C. Bazin, C. Gotsman, and M. Gross, "Gaze correction for home video conferencing," ACM TOG (SIGGRAPH Asia), 2012.
6 J. Zhu, R. Yang, and X. Xiang, "Eye contact in video conference via fusion of time-of-flight depth sensor and stereo," 3D Research, vol. 2, no. 3, pp. 1-10, 2011.
7 R. Stokes. "Human Factors and Appearance Design Considerations of the Mod II PicturePhone Station Set," IEEE Transactions on Communication Technology, pages 319-323, 1969.
8 Z. Zhang, "A flexible new technoque for camera calibration.," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, pp. 1330-1334, 2000.   DOI
9 R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision," Cambridge University Press, 2003.
10 I. W. Phillip and F. John, "Facial Feature Detection Using Haar Classifiers," Journal of Computing Sciences in Colleges, vol. 21, pp. 127-133, 2006.
11 S. M. Seitz and C. R. Dyer, "View morphing," In Proc. SIGGRAPH 96. 1996.
12 J. Canny, "A Computatiional Approach to Edge Detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-8, Issue 6, pp. 679-698, Nov. 1986.   DOI