Browse > Article

Gaze Detection by Computing Facial Rotation and Translation  

Lee, Jeong-Jun (Dept. of Electrical & electronic Engineering, Yonsei Univ.)
Park, Kang-Ryoung (LG Electronics Institute of Technology)
Kim, Jai-Hie (Dept. of Electrical & electronic Engineering, Yonsei Univ.)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.39, no.5, 2002 , pp. 535-543 More about this Journal
Abstract
In this paper, we propose a new gaze detection method using 2-D facial images captured by a camera on top of the monitor. We consider only the facial rotation and translation and not the eyes' movements. The proposed method computes the gaze point caused by the facial rotation and the amount of the facial translation respectively, and by combining these two the final gaze point on a monitor screen can be obtained. We detected the gaze point caused by the facial rotation by using a neural network(a multi-layered perceptron) whose inputs are the 2-D geometric changes of the facial features' points and estimated the amount of the facial translation by image processing algorithms in real time. Experimental results show that the gaze point detection accuracy between the computed positions and the real ones is about 2.11 inches in RMS error when the distance between the user and a 19-inch monitor is about 50~70cm. The processing time is about 0.7 second with a Pentium PC(233MHz) and 320${\times}$240 pixel-size images.
Keywords
Gaze Detection; Facial Rotation and Translation; Multi-Layered Perceptron;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Ballard and G. C. Stockman, 'Controlling a Computer via Facial Aspect', IEEE Transactions on Systems, Man, and Cybernetics, Vol. 25. pp. 669-677. April 1995   DOI   ScienceOn
2 T. Horprasert, Y. Yacoob and L. S. Davis, 'Computing 3-D Head Orientation from a Monocular Image Sequence', In Proc. of International Conf. on Automatic Face and Gesture Recognition, pp. 242-247, Killington, Vermont, USA, Oct. 1996   DOI
3 T. D. Rikert and M. J. Jones, 'Gaze Estimation using Morphable Models,' In Proc. of International Conf. on Automatic Face and Gesture Recognition, pp. 436-441, Nara, Japan, April 1998   DOI
4 R. Brunelli and T. Poggio, 'Face Recognition: Features versus Templates,' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 10, pp. 1042-1052, October, 1993   DOI   ScienceOn
5 R. Jain, R. Kasturi and B. G. Schunck. MACHINE VISION, McGraw-Hill, pp. 7-9, 1995
6 박강령, '얼굴의 2차원 및 3차원 움직임을 이용한 시선 위치 추적에 관한 연구', 연세대학교 전기${\cdot}$컴퓨터 공학과 대학원 박사 졸업 논문, 2000, 2
7 A. Gee and R. Cipolla, 'Fast visual tracking by temporal consensus', Image and Vision Computing, Vol. 14, pp.105-114, 1996   DOI   ScienceOn
8 S. Baluja and D. Pornerleau, 'Non-Intrusive Gaze Tracking Using Artificial Neural networks', Technical report (CMU-CS-94-102) of School of Computer Science, Camegie Mellon University, USA, January 1994
9 K. N. Kim and R. S. Ramakrishna 'Vision-Based Eye-Gaze Tracking for Hunam Computer Interface', In Proc. of Internationl Conf. on System, Man and Cybernetics, Vol 2, pp. 324-329, Tokyo, Japan, October 1999   DOI