Browse > Article

Gaze Detection by Computing Facial and Eye Movement  

박강령 (상명대학교 소프트웨어대학 미디어학부)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.41, no.2, 2004 , pp. 79-88 More about this Journal
Abstract
Gaze detection is to locate the position on a monitor screen where a user is looking by computer vision. Gaze detection systems have numerous fields of application. They are applicable to the man-machine interface for helping the handicapped to use computers and the view control in three dimensional simulation programs. In our work, we implement it with a computer vision system setting a IR-LED based single camera. To detect the gaze position, we locate facial features, which is effectively performed with IR-LED based camera and SVM(Support Vector Machine). When a user gazes at a position of monitor, we can compute the 3D positions of those features based on 3D rotation and translation estimation and affine transform. Finally, the gaze position by the facial movements is computed from the normal vector of the plane determined by those computed 3D positions of features. In addition, we use a trained neural network to detect the gaze position by eye's movement. As experimental results, we can obtain the facial and eye gaze position on a monitor and the gaze position accuracy between the computed positions and the real ones is about 4.8 cm of RMS error.
Keywords
Facial and Eye Gaze detection; IR-LED based camera;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Seika-Tenkai-Tokushuu-Go, ATR Journal, 1996
2 Eyemark Recorder Model EMR-NC, NAC Image Technology Cooperation
3 Varchmin-AC. et al., 'Image Based Recognition of Gaze Direction Using Adaptive Methods. Gesture and Sign Language in Human-Computer Interaction'. in Proc. of Int. Gesture Workshop. pp. 245-57. Berlin, Germany, 1998
4 J. Heinzmann et al., 'Robust Real-Time Face Tracking and Gesture Recognition'. in Proc. of the IJCAI, vol. 2, pp. 1525-1530, 1997
5 Newman-R. et al., Real-Time Stereo Tracking for Head Pose and Gaze Estimation. in Proceedings of the 4th ICAFGR, pp. 122-8, 2000   DOI
6 T. Fukuhara et al., '3D-Motion Estimation of Human Head for Model-Based Image Coding'. IEE Proc., vol. 140, no. 1, pp. 26-35, 1993
7 Matsumoto-Y. et al., 'An Algorithm for Real-Time Stereo Vision Implementation of Head Pose and Gaze Direction measurement'. in Proc. the ICAFGR, pp. 499-504, 2000   DOI
8 Jaihie Kim et al., 'Intelligent Process Control via Gaze Detection Technology'. The journal of Engineering Applications of Artificial Intelligence, vol. 13, no. 5, pp. 577-587, 2000   DOI   ScienceOn
9 Betke-M et al., 'Gaze Detection via Self-Organizing Gray-Scale Units'. in Proc. of Int. Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time System, pp. 70-6, 1999   DOI
10 T. BROIDA et al., 'Recursive 3-D Motion Estimation from a Monocular Image Sequence'. IEEE Trans. Aerospace and Electronic Systems, vol. 26, no. 4, pp. 639-656, 1990   DOI   ScienceOn
11 www.polhemus.com
12 A. Ali-A-L et al., 'Man-Machine Interface through Eyeball Direction of Gaze'. in Proc. of the Southeastern Symposium on System Theory, pp. 478-82, 1997   DOI
13 John G. Daugman, 'High Confidence Visual Recognition of Personals by a Test of Statistical Independence'. IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1148-1160, 1993   DOI   ScienceOn
14 A. Azarbayejani., 'Visually Controlled Graphics'. IEEE Trans. PAMI, vol. 15, no. 6, pp. 602-605, 1993   DOI   ScienceOn
15 K. OHMURA et al., 'Pointing Operation Using Detection of Face Direction from a Single View'. IEICE Trans. on Information and Systems, D-Ⅱ, vol. J72-D-II, no.9, pp. 1441-1447, 1989
16 K. R. Park et al., 'Gaze Point Detection by Computing the 3D Positions and 3D Motions of Face', IEICE Trans. Information and Systems. vol. E83-D, no. 4, pp.884-894, Apr 2000
17 A. Gee et al., 'Fast Visual Tracking by Temporal Consensus', Image and Vision Computing, vol. 14, pp. 105-114, 1996   DOI   ScienceOn
18 K. R. Park et al., 'Gaze Detection by Estimating the Depth and 3D Motions of Facial Features in Monocular Images', IEICE Trans. Fundamentals, vol. E.82-A, no. 10, pp. 2274-2284, Oct. 1999
19 T. Rikert et al., 'Gaze Estimation using Morphable Models'. in Proc. of ICAFGR, pp. 436-441, 1998   DOI
20 P. Ballard et al., 'Controlling a Computer via Facial Aspect'. IEEE Trans. on SMC, vol. 25, no. 4, pp. 669-677, 1995   DOI   ScienceOn
21 A. TOMONO et al., 'Eye Tracking Method Using an Image Pickup Apparatus,' European Patent Specification-94101635, 1994
22 J. Heinzmann et al., '3D Facial Pose and Gaze Point Estimation using a Robust Real-Time Tracking Paradigm', in Proceedings of ICAFGR, pp. 142-147, 1998   DOI
23 Porrill-J et al., 'Robust and Optimal Use of Information in Stereo Vision'. Nature. vol. 397, no. 6714, pp. 63-6, Jan. 1999   DOI   ScienceOn