Browse > Article

Gaze Detection System by Wide and Narrow View Camera  

박강령 (상명대학교 미디어학부)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.28, no.12C, 2003 , pp. 1239-1249 More about this Journal
Abstract
Gaze detection is to locate the position on a monitor screen where a user is looking by computer vision. Previous gaze detection system uses a wide view camera, which can capture the whole face of user. However, the image resolution is too low with such a camera and the fine movements of user's eye cannot be exactly detected. So, we implement the gaze detection system with a wide view camera and a narrow view camera. In order to detect the position of user's eye changed by facial movements, the narrow view camera has the functionalities of auto focusing and auto pan/tilt based on the detected 3D facial feature positions. As experimental results, we can obtain the facial and eye gaze position on a monitor and the gaze position accuracy between the computed positions and the real ones is about 3.1 cm of RMS error in case of Permitting facial movements and 3.57 cm in case of permitting facial and eye movement. The processing time is so short as to be implemented in real-time system(below 30 msec in Pentium -IV 1.8 GHz)
Keywords
facial and Eye Gaze detection; auto focusing and auto pan/tilt;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Ballard et al., 'Controlling a Computer via Facial Aspect'. IEEE Trans. on SMC, Vol. 25, No. 4, pp. 669-677, 1995
2 A. Gee et al., 'Fast visual tracking by temporal consensus', Image and Vision Computing. Vol. 14, pp. 105-114, 1996   DOI   ScienceOn
3 J. IIeinzmann et al., '3D Facial Pose and Gaze Point Estimation using a Robust Real-Time Tracking Paradigm' .Proceedings of ICAFGR, pp. 142-147, 1998
4 T. Rikert et al., 'Gaze Estimation using Morphable Models'. Proc. of ICAFGR, pp. 436-441, 1998
5 A.Ali-A-L et al., 'Man-machine interface through eyeball direction of gaze'. Proc. of the Southeastern Symposium on System Theory, pp. 478-82, 1997
6 A. TOMONO et al., 'Eye Tracking Method Using an Image Pickup Apparalus'. European Patent Specification-94101635, 1994
7 Varchmin-AC et al., 'Image based recognition of gaze direction using adaptive methods. Gesture and Sign Languase in Human-Computer Interaction', Int. Gesture Workshop Proc. Berlin, Germany, pp. 245-57, 1998
8 Betke-M et al., Gaze detection via self-organizing gray-scale units. Proc. Int. Workshop on Recog., Analy., and Tracking of Faces and Gestures in Real-Time System. pp. 70-6, 1999
9 T. BROIDA et al., 'Recursive 3-D Motion Estimation from a Monocular Image Sequence'. IEEE Trans. Aerospace and Electronic Systems, Vol. 26, No. 4, pp. 639-656, 1990   DOI   ScienceOn
10 K. R. Park et al., 'Gaze Point Detection by Computing the 3D Poskions and 3DMotions of Face', IEICE Trans. Inf. and Syst., Vol. E.83-D, No.4, pp.884-894, Apr 2000
11 K. R. Park et al., 'Intelligent Process Control via Gaze Detection Technology'. EAAI, Vol. 13, No. 5, pp. 577-587, 2000
12 A. Azarbayejani. 'Visually Controlled Graphics'. IEEE Trans. PAMI, Vol. 15, No. 6, pp. 602-605, 1993   DOI   ScienceOn
13 Eyemark Recorder Model EMR-NC, NAC Image Technology Cooperation
14 K. OHMURA et al., 'Pointing Operation Using Detection of Face Direction from a Single View'. IEICE Trans. Inf./&Syst., Vol. J72-D-II, No.9, pp. 1441-1447, 1989
15 Porrill-J et al., 'Robust and optimal use of information in stereo vision'. Nature. vol. 397, no. 6714, pp. 63-6, Jan 1999   DOI   ScienceOn
16 http://www.polhemus.com
17 J. Heinzmann et al., 'Robust real-time face tracking and gesture recognition' .Proc. of the IJCAI, Vol. 2, pp. 1525-15 30,1997
18 Matsumoto-Y, et al., 'An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement'. Proc. the ICAFGR. pp. 499-504, 2000
19 T. Fukuhara et al., '3D-motion estimation of human head for model-based image coding'. IEE Proc., Vol. 140, No. 1, pp. 26-35, 1993
20 Newman-R et al., 'Real-time stereo tracking for head pose and gazeestimaton'. Proceedings the 4th ICAFGR. pp. 122-8, 2000
21 K. R. Park et aL 'Gaze Detection by Estimating the Depth and 3D Motions of Facial Features in Monocular Images', IEICE Trans. Fundamentals, Vol. E.82-A No. 10, PP. 2274-2284, Oct 1999
22 K. R. Park et al., 'Facial and Eye Gaze detection'. LNCS, Vo1.2525, pp. 368-376, 2002
23 Seika-Tenkai-Tokushuu-Go, ATR Joumal, 1996