Browse > Article

Eye Tracking Using Neural Network and Mean-shift  

Kang, Sin-Kuk (School of Computer Science & Engineering, Seoul National University)
Kim, Kyung-Tai (Dept, of Computer Eng. Konkuk University)
Shin, Yun-Hee (Dept, of Computer Eng. Konkuk University)
Kim, Na-Yeon (Dept, of Computer Eng. Konkuk University)
Kim, Eun-Yi (Dept. of Internet and Multimedia Engineering, NITRI, Konkuk University)
Publication Information
Journal of the Institute of Electronics Engineers of Korea CI / v.44, no.1, 2007 , pp. 56-63 More about this Journal
Abstract
In this paper, an eye tracking method is presented using a neural network (NN) and mean-shift algorithm that can accurately detect and track user's eyes under the cluttered background. In the proposed method, to deal with the rigid head motion, the facial region is first obtained using skin-color model and con-nected-component analysis. Thereafter the eye regions are localized using neural network (NN)-based tex-ture classifier that discriminates the facial region into eye class and non-eye class, which enables our method to accurately detect users' eyes even if they put on glasses. Once the eye region is localized, they are continuously and correctly tracking by mean-shift algorithm. To assess the validity of the proposed method, it is applied to the interface system using eye movement and is tested with a group of 25 users through playing a 'aligns games.' The results show that the system process more than 30 frames/sec on PC for the $320{\times}240$ size input image and supply a user-friendly and convenient access to a computer in real-time operation.
Keywords
Eye Tracking system; neural network; mean-shift algorithm; human-computer interaction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Yang, Jie., A., Waibel.: A real-time face tracker.Applications of Computer Vision, 1996. WACV '96., Proceedings 3rd IEEE Workshop on , 2-4 (1996) 142-147   DOI
2 Chan A. D. C., Englehart K., Hudgins B., and Lovely D. F. : Hidden markov model classification of myoelectric signals in speech. IEEE Engineering in Medicine and Biology Magazine, vol. 21, no. 4, pp. 143？146, 2002
3 Betke, M., Gips, J., Fleming, P.: The camera mouse: visual tracking of body features to provide computeraccess for people with severe disabilities.Neural Systems and Rehabilitation Engineering, IEEE Transactions on [see also IEEE Trans. on Rehabilitation Engineering], Volume: 10 , Issue: 1. (2002) 1-10   DOI   ScienceOn
4 Takami, N., Irie, Kang C., Ishimatsu, T., Ochiai, T.: Computer interface to use head movement for handicapped people. TENCON '96. Proceedings. 1996 IEEE TENCON. Digital Signal Processing Applications , Volume: 1 , 26-29 Nov. vol. 1 (1996) 468-472   DOI
5 Sako, H., Whitehouse, M., Smith, A., Sutherland, A.,: Real-time facial-feature tracking based on matching techniques and its applications. Pattern Recognition, 1994. Vol. 2-Conference B: Computer Vision & Image Processing., Proceedings of the 12th IAPR International. Conference on , Volume: 2 , 9-13 vol.2 (1994) 320-324   DOI
6 Kim, Sang-Hoon., Kim, Hyoung-Gon., Tchah, Kyun-Hyon.: Object oriented face detection using range and color information. Electronics Letters , Volume: 34 , Issue: 10, 14 (1998) 979-980   DOI
7 Schiele, Bernet., Waibel, Alex.:Gaze Tracking Based on Face-Color. School of Computer Science, Carnegie Mello University (1995)
8 Scassellati, Brian.: Eye finding via face detection for a foveated, active vision system. American Association for Artificial Intelligence. (1998)
9 Kurata, Takeshi., Okuma, Takashi., Kourogi, Masakatsu., Sakaue, Katsuhiko.: The Hand Mouse: GMM Hand-color Classification and Mean Shift Tracking. In Proc. Second International Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems (RATFG-RTS 2001) 119-124   DOI
10 Kaufman, Arie E., Bandopadhay, Amit., Shaviv, Bernard D.: An Eye Tracking Computer User Interface. Virtual Reality, 1993. Proceedings., IEEE 1993 Symposium on Research Frontiers in , 25-26 (1993)   DOI
11 Hyun Kang, Chang Woo Lee and Keechul Jung, : Recognition-based gesture spotting in video games. Pattern Recognition Letters, Volume 25, Issue 15, November 2004, Pages 1701-1714   DOI   ScienceOn
12 Alois Ferscha, Stefan Resmerita, Clemens Holzmann and Martin Reicho, : Orientation sensing for gesture-based interaction with smart artifacts. Computer Communications, Volume 28, Issue 13, 2 August 2005, Pages 1552-1563   DOI   ScienceOn
13 Jacob, Robert J. K.: Human-computer interaction: Input devices. ACM Computing Surveys, Vol. 28, No. 1 (1996)   DOI
14 Sharma, R., Pavlovic, V.I., Huang, T.S.: Toward multimodal human-computer interface. Proceedings of the IEEE , Volume: 86 , Issue: 5 (1998) 853-869   DOI   ScienceOn
15 William T. Freeman and C. D. Weissman. : Television control by hand gestures. IEEE international workshop on automatic face and gesture recognition, 1995