[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.6109/jicce.2010.8.5.575

Webcam-Based 2D Eye Gaze Estimation System By Means of Binary Deformable Eyeball Templates

Kim, Jin-Woo (Department of Information & Communication, Kyungsung University)

Publication Information

Journal of information and communication convergence engineering / v.8, no.5, 2010 , pp. 575-580 More about this Journal

Abstract

Eye gaze as a form of input was primarily developed for users who are unable to use usual interaction devices such as keyboard and the mouse; however, with the increasing accuracy in eye gaze detection with decreasing cost of development, it tends to be a practical interaction method for able-bodied users in soon future as well. This paper explores a low-cost, robust, rotation and illumination independent eye gaze system for gaze enhanced user interfaces. We introduce two brand-new algorithms for fast and sub-pixel precise pupil center detection and 2D Eye Gaze estimation by means of deformable template matching methodology. In this paper, we propose a new algorithm based on the deformable angular integral search algorithm based on minimum intensity value to localize eyeball (iris outer boundary) in gray scale eye region images. Basically, it finds the center of the pupil in order to use it in our second proposed algorithm which is about 2D eye gaze tracking. First, we detect the eye regions by means of Intel OpenCV AdaBoost Haar cascade classifiers and assign the approximate size of eyeball depending on the eye region size. Secondly, using DAISMI (Deformable Angular Integral Search by Minimum Intensity) algorithm, pupil center is detected. Then, by using the percentage of black pixels over eyeball circle area, we convert the image into binary (Black and white color) for being used in the next part: DTBGE (Deformable Template based 2D Gaze Estimation) algorithm. Finally, using DTBGE algorithm, initial pupil center coordinates are assigned and DTBGE creates new pupil center coordinates and estimates the final gaze directions and eyeball size. We have performed extensive experiments and achieved very encouraging results. Finally, we discuss the effectiveness of the proposed method through several experimental results.

Keywords

Eye Tracking; Pupil Center Detection; 2D Gaze Estimation; Deformable Template Matching;

Citations & Related Records

Reference

1	T. Morris, F. Zaidi, and P. Blenkhorn, "Blink detection for real-time eye tracking," J.Networking and Computer Applications, vol. 25, no. 2, pp. 129-143, 2002. DOI
2	F. De la Torre, C. Garcia Rubio, and E. Martinez, "Subspace eyetracking for driving warning," Proc. Of ICIP, vol. 3, pp. 329-332, 2003.
3	P. Smith, M. Shah, and N. Da Vitoria Lobo, "Determining driver visual attention with one camera," Trans. on Intelligent Transportation Systems, vol. 4, no. 4, pp. 205-218, 2003. DOI ScienceOn
4	B. Noureddin, P.D. Lawrence, and C.F. Man, "A non-contact device for tracking gaze in a human computer interface," Computer Vision and Image Understanding, vol. 98, no. 1, pp. 52-82, 2005. DOI ScienceOn
5	Shumeet Baluja and Dean Pomerleau, "Non-intrusive gaze tracking using artificial neural networks," Advances in Neural Information Processing Systems, vol. 6, pp. 753-760, 1994.
6	OpenCV Library Home Page [Online]. Available: http://sourceforge.net/projects/opencvlibrary/
7	G. T. Buswell, "How People Look at Pictures: A Study of The Psychology of Perception in Art," The University of Chicago Press, 1935.
8	A. L. Yarbus, "Eye Movements and Vision," Plenum Press, 1967.
9	Tobii Eye-tracker, Tobii Technology Japan, Ltd 3-4-13, Takanawa, Minato-ku, Tokyo, 108-0074, Japan. Home Page [Online]. Available: http://www.tobii.com.
10	J. Deng, and F. Lai, "Region based template deformation and masking for eye-feature extraction and description," Pattern Recognition, vol. 30, no. 3, pp. 403-419, 1997 DOI ScienceOn
11	Y. Tian, T. Kanade, and J. Cohn, "Dual-state parametric eye tracking," Proc. of Conf. On Automatic Face and Gesture Recognition, pp. 110-115, 2000.
12	M. Betke, W. Mullally, and J. Magee, "Active detection of eye scleras in real time," Proceedings of the IEEE CVPR Workshop on Human Modeling, Analysis and Synthesis (HMAS 2000), Jun. 2000.
13	D. Witzner Hansen and A. E. C. Pece, "Eye tracking in the wild," Computer Vision and Image Understanding, vol. 98, no. 1, pp. 182-210, Apr. 2005. DOI ScienceOn
14	S. Crampton, and M. Betke, "Cunting figers in real time: A webcam based human-computer interface with game applications," Proceedings of the Cnference on Universal Access in Human-Computer Interaction (affiliated whith HCI International 2003), pp. 1357-1361, Jun. 2003.
15	C. Fagiani, M. Betke, and J. Gips, "Evaluation of tracking methods for human-computer interaction," Proceedings of the IEEE Workshop on Applications in Computer Vision (WACV 2002), pp. 121-126,Dec. 2002.
16	J. Lombardi, and M. Betke, "A camera based eyebrow tracker for hands-free computer control via a binary switch," Proceedings of the 7th ERCIM Workshop, User Interfaces For All (UI4ALL 2002), pp. 199-200, Oct. 2002.
17	J. J. Magee, M. R. Scott, B. N. Waber, and M. Betke, "Eyekeys: A real-time vision interface based on gaze detection from a low-grade video camera," Proceedings of the IEEE Workshop on Real-Time Vision for Human-Computer Interaction (RTV4HCI), Jul. 2004.
18	R. L. Cloud, M. Betke, and J. Gips, "Experiments with a camerabased human-computer interface system," Proceedings of the 7th ERCIM Workshop, User Interfaces For All (UI4ALL 2002), pp. 103-110, Oct. 2002.
19	M. Betke, J. Gips, and P. Fleming, "The camera Mouse: Visual tracking of body features to provide computer Access for people with severe disabilities," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 10, no. 1, pp. 1-10, Mar. 2002. DOI ScienceOn