Browse > Article
http://dx.doi.org/10.9708/jksci.2016.21.10.011

Robust pupil detection and gaze tracking under occlusion of eyes  

Lee, Gyung-Ju (Dept. of Computer Science and Engineering, Soongsil University)
Kim, Jin-Suh (Dept. of Computer Science and Engineering, Soongsil University)
Kim, Gye-Young (School of Software, Soongsil University)
Publication Information
Journal of the Korea Society of Computer and Information / v.21, no.10, 2016 , pp. 11-19 More about this Journal
Abstract
The size of a display is large, The form becoming various of that do not apply to previous methods of gaze tracking and if setup gaze-track-camera above display, can solve the problem of size or height of display. However, This method can not use of infrared illumination information of reflected cornea using previous methods. In this paper, Robust pupil detecting method for eye's occlusion, corner point of inner eye and center of pupil, and using the face pose information proposes a method for calculating the simply position of the gaze. In the proposed method, capture the frame for gaze tracking that according to position of person transform camera mode of wide or narrow angle. If detect the face exist in field of view(FOV) in wide mode of camera, transform narrow mode of camera calculating position of face. The frame captured in narrow mode of camera include gaze direction information of person in long distance. The method for calculating the gaze direction consist of face pose estimation and gaze direction calculating step. Face pose estimation is estimated by mapping between feature point of detected face and 3D model. To calculate gaze direction the first, perform ellipse detect using splitting from iris edge information of pupil and if occlusion of pupil, estimate position of pupil with deformable template. Then using center of pupil and corner point of inner eye, face pose information calculate gaze position at display. In the experiment, proposed gaze tracking algorithm in this paper solve the constraints that form of a display, to calculate effectively gaze direction of person in the long distance using single camera, demonstrate in experiments by distance.
Keywords
Pupil center detection; Deformable template; Head pose estimation; Gaze tracking; Gaze calibration;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 K. J. Jeong, J. S. Choi and G. J. Jang, "Facial Expression Recognition using Face Alignment and AdaBoost,", Journal of The Institute of Electronics and Information Engineers, Vol. 51, No. 11, Nov, 2014
2 A.W. Fitzgibbon and R.B. Fisher, "A buyers guide to conic fitting," in: Proc. fifth British Machine Vision Conference, pp. 513-522, Feb, 1995.
3 A. Yuille, "Deformable Templates for Face Recognition", J. Cognitive Neuroscience, Vol. 3, No. 1, pp. 59-71, Jan, 1991.   DOI
4 K.N. Kim and R.S. Ramakrishna, "Vision-based eye-gaze tracking for human computer interface", International Conference on Systems Man and Cybernetics, pp. 324-329, Oct, 1999.
5 Y. Matsumoto and A. Zelinsky, "An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement", International Conference on Automatic Face and Gesture Recognition, pp. 499-504, Mar, 2000.
6 J. Zhu and J. Yang, "Subpixel eye gaze tracking," in: Proc. of the 5th IEEE International Conference on Automatic Face and Gesture Recognition, Washington, DC, pp. 131-136, May, 2002.
7 M. Horsley, M. Eliot, B. A. Knight and R. Reilly, "Current Trends in Eye Tracking Research". Springer, Dec, 2013.
8 A. T. Duchowski, "A Breadth-First Survey of Eye-Tracking Applications", Behavior Research Methods Instruments Computers J. Psychonomic Soc. Inc., Vol. 34, pp. 455-470, Aug, 2002.   DOI
9 D. C. Cho and W. Y. Kim, "Long-Range Gaze Tracking System for Large Movements", IEEE Transactions on Biomedical Engineering, Vol. 60, No. 12, Jun, 2013.
10 H. C. Lee, W. O. Lee, C. W. Cho, S. Y. Gwon, K. R. Park, H. K. Lee and J. H. Cha, "Remote Gaze Tracking System on a Large Display", Sensors, Vol. 13, No. 10, pp. 13439-13463, Jul, 2013.   DOI
11 W. O. Lee, Y. G. Kim, K. Y. Shin, D. T. Nguen, K. W. Kim, K. R. Park and C. I. Oh, "New method for face gaze detection in smart television", Optical Engineering Vol. 53, No. 5, pp. 1-12, May, 2014.   DOI
12 C. Hennessey and J. Fiset, "Long Range Eye Tracking: Bringing Eye Tracking into the Living Room", Proc. of symposium on Eye tracking research & applications, pp.249-252, Jan, 2012.
13 C. Kublbeck and A. Ernst, "Face detection and tracking in video sequences using the modifiedcensus transformation", Image and Vision Computing, Vol. 24 No. 6, pp.564-572, Jun, 2006.   DOI
14 Y. Freund and R. E. Schapire, "A Short Introduction to Boosting", Journal of Japanese Society for Artificial Intelligence, Vol. 14, No. 5, pp. 771-780, Sep, 1999.
15 D. F DeMenthon and L. Davis, "Model-based object pose in 25 lines of code," In Second European Conference on Computer Vision(ECCV), pp. 335-343, Oct, 1992.
16 V. Kazemi and S. Josephine, "One millisecond face alignment with an ensemble of regression trees", Proc. IEEE Conf. Comput. Vis. Pattern Recog., pp. 1867-1874, Jun, 2014.