Browse > Article
http://dx.doi.org/10.3837/tiis.2015.03.014

An Eye Location based Head Posture Recognition Method and Its Application in Mouse Operation  

Chen, Zhe (School of Information and Communication Engineering, Dalian University of Technology)
Yang, Bingbing (School of Information and Communication Engineering, Dalian University of Technology)
Yin, Fuliang (School of Information and Communication Engineering, Dalian University of Technology)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.9, no.3, 2015 , pp. 1087-1104 More about this Journal
Abstract
An eye location based head posture recognition method is proposed in this paper. First, face is detected using skin color method, and eyebrow and eye areas are located based on gray gradient in face. Next, pupil circles are determined using edge detection circle method. Finally, head postures are recognized based on eye location information. The proposed method has high recognition precision and is robust for facial expressions and different head postures, and can be used in mouse operation. The experimental results reveal the validity of proposed method.
Keywords
head posture recognition; eye location; pupil correction; mouse operation; human computer interaction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Akinlar C, Topal C, "EDPF: A real-time parameter-free edge segment detector with a false detection control," Int. Journal of Pattern Recognition and Artificial Intelligence, vol. 26, no.1, pp.1-22, May 2012.
2 Akinlar C, Topal C, "EDLines: A real-time line segment detector with a false detection control," Pattern Recognition Letters, vol.32, no.13, pp.1633-1642, Oct. 2011.   DOI
3 Nordstrom M M, Larsen M, Sierakowski J, et al, "The IMM face database-an annotated dataset of 240 face images," Technical University of Denmark, DTU Informatics, Building 321, 2004. http://orbit.dtu.dk/fedora/objects/orbit:79272/datastreams/file_3069003/content
4 Jesorsky O, Kirchberg K J, Frischholz R W, "Robust face detection using the hausdorff distance," in Proc. of 3th Int. Conf. Audio-and Video-based Biometric Person Authentication, pp.90-95, Jun. 2001.
5 Dalal N, Triggs B, "Histograms of oriented gradients for human detection," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 886-893, Jun. 2005.
6 Li Z, Liu J, Zhu X, "Multi-modal multi-correlation person-centric news retrieval," in Proc. of 19th ACM Int. Conf. on Information and Knowledge Management, pp.179-188, Oct. 2010.
7 Li Z, Liu J, Lu H, "Sparse constraint nearest neighbour selection in cross-media retrieval," in Proc. of IEEE Int.Conference on Image Processing, pp.1465-1468, Sep. 2010.
8 Oyini Mbouna R, Kong S G, Chun M G, "Visual analysis of eye state and head pose for driver alertness monitoring," IEEE Transactions on Intelligent Transportation Systems, vol.14, no.3, pp. 1462-1469, Sep. 2013.   DOI
9 Huang D, Storer M, De la Torre F, "Supervised local subspace learning for continuous head pose estimation," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2921-2928, Jun. 2011.
10 Fanelli G, Gall J, Van Gool L, "Real time head pose estimation with random regression forests," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 617-624, Jun. 2011.
11 Yan Y, Subramanian R, Ricci, "Evaluating multi-task learning for multi-view head pose classification in interactive environments," in Proc. of IEEE Int. Conference on Pattern Recognition, pp.4182-4187, Aug. 2014.
12 Valenti R, Sebe N, Gevers T, "Combining head pose and eye location information for gaze estimation," IEEE Transactions on Image Processing, vol.21, no.2, pp.802-815, Jan. 2012.   DOI
13 Zhang W, Wang Z, Xu J, "A Method of gaze direction estimation considering head posture," Int. Journal of Signal Processing, Image Processing and Pattern Recognition, vol.6, no.2, pp.103-111, Apr. 2013. http://www.sersc.org/journals/IJSIP/vol6_no2/9.pdf
14 Zhang Y, Yue J, Dong Y, "Robust eye openness and head pose estimation based on multi modal camera," in Proc. of IEEE Workshop on Advanced Research and Technology in Industry Applications, pp.418-422, Sep. 2014.
15 Huang. D, Storer. M, DeLaTorre. F, Bischof. H, "Supervised local subspace learning for continuous head pose estimation," in Proc. of 2011 IEEE Conf. on Computer Vision and Pattern Recognition, pp. 2921-2928, Jun. 2011.
16 Ma. B. P, Yang. X, Shan. S. G, "Head Pose Estimation Via Background Removal," in Proc. of 5th Int. Workshop on Intelligent Science and Intelligent Data Engineering, pp.140-147, Oct. 2013.
17 Murphy C. E, Trivedi M M, "Head pose estimation and augmented reality tracking: an integrated system and evaluation for monitoring driver awareness," IEEE Trans. on Intelligent Transportation Systems, vol.11, no.2, pp. 300-311, Jun. 2010.   DOI
18 Cai, Q, Sankaranarayanan. A, Zhang. Q, Zhang. Z, Liu. Z, "Real time head pose tracking from multiple cameras with a generic model," in Proc. of 2010 IEEE Computer Society Conf. on Vision and Pattern Recognition Workshops, pp. 25-32, Jun. 2010.
19 Fu. Y, Huang. T. S, "Graph embedded analysis for head pose estimation." in Proc. of 7th Int. Conf. on Automatic Face and Gesture Recognition, pp. 6-8, Apr. 2006.
20 Cristiani. A, Porta. M, Gandini. D, Bertolotti. G. M, Serbedzija. N, "Driver drowsiness identification by means of passive techniques for eye detection and tracking," in Proc. of IEEE 4th Int. Conf. on Self-Adaptive and Self-Organizing Systems Workshop, pp. 142-146, Sep. 2010.
21 Mehta. R, Shrivastava. M, "Real time eye template detection and tracking," Int. Journal of Advanced Computer Research, vol.2, no.2, pp. 18-22, Jun. 2012. http://www.theaccents.org/ijacr/papers/current_jun_2012/3.pdf
22 Kasinski. A, Schmidt. A, "The architecture and performance of the face and eyes detection system based on the Haar cascade classifiers," Pattern Analysis & Applications, vol.13, no.2, pp. 197-211, May, 2010.   DOI
23 Choi. J. K, Chung. S. T, "Reliable and fast eye detection," in Proc. of 9th Int. Conf. on Signal Processing, Computational Geometry and Artificial Vision, pp. 78-82, 2009. http://dl.acm.org/citation.cfm?id=1627548
24 Lu. L, Yang. Y, Wang. L, Tang. B, "Eye location based on gray projection," in Proc. of IEEE 3th Int. Symposium on Intelligent Information Technology Application, pp.58-60, Nov. 2009.
25 Yan. B, Zhang. X, Gao. L, "Improvement on pupil positioning algorithm in eye tracking technique," in Proc. of IEEE Int. Conf.on Information Engineering and Computer Science, pp. 1- 4, Dec. 2009.
26 Bacivarov. I, Ionita. M, Corcoran. P, "Statistical models of appearance for eye tracking and eye-blink detection and measurement," IEEE Trans. on Consumer Electronics, vol.54, no.3, pp.1312-1320, Aug. 2008.   DOI
27 Akinlar C, Topal C, "ED-Circles: A real-time circle detector with a false detection control," Pattern Recognition, vol.46, no.3, pp.725-740, March, 2013.   DOI
28 Li W, Jiao F, He C, "Face detection using ellipsoid skin model," Emerging Technologies for Information Systems, Computing, and Management, Lecture Notes in Electrical Engineering, vol 236, pp.513-521, 2013.   DOI
29 Burt. P, Adelson. E, "The Laplacian pyramid as a compact image code," IEEE Trans. on Communications, vol.31, no.4, pp. 532-540, Apr. 1983.   DOI
30 Viola. P, Jones. M, "Rapid object detection using aBoosted cascade of simple features," in Proc. of IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 511-518, Dec. 2001.