International Journal of Fuzzy Logic and Intelligent Systems

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Novel Backprojection Method for Monocular Head Pose Estimation

  • Ju, Kun (Vista Entertainment Solutions) ;
  • Shin, Bok-Suk (Computer Science Department, The University of Auckland) ;
  • Klette, Reinhard (Computer Science Department, The University of Auckland)
  • Received : 2013.02.25
  • Accepted : 2013.03.15
  • Published : 2013.03.25
Download PDF
⟨ Previous Next ⟩

Abstract

Estimating a driver's head pose is an important task in driver-assistance systems because it can provide information about where a driver is looking, thereby giving useful cues about the status of the driver (i.e., paying proper attention, fatigued, etc.). This study proposes a system for estimating the head pose using monocular images, which includes a novel use of backprojection. The system can use a single image to estimate a driver's head pose at a particular time stamp, or an image sequence to support the analysis of a driver's status. Using our proposed system, we compared two previous pose estimation approaches. We introduced an approach for providing ground-truth reference data using a mannequin model. Our experimental results demonstrate that the proposed system provides relatively accurate estimations of the yaw, tilt, and roll angle. The results also show that one of the pose estimation approaches (perspective-n-point, PnP) provided a consistently better estimate compared to the other (pose from orthography and scaling with iterations, POSIT) using our proposed system.

Keywords

References

  1. R. Klette, J. Ahn, R. Haeusler, S. Hermann, J. Huang, W. Khan, S. Manoharan, S. Morales, J. Morris, R. Nicolescu, F. Ren, K. Schauwecker, and X. Yang, "Advance in vision-based driver assistance," in Proceedings of 2011 International Conference on Electric Technology and Civil Engineering, Lushan, 2011, pp. 987-990. http://dx.doi.org/10.1109/ICETCE.2011.5775884
  2. M. Rezaei and R. Klette, "Adaptive Haar-like classification for eye monitoring in non-ideal lighting conditions," in Proceedings of the 27th Conference on Image and Vision Computing New Zealand, Dunedin, 2012, pp. 521-526. http://dx.doi.org/10.1145/2425836.2425934
  3. Y. H. Wu and Z. Y. Hu, "PnP problem revisited," Journal of Mathematical Imaging and Vision, vol. 24, no. 1, pp. 131-141, Jan. 2006. http://dx.doi.org/10.1007/s10851-005-3617-z
  4. D. F. Dementhon and L. S. Davis, "Model-based object pose in 25 lines of code," in Proceedings of Second European Conference on Computer Vision, Ligure, 1992, pp. 335-343. http://dx.doi.org/10.1007/3-540-55426-2_38
  5. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, 1981, pp. 674-679.
  6. M. Dahmane and J. Meunier, "Oriented-filters based head pose estimation," in Proceedings of Fourth Canadian Conference on Computer and Robot Vision, Montreal, 2007, pp. 418-425.
  7. I. Marras, N. Nikolaidis, and I. Pitas, "3D head pose estimation in monocular video sequences by sequential camera self-calibration," in Proceedings of 2009 IEEE International Workshop on Multimedia Signal Processing, Rio De Janeiro, 2009, pp. 1-6. http://dx.doi.org/10.1109/MMSP.2009.5293570
  8. X. Wang, X. Huang, J. Gao, and R. Yang, "Illumination and person-insensitive head pose estimation using distance metric learning," in Proceedings of the 10th European Conference on Computer Vision: Part II, Marseille, 2008, pp. 624-637. http://dx.doi.org/10.1007/978-3-540-88688-4_46
  9. M. T. Wenzel and W. H. Schiffmann, "Head pose estimation of partially occluded faces," in Proceedings of the 2nd Canadian Conference on Computer and Robot Vision, Victoria, 2005, pp. 353-360. http://dx.doi.org/10.1109/CRV.2005.45
  10. Y. D. Zhu and K. Fujimura, "Head pose estimation for driver monitoring," in Proceedings of 2004 IEEE Intelligent Vehicles Symposium, Parma, 2004, pp. 501-506. http://dx.doi.org/10.1109/IVS.2004.1336434
  11. P. Fitzpatrick, Head Pose Estimation without Manual Initialization, Cambridge, MA: AI Lab, MIT, 2000.
  12. T. Vatahska, M. Bennewitz, and S. Behnke, "Feature-based head pose estimation from images," in Proceedings of 2007 7th IEEE-RAS International Conference on Humanoid Robots, Pittsburgh, 2007, pp. 330-335. http://dx.doi.org/10.1109/ICHR.2007.4813889
  13. L. G. Dong, L. M. Tao, G. Y. Xu, and P. Oliver, "A study of two image representations for head pose estimation," in Proceedings of Fifth International Conference on Image and Graphics, Xian, 2009, pp. 963-968. http://dx.doi.org/10.1109/ICIG.2009.141
  14. N. Gourier, J. Maisonnasse, D. Hall, and J. Crowley, "Head pose estimation on low resolution images," in Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships, Southampton, 2007, pp. 270-280. http://dx.doi.org/10.1007/978-3-540-69568-4_24
  15. E. Murphy-Chutorian, A. Doshi, and M. M. Trivedi, "Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation," in Proceedings of the 2007 IEEE Intelligent Transportation Systems Conference, Seattle, 2007, pp. 709-714. http://dx.doi.org/10.1109/ITSC.2007.4357803
  16. S. Choi and D. Kim, "Robust head tracking using 3D ellipsoidal head model in particle filter," Pattern Recognition, vol. 41, no. 9, pp. 2901-2915, Sep. 2008. http://dx.doi.org/10.1016/j.patcog.2008.02.002
  17. P. Martins and J. Batista, "Monocular Head Pose Estimation," in Proceedings of 5th international conference on Image Analysis and Recognition, Povoa de Varzim, 2008, pp. 357-368. http://dx.doi.org/10.1007/978-3-540-69812-8_35
  18. E. Murphy-Chutorian and M. M. Trivedi, "Head pose estimation and augmented reality tracking: an integrated system and evaluation for monitoring driver awareness," IEEE Transactions on Intelligent Transportation Systems, vol. 11, no. 2, pp. 300-311, Jun. 2010. http://dx.doi.org/10.1109/TITS.2010.2044241
  19. S. Basu, I. Essa, and A. Pentland, "Motion regularization for model-based head tracking," in Proceedings of the 13th International Conference on Pattern Recognition, Vienna, 1996, pp. 611-616. http://dx.doi.org/10.1109/ICPR.1996.547019
  20. P. J. Schneider and D. H. Eberly, "Geometric tools for computer graphics," Amsterdam: Morgan Kaufmann Publishers, 2003.