Browse > Article
http://dx.doi.org/10.7746/jkros.2018.13.1.038

Development of Driver's Safety/Danger Status Cognitive Assistance System Based on Deep Learning  

Miao, Xu (School of Robot Engineeing, Kyungpook National University)
Lee, Hyun-Soon (School of Mechanical Engineeing, Kyungpook National University)
Kang, Bo-Yeong (School of Mechanical Engineeing, Kyungpook National University)
Publication Information
The Journal of Korea Robotics Society / v.13, no.1, 2018 , pp. 38-44 More about this Journal
Abstract
In this paper, we propose Intelligent Driver Assistance System (I-DAS) for driver safety. The proposed system recognizes safety and danger status by analyzing blind spots that the driver cannot see because of a large angle of head movement from the front. Most studies use image pre-processing such as face detection for collecting information about the driver's head movement. This not only increases the computational complexity of the system, but also decreases the accuracy of the recognition because the image processing system dose not use the entire image of the driver's upper body while seated on the driver's seat and when the head moves at a large angle from the front. The proposed system uses a convolutional neural network to replace the face detection system and uses the entire image of the driver's upper body. Therefore, high accuracy can be maintained even when the driver performs head movement at a large angle from the frontal gaze position without image pre-processing. Experimental result shows that the proposed system can accurately recognize the dangerous conditions in the blind zone during operation and performs with 95% accuracy of recognition for five drivers.
Keywords
Convolutional neural network; Driver's head orientation; Intelligent diver assistance system;
Citations & Related Records
연도 인용수 순위
  • Reference
1 N.-N. Zheng, S. Tang, H. Cheng, Q. Li, G. Lai, and F. -W. Wang, "Toward intelligent driver-assistance and safety warning system," IEEE Intelligent Systems, Vol. 19, No. 2, pp. 8-11, Mar-Apr, 2004.
2 T. Horberry, J. Anderson, M. A. Regan, T. J. Triggs, and J. Brown, "Driver distraction: The effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance," Accident Analysis & Prevention, Vol. 38, No. 1, pp. 185-191, January, 2006.   DOI
3 Y. M. Cheung, and Q. Peng, "Eye gaze tracking with a web camera in a desktop environment," IEEE Transactions on Human Machine Systems, Vol. 45, No. 4, pp. 419-430, August, 2015.   DOI
4 X. Fu, X. Guan, E. Pel i, H. Liu, H, and G. Luo, "Automatic calibration method for driver's head orientation in natural driving environment," IEEE Transactions on Intelligent Transportation System, Vol. 14, No. 1, pp. 303-312, March, 2013.   DOI
5 A. Tawari, S. Martin, and M. M. Trivedi, "Continuous head movement estimator for driver assistance: Issues, algorithms, and on-road evaluations," IEEE Transactions on Intelligent Transportation Systems, Vol. 15, No. 2, pp. 818-830, April, 2014.   DOI
6 S. Y. Cheng, and M. M. Trivedi, "Turn-intent analysis using body pose for intelligent driver assistance," IEEE Pervasive Computing, Vol. 5, No. 4, pp. 28-37, Oct.-Dec., 2006.   DOI
7 S. J. Lee, J. Jo, H. G. Jung, K. P. Park, and J. Kim, "Real-time gaze estimator based on driver's head orientation for forward collision warning system," IEEE Transactions on Intelligent Transportation Systems, Vol. 12, No. 1, pp. 254-267, March, 2011.   DOI
8 P. Y. Simard, D. Steinkraus, and J. C. Platt, "Best practices for convolutional neural networks applied to visual document analysis," 7th International Conference on Document Analysis and Recognition, Edinburgh, UK, pp. 958-962, 2003.
9 A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," Communications of the ACM, Vol. 60, No. 6, pp. 84-90, June, 2017.   DOI
10 S. Vora, A. Rangesh, and M. M. Trivedi, "On generalizing driver gaze zone estimation using convolutional neural networks," 2017 IEEE Intelligent Vehicles Symposium (IV), Los Angeles, USA, pp. 849-854, 2017.
11 I. H. Choi, S. K. Hong, and Y.-G. Kim, "Real-time categorization of driver's gaze zone using the deep learning techniques," 2016 International Conference on Big Data and Smart Computing, Hong Kong, China, pp. 143-148, 2016.
12 S. Kannan, A. Thangavelu and R. Kalivaradhan, "An intelligent Driver Assistance System (I-DAS) for vehicle safety modelling using ontology approach," International Journal of UbiComp, Vol.1, No.3, pp.15-29, July, 2010.   DOI