DOI QR코드

DOI QR Code

Efficient Driver Attention Monitoring Using Pre-Trained Deep Convolution Neural Network Models

  • Kim, JongBae (Department of Software Engineering, Sejong Cyber University)
  • Received : 2022.03.20
  • Accepted : 2022.03.27
  • Published : 2022.05.31

Abstract

Recently, due to the development of related technologies for autonomous vehicles, driving work is changing more safely. However, the development of support technologies for level 5 full autonomous driving is still insufficient. That is, even in the case of an autonomous vehicle, the driver needs to drive through forward attention while driving. In this paper, we propose a method to monitor driving tasks by recognizing driver behavior. The proposed method uses pre-trained deep convolutional neural network models to recognize whether the driver's face or body has unnecessary movement. The use of pre-trained Deep Convolitional Neural Network (DCNN) models enables high accuracy in relatively short time, and has the advantage of overcoming limitations in collecting a small number of driver behavior learning data. The proposed method can be applied to an intelligent vehicle safety driving support system, such as driver drowsy driving detection and abnormal driving detection.

Keywords

Acknowledgement

An extended version of this paper has been published at the ICESI 2022 conference[24], and this work was supported by the NRF grant funded by the Korea government (MSIT)(NRF-2020R1F1A106890011)

References

  1. Y. H. Kim, "V2X Technology Trends for Next-Generation Mobility," International Journal of Internet, Broadcasting and Communication, vol. 12, no. 1, pp.7-13, 2020. https://doi.org/10.7236/IJIBC.2020.12.1.7
  2. B. C. Juan, D. C. Rufas, et al., " Resource-Constrained Machine Learning for ADAS: A Systematic Review," IEEE Access, vol. 8, pp.40573-40598, 2020. https://doi.org/10.1109/access.2020.2976513
  3. V. K. Kukkala, J. Tunnell, S. Pasricha, and T. Bradley, "Advanced Driver-Assistance Systems: A Path Toward Autonomous Vehicles," IEEE Consumer Electronics Magazine, vol. 7, no. 5, pp.18-25, 2018. https://doi.org/10.1109/mce.2018.2828440
  4. S. Raviteja and R. Shanmughasundaram, "Advanced Driver Assistance System (ADAS)," International Conference on Intelligent Computing and Control Systems, pp.737-740, 2018.
  5. S. S. Sarikan and A. M. Ozbayoglu, "Anomaly Detection in Vehicle Traffic with Image Processing and Machine Learning," Procedia Computer Science, vol. 140, pp.64-69, 2018. https://doi.org/10.1016/j.procs.2018.10.293
  6. N. Albarella, F. Masuccio, L. Novella, M. Tufo, and G. Fiengo, "A Forward-Collision Warning System for Electric Vehicles: Experimental Validation in Virtual and Real Environment," energies, vol. 14, no. 4872, pp.1-12, 2021.
  7. J. B. Carazo, D. C. Rufas, and E. Biemp, "Resource-Constrained Machine Learning for ADAS: A Systematic Review," IEEE Access, vol. 8, pp.40573-40598, 2020. https://doi.org/10.1109/access.2020.2976513
  8. C. Guo, J. Meguro, Y. Kojima, and T. Naito, "A Multimodal ADAS System for Unmarked Urban Scenarios Based on Road Context Understanding," IEEE Trans on ITS., vol. 16, no. 4, pp.1690-1704, 2015.
  9. Z. Sun, G. Bebis, and R. Miller, "On-road vehicle detection: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp.694-711, 2006. https://doi.org/10.1109/TPAMI.2006.104
  10. https://www.sae.org/blog/sae-j3016-update
  11. https://taiwanenglishnews.com/tesla-on-autopilot-crashes-into-overturned-truck/
  12. https://globalnews.ca/news/8286090/tesla-home-crash-ottawa/
  13. https://www.wheelsjoint.com/tesla-autopilot-accident-rate-drops-by-half-in-first-quarter-of-2020/
  14. http://taas.koroad.or.kr/
  15. Y. Cui, R. Chen, W. Chu, L. Chen, D. Tian, Y. Li, and D. Cao, "Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 2, pp.722-739, 2022. https://doi.org/10.1109/TITS.2020.3023541
  16. T. W. Kwon, J. Y. Lee, and K. D. Jung, "Design of Falling Recognition Application System using Deep Learning," International Journal of Internet, Broadcasting and Communication, vol. 12, no.2, pp.120-126, 2020. https://doi.org/10.7236/IJIBC.2020.12.2.120
  17. B. Alshaqaqi, et al., Vision based system for driver drowsiness detection," Int. Symp. on Programming and Systems, pp.103-108, 2013.
  18. W. J. Chang, L. B. Chen, and Y. Z. Chiou, "Design and Implementation of a Drowsiness-Fatigue-Detection System Based on Wearable Smart Glasses to Increase Road Safety," IEEE Trans. on CE., vol. 64, no. 4, pp.461-469, 2018.
  19. Y. L. Yang, F. Chang, and Y. Lu, "Driver Gaze Zone Estimation via Head Pose Fusion Assisted Supervision and Eye Region Weighted Encoding," IEEE Trans. on. CE., vol. 67, no. 4, pp.275-284, 2021.
  20. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation," Proc. of the IEEE Conf. on CVPR., pp.580-587, 2014.
  21. https://aihub.or.kr
  22. O. Russakovsky, J. Deng, H. Su, et al., "ImageNet Large Scale Visual Recognition Challenge," International Journal of Computer Vision, vol. 115, no. 3, pp.211-252, 2015. https://doi.org/10.1007/s11263-015-0816-y
  23. B. Zhou, A. Lapedriza, A. Torralbam, and A. Oliva, "Places: An image database for deep scene understanding," arXiv preprint arXiv:1610.02055, 2016.
  24. J. B. Kim, "Deep learning-based driver attention recognition for driver's abnormal behavior monitoring," Int. conf. on electric-vehicle, smart gird, and information technology, p02-1, 2022.