Browse > Article
http://dx.doi.org/10.3745/KTSDE.2021.10.11.439

Distracted Driver Detection and Characteristic Area Localization by Combining CAM-Based Hierarchical and Horizontal Classification Models  

Go, Sooyeon (숙명여자대학교 컴퓨터과학과)
Choi, Yeongwoo (숙명여자대학교 컴퓨터과학과)
Publication Information
KIPS Transactions on Software and Data Engineering / v.10, no.11, 2021 , pp. 439-448 More about this Journal
Abstract
Driver negligence accounts for the largest proportion of the causes of traffic accidents, and research to detect them is continuously being conducted. This paper proposes a method to accurately detect a distracted driver and localize the most characteristic parts of the driver. The proposed method hierarchically constructs a CNN basic model that classifies 10 classes based on CAM in order to detect driver distration and 4 subclass models for detailed classification of classes having a confusing or common feature area in this model. The classification result output from each model can be considered as a new feature indicating the degree of matching with the CNN feature maps, and the accuracy of classification is improved by horizontally combining and learning them. In addition, by combining the heat map results reflecting the classification results of the basic and detailed classification models, the characteristic areas of attention in the image are found. The proposed method obtained an accuracy of 95.14% in an experiment using the State Farm data set, which is 2.94% higher than the 92.2%, which is the highest accuracy among the results using this data set. Also, it was confirmed by the experiment that more meaningful and accurate attention areas were found than the results of the attention area found when only the basic model was used.
Keywords
Distracted Driver Detection; Convolutional Neural Networks; CAM(Class Activation Map); Attention Area Localization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Chung, S. Ahn, and Y. Bengio, "Hierarchical multiscale recurrent neural networks," IInternational Conference on Learning Representations, 2017.
2 J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "Imagenet: A large-scale hierarchical image database," Conference on Computer Vision and Pattern Recognition, pp. 248-255, 2009.
3 S. Masood, A. Rai, A. Aggarwal, and M. N. Doja, "Detecting distraction of drivers using Convolutional Neural Network," Pattern Recognition Letters, Vol.139, 2018.
4 K. Simonyan and A. Zisserman. "Very deep convolutional networks for large-scale image recognition," International Conference on Learning Representations, 2015.
5 X. Zhang, Y. Wei, J. Feng, Y. Yang, and T. Huang, "Adversarial complementary learning for weakly supervised object localization," in IEEE Computer Vision and Pattern Recognition, pp.1325-1334, 2018.
6 R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra. "Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization," IEEE International Conference on Computer Vision, pp.618-626, 2017.
7 K. K. Singh and Y. J. Lee, "Hide-and-seek: Forcing a network to be meticulous for weakly- supervised object and action localization," IEEE International Conference on Computer Vision, pp.3544-3553, 2017.
8 S. Yun, D. Han, S. J. Oh, S. Chun, J. Choe, and Y. Yoo, "Cutmix: Regularization strategy to train strong classifiers with localizable features," IEEE/CVF International Conference on Computer Vision, pp.6022-6031, 2019.
9 World Health Organization, Global Status Report on Road Safety 2018: Summary, World Health Organization, Geneva, Switzerland, 2018.
10 K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, Vol.1, pp.770-778, 2016.
11 National Highway Traffic Safety Administration, "2015 motor vehicle crashes: Overview," Traffic safety facts: research note, U.S. Department of Transportation, August, 2016.
12 C. H. Zhao, B. L. Zhang, J. He, and J. Lian, "Recognition of driving postures by contourlet transform and random forests," Intelligent Transport Systems, Vol.6, pp.161-168, 2012.   DOI
13 I. Sultan. Academic purposes, [Internet], https://www.kaggle.com/c/ state-farm-distracted-driver-detection/discussion/20043#117982. 2016.
14 H. M. Eraqi, Y. Abouelnaga, M. H. Saad, and M. N. Moustafa, "Driver distraction identification with an ensemble of convolutional neural networks," Journal of Advanced Transportation, Vol.2019, 2019.
15 M. Alotaibi and B. Alotaibi, "Distracted driver classification using deep learning," Signal Image Video Process, pp.617-624, 2019.
16 C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, and A. Rabinovich, "Going deeper with convolutions," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.1-9, 2015.
17 M. Q. Lu, Y. C. Hu, and X. B. Lu, "Driveraction recognition using deformable and dilated fasterR-CNN with optimized region proposals," Applied Intelligence, Vol.50, pp.1100-1111, 2020.   DOI
18 L. C. Valeriano, P. Napoletano, and R. Schettini, "Recognition of driver distractions using deep learning," In Proceedings of the 2018 IEEE 8th International Conferenceon Consumer Electronics, pp.1-6, 2018.
19 N. Moslemi, R. Azmi, and M. Soryani, "Driver distraction recognition using 3D convolutional neural networks," In Proceedings of the 2019 4th International Conferenceon Pattern Recognitionand Image Analysis, pp.145-151, 2019.
20 S. Ren, K. He, R. Girshick, and J. Sun. "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.39, pp.1137-1149, 2015.   DOI
21 B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba, "Learning deep features for discriminative localization," 2016 IEEE Conference on Computer Vision and Pattern Recognition, pp.2921-2929, 2016.