Browse > Article
http://dx.doi.org/10.6109/jkiice.2021.25.12.1835

A Black Ice Recognition in Infrared Road Images Using Improved Lightweight Model Based on MobileNetV2  

Li, Yu-Jie (School of Intelligent Manufacturing, Weifang University of Science and Technology)
Kang, Sun-Kyoung (Department of Computer Software Engineering, Wonkwang University)
Abstract
To accurately identify black ice and warn the drivers of information in advance so they can control speed and take preventive measures. In this paper, we propose a lightweight black ice detection network based on infrared road images. A black ice recognition network model based on CNN transfer learning has been developed. Additionally, to further improve the accuracy of black ice recognition, an enhanced lightweight network based on MobileNetV2 has been developed. To reduce the amount of calculation, linear bottlenecks and inverse residuals was used, and four bottleneck groups were used. At the same time, to improve the recognition rate of the model, each bottleneck group was connected to a 3×3 convolutional layer to enhance regional feature extraction and increase the number of feature maps. Finally, a black ice recognition experiment was performed on the constructed infrared road black ice dataset. The network model proposed in this paper had an accurate recognition rate of 99.07% for black ice.
Keywords
Black ice recognition; Transfer learning; Infrared images; MobileNetV2; Lightweight;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Ramachandran, B. Zoph, and Q. V. Le, "Searching for activation functions," arXiv:1710.05941, 2017.
2 A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet Classification with Deep Convolutional Neural Networks," Advances in Neural Information Processing Systems(NIPS), Lake Tahoe, pp. 1097-1105, Dec. 2012.
3 S. J. Pan and Q. A. Yang. "A Survey on transfer learning," IEEE Transactions on knowledge and data engineering, vol. 22, no. 10, pp. 1345-1359, 2010.   DOI
4 Z. Q. Liu, H. Fu, and Y. J. Li, "Electrical Equipment Detection in Infrared Images Based on Transfer Learning of Mask-RCNN," Journal of Data Acquisition and Processing, vol. 36, no. 1, pp. 176-183, 2021.
5 Y. E. Abdalla, M. T. Iqbal, and M. Shehata, "Black Ice detection system using Kinect," IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1-4, Apr. 2017.
6 G. Huang, Z. Liu, L. V. D. Maaten, and K. Q. Weinberger, "Densely Connected Convolutional Networks," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, pp. 1-3, Jun. 2017.
7 H. Lee, K. Hwang, M. Kang, and J. Song, "Black ice detection using CNN for the Prevention of Accidents in Automated Vehicle," International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas: USA, pp. 1189-1192, June. 2020.
8 C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going Deeper with Convolutions," IEEE Conference on Computer Vision and Pattern Recognition(CVPR), Boston: USA, pp. 1-9, Jun. 2015.
9 G. Y. Park, S. H. Lee, E. J. Kim, and B. Y. Yun, "A Case Study on Meteorological Analysis of Freezing Rain and Black Ice Formation on the Load at Winter," Journal of Environmental Science International, vol. 26, no. 7, pp. 827-836, 2017.   DOI
10 Korea Traffic Accident Analysis System [Internet]. Available: http://taas.koroad.or.kr/.
11 Q. Li, Y. W. Ji, and Z. P. Wang, "Design of Road Icing Detection System Based on Opencv+Python," Journal of Shaanxi University of Science & Technology(Natural Science Edition), vol. 35, no. 2, pp. 158-164, 2017.
12 P. Jonsson, "Remote Sensor for Winter Road Surface Status Detection," SENSORS, Limerick: Ireland, pp. 1285-1288, Oct. 2011.
13 A. Troiano, E. Pasero, and L. Mesin, "New System for Detecting Road Ice Formation," IEEE Transactions on Instrumentation and Measurement, vol. 60, no. 3, pp. 1091-1101, Mar. 2011.   DOI
14 X. Ma and C. Ruan, "Method for black ice detection on roads using tri-wavelength backscattering measurements," Appl. Opt, vol. 59, no. 24, pp. 7242-7246, 2020.   DOI
15 N. Henbest and M. Marten, The New Astronomy, 2nd ed. Cambridge, NewYork: Cambridge University Press, 1996.
16 P. Li, J. Li, and G. C. Wang, "Application of convolutional neural network in natural language processing," 15th International Computer Conference on Wavelet Active Media Technology and Information Processing(ICCWAMTIP), Chengdu: China, pp. 120-122, 2018.
17 K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," International Conference on Learning Representations(ICLR), arXiv preprint: arXiv:1409.1556, 2015.
18 A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, "MobileNets: Efficient convolutional neural networks for mobile vision applications," arXiv:1704.04861, 2017.
19 K. M. He, X. Y. Zhang, and J. Sun, "Deep residual learning for image recognition," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR), Boston: USA, pp. 770-778, Jun. 2016.
20 F. N. Landola, S. Han, M. W. Moskewicz, K. A. shraf, W. J. Dally, and K. Keutzer, "SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size," arXiv:1602.07360, 2016.
21 Y. H. Mao, Z. Z. He, and Z. Ma, "Infrared Target Classification with Reconstruction Transfer Learning," Journal of University of Electronic Science and Technology of China, vol. 49, no. 4, pp. 609-614, 2020.
22 A. Krizhevsky, I. Sutskever, and G. E. Hinton., "ImageNet classification with deep convolutional neural networks," Communications of the ACM, vol. 60, no. 6, pp. 84-90, 2017.   DOI
23 M. Oquab, L. Bottou, I. Laptev, and J. Sivic, "Learning and transferring mid-level image representations using convolutional neural networks," IEEE Conference on Computer Vision and Pattern Recognition(CVPR), Columbus, pp. 1717-1724, 2014.
24 L. Deng and K. Zhou, "Infrared image classification based on transferring learning," Journal of Tianjin University of Technology and Education, vol. 30, no. 3, pp. 23-29, 2020.