한국정보통신학회논문지 (Journal of the Korea Institute of Information and Communication Engineering)

  • 제25권12호
  • /
  • Pages.1835-1845
  • /
  • 2021
  • /
  • 2234-4772(pISSN)
  • /
  • 2288-4165(eISSN)
한국정보통신학회 (The Korea Institute of Information and Commucation Engineering)
권호 표지
DOI QR코드

DOI QR Code

MobileNetV2 기반의 개선된 Lightweight 모델을 이용한 열화도로 영상에서의 블랙 아이스 인식

A Black Ice Recognition in Infrared Road Images Using Improved Lightweight Model Based on MobileNetV2

  • Li, Yu-Jie (School of Intelligent Manufacturing, Weifang University of Science and Technology) ;
  • Kang, Sun-Kyoung (Department of Computer Software Engineering, Wonkwang University)
  • 투고 : 2021.11.22
  • 심사 : 2021.11.30
  • 발행 : 2021.12.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 블랙 아이스를 정확하게 인식하고 도로 노면 정보를 운전자에게 미리 알려줘서 속도를 제어하고 예방 조치를 취할 수 있도록 하기 위해 열화 도로 영상을 기반으로 블랙 아이스 검출하기 위해 lightweight 네트워크를 제안한다. 전이학습을 이용하여 블랙 아이스 인식 실험을 하였고, 블랙 아이스 인식의 정확도 향상을 위해 MobileNetV2 기반의 개선된 lightweight 네트워크를 개발하였다. 계산량을 줄이기 위해 Linear Bottleneck 및 Inverted Residuals를 활용하여 4개의 Bottleneck 그룹을 사용하고 모델의 인식률 향상을 위해 각 Bottleneck 그룹에 3×3 컨볼루션 레이어를 연결하여 지역적 특징 추출을 강화하고 특징 맵의 수를 늘렸다. 마지막으로 구축된 블랙 아이스 데이터 세트 대상으로 블랙 아이스 인식 실험을 진행하였으며, 제안된 모델은 블랙 아이스에 대해 99.07%의 정확한 인식률을 나타내었다.

To accurately identify black ice and warn the drivers of information in advance so they can control speed and take preventive measures. In this paper, we propose a lightweight black ice detection network based on infrared road images. A black ice recognition network model based on CNN transfer learning has been developed. Additionally, to further improve the accuracy of black ice recognition, an enhanced lightweight network based on MobileNetV2 has been developed. To reduce the amount of calculation, linear bottlenecks and inverse residuals was used, and four bottleneck groups were used. At the same time, to improve the recognition rate of the model, each bottleneck group was connected to a 3×3 convolutional layer to enhance regional feature extraction and increase the number of feature maps. Finally, a black ice recognition experiment was performed on the constructed infrared road black ice dataset. The network model proposed in this paper had an accurate recognition rate of 99.07% for black ice.

키워드

과제정보

This work was supported by National IT Industry Promotion Agency(nipa) grant funded by the Korea government (National Balanced Development Special Accounting)

참고문헌

  1. G. Y. Park, S. H. Lee, E. J. Kim, and B. Y. Yun, "A Case Study on Meteorological Analysis of Freezing Rain and Black Ice Formation on the Load at Winter," Journal of Environmental Science International, vol. 26, no. 7, pp. 827-836, 2017. https://doi.org/10.5322/JESI.2017.26.7.827
  2. Korea Traffic Accident Analysis System [Internet]. Available: http://taas.koroad.or.kr/.
  3. P. Jonsson, "Remote Sensor for Winter Road Surface Status Detection," SENSORS, Limerick: Ireland, pp. 1285-1288, Oct. 2011.
  4. A. Troiano, E. Pasero, and L. Mesin, "New System for Detecting Road Ice Formation," IEEE Transactions on Instrumentation and Measurement, vol. 60, no. 3, pp. 1091-1101, Mar. 2011. https://doi.org/10.1109/TIM.2010.2064910
  5. Y. E. Abdalla, M. T. Iqbal, and M. Shehata, "Black Ice detection system using Kinect," IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1-4, Apr. 2017.
  6. X. Ma and C. Ruan, "Method for black ice detection on roads using tri-wavelength backscattering measurements," Appl. Opt, vol. 59, no. 24, pp. 7242-7246, 2020. https://doi.org/10.1364/ao.398772
  7. Q. Li, Y. W. Ji, and Z. P. Wang, "Design of Road Icing Detection System Based on Opencv+Python," Journal of Shaanxi University of Science & Technology(Natural Science Edition), vol. 35, no. 2, pp. 158-164, 2017.
  8. H. Lee, K. Hwang, M. Kang, and J. Song, "Black ice detection using CNN for the Prevention of Accidents in Automated Vehicle," International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas: USA, pp. 1189-1192, June. 2020.
  9. N. Henbest and M. Marten, The New Astronomy, 2nd ed. Cambridge, NewYork: Cambridge University Press, 1996.
  10. P. Li, J. Li, and G. C. Wang, "Application of convolutional neural network in natural language processing," 15th International Computer Conference on Wavelet Active Media Technology and Information Processing(ICCWAMTIP), Chengdu: China, pp. 120-122, 2018.
  11. A. Krizhevsky, I. Sutskever, and G. E. Hinton., "ImageNet classification with deep convolutional neural networks," Communications of the ACM, vol. 60, no. 6, pp. 84-90, 2017. https://doi.org/10.1145/3065386
  12. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet Classification with Deep Convolutional Neural Networks," Advances in Neural Information Processing Systems(NIPS), Lake Tahoe, pp. 1097-1105, Dec. 2012.
  13. K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," International Conference on Learning Representations(ICLR), arXiv preprint: arXiv:1409.1556, 2015.
  14. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going Deeper with Convolutions," IEEE Conference on Computer Vision and Pattern Recognition(CVPR), Boston: USA, pp. 1-9, Jun. 2015.
  15. K. M. He, X. Y. Zhang, and J. Sun, "Deep residual learning for image recognition," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR), Boston: USA, pp. 770-778, Jun. 2016.
  16. F. N. Landola, S. Han, M. W. Moskewicz, K. A. shraf, W. J. Dally, and K. Keutzer, "SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size," arXiv:1602.07360, 2016.
  17. G. Huang, Z. Liu, L. V. D. Maaten, and K. Q. Weinberger, "Densely Connected Convolutional Networks," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, pp. 1-3, Jun. 2017.
  18. A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, "MobileNets: Efficient convolutional neural networks for mobile vision applications," arXiv:1704.04861, 2017.
  19. M. Oquab, L. Bottou, I. Laptev, and J. Sivic, "Learning and transferring mid-level image representations using convolutional neural networks," IEEE Conference on Computer Vision and Pattern Recognition(CVPR), Columbus, pp. 1717-1724, 2014.
  20. S. J. Pan and Q. A. Yang. "A Survey on transfer learning," IEEE Transactions on knowledge and data engineering, vol. 22, no. 10, pp. 1345-1359, 2010. https://doi.org/10.1109/TKDE.2009.191
  21. L. Deng and K. Zhou, "Infrared image classification based on transferring learning," Journal of Tianjin University of Technology and Education, vol. 30, no. 3, pp. 23-29, 2020.
  22. Y. H. Mao, Z. Z. He, and Z. Ma, "Infrared Target Classification with Reconstruction Transfer Learning," Journal of University of Electronic Science and Technology of China, vol. 49, no. 4, pp. 609-614, 2020.
  23. Z. Q. Liu, H. Fu, and Y. J. Li, "Electrical Equipment Detection in Infrared Images Based on Transfer Learning of Mask-RCNN," Journal of Data Acquisition and Processing, vol. 36, no. 1, pp. 176-183, 2021.
  24. P. Ramachandran, B. Zoph, and Q. V. Le, "Searching for activation functions," arXiv:1710.05941, 2017.