International Journal of Internet, Broadcasting and Communication

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

A study on road damage detection for safe driving of autonomous vehicles based on OpenCV and CNN

  • Lee, Sang-Hyun (Department of Computer Engineering, Honam University)
  • Received : 2022.02.20
  • Accepted : 2022.02.24
  • Published : 2022.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

For safe driving of autonomous vehicles, road damage detection is very important to lower the potential risk. In order to ensure safety while an autonomous vehicle is driving on the road, technology that can cope with various obstacles is required. Among them, technology that recognizes static obstacles such as poor road conditions as well as dynamic obstacles that may be encountered while driving, such as crosswalks, manholes, hollows, and speed bumps, is a priority. In this paper, we propose a method to extract similarity of images and find damaged road images using OpenCV image processing and CNN algorithm. To implement this, we trained a CNN model using 280 training datasheets and 70 test datasheets out of 350 image data. As a result of training, the object recognition processing speed and recognition speed of 100 images were tested, and the average processing speed was 45.9 ms, the average recognition speed was 66.78 ms, and the average object accuracy was 92%. In the future, it is expected that the driving safety of autonomous vehicles will be improved by using technology that detects road obstacles encountered while driving.

Keywords

References

  1. M. Tinnila and J. Kalli, "Impact of future trends on personal mobility services," International Journal of Automotive Technology and Management, vol. 15, no. 4, pp.401-417, 2015. DOI: https://doi/pdf/10.1504/IJATM.2015.072876
  2. R, Fan, "Real-time computer stereo vision for automotive applications," Doctoral Dissertation, University of Bristol, England, 2018.
  3. S. Bang, S. Park, H. Kim, "Encoder-decoder network for pixel level road crack detection in black-box images," Computer-Aided Civil and Infrastructure Engineering, vol. 34, no. 8, pp.713-727, 2019. DOI: https://doi.org/10.1111/mice.12440
  4. R. Madli, S. Hebbar, P. Pattar and V. Golla, "Automatic detection and notification of potholes and humps on roads to aid drivers," IEEE Sensors Journal, vol. 15, no. 8, pp.4313-4318, 2015. DOI: https://doi.org/10.1109/JSEN.2015.2417579.
  5. M. D. Jenkins, T. A. Carr, M. I. Iglesias, T. Buggy and G. Morison, "A deep convolutional neural network for semantic pixel-wise segmentation of road and pavement surface cracks," In Proc. 26th European Signal Processing Conference (EUSIPCO), Rome, Italy, pp.2120-2124, 2018. DOI: https://doi.org/10.23919/EUSIPCO.2018.8553280
  6. K. He, X. Zhang, S. Ren and J. Sun, "Deep residual learning for image recognition," In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, pp.770-778, 2016. DOI: https://doi.org/arXiv:1512.03384
  7. G. Huang, Z. Liu, L. Van Der Maaten and K. Q. Weinberger, "Densely connected convolutional networks," In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, pp.4700-4708, 2017. DOI: https://doi.org/arXiv:1608.06993
  8. H. Feng, G. S. Xu and Y. Guo, "Multi-scale classification network for road crack detection," IET Intelligent Transport Systems, vol. 13, no. 2, pp.398-405, 2018. DOI: https://doi.org/10.1049/iet-its.2018.5280
  9. Q. Mei, M. Gul and M. R. Azim, "Densely connected deep neural network considering connectivity of pixels for automatic crack detection," Automation in Construction, vol. 110, p.103018, 2020. DOI: https://doi.org/10.1016/j.autcon.2019.103018