Browse > Article
http://dx.doi.org/10.14346/JKOSOS.2021.36.1.18

Crack Inspection and Mapping of Concrete Bridges using Integrated Image Processing Techniques  

Kim, Byunghyun (Department of Civil Engineering, University of Seoul)
Cho, Soojin (Department of Civil Engineering, University of Seoul)
Publication Information
Journal of the Korean Society of Safety / v.36, no.1, 2021 , pp. 18-25 More about this Journal
Abstract
In many developed countries, such as South Korea, efficiently maintaining the aging infrastructures is an important issue. Currently, inspectors visually inspect the infrastructure for maintenance needs, but this method is inefficient due to its high costs, long logistic times, and hazards to the inspectors. Thus, in this paper, a novel crack inspection approach for concrete bridges is proposed using integrated image processing techniques. The proposed approach consists of four steps: (1) training a deep learning model to automatically detect cracks on concrete bridges, (2) acquiring in-situ images using a drone, (3) generating orthomosaic images based on 3D modeling, and (4) detecting cracks on the orthmosaic image using the trained deep learning model. Cascade Mask R-CNN, a state-of-the-art instance segmentation deep learning model, was trained with 3235 crack images that included 2415 hard negative images. We selected the Tancheon overpass, located in Seoul, South Korea, as a testbed for the proposed approach, and we captured images of pier 34-37 and slab 34-36 using a commercial drone. Agisoft Metashape was utilized as a 3D model generation program to generate an orthomosaic of the captured images. We applied the proposed approach to four orthomosaic images that displayed the front, back, left, and right sides of pier 37. Using pixel-level precision referencing visual inspection of the captured images, we evaluated the trained Cascade Mask R-CNN's crack detection performance. At the coping of the front side of pier 37, the model obtained its best precision: 94.34%. It achieved an average precision of 72.93% for the orthomosaics of the four sides of the pier. The test results show that this proposed approach for crack detection can be a suitable alternative to the conventional visual inspection method.
Keywords
concrete crack; deep learning; orthomosaic; drone; cascade mask R-CNN;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 S. Xie et al., "Aggregated Residual Transformations for Deep Neural Networks", Proceedings-30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Vol. 2017-Jan., pp. 5987-5995, 2017.
2 S. Goessens et al., "Feasibility Study for Drone-Based Masonry Construction of Real-Scale Structures", Automation in Construction, Vol. 94, pp. 458-480, 2018.   DOI
3 H. Kim et al., "Concrete Crack Identification Using a UAV Incorporating Hybrid Image Processing", Sensors, Vol. 17, No. 9, p. 2052, 2017.   DOI
4 Y. Liu et al., "Deep Learning-Based Enhancement of Motion Blurred UAV Concrete Crack Images", Journal of Computing in Civil Engineering, Vol. 34, No. 5, p. 04020028, 2020.   DOI
5 G. Leonardi et al., "Road Degradation Survey through Images by Drone", Smart Innovation, Systems and Technologies, Vol. 101, pp. 222-228, 2019.
6 Z. Cai and N. Vasconcelos, "Cascade R-CNN: High Quality Object Detection and Instance Segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019.
7 B. Kim and S. Cho, "Image-Based Concrete Crack Assessment Using Mask and Region-Based Convolutional Neural Network", Structural Control and Health Monitoring, Vol. 26, No. 8, p. e2381, 2019.   DOI
8 B. Hariharan et al., "Discriminative Decorrelation for Clustering and Classification", European Conference on Computer Vision, Vol. 7575 LNCS, No. PART 4, pp. 459-472, 2012.
9 B. Kim and S. Cho, "Development of Automatic Input Negative Sample Algorithm for Improving Crack Detection Deep Learning Model", Proceedings of Korea Institute for Structural Maintenance and Inspection, vol. 23, no. 2, p. 125, 2019.
10 J. Kiefer et al., "Stochastic Estimation of the Maximum of a Regression Function", The Annals of Mathematical Statistics, Vol. 23, No. 3, pp. 462-66, 1952.   DOI
11 T. Y. Lin et al., "Feature Pyramid Networks for Object Detection", Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Vol. 2017-Jan., pp. 936-944, 2017.
12 S. Ren et al., "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 39, No. 6, pp. 1137-1149, 2017.   DOI
13 K. Chen et al., MMDetection: Open MMLab Detection Toolbox and Benchmark. http://arxiv.org/abs/1906.07155, 2019.
14 Y. Li and C. Liu, "Applications of Multirotor Drone Technologies in Construction Management", International Journal of Construction Management, Vol. 19, No. 5, pp. 401-412, 2019.   DOI
15 T. Nishikawa et al., "Concrete Crack Detection by Multiple Sequential Image Filtering", Computer-Aided Civil and Infrastructure Engineering, Vol. 27, No. 1, pp. 29-47, 2012.   DOI
16 Y. Liu et al., "Automated Assessment of Cracks on Concrete Surfaces Using Adaptive Digital Image Processing", Smart Structures and Systems, Vol. 14, No. 4, pp. 719-741, 2014.   DOI
17 B. Kim and S. Cho, "Automated Vision-based Detection of Cracks on Concrete Structures Using a Deep Learning Technique", Sensors, Vol. 18, p. 3452, 2018.   DOI
18 B. Kim and S. Cho, "Efflorescence Assessment Using Hyperspectral Imaging for Concrete Structures", Smart Structures and Systems, Vol. 22, No. 2, pp. 209-221, 2018.   DOI
19 E. Ridolfi et al., "Accuracy Analysis of a Dam Model from Drone Surveys", Sensors, Vol. 17, No. 8, p. 1777, 2017.   DOI
20 R. Fan et al., "Real-Time Dense Stereo Embedded in a UAV for Road Inspection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019.
21 Agisoft, Agisoft Metashape, https://www.agisoft.com/, 2020.
22 J. Deng et al., "ImageNet: A Large-Scale Hierarchical Image Database", 2009 IEEE Conference on Computer Vision and Pattern Recognition, Institute of Electrical and Electronics Engineers (IEEE), pp. 248-255, 2009.