Browse > Article
http://dx.doi.org/10.3837/tiis.2020.09.013

Crack Detection Method for Tunnel Lining Surfaces using Ternary Classifier  

Han, Jeong Hoon (Department of Computer Science and Engineering, Hanyang University)
Kim, In Soo (Deep Inspection)
Lee, Cheol Hee (Deep Inspection)
Moon, Young Shik (Department of Computer Science and Engineering, Hanyang University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.9, 2020 , pp. 3797-3822 More about this Journal
Abstract
The inspection of cracks on the surface of tunnel linings is a common method of evaluate the condition of the tunnel. In particular, determining the thickness and shape of a crack is important because it indicates the external forces applied to the tunnel and the current condition of the concrete structure. Recently, several automatic crack detection methods have been proposed to identify cracks using captured tunnel lining images. These methods apply an image-segmentation mechanism with well-annotated datasets. However, generating the ground truths requires many resources, and the small proportion of cracks in the images cause a class-imbalance problem. A weakly annotated dataset is generated to reduce resource consumption and avoid the class-imbalance problem. However, the use of the dataset results in a large number of false positives and requires post-processing for accurate crack detection. To overcome these issues, we propose a crack detection method using a ternary classifier. The proposed method significantly reduces the false positive rate, and the performance (as measured by the F1 score) is improved by 0.33 compared to previous methods. These results demonstrate the effectiveness of the proposed method.
Keywords
Crack Detection; Convolutional Neural Network; Tunnel Lining Inspection;
Citations & Related Records
Times Cited By KSCI : 8  (Citation Analysis)
연도 인용수 순위
1 Y. Liu, J. Yao, X. Lu, R. Xie, and L. Li, "DeepCrack: A deep hierarchical feature learning architecture for crack segmentation," Neurocomputing, vol. 338, pp. 139-153, 2019.   DOI
2 C. AbdelQader, O. Abudayyeh, and M. Kelly, "Analysis of edge-detection techniques for crack identification in bridges," Journal of Computing in Civil Engineering, vol. 17, no. 4, Oct. 2003.
3 Y. Fujita and Y. Hamamoto, "A robust automatic crack detection method from noisy concrete surfaces," Machine Vision and Applications, vol. 22, no. 2, pp. 245-254, 2011.   DOI
4 T. Nishikawa, J. Yoshida, T. Sugiyama, and Y. Fujino, "Concrete crack detection by multiple sequential image filtering," Computer‐Aided Civil and Infrastructure Engineering, vol. 27, no. 1, pp. 29-47, 2012.   DOI
5 Y. R. Kim and T. M. Oh, "Multi-scale crack detection using scaling," Journal of the Institute of Electronics and Information Engineers, vol. 50, no. 9, pp. 194-199, Sep. 2013.   DOI
6 T. C. Hutchinson and Z. Chen, "Improved image analysis for evaluating concrete damage," Journal of Computing in Civil Engineering, vol. 20, no. 3, pp. 210-216, May, 2006.   DOI
7 H. Takeda, S. Koyama, K. Horiguchi, and T. Maruya, "Using image analysis and wavelet transform to detect cracks in concrete structures," Report of Taise Technology Center, no. 39, p. 25, 2006.
8 H. G. Sohn, Y. M Lim, K. H. Yun, and G. H. Kim, "Monitoring crack changes in concrete structures," Computer‐Aided Civil and Infrastructure Engineering, vol. 20, no. 1, pp. 52-61, 2005.   DOI
9 T. Yamaguchi, S. Nakamura, and S. Hashimoto, "An efficient crack detection method using percolation-based image processing," in Proc. of the IEEE Conference on Industrial Electronics and Applications, pp. 1875-1880, Jun. 2008.
10 T. Yamaguchi and S. Hashimoto, "Fast crack detection method for large-size concrete surface images using percolation-based image processing," Machine Vision and Applications, vol. 21, no. 5, pp. 797-809, 2010.   DOI
11 G. K. Choudhary and S. Dey, "Crack detection in concrete surfaces using image processing, fuzzy logic, and neural networks," in Proc. of the IEEE International Conference on Advanced Computational Intelligence (ICACI), pp. 404-411, Oct. 2012.
12 Y. H. Noh, D. H. Koo, Y.M. Kang, D. G. Park, and D. H. Lee, "Automatic crack detection on concrete images using segmentation via fuzzy C-means clustering," in Proc. of the International Conference on Applied System Innovation (ICASI), pp. 877-880, 2017.
13 Y. Xu, Y. Bao, J. Chen, W. Zuo, and H. Li, "Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images," Structural Health Monitoring, vol.18, pp 653-674, 2018.   DOI
14 C. Hu, X. Wu, and Z. Chu, "Bagging deep convolutional autoencoders trained with a mixture of real data and GAN-generated data," KSII Transactions on Internet and Information Systems, vol. 13, pp. 5427-5445, 2019.   DOI
15 Q. Zou, Z. Zhang, Q. Li, and X. Qi, "DeepCrack: Learning Hierarchical Convolutional Features for Crack Detection," IEEE Transactions on Image Processing, vol. 28, pp. 1498-1512, 2019.   DOI
16 S. J. Park, W. J. Jeong, and Y. S. Moon, "X-ray Image Segmentation using Multi-task Learning," KSII Transactions on Internet and Information Systems, vol. 14, no. 3, pp. 1104-1120, 2020.   DOI
17 Y. Zhang, R. Yao, Q. Jiang, C. Zhang, and S. Wang, "Video Object Segmentation with Weakly Temporal Information," KSII Transactions on Internet and Information Systems, vol. 13, pp. 1434-1449, 2019.   DOI
18 S. Xie and Z. Tu, "Holistically-nested edge detection," in Proc. of the IEEE International Conference on Computer Vision (ICCV), pp. 1395-1403, 2015.
19 O. Ronneberger, P. Fischer, T. Brox, "U-Net: Convolutional Networks for Biomedical Image Segmentation," Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 234-241, 2015.
20 I. S. Kim and C. H. Lee, "Development of Video Shooting System and Technique Enabling Detection of Micro Cracks in the Tunnel Lining while Driving," Journal of the Korean Society of Hazard Mitigation, vol. 18, pp. 217-229, 2018.   DOI
21 K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," in Proc. of the International Conference on Learning Representations (ICLR), pp. 1-14, 2015.
22 Y. Wu and K. He, "Group normalization," in Proc. of European Conference on Computer Vision (ECCV), 2018.
23 K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770- 778, 2016.
24 L. C. Chen, G. Papandreou, F. Schroff, and H. Adam, "Rethinking atrous convolution for semantic image segmentation," arXiv:1706.05587, 2017.
25 K. S. Lim, N. H. Shin, Y. Y. Lee, and C. S. Kim, "Order Learning and Its Application to Age Estimation," in Proc. of the International Conference on Learning Representations (ICLR), 2020.
26 D. P. Kingma and J. Ba, "Adam: A Method for Stochastic Optimization," in Proc. of the International Conference on Learning Representations (ICLR), 2015.
27 L. C. Chen, Y. Zhu, G. Papandreou, F. Schroff, and H. Adam, "Encoder-decoder with atrous separable convolution for semantic image segmentation," in Proc. of European Conference on Computer Vision (ECCV), pp. 801-818, 2018.
28 Ministry of Land, Infrastructure and Transport, Department of Advanced Road Safety, "Road Bridge and Tunnel Status," KOSIS Transportation.Information Communication, 2018.
29 Korea Infrastructure Safety Corporation, "Development of special specifications of crack evaluation method, repair, strengthening on concrete structures," Korea Infrastructure Safety Corporation, 1999.
30 B. K. Han, H. S. Yang, J. M. Lee, and Y. S. Moon, "Crack Detection in Tunnel Using Convolutional Encoder-Decoder Network," Journal of The Institute of Electronics and Information Engineers, vol. 54, pp. 80-89, 2017.   DOI
31 C. J. Cha, W. R. Choi, and B. Oral, "Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks," Computer‐Aided Civil and Infrastructure Engineering, vol. 32, pp. 361-378, 2017. Article (CrossRefLink)   DOI
32 F. Chen and M. Jahanshahi, "NB-CNN: Deep Learning-based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion," IEEE Transactions on Industrial Electronics, vol. 65, pp. 4392-4400, 2018.   DOI
33 O. Oktay, J. Schlemper, L. Folgoc , M. Lee, M. Heinrich, K. Misawa, K. Mori, S. McDonagh, N. Y Hammerla, B. Kainz, B. Glocker, and D. Rueckert, "Attention U-Net: Learning Where to Look for the Pancreas," Medical Imaging with Deep Learning, 2018.