Browse > Article
http://dx.doi.org/10.3837/tiis.2020.03.010

Oil Pipeline Weld Defect Identification System Based on Convolutional Neural Network  

Shang, Jiaze (School of computer science and technology, Henan Polytechnic University)
An, Weipeng (School of computer science and technology, Henan Polytechnic University)
Liu, Yu (School of computer science and technology, Henan Polytechnic University)
Han, Bang (School of computer science and technology, Henan Polytechnic University)
Guo, Yaodan (School of computer science and technology, Henan Polytechnic University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.3, 2020 , pp. 1086-1103 More about this Journal
Abstract
The automatic identification and classification of image-based weld defects is a difficult task due to the complex texture of the X-ray images of the weld defect. Several depth learning methods for automatically identifying welds were proposed and tested. In this work, four different depth convolutional neural networks were evaluated and compared on the 1631 image set. The concavity, undercut, bar defects, circular defects, unfused defects and incomplete penetration in the weld image 6 different types of defects are classified. Another contribution of this paper is to train a CNN model "RayNet" for the dataset from scratch. In the experiment part, the parameters of convolution operation are compared and analyzed, in which the experimental part performs a comparative analysis of various parameters in the convolution operation, compares the size of the input image, gives the classification results for each defect, and finally shows the partial feature map during feature extraction with the classification accuracy reaching 96.5%, which is 6.6% higher than the classification accuracy of other existing fine-tuned models, and even improves the classification accuracy compared with the traditional image processing methods, and also proves that the model trained from scratch also has a good performance on small-scale data sets. Our proposed method can assist the evaluators in classifying pipeline welding defects.
Keywords
pipeline x-ray welding image; automatic identification; feature extraction; convolution neural network; convolution operation;
Citations & Related Records
Times Cited By KSCI : 6  (Citation Analysis)
연도 인용수 순위
1 Nasr-Esfahani, E., Samavi, S., Karimi, N., Soroushmehr, S.M., Ward, K., Jafari, M.H., Felfeliyan, B., Nallamothu, B., Najarian, K., "Vessel extraction in X-ray angiograms using deep learning," in Proc. of 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 643-646, 2016.
2 Y. Crutzen, R. Boman, L. Papeleux and J. P. Ponthot, "Continuous roll forming including in-line welding and post-cut within an ALE formalism," Finite Elements in Analysis & Design, 143, 11-31, 2018.   DOI
3 J. Shao, D. Dong, B. Chang and S. Han, "Automatic weld defect detection based on potential defect tracking in real-time radiographic image sequence," NDT&E INT, 46, 14-21, 2012.   DOI
4 G. Rooh, A. Khan, H. J. Kim, H. Park and S. Kim, "TlSr 2 Br 5: New intrinsic scintillator for X-ray and ${\gamma}$-ray detection," OPT MATER, 73, 523-526, 2017.   DOI
5 T. Liu, J. Bao, J. Wang and Y. Zhang, "A Hybrid CNN-LSTM Algorithm for Online Defect Recognition of CO2 Welding," SENSORS-BASEL, 18(12), 4369, 2018.   DOI
6 C. C. Huang and H. N. Manh, "X-Ray Enhancement Based on Component Attenuation, Contrast Adjustment, and Image Fusion," IEEE T IMAGE PROCESS, 1, 2018.
7 Hu, Y., Soltoggio, A., Lock, R., Carter, S., "A Fully Convolutional Two-Stream Fusion Network for Interactive Image Segmentation," NEURAL NETWORKS, 2018.
8 J. Fan and J. Wang, "A Two-phase Fuzzy Clustering Algorithm Based on Neurodynamic Optimization with Its Application for PolSAR Image Segmentation," IEEE T FUZZY SYST, 26(1), 72-83, 2018.   DOI
9 J. Miao, T. Huang, X. Zhou, Y. Wang and J. Liu, "Image segmentation based on an active contour model of partial image restoration with local cosine fitting energy," INFORM SCIENCES, 447, 52-71, 2018.   DOI
10 Y. Li, G. Cao, Q. Yu and X. Li, "Active contours driven by non-local Gaussian distribution fitting energy for image segmentation," APPL INTELL, 48(12), 4855-4870, 2018.   DOI
11 Ali, H., Rada, L., Badshah, N., "Image Segmentation for Intensity Inhomogeneity in Presence of High Noise," IEEE Transactions on Image Processing, 27(8), 3729-3738, 2018.   DOI
12 Zhou, X., Gao, X., Wang, J., Yu, H., Wang, Z., Chi, Z., "Eye Tracking Data Guided Feature Selection for Image Classification," PATTERN RECOGN, 63, 56-70, 2017.   DOI
13 Nizami, I.F., Majid, M., Khurshid, K., "New feature selection algorithms for no-reference image quality assessment," APPL INTELL, 48, 3482-3501, 2018.   DOI
14 Spampinato, C., Palazzo, S., Giordano, D., Aldinucci, M., Leonardi, R., "Deep Learning for Automated Skeletal Bone Age Assessment in X-Ray Images," MED IMAGE ANAL, 36, 41-51, 2017.   DOI
15 Zhou, W., Lu, Y., Qiu, W., Yang, Z., Wu, M., "Local gradient patterns (LGP): An effective local-statistical-feature extraction scheme for no-reference image quality assessment," INFORM SCIENCES, 397-398, 1-14, 2017.   DOI
16 Minkyu L, Donghyun L, Hosung P, "Convolutional Neural Network based Audio Event Classification," KSII Transactions on Internet and Information Systems, 12(6), 2748-2760, January 6-12, 2018.   DOI
17 Sheraz N, Yasir S, "Enhanced Network Intrusion Detection using Deep Convolutional Neural Networks," KSII Transactions on Internet and Information Systems, 12(6), 5159-5178, October 12-10, 2018.
18 Giseok C, Seungbin L, Jongho N, "CNN-based Visual/Auditory Feature Fusion Method with Frame Selection for Classifying Video Events," KSII Transactions on Internet and Information Systems, 13(3), 1689-1701, January 13-3, 2019.   DOI
19 Lecun, Y., Bottou, L., Bengio, Y., Haffner, P., "Gradient-based learning applied to document recognition," P IEEE, 86(11), 2278-2324, 1998.   DOI
20 T, L., W, S. Statistical approach to X-ray CT imaging and its applications in image analysis. II., "A new stochastic model-based image segmentation technique for X-ray CT image," IEEE T MED IMAGING, 11(1), 62-69, 1992.   DOI
21 Mahmoudi, A., Regragui, F., "Fast segmentation method for defects detection in radiographic images of welds," in Proc. of IEEE/ACS International Conference on Computer Systems & Applications, 2009 .
22 Guan, Q., Huang, Y., "Multi-label chest X-ray image classification via category-wise residual attention learning," PATTERN RECOGN LETT, 130, 259-266, 2020.   DOI
23 Malarvel, M., Sethumadhavan, G., Bhagi, P.C.R., Kar, S., Saravanan, T., Krishnan, A., "Anisotropic diffusion based denoising on X-radiography images to detect weld defects," DIGIT SIGNAL PROCESS, 68, 112-126, 2017.   DOI
24 Nacereddine, N., Goumeidane, A.B., Ziou, D., "Unsupervised weld defect classification in radiographic images using multivariate generalized Gaussian mixture model with exact computation of mean and shape parameters," COMPUT IND, 108, 132-149, 2019.   DOI
25 Shao, J., Dong, D., Chang, B., Han, S., "Automatic weld defect detection based on potential defect tracking in real-time radiographic image sequence," NDT&E INT, 46, 14-21, 2012.   DOI
26 Ciocca, G., Napoletano, P., Schettini, R., "Learning CNN-based Features for Retrieval of Food Images," in Proc. of International Conference on Image Analysis & Processing, 426-434, 2017.
27 Al-Antari, M.A., Al-Masni, M.A., Choi, M.T., Han, S.M., Kim, T.S., "A fully integrated computer-aided diagnosis system for digital X-ray mammograms via deep learning detection, segmentation, and classification," INT J MED INFORM, 117, 44-54, 2018.   DOI
28 Van Veenhuizen, M., "Void detection in solder bumps with deep learning," MICROELECTRON RELIAB, 88-90, 315-320, 2018.   DOI
29 Valavanis, I., Kosmopoulos, D., "Multiclass defect detection and classification in weld radiographic images using geometric and texture features," EXPERT SYST APPL, 37(12), 7606-7614, 2010.   DOI
30 Jiang, J., Zhen, Z., Qiao, D., Ni, F., "Characterization and identification of asphalt mixtures based on Convolutional Neural Network methods using X-ray scanning images," Construction & Building Materials, 174, 72-80, 2018.   DOI
31 Zapata, J., Vilar, R., Ruiz, R., "Performance evaluation of an automatic inspection system of weld defects in radiographic images based on neuro-classifiers," EXPERT SYST APPL, 38(7), 8812-8824, 2011.   DOI
32 Zou, Y., Dong, D., Chang, B., Ji, L., Pan, J., "Automatic weld defect detection method based on Kalman filtering for real-time radiographic inspection of spiral pipe," NDT&E INT, 72, 1-9, 2015.   DOI
33 Pranata, Y.D., Wang, K.C., Wang, J.C., Idram, I., Lai, J.Y., Liu, J.W., Hsieh, I.H., "Deep learning and SURF for automated classification and detection of calcaneus fractures in CT images," Comput Methods Programs Biomed, 171, 27-37, 2019.   DOI