Browse > Article
http://dx.doi.org/10.7236/IJIBC.2022.14.2.136

Steel Surface Defect Detection using the RetinaNet Detection Model  

Sharma, Mansi (Department of Computer Engineering, Kongju National University)
Lim, Jong-Tae (Department of Artificial Intelligence, Kongju National University)
Chae, Yi-Geun (Department of Computer Engineering, Kongju National University)
Publication Information
International Journal of Internet, Broadcasting and Communication / v.14, no.2, 2022 , pp. 136-146 More about this Journal
Abstract
Some surface defects make the weak quality of steel materials. To limit these defects, we advocate a one-stage detector model RetinaNet among diverse detection algorithms in deep learning. There are several backbones in the RetinaNet model. We acknowledged two backbones, which are ResNet50 and VGG19. To validate our model, we compared and analyzed several traditional models, one-stage models like YOLO and SSD models and two-stage models like Faster-RCNN, EDDN, and Xception models, with simulations based on steel individual classes. We also performed the correlation of the time factor between one-stage and two-stage models. Comparative analysis shows that the proposed model achieves excellent results on the dataset of the Northeastern University surface defect detection dataset. We would like to work on different backbones to check the efficiency of the model for real world, increasing the datasets through augmentation and focus on improving our limitation.
Keywords
Defect Detection; Deep Learning; Steel Defect Detection; RetinaNet model; One-Stage Detector;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. Iivarinen, "Surface defect detection with histogram-based texture features," Proceedings SPIE 4197, Intelligent Robots and Computer Vision XIX: Algorithms, Techniques, and Active Vision, pp. 140-145, Oct. 11, 2000, DOI: https://doi.org/10.1117/12.403757.   DOI
2 H. F. Ng, "Automatic thresholding for defect detection," Pattern Recognition Letters, Vol. 27, No. 14, pp. 1644-1649, Oct. 2006, DOI: https://doi.org/10.1016/j.patrec.2006.03.009.   DOI
3 V. F. Fadli and I. O. Herlistiono, "Steel Surface Defect Detection using Deep Learning," International Journal of Innovative Science and Research Technology, Vol. 5, No. 7, pp. 244-250, Jul. 2020, DOI: https://doi.org/10.38124/IJISRT20JUL240.   DOI
4 C. Tastimur, H. Yetis, M. Karakos, and E. Akin, "Rail defect detection and classification with real time image processing technique," International Journal of Computer Science and Software Engineering, Vol. 15, No. 12, pp. 283-290, Dec 2016.
5 V. A. Sindagi and S. Srivastava, "OLED panel defect detection using local inlier-outlier ratios and modified LBP," 2015 14th IAPR International Conference on Machine Vision Applications (MVA), pp. 214-217, May 18-22, 2015, DOI: https://doi.org/10.1109/MVA.2015.7153170.   DOI
6 J.P. Yun, S.J. Koo, G. Shin, C. Park, "Automatic defect inspection system for steel products with exhaustive dynamic encoding algorithm for searches," Optical Engineering, Vol. 58, No. 2, Feb 2019, DOI: https://doi.org/10.1117/1.OE.58.2.023107.   DOI
7 M. Win, A. R. Bushroa, M. A. Hassan, N. M. Hilman, and A. Ide-Ektessabi, "A Contrast Adjustment Thresholding Method for Surface Defect Detection Based on Mesoscopy," IEEE Transactions on Industrial Informatics, Vol. 11, No. 3, pp. 642-649, Jun. 2015, DOI: https://doi.org/10.1109/TII.2015.2417676.   DOI
8 K. Song and Y. Yan, "A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects," Applied Surface Science, Vol. 285, pp. 858-864, Nov. 2013, DOI: https://doi.org/10.1016/j.apsusc.2013.09.002.   DOI
9 L. Zhang, "Fabric Defect Classification Based on LBP and GLCM," Journal of Fiber Bioengineering and Informatics, Vol. 8, No. 1, pp. 81-89, Jun. 2015, DOI: https://doi.org/10.3993/jfbi03201508.   DOI
10 M. Aminzadeh and T. Kurfess, "Automatic thresholding for defect detection by background histogram mode extents," Journal of Manufacturing Systems., Vol. 37, pp. 83-92, Oct. 2015, DOI: https://doi.org/10.1016/j.jmsy.2015.09.004.   DOI
11 T. Maenpaa and M. Pietikainen, "Texture Analysis with Local Binary Patterns," Handbook of Pattern Recognition and Computer Vision, World Scientific, 2005, pp. 197-216. DOI: https://doi.org/10.1142/9789812775320_0011.   DOI
12 X. Bai, Y. Fang, W. Lin, L. Wang, and B.-F. Ju, "Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum," IEEE Transactions on Industrial Informatics, Vol. 10, No. 4, pp. 2135-2145, Nov. 2014, DOI: https://doi.org/10.1109/TII.2014.2359416.   DOI
13 K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," In Proceedings of the IEEE conference on computer vision and pattern recognition(CVPR), Jun. 2016, pp. 770-778. DOI: https://doi.org/10.1109/CVPR.2016.90.   DOI
14 G.H. Hu, "Automated defect detection in textured surfaces using optimal elliptical Gabor filters," Optik, Vol. 126, No. 14, pp. 1331-1340, Jul. 2015, DOI: https://doi.org/10.1016/j.ijleo.2015.04.017.   DOI
15 R. Borwankar and R. Ludwig, "An Optical Surface Inspection and Automatic Classification Technique Using the Rotated Wavelet Transform," IEEE Transactions on Instrumentation and Measurement, Vol. 67, No. 3, pp. 690-697, Mar. 2018, DOI: https://doi.org/10.1109/TIM.2017.2783098.   DOI
16 B.B. Mandelbrot, "The Fractal Geometry of Nature," WH Freeman: New York, NY, USA, Vol. 173, 1983.
17 D. Shumin, L. Zhoufeng, and L. Chunlei, "AdaBoost learning for fabric defect detection based on HOG and SVM," 2011 International Conference on Multimedia Technology, pp. 2903-2906, Jul. 26-28, 2011, DOI: https://doi.org/10.1109/ICMT.2011.6001937.   DOI
18 S. H. Hajimowlana, R. Muscedere, G. A. Jullien, and J. W. Roberts, "1D autoregressive modeling for defect detection in web inspection systems," 1998 Midwest Symposium on Circuits and Systems, IEEE Comput. Soc., pp. 318-321, DOI: https://doi.org/10.1109/MWSCAS.1998.759496.   DOI
19 K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," arXiv preprint, Vol. 6, Sep. 2014, DOI: https://arXiv.org/1409.1556
20 Y. He, K. Song, Q. Meng, and Y. Yan, "An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features," IEEE Transactions on Instrumentation and Measurement, Vol. 69, No. 4, pp. 1493-1504, Apr. 2020, DOI: https://doi.org/10.1109/TIM.2019.2915404.   DOI
21 J. Redmon and A. Farhadi, "YOLO9000: Better, Faster, Stronger," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Jul. 2017, pp. 6517-6525, DOI: https://doi.org/10.1109/CVPR.2017.690.   DOI
22 D. He, K. Xu, and P. Zhou, "Defect detection of hot rolled steels with a new object detection framework called classification priority network," Computers & Industrial Engineering., Vol. 128, pp. 290-297, Feb. 2019, DOI: https://doi.org/10.1016/j.cie.2018.12.043.   DOI
23 T. Konrad, L. Lohmann, and D. Abel, "Surface Defect Detection for Automated Inspection Systems using Convolutional Neural Networks," 2019 27th Mediterranean Conference on Control and Automation, Jul. 2019, pp. 75-80, DOI:https://doi.org/10.1109/MED.2019.8798497.   DOI
24 K. Li, X. Wang, and L. Ji, "Application of Multi-Scale Feature Fusion and Deep Learning in Detection of Steel Strip Surface Defect," 2019 International Conference on Artificial Intelligence and Advanced Manufacturing, IEEE, Oct. 2019, pp. 656-661, DOI: https://doi.org/10.1109/AIAM48774.2019.00136.   DOI
25 J. Redmon and A. Farhadi, "YOLOv3: An Incremental Improvement," arXiv preprint. Apr 8, 2018, DOI: https://arXiv.org/1804.02767.
26 T. Y. Lin, P. Dollar, R. Girshick, K. He, B. Hariharan, and S. Belongie, "Feature Pyramid Networks for Object Detection," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jul. 2017, pp. 936-944, 2017, DOI: https://doi.org/10.1109/CVPR.2017.106.   DOI
27 X. Lv, F. Duan, J. Jiang, X. Fu, and L. Gan, "Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network," Sensors, Vol. 20, No. 6, p. 1562, Mar. 2020, DOI: https://doi.org/10.3390/s20061562.   DOI
28 J. A. Tsanakas, D. Chrysostomou, P. N. Botsaris, and A. Gasteratos, "Fault diagnosis of photovoltaic modules through image processing and Canny edge detection on field thermographic measurements," International Journal of Sustainable Energy, Vol. 34, No.6, pp.351-372, June 2015, DOI: https://doi.org/10.1080/14786451.2013.826223.   DOI
29 C. H. Chan and G. K. H. Pang, "Fabric defect detection by Fourier analysis," IEEE Transactions on Industry Applications, Vol. 36, No. 5, pp. 1267-1276, 2000, DOI: https://doi.org/10.1109/28.871274.   DOI
30 R. Kindermann "Markov Random Fields and Their Applications," American Mathematical Society, 1980, DOI: https://doi.org/10.1090/conm/001.   DOI
31 V. Asha, N. U. Bhajantri, and P. Nagabhushan, "GLCM-based chi-square histogram distance for automatic detection of defects on patterned textures," International Journal of Computational Vision and Robotics, Vol. 2, No. 4, pp 302-313, Dec. 2012, DOI: https://doi.org/10.1504/IJCVR.2011.045267.   DOI
32 T. Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollar, "Focal Loss for Dense Object Detection," IEEE Trans., Proceedings of the IEEE International Conference on Computer Vision (ICCV), Vol. 42, No. 2, pp. 318-327, Feb. 2020, DOI: https://doi.org/10.1109/TPAMI.2018.2858826.   DOI
33 J. Chen and A. K. Jain, "A Structural Approach to Identify Defects in Textured Images," Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics, Vol. 1, pp. 29-32. DOI: https://doi.org/ICSMC.1988.754234.
34 K. L. Mak, P. Peng, and K. F. C. Yiu, "Fabric defect detection using morphological filters," Image and Vision Computing, Vol. 27, No. 10, pp. 1585-1592, Sep. 2009, DOI: https://doi.org/10.1016/j.imavis.2009.03.007.   DOI
35 S. J. Kim, "Medical Image Enhancement Using an Adaptive Weight and Threshold Values," The Journal of The Institute of Internet, Broadcasting and Communication, Vol. 12, No. 5, pp. 205-211, Oct. 2012, DOI: https://doi.org/10.7236/JIWIT.2012.12.5.205.   DOI
36 A. Chondronasios, I. Popov, and I. Jordanov, "Feature selection for surface defect classification of extruded aluminum profiles," The International Journal of Advanced Manufacturing Technology, Vol. 83, No. 1-4, pp. 33-41, Mar. 2016, DOI: https://doi.org/10.1007/s00170-015-7514-3.   DOI
37 W. Liu et al., "SSD: Single Shot MultiBox Detector," Computer Vision - European Conference on Computer Vision (ECCV) 2016, pp. 21-37, 2016, DOI: https://doi.org/10.1007/978-3-319-46448-02.   DOI
38 J. L. Raheja, S. Kumar, and A. Chaudhary, "Fabric defect detection based on GLCM and Gabor filter: A comparison," Optik, Vol. 124, No. 23, pp. 6469-6474, Dec. 2013, DOI: https://doi.org/10.1016/j.ijleo.2013.05.004.   DOI
39 J. Iivarinen, J. Rauhamaa, and A. Visa, "Unsupervised segmentation of surface defects," Proceedings of 13th International Conference on Pattern Recognition, 1996, pp. 356-360, Vol.4, DOI: https://doi.org/10.1109/ICPR.1996.547445.   DOI
40 P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, "OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks," Vol. 4, Dec 2013. DOI: https://arXiv.org/1312.6229
41 S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence., Vol. 39, No. 6, pp. 1137-1149, Jun. 2017, DOI: https://doi.org/10.1109/TPAMI.2016.2577031.   DOI
42 J. Dai, Y. Li, K. He, and J. Sun, "R-FCN: Object Detection via Region-based Fully Convolutional Networks," 30th Conference on Neural Information Processing Systems (NIPS), May 2016.
43 D. M. Tsai and C. Y. Hsieh, "Automated surface inspection for directional textures," Image and Vision Computing, Vol. 18, No. 1, pp. 49-62, Dec. 1999, DOI: https://doi.org/10.1016/S0262-8856(99)00009-8.   DOI