International Journal of Internet, Broadcasting and Communication

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Steel Surface Defect Detection using the RetinaNet Detection Model

  • Sharma, Mansi (Department of Computer Engineering, Kongju National University) ;
  • Lim, Jong-Tae (Department of Artificial Intelligence, Kongju National University) ;
  • Chae, Yi-Geun (Department of Computer Engineering, Kongju National University)
  • Received : 2022.03.25
  • Accepted : 2022.04.02
  • Published : 2022.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Some surface defects make the weak quality of steel materials. To limit these defects, we advocate a one-stage detector model RetinaNet among diverse detection algorithms in deep learning. There are several backbones in the RetinaNet model. We acknowledged two backbones, which are ResNet50 and VGG19. To validate our model, we compared and analyzed several traditional models, one-stage models like YOLO and SSD models and two-stage models like Faster-RCNN, EDDN, and Xception models, with simulations based on steel individual classes. We also performed the correlation of the time factor between one-stage and two-stage models. Comparative analysis shows that the proposed model achieves excellent results on the dataset of the Northeastern University surface defect detection dataset. We would like to work on different backbones to check the efficiency of the model for real world, increasing the datasets through augmentation and focus on improving our limitation.

Keywords

References

  1. J. A. Tsanakas, D. Chrysostomou, P. N. Botsaris, and A. Gasteratos, "Fault diagnosis of photovoltaic modules through image processing and Canny edge detection on field thermographic measurements," International Journal of Sustainable Energy, Vol. 34, No.6, pp.351-372, June 2015, DOI: https://doi.org/10.1080/14786451.2013.826223.
  2. J. Chen and A. K. Jain, "A Structural Approach to Identify Defects in Textured Images," Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics, Vol. 1, pp. 29-32. DOI: https://doi.org/ICSMC.1988.754234.
  3. C. Tastimur, H. Yetis, M. Karakos, and E. Akin, "Rail defect detection and classification with real time image processing technique," International Journal of Computer Science and Software Engineering, Vol. 15, No. 12, pp. 283-290, Dec 2016.
  4. K. L. Mak, P. Peng, and K. F. C. Yiu, "Fabric defect detection using morphological filters," Image and Vision Computing, Vol. 27, No. 10, pp. 1585-1592, Sep. 2009, DOI: https://doi.org/10.1016/j.imavis.2009.03.007.
  5. J.P. Yun, S.J. Koo, G. Shin, C. Park, "Automatic defect inspection system for steel products with exhaustive dynamic encoding algorithm for searches," Optical Engineering, Vol. 58, No. 2, Feb 2019, DOI: https://doi.org/10.1117/1.OE.58.2.023107.
  6. M. Win, A. R. Bushroa, M. A. Hassan, N. M. Hilman, and A. Ide-Ektessabi, "A Contrast Adjustment Thresholding Method for Surface Defect Detection Based on Mesoscopy," IEEE Transactions on Industrial Informatics, Vol. 11, No. 3, pp. 642-649, Jun. 2015, DOI: https://doi.org/10.1109/TII.2015.2417676.
  7. A. Chondronasios, I. Popov, and I. Jordanov, "Feature selection for surface defect classification of extruded aluminum profiles," The International Journal of Advanced Manufacturing Technology, Vol. 83, No. 1-4, pp. 33-41, Mar. 2016, DOI: https://doi.org/10.1007/s00170-015-7514-3.
  8. V. Asha, N. U. Bhajantri, and P. Nagabhushan, "GLCM-based chi-square histogram distance for automatic detection of defects on patterned textures," International Journal of Computational Vision and Robotics, Vol. 2, No. 4, pp 302-313, Dec. 2012, DOI: https://doi.org/10.1504/IJCVR.2011.045267.
  9. J. Iivarinen, J. Rauhamaa, and A. Visa, "Unsupervised segmentation of surface defects," Proceedings of 13th International Conference on Pattern Recognition, 1996, pp. 356-360, Vol.4, DOI: https://doi.org/10.1109/ICPR.1996.547445.
  10. J. L. Raheja, S. Kumar, and A. Chaudhary, "Fabric defect detection based on GLCM and Gabor filter: A comparison," Optik, Vol. 124, No. 23, pp. 6469-6474, Dec. 2013, DOI: https://doi.org/10.1016/j.ijleo.2013.05.004.
  11. J. Iivarinen, "Surface defect detection with histogram-based texture features," Proceedings SPIE 4197, Intelligent Robots and Computer Vision XIX: Algorithms, Techniques, and Active Vision, pp. 140-145, Oct. 11, 2000, DOI: https://doi.org/10.1117/12.403757.
  12. D. Shumin, L. Zhoufeng, and L. Chunlei, "AdaBoost learning for fabric defect detection based on HOG and SVM," 2011 International Conference on Multimedia Technology, pp. 2903-2906, Jul. 26-28, 2011, DOI: https://doi.org/10.1109/ICMT.2011.6001937.
  13. H. F. Ng, "Automatic thresholding for defect detection," Pattern Recognition Letters, Vol. 27, No. 14, pp. 1644-1649, Oct. 2006, DOI: https://doi.org/10.1016/j.patrec.2006.03.009.
  14. M. Aminzadeh and T. Kurfess, "Automatic thresholding for defect detection by background histogram mode extents," Journal of Manufacturing Systems., Vol. 37, pp. 83-92, Oct. 2015, DOI: https://doi.org/10.1016/j.jmsy.2015.09.004.
  15. K. Song and Y. Yan, "A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects," Applied Surface Science, Vol. 285, pp. 858-864, Nov. 2013, DOI: https://doi.org/10.1016/j.apsusc.2013.09.002.
  16. L. Zhang, "Fabric Defect Classification Based on LBP and GLCM," Journal of Fiber Bioengineering and Informatics, Vol. 8, No. 1, pp. 81-89, Jun. 2015, DOI: https://doi.org/10.3993/jfbi03201508.
  17. T. Maenpaa and M. Pietikainen, "Texture Analysis with Local Binary Patterns," Handbook of Pattern Recognition and Computer Vision, World Scientific, 2005, pp. 197-216. DOI: https://doi.org/10.1142/9789812775320_0011.
  18. V. A. Sindagi and S. Srivastava, "OLED panel defect detection using local inlier-outlier ratios and modified LBP," 2015 14th IAPR International Conference on Machine Vision Applications (MVA), pp. 214-217, May 18-22, 2015, DOI: https://doi.org/10.1109/MVA.2015.7153170.
  19. X. Bai, Y. Fang, W. Lin, L. Wang, and B.-F. Ju, "Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum," IEEE Transactions on Industrial Informatics, Vol. 10, No. 4, pp. 2135-2145, Nov. 2014, DOI: https://doi.org/10.1109/TII.2014.2359416.
  20. D. M. Tsai and C. Y. Hsieh, "Automated surface inspection for directional textures," Image and Vision Computing, Vol. 18, No. 1, pp. 49-62, Dec. 1999, DOI: https://doi.org/10.1016/S0262-8856(99)00009-8.
  21. C. H. Chan and G. K. H. Pang, "Fabric defect detection by Fourier analysis," IEEE Transactions on Industry Applications, Vol. 36, No. 5, pp. 1267-1276, 2000, DOI: https://doi.org/10.1109/28.871274.
  22. G.H. Hu, "Automated defect detection in textured surfaces using optimal elliptical Gabor filters," Optik, Vol. 126, No. 14, pp. 1331-1340, Jul. 2015, DOI: https://doi.org/10.1016/j.ijleo.2015.04.017.
  23. R. Borwankar and R. Ludwig, "An Optical Surface Inspection and Automatic Classification Technique Using the Rotated Wavelet Transform," IEEE Transactions on Instrumentation and Measurement, Vol. 67, No. 3, pp. 690-697, Mar. 2018, DOI: https://doi.org/10.1109/TIM.2017.2783098.
  24. R. Kindermann "Markov Random Fields and Their Applications," American Mathematical Society, 1980, DOI: https://doi.org/10.1090/conm/001.
  25. B.B. Mandelbrot, "The Fractal Geometry of Nature," WH Freeman: New York, NY, USA, Vol. 173, 1983.
  26. S. H. Hajimowlana, R. Muscedere, G. A. Jullien, and J. W. Roberts, "1D autoregressive modeling for defect detection in web inspection systems," 1998 Midwest Symposium on Circuits and Systems, IEEE Comput. Soc., pp. 318-321, DOI: https://doi.org/10.1109/MWSCAS.1998.759496.
  27. X. Lv, F. Duan, J. Jiang, X. Fu, and L. Gan, "Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network," Sensors, Vol. 20, No. 6, p. 1562, Mar. 2020, DOI: https://doi.org/10.3390/s20061562.
  28. V. F. Fadli and I. O. Herlistiono, "Steel Surface Defect Detection using Deep Learning," International Journal of Innovative Science and Research Technology, Vol. 5, No. 7, pp. 244-250, Jul. 2020, DOI: https://doi.org/10.38124/IJISRT20JUL240.
  29. K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," arXiv preprint, Vol. 6, Sep. 2014, DOI: https://arXiv.org/1409.1556
  30. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, "OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks," Vol. 4, Dec 2013. DOI: https://arXiv.org/1312.6229
  31. K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," In Proceedings of the IEEE conference on computer vision and pattern recognition(CVPR), Jun. 2016, pp. 770-778. DOI: https://doi.org/10.1109/CVPR.2016.90.
  32. D. He, K. Xu, and P. Zhou, "Defect detection of hot rolled steels with a new object detection framework called classification priority network," Computers & Industrial Engineering., Vol. 128, pp. 290-297, Feb. 2019, DOI: https://doi.org/10.1016/j.cie.2018.12.043.
  33. Y. He, K. Song, Q. Meng, and Y. Yan, "An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features," IEEE Transactions on Instrumentation and Measurement, Vol. 69, No. 4, pp. 1493-1504, Apr. 2020, DOI: https://doi.org/10.1109/TIM.2019.2915404.
  34. T. Konrad, L. Lohmann, and D. Abel, "Surface Defect Detection for Automated Inspection Systems using Convolutional Neural Networks," 2019 27th Mediterranean Conference on Control and Automation, Jul. 2019, pp. 75-80, DOI:https://doi.org/10.1109/MED.2019.8798497.
  35. K. Li, X. Wang, and L. Ji, "Application of Multi-Scale Feature Fusion and Deep Learning in Detection of Steel Strip Surface Defect," 2019 International Conference on Artificial Intelligence and Advanced Manufacturing, IEEE, Oct. 2019, pp. 656-661, DOI: https://doi.org/10.1109/AIAM48774.2019.00136.
  36. W. Liu et al., "SSD: Single Shot MultiBox Detector," Computer Vision - European Conference on Computer Vision (ECCV) 2016, pp. 21-37, 2016, DOI: https://doi.org/10.1007/978-3-319-46448-02.
  37. J. Redmon and A. Farhadi, "YOLO9000: Better, Faster, Stronger," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Jul. 2017, pp. 6517-6525, DOI: https://doi.org/10.1109/CVPR.2017.690.
  38. J. Redmon and A. Farhadi, "YOLOv3: An Incremental Improvement," arXiv preprint. Apr 8, 2018, DOI: https://arXiv.org/1804.02767.
  39. S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence., Vol. 39, No. 6, pp. 1137-1149, Jun. 2017, DOI: https://doi.org/10.1109/TPAMI.2016.2577031.
  40. T. Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollar, "Focal Loss for Dense Object Detection," IEEE Trans., Proceedings of the IEEE International Conference on Computer Vision (ICCV), Vol. 42, No. 2, pp. 318-327, Feb. 2020, DOI: https://doi.org/10.1109/TPAMI.2018.2858826.
  41. T. Y. Lin, P. Dollar, R. Girshick, K. He, B. Hariharan, and S. Belongie, "Feature Pyramid Networks for Object Detection," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jul. 2017, pp. 936-944, 2017, DOI: https://doi.org/10.1109/CVPR.2017.106.
  42. J. Dai, Y. Li, K. He, and J. Sun, "R-FCN: Object Detection via Region-based Fully Convolutional Networks," 30th Conference on Neural Information Processing Systems (NIPS), May 2016.
  43. S. J. Kim, "Medical Image Enhancement Using an Adaptive Weight and Threshold Values," The Journal of The Institute of Internet, Broadcasting and Communication, Vol. 12, No. 5, pp. 205-211, Oct. 2012, DOI: https://doi.org/10.7236/JIWIT.2012.12.5.205.