Journal of KIBIM (한국BIM학회 논문집)

Korean Institute of Building Information Modeling (한국BIM학회)
권호 표지
DOI QR코드

DOI QR Code

Artificial Intelligence Image Segmentation for Extracting Construction Formwork Elements

거푸집 부재 인식을 위한 인공지능 이미지 분할

  • Received : 2022.02.10
  • Accepted : 2022.03.30
  • Published : 2022.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Concrete formwork is a crucial component for any construction project. Artificial intelligence offers great potential to automate formwork design by offering various design options and under different criteria depending on the requirements. This study applied image segmentation in 2D formwork drawings to extract sheathing, strut and pipe support formwork elements. The proposed artificial intelligence model can recognize, classify, and extract formwork elements from 2D CAD drawing image and training and test results confirmed the model performed very well at formwork element recognition with average precision and recall better than 80%. Recognition systems for each formwork element can be implemented later to generate 3D BIM models.

Keywords

Acknowledgement

This work was supported by a 2-Year Research Grant of Pusan National University.

References

  1. Ahn, J., Kwak, S. (2018). "Learning pixel-level semantic affinity with image-level supervision for weakly supervised semantic segmentation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18-22 June, pp. 4981-4990.
  2. Badrinarayanan, V., Kendall, A., Cipolla, R. (2017). "Segnet: A deep convolutional encoder-decoder architecture for image segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), pp. 2481-2495. https://doi.org/10.1109/TPAMI.2016.2644615
  3. Bhavsar, K., Jani K., Vanzara, R. (2020). "Indian currency recognition from live video using deep learning". In Chaubey N., Parikh S., Amin K. (eds) Computing Science, Communication and Security. COMS2 2020, Communications in Computer and Information Science, 1235, Springer, Singapore, pp. 70-81.
  4. Dai, J., Li, Y., He, K., Sun, J. (2016). "R-FCN: Object detection via region-based fully convolutional networks", Advances in Neural Information Processing Systems 29 (NIPS 2016), pp. 379-387.
  5. Girshick, R., Donahue, J., Darrell, T., Malik, J. (2014). "Rich feature hierarchies for accurate object detection and semantic segmentation", Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 23-28 June, pp. 580-587.
  6. Habibi, H., Heravi, E. J. (2017). "Guide to convolutional neural networks: A practical application to traffic sign detection and classification, Springer International Publishing AG, Switzerland, pp. 63.
  7. He, K., Gkioxari, G., Dollar, P., Girshick, R. (2018). "Mask R-CNN", IEEE transactions on pattern analysis and machine intelligence, 42 (2), pp. 386-397. https://doi.org/10.1109/tpami.2018.2844175
  8. He, K., Gkioxari, G., Dollar, P., Girshick, R. (2017). "Mask R-CNN", In Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22-29 October, pp. 2980-2988.
  9. He, K., Zhang, X., Ren, S., Sun, J. (2016). "Deep residual learning for image recognition", Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June, pp. 770-778.
  10. Horna, S., Meneveaux, D., Damiand, G., Bertrand, Y. (2009). "Consistency constraints and 3D building reconstruction", Computer-Aided Design, 41 (1), pp. 13-27 2009. https://doi.org/10.1016/j.cad.2008.11.006
  11. Ker, J., Wang, L., Rao, J., Lim, T. (2017). "Deep learning applications in medical image analysis", IEEE Access, 6, pp. 9375-9379. https://doi.org/10.1109/access.2017.2788044
  12. Kim, B., Cho. S. (2020). "Automated multiple concrete damage detection using instance segmentation deep learning model", Appl. Sci., 10 (22), pp. 8008. https://doi.org/10.3390/app10228008
  13. Lee, B., Choi, H., Min, B., Lee, D.-E. (2020). "Applicability of formwork automation design software for aluminium formwork", Applied Sciences, 10 (24), pp. 9029. https://doi.org/10.3390/app10249029
  14. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., Belongie, S. (2017). "Feature pyramid networks for object detection", Proceedings of the IEEE conference on computer vision and pattern recognition, 21-26 July, Honolulu, HI, USA, pp. 2117-2125.
  15. Li, Y., Xu, W., Chen, H., Jiang, J., Li, X. (2021). "A novel f ramewo rk based on Mask R-CNN and histog ram thresholding for scalable segmentation of new and old rural buildings", Remote Sens, 13 (6), pp. 1070. https://doi.org/10.3390/rs13061070
  16. Long, J., Shelhamer, E., Darrell, T. (2015). "Fully convolutional networks for semantic segmentation." In: S. Lakusic, Ed. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 8-10 June, New Jersey, USA: Institute of Electrical and Electronics Engineers, pp. 3431-3440.
  17. Moon, S., Cowdhury, A. M. (2021). "Utilization of prior information in neural network training for improving 28-day concrete strength prediction", Journal of Construction Engineering and Management, 147 (5), pp. 04021028. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002047
  18. Rawat, W., Wang, Z. (2017). "Deep convolutional neural networks for image classification: A comprehensive review", Neural Computation, 29 (9), pp. 62352-2449.
  19. Ren, S., He, K., Girshick, R., Sun, J. (2017). "Faster R-CNN: Towards real-time object detection with region proposal networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, pp.1137-1149. https://doi.org/10.1109/TPAMI.2016.2577031
  20. Sahu, S., Sarma, S., Bora, D. J. (2018). "Image segmentation and its different techniques: An in-depth analysis", Proceedings of the 3rd IEEE International Conference on Research in Intelligent and Computing in Engineering, RICE 2018, 22-24 August, Ciudadela Don Bosco, San Salvador, El Salvador, pp. 1-7.
  21. Seo, J., Park, H., Choo S. (2020). "Inference of drawing elements and space usage on architectural drawings using semantic segmentation", Applied Science, 10 (20), pp. 7347. https://doi.org/10.3390/app10207347
  22. Sigalov, K., Konig, M. (2017). "Recognition of process patterns for BIM-based construction schedules", Advanced Engineering Informatics, 33, pp. 456-472. https://doi.org/10.1016/j.aei.2016.12.003
  23. Wang, N., Zhao, X., Zou, Z., Zhao, P., Qi, F. (2020). "Autonomous damage segmentation and measurement of glazed tiles in historic buildings via deep learning", Computer-Aided Civil and Infrastructure Engineering, 35 (3), pp. 277-291. https://doi.org/10.1111/mice.12488
  24. Xiao, Y., Chen, S., Ikeda, Y., Hotta, K. (2020). "Automatic recognition and segmentation of architectural elements from 2D drawings by convolutional neural network", Proceedings of The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA), pp. 843-852.
  25. Ying. H., Lee, S. (2019). "A Mask R-CNN based approach to automatically construct as-is IFC BIM objects from digital images," ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, 36. IAARC Publications, Banff, Canada, pp. 764-771.
  26. Zhang, Z., Pan, W., Zheng, Z. J. (2019). "Transfer learning enabled process recognition for module installation of high-rise modular buildings", Proceedings of the 2019 Modular and Offsite Construction (MOC) Summit, 21-24 May, Banff, Alberta, Canada, pp. 268-275.
  27. Zhao, Y., Deng, X., Lai, H. (2020). "A deep learning-based method to detect components from scanned structural drawings for reconstructing 3D models", Applied Science, 10 (6), pp. 2066. https://doi.org/10.3390/app10062066
  28. V. Badrinarayanan, A. Kendall, R. Cipolla, "Segnet: A deep convolutional encoder-decoder architecture for image segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 12, pp. 2481-2495, 2017. https://doi.org/10.1109/TPAMI.2016.2644615
  29. K. Bhavsar, K. Jani, R. Vanzara, "Indian currency recognition from live video using deep learning". In Chaubey N., Parikh S., Amin K. (eds) Computing Science, Communication and Security. COMS2 2020, Communications in Computer and Information Science, 1235, Springer, Singapore, pp. 70-81, 2020.