Browse > Article
http://dx.doi.org/10.7474/TUS.2021.31.5.374

Automatic Fracture Detection in CT Scan Images of Rocks Using Modified Faster R-CNN Deep-Learning Algorithm with Rotated Bounding Box  

Pham, Chuyen (Dept. of Geo-Space Engineering, University of Science and Technology (UST))
Zhuang, Li (Dept. of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology (KICT))
Yeom, Sun (Dept. of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology (KICT))
Shin, Hyu-Soung (Dept. of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology (KICT))
Publication Information
Tunnel and Underground Space / v.31, no.5, 2021 , pp. 374-384 More about this Journal
Abstract
In this study, we propose a new approach for automatic fracture detection in CT scan images of rock specimens. This approach is built on top of two-stage object detection deep learning algorithm called Faster R-CNN with a major modification of using rotated bounding box. The use of rotated bounding box plays a key role in the future work to overcome several inherent difficulties of fracture segmentation relating to the heterogeneity of uninterested background (i.e., minerals) and the variation in size and shape of fracture. Comparing to the commonly used bounding box (i.e., axis-align bounding box), rotated bounding box shows a greater adaptability to fit with the elongated shape of fracture, such that minimizing the ratio of background within the bounding box. Besides, an additional benefit of rotated bounding box is that it can provide relative information on the orientation and length of fracture without the further segmentation and measurement step. To validate the applicability of the proposed approach, we train and test our approach with a number of CT image sets of fractured granite specimens with highly heterogeneous background and other rocks such as sandstone and shale. The result demonstrates that our approach can lead to the encouraging results on fracture detection with the mean average precision (mAP) up to 0.89 and also outperform the conventional approach in terms of background-to-object ratio within the bounding box.
Keywords
Fracture detection; Computed tomography; Deep learning; Faster R-CNN; Rotated bounding box;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Wennberg, O. P., Rennan, L., and Basquet, R. (2009), "Computed tomography scan imaging of natural open fractures in a porous rock; geometry and fluid flow", Geophys. Prospect 57, pp. 239-249.   DOI
2 Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., HaIp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Mane, D., Monga, R, Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K., Tucker, P., Vanhoucke, V., Vasudevan, V., Viegas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y., & Zheng, X. (2015), "TensorFlow: Large-scale machine learning on heterogeneous systems", Software available from http://tensorflow.org/.
3 Andra, H., Combaret, N., Dvorkin, J., Glatt, E., Han, J., Kabel, M., Keehm, Y., Krzikalla, F., Lee M., and Madonna, C. (2013), "Digital rock physics benchmarks-Part I: Imaging and segmentation", Comput Geosci. 50, pp. 25-32.   DOI
4 Girshick, R (2015), Fast R-CNN. In: ICCV.
5 He, K., Gkioxari, G., Dollar, P., Girshick, R B. (2017), "Mask R-CNN", CoRR abs/1703.06870 (2017). arXiv:1703.06870 http://arxiv.org/abs/1703.06870
6 He, K., Zhang, X., Ren, S., and Sun, J. (2015), "Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification", In: Proceedings of the IEEE international conference on computer vision, IEEE, NY, USA, pp. 1026-1034.
7 Kyle, J. R, and Ketcham, R. A. (2015), "Application of high resolution X-ray computed tomography to mineral deposit origin, evaluation, and processing", Ore Geol. Rev. 65, pp. 821-839.   DOI
8 Lin, T., Dollar, P., Girshick, R.B., He, K., Hariharan, B., Belongie, S. J. (2017), "Feature pyramid networks for object detection", CVPR.
9 Voorn, M., Exner, U., and Rath, A. (2013), "Multiscale Hessian fracture filtering for the enhancement and segmentation of narrow fractures in 3D image data", Comput. Geosci. 57, pp. 44-53.   DOI
10 Kling, T., Huo, D., Schwarz, J.O., Enzmann, F., Benson, S., Blum, P. (2016), "Simulating stress-dependent fluid flow in a fracturedcore sample using real-time X-ray CT data", Solid Earth, 7, pp. 1109-1124.   DOI
11 Schmitt, M., Halisch, M., Muller, C., and Fernandes, C. P. (2016), "Classification and quantification of pore shapes in sandstone reservoir rocks with 3-D X-ray microcomputed tomography", Solid Earth. 7, pp. 285-300.   DOI
12 Yen, J.Y., 1970. An algorithm for finding shortest routes from all source nodes to a given destination in general networks. Quarterly of Applied Mathematics. 27 (4), 526-530. doi:10.1090/qam/253822.   DOI
13 Ketcham, R. A., and CarIson, W. D. (2001), "Acquisition, optimization and interpretation of X-ray computed tomographic imagery: applications to the geosciences", Comput. Geosci. Geosc. 27, pp. 381-400.   DOI
14 Lin, T., Maire, M, Belongie, S. J., Hays, J., Perona, P., Ramanan, D., Dollar, P., Zitnick C. L. (2014), "Microsoft COCO: common objects in context", in Computer Vision - ECCV 2014 - 13th European Conference, Zurich,Switzerland, September 6-12, 2014, Proceedings, Part V, ser. LectureNotes in Computer Science, vol. 8693. Springer, pp. 740-755.
15 Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu C-Y. (2016), "SSD: Single Shot MultiBox Detector", ArXiv151202325 Cs. 2016; 9905:21-37.
16 Otsu, N., 1979. A threshold selection method from gray-level histograms. IEEE Trans. Sys. Man. Cyber. 9 (1), 62-66. doi: 10.1109/TSMC.1979.4310076.   DOI
17 Redmon, J., DivvaIa, S., Girshick, R, Farhadi, A. (2016), "You only look once: Unified, real-time object detection", in IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
18 Ronneberger, P. Fischer, Brox, T. (2015), "U-Net: Convolutional Networks for Biomedical Image Segmentation", MICCAI, Springer, LNCS, 9351, pp. 234-241.
19 Vu, T. X., Jang, H., Pharo, T. X., and Yoo, C. D. (2019), "Cascade RPN: Delving into high-quality region proposal network with adaptive convolution", in Proc. NIPS, pp. 1-11.
20 Crandall D, Moore J, Gill M, Stadelman M. (2017), "CT scanning and flow measurements of shale fractures after multiple shearing events", Int J Rock Mech Min Sci. 100, pp.177-187.   DOI
21 Roo, S., He, K., Girshick, R, Sun, J. (2015), "Faster R-CNN: Towards real-time object detection with region proposal networks", in: NIPS.