Browse > Article
http://dx.doi.org/10.9717/kmms.2022.25.8.1224

Classification of Whole Body Bone Scan Image with Bone Metastasis using CNN-based Transfer Learning  

Yim, Ji Yeong (Dept. of Artificial Intelligence Convergence, Chonnam National University)
Do, Thanh Cong (Dept. of Artificial Intelligence Convergence, Chonnam National University)
Kim, Soo Hyung (Dept. of Artificial Intelligence Convergence, Chonnam National University)
Lee, Guee Sang (Dept. of Artificial Intelligence Convergence, Chonnam National University)
Lee, Min Hee (Dept. of Nuclear Medicine, Chonnam National University Hwasun Hospital)
Min, Jung Joon (Dept. of Nuclear Medicine, Chonnam National University Hwasun Hospital)
Bom, Hee Seung (Dept. of Nuclear Medicine, Chonnam National University Hwasun Hospital)
Kim, Hyeon Sik (Medical Photonics Research Center, Korea Photonics Technology Institute)
Kang, Sae Ryung (Dept. of Nuclear Medicine, Chonnam National University Hwasun Hospital)
Yang, Hyung Jeong (Dept. of Artificial Intelligence Convergence, Chonnam National University)
Publication Information
Journal of Korea Multimedia Society / v.25, no.8, 2022 , pp. 1224-1232 More about this Journal
Abstract
Whole body bone scan is the most frequently performed nuclear medicine imaging to evaluate bone metastasis in cancer patients. We evaluated the performance of a VGG16-based transfer learning classifier for bone scan images in which metastatic bone lesion was present. A total of 1,000 bone scans in 1,000 cancer patients (500 patients with bone metastasis, 500 patients without bone metastasis) were evaluated. Bone scans were labeled with abnormal/normal for bone metastasis using medical reports and image review. Subsequently, gradient-weighted class activation maps (Grad-CAMs) were generated for explainable AI. The proposed model showed AUROC 0.96 and F1-Score 0.90, indicating that it outperforms to VGG16, ResNet50, Xception, DenseNet121 and InceptionV3. Grad-CAM visualized that the proposed model focuses on hot uptakes, which are indicating active bone lesions, for classification of whole body bone scan images with bone metastases.
Keywords
Deep Learning; Computer Vision; CNN; Transfer Learning; Medical Image; Bone Scan;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 E. Hwang, H. Kim, S. Yoon, J. Goo, and C. Park, "Implementation of a Deep Learning-Based Computer-Aided Detection System for the Interpretation of Chest Radiographs in Patients Suspected for COVID-19," Korean Journal of Radiology, Vol. 10, pp. 1150-1160, 2020.
2 D. Kim, J. Park, J. Choi, D. Shim, H. Kim, and Y. Lee, "Building the Process for Reducing Whole Body Bone Scan Errors and its Effect," The Korean Journal of Nuclear Medicine Technology, Vol. 21, No. 1, pp. 76-82, 2017.
3 Radiologist Workforce Crisis and Radiologist Shortage, http://www.bosa.co.kr/news/articleView.html?idxno=2120014 (accessed June 27, 2022).
4 K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," arXiv Preprint, arXiv:1409.1556, 2014.
5 K.M. He, X.Y. Zhang, S.Q. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, 2016.
6 C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, "Rethinking the Inception Architecture for Computer Vision," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818-2826, 2016.
7 T.C. Hsieh, C.W. Liao, Y.C. Lai, K.M. Law, P.K. Chan, and C.H. Kao, "Detection of Bone Metastases on Bone Scans through Image Classification with Constrastive Learning," Journal of Personalized Medicine, Article ID 1248, 2021.
8 N. Papandrianos, E. Papageorgiou, A. Anagnostis, and K. Papageorgiou, "Bone Metastasis Classification Using Whole Body Images From Prostate Cancer Patients Based on Convolutional Neural Networks Application," PLOS ONE, Vol. 15, No. 8, e0237213, 2020.
9 Z. Zhao, Y. Pi, L. Jiang, Y. Xian, J. Wei, and P. Yang. et al., "Deep Neural Network Based Artificial Intelligence Assisted Diagnosis of Bone Scintigraphy for Cancer Bone Metastasis," Scientific Reports, Article ID 17046, 2020.
10 V. Nair and G.E. Hilton, "Rectified Linear Units Improve Restricted Boltzmann Machines," International Conference on Machine Learning, pp. 807-814, 2010.
11 S. Park and D. Kim, "Comparison of Image Classification Performance in Convolutional Neural Network according to Transfer Learning," Journal of Korea Multimedia Society, Vol. 21, No. 12, pp. 1387-1395, 2018.   DOI
12 G. Huang, Z. Liu, L.V.D. Maaten, and K.Q. Weinberger, "Densely Connected Convolutional Networks," 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4700-4708, 2017.
13 R.R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, "Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization," 2017 IEEE International Conference on Computer Vision (ICCV), pp. 618-626, 2017.
14 F. Chollet, "Xception: Deep Learning with Depthwise Separable Convolutions," 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1800-1807, 2017.
15 N. Papandrianos, E. Papageorgiou, A. Anagnostis, and A. Feleki, "A Deep-Learning Approach for Diagnosis of Metastatic Breast Cancer in Bones from Whole-Body Scans," Applied Sciences, Article ID 997, 2020.
16 M. Salim, E. Wahlin, K. Dembrower, E. Azavedo, T. Foukakis, and Y. Liu, et al., "External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms," The Journal of the American Medical Association Oncology, Vol. 6, No. 10, pp. 1581-1588, 2020.
17 Artificial Intelligence Healthcare that Evolves with the Covid Era, https://www.medifonews.com/mobile/article.html?no=163642 (accessed June 27, 2022).