DOI QR코드

DOI QR Code

Deep Learning-based Spine Segmentation Technique Using the Center Point of the Spine and Modified U-Net

척추의 중심점과 Modified U-Net을 활용한 딥러닝 기반 척추 자동 분할

  • Sungjoo Lim (Department of Biomedical Systems Informatics, Yonsei University) ;
  • Hwiyoung Kim (Department of Biomedical Systems Informatics, Yonsei University)
  • 임성주 (연세대학교 의과대학 의생명시스템정보학과) ;
  • 김휘영 (연세대학교 의과대학 의생명시스템정보학과)
  • Received : 2023.04.11
  • Accepted : 2023.04.21
  • Published : 2023.04.30

Abstract

Osteoporosis is a disease in which the risk of bone fractures increases due to a decrease in bone density caused by aging. Osteoporosis is diagnosed by measuring bone density in the total hip, femoral neck, and lumbar spine. To accurately measure bone density in the lumbar spine, the vertebral region must be segmented from the lumbar X-ray image. Deep learning-based automatic spinal segmentation methods can provide fast and precise information about the vertebral region. In this study, we used 695 lumbar spine images as training and test datasets for a deep learning segmentation model. We proposed a lumbar automatic segmentation model, CM-Net, which combines the center point of the spine and the modified U-Net network. As a result, the average Dice Similarity Coefficient(DSC) was 0.974, precision was 0.916, recall was 0.906, accuracy was 0.998, and Area under the Precision-Recall Curve (AUPRC) was 0.912. This study demonstrates a high-performance automatic segmentation model for lumbar X-ray images, which overcomes noise such as spinal fractures and implants. Furthermore, we can perform accurate measurement of bone density on lumbar X-ray images using an automatic segmentation methodology for the spine, which can prevent the risk of compression fractures at an early stage and improve the accuracy and efficiency of osteoporosis diagnosis.

Keywords

References

  1. Fasihi L, Tartibian B, Eslami R, Fasihi H. Artificial intelligence used to diagnose osteoporosis from risk factors in clinical data and proposing sports protocols. Scientific Reports. 2022;12(1):18330. 
  2. Cootes TF, Taylor CJ, Cooper DH, Graham J. Active Shape Models-Their Training and Application. Computer Vision and Image Understanding. 1995;61(1):38-59.  https://doi.org/10.1006/cviu.1995.1004
  3. Zamora G, Sari-Sarraf H, Long LR. Hierarchical segmentation of vertebrae from x-ray images. Proc SPIE. 2003;5032:631-642. 
  4. Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2015, Cham, Springer International Publishing. 
  5. Badrinarayanan V, Kendall A, Cipolla R. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2017;39(12):2481-2495.  https://doi.org/10.1109/TPAMI.2016.2644615
  6. Long J, Shelhamer E, Darrel T. Fully convolutional networks for semantic segmentation. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 
  7. Kim DH, Jeong JG, Kim YJ, Kim KG, Jeon JY. Automated Vertebral Segmentation and Measurement of Vertebral Compression Ratio Based on Deep Learning in X-Ray Images. J Digit Imaging. 2021;34(4):853-861.  https://doi.org/10.1007/s10278-021-00471-0
  8. He K, Zhang X, Ren S, Sun J. Deep Residual Learning for Image Recognition, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016;770-778. 
  9. Kim KC, Cho HC, Jang TJ, Choi JM, Seo JK. Automatic detection and segmentation of lumbar vertebrae from X-ray images for compression fracture evaluation. Computer Methods and Programs in Biomedicine. 2021;200:105833. 
  10. Abraham N, Khan NM. A Novel Focal Tversky Loss Function With Improved Attention U-Net for Lesion Segmentation. 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). 
  11. Wu Y, He K. Group Normalization. CoRR abs/1803.08494. 
  12. Maas AL. Rectifier Nonlinearities Improve Neural Network Acoustic Models. 2013. 
  13. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 2014;15(1):1929-1958. 
  14. Zhao R, Qian B, Zhang X, Li Y, Wei R, Liu Y, Pan Y. Rethinking Dice Loss for Medical Image Segmentation. 2020 IEEE International Conference on Data Mining (ICDM). 
  15. Kingma DP, Ba J. Adam: A Method for Stochastic Optimization. CoRR abs/1412.6980. 
  16. Bertels J, Eelbode T, Berman M, Vandermeulen D, Maes F, Bisschops R, Blaschko M. Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory & Practice. 2019. 
  17. Davis J, Goadrich M. The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd international conference on Machine learning. Pittsburgh, Pennsylvania, USA, Association for Computing Machinery: 233-240. 
  18. Fard AP, Ferrantelli J, Dupuis A, Mahoor MH. Sagittal Cervical Spine Landmark Point Detection in X-Ray Using Deep Convolutional Neural Networks. IEEE Access. 2022;10:59413-59427. https://doi.org/10.1109/ACCESS.2022.3180028