대한의용생체공학회:의공학회지 (Journal of Biomedical Engineering Research)

  • 제43권5호
  • /
  • Pages.341-352
  • /
  • 2022
  • /
  • 1229-0807(pISSN)
  • /
  • 2288-9396(eISSN)
대한의용생체공학회 (The Korean Society of Medical and Biological Engineering)
권호 표지
DOI QR코드

DOI QR Code

Accuracy evaluation of liver and tumor auto-segmentation in CT images using 2D CoordConv DeepLab V3+ model in radiotherapy

  • An, Na young (Department of Biomedicine & Health Sciences, The catholic University of Korea) ;
  • Kang, Young-nam (Advanced Institute For Radiation Medical Technology, College of Medicine, The catholic University of Korea)
  • 투고 : 2022.09.26
  • 심사 : 2022.10.21
  • 발행 : 2022.10.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Medical image segmentation is the most important task in radiation therapy. Especially, when segmenting medical images, the liver is one of the most difficult organs to segment because it has various shapes and is close to other organs. Therefore, automatic segmentation of the liver in computed tomography (CT) images is a difficult task. Since tumors also have low contrast in surrounding tissues, and the shape, location, size, and number of tumors vary from patient to patient, accurate tumor segmentation takes a long time. In this study, we propose a method algorithm for automatically segmenting the liver and tumor for this purpose. As an advantage of setting the boundaries of the tumor, the liver and tumor were automatically segmented from the CT image using the 2D CoordConv DeepLab V3+ model using the CoordConv layer. For tumors, only cropped liver images were used to improve accuracy. Additionally, to increase the segmentation accuracy, augmentation, preprocess, loss function, and hyperparameter were used to find optimal values. We compared the CoordConv DeepLab v3+ model using the CoordConv layer and the DeepLab V3+ model without the CoordConv layer to determine whether they affected the segmentation accuracy. The data sets used included 131 hepatic tumor segmentation (LiTS) challenge data sets (100 train sets, 16 validation sets, and 15 test sets). Additional learned data were tested using 15 clinical data from Seoul St. Mary's Hospital. The evaluation was compared with the study results learned with a two-dimensional deep learning-based model. Dice values without the CoordConv layer achieved 0.965 ± 0.01 for liver segmentation and 0.925 ± 0.04 for tumor segmentation using the LiTS data set. Results from the clinical data set achieved 0.927 ± 0.02 for liver division and 0.903 ± 0.05 for tumor division. The dice values using the CoordConv layer achieved 0.989 ± 0.02 for liver segmentation and 0.937 ± 0.07 for tumor segmentation using the LiTS data set. Results from the clinical data set achieved 0.944 ± 0.02 for liver division and 0.916 ± 0.18 for tumor division. The use of CoordConv layers improves the segmentation accuracy. The highest of the most recently published values were 0.960 and 0.749 for liver and tumor division, respectively. However, better performance was achieved with 0.989 and 0.937 results for liver and tumor, which would have been used with the algorithm proposed in this study. The algorithm proposed in this study can play a useful role in treatment planning by improving contouring accuracy and reducing time when segmentation evaluation of liver and tumor is performed. And accurate identification of liver anatomy in medical imaging applications, such as surgical planning, as well as radiotherapy, which can leverage the findings of this study, can help clinical evaluation of the risks and benefits of liver intervention.

키워드

참고문헌

  1. Gerard A, Buyse M, Nordlinger B, Loygue J, Pene F, Kempf P, Bosset JF, Gignoux M, Arnaud JP, Desaive C. Preoperative radiotherapy as adjuvant treatment in rectal cancer. Final results of a randomized study of the European Organization for Research and Treatment of Cancer (EORTC). Annals of surgery. 1988;208(5):606-614. https://doi.org/10.1097/00000658-198811000-00011
  2. Lei Chen, Hong Song, Chi Wang, Yutao Cui, Jian Yang, Xiaohua Hu, Le Zhang. Liver tumor segmentation in CT volumes using an adversarial densely connected network. BMC bioinformatics. 2019;20.16:1-13. https://doi.org/10.1186/s12859-018-2565-8
  3. Yuka Urago, Hiroyuki Okamoto, Tomoya Kaneda, Naoya Murakami, Tairo Kashihara, Mihiro Takemori, Hiroki Nakayama, Kotaro Iijima, Takahito Chiba, Junichi Kuwahara, Shouichi Katsuta, Satoshi Nakamura, Weishan Chang, Hidetoshi Saitoh, Hiroshi Igaki. Evaluation of auto-segmentation accuracy of cloud-based artificial intelligence and atlas-based models. Radiation Oncology. 2021;16.1:1-13. https://doi.org/10.1186/s13014-020-01701-5
  4. Llovet JM, Kelley RK, Villanueva A, Singal AG, Pikarsky E, Roayaie S, Lencioni R, Koike K, Zucman-Rossi J, Finn RS. Hepatocellular carcinoma. Nature reviews. Disease primers. 2021;7(1):6. https://doi.org/10.1038/s41572-020-00240-3
  5. Hyunseok Seo, Charles Huang, Maxime Bassenne; Ruoxiu Xiao, Lei Xing. Modified U-Net (mU-Net) with incorporation of object-dependent high level features for improved liver and liver-tumor segmentation in CT images. IEEE transactions on medical imaging. 2019;39(5):1316-1325.
  6. Jean-Francois Daisne & Andreas Blumhofer. Atlas-based automatic segmentation of head and neck organs at risk and nodal target volumes: a clinical validation. Radiation oncology. 2013;8(1):1-11. https://doi.org/10.1186/1748-717X-8-1
  7. Shalini K. Vinod, Michael G. Jameson, Myo Min, Lois C. Holloway. Uncertainties in volume delineation in radiation oncology: a systematic review and recommendations for future studies. Radiotherapy and Oncology 2016;121(2):169-179. https://doi.org/10.1016/j.radonc.2016.09.009
  8. Elif Deryaubeyli. Implementing automated diagnostic systems for breast cancer detection. Expert systems with Applications. 2007;33(4):1054-1062. https://doi.org/10.1016/j.eswa.2006.08.005
  9. Berkman Sahiner, Aria Pezeshk, Lubomir M. Hadjiiski, Xiaosong Wang, Karen Drukker, Kenny H. Cha, Ronald M. Summers, Maryellen L. Giger. Deep learning in medical imaging and radiation therapy. Medical physics. 2019;46(1):1-36. https://doi.org/10.1002/mp.13201
  10. Jonathan Long, Evan Shelhamer, Trevor Darrell. Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition. 2015;3431-3440.
  11. Holger R. Roth, Hirohisa Oda, Xiangrong Zhou, Natsuki Shimizu, Ying Yang, Yuichiro Hayashi, Masahiro Oda, Michitaka Fujiwara, Kazunari Misawa, Kensaku Mori. An application of cascaded 3D fully convolutional networks for medical image segmentation. Computerized Medical Imaging and Graphics. 2018;66: 90-99. https://doi.org/10.1016/j.compmedimag.2018.03.001
  12. Patrick Ferdinand Christ, Mohamed Ezzeldin A. Elshaer, Florian Ettlinger, Sunil Tatavarty, Marc Bickel, Patrick Bilic, Markus Rempfler, Marco Armbruster, Felix Hofmann, Melvin D'Anastasi, Wieland H. Sommer, Seyed-Ahmad Ahmadi, Bjoern H. Menze. Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. International conference on medical image computing and computer-assisted intervention. 2016;9901:415-423.
  13. Peijun Hu, Fa Wu, Jialin Peng, Yuanyuan Bao, Feng Chen, Dexing Kong. Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets. International journal of computer assisted radiology and surgery, 2017;12(3):399-411. https://doi.org/10.1007/s11548-016-1501-5
  14. Meg F. Bobo, Shunxing Bao, Yuankai Huo, Yuang Yao, Jack Virostko, Andrew J. Plassard, Ilwoo Lyu, Albert Assad, Richard G. Abramson, Melissa A. Hilmes, Bennett A. Landman. Fully convolutional neural networks improve abdominal organ segmentation. Medical Imaging 2018;10574:750-757.
  15. Lei Bi, Jinman Kim, Ashnil Kumar, Dagan Feng. Automatic liver lesion detection using cascaded deep residual networks. arXiv preprint arXiv. 2017;1704.02703.
  16. Yading Yuan. Hierarchical convolutional-deconvolutional neural networks for automatic liver and tumor segmentation. arXiv preprint arXiv. 2017;1710.04540.
  17. Krishna Chaitanya Kaluva, Mahendra Khened, Avinash Kori, Ganapathy Krishnamurthi. 2D-densely connected convolution neural networks for automatic liver and tumor segmentation. arXiv preprint arXiv. 2018;1802.02182.
  18. Tongle Fan, Guanglei Wang, Yan Li, Hongrui Wang. Ma-net: A multi-scale attention network for liver and tumor segmentation. IEEE Access. 2020;8:179656-179665. https://doi.org/10.1109/ACCESS.2020.3025372
  19. Patrick Bilic, Patrick Ferdinand Christ, Eugene Vorontsov, Grzegorz Chlebus, Hao Chen, Qi Dou, Chi-Wing Fu, Xiao Han, Pheng-Ann Heng, Jurgen Hesser, Samuel Kadoury, Tomasz Konopczynski, Miao Le, Chunming Li, Xiaomeng Li, Jana Lipkova, John Lowengrub, Hans Meine, Jan Hendrik Moltz, Chris Pal, Marie Piraud, Xiaojuan Qi, Jin Qi, Markus Rempfler, Karsten Roth, Andrea Schenk, Anjany Sekuboyina, Eugene Vorontsov, Ping Zhou, Christian Hulsemeyer, Marcel Beetz, Florian Ettlinger, Felix Gruen, Georgios Kaissis, Fabian Lohofer, Rickmer Braren, Julian Holch, Felix Hofmann, Wieland Sommer, Volker Heinemann, Colin Jacobs, Gabriel Efrain Humpire Mamani, Bram van Ginneken, Gabriel Chartrand, An Tang, Michal Drozdzal, Avi Ben-Cohen, Eyal Klang, Marianne M. Amitai, Eli Konen, Hayit Greenspan, Johan Moreau, Alexandre Hostettler, Luc Soler, Refael Vivanti, Adi Szeskin, Naama Lev-Cohain, Jacob Sosna, Leo Joskowicz, Bjoern H. Menze. The liver tumor segmentation benchmark (lits). arXiv preprint arXiv., 2019;1901.04056. https://doi.org/10.1016/j.media.2022.102680
  20. Nasser Alalwan, Amr Abozeid, AbdAllah A. ElHabshy, Ahmed Alzahrani. Efficient 3D deep learning model for medical image semantic segmentation. Alexandria Engineering Journal, 2021;60(1):1231-1239. https://doi.org/10.1016/j.aej.2020.10.046
  21. Amit Pandey, Achin Jain. Comparative analysis of KNN algorithm using various normalization techniques. International Journal of Computer Network and Information Security. 2017;9(11):36.
  22. Marcin Kociolek, Michal Strzelecki, Rafal Obuchowicz. Does image normalization and intensity resolution impact texture classification?. Computerized Medical Imaging and Graphics. 2020;81:101716. https://doi.org/10.1016/j.compmedimag.2020.101716
  23. El Jurdi R, Petitjean C, Honeine P, Abdallah F. CoordConvUnet: Investigating CoordConv for Organ Segmentation. IRBM. 2021;42(6):415-423. https://doi.org/10.1016/j.irbm.2021.03.002
  24. Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, Piotr Dollar. Focal loss for dense object detection. Proceedings of the IEEE international conference on computer vision. 2017;2980-2988.
  25. Seyed Sadegh Mohseni Salehi, Deniz Erdogmus, Ali Gholipour. Tversky loss function for image segmentation using 3D fully convolutional deep networks. International workshop on machine learning in medical imaging. 2017;10541:379-387.