DOI QR코드

DOI QR Code

A Comprehensive Analysis of Deformable Image Registration Methods for CT Imaging

  • Kang Houn Lee (Department of Biomedicine and Health Science, The Catholic University of Korea) ;
  • Young Nam Kang (Advanced Institute for Radiation Fusion Medical Technology, College of Medicine, The Catholic University of Korea)
  • Received : 2023.08.23
  • Accepted : 2023.09.20
  • Published : 2023.10.31

Abstract

This study aimed to assess the practical feasibility of advanced deformable image registration (DIR) algorithms in radiotherapy by employing two distinct datasets. The first dataset included 14 4D lung CT scans and 31 head and neck CT scans. In the 4D lung CT dataset, we employed the DIR algorithm to register organs at risk and tumors based on respiratory phases. The second dataset comprised pre-, mid-, and post-treatment CT images of the head and neck region, along with organ at risk and tumor delineations. These images underwent registration using the DIR algorithm, and Dice similarity coefficients (DSCs) were compared. In the 4D lung CT dataset, registration accuracy was evaluated for the spinal cord, lung, lung nodules, esophagus, and tumors. The average DSCs for the non-learning-based SyN and NiftyReg algorithms were 0.92±0.07 and 0.88±0.09, respectively. Deep learning methods, namely Voxelmorph, Cyclemorph, and Transmorph, achieved average DSCs of 0.90±0.07, 0.91±0.04, and 0.89±0.05, respectively. For the head and neck CT dataset, the average DSCs for SyN and NiftyReg were 0.82±0.04 and 0.79±0.05, respectively, while Voxelmorph, Cyclemorph, and Transmorph showed average DSCs of 0.80±0.08, 0.78±0.11, and 0.78±0.09, respectively. Additionally, the deep learning DIR algorithms demonstrated faster transformation times compared to other models, including commercial and conventional mathematical algorithms (Voxelmorph: 0.36 sec/images, Cyclemorph: 0.3 sec/images, Transmorph: 5.1 sec/images, SyN: 140 sec/images, NiftyReg: 40.2 sec/images). In conclusion, this study highlights the varying clinical applicability of deep learning-based DIR methods in different anatomical regions. While challenges were encountered in head and neck CT registrations, 4D lung CT registrations exhibited favorable results, indicating the potential for clinical implementation. Further research and development in DIR algorithms tailored to specific anatomical regions are warranted to improve the overall clinical utility of these methods.

Keywords

References

  1. Avants BB, Epstein CL, Grossman M. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Medical image analysis, 2008;12(1):26-41.  https://doi.org/10.1016/j.media.2007.06.004
  2. Yipeng Hu, Marc Modat, Eli Gibson, Wenqi Li, Nooshin Ghavami, Ester Bonmati, Guotai Wang, Steven Bandula, Caroline M. Moore, Mark Emberton, Sebastien Ourselin, J. Alison Noble, Dean C. Barratt, Tom Vercauteren, Weakly-supervised convolutional neural networks for multimodal image registration. Medical image analysis, 2018;49:1-13.  https://doi.org/10.1016/j.media.2018.07.002
  3. Rohe MM, Datar M, Heimann T, Sermesant M. Pennec SVF-Net: learning deformable image registration using shape matching.Springer International Publishing, 2017;266-274. 
  4. Shen D, Wu G, Suk HI. Deep learning in medical image analysis. Annu, rev, of biomedical engineering, 2017;19:221-248.  https://doi.org/10.1146/annurev-bioeng-071516-044442
  5. Jaderberg M, Simonyan K, Zisserman A, Kavukcuoglu K. Spatial transformer networks. Advances in neural information processing systems, 2015;28. 
  6. Balakrishnan G, Zhao A, Sabuncu MR, Guttag J, Dalca AV. VoxelMorph: a learning framework for deformable medical image registration. IEEE transactions on medical imaging, 2019;38(8):1788-1800.  https://doi.org/10.1109/TMI.2019.2897538
  7. De Vos BD, Berendsen FF, Viergever MA, Sokooti H, Staring M, Isgum I. A deep learning framework for unsupervised affine and deformable image registration. MIA, 2019;52:128-143.  https://doi.org/10.1016/j.media.2018.11.010
  8. Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Stephen M, Stanley P, David M, Michael P, Lawrence T, Prior F. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. Journal of digital imaging, 2013;26:1045-1057.  https://doi.org/10.1007/s10278-013-9622-7
  9. Bejarano T, De Ornelas Couto M, Mihaylov IB. Head-and-neck squamous cell carcinoma patients with CT taken during pre-treatment, mid-treatment, and post-treatment Dataset. The Cancer Imaging Archive, 2018;10:K9. 
  10. Modat M, Ridgway GR, Taylor ZA, Lehmann M, Barnes J, Hawkes DJ, Nick C Fox, Ourselin S. Fast free-form deformation using graphics processing units. Computer methods and programs in biomedicine, 2010;98(3):278-284.  https://doi.org/10.1016/j.cmpb.2009.09.002
  11. Kim, BA, Kim DH, Park SH, Kim JE, Lee JG, Ye JC. CycleMorph: cycle consistent unsupervised deformable image registration. Medical image analysis, 2021;71:102036. 
  12. Chen, Junyu, Eric C, He Y, Segars W, Li Y, Yong D. Transmorph: Transformer for unsupervised medical image registration. Medical image analysis, 2022;82:102615. 
  13. Yang, Xiao, Kwitt R, Styner M, Niethammer M. Quicksilver: Fast predictive image registration a deep learning approach. NeuroImage, 2017;158:378-396.  https://doi.org/10.1016/j.neuroimage.2017.07.008
  14. Sokooti H, de Vos B, Berendsen F, Lelieveldt BPF, Isgum I, Staring M. Nonrigid image registration using multi-scale 3D convolutional neural networks. Springer International Publishing, 2017;232-239. 
  15. Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, Soumith Chintala. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 2019;32. 
  16. Pukala J, Johnson PB, Shah AP, Langen KM, Bova FJ, Staton RJ, Manon RR, Kelly P, Meeks SL. Benchmarking of five commercial deformable image registration algorithms for head and neck patients. Journal of applied clinical medical physics, 2016;17(3):25-40.  https://doi.org/10.1120/jacmp.v17i3.5735
  17. Varadhan R, Karangelis G, Krishnan K, Hui S. A framework for deformable image registration validation in radiotherapy clinical applications. Journal of applied clinical medical physics, 2013;14(1):192-213.  https://doi.org/10.1120/jacmp.v14i1.4066
  18. Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Medical physics, 2017;44(7):43-76.  https://doi.org/10.1002/mp.12256
  19. Balik S, Weiss E, Jan N, Roman N, Sleeman WC, Fatyga M, Christensen GE, Zhang C, Murphy MJ, Lu J, Keall P, Williamson JF, Hugo GD. Evaluation of 4-dimensional computed tomography to 4-dimensional cone-beam computed tomography deformable image registration for lung cancer adaptive radiation therapy. International Journal of Radiation Oncology Biology Physics, 2013;86(2):372-379. https://doi.org/10.1016/j.ijrobp.2012.12.023