Browse > Article
http://dx.doi.org/10.9708/jksci.2019.24.03.041

Generation of contrast enhanced computed tomography image using deep learning network  

Woo, Sang-Keun (Division of applied RI, Korea Institute of Radiological and Medical Sciences (KIRAMS), Radiological and Medico-Oncological Sciences, University of Science and Technology (UST))
Abstract
In this paper, we propose a application of conditional generative adversarial network (cGAN) for generation of contrast enhanced computed tomography (CT) image. Two types of CT data which were the enhanced and non-enhanced were used and applied by the histogram equalization for adjusting image intensities. In order to validate the generation of contrast enhanced CT data, the structural similarity index measurement (SSIM) was performed. Prepared generated contrast CT data were analyzed the statistical analysis using paired sample t-test. In order to apply the optimized algorithm for the lymph node cancer, they were calculated by short to long axis ratio (S/L) method. In the case of the model trained with CT data and their histogram equalized SSIM were $0.905{\pm}0.048$ and $0.908{\pm}0.047$. The tumor S/L of generated contrast enhanced CT data were validated similar to the ground truth when they were compared to scanned contrast enhanced CT data. It is expected that advantages of Generated contrast enhanced CT data based on deep learning are a cost-effective and less radiation exposure as well as further anatomical information with non-enhanced CT data.
Keywords
Contrast enhanced computed tomography; deep learning; generative adversarial network;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Tepel, Martin, Peter Aspelin, and Norbert Lameire. "Contrast-induced nephropathy: a clinical and evidence-based approach." Circulation. Vol. 113. pp.1799-1806. Apr 2006.   DOI
2 Andreucci, Michele, Richard Solomon, and Adis Tasanarong. "Side effects of radiographic contrast media: pathogenesis, risk factors, and prevention." BioMed research international. Vol. 2014. pp.1-20. Mar 2014.
3 Bagheri, M. H., Ahlman, M. A., Lindenberg, L., Turkbey, B., Lin, J., Civelek, A. C., Malayeri, A. A., Agarwal, P. K., Choyke, P., L., Folio, L., R., Apolo, A. B. (2017, July). "Advances in medical imaging for the diagnosis and management of common genitourinary cancers." Urologic Oncology: Seminars and Original Investigations Vol. 35, pp. 473-491. Jul 2017.   DOI
4 Yoon, D. Y., Hwang, H. S., Chang, S. K., Rho, Y. S., Ahn, H. Y., Kim, J. H., Lee, I. J. "CT, MR, US, 18 F-FDG PET/CT, and their combined use for the assessment of cervical lymph node metastases in squamous cell carcinoma of the head and neck." European radiology. Vol. 19, pp. 634-642. Mar 2009.   DOI
5 Litjens, G, Kooi T, Bejnordi, B. E., Setio, A. A. A. Ciompi, F., Ghafoorian, M., Laak, J. A. W. M., Ginneken, B., Sanchez, C. I. "A survey on deep learning in medical image analysis." Medical image analysis. Vol. 42, pp. 60-80. Jul 2017.   DOI
6 Gan, H. S., Tan, T. S., Kadir, B. A., Rafiq, M., Karim, A., Helmy, A., Sayuti, K. A., Wong, L. X., Tham, W. K. (2014). "Medical image contrast enhancement using spline concept: data from the osteoarthritis initiative." Journal of Medical Imaging and Health Informatics, Vol. 4, pp.511-520. May 2014.   DOI
7 Nie, D., Trullo, R., Lian, J., Petitjean, C., Ruan, S., Wang, Q., Shen, D. "Medical image synthesis with context-aware generative adversarial networks." International Conference on Medical Image Computing and Computer-Assisted Intervention Vol. 10435, pp. 417-425. Sep 2017.
8 Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courvile, A., Bengio, Y. (2014). "Generative adversarial nets." In Advances in neural information processing systems. pp. 2672-2680. 2014.
9 Yi, X., Walia, E., Babyn, P. "Generative adversarial network in medical imaging: A review." arXiv preprint arXiv:1809. Mar 2019.
10 Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., Greenspan, H. "GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification." Neurocomputing. Vol. 321, pp. 321-331. Dec 2018   DOI
11 Jin, D., Xu, Z., Tang, Y., Harrison, A. P., Mollura, D. J. (2018, September). "CT-realistic lung nodule simulation from 3d conditional generative adversarial networks for robust lung segmentation." In International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 732-740. Sep 2018
12 Ben-Cohen, A., Klang, E., Raskin, S. P., Amitai, M. M., Greenspan, H. "Virtual PET images from CT data using deep convolutional networks: initial results." In International Workshop on Simulation and Synthesis in Medical Imaging pp. 49-57. Sep 2017.
13 Penney, G. P., Weese, J., Little, J., A., Desmedt, P., Hill, D. L., Hawkes, D. J. "A comparison of similarity measures for use in 2-D-3-D medical image registration." IEEE transactions on medical imaging. Vol. 17. pp. 586-595. Aug 1998.   DOI
14 Zhu, Y., Cheng H. "An adaptive histogram equalization algorithm on the image gray level mapping." Physics Procedia. Vol. 25, pp.601-608. Apr 2012.   DOI
15 Mirza, M., Osindero, S. "Conditional generative adversarial nets." arXiv preprint. arXiv:1411.1784. Nov 2014.
16 Hathcock, John T., and Russ L. Stickle. "Principles and concepts of computed tomography." The Veterinary clinics of North America. Small animal practice. Vol. 23, pp. 399-415. Mar 1993.   DOI
17 Isola, P., Zhu, J. Y., Zhou, T., Efros, A. A. "Image-to-image translation with conditional adversarial networks." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1125-1134. 2017.
18 Jeong, J. S., Kim, Y. J. "Structural Similarity Index for Image Assessment Using Pixel Difference and Saturation Awareness." Journal of KIISE, Vol. 41, pp. 847-858. Oct 2014.   DOI
19 Zimmerman, D. W. "Teacher's corner: A note on interpretation of the paired-samples t test." Journal of Educational and Behavioral Statistics, Vol. 22, pp. 349-360. Sep 1997.   DOI
20 Steinkamp, H. J., Cornehl, M., Hosten, N., Pegios, W., Vogl, T., Felix, R. "Cervical lymphadenopathy: ratio of long-to short-axis diameter as a predictor of malignancy." The British journal of radiology, Vol. 68, pp. 266-270. Nov 1994.   DOI
21 Brenner, David J., and Eric J. Hall. "Computed tomography -an increasing source of radiation exposure." New England Journal of Medicine. Vol. 357, pp. 2277-2284. Nov 2007.   DOI
22 Schneider, Uwe, Eros Pedroni, and Antony Lomax. "The calibration of CT Hounsfield units for radiotherapy treatment planning." Physics in Medicine & Biology Vol. 41, pp. 111-124. Feb 1996.   DOI
23 Gao, Feng, Ming, Li, Yingli, Sun, Li, Xiao, Yangqing, Hua. "Diagnostic value of contrast-enhanced CT scans in identifying lung adenocarcinomas manifesting as GGNs (ground glass nodules)." Medicine. Vol. 96, pp. 1-6. Oct 2017.
24 Pena, Constantino S., Boland, Giles W. L., Hahn, Peter F., Lee, Michael J., Mueller, Peter R. "Characterization of indeterminate (lipid-poor) adrenal masses: use of washout characteristics at contrast-enhanced CT." Radiology. Vol. 217, pp. 798-802. Dec 2000.   DOI
25 Herman, Sean. "Computed tomography contrast enhancement principles and the use of high-concentration contrast media." Journal of computer assisted tomography. Vol. 28, pp. 7-11. Jul 2004.   DOI
26 Lusic, H., Grinstaff, M. W. "X-ray-computed tomography contrast agents." Chemical reviews. Vol. 113, pp. 1641-1666. Mar 2012.   DOI
27 Kim, E. S., Yoon, D. Y., Moon, J. Y., Baek, S., Han, Y. M., Seo, Y. L., Yun, E. J. "Detection of loco-regional recurrence in malignant head and neck tumors: a comparison of CT, MRI, and FDG PET-CT." Acta Radiologica. Vol. 60, pp. 186-195. Apr 2018.