Browse > Article
http://dx.doi.org/10.5909/JBE.2020.25.1.1

Generation of High-Resolution Chest X-rays using Multi-scale Conditional Generative Adversarial Network with Attention  

Ann, Kyeongjin (Cardio-vascular ICT Research Center, Yonsei University)
Jang, Yeonggul (Cardio-vascular ICT Research Center, Yonsei University)
Ha, Seongmin (Cardio-vascular ICT Research Center, Yonsei University)
Jeon, Byunghwan (Cardio-vascular ICT Research Center, Yonsei University)
Hong, Youngtaek (Cardio-vascular ICT Research Center, Yonsei University)
Shim, Hackjoon (Cardio-vascular ICT Research Center, Yonsei University)
Chang, Hyuk-Jae (Department of Cardiology, Yonsei University College of Medicine)
Publication Information
Journal of Broadcast Engineering / v.25, no.1, 2020 , pp. 1-12 More about this Journal
Abstract
In the medical field, numerical imbalance of data due to differences in disease prevalence is a common problem. It reduces the performance of a artificial intelligence network, leading to difficulties in learning a network with good performance. Recently, generative adversarial network (GAN) technology has been introduced as a way to address this problem, and its ability has been demonstrated by successful applications in various fields. However, it is still difficult to achieve good results in solving problems with performance degraded by numerical imbalances because the image resolution of the previous studies is not yet good enough and the structure in the image is modeled locally. In this paper, we propose a multi-scale conditional generative adversarial network based on attention mechanism, which can produce high resolution images to solve the numerical imbalance problem of chest X-ray image data. The network was able to produce images for various diseases by controlling condition variables with only one network. It's efficient and effective in that the network don't need to be learned independently for all disease classes and solves the problem of long distance dependency in image generation with self-attention mechanism.
Keywords
Medical; Multi-scale cGAN; Chest X-rays; Self Attention; High-Resolution;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Gyeongwan Kug, Application of Artificial Intelligence Technology and Industry, IITP, pp.22-26, March, 2019.
2 F Provost, "Machine learning from imbalanced data sets 101," Proceedings of the AAAI'2000 workshop on imbalanced data sets, Vol. 68, No. 2000, AAAI Press, 2000.
3 Goodfellow, Ian, et al., "Generative adversarial nets," Advances in neural information processing systems, pp. 2672-2680, 2014.
4 A. Radford, L. Metz, and S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks," in International Conference on Learning Representations (ICLR), 2015.
5 Mirza, Mehdi, and Simon Osindero, "Conditional generative adversarial nets," arXiv preprint, arXiv:1411.1784, 2014.
6 Isola, Phillip, et al., "Image-to-image translation with conditional adversarial networks," Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1125-1134, 2017.
7 Zhu, Jun-Yan, et al., "Unpaired image-to-image translation using cycle- consistent adversarial networks," Proceedings of the IEEE International Conference on Computer Vision, pp. 2223-2232, 2017.
8 Kim, Taeksoo, et al., "Learning to discover cross-domain relations with generative adversarial networks," Proceedings of the 34th International Conference on Machine Learning, Volume 70, JMLR. org, 2017.
9 Choi, Yunjey, et al., "Stargan: Unified generative adversarial networks for multi-domain image-to-image translation," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018.
10 Salehinejad, Hojjat, et al., "Generalization of deep neural networks for chest pathology classification in x-rays using generative adversarial networks," 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 990-994, April, 2018.
11 Salehinejad, Hojjat, et al., "Synthesizing Chest X-Ray Pathology for Training Deep Convolutional Neural Networks," IEEE transactions on medical imaging, 38.5: 1197-1206, 2018.   DOI
12 Zhang, Han, et al., "Stackgan++: Realistic image synthesis with stacked generative adversarial networks," arXiv preprint, arXiv: 1710.10916, 2017.
13 Bahdanau, Dzmitry, Kyunghyun Cho, and Yoshua Bengio, "Neural machine translation by jointly learning to align and translate," arXiv preprint, arXiv:1409.0473, 2014.
14 Hochreiter, Sepp, and Jurgen Schmidhuber, "Long short-term memory," Neural computation, 9.8: 1735-1780, 1997.   DOI
15 Sutskever, Ilya, Oriol Vinyals, and Quoc V. Le, "Sequence to sequence learning with neural networks," Advances in neural information processing systems, 2014.
16 Zhang, Han, et al., "Self-Attention Generative Adversarial Networks," arXiv preprint, arXiv:1805.08318, 2018.
17 Mao, Xudong, et al., "Least squares generative adversarial networks," Proceedings of the IEEE International Conference on Computer Vision, 2017.
18 Heusel, Martin, et al., "Gans trained by a two time-scale update rule converge to a local nash equilibrium," Advances in Neural Information Processing Systems, 2017.
19 Salimans, Tim, et al., "Improved techniques for training gans," Advances in neural information processing systems, 2016.