Browse > Article
http://dx.doi.org/10.3745/KTSDE.2019.8.10.403

Perceptual Generative Adversarial Network for Single Image De-Snowing  

Wan, Weiguo (전북대학교 컴퓨터공학부)
Lee, Hyo Jong (전북대학교 컴퓨터공학부)
Publication Information
KIPS Transactions on Software and Data Engineering / v.8, no.10, 2019 , pp. 403-410 More about this Journal
Abstract
Image de-snowing aims at eliminating the negative influence by snow particles and improving scene understanding in images. In this paper, a perceptual generative adversarial network based a single image snow removal method is proposed. The residual U-Net is designed as a generator to generate the snow free image. In order to handle various sizes of snow particles, the inception module with different filter kernels is adopted to extract multiple resolution features of the input snow image. Except the adversarial loss, the perceptual loss and total variation loss are employed to improve the quality of the resulted image. Experimental results indicate that our method can obtain excellent performance both on synthetic and realistic snow images in terms of visual observation and commonly used visual quality indices.
Keywords
Generative Adversarial Network; De-Snowing; U-Net; Image Synthesis; Residual Block;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Z. Wang, A. C. Bovik, H. Sheikh, and E. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Transactions on Image Processing, Vol.13, No.4, pp.600-612, 2004.   DOI
2 X. Fu, B. Liang, Y. Huang, X. Ding, and J. Paisley, "Lightweight pyramid networks for image deraining," arXiv preprint arXiv: 1805.06173, 2018.
3 L. Deng, T. Huang, X. Zhao, and T. Jiang, "A directional global sparse model for single image rain removal," Applied Mathematical Modelling, Vol.59, pp.662-679, 2018,   DOI
4 ImageAI [Internet], http://imageai.org/.
5 R. Li. J. Pan, Z. Li, and J. Tang, "Single image dehazing via conditional generative adversarial network," in Proceedings of the CVPR, pp.8202-8211, 2018.
6 W. Yang, R. T. Tan, J. Feng, J. Liu, Z. Guo, and S. Yan, "Deep joint rain detection and removal from a single image," in Proceedings of the CVPR, pp.1357-1366, 2017.
7 S. Pei, Y. Tsai, and C. Lee, "Removing rain and snow in a single image using saturation and visibility features," IEEE International Conference on Multimedia and Expo Workshops, pp.1-6, 2014.
8 O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," International Conference on Medical Image Computing and Computer-assisted Intervention, pp.234-241, 2015.
9 I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets. in International Conference on Neural Information Processing Systems," pp.2672-2680, 2014.
10 C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.1-9, 2015:
11 Y. Zhang, Y. Tian, Y. Kong, B. Zhong, and Y. Fu, "Residual dense network for image super-resolution," in Proceedings of the CVPR, pp.2472-2481, 2018.
12 O. Kupyn, V. Budzan, M. Mykhailych, D. Mishkin, and J. Matas, "Deblurgan: Blind motion deblurring using conditional adversarial networks," in Proceedings of CVPR, pp.8183- 8192, 2018.
13 Z. Fan, H. Wu, X. Fu, Y. Huang, and X. Ding, "Residualguide network for single image deraining," 2018 ACM Multimedia Conference on Multimedia, pp.1751-1759, 2018.
14 B. Wu, H. Duan, Z. Liu, and G. Sun, "SRPGAN: Perceptual generative adversarial network for single image super resolution. arXiv preprint arXiv:1712.05927, 2017.
15 J. Johnson, A. Alahi, L. Fei-Fei, "Perceptual losses for real-time style transfer and super-resolution," European Conference on Computer Vision, pp.694-711, 2016.
16 Y. F. Liu, D. W. Jaw, S. C. Huang, and J. N. Hwang, "DesnowNet: Context-aware deep network for snow removal," IEEE Transactions on Image Processing, Vol.27, No.6, pp.3064-3073, 2018.   DOI
17 X. Zheng, Y. Liao, W. Guo, X. Fu, and X. Ding, "Singleimage-based rain and snow removal using multi-guided filter," in Proc. Int. Conf. Neural Inf. Process, pp.258-265, 2013.