Browse > Article
http://dx.doi.org/10.5909/JBE.2015.20.1.153

Rain Detection and Removal Algorithm using Motion-Compensated Non-local Means Filter for Video Sequences  

Seo, Seung Ji (Department of Electronic Engineering, Inha University)
Song, Byung Cheol (Department of Electronic Engineering, Inha University)
Publication Information
Journal of Broadcast Engineering / v.20, no.1, 2015 , pp. 153-163 More about this Journal
Abstract
This paper proposes a rain detection and removal algorithm that is robust against camera motion in video sequences. In detection part, the proposed algorithm initially detects possible rain streaks by using intensity properties and spatial properties. Then, the rain streak candidates are selected based on Gaussian distribution model. In removal part, a non-rain block matching algorithm is performed between adjacent frames to find similar blocks to the block that has rain pixels. If the similar blocks to the block are obtained, the rain region of the block is reconstructed by non-local means (NLM) filter using the similar neighbors. Experimental results show that the proposed algorithm outperforms the previous works in terms of subjective visual quality of de-rained video sequences.
Keywords
Rain streak; rain detection; rain removal; visibility enhancement;
Citations & Related Records
연도 인용수 순위
  • Reference
1 X. Xue, X. Jin, C. Zhang, and S. Goto, “Motion robust rain detection and removal from videos,” in Proc, IEEE Int. Workshop on Multimedia Signal Processing, 2012, pp.170-174.
2 J. H. Kim, C. Lee, J. Y. Sim and C. S. Kim, “Single-image deraining using an adaptive nonlocal means filter,” in Proc. IEEE Conf. Image Process., Sept. 2013, pp.914-917.
3 K. Garg and S.K. Nayar, “Vision and rain,” Int. J. Comput. Vis., vol. 75, no. 1, pp.3–27, Jan. 2007.   DOI
4 J. H. Lee, K. W. Lim, B. C. Song, and J. B. Ra, “A fast multi-resolution block matching algorithm and its LSI architecture for low bit-rate video coding,” IEEE Trans. Circuits and Systems for Video Technology, vol. 11, no. 12, pp.1289–1300, Dec. 2001.   DOI   ScienceOn
5 A. M. Tourapis, O. C. Au, and M. L. Liou, “Highly efficient predictive zonal algorithms for fast block-matching motion estimation,” IEEE Trans. Circuits and Systems for Video Technology, vol. 12, no. 10, pp. 934- 941, Oct. 2002.   DOI   ScienceOn
6 A. Buades, B. Coll, and J.-M. Morel, “A non-local algorithm for image denoising”, in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 2, pp. 60-65, Jun. 2005.
7 K. Garg and S. K. Nayar, “Detection and removal of rain from videos,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2004, vol. 1, pp. 528–535.
8 W. Ahn and J.-S. Kim, “Flat-region detection and false contour removal in the digital TV display,” in Proc. IEEE Int. Conf. Multimedia and Expo, Armsterdam, The Netherlands, July 2005, pp. 1338-1341.
9 K. He, J. Sun, and X. Tang, “Guided Image Filtering,” in Proc. European Conf. Computer Vision, pp. 1-14, 2010.
10 J. P. Tarel and N. Hautiere, “Fast visibility restoration from a single color or gray level image,” in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 2201–2208.
11 X. Zhang, H. Li, Y. Qi, W. K. Leow, and T. K. Ng, “Rain removal in video by combining temporal and chromatic properties,” in Proc. IEEE Int. Conf. Multimedia Expo., Toronto, ON, Canada, Jul. 2006, pp. 461–464.
12 P. Barnum, T. Kanade, and S. G. Narasimhan, “Spatio-temporal frequency analysis for removing rain and snow from videos,” in Workshop on Photometric Analysis for Computer Vision, in Conjunction with International Conference on Computer Vision, 2007.
13 P. Barnum, S. Narasimhan, and T. Kanade, “Analysis of rain and snow in frequency space,” Int. J. Comput. Vis., vol. 86, no. 2/3, pp. 256–274, Jan. 2010.   DOI