Browse > Article
http://dx.doi.org/10.3837/tiis.2014.08.017

A Kalman Filter based Video Denoising Method Using Intensity and Structure Tensor  

Liu, Yu (College of Information System and Management, National University of Defense Technology)
Zuo, Chenlin (College of Information System and Management, National University of Defense Technology)
Tan, Xin (College of Information System and Management, National University of Defense Technology)
Xiao, Huaxin (College of Information System and Management, National University of Defense Technology)
Zhang, Maojun (College of Information System and Management, National University of Defense Technology)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.8, no.8, 2014 , pp. 2866-2880 More about this Journal
Abstract
We propose a video denoising method based on Kalman filter to reduce the noise in video sequences. Firstly, with the strong spatiotemporal correlations of neighboring frames, motion estimation is performed on video frames consisting of previous denoised frames and current noisy frame based on intensity and structure tensor. The current noisy frame is processed in temporal domain by using motion estimation result as the parameter in the Kalman filter, while it is also processed in spatial domain using the Wiener filter. Finally, by weighting the denoised frames from the Kalman and the Wiener filtering, a satisfactory result can be obtained. Experimental results show that the performance of our proposed method is competitive when compared with state-of-the-art video denoising algorithms based on both peak signal-to-noise-ratio and structural similarity evaluations.
Keywords
Video denoising; Kalman filter; motion estimation; structure tensor; Wiener filter;
Citations & Related Records
연도 인용수 순위
  • Reference
1 N. Lian, V. Zagorodnov, and Y. Tan, "Video denoising using vector estimation of wavelet coefficients," in Proc.of IEEE Int. Sym. Circuits Syst., May 2006, pp. 2673-2676.
2 J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. on Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.   DOI   ScienceOn
3 F. Jin, P. Fieguth, and L. Winger, "Wavelet video denoising with regularized multiresolution motion estimation," Eup. Assoc. Speech,Signal, Image Process. J. Appl. Singal Process., vol. 2006, no. 72705, pp. 1-11, 2006.
4 D. Rusanovskyy and K. Egiazarian, "Video denoising algorithm in sliding 3-D DCT domain," in Proc of ACIVS, Sep. 2005, pp. 618-625.
5 C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. of IEEE Int. Conf. Computer Vision, pp. 839-846, Bombay, India, 1998.
6 E. P. Bennett and L. McMillan, "Video enhancement using per-pixel virtual exposures," in Proc. of ACM SIGGraph 05 Conference, pp. 845-852, Jul. 2005.
7 G. Varghese and Z. Wang, "Video denoising based on a spatiotemporal Gaussian scale mixture model", IEEE Trans. Circuits and Systems for Video Technology, vol. 20, no. 7, pp. 1032-1040, Jul. 2010.   DOI   ScienceOn
8 S. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, Jul. 1989.   DOI   ScienceOn
9 K. Dabov, A. Foi, and K. Egiazarian, "Video denoising by sparse 3-D transform-domain collaborative filtering," IEEE trans. Eur. Signal Process. Conf., Poznan, Poland, pp. 1257-1260, Sep. 2007.
10 F. Luiser, T. Blu, and M. Unser, "SURE-LET for Orthonormal Wavelet-Domain Video Denoising," IEEE Trans. Circuits and Systems for Video Technology, vol. 20, no. 6, pp. 913-919, Jun. 2010.   DOI   ScienceOn
11 Y. Han, and R.Chen, "Efficient video denoising based on dynamic nonlocal means," Image and Vision Computing, vol. 30, no. 2, pp. 78-85, Feb. 2012.   DOI   ScienceOn
12 I. Daubechies, "Orthonormal bases of compactly supported wavelets," Comm. Pure Appl. Math., vol. 41, no. 7, pp. 909-996, Oct. 1988.   DOI
13 V. Zlokolica, A. Pizurica and W. Philips, "Wavelet-domain video denoising based on reliability measures," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 8, pp. 993-1007, Aug. 2006.   DOI   ScienceOn
14 S. M. M. Rahman, F. M. Omair Ahmad, and M. N. S. Swamy, "Video denoising based on inter-frame statistical modeling of wavelet coefficients," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 2, pp. 187-198, Feb. 2007.   DOI   ScienceOn
15 H. Ji, C. Liu, Z. Shen and Y. Xu, "Robust video denoising using Low rank matrix completion," in Proc. of CVPR, pp. 13-18, Jun. 2010.
16 L. Jovanov, A. Pizurica, S. Schulte, P. Schelkens, A. Munteanu, E. Kerre, and W. Philips, "Combined wavelet-domain and motion-compensated video denoising based on video codec motion estimation methods," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 3, pp. 417-421, Mar. 2009.   DOI   ScienceOn
17 S. Yu, M. O. Ahmad and M. N. S. Swamy, "Video denoising using motion compensated 3-D wavelet transform with integrated recursive temporal filtering," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 6, pp. 780-791, Jun. 2010.   DOI   ScienceOn
18 M. Maggioni, G. Boracchi. A. Foi and K. Egiazarian, "Video denoising, deblocking, and enhancement through separable 4-D nonlocal spatiotemporal transforms," IEEE Transactions on Image Processing, vol. 21, no. 9, pp. 3952-3966, Sep. 2012.   DOI   ScienceOn
19 R. E. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME, Journal of Basic Engineering, vol. 82, pp. 35-45, 1960.
20 J.Weickert, H. Scharr, "A scheme for coherence-enhancing diffusion filtering with optimized rotation invariance," J. Visual Comm. Imag. Repres, vol. 13, pp.103-118, 2002.   DOI   ScienceOn
21 J.Weickert, "Anisotropic Diffusion in Image Processing," Teubner-Verlag, Stuttgart, Germany, 1998.
22 J. Weickert, "Coherence-enhancing diffusion filltering," Int. J. Computer Vision, vol. 31, pp. 111-127, Apl. 1999.   DOI
23 J. S. Lim, "Two-Dimensional Signal and Image Processing," Englewood Cliffs, NJ, Prentice Hall, pp. 548, 1990.
24 V. Arsigny, P. Fillard, X. Pennec, and N. Ayache, "Log-Euclidean metrics for fast and simple calculus on diffusion tensors," Magnetic Resonance in Medicine, vol. 56, no. 2, pp. 411-421, Jun. 2006.   DOI   ScienceOn
25 Z. Wang and A. C. Bovik, "A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002.   DOI   ScienceOn
26 Original codes of ST-GSM: https://ece.uwaterloo.ca/-z70wang/research/stgsm/
27 Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.   DOI   ScienceOn
28 Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Process.: Image Commun., vol. 19, no.2, pp. 121-132, Feb. 2004.   DOI   ScienceOn
29 Z. Wang and A. C. Bovik, "Mean squared error: Love it or leave it? A new look at signal fidelity measures," IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
30 Original codes of VBM3D: http://www.cs.tut.fi/-foi/GCF-BM3D/
31 Video Sequence Database: http://media.xiph.org/video/derf/
32 X. Li and Y. Zheng, "Patch-based video processing: A variational Bayesian approach," IEEE Trans. on Circuits Syst. Video Tech., vol. 19, no. 1, pp. 27-40, Jan. 2009.   DOI   ScienceOn
33 A. Buades, B. Coll, and J. Morel, "Nonlocal image and movie denoising," Int. J. Comput. Vision, vol. 76, no. 2, pp. 123-139, 2008.   DOI   ScienceOn
34 M. Protter, and M. Elad, "Image sequence denoising via sparse and redundant representations," IEEE Trans. on Image Process., vol. 18, no. 1, pp. 27-35, Jan. 2009.   DOI   ScienceOn
35 M. Elad, and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. on Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006.   DOI   ScienceOn