Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Video De-noising Using Adaptive Temporal and Spatial Filter Based on Mean Square Error Estimation

MSE 추정에 기반한 적응적인 시간적 공간적 비디오 디노이징 필터

  • Jin, Changshou (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Kim, Jongho (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Choe, Yoonsik (School of Electrical and Electronic Engineering, Yonsei University)
  • 김창수 (연세대학교 전기전자공학부) ;
  • 김종호 (연세대학교 전기전자공학부) ;
  • 최윤식 (연세대학교 전기전자공학부)
  • Received : 2012.08.06
  • Accepted : 2012.11.09
  • Published : 2012.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, an adaptive temporal and spatial filter (ATSF) based on mean square error (MSE) estimation is proposed. ATSF is a block based de-noising algorithm. Each noisy block is selectively filtered by a temporal filter or a spatial filter. Multi-hypothesis motion compensated filter (MHMCF) and bilateral filter are chosen as the temporal filter and the spatial filter, respectively. Although there is no original video, we mathematically derivate a formular to estimate the real MSE between a block de-noised by MHMCF and its original block and a linear model is proposed to estimate the real MSE between a block de-noised by bilateral filter and its original block. Finally, each noisy block is processed by the filter with a smaller estimated MSE. Simulation results show that our proposed algorithm achieves substantial improvements in terms of both visual quality and PSNR as compared with the conventional de-noising algorithms.

본 논문에서는 영상에 포함되어 있는 잡음을 효율적으로 제거하기 위해 원본 영상과 잡음이 포함된 영상 사이의 mean square error (MSE) 추정에 기반한 적응적인 시공간 디노이징 필터(Adaptive Temporal and Spatial De-noising Filter : ATSF)를 제안하였다. 제안하는 디노이징 필터는 잡음이 포함되어 있는 영상에 블록 단위로 적용되며, 시간적 필터인 Multi-Hypothesis Motion Compensated Filter (MHMCF)를 사용하고, 공간적 필터로는 bilateral filter를 사용하였다. 각각의 블록에 대해 시간적 필터와 공간적 필터 중에서 최적의 필터를 선택하기 위해서 잡음이 포함되지 않은 원본 영상과 잡음이 포함된 입력 영상 사이의 MSE를 추정하는 기법을 제안하였다. 디노이징 단계에서 원본 영상이 주어지지 않기 때문에 MSE를 추정하기 위해서, 본 논문에서는 MHMCF가 적용된 블록의 MSE를 수학적으로 예측하고, bilateral filter가 적용된 블록의 MSE를 통계적 선형 모델을 통해 예측하였다. 이렇게 예측된 MSE를 비교하여 더 작은 MSE를 갖는 필터를 선택적으로 매 단위 블록마다 적용하게 된다. 제안된 방법은 시간적 필터와 공간적 필터를 적응적으로 적용함으로써 기존의 디노이징 방법에 비해 객관적 화질 뿐만 아니라 주관적인 화질에서 우수한 성능을 보여준다.

Keywords

References

  1. J.Woods and C. Radewan, "Kalman filtering in two dimensions," IEEE Trans. Inf. Theory., vol. 23, no. 7, pp. 473-482, Jul.1977. https://doi.org/10.1109/TIT.1977.1055750
  2. F. Jin, P. Fieguth, L. Winger, and E. Jernigan, "Adaptive wiener filtering of noisy images and image sequences," in Proc. IEEE Int. Conf. on Image Process., pp. 349-352, Sep.2003.
  3. D. L. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inf. Theory., vol. 41, no. 5, pp. 613-627, May. 1995. https://doi.org/10.1109/18.382009
  4. A. Buades, B. Coll, and J. M. Morel, "A non-local algorithm for image denoising," in Proc. IEEE Computer Soc. Conf. on Comput. Vision and Pattern Recog., pp. 60-65, Jun.2005.
  5. TOMASI C., MANDUCHI R.: "Bilateral filtering for gray and color images," Sixth Int. Conf. on Computer Vision., pp. 839-846, 1998.
  6. MING Z., GUNTURK B.K.: "Multiresolution bilateral filtering for image denoising", IEEE Trans. Image Process., 17, pp. 2324-2333, 2008. https://doi.org/10.1109/TIP.2008.2006658
  7. LI Y., YANFENG Q.:"Novel adaptive temporal filter based on motion compensation for video noise reduction," Int. Symp. on Communications and Information Technologies, ISCIT.', pp. 1031-034, 06, 2006.
  8. GUO L., AU O.C., MA M., LIANG Z.:"Temporal video denoising based on multihypothesis motion compensation," IEEE Trans. Circuits Syst. Video Technol.,17, p. 1423, 2007. https://doi.org/10.1109/TCSVT.2007.903797
  9. A. J. Patti, A. M. Tekalp, and M. I. Sezan, "A new motion-compensated reduce-order model Kalman filter for space-varying restoration of progressive and interlaced video," IEEE Trans. Image Process., vol.7, no.4, pp. 543-554, Apr. 1998. https://doi.org/10.1109/83.663499
  10. E. J. Balster,Y. F. Zheng, and R. L. Ewing, "Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 2, pp. 220-230, Feb.2006. https://doi.org/10.1109/TCSVT.2005.857816
  11. R. Dugad and N. Ahuja, "Video denoising by combining Kalman and wiener estimates," in Proc. IEEE Int. Conf. on Image Process., pp. 152-156, Oct. 1999.
  12. D. H. Shin, R. H. Park, S. Yang, and J. H. Jung, "Block-based noise estimation using adaptive Gaussian filtering," IEEE Trans. on Consumer Electronics., vol. 51, No. 1, pp. 218-226, 2005. https://doi.org/10.1109/TCE.2005.1405723
  13. A. Bosco, A. Bruna, G. Messina, and G. Spampinato, "Fast method for noise level estimation and integrated noise reduction," IEEE Trans. On Consumer Electronics., vol. 51 , No. 3, pp. 1028-1033, 2005. https://doi.org/10.1109/TCE.2005.1510518