Reconstruction of HR by POCS and Regularized Block Matching

정규화된 블록매칭과 POCS에 의한 HR 영상 재구성

  • 최종범 (서울시립대학교 전자전기컴퓨터공학부 컴퓨터비전연구실) ;
  • 오태석 (서울시립대학교 전자전기컴퓨터공학부 컴퓨터비전연구실) ;
  • 김용철 (서울시립대학교 전자전기컴퓨터공학부 컴퓨터비전연구실)
  • Published : 2005.08.01

Abstract

In the reconstruction of high resolution (HR) images from low resolution (LR) images frames, the error in the estimated motion degrades the reliability of the reconstructed HR image. Some methods were recently proposed where motion estimation and HR reconstruction is performed simultaneously. The estimated motion is still prone to error when it is based on a simple block matching. In this paper, we propose a reconstruction of a HR image by applying POCS and a regularized block matching simultaneously. In this method, a motion vector is obtained from a regularized block matching algorithm since the motion of a pixel in an image is highly correlated with the motion in neighboring regions. Experimental results show that the improved accuracy of the estimated motion vectors results in higher PSNR of the reconstructed HR images.

LR 영상을 이용하는 HR 영상 재구성에서 추정된 움직임 벡터의 오류는 재구성된 영상의 화질을 저하시킨다. 이를 해결하기 위해 움직임 추정과 HR 영상의 추정을 동시에 하는 방법들이 제안되었으나, 블록 정합법과 같은 간단한 방법을 사용하는 경우 추정된 움직임 벡터에는 여전히 오류가 발생한다. 본 논문에서는 정규화된 움직임 추정과 POCS를 이용한 HR 영상 재구성을 동시에 하는 IBR 재구성 방법을 제안한다. 이 방법에서는 어느 한 화소의 움직임 벡터가 이웃의 움직임 벡터들과 연관성이 있음을 이용하여 블록 정합법에 정규화를 적용하여 움직임 추정이 이루어진다. 제안된 방법을 사용한 실험 결과 종래의 방법에 비하여 움직임 추정이 개선되었으며 이에 따라서 재구성된 고해상도 영상의 화질과 PSNR이 현저히 개선되었다.

Keywords

References

  1. Andrew J. Patti, et al., 'Super Resolution Video Reconstruction with Arbitrary Sampling Lattices and Non-zero Aperture Time', IEEE Trans. Circuits and Systems for Technology. Vol. XX, No. Y, 1999
  2. S. C. Park et. al., 'Super-Resolution Image Reconstruction: A Technical Overview', IEEE Signal Processing Magazine, May, 2003
  3. A. Murat Tekalp, et aI., 'High-Resolution Image Reconstruction From Lower-Resolution Image Sequences And Space-Varying Image Restoration', IEEE ICASSP-92, Vol.3, pp.169-172, 1992
  4. Henry Stark, 'Theory Of Convex Projection And Its Application To Image Restoration', IEEE ISCAS'88, 1988
  5. 강수원, 이승준, 양경호, 이충웅, 'POCS를 이용한 벡터양자화영상의 복원', 대한전자공학회 추계종합학술대회 논문집 제 17권 제2호, 1994.11
  6. Sean Borman, Robert Stevenson, 'Spatial Resolution Enhancement of Low-Resolution Image Sequences. A Comprehensive Review with Directions for Future Research', Lab. Image and Signal Analysis, University of Notre Dame, Tech. Rep., 1998
  7. Javier Mateos, Aggelos K. Katsaggelos and Rafael Molina, 'Simultaneous Motion Estimation and Resolution Enhancement of Compressed Low Resolution Video', IEEE, 2000
  8. Russell C. Hardie, et aI., 'Joint MAP Registration and High-Resolution Image Estimation Using a Sequence of Undersampled Images', IEEE Trans. on Image Processing, VoI.6, No. 12, 1997
  9. S. P. Kim, et aI., 'Recursive Reconstruction of High Resolution Image From Noisy Undersampled Multiframes', IEEE Trans. on Acoustics, Speech and Signal Proc. Vol.38, No.6. June, 1990
  10. Sung Park, et aI., 'Spatially Adaptive High-Resolution Image Reconstruction of LowResolution DCT-Based Compressed Images', IEEE ICIP 2002
  11. Yucel Altunbasak, et aI., 'Super-Resolution Still and Video Reconstruction From MPEGCoded Video', IEEE Trans. on Circuits and Systems for Video Tech., Vol. 12, No.4, 2002
  12. Richard R. Schultz and Robert L. Stevenson, 'Extractionof High-Resolution Frames from Video Sequences', IEEE Trans. on Image Processing, Vol. 5, No.6, June 1996
  13. Richard R. Schultz and Robert L. Stevenson, 'Bayesian Estimation of Subpixel-Resolution Motion Fiedls and High-Resolution Video Stills', IEEE, 1997
  14. 김윤, 정재한, 김재원, 고성제, 'POCS를 이용한 효과적인 블록 현상 제거 기법', 신호처리합동학술대회 논문집, 제14권, 제1호, pp.755-758, Sep. 2001
  15. A. Murat Tekalp, 'Digital video processing', Prentice Hall PTR, 1995
  16. S. H. Rhee, M. G. Kang, 'DCT-Based Regularized Algorithm for High-Resolution Image Reconstruction', IEEE, 1999