Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

High-Resolution Image Reconstruction Considering the Inaccurate Sub-Pixel Motion Information

부정확한 부화소 단위의 움직임 정보를 고려한 고해상도 영상 재구성 연구

  • Park, Jin-Yeol (Dept.of Electric Electronics Engineering, Yonsei University) ;
  • Lee, Eun-Sil (Dept.of Electric Electronics Engineering, Yonsei University) ;
  • Gang, Mun-Gi (Dept.of Electric Electronics Engineering, Yonsei University)
  • 박진열 (연세대학교 전기전자공학과) ;
  • 이은실 (연세대학교 전기전자공학과) ;
  • 강문기 (연세대학교 전기전자공학과)
  • Published : 2001.03.01
Download PDF
⟨ Previous Next ⟩

Abstract

The demand for high-resolution images is gradually increasing, whereas many imaging systems have been designed to allow a certain level of aliasing during image acquisition. Thus, digital image processing approaches have recently been investigated to reconstruct a high-resolution image from aliased low-resolution images. However, since the sub-pixel motion information is assumed to be accurate in most conventional approaches, the satisfactory high-resolution image cannot be obtained when the sub-pixel motion information is inaccurate. Therefore, in this paper we propose a new algorithm to reduce the distortion in the reconstructed high-resolution image due to the inaccuracy of sub-pixel motion information. For this purpose, we analyze the effect of inaccurate sub-pixel motion information on a high-resolution image reconstruction, and model it as zero-mean additive Gaussian errors added respectively to each low-resolution image. To reduce the distortion we apply the modified multi-channel image deconvolution approach to the problem. The validity of the proposed algorithm is both theoretically and experimentally demonstrated in this paper.

고해상도 영상에 대한 요구는 점점 더 증가되고 있지만, 기존의 영상 시스템들이 어느 정도의 엘리어싱을 발생하기 때문에 해상도의 저하가 생긴다. 따라서 엘리어싱이 발생한 다수의 저해상도 영상들을 사용하여 하나의 고해상도 영상을 재구성해 내는 디지털 영상 처리기법이 연구되어 왔다. 기존의 연구들은 저해상도 영상들간의 부화소 단위의 움직임 정보가 정확하다고 가정하였기 때문에, 움직임 정보가 정확하지 않은 경우에 대해서는 만족할 만한 고해상도 영상을 얻을 수 없었다. 따라서 본 논문에서는 부화소 단위의 움직임 정보가 정확하지 않기 때문에 생긴 고해상도 영상 내의 왜곡을 줄일 수 있는 알고리즘을 제안하고자 한다. 이를 위해 정확하지 않은 부화소 단위의 움직임 정보가 고해상도 영상 재구성에 미치는 영향을 분석하고, 이를 각각의 저해상도 영상에 대하여 가우시안 오류가 첨가된 것으로 모델링하였다. 그리고 고해상도 영상 내의 왜곡을 줄이기 위해서 다중채널 디컨벌루션 기법을 수정하여 적용하였다. 본 논문에서 제안된 알고리즘의 타당성은 이론 및 실험을 통하여 검증할 수 있었다.

Keywords

References

  1. K. Aizawa and T. Komatsu and T. Saito, 'A scheme for acquiring very high resolution images using multiple cameras', in Proc. IEEE Int. Conf. Acoust. Speech, Signal Processing, San Francisco, CA, vol.III, pp.289-292, 1992 https://doi.org/10.1109/ICASSP.1992.226244
  2. Y. Nakazawa and T. Saito and T. Komatsu and K. Aizawa, 'Two Approaches for Image-Processing Based High Resolution Image Acquisition', in Proc. IEEE Int. Conf. Image Processing, Austin, TX, vol.III, pp.147-151, Nov. 1994 https://doi.org/10.1109/ICIP.1994.413870
  3. S. P. Kim and N. K. Bose and H. M. Valenzuela, 'Recursive reconstruction of high resolution image from noisy undersampled multiframes', IEEE Trans. Acoust., Speech, Signal Processing, vol.38,no.6, pp.1013-1027, June 1990 https://doi.org/10.1109/29.56062
  4. Jin Yeol Park, Seunghyeon Rhee, and Moon Gi Kang, 'Multichannel dealiasing technique for superresolution,' Proc. ITC-CSCC, Sokcho, Korea, vol.1, pp. 35-38, July 14, 1998
  5. Seunghyeon Rhee and Moon Gi Kang, 'DCT-based Regularized High-Resolution Image Reconstruction Algorithm,' Opt. Eng., vol. 38, no.8, pp. 1348-1356, Aug. 1999 https://doi.org/10.1117/1.602177
  6. A. M. Tekalp and M. K. Ozkan and M. I. Sezan, 'High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration', in Proc. IEEE Int. Conf. Image Processing, San Francisco, CA, vol.III, pp.169-172, 1992 https://doi.org/10.1109/ICASSP.1992.226249
  7. H. Stark and P. Oskoui, 'High-resolution image recovery from image-plane arrays, using convex projections', J. Opt. Soc. Ammer. A, vol.6, no.11, pp.1715-1726, Nov.1989
  8. M. Irani and S. Peleg, 'Improving resolution by image registration', Comput. Vis., Graphics, Image Processing: Graphical Models and Image Processing, vol.53, no.3, pp.231-239, May 1991 https://doi.org/10.1016/1049-9652(91)90045-L
  9. M. G. Kang and A. K. Katsaggelos, 'General Choice of the Regularization Functional in Regularized Image Restoration', IEEE Trans. Image Processing, vol.4, no.5, pp.594-602, May 1995 https://doi.org/10.1109/83.382494
  10. M. G. Kang and A. K. Katsaggelos, 'Simultaneous multichannel image restoration and estimation of the regularization parameters', IEEE Trans. Image Processing, vol.6, no.5, pp.774-778, May 1997 https://doi.org/10.1109/83.568936
  11. M. G. Kang, 'Generalized multichannel deconvolution approach and its applications', Optical Engineering, vol.37, no.11,pp.2953-2964, Nov. 1998 https://doi.org/10.1117/1.601883
  12. A. K. Katsaggelos, J. Biemond, R. W. Schafer, and R. M. Mersereau, 'A regularized iterative image restotation algorithm', IEEE Trans. Signal Processing, vol.39, pp.914-929, Apr. 1991 https://doi.org/10.1109/78.80914
  13. S. J. Reeves and R. M. Mersereau, 'Optimal estimation of the regularization parameters and stabilizing functional for regularized image restoration', Optical Engineering, vol.29, pp.446-454, May, 1990 https://doi.org/10.1117/12.55613