High-resolution image restoration based on image fusion

영상융합 기반 고해상도 영상복원

  • Shin Jeongho (Image Processing and Intelligent Systems Laboratory, Department of Image Engineering, Graduate School of Advance Imaging Science, Multimedia, and Film, Chung-Ang University) ;
  • Lee Jungsoo (Image Processing and Intelligent Systems Laboratory, Department of Image Engineering, Graduate School of Advance Imaging Science, Multimedia, and Film, Chung-Ang University) ;
  • Paik Joonki (Image Processing and Intelligent Systems Laboratory, Department of Image Engineering, Graduate School of Advance Imaging Science, Multimedia, and Film, Chung-Ang University)
  • 신정호 (중앙대학교 첨단영상대학원 영상공학과 시각 및 지능시스템 연구실) ;
  • 이정수 (중앙대학교 첨단영상대학원 영상공학과 시각 및 지능시스템 연구실) ;
  • 백준기 (중앙대학교 첨단영상대학원 영상공학과 시각 및 지능시스템 연구실)
  • Published : 2005.06.01

Abstract

This paper proposes an iterative high-resolution image interpolation algorithm using spatially adaptive constraints and regularization functional. The proposed algorithm adapts adaptive constraints according to the direction of..edges in an image, and can restore high-resolution image by optimizing regularization functional at each iteration, which is suitable for edge directional regularization. The proposed algorithm outperforms the conventional adaptive interpolation methods as well as non-adaptive ones, which not only can restore high frequency components, but also effectively reduce undesirable effects such as noise. Finally, in order to evaluate the performance of the proposed algorithm, various experiments are performed so that the proposed algorithm can provide good results in the sense of subjective and objective views.

본 논문에서는 공간 적응적 제약조건과 정칙화 함수를 이용한 반복적 고해상도 영상보간 기법을 제안한다. 제안된 정칙화 영상보간 알고리듬은 에지 방향에 따라 제약조건들을 적응적으로 적용하고, 각각의 반복 연산 단계에서 에지 방향별 정칙화에 적합한 정칙화 함수를 최적화하여 고해상도 영상보간을 구현한다. 제안한 알고리즘은 기존의 비적응적 정칙화 보간 방법뿐만 아니라 적응적 보간 방법보다도 방향성 고주파 성분을 적절히 보존하는 동시에 잡음과 같은 바람직하지 못한 효과들을 억제할 수 있다. 마지막으로 본 논문에서 제안한 알고리듬의 성능평가를 위해서 기존에 제안된 여러 가지의 고해상도 영상보간 알고리듬과의 다양한 비교실험을 수행하였고, 이를 통하여 제안한 고해상도 영상보간 기법이 주관적으로나 객관적으로 우수함을 보였다.

Keywords

References

  1. A. K. Jain, Fundamentals of Digital Image Processing, Prentice-Hall, 1989
  2. M. Unser, A. Aldroubi, and M. Eden, 'Fast B-spline trasnforms for continous image representation and interpolation,' IEEE Trans. Pattern Analysis, Machine Intelligence, Vol. 13, No.3, pp.277-285, Mar. 1991 https://doi.org/10.1109/34.75515
  3. J. A. Parker, R. V. Kenyon, and D. E. Troxel, 'comparison of interplating methods for image resampling,' IEEE Trans. Med. Imaging, Vol. 2, No.1, pp. 31-39, Mar. 1983
  4. K. P. Hong, J. K. Paik, H. J. Kim, and C. H. Lee, 'An edge-preserving image interpolation system for a digital camcoder,' IEEE Trans. Consumer Electronics, Vol. 42, No.3, pp. 279-284, Aug. 1996 https://doi.org/10.1109/30.536121
  5. S. P. Kim, H. K. Bose, and H. M. Valenzuela, 'Recursive reconstruction of high-resolution image from noisy undersampled frames,' IEEE Trans. Acounst., Speech, Signal Processing, Vol. 38, pp. 1013-1027, Jun. 1990 https://doi.org/10.1109/29.56062
  6. A. Patti, M. I. Sezan, and A. M. Tekalp, 'High-resolution image reconstruction from a low-resolution image sequence in the presence of time varying motion blur,' Proc. 1994 Int. Conf. Image Processing, Nov. 1994
  7. M. C. Hong, M. G. Kang, and A. K. Katsaggelos, 'An iterative weighted regularized algorithm for improving the resolution of video sequences,' Proc. 1997Int. Conf. Image Processing, Vol. 2, pp. 474-477, Oct. 1997
  8. B. C. Tom and A. K. Katsaggelos, 'An iterative algorithm for improving the resolution of video sequences,' Proc. SPIE Visual Comm., Image Proc., pp. 1430-1438, Mar. 1996
  9. R. R. Schulz and R. L. Stevenson, 'A bayesian approach to image expansion for improved definition,' IEEE Trans. Image Processing, Vol. 3, No.3, pp. 233-242, May. 1994 https://doi.org/10.1109/83.287017
  10. A. J. Patti, M.I. Sezan, and A. M. Tekalp, 'High-resolution standards conversion of low resolution video,' Proc. 1995 Int. Conf. Acoust., Speech, Signal Processing, pp. 2197-2200, 1995
  11. A. M. Thompson, J. C. Brown, J. W. Kay, and D. M. Titterington, 'A study of methods of choosing the smoothing parameter in image restoration by regularization,' IEEE Trans.Pattern Analy. Mach. Intell., Vol. 13, No.4, pp.326-339, Apr. 1991 https://doi.org/10.1109/34.88568
  12. M. G. Kang and A. K. Katsaggelos, 'Simultaneous iterative restoration and evaluation of the regularization parameter,' IEEE Trans. Signal Processing, Vol. 40, pp. 2329-2334, Sep. 1992 https://doi.org/10.1109/78.157234
  13. M. G. Kang and A. K. Katsaggelos, 'General choice of the regularization functional in regularized image restoration,' IEEE Trans. Image Processing, Vol. 4, No.5, pp. 594-602, May. 1995 https://doi.org/10.1109/83.382494
  14. E. S. Lee and M. G. Kang, 'Regularized adaptive high-resolution image reconstruction considering inaccurate subpixe1 registration,' IEEE Trans. Image Processing, Vol. 12, No.7, Jul. 2003
  15. M. G. Kang, 'Generalized multichannel deconvolution approach and its applications,' SPIE Optical Engineering, Vol. 37, No. 11, pp. 2953-2964, Nov. 1998
  16. A. K. Katsaggelos, 'Iterative image restoration algorithms,' Optical Engineering, Vol. 28, pp. 735-748, Jul. 1989
  17. A. K. Katsaggelos, J. Biemond, R. W. Schafer, R. M. Mersereau, 'A regularized Iterative image restoration algorithms,' IEEE Trans. Signal Processing, Vol. 39, No.4, pp. 914-929, Apr. 1991 https://doi.org/10.1109/78.80914