Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Spatial Resolution and Dynamic Range Enhancement Algorithm using Multiple Exposures

복수 노출을 이용한 공간 해상도와 다이내믹 레인지 향상 알고리즘

  • Choi, Jong-Seong (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Han, Young-Seok (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Kang, Moon-Gi (School of Electrical and Electronic Engineering, Yonsei University)
  • 최종성 (연세대학교 전기전자공학과 TMS 정보기술사업단) ;
  • 한영석 (연세대학교 전기전자공학과 TMS 정보기술사업단) ;
  • 강문기 (연세대학교 전기전자공학과 TMS 정보기술사업단)
  • Published : 2008.11.25
Download PDF
⟨ Previous Next ⟩

Abstract

The approaches to overcome the limited spatial resolution and the limited dynamic range of image sensors have been studied independently. A high resolution image is reconstructed from multiple low resolution observations and a wide dynamic range image is reconstructed from differently exposed multiple low dynamic range in es based on signal processing approach. In practical situations, it is reasonable to address them in a unified context because the recorded image suffers from limitations of both spatial resolution and dynamic range. In this paper, the image acquisition process including limited spatial resolution and limited dynamic range is modelled. With the image acquisition model, the response function of the imaging system is estimated and the single image of which spatial resolution and dynamic range are simultaneously enhanced is obtained. Experimental results indicate that the proposed algorithm outperforms the conventional approaches that perform the high resolution and wide dynamic range reconstruction sequentially with respect to both objective and subjective criteria.

이미지 센서의 물리적 한계 가운데 공간 해상도의 제약과 다이내믹 레인지의 제약을 극복하기 위한 방법 가운데 신호처리기법에 기반하여 여러 장의 저해상도 영상으로부터 고해상도 영상을 복원하는 것과, 다이내믹 레인지가 좁은 여러 장의 영상으로부터 넓은 다이내믹 레인지를 갖는 영상을 복원하는 방법이 있다. 하지만, 일반적으로 실제 영상을 획득하는 과정에서 공간 해상도와 다이내믹 레인지의 제약을 동시에 받게 되므로, 이 두 제약을 동시에 극복하는 연구가 필요하다. 본 논문에서는 영상 장치의 응답 함수의 추정과 함께 공간 해상도와 다이내믹 레이지를 동시에 향상시킬 수 있는 알고리즘을 제안한다. 이를 위해 영상의 공간 해상도 제한과, 다이내믹 레인지의 제약을 포함하는 영상 획득 과정을 모델링하고, 이 영상 획득 모델을 기반으로 하여 영상 입력 장치의 응답 함수를 추정하고, 영상의 공간 해상도와 다이내믹 레인지를 동시에 향상시킬 수 있는 알고리즘을 제안한다. 실험 결과를 통해 제안된 알고리즘이 기존의 고해상도 복읜 알고리즘과 와이드 다이내믹 레인지 영상 복원을 연속적으로 처리한 결과보다 시각적, 수치적으로 더 좋은 결과를 보여줌을 확인할 수 있다.

Keywords

References

  1. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction : A technical overview", IEEE Signal Processing Magazine, pp. 21-36, May, 2003
  2. L. J. van Viley and C. L. L. Hendriks, "Improving spatial resolution in exchange of temporal resolution in aliased image sequences", Proc. of 11th Scandinavian Conf. on Image Analysis, pp. 493-499, 1999
  3. R. Y. Tsai and T. S. Huang, "Multipleframe image restoration and registration", Advances in Computer Vision and Image Processing, 1, pp 317-339, 1984
  4. S. H. Rhee and M. G. Kang, "Discrete cosine transform based regularized high-resolution image reconstruction algorithm", Optical Engineering, 38(8), pp. 1348-1356, 1999 https://doi.org/10.1117/1.602177
  5. M. C. Hong, M. G. Kang, and A. K. Katsaggelos, "An iterative weighted regularized algorithm for improving the resolution of video sequences", Proc. International Conference on Image Processing, 2, pp. 474-477, 1997
  6. M. G. Kang, "Generalized multichannel image deconvolution approach and its applications", Optical Engineering, 37(11), pp. 2953-2964, 1998 https://doi.org/10.1117/1.601883
  7. R. C. Hardie, K. J. Barnard, J. G. Bognar, E. E. Armstrong, and E. A. Watson, "High-resolution image reconstruction from a sequence of rotated and translated frames and its application to an infrared imaging system", Optical Engineering, 37(1), pp. 247-260, 1998 https://doi.org/10.1117/1.601623
  8. P. E. Eren, M. I. Sezan, and A. M. Tekalp, "Robust, object based high-resolution image reconstruction from low-resolution video", IEEE Trans. on Image Processing, 6(10), pp. 1446-1451, 1997 https://doi.org/10.1109/83.624970
  9. A. J. Patti and Y. Altunbasak, "Artifact reduction for set theoretic super resolution image reconstruction with edge adaptive constraints and higher-order interpolants", IEEE Trans. on Image Processing, 10(1), pp. 179-186, 2001 https://doi.org/10.1109/83.892456
  10. P. E. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs", SIGGRAPH 97 Conference proceedings, pp. 369-378. Aug. 1997
  11. Technical Report MS-CIS-93-96, "Extended Intensity Range Imaging", Grasp Laboratory, Univ. of Pennsylvania, 1993
  12. M. Aggarwal, N. Ahuja, "Split aperture imaging for high dynamic range". Proc. IEEE International Conference on Computer Vision, 2001. (ICCV 2001.), pp. 10-17, Jul. 2001
  13. S. k. Nayar and T. Mitsunaga, "High dynamic range imaging: spatially varying pixel exposures", Proc. IEEE Conference on Computer Vision and Pattern Recognition 2000, pp. 472-479, Jun. 2000
  14. C. Kolb, D. Mitchell, P. Hanrahan, "A Realistic Camera Model for Computer Graphics", Computer Graphics, Proceedings of SIGGRAPH '95, pp. 317-324, 1995
  15. M. A. Robertson, S. Borman, and R. L. Stevenson, "Dynamic Range Improvement through Multiple Exposures", Proc. IEEE International Conference on Image Processing 1999. (ICIP 99.), 3, pp. 159-163, Oct. 1999
  16. T. Tani, "Photography Sensitivity : Theory and Mechanisms", Oxford University Press, 1995