Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Patch based Multi-Exposure Image Fusion using Unsharp Masking and Gamma Transformation

언샤프 마스킹과 감마 변환을 이용한 패치 기반의 다중 노출 영상 융합

  • Kim, Jihwan (Department of Intelligent robot engineering, Hanyang university) ;
  • Choi, Hyunho (Department of Intelligent robot engineering, Hanyang university) ;
  • Jeong, Jechang (Department of Intelligent robot engineering, Hanyang university)
  • 김지환 (한양대학교 지능형로봇학과) ;
  • 최현호 (한양대학교 지능형로봇학과) ;
  • 정제창 (한양대학교 지능형로봇학과)
  • Received : 2017.08.25
  • Accepted : 2017.10.31
  • Published : 2017.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an unsharp masking algorithm using Laplacian as a weight map for the signal structure and a gamma transformation algorithm using image mean intensity as a weight map for mean intensity. The conventional weight map based on the patch has a disadvantage in that the brightness in the image is shifted to one side in the signal structure and the mean intensity region. So the detailed information is lost. In this paper, we improved the detail using unsharp masking of patch unit and proposed linearly combined the gamma transformed values using the average brightness values of the global and local images. Through the proposed algorithm, the detail information such as edges are preserved and the subjective image quality is improved by adjusting the brightness of the light. Experiment results show that the proposed algorithm show better performance than conventional algorithm.

본 논문에서는 신호 구조에 가중치 맵으로써 Laplacian을 이용한 언샤프 마스킹과 평균 밝기에 가중치 맵으로써 영상의 평균 밝기를 이용한 감마 변환 알고리듬을 제안하고자 한다. 패치를 기반으로 한 기존의 가중치 맵은 신호 구조 및 평균 밝기 영역에서 영상 내 밝기 값이 한쪽으로 치우쳐 세부 정보가 손실되는 단점이 있다. 본 논문에서는 패치 단위의 언샤프 마스킹을 이용하여 세부정보를 향상시켰고, 전역적 및 지역적 영상의 평균 밝기 값을 이용하여 감마 변환된 값을 선형 결합한 기법을 제안한다. 제안하는 알고리듬은 영상 내 윤곽선과 같은 세부 정보를 보존시키고 빛의 밝기 조절을 통해 주관적 화질을 향상시켰다. 실험 결과를 통해 기존 알고리듬에 비해 제안한 알고리듬이 우수한 성능을 나타내는 것을 확인하였다.

Keywords

References

  1. S. Jeong, and M. Jeong, "Histogram Equalization using Gamma Transformation," Journal of Computing Science and Engineering, Vol. 20, No.12, pp. 646-651, 2014.
  2. R. C. Gonzalez, and R. E. Woods. Digital image processing, Pearson, New Jersey, 2010.
  3. S, Hwang, Image processing programming by Visual C++, Hanbit media, 2007.
  4. G. Ramponi, N. Strobel, S. K. Mitra, and T. Yu, "Nonlinear unsharp masking methods for image contrast enhancement", J. Electron. Imag., Vol. 5, pp. 353-366, July 1996. https://doi.org/10.1117/12.242618
  5. T. Luft, C. Colditz, and O. Deussen, "Image Enhancement by Unsharp Masking the Depth Buffer," ACM Transactions on Graphics, vol. 25, No. 3, pp. 1206-1213, July 2006. https://doi.org/10.1145/1141911.1142016
  6. E. Reinhard, W. Heidrich, P. Debevec, S. Pattanaik, G. Ward, and K. Myszkowski, High Dynamic Range Imaging: Acquisition, Display, and Image-based Lighting, Morgan Kaufmann, 2010.
  7. P. J. Burt, The pyramid as a structure for efficient computation in Multi resolution Image Processing and Analysis, Berlin, Germany: Springer-Verlag, 1984.
  8. K. Ma, K. Zeng, and Z. Wang, "Perceptual quality assessment for multi-exposure image fusion," IEEE Transactions on Image Processing, Vol. 24, No. 11, pp. 3345-3356, 2015. https://doi.org/10.1109/TIP.2015.2442920
  9. S. Li, and X. Kang, "Fast multi-exposure image fusion with median filter and recursive filter," IEEE Trans. Consum. Electron, Vol. 58, No. 2, pp. 626-632, May 2012. https://doi.org/10.1109/TCE.2012.6227469
  10. B. Gu, W. Li, J. Wong, M. Zhu, and M. Wang, "Gradient field multi-exposure images fusion for high dynamic range image visualization, " J. Vis. Commun. Image Represent, Vol. 23, No. 4, pp. 604-610, 2012. https://doi.org/10.1016/j.jvcir.2012.02.009
  11. S. Raman, and S. Chaudhuri, "Bilateral filter based compositing for variable exposure photography," Proc. Eurographics, pp. 1-4, 2009.
  12. T. Mertens, J. Kautz, and F. Van Reeth, "Exposure fusion: A simple and practical alternative to high dynamic range photography," Computer Graphics Forum, Vol. 28, No. 1, pp. 161-171, 2009. https://doi.org/10.1111/j.1467-8659.2008.01171.x
  13. P. J. Burt, and R. J. Kolczynski, "Enhanced image capture through fusion," Proc. 4th IEEE ICCV, pp. 173-182, May 1993.
  14. M. Song, D.Tao, C. Chen, J.Luo, and C. Zhang, "Probabilistic exposure fusion," IEEE Transactions on Image Processing, Vol. 21.1, pp.341-357, 2012. https://doi.org/10.1109/TIP.2011.2157514
  15. K. Ma, and Z. Wang, "Multi-exposure image fusion: A patch-wise approach," IEEE International Conference on Image Processing, pp.1717-1721, 2015.
  16. Y. Liu, and Z. Wang, "Dense sift for ghost-free multi exposure fusion," Journal of Visual Communication and Image Representation, vol.31, pp. 208-224, 2015. 4 https://doi.org/10.1016/j.jvcir.2015.06.021