전자공학회논문지 (Journal of the Institute of Electronics and Information Engineers)

  • 제52권1호
  • /
  • Pages.111-120
  • /
  • 2015
  • /
  • 2287-5026(pISSN)
  • /
  • 2288-159X(eISSN)
대한전자공학회 (The Institute of Electronics and Information Engineers)
권호 표지
DOI QR코드

DOI QR Code

밝기 비트맵과 색도 일관성을 이용한 무 잔상 High Dynamic Range 영상 생성

Ghost-free High Dynamic Range Imaging Based on Brightness Bitmap and Hue-angle Constancy

  • Yuan, Xi (School of Electronics Engineering, Kyungpook National University) ;
  • Ha, Ho-Gun (School of Electronics Engineering, Kyungpook National University) ;
  • Lee, Cheol-Hee (Computer Engineering, Andong National University) ;
  • Ha, Yeong-Ho (School of Electronics Engineering, Kyungpook National University)
  • 투고 : 2014.08.06
  • 심사 : 2014.12.29
  • 발행 : 2015.01.25
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

HDR(high dynamic range) 영상 생성은 실세계의 고명암비 영상을 재현하는 방법이다. Exposure fusion은 여러 HDR 영상 생성방법 중 한 가지로 true-HDR 영상을 생성하지 않고, 바로 pseudo-HDR 영상을 생성하는 방법이다. 그러나 노출이 다른 여러 입력영상들 중에서 이동하는 물체가 존재하면 잔상 효과가 발생하여 pseudo-HDR 영상의 화질 열화를 가져온다. 이러한 단점을 해결하기 위해 본 논문에서는 시간 영역에서 일치성 평가를 통한 무 잔상 exposure fusion을 제안하였다. 먼저 다중 역치 및 밝기를 이용한 비트맵과 색도 일관성 맵을 이용하여 각 입력 영상들간의 일치성을 평가하였고, 이를 시간 영역 가중치 맵으로 나타내었다. 그리고 기존 exposure fusion에서의 공간 영역 가중치 맵과 결합하여 최종 가중치 맵을 생성하였다. 마지막으로 각각 입력 영상에 최종 가중치 맵을 적용한 후, 합성하여 잔상이 제거된 pseudo-HDR 영상을 생성하였다. 실험을 통해 제안된 방법의 pseudo-HDR이 기존의 방법보다 잔상이 더 많이 제거되어 화질이 개선됨을 확인하였고, 객관적인 평가 방법인 기준 영상 대비 오차도 더 적게 나타남을 확인하였다.

HDR(High dynamic range) imaging is a technique to represent a dynamic range of real world. Exposure fusion is a method to obtain a pseudo-HDR image and it directly fuses multi-exposure images instead of generating the true-HDR image. However, it results ghost artifacts while fusing the multi-exposure images with moving objects. To solve this drawback, temporal consistency assessment is proposed to remove moving objects. Firstly, multi-level threshold bitmap and brightness bitmap are proposed. In addition, hue-angle constancy map between multi-exposure images is proposed for compensating a bitmap. Then, two bitmaps are combined as a temporal weight map. Spatial domain image quality assessment is used to generate a spatial weight map. Finally, two weight maps are applied at each multi-exposure image and combined to get the pseudo-HDR image. In experiments, the proposed method reduces ghost artifacts more than previous methods. The quantitative ghost-free evaluation of the proposed method is also less than others.

키워드

참고문헌

  1. Paul Debevec, and Jitendra Malik, "Recovering High Dynamic Range Radiance Maps from photographs," Proceeding of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '97). pp. 369-378, 1998.
  2. Erik Reinhard, Wolfgang Herigrich, Paul Debevec, Sumanta Pattanaik, Greg Ward, and Karol Myszkowski, "High Dynamic Range Imaging, Second Edition: Acquisition, Display, and Image-Based Lighting," Morgan Kaufmann, ISBN-10: 012374914X, ISBN-13: 978-0123749147, 2010.
  3. Jack Tumblin, and Greg Turk, "LCIS: A Boundary Hierarchy For Detail-Preserving Contrast Reduction," Proceeding of the 26th annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99). pp. 83-90, 1999.
  4. Zeev Farbman, Raanan Fattal, Dani Lischinski, and Richhard Szeliski, "Edge-preserving Decompositions for Multi-Scale Tone and Detail Manipulation", ACM Transaction on Graphics-Proceding of ACM SIGGRAPH 2008, Vol. 27, Iss. 3, 2008.
  5. Ji Won Lee, and Rae-Hong Park, "Tone Mapping Using Color Correction Function and Image Decomposition in High Dynamic Range Imaging," IEEE Transactions on Consumer Electronics, Vol. 56, No. 4, pp. 2772-2780, 2010. https://doi.org/10.1109/TCE.2010.5681168
  6. Bo Gu, Wujing Li, Minyun Zhu, and Minghui Wang, "Local Edge-preserving Multiscale Decomposition for high Dynamic Range Image Tone Mapping," IEEE Transaction on Image Processing, Vol. 22, No. 1, pp. 70-79, 2013. https://doi.org/10.1109/TIP.2012.2214047
  7. T. Mertens, J. Kautz, and F. Van reeth, "Exposure Fusion: A Simple and Practical Alternative to High Dynamic Range Photography," Computer Graphics Forum, Vol. 28, No. 1, pp.161-171, 2009. https://doi.org/10.1111/j.1467-8659.2008.01171.x
  8. J. Im, J. Jeon, M. H.Hayes, and J. Paik, "Single Image-Based Ghost-Free High Dynamic Range Imaging Using Local Histogram Stretching and Spatially-Adaptive Denoising," IEEE Transactions on Consumer Electronics, Vol. 57, No. 4, pp. 1478-1484, 2011. https://doi.org/10.1109/TCE.2011.6131114
  9. Katerien Jacobs, Celine Loscos, and Greg Ward, "Automatic High-dynamic Range Image Generation for Dynamic Scenes," Computer Graphics and Applications, IEEE, Vol. 28, Iss. 2, pp. 84-93, 2008.
  10. W. Zhang, and Wai-Kuen Cham, "Reference-guided exposure fusion in dynamic scenes," Journal of Visual Communication and Image Representation. Vol. 23, No. 3, pp. 467-475, 2012. https://doi.org/10.1016/j.jvcir.2012.01.006
  11. F. Pece, Jan Kautz, "Bitmap movement detection: HDR for dynamic scenes," 2010 Conference on Visual Media Production (CVMP), pp. 1-8, 2010.
  12. F. Pece, Jan Kautz, "Bitmap movement detection: HDR for dynamic scenes," Journal of Virtual Reality and Broadcasting, Vol. 10, No. 2, 2013.
  13. Perter J. Burt, Edward H. Adelson, "The Laplacian Pyramid as Compact Image Code," IEEE Transactions on Communication. Vol. 31, No. 4, pp. 532-540. https://doi.org/10.1109/TCOM.1983.1095851
  14. Robert M. Haralick and Linda G. Shapiro, "Computer and Robot Vision", Addison-Wesley, ISBN: 0201569434, 1992.