Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지

Adaptive illumination change compensation method for multi-view video coding

다시점 비디오 부호화를 위한 적응적인 조명변화 보상 방법

  • Hur, Jae-Ho (Dept. of Computer Engineering, DMS Lab., Sejong University) ;
  • Cho, Suk-Hee (Broadcasting System Research Group, Electronics and Telecommunications Research Institute) ;
  • Hur, Nam-Ho (Broadcasting System Research Group, Electronics and Telecommunications Research Institute) ;
  • Kim, Jin-Woong (Broadcasting System Research Group, Electronics and Telecommunications Research Institute) ;
  • Lee, Yung-Lyul (Dept. of Computer Engineering, DMS Lab., Sejong University)
  • Published : 2006.12.29
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, an adaptive illumination change compensation method is proposed for multi-view video coding. In multi-view video, an illumination change can occur due to physically imperfect camera calibration, each different camera position and direction, and so on. These characteristics can cause a performance decrease in the multi-view video coding that uses an inter-view prediction by referring to the pictures obtained from the neighboring views. By using the proposed method, a compression ratio of the proposed method in the multi-view video coding is increased, and finally $0.1{\sim}0.6dB$ PSNR(Peak Signal-to-Noise Ratio) improvement was obtained compared with the case of not using the proposed method.

본 논문은 다시점 동영상 부호화를 위한 적응적인 조명변화 보상 방법을 제안한다. 다시점 비디오에서 카메라의 위치에 따라 조명의 차이가 발생할 수 있으며, 여러 대의 카메라가 물리적으로 완전히 동일한 특성을 가지도록 조정되지 못하여 각 카메라에서 촬영된 영상 간에 미세한 차이가 발생할 수 있다. 이러한 특성은 인접한 위치의 카메라로부터 획득된 영상을 참조하여 부호화하는 다시점 비디오 부호화의 성능을 저하시키는 요인이 된다. 제안하는 조명변화 보상 방법을 통하여 다시점 비디오 부호화의 압축 효율을 높일 수 있었으며, 조명변화 보상을 수행하지 않는 다시점 비디오 부호화와 비교하여 PSNR(Peak Signal-to-Noise Ratio)이 약 $0.1{\sim}0.6dB$ 정도 향상되었다.

Keywords

References

  1. A. Smolic and D. McCutchen, '3DAV Exploration of Video-Based Rendering Technology in MPEG,' IEEE Trans. Circuits Syst. Video Technol., vol. 14, pp. 348–356, Mar. 2004 https://doi.org/10.1109/TCSVT.2004.823395
  2. S. Yea, J. Oh, S. Ince, E. Martinian, and A. Vetro, 'Report on Core Experiment CE3 of Multiview Coding,' ISO/IEC JTC1/SC29/WG11, Doc. M13695, Klagenfurt, Austria, Jul. 2006
  3. M. Kitahara, H. Kimata, M. Tanimoto, T. Fujii, and K. Yamamoto, 'Report of Core Ex-periment on View Interpolation (Multi-view Video Coding CE3),' ISO/IEC JTC1/SC29/WG11, Doc. M13509, Klagenfurt, Austria, Jul. 2006
  4. Y. L. Lee, J.H. Hur, Y. K. Lee, S. Cho, H. J. Kwon, N. Hur, and J. Kim, 'Results of CE2 on Multi-view Video Coding,' ISO/IEC JTCI/SC29/WG11, Doc. M13498, Klagenfurt, Austria, Jul. 2006
  5. J. H. Kim, P. L. Lai, A. Ortega, Y. Su, P. Yin, and C. Gomila, 'Results of CE2 on Multi-view Video Coding,' ISO/IEC JTC1/SC29/WG11, Doc. M13720, Klagenfurt, Austria, Jul. 2006
  6. K. Sohn, Y. Kim, J. Seo, J. Yoon, G. Kim, C. Park, and J. Lee, 'Results on CE2 using IBDE for multi-view video coding, ISO/IEC JTC1/SC29/WG11, Doc. M13543, Klagen-furt, Austria, Jul. 2006
  7. H. S. Koo, Y. J. Jeon, and B. M. Jeon, 'Motion Skip Mode for MVC,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT- U091-L, Oct. 2006
  8. K. Mueller, P. Merkle, A. Smolic, and T. Wiegand, 'Multiview Coding using AVC,' ISO/IEC JTC1/SC29/WG11, Doc. M12945, Bangkok, Thailand, Jan. 2006
  9. H. Schwarz, D. Marpe, and T. Wiegand, 'Hierarchical B Pictures,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-P014, Jul. 2005
  10. G. J. Sullivan and T. Wiegand, 'Rate-Distortion Optimization for Video Compression,' IEEE Signal Processing Magazine, vol. 15, pp. 74-90, Nov. 1998 https://doi.org/10.1109/79.733497
  11. T. Wiegand, H. Schwarz, A. Joch, F. Kossentini, and G. J. Sullivan, 'Rate-Constrained Coder Control and Comparison of Video Coding Standards,' IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 688-703 July 2003 https://doi.org/10.1109/TCSVT.2003.815168
  12. Detlev Marpe, Thomas Wiegand, and Heiko Schwarz, 'Context-based adaptive binary arithmetic coding in the H.264/ AVC video compression standard,' IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 620-636 July 2003 https://doi.org/10.1109/TCSVT.2003.815173
  13. A. M. Tourapis, F. Wu, and S. Li, 'Direct Mode Coding for Bipredictive Slices in the H.264 Standard,' IEEE Trans. Circuits Syst. Video Technol., vol. 15, pp. 119-126, Jan. 2005 https://doi.org/10.1109/TCSVT.2004.837021
  14. Multi-View Coding Software, http://iphome.hhi.de/mueller/MVC_ SW.htm
  15. Video and Test, 'Updated Call for Proposals on Multi-view Video Coding,' ISO/IEC JTC1/SC29/WG11, Doc. N7567, October 2005
  16. J. M. Boyce, 'Weighted Prediction in the H.264/MPEG AVC Video Coding Standard,' Circuits and Systems, 2004. ISCAS '04. Proceedings of the 2004 International Symposium, vol. 3, pp. III-789-92 , May 2004