Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Application of Adaptive Loop Filter for NRT-Based Stereoscopic Video Coding

비실시간 기반 스테레오스코픽 비디오 부호화를 위한 적응루프필터 적용기법

  • Received : 2012.12.31
  • Accepted : 2013.02.07
  • Published : 2013.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

A stereoscopic 3D video service is able to provide a 3D video service while keeping backward compatibility with the existing 2D video service. In the terrestrial digital television (DTV) system, a stereoscopic video codec is required to have high coding efficiency in order to provide a 3D video service in the same channel capacity. A hybrid codec consisting of MPEG-2 for base video and H.264/AVC or HEVC for 3D auxiliary video is considered. Furthermore, Non-Real-Time (NRT) delivery of stereoscopic video is also considered as a service scenario for 3DTV services to overcome the limited bandwidth. In this paper, we propose a stereoscopic video coding scheme using adaptive loop filter (ALF) which had been considered in HEVC as a pre-/post-filter for enhancing coding efficiency in NRT-based 3DTV services. In order to apply ALF as a post-filter to the reconstructed additional view coded by H.264/AVC, we devise a method in which ALF is adaptively applied based on a structure determined by using macroblock (MB) coding information such as MB mode type and reference index instead of coding unit (CU) structure on which ALF is applied in the HEVC. Experimental results shows that the proposed stereoscopic video coding scheme applying ALF obtains up to 24.9% gain of bit saving.

스테레오스코픽(stereoscopic) 3D 비디오 서비스는 기존 2D와의 호환성을 유지하면서 새로운 3D 비디오 서비스를 제공할 수 있다. 전송 대역이 제한된 지상파 방송의 경우 높은 부호화 효율을 갖는 스테레오스코픽 비디오 코덱이 요구된다. 따라서 기준영상은 기존 2D 비디오 서비스와의 호환성을 위해 MPEG-2로 부호화하는 반면 3D를 위한 부가영상 부호화를 위해 부호화 효율이 높은 H.264/AVC, HEVC(High Efficiency Video Coding) 등을 고려하고 있으며, 또한 부가영상을 비실시간으로 전송하는 NRT(Non-Real Time) 3D 서비스도 고려되고 있다. 본 논문에서는 NRT 3D 서비스를 위한 스테레오스코픽 비디오 부호화에 있어서, HEVC에서 고려되었던 적응루프필터(ALF: Adaptive Loop Filter)를 전/후처리 필터로 적용하는 기법을 제시한다. 특히, 부가영상의 후처리에 ALF를 적용하기 위하여 부호화 과정에 결정되는 CU(Coding Unit) 구조를 이용하는 HEVC와 달리 MVC(Multiview Video Coding)로 부호화한 부가영상의 매크로블록(MB) 부호화 모드 및 참조영상 인덱스 등의 MB 부호화 정보를 이용한 ALF 적용 기법을 제안한다. 부가 영상 부호화에 있어서 제안한 기법으로 전처리 및 후처리 과정으로 ALF를 적용함으로써 최대 약 24.9%의 비트율 감소를 확인하였다.

Keywords

References

  1. ATSC: TSG-876r1-NRT-CS(Candidate Standard Non-Real-Time Content Delivery), Dec. 2010.
  2. A. Vetro, P. Pandit, H. Kimata, A. Smolic, and Y.-K. Wang, Joint draft 8 of multiview video coding, Hannover, Germany, Joint Video Team (JVT) Doc. JVT-AB204, Jul. 2008.
  3. Anthony Vetro, Thomas Wiegand, and Gary J. Sullivan, "Overview of the Stereo and Multiview Video Coding Extensions of the H.264/AVC Standard," Proc. IEEE, vol. 99, no 4, pp.626-642, Apr.2011.
  4. L.-F. Ding, S.-Y. Chien, and L.-G. Chen, "Joint prediction algorithm and architecture for stereo video hybrid coding systems," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no.11, pp.1324-1337, 2006. https://doi.org/10.1109/TCSVT.2006.883510
  5. P. Merkle, H. Brust, K. Dix, K. Müller, and T. Wiegand, "Stereo Video Compression for Mobile 3D Services," in Proc. 3DTV Conference, Potsdam, Germany, 2009.
  6. B. Lee, B.-T. Lee, W.-S. Cheong, N. Hur, S. Lee and J.-G. Kim, "Study on the stereoscopic codecs for non-real time 3DTV services," in Proc. IS&TSPIE Stereoscopic Displays and Applications(SD&A), SPIE vol.7863, San Francisco, Jan. 2011.
  7. B.-T. Lee, B. Lee, H. Choi, J.-s. Kim, K. Yun, W.-S. Cheong, and J.-G. Kim, "Adaptive Pre-/Post-Filters for NRT-Based Stereoscopic Video Coding", ETRI J., vol. 34, no. 5, pp. 666-673, Oct. 2012. https://doi.org/10.4218/etrij.12.0112.0182
  8. B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan, and T. Wiegand, High efficiency video coding (HEVC) text specification draft 8, Doc. JCTVC-H1003, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC), Feb. 2012.
  9. B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan, and T. Wiegand, High efficiency video coding (HEVC) text specification draft 10, Doc. JCTVC-L1003, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC), Jan. 2013.
  10. T. Paila, M. Luby, R. Lehtonen, V. Roca, and R. Walsh: FLUTE -File Delivery over Unidirectional Transport. RFC 3926, Oct. 2004.
  11. T. Chujoh, N. Wada, T. Watanabe, and T. Yamakage, "Specification and experimental results of Quadtree-based Adaptive Loop Filter," ITU-T SG16/Q.6 Doc. VCEG-AK22, Apr. 2009.
  12. http://www.mpeg.org/MPEG/MSSG.
  13. "Joint multiview video model (JMVM) 8.0," JVT-AA207, Geneva, Switzerland, Apr. 2008.
  14. G. Lee, K. Jung, W.-S. Cheong, N. Hur, and K. Pyo, "Development of high-definition 3DTV experimental system based on dual stream method," J. Broadcasting Engineering, vol 16, no 3, pp. 471-482, May 2011. https://doi.org/10.5909/JEB.2011.16.3.471
  15. "Block-based Adaptive Loop Filter," ITU-T SG16/Q.6 Doc. VCEGAI18, July 2008.
  16. G. Bjontegaard, "Calculation of Average PSNR Differences between RD curves," ITU-T SG16/Q6, 13th VCEG Meeting, Austin, Texas, USA, April 2001, Doc. VCEG-M33.