Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지

Scalable Stereoscopic Video Coding for Heterogeneous Environments

이질적인 환경을 위한 스케러블 스테레오 영상 부호화

  • 오세찬 (광주과학기술원 정보통신공학과 U-VR 연구실) ;
  • 이영호 (광주과학기술원 정보통신공학과 U-VR 연구실) ;
  • 우운택 (광주과학기술원 정보통신공학과 U-VR 연구실)
  • Published : 2004.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a new stereoscopic video coding approach for heterogeneous consumer devices by exploiting the concept of spatio-temporal scalability. The proposed method uses MPEG-2 standard for coding the left or main sequence and an enhanced compatible coding scheme for predicting the P- and B-type of frames of the right or auxiliary sequence. The enhanced compatible coding scheme predicts matching block by interpolating both two forward and backward motion predicted macroblocks and disparity predicted macroblock. To provide flexible stereo video service, we define both a temporally scalable layer and a spatially scalable layer for each eye-view. The experimental results show the efficiency of proposed coding scheme by comparison with already known methods and the advantages of disparity estimation in terms of scalability overhead. According to the experimental results, we expect the proposed functionalities will play a key role in establishing highly flexible stereo video service for ubiquitous computing environment where devices and network connections are heterogeneous.

본 논문에서는 이질적인 수신 단말을 위해 시공간적 계위(spatio-temporal scalability)를 이용한 새로운 3차원 영상 부호화 방법을 제안한다. 제안된 방법은 좌 영상의 부호화를 위해 MPEG-2 표준을 이용하며, 우 영상의 부호화를 위해서 향상된 호환성(enhanced compatible) 부호화 방법을 이용하여 P-와 B-타입의 영상을 예측한다. 향상된 호환성 부호화 방법은 두 개의 전후방향 움직임으로부터 예측된 매크로 블록과 양안차로부터 예측된 블록을 보간하여 매칭 블록을 예측한다. 유연성 있는 3차원 비디오 서비스를 위해서, 각각의 좌우 영상에 대해 시공간적 확장 가능한 계층을 정의하였다. 실험을 통하여 제안된 3차원 영상 부호화기의 성능을 기존의 방법들과 비교하여 검증하였으며, 양안차 예측의 이점을 계위에 따르는 오버헤드의 관점에서 분석하였다. 제안된 시공간적 계위를 이용한 3차원 영상 부호화기는 다양한 디스플레이 장치 및 네트워크 환경을 가지는 유비쿼터스 컴퓨팅 환경을 위한 효율적인 3차원 비디오 전송 서비스에 활용될 것으로 기대된다.

Keywords

References

  1. M.Domanski, S.Mackowiak, 'Modified MPEG-2 video coders with efficient multi-layer scalability,' Proc. of ICIP, vol. 2, pp. 1033-36, Oct. 2001
  2. M.Narroschke, 'Functionalities and Costs of Scalable Video Coding for Streaming Services', Proc. of Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, Nov. 2002
  3. B. Haskell, A. Purl, A. N. Netravali, 'Digital Video: An Introduction to MPEG-2,' New York: Chapman & Hall, 1997
  4. R.Shukla, H.Radha, 'Disparity Dependent Segmentation based Stereo Image Coding,' Proc. of ICIP, Sept. 2003
  5. A.Puri, R.V.Kollarits, and B.G.Haskell, 'Basics of Stereoscopic Video, New Compression Results with MPEG-2 and a Proposal for MPEG-4,' Proc. of Image Communications, vol. 10, pp. 201-234, 1997
  6. W.Woo, A.Ortega, 'Overlapped Block Disparity Compensation with Adaptive Windows for Stereo Image Coding,' Proc. of IEEE Tr. Circuits Syst. Video Tech. vol. 10. pp. 194-200, Mar. 2000
  7. A.Mancini, J.Konracd, 'Robust Quadtree-Based Disparity Estimation for the Reconstruction of Intermediate Stereoscopic Images,'Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems, vol. 3295, pp. 53-64, Jan, 1998
  8. M.W.Siegel, S.Sethuraman, J.S.McVeigh, and A.G.Jordan. 'Compression and interpolation of 3D-stereoscopic and multi-view video,' Proc. of SPIE, vol. 3012, pp. 227-238, Feb. 1997 https://doi.org/10.1117/12.274461
  9. S.Sethuraman, M.W.Siegel, A.G.Jordan, 'A Multiresolution Framework For Stereoscopic Image Sequence Compression,' Proc. of ICIP, vol. 2, pp. 361-365, Nov. 1994
  10. S.Sethuraman, A.G.Jordan, M.W.Siegel, 'Multiresolution Based Hierarchical Disparity Estimation for Stereo Image Pair Compression,' Proc. of the Symposium on Application of subbands and wavelets, 1994
  11. D.Tzovaras, N.Grammalidis, and M.G.Strintzis, 'Object-Based Coding of Stereo Image Sequences using Joint 3-D Motion/Disparity Compensation,' Proc. of IEEE Tr. on Video Technology, vol. 7, no. 2, pp. 312-328, April 1997
  12. J.Jiang and E.A.Edirisinghe, 'A Hybrid Scheme for Low Bit-rate Coding of Stereo Images,' Proc. of IEEE Tr. Image, vol. 11, no. 2, pp. 123-134, Feb. 2002
  13. W.Woo, A.Ortega, 'Overlapped Block Disparity Compensation with Adaptive Windows for Stereo Image Coding,' Proc. of IEEE Tr. Circuits Syst. Video Tech. vol. 10. pp. 194-200, Mar. 2000
  14. W.Woo, A.Ortega, 'Optimal Blockwise Dependent Quantization for Stereo Image Coding,' Proc. of IEEE Tr. CSVT. vol. 9. pp. 861-867, Sept. 1999
  15. D.Tzovaras,M.G.Strintzis, 'Motion and Disparity Field Estimation using Rate-distortion Opimization,' Proc. of IEEE Tr. on Video Technology, vol. 8, pp. 171-180, April 1998
  16. Woon-Tack Woo, 'http://vr.gist.ac.kr/~3D/,' 2001
  17. M.Narroschke, 'Functionalities and Costs of Scalable Video Coding for Streaming Services,' Proc. of Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, Nov. 2002