Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지

Error Resilient Video Coding Techniques Using Multiple Description Scheme

다중 표현을 이용한 에러에 강인한 동영상 부호화 방법

  • 김일구 (서울대학교 전기컴퓨터공학부 뉴미디어통신공동연구소) ;
  • 조남익 (서울대학교 전기컴퓨터공학부 뉴미디어통신공동연구소)
  • Published : 2004.03.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes an algorithm for the robust transmission of video in error Prone environment using multiple description codingby optimal split of DCT coefficients and rate-distortionoptimization framework. In MDC, a source signal is split Into several coded streams, which is called descriptions, and each description is transmitted to the decoder through different channel. Between descriptions, structured correlations are introduced at the encoder, and the decoder exploits this correlation to reconstruct the original signal even if some descriptions are missing. It has been shown that the MDC is more resilient than the singe description coding(SDC) against severe packet loss ratecondition. But the excessive redundancy in MDC, i.e., the correlation between the descriptions, degrades the RD performance under low PLR condition. To overcome this Problem of MDC, we propose a hybrid MDC method that controls the SDC/MDC switching according to channel condition. For example, the SDC is used for coding efficiency at low PLR condition and the MDC is used for the error resilience at high PLR condition. To control the SDC/MDC switching in the optimal way, RD optimization framework are used. Lagrange optimization technique minimizes the RD-based cost function, D+M, where R is the actually coded bit rate and D is the estimated distortion. The recursive optimal pet-pixel estimatetechnique is adopted to estimate accurate the decoder distortion. Experimental results show that the proposed optimal split of DCT coefficients and SD/MD switching algorithm is more effective than the conventional MU algorithms in low PLR conditions as well as In high PLR condition.

본 논문에서는 다중 표현(multiple description) 개념을 이용하여 에러에 강인한 동영상 부호화 방법을 제안한다 제안하는 방법은 DCT 계수의 최적 분할 방법과 채널 환경에 따른 단일표현/다중표현 전환 방법으로 구성되어 있다. DCT 계수 최적 분할 방법에서는 입력 신호를 주어진 중복량(redundancy)에서 최적의 과잉 비트율-왜곡(redundancy rate-distortion, RRD) 성능을 갖는 두 개의 표현으로 분할한다. 최적화 방법으로는 라그랑제 최적화 방법(Lagrange optimization method)을 사용하였고 재귀적 구조를 사용한 다이나믹 프로그래밍 기법을 사용하여 분할의 복잡도를 줄인다. 단일표현/다중표현 전환 방법에서는 재귀적 최적 화소단위 예측(recursive optimal per-pixel estimate, ROPE)를 이용하여 복원 에러를 예측한 후, 낮은 패킷 손실율에서는 압축 효율을 위하여 단일표현을 사용하고 패킷 손실율이 큰 환경에서는 에러에 대한 강인성을 위해 다중표현을 사용한다. 모의 실험 결과, 제안하는 다중표현 동영상 부호화 방법은 이상적인 다중표현 채널에서뿐만 아니라 다양한 패킷 손실율을 갖는 채널 환경에서도 기존의 단일표현 및 다중표현 에러 내성 부호화 방법보다 더 좋은 성능을 보임을 알 수 있다.

Keywords

References

  1. V. Goyal, 'Multiple description coding : Compression meets the network,' IEEE Signal Processing Mag., vol. 18, pp. 74-93, Sept. 2001
  2. A. Ingle and V. Vaishampayan, 'DPCM system design for diversity systems with applications to packetized speech,' IEEE Trans. Speech and Audio Processing, vol. 3, pp. 48-57, Jan. 1995
  3. Y. Wang, M. Orchard, and A. Reibman, 'Multiple description image coding for noisy channels by pairing transform coefficients,' in Proc. First Workshop on Multimedia Signal Processing, June 1997, pp. 419-424
  4. A. Reibman, H. Jafarkhani, Y. Wang, M. Orchard, and R. Puri, 'Multiple description coding for video using motion compensated prediction,' in Proc. Int. Conf. Image Processing, Oct. 1999, pp. 837-841
  5. V. Vaishampayan and S. John, "Balanced interframe multiple description video compression," in Proc. Int. Conf. Image Processing, Oct. 1999, pp. 812-816
  6. A. Reibman, H. Jafarkhani, Y. Wang, and M. Orchard, 'Multiple description video using rate-distortion splitting,' in Proc. Int. Conf. Image Processing, Oct. 2001, pp. 978-981
  7. D. Comas, R. Singh, and A. Ortega, 'Rate-distortion optimization in a robust video transmission based on unbalanced multiple description coding,' in Proc. of 2001 IEEE Fourth Workshop on Multimedia Signal Processing, Oct. 2001, pp. 581-586
  8. Y.-C. Lee, Y. Altunbasak, and R. Mersereau, 'A two-stage multiple description video coder with drift-preventing motion compensated prediction,' in Proc. Int. Conf. Image Processing, Sept. 2002, pp. 557-560
  9. A. Reibman, 'Optimizaing multiple description video coders in a packet loss environment,' in Proc. Int. Packet Video Workshop, Mar. 2002
  10. R. Zhang, S Regunathan, and K. Rose, 'Video coding with optimal Inter/Intra-mode switching for packet loss resilience,' IEEE Journal on Selected Areas in Communications, vol. 18, pp. 966-976, June 2000
  11. I. K. Kim and N. I. Cho, 'Error resilient video coding using optimal multiple description of dct coefficients,' in Proc. Int. Conf. Image Processing, Sept. 2003
  12. H. Everett, 'Generalized lagrange multiplier method for solving problems of optimum allocation of resources,' Oper. Res., vol. 11, pp. 399-417, 1963
  13. A. Ortega and K. Ramchandran, 'Rate-distortion methods for image and video compression,' IEEE Signal Processing Mag., vol. 15, pp. 23-50, Nov. 1998
  14. G. Sullivan and T. Wiegand, 'Rate-distortion optimization for video compression,' IEEE Signal Processing Mag., vol. 15, pp. 74-90, Nov. 1998
  15. K. Ramchandran and M. Vetterli, 'Rate-distortion optimal fast thresholding with complete JPEG/MPEG decoder compatiblility,' IEEE Trans. Image Processing, vol. 3, pp. 700-704, 1994
  16. L. Kondi and A. Katsaggelos, "An operational rate-distortion optimal single-pass SNR scalable video coder," IEEE Trans. Image Processing, vol. 10, pp. 1613-1620, 2001
  17. Z. Jia, K. Tang, and H. Cui, 'A H.263 compatible error resilient video coder,' in Proc. Int. Conf. WCC-ICCT 2000, Aug. 2000, pp. 21-25
  18. T. Wiegand and B. Girod, 'Lagrange multiplier selection in hybrid video coder control,' in Proc. Int. Conf. Image Processing, Oct. 2001, pp. 542-545