IEIE Transactions on Smart Processing and Computing

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

Reliability-Based Deblocking Filter for Wyner-Ziv Video Coding

  • Dinh, Khanh Quoc (School of Electronic & Electrical Engineering, Sungkyunkwan University) ;
  • Shim, Hiuk Jae (School of Electronic & Electrical Engineering, Sungkyunkwan University) ;
  • Jeon, Byeungwoo (School of Electronic & Electrical Engineering, Sungkyunkwan University)
  • Received : 2016.03.07
  • Accepted : 2016.03.12
  • Published : 2016.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

In Wyner-Ziv coding, video signals are reconstructed by correcting side information generated by block-based motion estimation/compensation at the decoder. The correction is not always accurate due to the limited number of parity bits and early stopping of low-density parity check accumulate (LDPCA) decoding in distributed video coding, or due to the limited number of measurements in distributed compressive video sensing. The blocking artifacts caused by block-based processing are usually conspicuous in smooth areas and degrade the perceptual quality of the reconstructed video. Conventional deblocking filters try to remove the artifacts by treating both sides of the block boundary equally; however, coding errors generated by block-based processing are not necessarily the same on both sides of the block boundaries. Such a block-wise difference is exploited in this paper to improve deblocking for Wyner-Ziv frameworks by designing a filter where the deblocking strength at each block can be non-identical, depending on the reliability of the reconstructed pixels. Test results show that the proposed filter not only improves subjective quality by reducing the coding artifacts considerably, but also gains rate distortion performance.

Keywords

References

  1. I. E. G. Richardson, H.264 and MPEG-4 video compression: video coding for next generation multimedia (John Wiley & Son Ltd., Wiltshire, 92003)
  2. D. Slepian and J.K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. on Inform. Theory, vol. IT-19, pp. 471-480, 1973.
  3. D. Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. on Inform. Theory, vol. IT-22, pp. 1-10, 1976.
  4. R Martins, C. Brites, J. Ascenso, and F. Pereira, "Adaptive deblocking filter for transform domain Wyner-Ziv video coding," IET Image Processing, vol. 3, pp. 315-328, 2009. https://doi.org/10.1049/iet-ipr.2008.0201
  5. S. Mun and J. E. Fowler, "Residual reconstruction for block-based compressed sensing of video," Proc. Data Compression Conf., pp. 183-192, USA, 2011.
  6. E. Candes, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Comm. on Pure and Applied Mathematics, vol. 59, issue 8, pp. 1207-1223, 2006. https://doi.org/10.1002/cpa.20124
  7. P. List, A. Joch, J. Lainema, G. Bjontegaard, and M. Karczewicz, "Adaptive deblocking filter," IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, pp. 614-619, 2003. https://doi.org/10.1109/TCSVT.2003.815175
  8. Y. Y. Chen, Y. W. Chang, and W. C. Yen , "Design a deblocking filter with three separate modes in DCT-based coding," Journal of Visual Comm. and Image Representation, vol. 19, issue 4, pp. 231-244, 2008. https://doi.org/10.1016/j.jvcir.2008.02.001
  9. S. C. Tai Y. Y. Chen, and S. F. Sheu, "Deblocking filter for low bit rate mpeg-4 video," IEEE Trans. on Circuits and Systems for Video Tech., vol 15, pp. 733-741, 2005. https://doi.org/10.1109/TCSVT.2005.848314
  10. J. Wang, J. Kim, and J. Jeong, "An new deblocking algorithm for DCT coded images using adaptive spatial filters," Proc. IEEE Intern. Conf. Network Infrastructure and Digital Content, pp. 813-818, 2009.
  11. Y. M. Huang, J. J. Leou, and M. H. Cheng, "A Post Deblocking Filter for H.264 Video," Proc. Intern. Conf. on Computer Comm. and Networks, pp. 1137-1142, Hawaii, USA, 2007.
  12. J. Yang, K. Won, and B. Jeon, "Adaptive deblocking filter for intra blocks," Optical Engineering, vol. 49, issue 12, pp. 120502-120502-3, 2010. https://doi.org/10.1117/1.3523479
  13. Y. W. Chang, and Y. Y. Chen, "Design of a deblocking filter for both objective and subjective metrics," IEICE Trans. on Fundamentals of Electronics, vol. E91.A, pp. 2038-2040, 2010.
  14. M. Esche, A. Krutz, A. Glantz, and T. Sikora, "A novel inloop filter for video-compression based on temporal pixel trajectories," Proc. Picture Coding Symposium (PCS), pp. 514-517, 2010.
  15. A. Glantz, A. Krutz, M. Haller, and T. Sikora, "Video coding using global motion temporal filtering," Proc. IEEE Intern. Conf. on Image Processing, pp. 1053-1056, Cairo, Egypt, 2009.
  16. A. Glantz, A. Krulz, and T. Sikora, "Global motion temporal filtering for in-loop deblocking," Proc. IEEE Intern. Conf. on Image Processing, pp. 957-960, Hong Kong, 2010.
  17. B. Jeon and J. Jeong, "Blocking Artifacts Reduction In Image Coding Based On Minimum Block Discontinuity Criterion," IEEE Trans. on Circuits and Systems for Video Tech., vol. 8, no.3, pp. 345-357, June 1998. https://doi.org/10.1109/76.678634
  18. Luong Pham Van, Hoyoung Lee, Jaehwan Kim, and Byeungwoo Jeon, "A Low Complexity H.264/AVC Deblocking Filter with Simplified Filtering Boundary Strength Decision," Proc. IEEE Trans. on Fundamentals of Electronics, Comm. and Computer Sciences, vol. E96-A, no.2, pp. 562-572, Feb. 2013.
  19. M. A. Robertson and R. L. Stevenson, "DCT quantization noise in compressed images," Proc. IEEE Intern. Conf. on Image Processing, vol. 1, pp. 185-188, Greece, 2001.
  20. R. Puri and K. Ramchandran, "PRISM: a new robust video coding architecture based on distributed compression principles," Proc. Allerton Conf. on Comm., Control, and Computing, pp. 586-595, IL, 2002.
  21. A. Aaron, R. Zhang, and B. Girod, "Wyner-Ziv coding of motion video," Proc. Asilomar Conf. on Signals, Systems and Computers, USA , 2002, vol.1, pp. 240-244.
  22. A. Aaron, S. Rane, E. Setton and B. Girod, "Transform-domain Wyner-Ziv codec for video," Proc. Intern. Conf. on Visual Comm. and Image Processing, pp. 520-528, 2004.
  23. E. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information," IEEE Trans. on Inform. Theory, vol. 52, issue 2, pp. 489-5209, 2006. https://doi.org/10.1109/TIT.2005.862083
  24. E. Candes and T. Tao, "Near-optimal signal recovery from random projections and universal encoding strategies," IEEE Trans. on Inform. Theory, vol. 52, issue 12, 2006.
  25. C. E. Shannon, "Communication in the presence of noise," Proc. Institute of Radio Engineers, vol. 37, no. 1, pp. 10-21, Jan. 1949.
  26. H. Nyquist, "Certain topics in telegraph transmission theory", Trans. AIEE, vol. 47, pp. 617-644, Apr. 1928.
  27. R. G. Baraniuk, "Compressive sensing," IEEE Signal Processing Magazine, vol. 24. issue 4, pp. 118-121, 2007. https://doi.org/10.1109/MSP.2007.4286571
  28. L. W. Kang and C. S. Lu, "Distributed compressive video sensing," Proc. IEEE Intern. Conf. on Acoustics, Speech and Signal Processing, pp. 1169-1172, Taipei, 2009.
  29. T. T. Do, Y. Chen, D. T. Nguyen, N. Nguyen, L. Gan, and T. D. Tran, "Distributed compressed video sensing," Proc. IEEE Intern. Conf. on Image Processing, pp. 1393-1396, USA, 2009.
  30. J. Ascenso, C. Brites, and F. Pereira, "Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding," Proc. EURASIP Conf. on Speech and Image Processing, Multimedia Comm. and Services, Slovak Republic, 2005.
  31. J. Park, B. Jeon, D. Wang, and A. Vincent, "Wyner- Ziv video coding with region adaptive quantization and progressive channel noise modeling," Proc. of IEEE Broadband Multimedia Systems and Broadcasting, pp. 1-6, 2009.
  32. E. Y. Lam, J. W. Goodman, "A mathematical analysis of the DCT coefficient distributions for images," IEEE Trans. on Image Processing, Oct. 2000, vol. 9, pp. 1661-1666, 2000. https://doi.org/10.1109/83.869177
  33. D. Kubasov, J. Nayak, and C, Guillemot, "Optimal reconstruction in Wyner-Ziv video coding with multiple side information," Proc. IEEE Workshop on Multimedia Signal Processing, pp. 183-186, Rennes, France, 2007.
  34. S. Y. Shim, J. K. Han, D. T. Vo, and T. Q. Nguyen, "PSNR estimation scheme for intra and Wyner-Ziv frames in WZVC decoder," Proc. Intern. Tech. Conf. on Circuits/Systems, Computers and Comm., pp. 91-94, Korea, 2009.
  35. C. Brites, J. Ascenso, and F. Pereira, "Studying temporal correlation noise modeling for pixel based Wyner-Ziv video coding," Proc. IEEE Intern. Conf. on Image Processing, pp. 273-276, USA, 2006.
  36. S. Mun and E. Fowler, "Block compressed sensing of images using directional transforms," Proc. IEEE Intern. Conf. on Image Processing, pp. 3021-3024, USA, 2009.
  37. R. C. Gonzalez and R. E. Woods, Digital image processing, Addison-Wesley Publishing Company Inc., pp. 192, 1993.
  38. K. Q. Dinh, J. Park, and B. Jeon, "Reliability-based deblocking filter for distributed video coding," Proc. International Symposium on Communications and Information Technologies (ISCIT), pp. 18-21, 2012.
  39. K. Q. Dinh, H. Shim, and B. Jeon, "Deblocking filter for artifact reduction in distributed compressive video sensing," Proc. IEEE Visual Communications and Image Processing (VCIP), pp. 1-5, 2012.

Cited by

  1. Iterative Weighted Recovery for Block-Based Compressive Sensing of Image/Video at a Low Subrate vol.27, pp.11, 2017, https://doi.org/10.1109/TCSVT.2016.2587398