Boundary Match and Block Reliability Based Error Concealment Algorithm

블록 신뢰도와 경계면 매칭 기반의 잡음 은닉 알고리즘

  • Received : 2017.04.13
  • Accepted : 2017.06.07
  • Published : 2017.06.30

Abstract

A packet loss in wireless environments causes a severe degradation of video quality in video communications. In this paper, a novel video error concealment algorithm is presented by combining boundary errors and a block reliability measure. The block reliability measure decides the reliability of a block by checking residual errors of a block. In the proposed approach, a motion vector of a missing unreliable block in an inter coded frame is obtained initially based on the motion vector of the same block in the reference frame. Furthermore, if the block in the reference frame is unreliable according to the reliability measure, a new motion vector is decided based on block boundary errors around the initial motion vector. According to our simulations, the proposed approach shows promising results for error concealment in error-prone wireless environments.

무선 환경에서의 패킷 손실은 비디오 통신과정에서 심각한 비디오 품질 저하를 초래한다. 이 논문에서는 블록의 신뢰도와 블록 경계면 매칭을 기반으로 한 비디오 에러 은닉 기술에 대해서 제안한다. 손실된 블록의 모션 정보를 참조 프레임의 동일한 위치에 존재하는 블록의 모션 정보를 복사하여 사용함으로써 임시로 손실된 블록의 잡음을 은닉하고, 블록의 신뢰도를 기준으로 블록의 신뢰도가 낮은 경우에는 추가적으로 블록의 경계면 매칭을 이용하여 모션 벡터를 재탐색하여 잡음 은닉에 대한 정확도를 높이도록 하였다. 실험을 통해서 제안된 기법이 다양한 패킷 손실 환경에서 우수한 에러 은닉 성능을 보임을 확인하였다.

Keywords

References

  1. G.J. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the high efficiency video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1649-1668, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2221191
  2. Z. M. Vyas, K. Lineswala and K. C. Pathak, "Error concealment techniques using intra-modes and weighted interpolation in H.264 decoder," Proceedings of International Conference on Computer, Communication and Control (IC4), pp. 1-6, 2015.
  3. G. Kulupana, D. S. Talagala, H. K. Arachchi and A. Fernando, "Error resilience aware motion estimation and mode selection for HEVC video transmission," Proceedings of IEEE International Conference on Consumer Electronics (ICCE), pp. 85-86, 2016.
  4. Y. Chang, Y. A. Reznik, Z. Chen, and P. C. Cosman, "Motion compensated error concealment for HEVC based on block-merging and residual energy," Proceedings of 20th International Packet Video Workshop, pp. 1-6, Dec. 2013.
  5. J. Nightingale, W. Qi, C. Grecos, and S. Goma, "The impact of network impairment on quality of experience (QoE) in H.265/HEVC video streaming," IEEE Transactions on Consumer Electronics, vol. 60, no. 2, pp.242-250, May 2014. https://doi.org/10.1109/TCE.2014.6852000
  6. Y. Chen, Y. Hu, O. C. Au, H. Li, and C. W. Chen, "Video error concealment using spatio-temporal boundary matching and partial differential equation," IEEE Transactions on Multimedia, vol. 10, pp. 2-15, Jan. 2008. https://doi.org/10.1109/TMM.2007.911223
  7. Y. Wang and Q. Zhu, "Error control and concealment for video communication: a review," Proceedings of IEEE, Vol. 86, No. 5, pp. 974-997, May 1998. https://doi.org/10.1109/5.664283
  8. S. Kumar, L. Xu, M. K. Mandal, and S. Panchanathan, "Error Resiliency Schemes in H.264/AVC Standard," Journal of Visual Communication & Image Representation, vol. 17, no. 2, April 2006.
  9. T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Systems and Video Technology, vol. 13, pp. 560-576, July 2003. https://doi.org/10.1109/TCSVT.2003.815165
  10. Q. Peng, T. Yang, and C. Zhu, "Block-based temporal error concealment for video packet using motion vector extrapolation," Proceedings of IEEE International Conference on Communications, Circuits and Systems and West Sino Expositions, pp. 10-14, July 2002.
  11. K. Seth, V. Kamakoti, and S. Srinivasan, "Efficient motion vector recovery algorithm for H.264 using Bspline approximation," IEEE Transactions on Broadcasting, vol. 56, pp. 467 - 480, Dec 2010. https://doi.org/10.1109/TBC.2010.2058030
  12. T. Lin, N. Yang, R. Syu, C. Liao, and W. Tsai, "Error concealment algorithm for HEVC coded video using block partition decisions," Proceedings of IEEE International Conference on Signal Processing, Communication and Computing, pp. 1-5, Aug. 2013.
  13. J. Leng, L. Sun, T. Ikenaga, and S. Sakaida, "Content based hierarchical fast coding unit decision algorithm for HEVC," Proceedings of IEEE International Conference on Multimedia and Signal Processing (CMSP), vol. 1, pp. 56-59, 2011.