A Spatial Error Concealment Using Pixelwise Fine Directional Interpolation

픽셀 단위의 정밀한 방향성 보간을 이용한 공간적 에러 은닉 기법

  • 김원기 (한양대학교 전자통신컴퓨터공학과 영상통신 및 신호처리 연구실) ;
  • 구자성 (한양대학교 전자통신컴퓨터공학과 영상통신 및 신호처리 연구실) ;
  • 진순종 (한양대학교 전자통신컴퓨터공학과 영상통신 및 신호처리 연구실) ;
  • 정제창 (한양대학교 전자통신컴퓨터공학과 영상통신 및 신호처리 연구실)
  • Published : 2007.02.28

Abstract

This paper presents a block loss recovery technique for the image block data corrupted by transmission losses through the employment of fine directional interpolation (FDI). The proposed algorithm introduces a spatial direction vector (SDV). The SDVs are extracted from the edge information of the neighboring image data. Subsequently, the SDVs are adaptively applied to interpolate lost pixels on a pixel-by-pixel basis. This approach improves the capability to more reliably recover high-detailed contents in the corrupted block. Experimental results demonstrate that the FDI method performs better as compared to previous techniques.

본 논문에서는 전송 에러로 인해 발생하는 영상의 손실을 정밀한 방향성 보간(FDI: Fine Directional Interpolation)을 이용하여 복원하는 기법을 제안한다. 제안된 알고리즘은 공간 방향 벡터(SDV: Spatial Direction Vector)를 도입한다. 공간 방향 벡터는 손실블럭 주위의 영상 데이터의 에지 정보를 추출하여 구한다. 이 후 손실된 영상 블록은 공간 방향 벡터를 이용하여 픽셀단위로 적응적으로 보간함으로써 복원된다. 이러한 방식은 평탄한 영역뿐만 아니라 에지를 포함한 복잡한 영역도 우수하게 복원할 수 있다. 실험결과 제안된 방식은 기존의 공간적 에러은닉 방법과 비교하여 성능이 우수하다는 것을 알 수 있다.

Keywords

References

  1. JPEG Tech. Spec., Revision 8, JPEG-8-R8, ISO-IEC/JTC1/SC2/WP8, Aug. 1990
  2. ISO/IEC 13818-2, Generic Coding of Moving Pictures and Associated Audio Information-Part 2: Video, ISO/IEC 13 818-2 MPEG-2 Video Coding Standard, 1995
  3. 'Video codec for audiovisual services at p. 64 kbits/s,' CCITT Draft Revision of Recommendation H.261, CCITT SC XV, Description of Reference Model 8* RM8), Doc. 525, 1989
  4. Y. Wang and Q. F. Zhu, 'Error control and concealment for video communication: A review,' in Proc. IEEE Multimedia Signal Processing, May 1998, pp. 974-997
  5. S. Aign and K. Fazel, 'Temporal and Spatial Error Concealment Techniques for Hierarchical MPEG-2 Video Codec,' in Proc. IEEE Int. Conf. on commun., Vol. 3, pp. 1778-1783, 1995
  6. P. Salama, N. B. Shroff, E. J. Coyle, and E. J. Delp, 'Error concealment techniques for encoded video streams,' in Proc. Int. Conf. Image Processing, vol. I, Oct. 1995, pp. 9-12
  7. Y. Wang and Q. Zhu, 'Signal loss recovery in DCT-based image and video codecs,' in Proc. SPIE Conf. Visual Commun. and Image Processing, vol. 1605, pp. 667-678, Nov. 1991
  8. J. W. Park and S. U. Lee, 'Recovery of corrupted image data based on the NURBS interpolation,' IEEE Trans. Circuits Syst. Video Technol., vol. 9, pp. 1003-1008, Oct. 1999 https://doi.org/10.1109/76.795052
  9. H. Sun and W. Kwok, 'Concealment of damaged blocks transform coded images using projections onto convex sets,' IEEE Trans. Image Process., vol. 4, no. 4, pp. 470-477, Apr. 1995 https://doi.org/10.1109/83.370675
  10. S. S. Hemami and T. H.-Y. Meng, 'Transform coded image reconstruction exploiting interblock correlation,' IEEE Trans. Image Process., vol. 4, no. 7, pp. 1023-1027, Jul. 1995 https://doi.org/10.1109/83.392344
  11. S. Shirani, F. Kossentini, and R. Ward, 'Reconstruction of baseline JPEG coded images in error prone environments,' IEEE Trans. Image Process., vol. 9, no. 7, pp. 1292-1299, Jul. 2000 https://doi.org/10.1109/83.847842
  12. Z. Alkachouh and M. G. Bellanger, 'Fast DCT-based spatial domain interpolation of blocks in images,' IEEE Trans. Image Process., vol. 9, no. 4, pp. 729-732, Apr. 2000 https://doi.org/10.1109/83.841948
  13. M. Ancis and D. D. Giusto, 'Reconstruction of missing blocks in JPEG picture transmission,' in Proc. IEEE Pacific Rim Conf., pp. 288-291, Aug. 1999
  14. J.-W. Suh and Y.-S. Ho, 'Error concealment based on directional interpolation,' IEEE Trans. Consumer Electron., vol. 43, pp. 295-302, Aug. 1997 https://doi.org/10.1109/30.628616
  15. Y. Wang, Q. F. Zhu, and L. Shaw, 'Maximally smooth image recovering transform coding,' IEEE Trans. Commun., vol. 41, no. 10, pp.1544-1551, Oct. 1993 https://doi.org/10.1109/26.237889
  16. J.W. Park, J. W. Kim, and S. U. Lee, 'DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error,' IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 8, pp. 845-854, Dec. 1997 https://doi.org/10.1109/76.644064
  17. X. Lee, Y.-Q. Zhang, and A. Leon-Garcia, 'Information loss recovery for block-based image coding techniques-a fuzzy logic approach,' IEEE Trans. Image Process., vol. 4, no. 3, pp. 259-273, Mar. 1995 https://doi.org/10.1109/83.366475
  18. Z. Wang, Y. Yu, and D. Zhang, 'Best neighborhood matching: An information loss restoration technique for block-based image coding systems,' IEEE Trans. Image Processing, vol. 7, pp. 1056-1061, Jul. 1998 https://doi.org/10.1109/83.701166
  19. S.-C. Hsia, 'An edge-oriented spatial interpolation for consecutive block error concealment,' IEEE Signal Processing Letters, vol. 11, pp. 577-580, Jun. 2004 https://doi.org/10.1109/LSP.2004.827916
  20. Xin Li; Orchard, M.T., 'Novel sequential error-concealment techniques using orientation adaptive interpolation,' IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 10, pp. 857-864, Oct. 2002 https://doi.org/10.1109/TCSVT.2002.804882
  21. J. Park, D.-C. Park, R. J. Marks, II, M. A. El-Sharkawi, 'Recovery of image blocks using the method of alternating projections,' IEEE Trans. Image Process., vol. 14, no. 4, pp. 461-474, Apr. 2005 https://doi.org/10.1109/TIP.2004.842354