POCS와 정규화를 기반으로한 프레임간 압출 영사의 후처리

Postprocessing of Inter-Frame Coded Images Based on Convex Projection and Regularization

  • 김성진 (중앙대학교 첨단영상대학원 영상공학과) ;
  • 정시창 (중앙대학교 첨단영상대학원 영상공학과) ;
  • 황인경 (중앙대학교 첨단영상대학원 영상공학과) ;
  • 백준기 (중앙대학교 첨단영상대학원 영상공학과)
  • Kim, Seong-Jin (Dept.of Media Engineering, Gsaim Art Technology college, Chungang University) ;
  • Jeong, Si-Chang (Dept.of Media Engineering, Gsaim Art Technology college, Chungang University) ;
  • Hwang, In-Gyeong (Dept.of Media Engineering, Gsaim Art Technology college, Chungang University) ;
  • Baek, Jun-Gi (Dept.of Media Engineering, Gsaim Art Technology college, Chungang University)
  • 발행 : 2002.05.01

초록

본 논문에서는 프레임간 압축된 영상의 블록화 현상을 감소시키기 위해 재구성하기 전 차분 영상을 처리하는 새로운 복원 알고리듬을 제안한다. 프레임내 압축 영상의 블록화 현상은 오직 8×8 DCT에 의해서 일어나는 반면에, 프레임간 압축된 영상에서는 8×8 DCT뿐만 아니라 움직임 보상을 위해 사용한 16×16의 매크로 블록에 의해서 발생된다. 이러한 이유로 본 논문에서는 차분 영상에 대한 새로운 열화모델을 제시하고, 블록 경계와 내부의 불연속에 대한 POCS를 이용한 복원 알고리듬을 제시한다. 제안된 알고리듬은 DCT계수의 일부를 이용해 블록 경계의 방향을 고려하는 공간 적응적 저대역 통과 필터를 포함하는 표준 정규화의 변환된 형태이다. 일반적인 비디오 압축 표준은 블록을 기준으로 하는 움직임 보상과 블록 이산여현 변환(BDCT)을 이용한 혼성(hybrid) 구조를 채택하고 있다. 이러한 이유에서 블록화 현상은 블록 경계와 블록 내부에서 일어난다. 두 종류의 블록화 현상을 좀 더 완벽히 제거하기 위해서 복원된 차분 영상은 블록 경계와 블록 내부에서의 방향성 불연속과 같은 제약조건을 만족시켜야만 한다. 그러한 제약조건은 차분 영상을 복구하기 위한 convex set을 정의하는데 이용한다.

In order to reduce blocking artifacts in inter-frame coded images, we propose a new image restoration algorithm, which directly processes differential images before reconstruction. We note that blocking artifact in inter-frame coded images is caused by both 8$\times$8 DCT and 16$\times$16 macroblock based motion compensation, while that of intra-coded images is caused by 8$\times$8 DCT only. According to the observation, we Propose a new degradation model for differential images and the corresponding restoration algorithm that utilizes additional constraints and convex sets for discontinuity inside blocks. The proposed restoration algorithm is a modified version of standard regularization that incorporate!; spatially adaptive lowpass filtering with consideration of edge directions by utilizing a part of DCT coefficients. Most of video coding standard adopt a hybrid structure of block-based motion compensation and block discrete cosine transform (BDCT). By this reason, blocking artifacts are occurred on both block boundary and block interior For more complete removal of both kinds of blocking artifacts, the restored differential image must satisfy two constraints, such as, directional discontinuities on block boundary and block interior Those constraints have been used for defining convex sets for restoring differential images.

키워드

참고문헌

  1. Y. Yang, N. P. Galantsanos, and A. K. Katsaggelos, 'Projection-based spatially adaptive reconstruction of block-transform compressed images', IEEE Trans. Image Processing, vol. 4, no. 7, pp. 896-908, July 1995 https://doi.org/10.1109/83.392332
  2. H. Reeve and J. S. Lim, 'Reduction of blocking effects in image coding', Optical Engineering, vol. 23, no. 1, pp. 34-37, January 1984
  3. Y. Yang, N. P. Galantsanos, and A. K. Katsaggelos, 'Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images', IEEE Trans. Circuits, Syst., Video Technol., vol. 3, no. 6, pp. 421-432, December 1993 https://doi.org/10.1109/76.260198
  4. S. Minami and A. Zakhor, 'An optimization approach for removing blocking effects in transform coding', IEEE Trans. Circuits. Syst., Video Technol., vol. 5, no, 2, pp. 74-82, April 1995 https://doi.org/10.1109/76.388056
  5. B. Jeon, J. Jeong, and J. Jo, 'Blocking artifacts reduction in image coding based on minimum block boundary discontinuity', Proc. 1995, Visual Commun., Image Processing, pp. 198-209, May 1995 https://doi.org/10.1117/12.206723
  6. J. Jeong and B. Jeon, 'Use of a class of two-dimensional functions for blocking artifacts reduction in image coding', Proc. 1995 Int. Conf. Image Processing, pp. 478-481, October 1995 https://doi.org/10.1109/ICIP.1995.529750
  7. H. W. Park and Y. L. Lee, 'A Postprocessing method for reducing quantization effects in low bit-rate moving picture coding', Proc. 1999 IEEE Trans. Circuits, Syst., Video Technol.., vol. 9, no. 1, pp. 161-171, February 1999 https://doi.org/10.1109/76.744283
  8. T. K. Kim and J. K. Paik, 'Fast image restoration for reducing block artifacts based on adaptive constrained optimization', J. Visual Comm, Image Representation, vol. 9, no. 3, pp. 234-242, September 1998 https://doi.org/10.1006/jvci.1998.0386
  9. T. K. Kim and J. K. Paik, 'Blocking artifacts reduction based on regularized iterative image restoration', Proc. 1998 Int. Tech. Conf. Circuit, Systems, Computers, Communications, vol. 1, pp. 55-58, July 1998
  10. S. C. Joung and J. K. Paik, 'Modified regularized image restoration for postprocessing inter-frame coded images', Proc. 1999 Int. Conf. Image Processing, vol. 3, pp. 474-478, October 1999 https://doi.org/10.1109/ICIP.1999.817159
  11. S, C. Joung, H. B. Woo, J. K. Paik, and Y. W. Choi, 'Enhancement of inter-frame coded images based on convex projections', Proc. 1999 IEEE Region 10 Conf., vol. 2, pp. 1275-1278, September 1999 https://doi.org/10.1109/TENCON.1999.818661
  12. A. K. Katsaggelos, J. Biemond, R. W. Schafer, and R. M. Mersereau, 'A Regularized iterative image restoration algorithm', Proc. 1991 IEEE Trans. Signal Processing., vol. 39, pp. 914-929, April 1991 https://doi.org/10.1109/78.80914
  13. 'Video coding for low bitrate communication,' Draft ITU-T Recommendation H.263, December 5, 1995