Content Adaptive Interpolation for Intra-field Deinterlacting

공간적 디인터레이싱을 위한 컨텐츠 기반 적응적 보간 기법

  • 김원기 (한양대학교 전자통신컴퓨터공학과 영상통신 및 신호처리 연구실) ;
  • 진순종 (한양대학교 전자통신컴퓨터공학과 영상통신 및 신호처리 연구실) ;
  • 정제창 (한양대학교 전자통신컴퓨터공학과 영상통신 및 신호처리 연구실)
  • Published : 2007.10.31

Abstract

This paper presents a content adaptive interpolation (CAI) for intra deinterlacing. The CAI consists of three steps: pre-processing, content classification, and adaptive interpolation. There are also three main interpolation methods in our proposed CAI, i.e. modified edge-based line averaging (M-ELA), gradient directed interpolation (GDI), and window matching method (WMM). Each proposed method shows different performances according to spatial local features. Therefore, we analyze the local region feature using the gradient detection and classify each missing pixel into four categories. And then, based on the classification result, a different do-interlacing algorithm is activated in order to obtain the best performance. Experimental results demonstrate that the CAI method performs better than previous techniques.

본 논문에서는 공간적인 디인터레이싱을 위한 컨텐츠 기반 적응적 보간 기법을 제안한다. 제안하는 알고리즘은 전처리와 컨텐츠 분석, 컨텐츠에 따른 적응적 보간의 3 단계로 구성된다. 또한 적응적 보간 방식으로써 변형된 에지기반 라인 평균 방식과 그레디언트 기반 방향성 보간, 윈도우 매칭 방식의 세 가지 보간 방식을 제안한다. 각각의 보간 방식은 공간적인 영상 특징에 따라 다양한 성능을 나타낸다. 따라서 각각의 보간할 픽셀 영역은 그레디언트 검출을 통해 영역 특징을 분석하고 네 가지 카테고리로 분류된다. 이러한 분류 결과를 기반으로 각각에 적합한 디인터레이싱 방법을 사용함으로써 최적의 성능을 구현할 수 있다. 다양한 영상에 대한 실험을 통해 제안한 방식이 기존의 방식에 비해 가장 좋은 성능을 보임을 확인하였다.

Keywords

References

  1. G. de Haan and E. B. Bellers, 'deinterlacing - an overview,' Proc. Of the IEEE, vol.86, no. 9, pp. 1839-1857, Sep. 1998 https://doi.org/10.1109/5.705528
  2. H. Hwang, 'Interlaced to progressive scan converter for IDTV,' IEEE Trans. Consumer Electronics, vol. 38, pp 135-144 August 1992 https://doi.org/10.1109/30.156674
  3. H. Hwang, M.H. Lee, D.I. Song, 'Interlaced to progressive scan conversion with double smoothing,' IEEE Trans. Consumer Electronics, vol. 39, pp. 241-246, Aug. 1993 https://doi.org/10.1109/30.234588
  4. M. H. Lee, J. H. Kim, J. S. Lee, K. K. Ryu, and D. I. Song, 'A New Algorithm for Interlaced to Progressive Scan Conversion Based on Directional Correlations and its IC Design,' IEEE Trans. Consumer Electronics, Vol. 40, No. 2, pp. 119-129, May 1994 https://doi.org/10.1109/30.286406
  5. C.J. Kuo, C. Liao, and C.C. Lin, 'Adaptive interpolation technique for scanning rate conversion,' IEEE Trans. On Circuits Systems for Video Technology, vol. 6, no. 3, pp. 317-321, Jun. 1996 https://doi.org/10.1109/76.499841
  6. T. Doyle, 'Interlaced to sequential conversion for EDTV applications,' in proc. 2nd Int. Workshop Signal Processing of HDTV, pp. 412-430, Feb. 1998
  7. Tao Chen, Hong Ren Wu, and Zheng Hua Yu, 'Efficient Deinterlacing algorithm using edge-based line average interpolation,' Optical Engineering, Vol. 39, No. 8, pp. 2101-2105, Aug. 2000 https://doi.org/10.1117/1.1305262
  8. Hoon Yoo and Jechang Jeong, 'Direction-oriented interpolation and its application to de-interlacing,' IEEE Trans. Consumer Electronics, vol. 48, Issue 4, pp. 954-962, Nov. 2002 https://doi.org/10.1109/TCE.2003.1196426
  9. Shyh-Feng Lin, Yu-Ling Chang, and Liang-Gee Chen, 'Motion adaptive interpolation with horizontal motion detection for deinterlacing,' IEEE Trans. Consumer Electronics, Vol. 49, Issue 4, pp. 1256-1265, Nov. 2003 https://doi.org/10.1109/TCE.2003.1261227
  10. Min Kyu Park, Moon Gi Kang, Kichul Nam, and Sang Gun Oh, 'New edge dependent deinterlacing algorithm based on horizontal edge pattern,' IEEE Trans. Consumer Electronics, Vol. 49, Issue 4, pp. 1508-1512, Nov. 2003 https://doi.org/10.1109/TCE.2003.1261260
  11. Tak-Song Chong, Au, O.C., Wing-San Chau, Tai-Wai Chan, 'A content adaptive de-interlacing algorithm,' IEEE International Symposium on Circuits and Systems, pp. 4923-4926, May 2005
  12. L.Vandendorpe et al., 'Motion-compensated conversion from interlaced to progressive formats,' Signal Process.: Image Commun., vol. 6, pp. 193-211, 1994 https://doi.org/10.1016/0923-5965(94)90025-6
  13. G. Haan and E. B. Bellers, 'De-interlacing of video data,' IEEE Trans. Consumer Electronics, vol. 43, no. 3, pp. 819-825, Aug. 1997 https://doi.org/10.1109/30.628721
  14. D. Han, C.-Y Shin, S.-J. Choi, and J.-S park, 'A motion adaptive 3-d de-interlacing algorithm based on the brightness profile pattern difference,' IEEE Trans. Consumer Electronics, vol. 45, no. 3, pp. 690-697, Aug. 1999 https://doi.org/10.1109/30.793572
  15. K. Sugiyama and H. Nakamura, 'A method of de-interlacing with motion compensated interpolation,' IEEE Trans. Consumer Electronics, vol. 45, no. 3, pp. 611-616, Aug. 1999 https://doi.org/10.1109/30.793548
  16. R. Li, B. Zeng, and M. L. Liou, 'Reliable motion detection /compensation for interlaced sequences and its applications to deinterlacing,' IEEE Trans. Circuits Systems for Video Technology, vol. 10, no. 1, pp. 23-29, Feb. 2000 https://doi.org/10.1109/76.825854
  17. Y.-Y Jung, B.-T Choi, Y.-J Park, and S.-J. Ko, 'An efficient de-interlacing technique using motion compensated interpolation,' IEEE Trans. Consumer Electronics, vol. 46, no. 3, pp. 460-466, Aug. 2000 https://doi.org/10.1109/30.883394