Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

De-interlacing Algorithm based on Motion Compensation Reliability

움직임 보상의 신뢰도에 기반 한 순차주사화 알고리즘

  • Chang, Joon-Young (Institute of TMS Information Technology Yonsei University) ;
  • Kim, Young-Duk (Institute of TMS Information Technology Yonsei University) ;
  • Kang, Moon-Gi (Institute of TMS Information Technology Yonsei University)
  • 장준영 (연세대학교 전기전자공학과 TMS 정보 기술 사업단) ;
  • 김영덕 (연세대학교 전기전자공학과 TMS 정보 기술 사업단) ;
  • 강문기 (연세대학교 전기전자공학과 TMS 정보 기술 사업단)
  • Published : 2009.11.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a de-interlacing algorithm that combines a motion compensation (MC) method and the vertical-temporal filter with motion compensation (MC V-T filter) according to motion compensation reliability. The MC method represent one of the best ways of improving the resolution of de-interlaced frames, but it may introduce motion compensation artifacts in regions with incorrect motion information. In these regions, the MC V-T filter that is very robust to motion vector errors can be used to correct motion compensation artifacts. The combination between two methods is controlled by the motion compensation reliability that is measured by analyzing the estimated motion vectors and the results of MC. The motion compensation reliability contains information about motion compensation artifacts of MC results and determines the combination weight according to this information. Therefore, the combination rule of the proposed method is more accurate than those of the conventional methods and it enables the proposed method to provide high quality video sequences without producing any visible artifacts. Experimental results with various test sequences show that the proposed algorithm outperforms conventional algorithms in terms of both visual and numerical criteria.

본 논문에서는 움직임 보상 결과의 신뢰도를 바탕으로 움직임 보상 순차주사화 알고리즘의 결과와 움직임 보상 수직-시간 필터의 결과를 결합하는 순차주사화 알고리즘을 제안한다. 움직임 보상 순차주사화 알고리즘은 높은 공간 해상도를 가진 고화질 영상을 생성하지만 움직임 벡터가 잘못 추정되었을 경우 눈에 띄는 에러를 발생시킨다. 반면에 움직임 보상 수직-시간 필터는 높은 공간 해상도를 제공하지는 못하지만 움직임 벡터의 에러에 강건한 특성을 가지고 있기 때문에 전체적으로 자연스러운 영상을 제공한다. 제안하는 순차주사화 알고리즘은 추정된 움직임 벡터와 움직임 보상 순차주사화 알고리즘의 결과를 분석하여 움직임 보상의 신뢰도를 추정한 후, 움직임 보상 신뢰도에 기반 한 가중치를 바탕으로 두 가지 방법의 장점을 결합한다. 제안된 방법은 움직임 보상의 신뢰도가 높은 영역에서는 높은 공간 해상도를 제공하는 움직임 보상 순차주사화 알고리즘을 적용하고 움직임 보상의 신뢰도가 낮은 영역에 대해서는 움직임 보상 수직-시간 필터를 적용하여 눈에 띄는 에러 없이 높은 공간 해상도를 가지는 영상을 생성한다. 실험 결과에서는 제안된 알고리즘이 기존의 알고리즘에 비해 시각적 및 수치적인 면에서 뛰어난 결과를 보임을 확인할 수 있다.

Keywords

References

  1. G. de Haan and E. B. Bellers, 'Deinterlacing-an overview,' Proc. IEEE, vol. 86, no. 9, pp. 1839-1857, Sep. 1998 https://doi.org/10.1109/5.705528
  2. H. Yoo and J. Jeong, 'Direction-oriented interpolation and its application to de-interlacing', IEEE Trans. Consum. Electron., vol. 48, no. 4, pp. 954-962, Nov. 2002 https://doi.org/10.1109/TCE.2003.1196426
  3. M. K. Park, M. G. Kang, K. Nam, and S. G. Oh, 'New edge dependent deinterlacing algorithm based on horizontal edge pattern', IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1508-1512, Nov. 2003 https://doi.org/10.1109/TCE.2003.1261260
  4. M. K. Park, M. Byun, J. H. Park, and M. G. Kang, 'Edge-dependent interpolation-based de-interlacing using edge patterns', SPIE Electronic Imaging., vol. 4, pp.22-29, Oct. 2006 https://doi.org/10.1117/1.2360696
  5. Xin Li, 'New edge-directed interpolation', IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001 https://doi.org/10.1109/83.951537
  6. S. G. Lee and D. H. Lee, 'A motion-adaptive de-interlacing method using an efficient spatial and temporal interpolation', IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1266-1271, Nov. 2003 https://doi.org/10.1109/TCE.2003.1261228
  7. Y. Y. Jung, S. Yang and P. Yu, "An effective de-interlacing technique using two types of motion information", IEEE Trans. Consum. Electron., vol. 49, no. 3, pp. 493-498, Aug. 2003 https://doi.org/10.1109/TCE.2003.1233760
  8. M.-J. Chen, C.-H. Huang and C.-T. Hsu, "Efficient de-interlacing technique by inter-field information", IEEE Trans. Consum. Electron., vol. 50, no. 4, pp. 1202-1208, Nov. 2004 https://doi.org/10.1109/TCE.2004.1362520
  9. S. Yang, Y. Jung, Y. H. Lee, and R. Park, "Motion compensation assisted motion adaptive interlaced-to-progressive conversion", IEEE Trans. on Circuits and Systems for Video Technology, Vol. 14, No. 9, pp. 1138-1148, Sep. 2004 https://doi.org/10.1109/TCSVT.2004.833163
  10. D. Wang, A. Vincent, and P. Blanchfield, "Hybrid de-interlacing algorithm based on motion vector reliability", IEEE Trans. Circuits Syst. for Video Technology Video Technol., vol. 15, no. 8, pp. 1019-1025, Aug. 2005 https://doi.org/10.1109/TCSVT.2005.852414
  11. O. Kwon, K. Sohn, and C. Lee, 'Deinterlacing using directional interpolation and motion compensation', IEEE Trans. Consum. Electron., vol. 49, no. 1, pp. 198-203, Feb. 2003 https://doi.org/10.1109/TCE.2003.1205477
  12. Y.-Y. Jung, B.-T. Choi, Y.-J. Park and S.-J. KO, 'An effective de-interlacing technique using motion compensated interpolation', IEEE Trans. Consum. Electron., vol. 46, no. 3, pp. 460-466, Aug. 2000 https://doi.org/10.1109/30.883394
  13. Y.-L. Chang, S.-F. Lin, C.-Y. Chen, and L.-G. Chen, "Video de-interlacing by adaptive 4-field global/local motion compensated approach", IEEE Trans. Circuits Syst. for Video Technology Video Technol., vol. 15, no. 12, pp. 1569-1582, Dec. 2005 https://doi.org/10.1109/TCSVT.2005.858746
  14. K. Sugiyama and H. Nakamura, 'A method of de-interlacing with motion compensated interpolation', IEEE Trans. Consum. Electron., vol. 45, no. 3, pp. 611-616, Aug. 1999 https://doi.org/10.1109/30.793548
  15. G. de Haan, P. W. A. C. Biezen, H. Huijgen, and O. A. Ojo, 'True-motion estimation with 3-D recursive search block matching', IEEE Trans. Circuits Syst. for Video Technology Video Technol., vol. 3, no. 5, pp. 368-379, 388, Oct. 1993 https://doi.org/10.1109/76.246088
  16. R. A. Beuker, and I. A. Shah, "Analysis of interlaced video signals and its applications", IEEE Trans. Image Process., vol. 3, no. 5, pp. 501-512, Sep. 1994 https://doi.org/10.1109/83.334990