Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

A time recursive approach for do-interlacing using improved ELA and motion compensation based on hi-directional BMA

개선된 ELA와 양방향 BMA기반의 움직임 보상을 이용한 재귀적 디인터레이싱

  • Published : 2004.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an algorithm for interlaced-to-progressive conversion by the weighted summation of the information collected from spatial do-interlacing method, in which the weighted edge based line average is applied, and the temporal method in which the motion compensation is employed by using hi-directional BMA (block matching algorithm). We employed time-recursive and motion adaptive processing as motion detection is involved. Also, a median filter is used to deal with limitation of the linear summation in which only an intermediate of values being involved is determined. The main goal of the approach is to overcome the shortcomings of each of the do-interlacing techniques without significant increment of the computational complexity, and the proposed method is apt to implement in hardware for real-time processing.

본 논문에서는 공간정보(spatial information)를 이용하는 개선된 ELA(edge based line average) 방법과 시간정보(temporal information)를 이용하는 움직임 보상(motion compensation) 방법 간의 가중합산을 통하여 비원주사 방식의 영상(interlaced image)을 순차주사 방식의 영상(progressive image)으로 변환하는 알고리즘을 제안한다. 이 때, 움직임 보상은 하드웨어 구현이 용이한 양방향 BMA(block matching algorithm)에 의해 이루어진다. 보다 높은 성능과 효율성을 갖기 위하여 앞선 단계에서 디인터레이싱 되어진 영상을 사용하는 재귀적 구조와 움직임 검출을 통한 움직임에 적응적인 처리과정을 거치게 된다. 또한, 가중변수를 통하여 선형 결합할 경우 그 결과값은 결합하는 값의 사이값만을 가질 수 있기 때문에 미디언 필터(median filter)를 사용하여 이를 보완한다. 이러한 접근은 각각의 디인터레이싱 방법이 갖고 있는 단점을 계산복잡도의 증가 없이 극복하여 보다 다양한 영상조건에서 정확하고 효율적인 디인터레이싱을 가능하게 해주며, 실시간 처리를 위한 하드웨어 구현을 용이하게 해준다.

Keywords

References

  1. G. D. Haan and E. B. Bellers, 'Deinterlacing An Overview', Proceedings of IEEE, Vol. 86, No. 9, pp. 1839 -1857, September 1998 https://doi.org/10.1109/5.705528
  2. A. Nguyen and E. Dubois, 'Spatio-temporal adaptive interlaced-to-progressive conversion,' in Signal Processing of HDIV, IV, E. Dubois and L. Chiariglione, Eds. Amsterdam, The Netherlands: Elsevier Science Publisher, pp. 749-756, 1993
  3. M. Achiha, K. Ishikura, and T. Fukinuki, 'A motion-adaptive high-definition converter for NTSC color TV signals,' SMPTE Journal, vol. 93, no. 5, pp. 470-476, May 1984 https://doi.org/10.5594/J03570
  4. F. M. Wang, D. Anastassiou, and A. N. Netravali, 'Time-recursive deinterlacing for IDTV and pyramid coding', Signal Process. Image Communication 2, pp. 365-374, 1990 https://doi.org/10.1016/0923-5965(90)90012-7
  5. T. Koivunen, 'Motion detection of an interlaced video signal,' IEEE Transactions on Consumer Electronics, vol. 40, no. 3, pp. 753-760, Aug. 1994 https://doi.org/10.1109/30.320867
  6. R. C. Gonzalez, and R. E. Woods, Digital Image Processing, Second Edition, Prentice Hall, 2001
  7. T. Doyle and M. Looymans, 'Progressive scan conversion using edge information,' in Signal Processing of HDTV, II, L. Chiariglione, Ed. Amsterdam, The Netherlands: Elsevier Science Publisher, pp. 711-715, 1990
  8. J. Salonen, 'Edge and motion controlled spatial upconversion,' IEEE Transactions on Consumer Electronics, vol. 40, no. 3, pp. 225-233, Aug. 1994 https://doi.org/10.1109/30.320799
  9. Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video processing and communications, Upper Saddle River, N.J.: Prentice Hall, 2002
  10. D. J. Wang and J. J. Leou, 'A new approach to video format conversion using bidirectional motion estimation and hybrid error concealment,' Journal of Information Science and Engineering, vol. 17, no. 5, pp. 763-777, 2001