Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Frame Rate Conversion Algorithm Using Adaptive Search-based Motion Estimation

적응적 탐색기반 움직임 추정을 사용한 프레임 율 변환 알고리즘

  • Kim, Young-Duk (Institute of TMS Information Technology Yonsei University) ;
  • Chang, Joon-Young (Institute of TMS Information Technology Yonsei University) ;
  • Kang, Moon-Gi (Institute of TMS Information Technology Yonsei University)
  • 김영덕 (연세대학교 전기전자공학과 TMS 정보 기술 사업단) ;
  • 장준영 (연세대학교 전기전자공학과 TMS 정보 기술 사업단) ;
  • 강문기 (연세대학교 전기전자공학과 TMS 정보 기술 사업단)
  • Published : 2009.05.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a frame rate conversion algorithm using adaptive search-based motion estimation (ME). The proposed ME method uses recursive search, 3-step search, and single predicted search as candidates for search strategy. The best method among the three candidates is adaptively selected on a block basis according to the predicted motion type. The adaptation of the search method improves the accuracy of the estimated motion vectors while curbing the increase of computational load. To support the proposed ME method, an entire image is divided into three regions with different motion types. Experimental results show that the proposed FRC method achieves better image quality than existing algorithms in both subjective and objective measures.

본 논문에서는 적응적 탐색기반 움직임 추정을 사용한 프레임 율 변환(FRC : Frame Rate Conversion) 알고리즘을 제안한다. 제안된 움직임 추정은 회귀탐색, 삼 단계탐색(3-SS : 3-Step Search), 그리고 단일예측탐색을 복합적으로 사용하며, 이 세 가지 탐색기법 중 블록 별 영역 특성에 가장 적합한 탐색 기법을 적용한다. 이러한 적응적 탐색방법을 적용함으로써 계산 량의 증가를 억제하면서 움직임 추정의 정확도를 향상시킨다. 이를 위해 제안된 기법에서는 시간적 예측을 통해 영상전체를 블록 별 움직임 종류에 따라 3가지 영역으로 분할한다. 제안된 움직임 추정기법을 사용한 프레임 율 변환 알고리즘은 기존 알고리즘에 비해 주관적 및 객관적인 면에서 모두 뛰어난 결과를 보임을 실험을 통해 확인 할 수 있다.

Keywords

References

  1. B. Choi, S. Lee, S. Ko, "New frame rate up-conversion using bi-directional motion estimation," IEEE Trans. Consum. Electron., Vol. 46, No. 3, pp. 603-609, Aug. 2000 https://doi.org/10.1109/30.883418
  2. B. Choi, J. Han, C. Kim, and S. Ko, "Frame Rate Up-Conversion Using Perspective Transform," IEEE Trans. Consum. Electron., Vol. 52, No. 3, pp. 975-982, Aug. 2006 https://doi.org/10.1109/TCE.2006.1706496
  3. K. Hilman, H. Park, Y. Kim, "Using Motion-Compensated Frame-Rate Conversion for the Correction of 3:2 Pulldown Artifacts in Video Sequences," IEEE Trans. Circuits Syst. Video Technol., Vol. 10, No. 6, pp.869-877, Sep. 2000 https://doi.org/10.1109/76.867925
  4. S. Lee, O. Kwon, and R. Park, "Weighted- Adaptive Motion-Compensated Frame Rate Up- Conversion," IEEE Trans. Consum. Electron., Vol. 49, No. 3, pp. 485-492, Aug. 2003 https://doi.org/10.1109/TCE.2003.1233759
  5. B. Jeon, G. Lee, S. Lee, and R. Park "Coarse-to-Fine Frame Interpolation for Frame Rate Up-Conversion Using Pyramid Structure," IEEE Trans. Consum. Electron., Vol. 49, No. 3,pp.499-508, Aug. 2003 https://doi.org/10.1109/TCE.2003.1233761
  6. T Ha, S. Lee, and J. Kim, "Motion Compensated Frame Interpolation by new Block-based Motion Estimation Algorithm," IEEE Trans. Consum. Electron., Vol. 50, No. 2, pp.752-759, May. 2004. https://doi.org/10.1109/TCE.2004.1309458
  7. J. Zhai, K. Yu, J. Li, and S. Li, "A Low Complexity Motion Compensated Frame Interpolation Method," Proc. IEEE International Symposium on Circuits and Systems, Vol. 5, pp.4927-4930, May 2005
  8. S. Fujiwara and A. Taguchi, "Motion- Compensated Frame Rate Up-Conversion Based on Block Matching Algorithm with Multi-size Blocks," Proc. Int. Symp. Intelligent Signal Processing and Communication Systems, pp.353-356, Dec. 2005
  9. J. Wang, N. Patel, and W. Grosky, "A Fast Block-based Motion Compensation Video Frame Interpolation Approach," Proc. Asilomar Conf. Signals, Systems, Computers, Vol. 2, pp. 1740-1743, Nov. 2004
  10. P. Csillag and L. Boroczky, "Frame-rate conversion based on acceleration and motion-based segmentation," Proc. SPIE Vol.2952, pp.438-448, 1996 https://doi.org/10.1117/12.251304
  11. V. Lin and S. G. Chen, "Efficient algorithm for frame rate conversion," Proc. SPIE Vol. 2308, pp.694-702, 1994 https://doi.org/10.1117/12.186012
  12. G. de Haan, P. W.A.C. Biezen, H. Huijgen, and O. A. Ojo, "True-Motion Estimation with 3-D Recursive Search Block Matching," IEEE Trans. Circuits Syst. Video Technol., Vol. 3, No. 5, pp.368-379, Oct. 1993 https://doi.org/10.1109/76.246088
  13. 김영덕, 장준영, 강문기, "관심영역을 고려한 적분 프로젝션기반 움직임 추정을 사용한 순차주사화 알고리즘", 대한전자공학회, 제45권 SP편 제3호, pp20-29, 2008년 5월