DOI QR코드

DOI QR Code

블록의 성질과 프레임 움직임을 고려한 적응적 확장 블록을 사용하는 프레임율 증강 기법

Adaptive Extended Bilateral Motion Estimation Considering Block Type and Frame Motion Activity

  • 박대준 (한양대학교 전자컴퓨터통신공학과) ;
  • 정제창 (한양대학교 전자컴퓨터통신공학과)
  • Park, Daejun (Department of Electronics and Computer Engineering, Hanyang University) ;
  • Jeong, Jechang (Department of Electronics and Computer Engineering, Hanyang University)
  • 투고 : 2013.03.29
  • 심사 : 2013.05.23
  • 발행 : 2013.05.30

초록

본 논문에서는 적응적인 확장 블록을 사용하는 프레임율 증강 기법인 AEBME (Adaptive Extended Bilateral Motion Estimation)을 제안하고자 한다. 기존의 EBME (Extended Bilateral Motion Estimation) 알고리듬은 동일한 구역에 두 번의 움직임 예측을 수행함으로 인해 높은 계산량이 요구되었다. 본 논문에서는 영상의 edge 정보를 활용한 블록 유형의 일치 유무를 고려하여 EBME 수행여부를 결정함으로써 움직임 예측 과정을 보다 빠르게 수행하도록 하였다. 움직임 벡터 평활화 과정이 적용되어 움직임 벡터 필드 내의 이상 벡터를 찾아 수정한다. 최종적으로 OBMC (Overlapped Block Motion Compensation)와 MCFI (Motion Compensated Frame Interpolation)이 프레임 움직임의 성질에 따라 적용되어 중간 프레임을 보간하게 된다. 실험 결과를 통해 제안하는 알고리듬이 기존의 알고리듬인 EBME에 비해 향상된 성능과 빠른 속도를 보임을 알 수 있다.

In this paper, a novel frame rate up conversion (FRUC) algorithm using adaptive extended bilateral motion estimation (AEBME) is proposed. Conventionally, extended bilateral motion estimation (EBME) conducts dual motion estimation (ME) processes on the same region, therefore involves high complexity. However, in this proposed scheme, a novel block type matching procedure is suggested to accelerate the ME procedure. We calculate the edge information using sobel mask, and the calculated edge information is used in block type matching procedure. Based on the block type matching, decision will be made whether to use EBME. Motion vector smoothing (MVS) is adopted to detect outliers and correct outliers in the motion vector field. Finally, overlapped block motion compensation (OBMC) and motion compensated frame interpolation (MCFI) are adopted to interpolate the intermediate frame in which OBMC is employed adaptively based on frame motion activity. Experimental results show that this proposed algorithm has outstanding performance and fast computation comparing with EBME.

키워드

참고문헌

  1. S. H. Chan, T. X. Wu and T. Q. Nguyen, "Comparison of two frame conversion schemes for reducing LCD motion blurs," IEEE Signal Processing Letters, vol. 17, no.9, pp. 782-786, Sept. 2010.
  2. S. J. Kang, K. R. Cho and Y. H. Kim, "Motion compensated frame rate up-conversion using extended bilateral motion estimation," IEEE Trans. Consumer Electron., vol. 53, no. 4, pp. 1759-1767, Nov. 2007. https://doi.org/10.1109/TCE.2007.4429281
  3. S. J. Kang, D. G. Yoo and S. K. Lee, "Multiframe-based bilateral motion estimation with emphasis on stationary caption processing for frame rate up-conversion," IEEE Trans. Consumer Electron., vol. 54, no. 4, pp. 1830-1838, Nov. 2008. https://doi.org/10.1109/TCE.2008.4711242
  4. M. T. Orchard and C. J. Sullivan, "Overlapped block motion compensation: an estimation-theoretic approach," IEEE Trans. Image Processing, vol. 9, no. 5, pp.1509-1521, Sept. 1994.
  5. B. D. Choi, J. W. Han, C. S. Kim and S. J. Ko, "Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion compensation," IEEE Trans. Circuits and Systems for Video Technology, vol. 17, no. 4, pp. 407-416, Apr. 2007. https://doi.org/10.1109/TCSVT.2007.893835
  6. D. Wang, A. Vincent, P. Blanchfield and R. Klepko, "Motion- Compensated Frame Rate Up-Conversion-Part II: New Algorithms for Frame Interpolation," IEEE Trans. Broadcating, vol. 56, no.2, pp. 142-149, Jun. 2007.
  7. R. C. Gonzalez and R. E. Woods, Digital Image Processing, 3rd Edition, Prentice Hall, New Jersey, 2010.