계층적 적응적 탐색과 양방향 움직임 예측을 이용한 프레임율 증가 방법

Frame-rate Up-conversion using Hierarchical Adaptive Search and Bi-directional Motion Estimation

  • 민경연 (광운대학교 컴퓨터공학과) ;
  • 박시내 (광운대학교 컴퓨터공학과) ;
  • 심동규 (광운대학교 컴퓨터공학과)
  • 발행 : 2009.05.25

초록

본 논문은 비디오의 시간적 화질 향상을 위한 새로운 프레임율 증가 방법을 제안한다. 제안하는 방법에서는 계층적 움직임 추정 시에 탐색범위를 적응적으로 변환하는 방법을 이용하며, 움직임 보상 시 보간되지 않은 부분에 한하여 양방향 움직임 추정 및 보상과 선형 보간법을 수행한다. 부정확한 움직임 벡터 추정으로 인한 오류를 방지하기 위하여 신뢰도를 기반으로 탐색범위를 적응적으로 조절하며, 움직임 추정에 대한 신뢰도를 높이기 위하여 분산이 높은 블록 순으로 움직임 추정을 수행한다. 또한, 보간되지 않은 영역에서 배경과 객체를 분리한 후 배경인 영역에서는 선형보간법을 수행하고, 객체로 추정된 영역에서는 양방향 움직임 추정 방법을 이용하여 보간한다. 알고리즘의 성능을 평가하기 위하여 원본 프레임과 제안한 알고리즘을 이용하여 보간한 프레임 사이의 PSNR을 측정하였다. 그 결과, 화질이 기존 알고리즘보다 약 2dB 정도 개선되었으며, 블록화 현상과 몽롱화 현상이 감소한 것을 확인할 수 있었다.

In this paper, we propose a frame-rate up-conversion method for temporal quality enhancement. The proposed method adaptively changes search range during hierarchical motion estimation and reconstructs hole regions using the proposed bi-direction prediction and linear interpolation. In order to alleviate errors due to inaccurate motion vector estimation, search range is adaptively changed based on reliability and for more accurate, motion estimation is performed in descending order of block variance. After segmentation of background and object regions, for filling hole regions, the pixel values of background regions are reconstructed using linear interpolation and those of object regions are compensated based on the proposed hi-directional prediction. The proposed algorithm is evaluated in terms of PSNR with original uncompressed sequences. Experimental results show that the proposed algorithm is better than conventional methods by around 2dB, and blocky artifacts and blur artifacts are significantly diminished.

키워드

참고문헌

  1. R. Castagno, P. Haavisto, and G. Ramponi, 'A method for motion adaptive frame rate upconversion,' IEEE Transactions on Circuits Systems for Video Technology, vol. 6, no. 5, pp.436-446, Oct. 1996 https://doi.org/10.1109/76.538926
  2. H. Sasai, S. Kondo, and S. Kadono, 'Frame-rate up-conversion using reliable analysis of transmitted motion information,' IEEE International Conference on Acoustics, Speech, and Signal Processing, Osaka, Japan, vol 5, pp. 257-260, May 2004
  3. Y.-K. Chen, A. Vetro, H. Sun, and S. Y. Kung, 'Frame-rate up-conversion using transmitted true motion vectors,' in Proc. 2nd IEEE International Workshop on Multimedia Signal Processing, CA, pp. 622-627, Dec. 1998
  4. Y.-T. Yang, Y.-S. Tung, and J.-L. Wu, 'Quality enhancement of frame rate up-converted video by adaptive frame skip and reliable motion extraction,' IEEE Transactions on Circuits and Systems for Video Technology, vol 17, no. 12, pp. 1700-1713, Dec. 2007 https://doi.org/10.1109/TCSVT.2007.903806
  5. C. Cafforio, F. Rocca, and S. Tubaro, 'Motion compensated image interpolation,' IEEE Transactions Communication, vol. 35, no. 2, pp.215-222, Feb. 1990
  6. G.-I. Lee, B.-W. Jeon, R.-H. Park, and S.-H. Le, 'Frame rate up-conversion using the wavelet transform,' Intv Conference on Consumer Electronics 2000, Los Angeles, CA, pp.172-173, June 2000
  7. B.-D. Choi, S.-J Ko, J.-W. Han, and C.-S. Kim, "Frame rate up-conversion using perspective trans," IEEE Transaction on Consumer Electronics, vol. 52, no. 3, pp.975-982, Aug. 2006 https://doi.org/10.1109/TCE.2006.1706496
  8. J. Zhai, K. Yu, J. Li, and S. Li, 'A low complexitymotioncompensatedframe interpolation method,' IEEE Intactions Symposium on Circuits and Systems, Kobe, Japan, pp. 4927-4930, May 2005
  9. 'Bi-directionally motion-copensated frame-rate up-conversion for H.264/AVC decoder,' ELMAR Symposium, Zadar, Croatia, pp. 41-44, Jane 2005
  10. G.-I. Lee, B.-W. Jeon, R.-H. Park, and S.-H. Lee, 'Hierarchical motion compensated frame rate up-conversion based on the Gaussian/Laplacian pyramid,' IEEE International Conference on Consumer Electronicspp, Los Angeles, CA, pp. 350-351, June 2003
  11. S. Fujiwara and A. Taguchi, 'Motion- compensated frame rate up-conversion based on block matching algorithm with multi-size blocks,' Proceedings of 2005 International Symposium on Intelligent Signal Processing and Communication Systems, Tokyo, Japan, pp.353-356, Dec. 2005
  12. J. Shi and J. Malik, 'Normalized cuts and image segmentation,' IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000 https://doi.org/10.1109/34.868688
  13. S.-H. Lee, S. Yang, Y.-Y. Jung, and R.-H. Park, "Adaptive motion-compensated interpolation for frame rate up-conversion," Proc 2002, IEEE International Conference on Consumer Electronicsin, Los Angeles, CA, pp. 68-69, June 2002
  14. T. Chen, 'Adaptive temporal interpolation using bidirectional motion estimation and compensation,' IEEE International Conference of Image Processing, Princeton, NJ, pp313–316, Sept. 2002