Browse > Article

Frame-rate Up-conversion using Hierarchical Adaptive Search and Bi-directional Motion Estimation  

Min, Kyung-Yeon (Dept. Computer Eng., Kwangwoon University)
Park, Sea-Nae (Dept. Computer Eng., Kwangwoon University)
Sim, Dong-Gyu (Dept. Computer Eng., Kwangwoon University)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.46, no.3, 2009 , pp. 28-36 More about this Journal
Abstract
In this paper, we propose a frame-rate up-conversion method for temporal quality enhancement. The proposed method adaptively changes search range during hierarchical motion estimation and reconstructs hole regions using the proposed bi-direction prediction and linear interpolation. In order to alleviate errors due to inaccurate motion vector estimation, search range is adaptively changed based on reliability and for more accurate, motion estimation is performed in descending order of block variance. After segmentation of background and object regions, for filling hole regions, the pixel values of background regions are reconstructed using linear interpolation and those of object regions are compensated based on the proposed hi-directional prediction. The proposed algorithm is evaluated in terms of PSNR with original uncompressed sequences. Experimental results show that the proposed algorithm is better than conventional methods by around 2dB, and blocky artifacts and blur artifacts are significantly diminished.
Keywords
Hierarchical motion estimation; adaptive search range; bi-direction; frame-rate up-conversion;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Fujiwara and A. Taguchi, 'Motion- compensated frame rate up-conversion based on block matching algorithm with multi-size blocks,' Proceedings of 2005 International Symposium on Intelligent Signal Processing and Communication Systems, Tokyo, Japan, pp.353-356, Dec. 2005
2 H. Sasai, S. Kondo, and S. Kadono, 'Frame-rate up-conversion using reliable analysis of transmitted motion information,' IEEE International Conference on Acoustics, Speech, and Signal Processing, Osaka, Japan, vol 5, pp. 257-260, May 2004
3 J. Zhai, K. Yu, J. Li, and S. Li, 'A low complexitymotioncompensatedframe interpolation method,' IEEE Intactions Symposium on Circuits and Systems, Kobe, Japan, pp. 4927-4930, May 2005
4 C. Cafforio, F. Rocca, and S. Tubaro, 'Motion compensated image interpolation,' IEEE Transactions Communication, vol. 35, no. 2, pp.215-222, Feb. 1990
5 B.-D. Choi, S.-J Ko, J.-W. Han, and C.-S. Kim, "Frame rate up-conversion using perspective trans," IEEE Transaction on Consumer Electronics, vol. 52, no. 3, pp.975-982, Aug. 2006   DOI   ScienceOn
6 S.-H. Lee, S. Yang, Y.-Y. Jung, and R.-H. Park, "Adaptive motion-compensated interpolation for frame rate up-conversion," Proc 2002, IEEE International Conference on Consumer Electronicsin, Los Angeles, CA, pp. 68-69, June 2002
7 Y.-K. Chen, A. Vetro, H. Sun, and S. Y. Kung, 'Frame-rate up-conversion using transmitted true motion vectors,' in Proc. 2nd IEEE International Workshop on Multimedia Signal Processing, CA, pp. 622-627, Dec. 1998
8 Y.-T. Yang, Y.-S. Tung, and J.-L. Wu, 'Quality enhancement of frame rate up-converted video by adaptive frame skip and reliable motion extraction,' IEEE Transactions on Circuits and Systems for Video Technology, vol 17, no. 12, pp. 1700-1713, Dec. 2007   DOI   ScienceOn
9 R. Castagno, P. Haavisto, and G. Ramponi, 'A method for motion adaptive frame rate upconversion,' IEEE Transactions on Circuits Systems for Video Technology, vol. 6, no. 5, pp.436-446, Oct. 1996   DOI   ScienceOn
10 J. Shi and J. Malik, 'Normalized cuts and image segmentation,' IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000   DOI   ScienceOn
11 'Bi-directionally motion-copensated frame-rate up-conversion for H.264/AVC decoder,' ELMAR Symposium, Zadar, Croatia, pp. 41-44, Jane 2005
12 G.-I. Lee, B.-W. Jeon, R.-H. Park, and S.-H. Le, 'Frame rate up-conversion using the wavelet transform,' Intv Conference on Consumer Electronics 2000, Los Angeles, CA, pp.172-173, June 2000
13 T. Chen, 'Adaptive temporal interpolation using bidirectional motion estimation and compensation,' IEEE International Conference of Image Processing, Princeton, NJ, pp313–316, Sept. 2002
14 G.-I. Lee, B.-W. Jeon, R.-H. Park, and S.-H. Lee, 'Hierarchical motion compensated frame rate up-conversion based on the Gaussian/Laplacian pyramid,' IEEE International Conference on Consumer Electronicspp, Los Angeles, CA, pp. 350-351, June 2003