Browse > Article
http://dx.doi.org/10.3837/tiis.2013.10.007

Joint Overlapped Block Motion Compensation Using Eight-Neighbor Block Motion Vectors for Frame Rate Up-Conversion  

Li, Ran (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications)
Wu, Minghu (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications)
Gan, Zongliang (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications)
Cui, Ziguan (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications)
Zhu, Xiuchang (Jisangsu Key Lab on Image Processing & Image Communication, Nanjing University of Posts and Telecommunications)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.7, no.10, 2013 , pp. 2448-2463 More about this Journal
Abstract
The traditional block-based motion compensation methods in frame rate up-conversion (FRUC) only use a single uniquely motion vector field. However, there will always be some mistakes in the motion vector field whether the advanced motion estimation (ME) and motion vector analysis (MA) algorithms are performed or not. Once the motion vector field has many mistakes, the quality of the interpolated frame is severely affected. In order to solve the problem, this paper proposes a novel joint overlapped block motion compensation method (8J-OBMC) which adopts motion vectors of the interpolated block and its 8-neighbor blocks to jointly interpolate the target block. Since the smoothness of motion filed makes the motion vectors of 8-neighbor blocks around the interpolated block quite close to the true motion vector of the interpolated block, the proposed compensation algorithm has the better fault-tolerant capability than traditional ones. Besides, the annoying blocking artifacts can also be effectively suppressed by using overlapped blocks. Experimental results show that the proposed method is not only robust to motion vectors estimated wrongly, but also can to reduce blocking artifacts in comparison with existing popular compensation methods.
Keywords
Frame rate up-conversion (FRUC); 8-neighbor blocks; minimum mean square error (MMSE); Tikhonov regularization; overlapped block;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Hwang, Y. Choi and Y. Choe. "Frame rate up-conversion technique using hardware-efficient motion estimator architecture for motion blur reduction for TFT-LCD," IEICE Transaction on Electronics, vol.E94-C, no.5, pp.896-904, 2001.
2 K. Hilman, Y. W. Park and Y. Kim. "Using motion compensated frame rate conversion for the correction of 3:2 pulldown artifacts in video sequence," IEEE Transaction on Circuits and Systems for Video Technology, vol.10, no.6, pp.869-877, 2000.   DOI   ScienceOn
3 Z. L. Gan and X. C. Zhu. "Study of frame-rate up conversion based on H.264," The Journal of China Universities of Posts and Telecommunications, vol.14, no.1, pp.106-110, 2007.
4 B. Girod, A. Aaron and S. Rane, et al.. "Distributed video coding," Processing of the IEEE , vol.93, no.1, pp. 71-83, 2005.
5 Y. K. Chen and S. Y. Kung. "Rate optimization by true motion estimation." in Proc. of IEEE Workshop Myltimedia Signal Process, pp.187-194, 23-25 June, 1997.
6 C. C. Cheng, W. L. Hwang and Z. Shen, et al.. "Advanced motion compensation techniques ofr blocking artifacts reduction in 3-D vides coding systems," in Proc. of IEEE International Conference on Image Processing, pp.89-92, 11-14 September, 2005.
7 G. D. Haan, P. W. A. C. Biezen and H. Huijgen, et al.. "True motion estimation with 3-D recursive search block matching," IEEE Transaction on Circuits System and Video Technology, vol.3, no.5, pp. 368-379, 1993.   DOI   ScienceOn
8 B. T. Choi, S. H. Lee and S. J. Ko. "New frame rate up-conversion using bi-directional motion estimation," IEEE Transaction on Consumer and Electron, vol. 46, no. 3, pp. 603-609, 2000.   DOI   ScienceOn
9 S. J. Kang, S. J. Yoo and Y. H. Kim. "Dual motion estimation for frame rate up-conversion," IEEE Transaction on Circuits System and Video Technology, vol.20, no.12, pp.1909-1914, 2010.   DOI   ScienceOn
10 D. M. Wang, Zhang L and A. Vincent. "Motion-compensated frame rate up-conversion, part I: Fast multi-frame motion estimation," IEEE Transaction on Broadcast, vol.56, no.2, pp.133-141, 2010.   DOI   ScienceOn
11 L. Alparone, M. Barni and F. Bartolini, et al.. "Adaptively weighted vector-median filters for motion fields smoothing," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2267-2270, May, 1996.
12 G. Dane and T. Nguyen. "Motion vector processing for frame rate up conversion," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, pp.309-312, 17-21 May, 2004.
13 M. T. Orchard and C. J. Sullivan. "Overlapped block motion compensation: an estimation-theoretic approach," IEEE Transaction on Image Processing, vol. 3, no.9, pp. 693-699, 1994.   DOI   ScienceOn
14 Su K J and Mersereau R M. "Motion estimation methods for overlapped block motion compensation," IEEE Transaction on Image Processing, vol.9, no.1, pp. 1509-1521, 2000.   DOI   ScienceOn
15 Y. B. Zhang, D. B. Zhao and S. W. Ma, et al.. " A motion-aligned auto-regressive model for frame rate up-conversion," IEEE Transaction on Image Processing, vol.19, no.5, pp.1248-1258, 2010.   DOI   ScienceOn
16 B. D. Choi, J. W. Han and C. S. Kim, et al.. "Motion-compensated frame interpolation using bilateral motion estimation and aadaptive overlapped block motion compensation," IEEE Transaction on Circuits System and Video Technology, vol.17, no.7, pp. 407-416, ,2007.   DOI   ScienceOn
17 R. Li, Z. L. Gan, and Z. G. Cui, et al.. "Joint motion-compensated Interpolation using eight-neighbor block motion vectors." IEICE Transaction on Information and System, vol.E96-D, no.4, pp.976-979, 2013.   DOI
18 Y. Zhang, D. Zhao and X. Ji, et al.. "A motion-aligned auto-regressive model for frame rate up-conversion," IEEE Transaction on Circuits System and Video Technology, vol.19, no.9, pp.1289-1301, 2009.   DOI   ScienceOn
19 H . Liu, R. Xiong and B. Zhao, et al.. "Multiple hypotheses Bayesian frame rate up-conversion by adaptive fusion of motions-compensated interpolations," IEEE Transaction on Circuits System and Video Technology, vol.22, no.8, pp.1188-1198, 2012.   DOI   ScienceOn
20 J. Ascenso, C. Brites and F. Pereira. "Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding," in Proc. of 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Services, pp.1-6, July, 2005.
21 A. N. Tikhoneov and V. Y. Arsenin, "Solutions of Ill-Posed Problems," V. H. Winston & Sons, Washington, D. C.. 1977.
22 J. Zhai, K. Yu and S Li. "A low complexity motion compensated frame inperpolation method," in Proc. of IEEE International Symposium on Ciruits and Systems, pp.4927-4930, 23-26 May, 2005.