DOI QR코드

DOI QR Code

An Adaptive Occluded Region Detection and Interpolation for Robust Frame Rate Up-Conversion

  • Kim, Jin-Soo (School of Information Communication and Computer Engineering, Hanbat National University) ;
  • Kim, Jae-Gon (School of Elec. Telecom and Computer Engineering, Korea Aerospace Univ.)
  • Received : 2011.03.07
  • Accepted : 2011.04.12
  • Published : 2011.04.30

Abstract

FRUC (Frame Rate Up-Conversion) technique needs an effective frame interpolation algorithm using motion information between adjacent neighboring frames. In order to have good visual qualities in the interpolated frames, it is necessary to develop an effective detection and interpolation algorithms for occluded regions. For this aim, this paper proposes an effective occluded region detection algorithm through the adaptive forward and backward motion searches and also by introducing the minimum value of normalized cross-correlation coefficient (NCCC). That is, the proposed scheme looks for the location with the minimum sum of absolute differences (SAD) and this value is compared to that of the location with the maximum value of NCCC based on the statistics of those relations. And, these results are compared with the size of motion vector and then the proposed algorithm decides whether the given block is the occluded region or not. Furthermore, once the occluded regions are classified, then this paper proposes an adaptive interpolation algorithm for occluded regions, which still exist in the merged frame, by using the neighboring pixel information and the available data in the occluded block. Computer simulations show that the proposed algorithm can effectively classify the occluded region, compared to the conventional SAD-based method and the performance of the proposed interpolation algorithm has better PSNR than the conventional algorithms.

Keywords

References

  1. R. Castagno, P. Haavisto, and G. Ramponi, "A method for motion adaptive frame rate upconversion," IEEE Trans. Circuits Systems for Video Technology, vol. 6, no. 5, pp. 436-446, Oct. 1996. https://doi.org/10.1109/76.538926
  2. R. Feghali, F. Speranza, D. Wang, and A. Vincent, "Video Quality Metric for Bit Rate Control via Joint Adjustment of Quantization and Frame Rate," IEEE Trans. Broadcasting, Vol.33, No. 1, pp.441-446, Mar. 2007
  3. B.D.Choi, J.W.Han, C.S.Kim, and S.J.Ko, "Motion-Compensated Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation," IEEE Trans. CSVT, Vol. 17, No.4, pp.407-416, Apr. 2007.
  4. T.Thaipanich, P.-H.Wu, and C.-C. J. Kuo, "Low Complexity Algorithm for Robust Video Frame Rate Up-Conversion(FRUC) Technique," IEEE Trans. Consumer Electronics, Vol. 55, No. 1, pp. 220-228, Feb. 2009 https://doi.org/10.1109/TCE.2009.4814438
  5. E. Peixoto, R. L. Queiroz and D. Mukherjee, "On Side Information Generation for Wyner-Ziv Video Coding," Proc. of Simposio Brasileiro de Tel., Rio de Janeiro, Brazil, Sept. 2008.
  6. J. Ascenso, C. Brites, and F. Pererira, "Improving Frame Interpolation with Spatial Motion Smoothing for Pixel Domain Distributed Video Coding," in Proc. EURASIP Conf. Speech and Image Processing, July 2005. Pp. 311-316
  7. Sang-Uk Park, Jin-Woo Choi, Chang-Su Kim, Sang-Uk Lee and Jung-Won Kang, "Efficient Distributed Video Coding Using Symmetric Motion Estimation and Channel Division," PACRIM09, Aug. 2009.

Cited by

  1. Distributed Video Coding with Reliability Estimation Based on Spatio-temporal Statistical Characteristics of Side Information vol.17, pp.7, 2013, https://doi.org/10.6109/jkiice.2013.17.7.1694
  2. 움직임 보상 보간 프레임에 대한 블록 적응적 정합 특성을 이용한 왜곡 예측 기법 vol.16, pp.6, 2011, https://doi.org/10.5909/jeb.2011.16.6.1058