Journal of the Institute of Electronics and Information Engineers (전자공학회논문지)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

Accuracy Improvement of Frame Interpolation Algorithm using Wedge-shaped Block Partitioning

비정방형 블록을 이용한 보간 프레임의 정확도 향상 기법

  • Jeong, Jae Heon (Department of Electrical and Computer Engineering, Ajou University) ;
  • Jung, Ho Sun (Department of Electrical and Computer Engineering, Ajou University) ;
  • Sunwoo, Myung Hoon (Department of Electrical and Computer Engineering, Ajou University)
  • Received : 2015.01.14
  • Accepted : 2015.04.22
  • Published : 2015.05.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a novel frame rate up-conversion (FRUC) algorithm. Existing algorithms, in general, employ rectangular blocks for motion estimation and arbitrary shape of an actual object region cannot be precisely represented. On the other hand, the proposed wedge-shaped block partitioning algorithm partitions a rectangular block into two wedge-shaped blocks using the texture information, which makes better approximation for an actual object region. The wedge-shaped block partitioning algorithm as well as the adaptive motion vector prediction algorithm is used to reliably estimate the actual motion. Experimental results show that the proposed FRUC algorithm is superior to existing algorithms up to 1.988dB in PSNR and 0.0167 in SSIM comparisons.

기존의 프레임율 증가 변환 알고리즘의 경우 움직임 추정을 위해 정방형의 블록을 사용하며, 임의의 형태를 갖는 물체의 경계를 정확하게 구분할 수 없어 정확한 움직임 벡터를 찾는데 한계가 있었다. 이에 반해 제안하는 비정방형 블록 분할 알고리즘은 텍스처 정보를 이용하여 블록을 두 개의 비정방형 블록으로 분할하여 실제 물체의 경계를 찾는데 적합하다. 또한 주변 블록의 분할 방법에 따라 선택적으로 움직임 벡터를 참조하는 알고리즘을 제안함으로써, 아웃라이어(Outlier)를 방지하고 실제 움직임 벡터를 찾는데 탁월한 성능을 보인다. 실험 결과 제안하는 알고리즘은 기존대비 평균 20-40%의 연산량으로 최대 2.03dB 높은 PSNR 성능을 보이는 것을 확인하였으며, SSIM 비교에서는 최대 0.0214의 향상을 확인하였다.

Keywords

References

  1. K. Hilman, H.-W. Park, and Y.-M. Kim, "Using motion compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences," IEEE Trans. on CSVT, Vol. 10, No. 6, pp. 869-877, Sep. 2000.
  2. Q. Huynh-thu and M. Ghanbari, "Temporal aspect of perceived quality in mobile video broadcasting," IEEE Trans. Broadcasting, vol. 54, no. 3, pp. 641-651, Sep. 2008. 6 https://doi.org/10.1109/TBC.2008.2001246
  3. S.-C. Han and J. W. Woods, "Frame-rate up-conversion using transmitted motion and segmentation fields for very low bit-rate video coding," in Proc. IEEE Int. Conf. Image Process. (ICIP), 1997, pp. 747-750.
  4. J. Someya, N. Okuda and H. Sugiura, "The Suppression of Noise on a Dithering Image in LCD Overdrive," IEEE Trans. Consumer Electronics, vol. 52, no. 4, pp. 1325-1332, Nov. 2006. https://doi.org/10.1109/TCE.2006.273152
  5. Y.-H. Ko, J.-H. Kim, S.-W. Lee, and H.-S. Kang, "Dual Block Truncation Coding for Overdriving of Full HD LCD Driver," IEEE Trans. Consumer Electronics, vol. 58, no. 1, pp.1-7, Feb. 2012 https://doi.org/10.1109/TCE.2012.6170048
  6. B.-D. Choi, J.-W. Han, C.-S. Kim and S.-J. Ko, "Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation," IEEE Trans. Circuits Syst. Viedo Technol., vol. 17, no. 4, pp. 407-416, Apr. 2007. https://doi.org/10.1109/TCSVT.2007.893835
  7. S.-J. Kang, S.-J. Yoo and Y.-H. Kim, "Dual motion estimation for frame rate up-conversion," IEEE Trans. Circuits Syst. Viedo Technol., vol. 20, no. 12, pp. 1909-1914, Dec. 2010. https://doi.org/10.1109/TCSVT.2010.2087832
  8. U.-S. Kim and M.-H. Sunwoo, "New frame rate up-conversion algorithms with low computational complexity," IEEE Trans. Circuits Syst. Viedo Technol., vol. 24, no. 3, pp. 384-393, Aug. 2014. https://doi.org/10.1109/TCSVT.2013.2278142
  9. S,-J. Kang, D.-G. Yoo, S.-K. Lee, and Y. H. Kim, "Design and Implementation of Median Filter based Adaptive Motion Vector Smoothing for Motion Compensated Frame Rate Up-Conversion," International Symposium on Consumer Electronics, May. 25-28, 2009.
  10. J. Ascenso, C. Brites, and F. Pereira, "Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding," in Proc. Eur. Signal Process. Conf., Smolenice, Slovak Republic, Jul. 2005.
  11. J. Guo and J. Kim, "Adaptive motion vector smoothing for improving side information in distributed video coding," J. Inf. Process. Syst., vol. 7, no. 1, Mar. 2011.
  12. G. Y. Lu and D. W. Wong, "An adaptive inverse-distance weighting spatial interpolation technique,". Comput. Geosci., vol. 34, no. 9, pp. 1044.1055, Sep. 2008.