Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Adaptive Frame Rate Up-Conversion Algorithms using Block Complexity Information

  • Lee, Kangjun (Department of Automobile and IT Convergence, Kookmin University)
  • Received : 2018.07.09
  • Accepted : 2018.07.20
  • Published : 2018.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes new frame rate up-conversion algorithms. Adaptive motion estimation based on block complexity information are used to obtain more accurate motion vectors. Because the information on block complexity is extracted from the motion estimation prediction size from the original frame, additional computational complexity is not imparted. In experimental results, the proposed algorithms provide robust frame interpolation performance for whole test sequences. Also, the computational complexity of the proposed algorithm is reduced to a benchmark algorithm.

Keywords

References

  1. J. Someya, N. Okuda, and H. Sugiura, "The Suppression of Noise on a Dithering Image in LCD Overdrive," IEEE Transactions on Consumer Electronics, Vol. 52, No. 4, pp. 1325-1332, 2006. https://doi.org/10.1109/TCE.2006.273152
  2. P. Gunawan and M. Ghanbari, "Efficient Reduced-reference Video Quality Meter," IEEE Transactions on Broadcasting, Vol. 54, No. 3, pp. 669-679, 2008. https://doi.org/10.1109/TBC.2008.2000734
  3. R. Feghali, F. Speranza, D. Wang, and A. Vincent, "Video Quality Metric for Bit Rate Control Via Joint Adjustment of Quantization and Frame Rate," IEEE Transactions on Broadcasting, Vol. 33, No. 1, pp. 441-446, 2007.
  4. C.L. Huang and T.T. Chai, "Motion-comsated Interpolation for Scan Rate Up-conversion," Optical Engineering, Vol. 35, No. 1, pp. 166-176, 1996. https://doi.org/10.1117/1.600951
  5. P. Haavisto, J. Juhola, and Y. Neuvo, "A Method for Motion Adaptive Frame Rate Up-conversion," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, No. 5, pp. 436-446, 1996. https://doi.org/10.1109/76.538926
  6. T. Koga, K. Iinuma, Y. Iijima, and T. Ishiguro, "Motion-compensated Interframe Coding for Video Conferencing," Proceeding of National Telecommunication Conference, G5.3.1-5.3.5, 1981.
  7. G.D. Haan, P.W.A.C. Biezen, H. Huijgen, and O.A. Ojo, "True Motion Estimation with 3-D Recursive Search Block Matching," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 3, No. 5, pp. 368-379, 1993. https://doi.org/10.1109/76.246088
  8. D. wang, A. Vincent, P. Blanchfield, and R. Klepko, "Motion-compendated Frame Rate up Conversion? Part II: New Algorithms for Frame Interpolation," IEEE Transactions on Broadcasting, Vol. 56, No. 2, pp. 142-149, 2010. https://doi.org/10.1109/TBC.2010.2043895
  9. U.S. Kim and M.H. Sunwoo, "New Frame Rate Up-conversion Algorithms with Low Computational Complexity," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 24, No. 3, pp. 384-393, 2014. https://doi.org/10.1109/TCSVT.2013.2278142
  10. C. Wang, L. Zhang, Y. He, and Y.P. Tan, "Frame Rate Up-conversion Using Trilateral Filtering," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 20, No. 6, pp. 886-893, 2010. https://doi.org/10.1109/TCSVT.2010.2046057
  11. B.T. Choi, S.H. Lee, and S.J. Ko, "New Frame Rate Up-conversion Using Bi-directional Motion Estimation," IEEE Transactions on Consumer Electronics, Vol. 46, No. 3, pp. 603-609, 2000. https://doi.org/10.1109/30.883418
  12. J.H. Kim, Y.H. Ko, H.S. Kang, S.W. Lee, and J.W. Kwon, "Frame Rate Up-conversion Method Based on Texture Adaptive Bilateral Motion Estimation," IEEE Transactions on Consumer Electronics, Vol. 60, No. 3, pp. 445-452, 2014. https://doi.org/10.1109/TCE.2014.6937329
  13. B.D. Choi, J.W. Han, C.S. Kim, and S.J. Ko, "Motion-compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, No. 4, pp. 407-416, 2007. https://doi.org/10.1109/TCSVT.2007.893835
  14. S.J. Kang, K.R. Cho, and Y.H. Kim, "Motion Compensated Frame Rate Up-conversion Using Extended Bilateral Motion Estimation," IEEE Transactions on Consumer Electronics, Vol. 53, No. 4, pp. 1759-1767, 2007. https://doi.org/10.1109/TCE.2007.4429281
  15. T.H. Tsai and H.Y. Lin, "High Visual Quality Particle Based Frame Rate up Conversion with Acceleration Assisted Motion Trajectory Calibration," Journal of Display Technology, Vol. 8, No. 6, pp. 341-351, 2012. https://doi.org/10.1109/JDT.2012.2186555
  16. D.G. Yoo, S.J. Kang, and Y.H. Kim, "Direction-select Motion Estimation for Motioncompensated Frame Rate Up-conversion," Journal of Display Technology, Vol. 9, No. 10, pp. 840-850, 2013. https://doi.org/10.1109/JDT.2013.2263374
  17. S.C. Han and J.W. Woods, "Frame-rate Up-conversion Using Transmitted Motion and Segmentation Field for very Low Bit-rate Video Coding," Proceeding of International Conference on Image Processing, pp. 747-750, 1997.
  18. Y.H. Jung, J.H. Kim, and Y.H. Ko, "Frame Rate up Conversion Method Using Bilateral Motion Estimation Based on Texture Activity and Neighboring Motion Information," Journal of Korea Multimedia Society, Vol. 17, No. 7, pp. 797-805, 2014. https://doi.org/10.9717/kmms.2014.17.7.797
  19. T.Y. Kuo and C.C.J. Kuo, "Motion-compesated Interpolation for Low-bit-rate Video Quality Enhancement," Proceeding of Applications of Digital Image Processing, pp. 277-288, 1998.
  20. A. Kaup and T. Aach, "Efficient Prediction of Uncovered Background in Interframe Coding Spatial Extraprediction," Proceeding of International Conference on Acoustics, Speech and Signal Processing, pp. 501-504, 1994.
  21. R.J. Schutte and G.D. Haan, "Real-time 2-3 Pull-down Elimination Applying Motion Estimation/Compensation in a Programmable Device," IEEE Transactions on Consumer Electronics, Vol. 44, No. 3, pp. 501-504, 1998.
  22. B.W. Jeon, G.I. Lee, S.H. Lee, and R.H. Park, "Coarse-to-fine Frame Interpolation for Frame Rate Up-conversion Using Pyramid Structure," IEEE Transactions on Consumer Electronics, Vol. 46, No. 3, pp. 603-609, 2000. https://doi.org/10.1109/30.883418
  23. B.G. Kim, "Novel Inter-mode Decision Algorithm Based on Macroblock(MB) Tracking for the P-slice in H.264/AVC Video Coding," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 18, No. 2, pp. 273-279, 2008. https://doi.org/10.1109/TCSVT.2008.918121
  24. R. Han and A. Men, "Frame Rate Up-conversion for High-definition Video Applications," IEEE Transactions on Consumer Electronics, Vol. 59, No. 1, pp. 229-236, 2013. https://doi.org/10.1109/TCE.2013.6490264