Browse > Article
http://dx.doi.org/10.5573/ieie.2015.52.3.154

UHD TV Image Enhancement using Multi-frame Example-based Super-resolution  

Jeong, Seokhwa (Dept. of Image Engineering, Graduate School of Advanced Image Science, Multimedia, and Film, Chung-Ang University)
Yoon, Inhye (Dept. of Image Engineering, Graduate School of Advanced Image Science, Multimedia, and Film, Chung-Ang University)
Paik, Joonki (Dept. of Image Engineering, Graduate School of Advanced Image Science, Multimedia, and Film, Chung-Ang University)
Publication Information
Journal of the Institute of Electronics and Information Engineers / v.52, no.3, 2015 , pp. 154-161 More about this Journal
Abstract
A novel multiframe super-resolution (SR) algorithm is presented to overcome the limitation of existing single-image SR algorithms using motion information from adjacent frames in a video. The proposed SR algorithm consists of three steps: i) definition of a local region using interframe motion vectors, ii) multiscale patch generation and adaptive selection of multiple optimum patches, and iii) combination of optimum patches for super-resolution. The proposed algorithm increases the accuracy of patch selection using motion information and multiscale patches. Experimental results show that the proposed algorithm performs better than existing patch-based SR algorithms in the sense of both subjective and objective measures including the peak signal-to-noise ratio (PSNR) and structural similarity measure (SSIM).
Keywords
super-resolution; patch-based image restoration; image enhancement; UHD TV;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Lehmann, C. Gonner, and K. Spitzer, "Survey: interpolation methods in medical image processing," IEEE Trans. Medical Imaging, vol1. 18, no. 11, pp. 1049-1075, November 1999.   DOI   ScienceOn
2 W. Freeman, T. Jones, and E. Pasztor, "Example-based super-resolution," IEEE Computer Graphics and Applications, vol. 22, no. 2, pp. 56-65, March/April 2002.   DOI
3 D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," Proc. IEEE Int. Conf. Computer Vision, pp. 349-356, September 2009.
4 G. Freedman and R. Fattal, "Image and video upscaling from local self-examples," ACM Trans. Graphics, vol. 30, no. 2, pp. 12.1-12.11, April 2011.
5 S. Farsiu, M. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super resolution," IEEE Trans. Image Processing, vol. 13, no. 10, pp. 1327-1344, October 2004.   DOI   ScienceOn
6 S. Farsiu, M. Elad, and P. Milanfar, "Multiframe demosaicing and super-resolution of color images," IEEE Trans. Image Processing, vol. 15, no. 1, pp. 141-159, January 2006.   DOI   ScienceOn
7 W. Bai, J. Liu, M. Li, and Z. Guo, "Multi-frame super-resolution using refined exploration of extensive self-examples," MMM, pp. 403-413, January January 2013.
8 C. Cho, J. Jeon, and J. Paik, "Example-based super-resolution using self-patches and approximated constrained least squares filter," Proc. IEEE Int. Conf. Image Processing, pp. 2140-2144, October 2014.
9 S. Jeong, I. Yoon, J. Jeon, and J. Paik, "Multi-frame example-based super-resolution using locally directional self-similarity," Proc. IEEE Int. Conf. Consumer Electronics, to appear, January 2015.
10 L. Xu, S. Zheng, and J. Jia, "Unnatural L0 sparse representation for natural image deblurring," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1107-1114, June 2013.
11 C. Shen, W. Hwang, and S. Pei, "Spatially-varying out-of-focus image deblurring with L1-2 optimization and a guided blur map," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, pp. 1069-1072, March 2012.
12 J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super resolution via sparse representation," IEEE Trans. Image Processing, vol. 19, no. 11, pp. 2861-2873, November 2010.   DOI   ScienceOn
13 S. H. Kim, S. B. Cho, "Super-Resolution Algorithm Using Motion Estimation for Moving Vehicles", Jounal of The Institute of Electronics Engineers of Korea, vol. 49SP, no.4, pp. 23-31, July 2012.