Browse > Article
http://dx.doi.org/10.9708/jksci.2017.22.03.045

Consecutive-Frame Super-Resolution considering Moving Object Region  

Cho, Sung Min (Dept. of Computer Science and Engineering, Hanyang University)
Jeong, Woo Jin (Dept. of Computer Science and Engineering, Hanyang University)
Jang, Kyung Hyun (Image PGM Team, Hanwha Systems)
Choi, Byung In (Image PGM Team, Hanwha Systems)
Moon, Young Shik (Dept. of Computer Science and Engineering, Hanyang University)
Publication Information
Journal of the Korea Society of Computer and Information / v.22, no.3, 2017 , pp. 45-51 More about this Journal
Abstract
In this paper, we propose a consecutive-frame super-resolution method to tackle a moving object problem. The super-resolution is a method restoring a high resolution image from a low resolution image. The super-resolution is classified into two types, briefly, single-frame super-resolution and consecutive-frame super-resolution. Typically, the consecutive-frame super-resolution recovers a better than the single-frame super-resolution, because it use more information from consecutive frames. However, the consecutive-frame super-resolution failed to recover the moving object. Therefore, we proposed an improved method via moving object detection. Experimental results showed that the proposed method restored both the moving object and the background properly.
Keywords
Super-resolution; Consecutive-frame; Multi-frame; Moving Object Detection;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and Robust Super-Resolution," IEEE Transactions on Image Processing, Vol. 13, No. 10, pp. 1327-1344, Oct. 2004   DOI
2 L. Zhang and X. Wu, "An Edge-Guided Image Interpolation Algorithm via Directional Filtering and Data Fusion," IEEE Transactions on Image Processing, Vol. 15, No. 8, pp. 2226-2238, Aug. 2006   DOI
3 A. Giachetti and N. Asuni, "Real-Time Artifact-Free Image Upscaling," IEEE Transactions on Image Processing, Vol. 20, No. 10, pp. 2760-2768, Oct. 2011   DOI
4 D. Zhou, X. Shen, and W. Dong, "Image zooming using directional cubic convolution interpolation," IET Image Processing, Vol. 6, No. 6, pp. 627-634, Feb. 2012   DOI
5 G. Anbarjafari and H. Demirel, "Image Super Resolution Based on Interpolation of Wavelet Domain High Frequency Subbands and the Spatial Domain Input Image," ETRI journal, Vol. 32, No. 3, pp. 390-394, June 2010   DOI
6 J. M. Lee and Y. S. Shik, "Super-resolution Image Reconstruction by High-frequency Components Estimation Based on Self-reference," Ph. D. Thesis, Hanyang University, Republic of Korea, 2015
7 H. Shen, L. Zhang, B. Huang, and P. Li, "A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution," IEEE Transactions on Image Processing, Vol. 16, No. 2, pp. 479-490, Feb. 2007   DOI
8 W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-Based Super-Resolution," IEEE Computer Graphics and Applications, Vol. 22, No. 2, pp. 56-65, Mar. 2002   DOI
9 H. Shin, D. Chung, B. Ku, and H. Ko, "Local Block Learning based Super resolution for license plate," KCSI journal, Vol. 16, No. 6, pp. 71-77, June 2011
10 C. Dong, C. C. Loy, K. He, and X. Tang, "Learning a Deep Convolutional Network for Image Super-Resolution," European Conference on Computer Vision, pp. 184-199, Sep. 2014
11 D. Mitzel, T. Pock, T. Schoenemann, and D. Cremers, "Video Super Resolution using Duality Based $TV-L^1$ Optical Flow," Joint Pattern Recognition Symposium, pp. 432-441, Sep. 2009
12 X. Li, Y. Hu, X. Gao, D. Tao, and B. Ning, "A multi-frame image super-resolution method," Signal Processing, Vol. 90, No. 2, pp. 405-414, Feb. 2010   DOI
13 M. M. Islam, N. K. Asari, M. N. Islam, and M. A. Karim, "Super-Resolution Enhancement Technique for Low Resolution Video," IEEE Transactions on Consumer Electronics, Vol. 56, No. 2, pp.919-924, May 2010   DOI
14 T. Song, Y. Lee, M. Kim, B. Ku, and H. Ko, "Fusion Methods of License Plate Detection and Super Resolution for Improving License Plate Recognition," KCSI journal, Vol. 16, No. 4, pp. 53-60, April 2011
15 B. D. Lucas and T. Kanade, "An iterative image registration technique with and application to stereo vision," International Joint Conference on Artificial Intelligence, Vol. 81, No. 1, pp. 674-694, Aug. 1981
16 C. Liu and D. Sun, "A Bayesian Approach to Adaptive Video Super Resolution," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 209-216, 2011
17 Z. Ma, R. Liao, X. Tao, L. Xu, J. Jia, and E. Wu, "Handling motion blur in multi-frame super-resolution," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5224-5232, June 2015
18 W. Shi, J. Caballero, F. Huszár, J. Totz, A. P. Aitken, R. Bishop, D. Rueckert, and Z. Wang, "Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1874-1883, June 2016