Browse > Article
http://dx.doi.org/10.6109/jkiice.2018.22.3.425

Super-resolution Reconstruction Method for Plenoptic Images based on Reliability of Disparity  

Jeong, Min-Chang (Graduate School of Information and Communication Engineering, Chungbuk National University)
Kim, Song-Ran (Graduate School of Information and Communication Engineering, Chungbuk National University)
Kang, Hyun-Soo (Graduate School of Information and Communication Engineering, Chungbuk National University)
Abstract
In this paper, we propose a super-resolution reconstruction algorithm for plenoptic images based on the reliability of disparity. The subperture image generated by the Flanoptic camera image is used for disparity estimation and reconstruction of super-resolution image based on TV_L1 algorithm. In particular, the proposed image reconstruction method is effective in the boundary region where disparity may be relatively inaccurate. The determination of reliability of disparity vector is based on the upper, lower, left and right positional relationship of the sub-aperture image. In our method, the unreliable vectors are excluded in reconstruction. The performance of the proposed method was evaluated by comparing to a bicubic interpolation method, a conventional disparity based method and dictionary based method. The experimental results show that the proposed method provides the best performance in terms of PSNR(Peak Signal to noise ratio), SSIM(Structural Similarity).
Keywords
super-resolution; plenoptic images; light field camera; disparity;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 I. H. Choe, H. J. Lee, and B. C. Song. "Super Resolution Image Reconstruction Technique for Digital video devices," The Magazine of the IEIE, vol. 39, no. 10, pp. 36-44, Oct. 2012.
2 J. Sanchez, E. M-Llopis, and G. Facciolo, "TV-L1 optical flow estimation," IPOL(Image Processing On Line), vol. 3, pp. 137-150, July. 2013.   DOI
3 L. I. Rudin, S. Osher, and E. Fatemi. "Nonlinear total variation based noise removal algorithms," Physica D, vol. 60, pp. 259-268, Nov. 1992.   DOI
4 A. Chambolle, "An Algorithm for Total Variation Minimization and Applications," Journal of Mathematical Imaging and Vision, vol. 20, no. 1-2, pp. 89-97, Jan. 2004.   DOI
5 Sven Wanner and Bastian Goldluecke, "Variational Light Field Analysis for Disparity Estimation and Super-Resolution," IEEE Transactions of Pattern Analysis and Machine Intelligence, vol. 36, no. 3, pp. 606-619, March. 2014.   DOI
6 D. Dansereau, O. Pizarro, and S. Williams. "Decoding, calibration and rectification for lenselet-based plenoptic cameras," in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1027-1034, June 2013.
7 S. R. Kim, M. C. Jeong, H. S. Kang, "Calibration Method of Plenoptic Camera using CCD Camera Model", in Proceedings of The Korea Institute of Information and Communication Engineering, Journal of the Korea Institute of Information and Communication Engineering, vol. 22, no. 2, pp. 261-269, Feb. 2018.
8 D. H. Kim, "SVD-based Image Enhancement Method using Weighted Average of Histogram Stretching and Equalization," in Proceeding of Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, vol.5, no.5, pp. 77-85, Oct. 2015
9 J. Yang, J. Wright, T. Huang, and Y. Ma, "Image superresolution via sparse representation," IEEE Trans. Image Processing, vol. 19, no. 11, pp. 2861-2873, Nov. 2010.   DOI
10 R. Zeyde, M. Elad, and M. Protter, "On single image scale-up using sparse-representations," Lecture Note in Computer Science, vol. 6920, pp. 711-730, 2012.
11 R. Timofte, V. De, and L. Van Gool, "Anchored neighborhood regression for fast example-based superresolution," in Proceeding of IEEE International Conference Computer Vision, pp. 1920-1927, Dec. 2013.
12 J. Jiang, X. Ma, C. Chen, L. Tao, Z. Wang, and J. Ma, "Single Image Super-Resolution via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means," IEEE Trans. on Multimedia, vol. 19, no. 1, pp. 15-26, Aug. 2016.   DOI