Browse > Article
http://dx.doi.org/10.3837/tiis.2016.09.021

Image Completion using Belief Propagation Based on Planar Priorities  

Xiao, Mang (College of Electronics and Information Engineering, Tongji University)
Li, Guangyao (College of Electronics and Information Engineering, Tongji University)
Jiang, Yinyu (College of Mechanical and Electrical Engineering, Yangtze Normal University)
Xie, Li (College of Electronics and Information Engineering, Tongji University)
He, Ye (College of Electronics and Information Engineering, Tongji University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.10, no.9, 2016 , pp. 4405-4418 More about this Journal
Abstract
Automatic image completion techniques have difficulty processing images in which the target region has multiple planes or is non-facade. Here, we propose a new image completion method that uses belief propagation based on planar priorities. We first calculate planar information, which includes planar projection parameters, plane segments, and repetitive regularity extractions within the plane. Next, we convert this planar information into planar guide knowledge using the prior probabilities of patch transforms and offsets. Using the energy of the discrete Markov Random Field (MRF), we then define an objective function for image completion that uses the planar guide knowledge. Finally, in order to effectively optimize the MRF, we propose a new optimization scheme, termed Planar Priority-belief propagation that includes message-scheduling-based planar priority and dynamic label cropping. The results of experiment show that our approach exhibits advanced performance compared with existing approaches.
Keywords
Image completion; image inpainting; belief propagation; markov random fields; guided synthesis;
Citations & Related Records
연도 인용수 순위
  • Reference
1 R. Hartley and A. Zisserman, “Multiple view geometry in computer vision,” Robotica, vol. 23 no. 2, pp. 271, 2005. Article (CrossRef Link) .
2 M. Bertalmio, G. Sapiro, V. Caselles and C. Ballester, “Image inpainting,” in Proc. of the 27th annual conference on Computer graphics and interactive techniques, pp. 417-424, July, 2000. Article (CrossRef Link).
3 T. F. Chan and J. Shen, “Nontexture inpainting by curvature-driven diffusions,” Journal of Visual Communication and Image Representation, vol. 12, no. 4, pp. 436-449, 2001. Article (CrossRef Link).   DOI
4 D. Tschumperlé, “Fast anisotropic smoothing of multi-valued images using curvature-preserving PDE's,” International Journal of Computer Vision, vol. 68, no. 1, pp. 65-82, 2006. Article (CrossRef Link).   DOI
5 J. Shen and T. Chan, “Mathematical models for local nontexture inpaintings,” SIAM Journal on Applied Mathematics, vol. 62, no. 3, pp. 1019-1043, 2002. Article (CrossRef Link) .   DOI
6 A. Efros and T. K. Leung, “Texture synthesis by non-parametric sampling,” in Proc. of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1033-1038, 1999. Article (CrossRef Link) .
7 D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” International journal of computer vision, vol. 60, no. 2, pp. 91-110, 2004. Article (CrossRef Link) .   DOI
8 P. F. Felzenszwalb and D. P. Huttenlocher, “Efficient belief propagation for early vision,” International journal of computer vision, vol. 70, no. 1, pp. 41-54, 2006. Article (CrossRef Link) .   DOI
9 M. Xiao, G. Y. Li, L. Xie, Y. L. Tan and Y. H. Mao, “Contour-guided image completion using a sample image,” Journal of Electronic Imaging, vol. 24, no. 2, pp. 023029-023029, 2015. Article (CrossRef Link) .   DOI
10 A. Criminisi, P. Pérez and K. Toyama, “Region filling and object removal by exemplar-based image inpainting,” Image Processing, IEEE Transactions on, vol. 13 no. 9, pp. 1200-1212, 2004. Article (CrossRef Link) .   DOI
11 S. Darabi, E. Shechtman, C. Barnes, D. B. Goldman and P. Sen, “Image melding: combining inconsistent images using patch-based synthesis,” ACM Transactions on Graphics-TOG, vol. 31, no. 4, pp. 82, 2012. Article (CrossRef Link) .
12 M. Xiao, G. Li, L. Xie, L. Peng, Y. J. Lv and Y. H. Mao, “Completion of Images of Historical Artifacts Based on Salient Shapes,” Optik - International Journal for Light and Electron Optics, vol. 127, no. 1, pp. 396-400, 2016. Article (CrossRef Link) .   DOI
13 N. Komodakis and G. Tziritas, “Image completion using efficient belief propagation via priority scheduling and dynamic pruning,” Image Processing, IEEE Transactions on, vol. 16, no. 11, pp. 2649-2661, 2007. Article (CrossRef Link) .   DOI
14 C. Barnes, E. Shechtman, A. Finkelstein and D. Goldman, “PatchMatch: A randomized correspondence algorithm for structural image editing,” ACM Transactions on Graphics-TOG, vol. 28, no. 3, pp. 24, 2009. Article (CrossRef Link) .
15 A. Mansfield, M. Prasad, C. Rother, T. Sharp, P. Kohli and L. J. Van Gool, “Transforming Image Completion,” in Proc. of the BMVC, pp. 1-11, August, 2011. Article (CrossRef Link) .
16 J. Huang, J. Kopf, N. Ahuja and S. B. Kang, “Transformation guided image completion,” IEEE International Conference on Computational Photography, pp. 1-9, April, 2013. Article (CrossRef Link) .
17 K. He and J. Sun, “Statistics of patch offsets for image completion,” Computer Vision–ECCV, pp. 16-29, 2012. Article (CrossRef Link).
18 W. T. Freeman, E. C. Pasztor and O. T. Carmichael, “Learning low-level vision,” International journal of computer vision, vol. 40 no. 1, pp. 25-47, 2000. Article (CrossRef Link) .   DOI