Browse > Article
http://dx.doi.org/10.6109/jkiice.2018.22.4.617

Poisson Video Composition Using Shape Matching  

Heo, Gyeongyong (Department of Electronic Engineering, Dong-Eui University)
Choi, Hun (Department of Electronic Engineering, Dong-Eui University)
Kim, Jihong (Department of Electronic Engineering, Dong-Eui University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.22, no.4, 2018 , pp. 617-623 More about this Journal
Abstract
In this paper, we propose a novel seamless video composition method based on shape matching and Poisson equation. Video composition method consists of video segmentation process and video blending process. In the video segmentation process, the user first sets a trimap for the first frame, and then performs a grab-cut algorithm. Next, considering that the performance of video segmentation may be reduced if the color, brightness and texture of the object and the background are similar, the object region segmented in the current frame is corrected through shape matching between the objects of the current frame and the previous frame. In the video blending process, the object of source video and the background of target video are blended seamlessly using Poisson equation, and the object is located according to the movement path set by the user. Simulation results show that the proposed method has better performance not only in the naturalness of the composite video but also in computational time.
Keywords
image segmentation; Poisson blending; shape matching; video composition;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. Wang, P. Bhat, R. A. Colburn, M. Agrawala, and M. F. Cohen, "Interactive Video Cutout," ACM SIGGRAPH 2005, pp. 585-594, July 2005.
2 P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient Graph-Based Image Segmentation," International Journal of Computer Vision, vol. 59, no. 2, pp. 167-181, January 2004.   DOI
3 C. J. Armstrong, B. L. Price, and W. A. Barrett, "Interactive Segmentation of Image Volumes with Live Surface," Computer Graphics, vol. 31, no. 2, pp. 212-229, February 2007.   DOI
4 X. Bai, J. Wang, D. Simons, and G. Sapiro, "Video Snapcut: Robust Video Object Cutout Using Localized Classifiers," ACM Transactions on Graphics, vol. 28, no. 3, pp. 1-11, July 2009.
5 M. Grundmann and V. Kwatra, "Efficient Hierarchical Graph-Based Video Segmentation," [Internet]. Available: https://www.cc.gatech.edu/cpl/projects/videosegmentation/.
6 T. Chen, J. Y. Zhu, A. Shamir, and S.M. Hu, "Motion-Aware Gradient Domain Video Composition," IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2532-2544, July 2013.   DOI
7 K. F. Hussain and R. M. Kamel, "Efficient Poisson Image Editing," Electronic Letters on Computer Vision and Image Analysis, vol. 14, no. 2, pp. 45-57, December 2015.
8 Richard J. Radke, Computer Vision for Visual Effects, Cambridge University Press, New York, 2013.
9 M. Afifi, K. F. Hussain, H. M. Ibrahim, and N. M. Omar, "Video Face Replacement System Using a Modified Poisson Blending Technique," International Symposium on Intelligent Signal Processing and Communication Systems, pp.1-5, December 2014.
10 I. S. Sevcenco and P. Agathoklis, "Video Editing in Gradient Domain Using a Wavelet based 3-D Reconstruction Algorithm and an Iterative Poisson Solver," IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, pp. 205-209, August 2015.
11 M. C. Jeong, S. R. Kim, and H. S. Kang, "Super-resolution Reconstruction Method for Plenoptic Images based on Reliability of Disparity," Journal of the Korea Institute of Information and Communication Engineering, vol. 22, no. 3, pp.425-433, March 2018.   DOI
12 N. Arora, M. Martolia, and A. Ashok, "A Comparative Study of the Image Registration Process on the Multimodal Medical Images," Asia-pacific Journal of Convergent Research Interchange, vol. 3, no. 1, pp.1-17, March 2017.