Browse > Article

Video Object Extraction Using Contour Information  

Kim, Jae-Kwang (School of Electrical Engineering, Korea Advanced Institute of Science and Technology)
Lee, Jae-Ho (School of Electrical Engineering, Korea Advanced Institute of Science and Technology)
Kim, Chang-Ick (School of Electrical Engineering, Korea Advanced Institute of Science and Technology)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.48, no.1, 2011 , pp. 33-45 More about this Journal
Abstract
In this paper, we present a method for extracting video objects efficiently by using the modified graph cut algorithm based on contour information. First, we extract objects at the first frame by an automatic object extraction algorithm or the user interaction. To estimate the objects' contours at the current frame, motion information of objects' contour in the previous frame is analyzed. Block-based histogram back-projection is conducted along the estimated contour point. Each color model of objects and background can be generated from back-projection images. The probabilities of links between neighboring pixels are decided by the logarithmic based distance transform map obtained from the estimated contour image. Energy of the graph is defined by predefined color models and logarithmic distance transform map. Finally, the object is extracted by minimizing the energy. Experimental results of various test images show that our algorithm works more accurately than other methods.
Keywords
Video Object Segmentation; Graph Cut; Histogram Back projection; Distance Transform;
Citations & Related Records
연도 인용수 순위
  • Reference
1 G. Hayit, G. Jacob, and M. Arnoldo, "A Probabilistic Framework for Spatio-Temporal Video Representation & Indexing," 7th European Conference on Computer Vision-Part IV, vol. 2353, pp. 461-475, 2002.
2 L. Lijie and F. Guoliang, "Combined key-frame extraction and object-based video segmentation," IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, pp. 869-884, 2005.   DOI
3 G. Borgefors, "Distance transformations in digital images," Computer Vision, Graphics, and Image Processing, vol. 34, pp. 344-371, 1986.   DOI   ScienceOn
4 Z. Liu, J. Cu, L. Shen, Z. Zhang, "Efficient Video Object Segmentation Based on Gaussian Mixture Model and Markov Random Field," IEEE International Conference on Signal Processing, pp. 1006-1009, 2008.
5 F. Y. C. Shih and O. R. Mitchell, "A mathematical morphology approach to Euclidean distance transformation," IEEE Transactions on Image Processing, vol. 1, pp. 197-204, 1992.
6 Z. Garrett and H. Saito, "Live Video Object Tracking and Segmentation Using Graph Cuts," IEEE International Conference on Image Processing, pp. 1576-1579, 2008.
7 C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: Interactive Foreground Extraction using Iterated Graph Cuts," ACM Transactions on Graphics, vol. 23, no. 3, pp. 309-314, 2004.   DOI   ScienceOn
8 X. Hou and L. Zhang, "Saliency detection: A Spectral Residual Approach," IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8, 2007.
9 J.F. Talbot, X. Xu, "Implementing GrabCut," Brigham Young University, 2006.
10 J. Lee, W. Lee, D. Jeong, "Object Tracking Method Using Back-Projection of Multiple Color Histogram Models," IEEE International Symposium on Circuits and Systems, vol. 2, pp. 668-671, 2003.
11 C. Jung, B. Kim, and C. Kim, "Automatic Segmentation of Salient Objects Using Iterative Reversible Graph Cut," will be appeared to IEEE International Conference on Multimedia & Expo, 2010.
12 S. Sun, D.R. Haynor, and Y. Kim, "Semiautomatic Video Object Segmentation Using VSnakes," IEEE Transactions on Circuit and System for Video Technology, vol. 13, no. 1, pp. 75-82, 2003.   DOI   ScienceOn
13 S. Yonggang and W. C. Karl, "A Real-Time Algorithm for the Approximation of Level-Set-Based Curve Evolution," IEEE Transactions on Image Processing, vol. 17, pp. 645-656, 2008.   DOI
14 P. Harper and R. B. Reilly, "Color based video segmentation using level sets," IEEE International Conference on Image Processing, vol. 3, pp. 480-483, 2000.
15 Y. Y. Boykov and M. P. Jolly, "Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images," IEEE International Conference on Computer Vision, vol. 1, pp. 105-112, 2001.
16 A. Yilmax, X. Li, and M. Shah, "Contour-Based Object Tracking with Occlusion Handling in Video Acquired Using Mobile Cameras," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 11, pp. 1531-1536, 2004.   DOI   ScienceOn
17 O. Javed, Z. Rasheed, K. Shafique, Mubarak Shah, "Tracking Across Multiple Cameras With Disjoint Views," IEEE International Conference on Computer Vision, vol. 2, pp. 952-957, 2003.
18 D. Comaniciu, V. Ramesh, P. Meer, "Kernel-Based Object Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 5, pp. 564-577, 2003.   DOI   ScienceOn
19 J. Kang, I. Cohen, and G. Mediono, "Object reacquisition using geometric invariant appearance model," IEEE International Conference on Pattern Recongnition, pp. 759-762, 2004.
20 Y. Li, J. Sun, and H.Y. Shum, "Video Object Cut and Paste," ACM Transactions on Graphics, vol. 24, no. 3, pp. 595-600, 2005.   DOI   ScienceOn
21 B. Li, B. Yuan, and Y. Sun, "Moving Object Segmentation Using Dynamic 3D Graph Cuts and GMM," IEEE International Conference on Signal Processing, vol 2, pp. 16-20, 2006.