Browse > Article
http://dx.doi.org/10.3837/tiis.2014.08.018

Scale Invariant Auto-context for Object Segmentation and Labeling  

Ji, Hongwei (Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, and Key Laboratory of System Control and Information Processing, Ministry of Education of China)
He, Jiangping (Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, and Key Laboratory of System Control and Information Processing, Ministry of Education of China)
Yang, Xin (Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, and Key Laboratory of System Control and Information Processing, Ministry of Education of China)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.8, no.8, 2014 , pp. 2881-2894 More about this Journal
Abstract
In complicated environment, context information plays an important role in image segmentation/labeling. The recently proposed auto-context algorithm is one of the effective context-based methods. However, the standard auto-context approach samples the context locations utilizing a fixed radius sequence, which is sensitive to large scale-change of objects. In this paper, we present a scale invariant auto-context (SIAC) algorithm which is an improved version of the auto-context algorithm. In order to achieve scale-invariance, we try to approximate the optimal scale for the image in an iterative way and adopt the corresponding optimal radius sequence for context location sampling, both in training and testing. In each iteration of the proposed SIAC algorithm, we use the current classification map to estimate the image scale, and the corresponding radius sequence is then used for choosing context locations. The algorithm iteratively updates the classification maps, as well as the image scales, until convergence. We demonstrate the SIAC algorithm on several image segmentation/labeling tasks. The results demonstrate improvement over the standard auto-context algorithm when large scale-change of objects exists.
Keywords
Image segmentation; image labeling; context information; auto-context; scale invariance;
Citations & Related Records
연도 인용수 순위
  • Reference
1 F. Melgani and S. B. Serpico, "A markov random field approach to spatio-temporal contextual image classification," IEEE Transactions on Geoscience and Remote Sensing, 41(11):2478-2487, Nov. 2003.   DOI   ScienceOn
2 S. Kumar and M. Hebert, "Discriminative random fields: a discriminative framework for contextual interaction in classification," in Proc. of ICCV, Oct. 2003.
3 J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: probabilistic models for segmenting and labeling sequence data," in Proc. of 10th Int'l Conf. on Machine Learning, pages 282-289, San Francisco, 2001.
4 J. Shotton, M. Johnson, and R. Cipolla, "Semantic texton forests for image categorization and segmentation," in Proc. of CVPR, 2008.
5 J. Shotton, J. Winn, C. Rother, and A. Criminisi, "Textonboost: Joint appearance, shape and context modeling for mult-class object recognition and segmentation," in Proc. of ECCV, 2006.
6 E. Borenstein, E. Sharon, and S. Ullman, "Combining top-down and bottom-up segmentation," in Proc. of IEEE workshop on Perc. Org. in Com. Vis., June 2004.
7 Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. of Comp. and Sys. Sci., 55(1):119-139, 1997.   DOI   ScienceOn
8 X. Ren, C. Fowlkes, and J. Malik, "Cue integration in figure/ground labeling," in Proc. of NIPS, 2005.
9 R. Rifkin and A. Klautau, "In defence of one-vs-all classification," J. Mach. Learn. Res., 5:101-141, 2004.
10 S. Geman and D. Geman, "Gibbs distributions and the Bayesian restoration of images," IEEE Trans. PAMI, 6:721-741, Nov. 1984.
11 Z. Tu and X. Bai, "Auto-context and its application to high-level vision tasks and 3D brain image segmentation," IEEE Trans. PAMI, 32:1744-1757, 2010.   DOI   ScienceOn
12 F. Melgani and S. B. Serpico, "A statistical approach to the fusion of the spectral and spatio-temporal contextual information for the classification of remote sensing images," Pattern Recognition Letters, 23(9):1053-1061, July 2002.   DOI   ScienceOn
13 F. Melgani, "Classification of multitemporal remote-sensing images by a fuzzy fusion of spectral and spatio-temporal contextual information," International Journal of Pattern Recognition and Artificial Intelligence, 18(2):143-156, February 2004.   DOI   ScienceOn