Browse > Article
http://dx.doi.org/10.6109/jkiice.2019.23.9.1049

Image Segmentation by Cascaded Superpixel Merging with Privileged Information  

Park, Yongjin (Department of Computer Science and Engineering, POSTECH)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.23, no.9, 2019 , pp. 1049-1059 More about this Journal
Abstract
We propose a learning-based image segmentation algorithm. Starting from super-pixels, our method learns the probability of merging two regions based on the ground truth made by humans. The learned information is used in determining whether the two regions should be merged or not in a segmentation stage. Unlike exiting learning-based algorithms, we use both local and object information. The local information represents features computed from super-pixels and the object information represent high level information available only in the learning process. The object information is considered as privileged information, and we can use a framework that utilize the privileged information such as SVM+. In experiments on the Berkeley Segmentation Dataset and Benchmark (BSDS 500) and PASCAL Visual Object Classes Challenge (VOC 2012) data set, out model exhibited the best performance with a relatively small training data set and also showed competitive results with a sufficiently large training data set.
Keywords
Image segmentation; Privileged information; Super pixel; Region merging model;
Citations & Related Records
연도 인용수 순위
  • Reference
1 D. Weiss, and B. Taskar, "Scalpel: Segmentation cascades with localized priors and efficient learning," in Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pp. 2035-2042, IEEE, 2013.
2 Z. Ren, and G. Shakhnarovich, "Image segmentation by cascaded region agglomeration," in Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pp. 2011-2018, IEEE, 2013.
3 R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, "Slic superpixels compared to state-of-the-art superpixel methods," Pattern Analysis and Machine Intelligence, IEEE Transaction on, 34(11):2274-2282, 2012.   DOI
4 V. Vapnik, and A. Vashist, "A new learning paradigm: Learning using privileged information," Neural Networks, 22(5):544-557, 2009.   DOI
5 D. Martin, C. Fowlkes, D. Tal, and J. Malik, "The Berkeley Segmentation Dataset and Benchmark," Available: https://www2.eecs.berkeley.edu/Research/Projects/CS/vision/bsds/.
6 M. Everingham, L. V. Gool, C. Williams, J. Winn, and A. Zisserman, "The PASCAL VOC Project," Available: http://host.robots.ox.ac.uk/pascal/VOC/.
7 N. Senthilkumaran, and S. Vaithegi, "Image segmentation by using thresholding techniques for medical images," Computer Science & Engineering: An International Journal 6.1 (2016): 1-13.
8 N.Dhanachandra, K. Manglem, and Y. J. Chanu, "Image segmentation using K-means clustering algorithm and subtractive clustering algorithm," Procedia Computer Science 54 (2015): 764-771.   DOI
9 K. Ramgopal, and P. Gautam, "Fast medical image segmentation using energy-based method," Pattern and Data Analysis in Healthcare Settings. IGI Global, 2017. 35-60.
10 A. Pratondo, C. K. Chui, and S. H. Ong, "Robust edge-stop functions for edge-based active contour models in medical image segmentation," IEEE Signal Processing Letters 23.2 (2015): 222-226.   DOI
11 Z. Liu, X. Li, P. Luo, C. C. Loy, and X. Tang, "Semantic image segmentation via deep parsing network," In Proceedings of the IEEE international conference on computer vision, pp. 1377-1385, 2015.
12 W. Liu, A. Rabinovich, and A. C. Berg, "Parsenet: Looking wider to see better," arXiv preprint arXiv:1506.04579, 2015.
13 H. Noh, S. Hong, and B. Han, "Learning deconvolution network for semantic segmentation," In Proceedings of the IEEE international conference on computer vision, pages 1520-1528, 2015.
14 K. He, G. Gkioxari, P. Dollar, and R. Girshick, "Mask rcnn," In Proceedings of the IEEE international conference on computer vision, pp. 2961-2969, 2017.
15 H. Zhang, K. Dana, J. Shi, Z. Zhang, X. Wang, A. Tyagi, and A. Agrawal, "Context encoding for semantic segmentation," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7151-7160, 2018.
16 P. F. Felzenszwalb, and D. P. Huttenlocher, "Ecient graph-based image segmentation," International Journal of Computer Vision, 59(2):167-181, 2004.   DOI
17 C. H. Wu, C. C. Lai, H. J. Lo, and P. S. Wang, "A Comparative Study on Encoding Methods of Local Binary Patterns for Image Segmentation," International Conference on Smart Vehicular Technology, Transportation, Communication and Applications. Springer, Cham, 2018.
18 P. Arbelaez, M. Maire, C Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation," Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(5):898-916, 2011.   DOI
19 X. Ren, and J. Malik, "Learning a classication model for segmentation," In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, pp. 10-17. IEEE, 2003.
20 L. Gao, J. Song, F. Nie, F. Zou, N. Sebe, and H. T. Shen, "Graph-without-cut: An ideal graph learning for image segmentation," Thirtieth AAAI Conference on Artificial Intelligence. 2016.
21 D. Ming, J. Li, J. Wang, and M. Zhang, "Scale parameter selection by spatial statistics for GeOBIA: Using mean-shift based multi-scale segmentation as an example," ISPRS Journal of Photogrammetry and Remote Sensing 106 (2015): 28-41.   DOI
22 M. V. Bergh, X. Boix, G. Roig, B. de Capitani, and L. Van Gool, "Seeds: Superpixels extracted via energy-driven sampling," Computer Vision-ECCV 2012, pp. 13-26, Spr. 2012.'