DOI QR코드

DOI QR Code

Detection of Multiple Salient Objects by Categorizing Regional Features

  • Oh, Kang-Han (School of Electronics and Computer Engineering Chonnam National University) ;
  • Kim, Soo-Hyung (School of Electronics and Computer Engineering Chonnam National University) ;
  • Kim, Young-Chul (School of Electronics and Computer Engineering Chonnam National University) ;
  • Lee, Yu-Ra (School of Electronics and Computer Engineering Chonnam National University)
  • Received : 2015.05.22
  • Accepted : 2015.10.31
  • Published : 2016.01.31

Abstract

Recently, various and effective contrast based salient object detection models to focus on a single target have been proposed. However, there is a lack of research on detection of multiple objects, and also it is a more challenging task than single target process. In the multiple target problem, we are confronted by new difficulties caused by distinct difference between properties of objects. The characteristic of existing models depending on the global maximum distribution of data point would become a drawback for detection of multiple objects. In this paper, by analyzing limitations of the existing methods, we have devised three main processes to detect multiple salient objects. In the first stage, regional features are extracted from over-segmented regions. In the second stage, the regional features are categorized into homogeneous cluster using the mean-shift algorithm with the kernel function having various sizes. In the final stage, we compute saliency scores of the categorized regions using only spatial features without the contrast features, and then all scores are integrated for the final salient regions. In the experimental results, the scheme achieved superior detection accuracy for the SED2 and MSRA-ASD benchmarks with both a higher precision and better recall than state-of-the-art approaches. Especially, given multiple objects having different properties, our model significantly outperforms all existing models.

Keywords

References

  1. A. Berengolts and M. Lindenbaum, “On the distribution of saliency,” IEEE Trans. Pattern Anal. Mach. Intell, vol. 28, no. 12, pp. 1973-1990, 2006. Article (CrossRef Link) https://doi.org/10.1109/TPAMI.2006.249
  2. C. Koch and S. Ullman, “Shifts in selective visual attention: towards the underlying neural circuitry,” Human Neuro, vol. 4, no. 4, pp.219-227, 1985. Article (CrossRef Link)
  3. L. Ye, S and Yuan Jun, "Salient object detection in video by optimal spatio-temporal path discovery," in Proc. of the ACM MM, pp.509-512, 2013. Article (CrossRef Link)
  4. P. Khuwuthyakorn, A. Robles-Kelly and J. Zhou, "Object of interest detection by Saliency Learning," in Proc. of the ECCV, pp. 636-649, 2010. Article (CrossRef Link)
  5. J. Bonaiuto and L. Itti, "Combining attention and recognition for rapid scene analysis," in Proc. of the CVPR, pp. 90-97, 2005. Article (CrossRef Link)
  6. Z. Li, S.Qin, and L. Itti, “Visual attention guided bit allocation in video compression,” Image. Video Comput. vol. 29, no. 1, pp.1-14, 2011. Article (CrossRef Link) https://doi.org/10.1016/j.imavis.2010.07.001
  7. R. Achanta and S. Susstrunk, "Saliency detection using maximum symmetric surround," in Proc. of the ICIP, pp.2653-2656, 2010. Article (CrossRef Link)
  8. G. Kootstra, B. de Boer and L. Schomaker, “Predicting eye fixations on complex visual stimuli using local symmetry,” Cognitive Computat, vol. 3, no. 1, pp.223-240, 2011. Article (CrossRef Link) https://doi.org/10.1007/s12559-010-9089-5
  9. P.L. Rosin, “A simple method for detecting salient regions,” Pattern Recognit, vol. 42, no. 11, pp.2363-2371, 2009. Article (CrossRef Link) https://doi.org/10.1016/j.patcog.2009.04.021
  10. N. Bruce and J.K. Tsotsos, "Saliency based on information maximization," in Proc. of the NIPS, pp.155-162, 2005. Article (CrossRef Link)
  11. R. Achanta, S. Hemami, F. Estrada and S.Susstrunk, "Frequency-tuned salient region detection," in Proc. of the CVPR, pp.1597-1604, 2009. Article (CrossRef Link)
  12. S. Alpert, M. Galun, R. Basri, and A. Brandt, “Image segmentation by probabilistic bottom-up aggregation and cue integration,” IEEE Trans. Pattern Anal. Mach. Intell, vol. 34, no. 2, pp.315-326, 2007. Article (CrossRef Link) https://doi.org/10.1109/TPAMI.2011.130
  13. L. Itti, C. Koch and E. Niebur, “A model of saliency-based visual attention for rapid scene analysis,” IEEE Trans. Pattern Anal. Mach. Intell, vol. 20, no. 11, pp.1254-1259, 1998. Article (CrossRef Link) https://doi.org/10.1109/34.730558
  14. E. Rahtu, J. Kannala and M. Salo, "Segmenting salient objects from images and videos," in Proc. of the ECCV, pp.366-379, 2010. Article (CrossRef Link)
  15. D. Klein and S. Frintrop, "Center-surround divergence of features tatistics for salient object detection," in Proc. of the ICCV, pp.2214-2219, 2011. Article (CrossRef Link)
  16. O. Kang-Han , K. Soo-Hyung, N. In-Seop, "Saliency detection using Centroid Weight Map," in Proc. of the ACM ICUIMC, Aticle No. 107, 2014. Article (CrossRef Link)
  17. D. Comaniciu and P. Meer, “Mean shift: a robust approach toward feature space analysis,” IEEE Trans. Pattern Anal. Mach. Intell, vol.24, no. 5, pp.603-619, 2002. Article (CrossRef Link) https://doi.org/10.1109/34.1000236
  18. Y.-F. Ma and H.-J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. of the ACM MM, pp.374-381, 2003. Article (CrossRef Link)
  19. T. Liu, J. Sun, N.-N. Zheng and X. Tang, “Shum Learning to detect a salient object,” IEEE Trans. Pattern Anal. Mach. Intell, vol. 33, no. 2, pp.1-8, 2007. Article (CrossRef Link) https://doi.org/10.1109/TPAMI.2007.250595
  20. M.M. Cheng, G.X. Zhang, N.J. Mitra and X. Huang, S.M.Hu, “Global contrast based salient region detection,” IEEE Trans. Pattern Anal. Mach. Intell , vol. 37, no. 3, pp.569-582, 2015. Article (CrossRef Link) https://doi.org/10.1109/TPAMI.2014.2345401
  21. J. Huaizu Jiang, W. Jingdong, Y. Zejian, W. Yang, Z. Nanning and L, Shipeng, "Salient Object Detection: A Discriminative Regional Feature Integration Approach," in Proc of the CVPR, pp 2083-2090, 2013. Article (CrossRef Link)
  22. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc of the NIPS, pp. 545-552, 2006. Article (CrossRef Link)
  23. S. Alpert, M. Galun, R. Basri, and A. Brandt, “Image segmentation by probabilistic bottom-up aggregation and cue integration,” IEEE Trans. Pattern Anal. Mach. Intell, vol. 34, no. 2, pp.315-326, 2007. Article (CrossRef Link) https://doi.org/10.1109/TPAMI.2011.130
  24. L. Ming-Yu, YL. Ming, T. Oncel, C. Rama, "Entropy Rate Superpixel Segmentation," in Proc. of the CVPR, pp. 2097-2104, 2011. Article (CrossRef Link)

Cited by

  1. Visual saliency detection using iterative outlier cluster elimination vol.30, pp.3, 2016, https://doi.org/10.1007/s11045-018-0610-4