KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Co-saliency Detection Based on Superpixel Matching and Cellular Automata

  • Zhang, Zhaofeng (College of Communication Engineering, PLA University of Science and Technology) ;
  • Wu, Zemin (College of Communication Engineering, PLA University of Science and Technology) ;
  • Jiang, Qingzhu (College of Communication Engineering, PLA University of Science and Technology) ;
  • Du, Lin (College of Communication Engineering, PLA University of Science and Technology) ;
  • Hu, Lei (College of Communication Engineering, PLA University of Science and Technology)
  • Received : 2016.09.03
  • Accepted : 2017.02.25
  • Published : 2017.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Co-saliency detection is a task of detecting same or similar objects in multi-scene, and has been an important preprocessing step for multi-scene image processing. However existing methods lack efficiency to match similar areas from different images. In addition, they are confined to single image detection without a unified framework to calculate co-saliency. In this paper, we propose a novel model called Superpixel Matching-Cellular Automata (SMCA). We use Hausdorff distance adjacent superpixel sets instead of single superpixel since the feature matching accuracy of single superpixel is poor. We further introduce Cellular Automata to exploit the intrinsic relevance of similar regions through interactions with neighbors in multi-scene. Extensive evaluations show that the SMCA model achieves leading performance compared to state-of-the-art methods on both efficiency and accuracy.

Keywords

References

  1. D. Zhang, J. Han, C. Li and J. Wang, "Co-saliency detection via looking deep and wide," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2994-3002, June 7-12, 2015.
  2. D. Zhang, D. Meng, C. Li, L. Jiang, Q. Zhao and J. Han, "A Self-Paced Multiple-Instance Learning Framework for Co-Saliency Detection," in Proc. of IEEE International Conf. on Computer Vision (ICCV), pp. 594-602, Dec. 13-16, 2015.
  3. H. Li and K. N. Ngan, "A Co-Saliency Model of Image Pairs," IEEE Transactions on Image Processing, vol 20, no.12, pp.3365-3375, 2011. https://doi.org/10.1109/TIP.2011.2156803
  4. H. Fu, X. Cao and Z. Tu, "Cluster-Based Co-Saliency Detection," IEEE Transactions on Image Processing, vol 22, no.10, pp.3766-3778, 2013. https://doi.org/10.1109/TIP.2013.2260166
  5. Z. Liu, W. Zou, L. Li and L. Shen, "Co-Saliency Detection Based on Hierarchical Segmentation," Signal Processing Letters, vol 21, no.1, pp.88-92, 2014. https://doi.org/10.1109/LSP.2013.2292873
  6. X. Cao, Z. Tao, B. Zhang and W Feng, "Self-adaptively Weighted Co-saliency Detection via Rank Constraint," IEEE Transactions on Image Processing, vol 23, no.9, pp.4175-4186, 2014. https://doi.org/10.1109/TIP.2014.2332399
  7. Y. Qin, H. Lu, Y. Xu and H. Wang, "Saliency detection via Cellular Automata," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 110-119, June 7-12, 2015.
  8. R. Achanta, A. Shaji, K. Smith, A. Lucchi , P. Fua and S. Susstrunk, "SLIC superpixels compared to state-of-the-art superpixel methods," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol 34, no.11, pp.2274-2282, 2012. https://doi.org/10.1109/TPAMI.2012.120
  9. J. Kim, D. Han, Y. Tai and J. Kim, "Salient Region Detection via High-Dimensional Color Transform and Local Spatial Support," IEEE Transactions on Image Processing, vol 25, no.1, pp.9-23, 2016. https://doi.org/10.1109/TIP.2015.2495122
  10. M. Dubuisson and A. K. Jain, "A modified Hausdorff distance for object matching," in Proc. of the 12th IAPR International Conf. on Pattern Recognition, pp. 566-568, October 9-13, 1994.
  11. M. Cheng, G. Zhang, N. J. Mitra, X. Huang and S. Hu, "Global contrast based salient region detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol 37, no.3, pp. 569-582, 2016. https://doi.org/10.1109/TPAMI.2014.2345401
  12. K. Chang, T. Liu, H. Chen and S. Lai, "Fusing generic objectness and visual saliency for salient object detection," in Proc. of IEEE International Conf. on Computer Vision (ICCV), pp. 914-921, November 6-13, 2011.
  13. F. Perazzi, P. Krahenbuhl, Y. Pritch and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 733-740, June 16-21, 2012.
  14. Y. Wei, F. Wen, W. Zhu and J. Sun, "Geodesic saliency using background priors," Computer Vision-ECCV, pp. 29-42, October 7-13, 2012.
  15. Q. Yan, L. Xu, J. Shi and J. Jia, "Hierarchical saliency detection," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 1155-1162, June 23-28, 2013.
  16. C. Yang, L. Zhang, H. Lu, X. Ruan and M. Yang, "Saliency detection via graph-based manifold ranking," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 3166-3173, June 23-28, 2013.
  17. R. Margolin, A. Tal and L. Zelnik-Manor, "What makes a patch distinct?," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 1139-1146, June 23-28, 2013.
  18. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng and S. Li, "Salient object detection: A discriminative regional feature integration approach," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2083-2090, June 23-28, 2013.
  19. X. Li, H. Lu, L. Zhang, X. Ruan and M. Yang, "Saliency detection via dense and sparse reconstruction," in Proc. of IEEE International Conf. on Computer Vision (ICCV), pp. 2976-2983, December 1-8, 2013.
  20. M. Cheng, J. Warrell, W. Lin, S. Zheng, V. Vineet and N. Crook, "Efficient salient region detection with soft image abstraction," in Proc. of IEEE International Conf. on Computer Vision (ICCV), pp. 1529-1536, IEEE (2013).
  21. J. Kim, D. Han, Y. Tai and J. Kim, "Salient region detection via high-dimensional color transform," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 883-890, June 24-27, 2014.
  22. W. Zhu, S. Liang, Y. Wei and J. Sun, "Saliency optimization from robust background detection," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2814-2821, June 24-27, 2014.
  23. R. Liu, J. Cao, Z. Lin and S. Shan, "Adaptive partial differential equation learning for visual saliency detection," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 3866-3873, June 24-27, 2014.
  24. S. Lu, V. Mahadevan and N. Vasconcelos, "Learning optimal seeds for diffusion-based salient object detection," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2790-2797, June 24-27, 2014.
  25. C. Li, Y. Yuan, W. Cai, Y. Xia, D. Feng, "Robust saliency detection via regularized random walks ranking," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2710-2717, June 7-12, 2015.
  26. D. Batra, A. Kowdle, D. Parikh, J. Luo and T. Chen, "Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance," International Journal of Computer Vision, vol 93, no.3, pp.273-292, 2011. https://doi.org/10.1007/s11263-010-0415-x
  27. A. Borji, M. Cheng, H Jiang, and J. Li, "Salient Object Detection: A Survey," Eprint Arxiv, vol 16, no. 7, pp.3118-3213, 2014.
  28. R. Achanta, S. Hemami, F. Estrada and S. Susstrunk, "Frequency-tuned salient region detection," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1597-1604, 20-25 June 2009.

Cited by

  1. Co-Saliency Detection via Local Prediction and Global Refinement vol.ea102, pp.4, 2017, https://doi.org/10.1587/transfun.e102.a.654
  2. Content-Based Superpixel Segmentation and Matching Using Its Region Feature Descriptors vol.103, pp.8, 2017, https://doi.org/10.1587/transinf.2019edp7322
  3. An Optimized Model for the Local Compression Deformation of Soft Tissue vol.14, pp.2, 2020, https://doi.org/10.3837/tiis.2020.02.011