Browse > Article
http://dx.doi.org/10.3837/tiis.2016.12.020

Saliency Detection based on Global Color Distribution and Active Contour Analysis  

Hu, Zhengping (School of Information Science and Engineering & Yanshan University)
Zhang, Zhenbin (School of Information Science and Engineering & Yanshan University)
Sun, Zhe (School of Information Science and Engineering & Yanshan University)
Zhao, Shuhuan (School of Information Science and Engineering & Yanshan University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.10, no.12, 2016 , pp. 5507-5528 More about this Journal
Abstract
In computer vision, salient object is important to extract the useful information of foreground. With active contour analysis acting as the core in this paper, we propose a bottom-up saliency detection algorithm combining with the Bayesian model and the global color distribution. Under the supports of active contour model, a more accurate foreground can be obtained as a foundation for the Bayesian model and the global color distribution. Furthermore, we establish a contour-based selection mechanism to optimize the global-color distribution, which is an effective revising approach for the Bayesian model as well. To obtain an excellent object contour, we firstly intensify the object region in the source gray-scale image by a seed-based method. The final saliency map can be detected after weighting the color distribution to the Bayesian saliency map, after both of the two components are available. The contribution of this paper is that, comparing the Harris-based convex hull algorithm, the active contour can extract a more accurate and non-convex foreground. Moreover, the global color distribution can solve the saliency-scattered drawback of Bayesian model, by the mutual complementation. According to the detected results, the final saliency maps generated with considering the global color distribution and active contour are much-improved.
Keywords
Saliency detection; active contour model; seed; global color distribution; affinity matrix; Bayesian model;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Siva, C. Russell, T. Xiang and L. Agapito, "Looking beyond the image: unsupervised learning for object saliency and detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.3238-3245, June 23-28, 2013.
2 J. Han, D. Zhang, G. Cheng and L. Guo, "Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning," IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 6, pp. 3325-3337, June, 2015.   DOI
3 M.-M. Cheng, G.-X. Zhang, N.J. Mitra, X. Huang and S.-M. Hu, "Global contrast based salient region detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 569 -582, June 20-25, 2011.
4 V. Saminadan, P. Aishwarya, M. Manimegalai, M. Nivedhitha and G. Subhapriya, "Efficient image dehazing based on pixel based dark channel prior and guided filter," in Proc. of Communications and Signal Processing, pp.1925-1927, April 2-4, 2015.
5 Z. Wang and B. Li, "A two-stage approach to saliency detection in images," in Proc. of IEEE Acoustics, Speech and Signal Processing, pp. 965- 968, March 31-April 4, 2008.
6 Shi, Q. Yan, L. Xu and J. Jia, "Hierarchical Image Saliency Detection on Extended CSSD," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 4, pp. 717-729, April, 2015.   DOI
7 Yan, L. Xu, J. Shi and J. Jia, "Hierarchical Saliency Detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 1155-1162, June 23-28, 2013.
8 A. Borji, M-M. Cheng, H. Jiang and J. Li, "Salient Object Detection: A Benchmark," IEEE Transactions on Image Processing, vol. 24, no. 12, pp. 5706-5722, Dec. 2015.   DOI
9 X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.853-860, June 16-21, 2012.
10 R. Achanta, S.S. Hemami, F.J. Estrada and S. Susstrunk, "Frequency-tuned salient region detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.1597-1604, June 20-25, 2009.
11 X. Li, H. Lu, L. Zhang, X. Ruan and M-H. Yang, "Saliency Detection via Dense and Sparse Reconstruction," in Proc. of IEEE Computer Vision, pp. 2976-2983, December 1-8, 2013.
12 X. Hou and L. Zhang, "Saliency detection: a spectral residual approach," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 1-8, June 17-22, 2007.
13 H. R. Tavakoli, E. Rahtu, and J. Heikkila, "Fast and efficient saliency detection using sparse sampling and kernel density estimation," in Proc. of Image Analysis-scandinavian Conference, pp. 666-675, May, 2011.
14 H. Jiang, J. Wang, Z. Yuan, T. Liu, N. Zheng and S. Li, "Automatic salient object segmentation based on context and shape prior," in Proc. of British Machine Vision Conference, pp. 1-12, September, 2011.
15 H. J. Seo and P. Milanfar, "Static and space-time visual saliency detection by self-resemblance," Journal of Vision, vol. 9, no. 12 pp. 1-27, November, 2009.
16 N. Murray, M. Vanrell, X. Otazu, and C. A. Parraga, "Saliency estimation using a non-parametric low-level vision model," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 433-440, June 20-25, 2011.
17 M-M Cheng, J. Warrell, W-Y. Lin, S. Zheng, V. Vineet and N. Crook, "Efficient Salient Region Detection with Soft Image Abstraction," in Proc. of IEEE Computer Vision, pp.1529-1536, December 1-8, 2013.
18 E. Rahtu, J. Kannala, M. Salo and J. Heikkila, "Segmenting salient objects from images and videos," in Proc. of European Conference on Computer Vision, pp. 366-379, September 5-11, 2010.
19 J. Harel, C. Koch and P. Perona, "Graph-based visual saliency," in Proc. of Neural Information Processing Systems, pp. 54-552, 2007.
20 J. Han, D. Zhang, X. Hu and L. Guo, "Background Prior-Based Salient Object Detection via Deep Reconstruction Residual," IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 8, pp. 1309-1321, Aug. 2015.   DOI
21 J. Han, D. Zhang, X. Hu and L.Guo, "Two-Stage Learning to Predict Human Eye Fixations via SDAEs," IEEE Transactions on Cybernetics, vol. 46, no. 2, pp. 487-498, Feb. 2016.   DOI
22 Y. Xie and H. Lu, "Visual saliency detection based on Bayesian model," in Proc. of IEEE International Conference on Image Processing, pp. 645-648, Sept 11-14, 2011.
23 S. Lu, V. Mahadevan and N. Vasconcelos, "Learning Optimal Seeds for Diffusion-Based Salient Object Detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 2790-2797, June 23-28, 2014.
24 F. Perazzi, P. Krahenbuhl, Y. Pritch and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 733-740, June 16-21, 2012.
25 L. Zhang, M. Tong, T. Marks, H. Shan, and G. Cottrell, "Sun: A Bayesian framework for saliency using natural statistics," Journal of Vision, vol. 8, no. 7, pp. 1-20, December, 2008.
26 C. Yang, L. Zhang and H. Lu, "Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior," IEEE Signal Processing Letters, vol. 20, no. 7, pp. 637-640, July, 2013.   DOI
27 R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua and S. Susstrunk, "Slic superpixels," in Proc. of EPFL, 2010.
28 J. Sun, H. Lu and X. Liu, "Saliency Region Detection based on Markov Absorption Probabilities," IEEE Transactions on Image Processing, vol. 24, no. 5, pp. 1639-1649, May, 2015.   DOI
29 J. Wang, H. Lu, X. Li, N. Tong and W. Liu, "Saliency detection via background and foreground seed selection," Neurocomputing, vol. 152, pp. 359-368, October, 2015.   DOI
30 R. Achanta, F. Estrada, P. Wils and S. Susstrunk, "Salient region detection and segmentation," in Proc. of Computer Vision Systems, pp. 66-75, May 12-15, 2008.
31 J.-S. Kim, J.-Y. Sim and C.-S. Kim, "Multiscale Saliency Detection Using Random Walk With Restart," IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, no. 2, pp. 198-210, Feb. 2014.   DOI
32 B. Jiang, L. Zhang, H. Lu, C. Yang and M.-H. Yang, "Saliency detection via absorbing Markov chain," in Proc. of IEEE Computer Vision, pp.1665-1672, December 1-8, 2013.
33 H. Ren, Z. Su, C. Lv and F. Zou, "An improved algorithm for active contour extraction based on greedy snake," in Proc. of IEEE Computer and Information Science, pp. 589-592, June 28-July 1, 2015.
34 S. Osher and J.A. Sethian, "Fronts Propagating with Curvature Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations," in Proc. of Journal of Computational Physics, vol. 79, no. 1, pp.12-49, 1988.   DOI
35 C. Li, C. Xu, C. Gui and M.D. Fox, "Level Set Evolution Without Re-initialization: A New Variational Formulation," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.430-436, June 20-25, 2005.
36 D. Zhang, J. Han, C. Li and J. Wang, "Co-saliency detection via looking deep and wide," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 2994-3002, June 7-12, 2015.
37 H. Fu, X. Cao and Z. Tu, "Cluster-Based Co-Saliency Detection," IEEE Transactions on Image Processing, vol. 22, no.10, pp. 3766-3778, Oct. 2013.   DOI
38 D. Zhang, J.Han, J. Han and L. Shao, "Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining," IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 6, pp. 1163-1176, June, 2016.   DOI