Browse > Article
http://dx.doi.org/10.5573/ieie.2017.54.6.72

Saliency Detection using Mutual Information of Wavelet Subbands  

Moon, Sang Whan (Dept. Electronics Eng., Pusan National University)
Lee, Ho Sang (Dept. Electronics Eng., Pusan National University)
Moon, Yong Ho (Dept. Electronics Eng., Pusan National University)
Eom, Il Kyu (Dept. Electronics Eng., Pusan National University)
Publication Information
Journal of the Institute of Electronics and Information Engineers / v.54, no.6, 2017 , pp. 72-79 More about this Journal
Abstract
In this paper, we present a new saliency detection algorithm using the mutual information of wavelet subbands. Our method constructs an intermediate saliency map using the power operation and Gaussian blurring for high-frequency wavelet coefficients. After combining three intermediate saliency maps according to the direction of wavelet subband, we find the main directional components using entropy measure. The amount of mutual information of each subband is obtained centering on the subband having the minimum entropy The final saliency map is detected using Minkowski sum based on weights calculated by the mutual information. As a result of the experiment on CAT2000 and ECSSD databases, our method showed good detection results in terms of ROC and AUC with few computation times compared with the conventional methods.
Keywords
saliency detection; wavelet transform; directional features; mutual information; Minkowski summation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Fang, Yuming, et al. "A visual attention model combining top-down and bottom-up mechanisms for salient object detection." 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2011.
2 Treisman, Anne M., and Garry Gelade. "A feature-integration theory of attention." Cognitive psychology vol. 12, no. 1, pp. 97-136, 1980.   DOI
3 M. Land, N. Mennie, and J. Rusted, "The Roles of Vision and Eye Movements in the Control of Activities of Daily Living," Perception, vol. 28, no. 11, pp. 1311-1328, 1999.   DOI
4 Furuya, Takahiko, and Ryutarou Ohbuchi. "Visual saliency weighting and cross-domain manifold ranking for sketch-based image retrieval." International Conference on Multimedia Modeling. Springer International Publishing, 2014.
5 Zhu, Xianqiang, et al. "A new approach for interesting local saliency features definition and its application to remote sensing imagery retrieval." Geomatics and Information Science of Wuhan University vol. 38, no. 6, pp. 652-655, 2013.
6 Chang, Kai-Yueh, Tyng-Luh Liu, and Shang-Hong Lai. "From co-saliency to co-segmentation : An efficient and fully unsupervised energy minimization model." Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, pp. 2129-2136, 2011.
7 Qin, Chanchan, et al. "Integration of the saliency-based seed extraction and random walks for image segmentation." Neurocomputing vol. 129 pp. 378-391, 2014.   DOI
8 Ding, Zhenghu, et al. "An approach for visual attention based on biquaternion and its application for ship detection in multispectral imagery." Neurocomputing vol. 76, no. 1, pp. 9-17, 2012.   DOI
9 Fang, Yuming, et al. "Saliency detection in the compressed domain for adaptive image retargeting." IEEE Transactions on Image Processing vol. 21, no. 9, pp. 3888-3901, 2012.   DOI
10 Bhatnagar, Gaurav, and QM Jonathan Wu. "An image fusion framework based on human visual system in framelet domain." International Journal of Wavelets, Multiresolution and Information Processing vol. 10, no. 01, pp. 1250002, 2012.   DOI
11 Kadir, Timor, and Michael Brady. "Saliency, scale and image description." International Journal of Computer Vision vol. 45, no. 2, pp. 83-105, 2001.   DOI
12 C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform," Proceeding of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2008.
13 Itti, Laurent, Christof Koch, and Ernst Niebur. "A model of saliency-based visual attention for rapid scene analysis." IEEE Transactions on pattern analysis and machine intelligence vol. 20, no. 11, pp. 1254-1259, 1998.   DOI
14 S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 10. pp. 1915-1926, 2012.   DOI
15 X. Hou, and L. Zhang, "Saliency detection: a spectral residual approach," Proceeding of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2007.
16 N. Imamoglu, W. Lin, and Y. Fang, "A saliency detection model using low-level features based on wavelet transform," IEEE Trans. Multimedia, vol. 15, no. 1, pp. 96-105, 2013.   DOI
17 N. Murray, M. Vanrell, X. Otazu, and C. A. Parraga, "Saliency estimation using a non-parametric low-level vision model," Proceeding of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 433-440, 2011.
18 W. Wang, Y. Wang, Q. Huang, and W. Gao, "Measuring visual saliency by site entropy rate," Proceeding of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 2368-2375, 2010.
19 W. Hou, X. Gao, D. Tao, and X. Li, "Visual saliency detection using information divergence," Pattern Recognit., vol 46, pp. 2658-2669, 2015.
20 X. Ma, X. Xie, K. M. Lan, J. Hu, and Y. Zhong, "Saliency detection based on singular value decomposition," J. Vis. Commun. Image Represent., vol. 32, pp. 95-106, 2015.   DOI
21 X. Ma, X. Xie, K. M. Lam, and Y. Zhong, "Efficient saliency analysis based on wavelet transform and entropy theory," J. Vis. Commun. Image Represent., vol. 30, pp. 201-207, 2015.   DOI
22 Y. Fang, W. Lin, Z. Chen, C. W. Lin, and C. Deng, "Visual acuity inspired saliency detection by using sparse features," Inf. Sci., vol. 309, pp. 1-10, 2015.   DOI
23 Y. Wo, X. Chen, and G. Han, "A saliency detection model using aggregation degree of color and texture," Signal process. Image commun., vol. 30. pp. 121-136, 2015.   DOI
24 J. Lou, M. Ren, and H. Wang, "Regional principal color based saliency detection," plos one, vol. 9, no. 11, e112475, 2014.   DOI
25 Lin, Yuewei, et al. "A visual-attention model using earth mover's distance-based saliency measurement and nonlinear feature combination." IEEE transactions on pattern analysis and machine intelligence, vol. 35, no. 2, pp. 314-328, 2013.   DOI
26 M. To, P.G. Lovell, T. Troscianko, and D.J. Tolhurst, "Summation of Perceptual Cues in Natural Visual Scenes," Proc. Royal Soc. B, vol. 275, no. 1649, pp. 2299-2308, 2008.   DOI
27 Borji, Ali, and Laurent Itti. "Cat2000: A large scale fixation dataset for boosting saliency research." arXiv preprint arXiv:1505.03581, 2015.
28 Shi, Jianping, et al. "Hierarchical image saliency detection on extended cssd." IEEE transactions on pattern analysis and machine intelligence vol. 38, no. 4, pp. 717-729, 2016.   DOI
29 C. D. Brown, and H. T. Davis, "Receiver operating characteristics curves and related decision measures: A tutorial," Chemometer, Intell. Lab., vol. 80, no. 1, pp. 24-38, 2006.   DOI