Browse > Article
http://dx.doi.org/10.3837/tiis.2016.01.017

No-reference Image Quality Assessment With A Gradient-induced Dictionary  

Li, Leida (School of Information and Electrical Engineering, China University of Mining and Technology)
Wu, Dong (School of Information and Electrical Engineering, China University of Mining and Technology)
Wu, Jinjian (School of Electronic Engineering, Xidian University)
Qian, Jiansheng (School of Information and Electrical Engineering, China University of Mining and Technology)
Chen, Beijing (School of Computer and Software, Nanjing University of Information Science and Technology)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.10, no.1, 2016 , pp. 288-307 More about this Journal
Abstract
Image distortions are typically characterized by degradations of structures. Dictionaries learned from natural images can capture the underlying structures in images, which are important for image quality assessment (IQA). This paper presents a general-purpose no-reference image quality metric using a GRadient-Induced Dictionary (GRID). A dictionary is first constructed based on gradients of natural images using K-means clustering. Then image features are extracted using the dictionary based on Euclidean-norm coding and max-pooling. A distortion classification model and several distortion-specific quality regression models are trained using the support vector machine (SVM) by combining image features with distortion types and subjective scores, respectively. To evaluate the quality of a test image, the distortion classification model is used to determine the probabilities that the image belongs to different kinds of distortions, while the regression models are used to predict the corresponding distortion-specific quality scores. Finally, an overall quality score is computed as the probability-weighted distortion-specific quality scores. The proposed metric can evaluate image quality accurately and efficiently using a small dictionary. The performance of the proposed method is verified on public image quality databases. Experimental results demonstrate that the proposed metric can generate quality scores highly consistent with human perception, and it outperforms the state-of-the-arts.
Keywords
Image quality assessment; no-reference; dictionary; K-means clustering; SVM;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Y. H. Kim, J. Shin and H. Kim, “Lightweight quality metric based on no-reference bitstream for H.264/AVC video,” KSII Transactions on Internet and Information Systems, vol. 6, no. 5, pp. 1388-1399, May, 2012. Article (CrossRef Link)   DOI
2 X. G. Liu, M. Chen, T.Wan and C. Yu, “Hybrid no-reference video quality assessment focusing on codec effects,” KSII Transactions on Internet and Information Systems, vol. 5, no. 3, pp. 592-606, March, 2011. Article (CrossRef Link)   DOI
3 Z. Q. Pan, Y. Zhang and S. Kwong, “Efficient motion and disparity estimation optimization for low complexity multiview video coding,” IEEE Transactions on Broadcasting, vol. 61, no. 2, pp. 166-176, June, 2015. Article (CrossRef Link)   DOI
4 Z. H. Xia, X. H. Wang, X. M. Sun, Q. S. Liu and N. X. Xiong, “Steganalysis of LSB matching using differences between nonadjacent pixels,” Multimedia Tools and Applications, DOI 10.1007/s11042-014-2381-8, 2015. Article (CrossRef Link)   DOI
5 D. T. Nguyen, Y. H. Park, K. Y. Shin and K. R. Park, “New finger-vein recognition method based on image quality assessment,” KSII Transactions on Internet and Information Systems, vol. 7, no. 2, pp. 347-365, February, 2013. Article (CrossRef Link)   DOI
6 J. Li, X. L. Li, B. Yang and X. M. Sun, “Segmentation-based image copy-move forgery detection scheme,” IEEE Transactions on Information Forensics and Security, vol. 10, no. 3, pp. 507-518, March, 2015. Article (CrossRef Link)   DOI
7 Z. H. Xia, X. H.Wang, X. M. Sun and B. W.Wang, “Steganalysis of least significant bit matching using multi-order differences,” Security and Communication Networks, vol. 7, no. 8, pp. 1283-1291, 2014. Article (CrossRef Link)   DOI
8 K. Gu, G. T. Zhai, X. K. Yang, W. J. Zhang and C. W. Chen, “Automatic contrast enhancement technology with saliency preservation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 9, pp. 1480-1494, 2015. Article (CrossRef Link)   DOI
9 W. S. Lin and C-C. Jay Kuo, “Perceptual visual quality metrics: a survey,” Journal of Visual Communication and Image Representation, vol. 22, no. 4, pp. 297-312, 2011. Article (CrossRef Link)   DOI
10 K. Gu, G. T. Zhai, X. K. Yang and W. J. Zhang, “Using free energy principle for blind image quality assessment,” IEEE Transactions on Multimedia, vol. 17, no. 1, pp. 50-63, 2015. Article (CrossRef Link)   DOI
11 L. D. Li, H. C. Zhu, G. B. Yang and J. S. Qian, “Referenceless measure of blocking artifacts by Tchebichef kernel analysis,” IEEE Signal Processing Letters, vol. 21, no. 1, pp. 122-125, 2014. Article (CrossRef Link)   DOI
12 L. D. Li, W. S. Lin, X. S.Wang, G. B. Yang, K. Bahrami and A. C. Kot, “No-reference image blur assessment based on discrete orthogonal moments,” IEEE Transactions on Cybernetics, DOI: 10.1109/TCYB.2015.2392129, 2015. Article (CrossRef Link)   DOI
13 S. A. Golestaneh and D. M. Chandler, “No-reference quality assessment of JPEG images via a quality relevance map,” IEEE Signal Processing Letters, vol. 21, no. 2, pp. 155-158, 2014.   DOI
14 L. D. Li, W. S. Lin and H. C. Zhu, “Learning structural regularity for evaluating blocking artifacts in JPEG images,” IEEE Signal Processing Letters, vol.21, no.8, pp. 918-922, 2014. Article (CrossRef Link)   DOI
15 A. K. Moorthy and A. C. Bovik, “Blind image quality assessment: from natural scene statistics to perceptual quality,” IEEE Transactions on Image Processing, vol. 20, no. 12, pp. 3350-3364, 2011. Article (CrossRef Link)   DOI
16 R. Hassen, Z. Wang and M. M. A Salama, “Image sharpness assessment based on local phase coherence,” IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2798-2810, July, 2013. Article (CrossRef Link)   DOI
17 K. Gu, G. T. Zhai, W. S. Lin, X. K. Yang and W. J. Zhang, “No-reference image sharpness assessment in autoregressive parameter space,” IEEE Transactions on Image Processing , vol. 24, no. 10, pp. 3218-3231, 2015. Article (CrossRef Link)   DOI
18 A. K. Moorthy and A. C. Bovik. “A two-step framework for constructing blind image quality indices,” IEEE Signal Processing Letters, vol. 17, no. 5, pp. 513-516, 2010. Article CrossRef Link)   DOI
19 M. A. Saad, A.C. Bovik, and C. Charrier, “Blind image quality assessment: a natural scene statistics approach in the DCT domain,” IEEE Transactions on Image Processing, vol. 21, no. 8, pp. 3339-3352, August, 2012. Article (CrossRef Link)   DOI
20 P. Ye, J. Kumar, L. Kang and D. Doermann, "Unsupervised feature learning framework for no-reference image quality assessment," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1098-1105, June 16-21, 2012. Article (CrossRef Link)
21 A. Mittal, A. K. Moorthy and A. C. Bovik, “No-reference image quality assessment in the spatial domain,” IEEE Transactions on Image Processing, vol. 21, no. 12 pp. 4695-4708, 2012. Article (CrossRef Link)   DOI
22 A. Mittal, R. Soundararajan and A. C. Bovik, “Making a “completely blind” image quality analyzer,” IEEE Signal Processing Letters, vol. 20, no. 3, pp. 209-212, 2013. Article (CrossRef Link)   DOI
23 N. Ponomarenko, O. Ieremeiev, V. Lukin, K. Egiazarian, L. Jin, J. Astola, B. Vozel, K. Chehdi, M. Carli, F. Battisti and C.-C. Jay Kuo, "Color image database TID2013: peculiarities and preliminary results," in Proc. of the 4th Europian Workshop on Visual Information Processing, pp. 106-111, June 10-12, 2013. Article (CrossRef Link)
24 C. C. Chang, and C. J. Lin. “LIBSVM: a library for support vector machines,” ACM Transactions on Intelligent Systems and Technology, vol. 2, no. 3, Article 27, 2011. Article (CrossRef Link)   DOI
25 E. C. Larson and D. M. Chandler, “Most apparent distortion: full-reference image quality assessment and the role of strategy,” Journal of Electronic Imaging, vol. 19, no. 1, pp. 001006:1-21, March, 2010. Article (CrossRef Link)
26 N. Ponomarenko, V. Lukin, A. Zelensky, K. Egiazarian, M. Carli and F. Battisti, “TID2008 - a database for evaluation of full-reference visual quality assessment metrics,” Advsances of Modern Radioelectronics, vol. 10, no. 4, pp. 30-45, 2009. Article (CrossRef Link)
27 D. Jayaraman, A. Mittal, A.K. Moorthy, A.C. Bovik, Objective quality assessment of multiply distorted images, in: Proc. of Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, pp. 1693-1697, Nov. 2012. Article (CrossRef Link)
28 VQEG, "Final report from the Video Quality Experts Group on the validation of objective models of video quality assessment-Phase II," available online: http://www.vqeg.org/, 2003. Article (CrossRef Link)
29 W. F. Xue, L. Zhang and X. Q. Mou, "Learning without human scores for blind image quality assessment," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 995-1002, June 23-28, 2013. Article (CrossRef Link)
30 L. X. Liu, B. Liu, H. Huang and A. C. Bovik, “No-reference image quality assessment based on spatial and spectral entropies,” Signal Processing: Image Communication, vol. 29, no. 8, pp. 856-863, 2014. Article (CrossRef Link)   DOI
31 G. E. Hinton and S. Osindero and Y. W. Teh, “A fast learning algorithm for deep belief nets,” Neural Computation, vol. 18, no. 7, pp. 1527-1554, 2006. Article (CrossRef Link)   DOI
32 H. L. Lee, C. Ekanadham and A. Y. Ng. "Sparse deep belief net model for visual area V2," in Proc. of Advances in Neural Information Processing Systems, pp. 873-880, December 8-11, 2008. Article (CrossRef Link)
33 B. A. Olshausen and D. J. Field, “Emergence of simple-cell receptive field properties by learning a sparse code for natural images,” Nature, vol. 381, no. 13, pp. 607-609, June, 1996. Article (CrossRef Link)   DOI
34 L. Zhang, L. Zhang, X. Q. Mou and D. Zhang, “FSIM: a feature similarity index for image quality assessment,” IEEE Transactions on Image Processing, vol. 20, no. 8, pp. 2378-2386, 2011. Article (CrossRef Link)   DOI
35 Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600-612, April, 2004. Article (CrossRef Link)   DOI
36 A. Coates, H. L. Lee and A. Y. Ng, "An analysis of single-layer networks in unsupervised feature learning," in Proc .of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 215-223, April 11-13, 2011. Article (CrossRef Link)
37 A. K. Moorthy and A. C. Bovik, “Visual importance pooling for image quality assessment,” IEEE Journal of Selected Topics in Signal Processing, vol. 3, no. 2, pp. 193-201, 2009. Article (CrossRef Link)   DOI
38 K. Gu, G. T. Zhai, W. S. Lin, and M. Liu, "The analysis of image contrast: From quality assessment to automatic enhancement," IEEE Transactions on Cybernetics, 2015, DOI: 10.1109/TCYB.2015.2401732, 2015. Article (CrossRef Link)   DOI
39 D. M. Chandler and S. S. Hemami, “VSNR: a wavelet-based visual signal-to-noise ratio for natural images,” IEEE Transactions on Image Processing, vol. 16, no. 9, pp. 2284-2298, 2007. Article (CrossRef Link)   DOI
40 K. Gu, G. T. Zhai, X. K. Yang, and W. J. Zhang, "Hybrid no-reference quality metric for singly and multiply distorted images," IEEE Transactions on Broadcasting, vol. 60, no. 3, pp. 555-567, Sept. 2014. Article (CrossRef Link)   DOI
41 B. J. Chen, H. Z. Shu, G. Coatrieux, G. Chen, X. M. Sun and J. L. Coatrieux, “Color image analysis by quaternion-type moments,” Journal of Mathematical Imaging and Vision, vol. 51, no. 1, pp. 124-144, 2015. Article (CrossRef Link)   DOI