Browse > Article
http://dx.doi.org/10.3837/tiis.2020.10.008

No-reference Image Blur Assessment Based on Multi-scale Spatial Local Features  

Sun, Chenchen (College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications)
Cui, Ziguan (College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications)
Gan, Zongliang (College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications)
Liu, Feng (College of Educational Science and Technology, Nanjing University of Posts and Telecommunications)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.10, 2020 , pp. 4060-4079 More about this Journal
Abstract
Blur is an important type of image distortion. How to evaluate the quality of blurred image accurately and efficiently is a research hotspot in the field of image processing in recent years. Inspired by the multi-scale perceptual characteristics of the human visual system (HVS), this paper presents a no-reference image blur/sharpness assessment method based on multi-scale local features in the spatial domain. First, considering various content has different sensitivity to blur distortion, the image is divided into smooth, edge, and texture regions in blocks. Then, the Gaussian scale space of the image is constructed, and the categorized contrast features between the original image and the Gaussian scale space images are calculated to express the blur degree of different image contents. To simulate the impact of viewing distance on blur distortion, the distribution characteristics of local maximum gradient of multi-resolution images were also calculated in the spatial domain. Finally, the image blur assessment model is obtained by fusing all features and learning the mapping from features to quality scores by support vector regression (SVR). Performance of the proposed method is evaluated on four synthetically blurred databases and one real blurred database. The experimental results demonstrate that our method can produce quality scores more consistent with subjective evaluations than other methods, especially for real burred images.
Keywords
Image blur assessment; Gaussian scale space; generalized Gaussian distribution; singular value decomposition; gradient;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 N. D. Narvekar and L. J. Karam, "A no-reference blur metric based on the cumulative probability of blur detection (CPBD)," IEEE Transactions on Image Processing, vol. 20, no. 9, pp. 2678-2683, March, 2011.   DOI
2 L. Li, W. Lin, X. Wang, G. Yang, K. Bahrami and A. C. Kot, "No-reference image blur assessment based on discrete orthogonal moments," IEEE Transactions on Cybernetics, vol. 46, no. 1, pp. 39-50, January, 2016.   DOI
3 L. Li, D. Wu, J. Wu, H. Li, W. Lin and A. C. Kot, "Image sharpness assessment by sparse representation," IEEE Transactions on Multimedia, vol. 18, no. 6, pp. 1085-1097, June, 2016.   DOI
4 Y. Zhan and R. Zhang, "No-reference image sharpness assessment based on maximum gradient and variability of gradients," IEEE Transactions on Multimedia, vol. 20, no. 7, pp.1796-1808, July, 2018.   DOI
5 K. Bahrami and A. C. Kot, "A fast approach for no-reference image sharpness assessment based on maximum local variation," IEEE Signal Processing Letters, vol. 21, no. 6, pp.751-755, June, 2014.   DOI
6 K. Gu, G. Zhai, W. Lin, X. Yang and W. Zhang, "No-reference image sharpness assessment in autoregressive parameter space," IEEE Transactions on Image Processing, vol. 24, no. 10, pp. 3218-3231, October, 2015.   DOI
7 M. Hosseini, Y. Zhang, and K. Plataniotis, "Encoding visual sensitivity by MaxPol convolution filters for image sharpness assessment," IEEE Transactions on Image Processing, vol. 28, no. 9, pp. 4510-4525, September, 2019.   DOI
8 R. Hassen, Z. Wang and M. M. A. Salama, "Image sharpness assessment based on local phase coherence," IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2798-2810, July, 2013.   DOI
9 G. Gvozden, S. Grgic and M. Grgic, "Blind image sharpness assessment based on local contrast map statistics," Journal of Visual Communication and Image Representation, vol. 50, pp. 145-158, January, 2018.   DOI
10 F. Kerouh, D. Ziou and A. Serir, "Histogram modeling-based no reference blur quality measure," Signal Processing Image Communication, vol. 60, pp. 22-28, September, 2017.   DOI
11 A. K. Moorthy and A. C. Bovik, "Blind image quality assessment: from natural scene statistics to perceptual quality," IEEE Transactions on Image Processing, vol. 20, no. 12, pp. 3350-3364, December, 2011.   DOI
12 A. Mittal, A. K. Moorthy and A. C. Bovik, "No-reference image quality assessment in the spatial domain," IEEE Transactions on Image Processing, vol. 21, no. 12, pp. 4695-4708, December, 2012.   DOI
13 L. Li, D. Wu, J. Wu, J. Qian, B. Chen, "No-reference image quality assessment with a gradient-induced dictionary," KSII Transactions on Internet and Information Systems, vol. 10, no. 1, pp. 288-307, January, 2016.   DOI
14 G. Yue, C. Hou, K. Gu and N. Ling, "No reference image blurriness assessment with local binary patterns," Journal of Visual Communication and Image Representation, vol. 49, pp. 382-391, September, 2017.   DOI
15 L. Li, W. Xia, W. Lin, Y. Fang and S. Wang, "No-reference and robust image sharpness evaluation based on multiscale spatial and spectral features," IEEE Transactions on Multimedia, vol. 19, no. 5, pp. 1030-1040, May, 2017.   DOI
16 S. Bosse, D. Maniry, K. Muller, K. Robert, T. Wiegand and W. Samek, "Deep neural networks for no-reference and full-reference image quality assessment," IEEE Transactions on Image Processing, vol. 27, no. 1, pp. 206-219, January, 2018.   DOI
17 T. Lindeberg, "Scale-space theory: a basic tool for analyzing structures at different scales," Journal of Applied Statistics, vol. 21, no. 2, pp. 225-270, September, 1994.   DOI
18 K. Ma, LIU W. Liu, K. Zhang, Z. Duanmu, Z. Wang and W. Zuo, "End-to-end blind image quality assessment using deep neural networks," IEEE Transactions on Image Processing, vol. 27, no. 3, pp. 1202-1213, March, 2018.   DOI
19 Y. Ma, X. Cai, F. Sun and S. Hao, "No-Reference image quality assessment based on multi-task generative adversarial network," IEEE Access, vol. 7, pp. 146893-146902, September, 2019.   DOI
20 W. Zhang, K. Ma, J. Yan, D. Deng and Z. Wang, "Blind image quality assessment using a deep bilinear convolutional neural network," IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 1, pp. 36-47, January, 2020.   DOI
21 K. Sharifi and A. Leon-garcia, "Estimation of shape parameter for generalized Gaussian distributions in sub-band decompositions of video," IEEE Transactions on Circuits and Systems for Video Technology, vol. 5, no. 1, pp. 52-56, February, 1995.   DOI
22 N. E. Lasmar, Y. Stitou, and Y. Berthoumieu, "Multiscale skewed heavy tailed model for texture analysis," in Proc. of 16th IEEE International Conference on Image Processing, pp. 2281-2284, November 7-10, 2009.
23 C. C. Chang and C. J. Lin, "LIBSVM: A library for support vector machines," ACM Transactions on Intelligent Systems and Technology, vol. 2, no. 3, pp. 1-27, May, 2011.   DOI
24 H. R. Sheikh, Z. Wang, L. Cormack, A.C. Bovik, "LIVE image quality assessment database release 2," 2006.
25 P. Marziliano, F. Dufaux, S. Winkler and T. Ebrahimi, "Perceptual blur and ringing metrics: application to JPEG2000," Signal Processing Image Communication, vol. 19, no. 2, pp. 162-173, February, 2004.
26 N. Ponomarenko, V. Lukin, A. Zelensky, K. Egiazarian, M. Carli and F. Battisti, "TID2008-a database for evaluation of full-reference visual quality assessment metrics," Advances of Modern Radioelectronics, vol. 10, no. 4, pp. 30-45, February, 2009.
27 N. Ponomarenko, L. Jin, O. Leremeiev, V. Lukin, K. Egiazarian, J. Astola, B. Vozel, K. Chehdi, M. Carli, F. Battisti and C.C.J. Kuo, "Image database TID2013: Peculiarities, results and perspectives," Signal Processing Image Communication, vol. 30, pp. 57-77, January, 2015.   DOI
28 LARSON E. C. Larson and D. M. Chandler, "Categorical subjective image quality CSIQ database," 2009.
29 A. Ciancio, A. L. N. T. Targino da Costa, E. A. B. da Silva, A. Said, R. Samadani and P. Obrador, "No-reference blur assessment of digital pictures based on multifeature classifiers," IEEE Transactions on Image Processing, vol. 20, no. 1, pp. 64-75, January, 2011.   DOI
30 H.R. Sheikh and A. Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms," IEEE Transactions on Image Processing, vol. 15, no. 11, pp. 3340-3451, November, 2006.
31 A. C. Bovik and Z. Wang, "Modern image quality assessment," Synthesis Lectures on Image, Video, and Multimedia Processing, vol. 2, no. 1, pp. 1-156, January, 2006.   DOI
32 S. Athar and Z. Wang, "A comprehensive performance evaluation of image quality assessment algorithms," IEEE Access, vol. 7, pp. 140030-140070, September, 2019.   DOI
33 R. Ferzli and L. J. Karam, "A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)," IEEE Transactions on Image Processing, vol. 18, no. 4, pp. 717-728, March, 2009.   DOI