Browse > Article
http://dx.doi.org/10.3837/tiis.2021.07.012

Video Quality Assessment Based on Short-Term Memory  

Fang, Ying (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Chen, Weiling (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Zhao, Tiesong (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Xu, Yiwen (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Chen, Jing (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.15, no.7, 2021 , pp. 2513-2530 More about this Journal
Abstract
With the fast development of information and communication technologies, video streaming services and applications are increasing rapidly. However, the network condition is volatile. In order to provide users with better quality of service, it is necessary to develop an accurate and low-complexity model for Quality of Experience (QoE) prediction of time-varying video. Memory effects refer to the psychological influence factor of historical experience, which can be taken into account to improve the accuracy of QoE evaluation. In this paper, we design subjective experiments to explore the impact of Short-Term Memory (STM) on QoE. The experimental results show that the user's real-time QoE is influenced by the duration of previous viewing experience and the expectations generated by STM. Furthermore, we propose analytical models to determine the relationship between intrinsic video quality, expectation and real-time QoE. The proposed models have better performance for real-time QoE prediction when the video is transmitted in a fluctuate network. The models are capable of providing more accurate guidance for improving the quality of video streaming services.
Keywords
Video Quality Assessment; Short-Tterm Memory; Expectation; Quality of Experience;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 C. Chao, L. K. Choi, G. Vecianna, C. Caramanis, R.W. Heath and A. C. Bovik, "Modeling the time-varying subjective quality of HTTP video streams with rate adaptations," IEEE Transactions on Image Processing, vol.23, no.5, pp.2206-2221, 2014.   DOI
2 N. Cowan, "What are the differences between long-term, short-term, and working memory?," Progress in Brain Research, 169, 323-338, 2008.   DOI
3 K. Seshadrinathan, A. C. Bovik, "Temporal hysteresis model of time varying subjective video quality," in Proc. of 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 22-27 May 2011.
4 C. G. Bampis and Z. Li, et al., "study of temporal effects on subjective video Quality of Experience," IEEE Transactions on Image Processing, vol.26, no.11, pp. 5217 - 5231, Nov. 2017.   DOI
5 S. Tavakoli, S. Egger, M. Seufert, R. Schatz, K. Brunnstrom, N. Garcia, "Perceptual Quality of HTTP adaptive streaming strategies: cross-experimental analysis of multi-Laboratory and crowdsourced subjective studies," IEEE Journal on Selected Areas in Communications, vol.34, no.8, pp.2141-2153, June 2016.   DOI
6 "Vocabulary and effects of transmission parameters on customer opinion of transmission quality," amendment 2, ITU-T Recommendation P.10/G.100, Tech. Rep., 2017.
7 A. Finamore, M. Mellia, M. M. Munafo, R. Torres and S. G. Rao, "YouTube everywhere: Impact of device and infrastructure synergies on user experience," in Proc. of the 2011 ACM SIGCOMM conference on Internet measurement conference, pp.345-360, 2011.
8 A. Mittal, M. A. Saad and A. C. Bovik, "A completely blind video integrity oracle," IEEE Transactions on Image Processing, vol.25, no.1, pp.289-300, 2016.   DOI
9 A. Biernacki, "Improving Video quality by diversification of adaptive streaming strategies," KSII Transactions on Internet and Information Systems, vol. 11, no. 1, pp. 374-395, 2017.   DOI
10 J. G. Anthony, P. Colin and B. L. William, "Primacy versus recency in a quantitative model: Activity is the critical distinction," Learn. Memory, vol.7, no.1, pp.48-57, 2000.   DOI
11 A. B. Watson and J. Malo, "Video quality measures based on the standard spatial observer," in Proc. of International Conference on Image Processing, 22-25 Sept. 2002.
12 Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600-612, April 2004.   DOI
13 T. Zhao, Q. Liu and C. W. Chen, "QoE in video transmission: a user experience-driven strategy," IEEE Communications Surveys & Tutorials, vol. 19, no. 1, pp.285-302, October 2016.   DOI
14 U. Reiter and K. Brunnstrom, K. D. Moor, M-C. Larabi, M. Pereira, A. Pinheiro, J. You and A. Zgank, "Factors influencing Quality of Experience," Quality of Experience, pp. 55-72, 2014.
15 C. Bampis, Z. Li and A. C. Bovik, "Continuous prediction of streaming video QoE using dynamic networks," IEEE Signal Processing Letters, vol.24, no.7, pp.1083-1087, May 2017.   DOI
16 P. Juluri, V. Tamarapalli and D. Medhi, "Measurement of Quality of Experience of video-on-demand services: A survey," IEEE Communications Surveys & Tutorials, vol. 18, no. 1, pp. 401-418, February 2015.   DOI
17 L. Gao, Y. Xie, J. Qi and Z. Li, "A multifunctional video quality assessment system," in Proc. of 5th International Congress on Image and Signal Processing, 16-18 Oct. 2012.
18 X. Liu, M. Chen, T. Wan and C. Yu, "Hybrid No-Reference Video Quality Assessment Focusing on Codec Effects," KSII Transactions on Internet and Information Systems, vol. 5, no. 3, pp. 592-606, 2011.   DOI
19 M. Zink, J. Schmitt, and R. Steinmetz, "Layer-encoded video in scalable adaptive streaming," IEEE Transactions on Multimedia, vol.7, no.1, pp.75-84, Feb.2005.   DOI
20 L. O. Richard, "A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions," Journal of Marketing Research, vol.17, no.4, pp. 460-469, 1980.   DOI
21 K. Seshadrinathan, A. C. Bovik: "Recency and duration neglect in subjective assessment of television picture quality," Applied Cognitive Psychology, vol.15, no.6, pp.639-657, 2001.   DOI
22 Z. Duanmu, K. Ma, Z. Wang, "Quality-of-Experience for adaptive streaming videos: An expectation confirmation theory motivated approach," IEEE Transactions on Image Processing, vol.27, no.12, pp. 6135-6146, 2018.   DOI
23 D. Ghadiyaram, J. Pan, and A. C. Bovik, "Learning a continuous-time streaming video QoE model," IEEE Transactions on Image Processing, vol.27, no.5, pp.2257-2271, 2018.   DOI
24 W. Shi, Y. Sun and J. Pan, "Continuous prediction for Quality of Experience in wireless video streaming," IEEE Access, vol.7, pp. 70343 - 70354, May 2019.   DOI
25 Y. Fang, C. Zhang, W. Yang, J. Liu and Z. Guo, "Blind visual quality assessment for image super-resolution by convolutional neural network," Multimedia Tools and Applications(MTAP), vol. 77, pp. 29829-29846, 2018.   DOI
26 Z. Wang, E. P. Simoncelli, and A. C. Bovik, "Multiscale structural similarity for image quality assessment," in Proc. of The Thirty-Seventh Asilomar Conference on Signals, Systems & Computers, 9-12 Nov. 2003.
27 Methodology for the subjective assessment of the quality of television pictures, ITU-R Recommendation BT.500-13, 2012.
28 Methodology for the subjective assessment of video quality in multimedia applications, ITU-R Recommendation BT.1788, 2007.
29 J. Xu, P. Ye, Q. Li, H. Du, Y. Liu and D. Doermann, "Blind image quality assessment based on high order statistics aggregation," IEEE Transactions on Image Processing, vol.25 no.9, pp. 4444-4457, 2016.   DOI