Electronics and Telecommunications Trends (전자통신동향분석)

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Technology Trends on Image/Video Perceptual Quality Assessment

정지영상 및 동영상 인지화질 측정 기술 동향

  • Published : 2018.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

Assessment technologies regarding the perceptual quality of images and videos have been receiving significant attention, as they serve as essential tools for monitoring and improving the quality of various media services. In this paper, we review the technology trends of recent studies on the perceptual quality assessment of images and videos, and discuss the future direction of this research field.

Keywords

Acknowledgement

Grant : 초실감 테라미디어를 위한 AV 부호화 및 LF 미디어 원천기술 개발

Supported by : 정보통신기술진흥센터

References

  1. Z. Li, A. Aaron, I. Katsavounidis, A. Moorthy, and M. Manohara, "Toward a Practical Perceptual Video Quality Metric," The Netflix Tech Blog, July 24, 2017. http://techblog.netflix.com/2016/06/toward-practical-perceptual-video.html
  2. C.G. Bampis, Z. Li, I. Katsavounidis, and A.C. Bovik "Recurrent and Dynamic Models for Predicting Streaming Video Quality of Experience," IEEE Trans. Image Process., vol. 27, no. 7, July 2018, pp. 3316-3331. https://doi.org/10.1109/TIP.2018.2815842
  3. L. Xu, W. Lin, and C.C. Kuo, Visual Quality Assessment by Machine Learning, Singapore: Springer, 2015.
  4. LIVE Image Quality Assessment Database. http://live.ece.utexas.edu/research/quality/subjective.htm
  5. N.N. Ponomarenko, "Tampere Image Database, Version 1.0, 2008," Feb. 22, 2010. http://www.ponomarenko.info/tid2008.htm
  6. N.N. Ponomarenko, "Image Database for Evaluation of Full-Reference Image Visual Quality Assessment Metrics," Mar. 23, 2014. http://www.ponomarenko.info/tid2013.htm
  7. CSIQ Lab, "CSIQ Image Database," Apr. 29, 2016. http://vision.eng.shizuoka.ac.jp/mod/page/view.php?id=23
  8. Laboratory for Image & Video Engineering, "LIVE Video Quality Assessment Database," 2009. http://live.ece.utexas.edu/research/quality/live_video.html
  9. CSIQ Lab, "CSIQ Video Database," May 8, 2016. http://vision.eng.shizuoka.ac.jp/mod/page/view.php?id=24
  10. Z. Li, "NFLX Public Database," GooGle Drive, Mar. 2, 2016. https://drive.google.com/drive/u/0/folders/0B3YWNICYMBIweGdJbERlUG9zc0k
  11. Institute for Telecommunication Science, "VQEG, HDTV Database." http://www.its.bldrdoc.gov/vqeg/projects/hdtv/
  12. ITU-R BT.500-13 (2012) ITU, Methodology for the Subjective Assessment of the Quality of Television Pictures, 2012.
  13. S. Bosse, D. Maniry, T. Wiegand, and W. Samek, "A Deep Neural Network for Image Quality Assessment," IEEE Trans. Image Proccess., Phoenix, AZ, USA, Sept. 28, 2016, pp. 3773-3777.
  14. S. Bosse, D.Maniry, K.-R. Muller, T. Wiegand, and W. Samek, "Deep Neural Networks for No-reference and Full-Reference Image Quality Assesment," IEEE Trans. Image Proccess., vo. 27, no. 1, Jan. 2017, pp. 206-219.
  15. Z. Wang, E.P. Simoncelli, and A.C. Bovik, "Multiscale Structural Similarity for Image Quality Assessment," IEEE Asilomar Conf. Signals, Syst. Comput., Pacific Grove, CA, USA, Nov. 9-12, 2003, pp. 1398-1402.
  16. E.C. Larson and D.M. Chandler, "Most Apparent Dis-Tortion: Full-Reference Image Quality Assessment and the Role of Strategy," J. Electron. Imag., vol. 19, no. 1, 2010, pp. 0110061:1-0110061:21.
  17. M.A Saad, A.C. Bovik, and C. Charrier, "Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain," IEEE Trans. Image Process., vol. 21, no. 8, Aug. 2012, pp. 3339-3352. https://doi.org/10.1109/TIP.2012.2191563
  18. K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," arXiv:1409.1556, Sept. 2014.
  19. P.V. Vu, C.T. Vu, and D.M. Chandler, "A Spatiotemporal Most-Apparent-Distortion Model for Video Quality Assessment," IEEE Int. Conf. Image Process., Brussels, Belgium, Sept. 11-14, 2011, pp. 2505-2508.
  20. M.A. Saad, A.C. Bovik, and C. Charrier, "Blind Prediction of Natural Video Quality," IEEE Trans. Image. Process., vol. 23, no. 3, Mar. 2014, pp. 1352-1365. https://doi.org/10.1109/TIP.2014.2299154
  21. S. Wolf and M.H. Pinson, "Video Quality Model for Variable Frame Delay (VQM_VFD)," U.S. Dept. Commer., Nat. Telecommun. Inf. Admin., Boulder, CO, USA, Tech. Memo TM-11-482, Sept. 2011.
  22. D. Ghadiyaram, J. Pan, and A. Bovik, "A Subjective and Objective Study of Stalling Events in Mobile Streaming Videos," IEEE Trans. Circuits Syst. Video Technol., Nov. 2017.
  23. Z. Duanmu, A. Rehman, K. Zeng, and Z. Wang, "Quality-of-Experience Prediction for Streaming Video," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), Seattle, WA, USA, July 11-16, 2016, pp. 1-6.
  24. C.G. Bampis, Z. Li, A.K. Moorthy, I. Katsavounidis, A. Aaron, and A.C. Bovik, "Study of Temporal Effects on Subjective Video Quality of Experience," IEEE Trans. Image Process., vol. 26, no. 11, Nov. 2017, pp. 5217-5231. https://doi.org/10.1109/TIP.2017.2729891
  25. D. Ghadiyaram, J. Pan, and A.C. Bovik, "Learning a Continuous-Time Streaming Video QoE Model," IEEE Trans. Image Process., May. 2018, pp. 2257-2271.
  26. J.A. Nelder, "The Fitting of a Generalization of the Logistic Curve," Biometrics, vol. 17, no. 1, 1961, pp. 89-110. https://doi.org/10.2307/2527498
  27. J.L. Elman, "Finding Structure in Time," Cognitive Sci., vol. 14, no. 2, 1990, pp. 179-211. https://doi.org/10.1207/s15516709cog1402_1
  28. C.G. Bampis and A.C. Bovik, "An Augmented Autoregressive Approach to HTTP Video Stream Quality Prediction," arXiv: 1707.02709, July 2017.