Browse > Article
http://dx.doi.org/10.5909/JBE.2007.12.2.177

Comparison of subjective video quality assessment methods for multimedia applications  

Choe, Ji-Hwan (Dept. of Electrical and Electronic Engineering, Yonsei University)
Jeong, Tae-Uk (Dept. of Electrical and Electronic Engineering, Yonsei University)
Choi, Hyun-Soo (Dept. of Electrical and Electronic Engineering, Yonsei University)
Lee, Eun-Jae (Samsung Electronics Co., Ltd.)
Lee, Sang-Wook (Dept. of Electrical and Electronic Engineering, Yonsei University)
Lee, Chul-Hee (Dept. of Electrical and Electronic Engineering, Yonsei University)
Publication Information
Journal of Broadcast Engineering / v.12, no.2, 2007 , pp. 177-184 More about this Journal
Abstract
In this paper, we compared two subjective assessment methods DSCQS(Double Stimulus Continuous Quality Scale method) and ACR(Absolute Category Rating). These methods are widely used in order to evaluate video quality for multimedia application. We performed subjective quality tests using DSCQS and ACR methods. The subjective scores obtained by the DSCQS and ACR methods show that these methods are highly correlated in terms of MOS(Mean Opinion Score) and have slightly lower correlation in terms of DMOS(Difference Mean Opinion Score). The results indicate that ACR method is an effective subjective quality assessment method, which shows compatible performance with DSCQS method and can evaluate a larger number of video sequences.
Keywords
video quality assessment; DSCQS; ACR; MOS; DMOS;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Z. Wang, HR Sheikh, and AC Bovik, Objective video quality assessment, in The Handbook of Video Databases: Design and Applications (B. Furht and O. Marques, eds.), CRC Press, 2003
2 Video Quality Experts Group, 'Video Quality Experts Group: Current Results and Future Directions,' 2000
3 S. Olsson, M. Stroppiana and J. Baina, 'Objective methods for assessment of video quality: state of the art,' IEEE Trans. Broadcasting, vol.43, no.4, pp.487-495, 1997   DOI   ScienceOn
4 Video Quality Experts Group, 'Final report from the Video Quality Experts Group on the validation of objective models of video quality assessment, Phase II,' 2003
5 ITU-R, 'Objective perceptual video quality measurement techniques for standard definition digital broadcast television in the presence of a full reference,' Recommendation ITU-R BT.1683, 2004
6 ITU-T, 'Advanced video coding for generic audiovisual services,' Recommendation ITU-T H.264, 2005
7 ISO/IEC, 'Coding of Audio-Visual Objects: Visual,' ISO/IEC Standard 14496-2, 1998
8 http://www.its.bldrdoc.gov/vqeg/
9 Video Quality Experts Group, 'Final report from the Video Quality Experts Group on the validation of objective models of video quality assessment,' 2000
10 ITU-R, 'Methodology for the subjective assessment of the quality of television pictures,' Recommendation ITU-R BT.500-11, 2002
11 ITU-T, 'Subjective video quality assessment methods for multimedia applications,' Recommendation ITU-T P.910, 2002
12 ITU-T, 'Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference,' Recommendation ITU-T J.144, 2004
13 Video Quality Experts Group, 'Multimedia Group Test Plan,' Ver. 1.16, 2007