Browse > Article
http://dx.doi.org/10.5909/JBE.2014.19.4.468

Perceptual Quality-based Video Coding with Foveated Contrast Sensitivity  

Ryu, Jiwoo (Kwangwoon University)
Sim, Donggyu (Kwangwoon University)
Publication Information
Journal of Broadcast Engineering / v.19, no.4, 2014 , pp. 468-477 More about this Journal
Abstract
This paper proposes a novel perceptual quality-based (PQ-based) video coding method with foveated contrast sensitivity (FCS). Conventional methods on PQ-based video coding with FCS achieve minimum loss on perceptual quality of compressed video by exploiting the property of human visual system (HVS), that is, its sensitivity differs by the spatial frequency of visual stimuli. On the other hand, PQ-based video coding with foveated masking (FM) exploits the difference of the sensitivity of the HVS between the central vision and the peripheral vision. In this study, a novel FCS model is proposed which considers both the conventional DCT-based JND model and the FM model. Psychological study is conducted to construct the proposed FCS model, and the proposed model is applied to PQ-based video coding algorithm implemented on HM10.0 reference software. Experimental results show that the proposed method decreases bitrate by the average of 10% without loss on the perceptual quality.
Keywords
Perceptual quality; Perceptual quality-based video coding; foveated contrast sensitivity; HEVC;
Citations & Related Records
연도 인용수 순위
  • Reference
1 H. Hadizadeh, I.V., Bajic, "Saliency-preserving video compression," IEEE International Conference on Multimedia and Expo (ICME), Barcelona, Spain, pp. 1-6, July 2011
2 D. Grois, E. Kaminsky, O. Hadar, "Dynamically adjustable and scalable ROI video coding," IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Shanghai, China, pp. 1-5, March 2010
3 W. S. Geisler, and J. S. Perry, "A real-time foveated multiresolution system for low-bandwidth video communication," Proceedings of SPIE, vol. 3299, 1998.
4 L. Itti, C. Koch, E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 20, No. 11, pp. 1254-1259, Nov. 1998   DOI   ScienceOn
5 Grois, D., Kaminsky, E., Hadar, O., "Dynamically adjustable and scalable ROI video coding," 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Shanghai, China, pp. 1-5, March 2010
6 H. Oh, W. Kim, "Video processing for human perceptual visual quality-oriented video coding," IEEE Transactions on Image processing, Vol. 22, No. 4, pp. 1526-1535, Dec. 2012
7 Yang Xia, RuiMin Hu, Zhongyuan Wang, "Perceptual video compression based on DCTdomain foveated JND model," 2011 4th International Congress on Image and Signal Processing, Shanhai, China, 2011 Oct.
8 H. Oh, W. Kim, "Video Processing for Human Perceptual Visual Quality-Oriented Video Coding," IEEE Transactions on Image Processing, Vol. 22, Issue 4, pp. 1526-1535, April 2013   DOI   ScienceOn
9 H. H. Chen, Y.-H. Huang, P.-Y. Su, T.-S. Ou, "Improving video coding quality by perceptual rate-distortion optimization," 2010 IEEE International Conference on Multimedia and Expo (ICME), Suntec City, Singapore, pp. 1287-1292, July 2010
10 D. Zhang, L. Gao, D. Zang, Y. Sun, "A DCT-domain JND model based on visual attention for image," 2013 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Melaka, Malaysia, pp. 1-4, Oct. 2013
11 S. H. Bae and M. Kim, "A Novel DCT-based JND Model for Luminance Adaptation Effect in DCT Frequency," IEEE Signal Processing Letters, vol. 20, no. 9, pp. 893-896, Sept. 2013   DOI   ScienceOn
12 Z. Wei, Ngan, K.N., "A temporal just-noticeble distortion profile for video in DCT domain," 15th IEEE International Conference on Image Processing, San Diego, CA, pp. 1336-1339, Oct. 2008
13 G. J. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," Vol. 22, No. 12, pp. 1649-1668, Dec. 2012   DOI   ScienceOn
14 M. J. Nadenau, J. Reichel, M. Kunt, "Wavelet-based color image compression: exploiting the contrast sensitivity function," IEEE Transactions on Image Processing, Vol. 12, No. 1, pp. 58-70, Jan. 2003   DOI   ScienceOn
15 M. G. Albanesi, M. Ferretti, F. Guerrini, "Adaptive image compression based on regions of interest and a modified contrast sensitivity function," 15th International Conference on Pattern Recognition, Barcelona, Spain, Vol. 3, pp. 215-218, Sep. 2000