Browse > Article
http://dx.doi.org/10.4218/etrij.14.2113.0012

Visual-Attention-Aware Progressive RoI Trick Mode Streaming in Interactive Panoramic Video Service  

Seok, Joo Myoung (Broadcasting &Telecommunications Media Research Laboratory, ETRI)
Lee, Yonghun (Agency for Defense Development (ADD))
Publication Information
ETRI Journal / v.36, no.2, 2014 , pp. 253-263 More about this Journal
Abstract
In the near future, traditional narrow and fixed viewpoint video services will be replaced by high-quality panorama video services. This paper proposes a visual-attention-aware progressive region of interest (RoI) trick mode streaming service (VA-PRTS) that prioritizes video data to transmit according to the visual attention and transmits prioritized video data progressively. VA-PRTS enables the receiver to speed up the time to display without degrading the perceptual quality. For the proposed VA-PRTS, this paper defines a cutoff visual attention metric algorithm to determine the quality of the encoded video slice based on the capability of visual attention and the progressive streaming method based on the priority of RoI video data. Compared to conventional methods, VA-PRTS increases the bitrate saving by over 57% and decreases the interactive delay by over 66%, while maintaining a level of perceptual video quality. The experiment results show that the proposed VA-PRTS improves the quality of the viewer experience for interactive panoramic video streaming services. The development results show that the VA-PRTS has highly practical real-field feasibility.
Keywords
Human visual system; Scalable Video Coding; panoramic video; RoI; trick mode; visual attention; CSF;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 C. Montgomery et al., Xiph.org Video Test Media (derf's collection), the xiph open source community, 1994. Accessed Aug. 16, 2013. http://media.xiph.org/video/derf
2 S. Rimac-Drlje, M. Vranjes, and D. Zagar, "Foveated Mean Squared Error - A Novel Video Quality Metric," Multimedia Tools Appl., vol. 49, no. 3, Sept. 2010, pp. 425-445.   DOI
3 S. Lee, M.S. Pattichis, and A.C. Bovic, "Foveated Video Quality Assessment," IEEE Trans. Multimedia, vol. 4, no. 1, Mar. 2002, pp. 129-132.   DOI   ScienceOn
4 R. Kooij, K. Ahmed, and K. Brunnstrom, "Perceived Quality of Channel Zapping," Proc. 5th IASTED Int. Conf. Commun. Syst. Netw., Palma de Mallorca, Spain, Aug. 28-30, 2006, pp. 155-158.
5 S. Lantinga et al., SDL version 1.2.15 open source, Simple DirectMedia Layer forum, 2012. Accessed Jan. 15, 2013. http://www.libsdl.org/download-1.2.php
6 J. Seok et al., "A Visual Perception Based View Navigation Trick Mode in the Panoramic Video Streaming Service," IEICE Trans. Commun., vol. E94-B, no. 12, Dec. 2011, pp. 3631-3634.   DOI
7 P. Siebert, T.N.M. Van Caenegem, and M. Wagner, "Analysis and Improvements of Zapping Times in IPTV Systems," IEEE Trans. Broadcast., vol. 55, no. 2, June 2009, pp. 407-418.   DOI   ScienceOn
8 I. Kopilovic and M. Wagner, "A Benchmark for Fast Channel Change in IPTV," IEEE Int. Symp. Broadband Multimedia Syst. Broadcast., Mar. 31 - Apr. 2, 2008, pp. 1-7.
9 C.Y. Lee, C.K. Hong, and K.Y. Lee, "Reducing Channel Zapping Time in IPTV Based on User's Channel Selection Behaviors," IEEE Trans. Broadcast., vol. 56, no. 3, Sept. 2010, pp. 321-330.   DOI   ScienceOn
10 E. Kurutepe, M.R. Civanlar, and A.M. Tekalp, "Client-Driven Selective Streaming of Multi-view Video for Interactive 3DTV," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, Nov. 2007, pp. 1558-1565.   DOI   ScienceOn
11 G. Muntean, G. Ghinea, and T.N. Sheehan, "Region of Interest-Based Adaptive Multimedia Streaming Scheme," IEEE Trans. Broadcast., vol. 54, no. 2, June 2008, pp. 296-303.   DOI   ScienceOn
12 B. Ciubotaru, G. Muntean, and G. Ghinea, "Objective Assessment of Region of Interest-Aware Adaptive Multimedia Streaming Quality," IEEE Trans. Broadcast., vol. 55, no. 2, June 2009, pp. 202-212.   DOI   ScienceOn
13 S. Daly, "Engineering Observations from Spatiovelocity and Spatiotemporal Visual Models," Proc. SPIE Human Vis. Electron. Imag., vol. 3299, Jan. 17, 1998, pp. 180-191.
14 J. You et al., "Visual Contrast Sensitivity Guided Video Quality Assessment," IEEE Int. Conf. ICME, Melbourne, VIC, Australia, July 9-13, 2012, pp. 824-829.
15 S. Winkler, "Issue in Vision Modeling for Perceptual Video Quality Assessment," Signal Process., vol. 78, no. 2, Oct. 1999, pp. 231-252.   DOI   ScienceOn
16 Y. Ishiguro and J. Rekimoto, "Peripheral Vision Annotation: Noninterference Information Presentation Method for Mobile Augmented Reality," Proc. 2nd Augmented Human Int. Conf., Tokyo, Japan, Mar. 12, 2011, article no. 8.
17 R. Szeliski, "Image Alignment and Stitching: A Tutorial," Microsoft Research, Technical Report MSR-TR-2004-92, Oct. 2004. http://research.microsoft.com
18 Z. Wang et al., "Foveated Wavelet Image Quality Index," Proc. SPIE Appl. Digital Image Process. XXIV, vol. 4472, Aug. 2001, pp. 42-52.
19 O. Scheer et al., "Ultrahigh-Resolution Panoramic Imaging for Format-Agnostic Video Production," Proc. IEEE, vol. 101, no. 1, Jan. 2013, pp. 99-114.   DOI   ScienceOn
20 London Calling Demo Contents, Immersive Media Company, Kelowna, BC, Canada, 1994. Accessed Jan. 15, 2013. http://immersivemedia.com/demos
21 H.S. Quershi et al., "Quantitative Quality Assessment of Stitched Panoramic Images," IET Image Proc., vol. 6, no. 9, Dec. 2012, pp. 1348-1358.   DOI   ScienceOn
22 A. Ahmed et al., "Geometric Correction for Uneven Quadric Projection Surfaces Using Recursive Subdivision of Bezier Patches," ETRI J., vol. 35, no. 6, Dec. 2013, pp. 1115-1125.   DOI   ScienceOn
23 S. Azad, W. Song, and D. Tjondronegoro, "Measuring Bitrate and Quality Trade-off in a Fast Region-of-Interest Based Video Coding," Springer Adv. Multimedia Modeling, vol. 6524, 2011, pp. 442-453.
24 H. Kimata, K. Fulazawa, and N. Matsuura, "Partial Delivery Method with Multi-bitrates and Resolutions for Interactive Panoramic Video Streaming System," ICCE IEEE Int. Conf., Las Vegas, NV, USA, vol. 4, no. 1, Jan. 9-12, 2011, pp. 891-892.
25 M. Makar et al., "Real-Time Video Streaming with Interactive Region of Interest," 17th IEEE Int. Conf. Image Process., Hong Kong, China, Sept. 2010, pp. 4437-4440.
26 T.M. Bae et al., "Multiple Region-of-Interest Support in Scalable Video Coding," ETRI J., vol. 28, no. 2, Apr. 2006, pp. 239-242.   DOI   ScienceOn
27 Text of ISO/IEC 14496-10:2005/FDAM 3 Scalable Video Coding, Joint Video Team (JVT) of ISO-IEC MPEG & ITU-T VCEG, Lausanne, N9197, Sept. 2007.
28 H. Kim et al., "Reducing Channel Capacity for Scalable Video Coding in a Distributed Network," ETRI J., vol. 32, no. 6, Dec. 2010, pp. 863-870.   DOI   ScienceOn
29 J. Yoo et al., "Regional Linear Warping for Image Stitching with Dominant Edge Extraction," KSII Trans. Internet Inf. Syst., vol. 7, no. 10, Oct. 2013, pp. 2464-2478.   DOI   ScienceOn