[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.3837/tiis.2019.01.017

Bandwidth-Efficient Live Virtual Reality Streaming Scheme for Reducing View Adaptation Delay

Lee, Jongmin (Department of Software, Gachon University)
Lee, Joohyung (Department of Software, Gachon University)
Lim, Jeongyeon (Department of Software, Gachon University)
Kim, Maro (Department of Software, Gachon University)

Publication Information

KSII Transactions on Internet and Information Systems (TIIS) / v.13, no.1, 2019 , pp. 291-304 More about this Journal

Abstract

This paper proposes a dynamic-tiling-based bandwidth-efficient (DTBE) virtual reality (VR) streaming scheme. We consider 360-degree VR contents with multiple view points such as the front, back, upper, and bottom sides. At a given time, the focus of a client is always bound to a certain view among multiple view points. By utilizing this perspective, under our proposed scheme, tiles with high encoding rates are selectively assigned to the focused view where multiple view points consist of multiple tiles with different encoding rates. The other tiles with low encoding rates are assigned to the remaining view points. Furthermore, for reducing view adaptation delay, we design a novel rapid view adaptation mechanism that selectively delivers an I-frame during view point updates by using frame indexing. We implement the proposed scheme on a commercial VR test bed where we adopt the MPEG media transport (MMT) standard with high-efficiency video coding (HEVC) tile modes. The measurement-based experiments show that the proposed scheme achieves an average data usage reduction of almost 65.2% as well as average view adaptation delay reduction of almost 57.7%.

Keywords

Virtual Reality; Live Streaming; Test bed; Bandwidth Efficient; View Point Adaptation; HEVC;

Citations & Related Records

Reference

1	A. T. Nasrabadi, A. Mahzri, J. D. Beshay and R. Prakash, "Adaptive 360-Degree Video Streaming using Layered Video Coding," in Proc. of IEEE VR, Los Angeles, CA, USA, 2017.
2	E. Kurutepe, M. R. Civanlar and A. M. Tekalp, "Selective Streaming of Multi-View Video for Head-Tracking 3D Displays," in Proc. of ICIP, San Antonio, TX, USA, 2007.
3	Information technology -High efficiency coding and media delivery in heterogeneous environments -Part 1: MPEG media transport (MMT), AMENDMENT 2: Enhancements for Mobile Environments, MPEG Standard, 2017.
4	M. Makar, A. Mavlankar, P. Agrawal and B. Girod, "Real-time video streaming with interactive region-of-interest," in Proc. of IEEE ICIP, Hong Kong, China, 2010.
5	S. Khire, S. Robertson, N. Jayant, E. A. Wood and M. E. Stachura, "Region-of-interest video coding for enabling surgical telementoring in low-bandwidth scenarios," in Proc. of IEEE MILCOM, Orlando, FL, USA, 2012.
6	Y. Feng, G. Cheung, W. Tan, P. L Callet and Y. Ji, "Low-Cost Eye Gaze Prediction System for Interactive Networked Video Streaming," IEEE Trans. Multimedia, vol. 15, no. 8, pp.1865-1879, Dec. 2013. DOI
7	S. Cho, J. Lee and K. Park, "Low delayed Mobile Live Streaming method and its implementation," in Proc. of IEEE ICMEW, Turin, Italy, 2015.
8	H. Jang, J. Lee, H. Choi and S. Cho, "Study on the field test result of mobile MMT trial service over LTE network at open dense area, subway and high speed train," in Proc. of IEEE ICME, Seattle, WA, USA, 2016.
9	C. Zhou, Z. Li and Y. Liu, "A Measurement Study of Oculus 360 Degree Video Streaming," in Proc. of ACM MMSys, Taipei, Taiwan, 2017.
10	K. K. Sreedhar, A. Aminlou, M. M. Hannuksela and M. Gabbouj, "Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications," in Proc. of IEEE ISM '16, San Jose, CA, USA, 2016.
11	Y.-M. Hsiao, C.-H. Chen, J.-F. Lee, and Y.-S. Chu, "Designing and implementing a scalable video-streaming system using an adaptive control scheme," IEEE Trans. Consumer Electronics, vol. 58, no. 4, pp. 1314-1322, Nov. 2012. DOI
12	A. Zare, A. Aminlou, M. M. Hannuksela and M. Gabbouj, "HEVC compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications," in Proc. of ACM MM, Amsterdam, Netherlands, 2016, pp. 601-605.
13	S.N. Yao, "Headphone-Based Immersive Audio for Virtual Reality Headsets," IEEE Trans. Consumer Electronics, vol. 63, no. 3, pp. 300-308, Aug. 2017. DOI
14	S. Akhshabi, A. C. Begen and C. Dovrolis, "An Experimental Evaluation of Rate-Adaptation Algorithms in Adaptive Streaming over HTTP," in Proc. of ACM MMSys, San Jose, CA, USA, 2011, pp. 157-168.
15	T. Y. Huang, N. Handigol, B. Heller, N. Mackeown and R. Johari, "Confused, timid, and unstable: picking a video streaming rate is hard," in Proc. of ACM IMC, Boston, Massachusetts, USA, 2012, pp. 225-238.
16	T. Y. Huang, R. Johari, N. Mackeown, M. Trunnell and M. Watson, "A buffer-based approach to rate adaptation: evidence from a large video streaming service," in Proc. of ACM SIGCOMM, Chicago, Illinois, USA, 2014, pp. 187-198.
17	J. Hwang, J. Lee, N. Choi and C. Yoo, "HAVS: Hybrid Adaptive Video Streaming for Mobile Devices," IEEE Trans. Consumer Electronics, vol. 60, no. 2, pp.210-216, May 2014. DOI
18	Y. Bao, H. Wu, A. A. Ramli, B. Wang and X. Liu, "Viewing 360 Degree Videos: Motion Prediction and Bandwidth Optimization," in Proc. of IEEE ICNP, Singapore, 2016.
19	M. Budagavi, J. Furton, G. Jin, A. Saxena, J. Wilkinson and A. Dickerson, "360 degrees video coding using region adaptive smoothing," in Proc. of IEEE ICIP, Quebec City, QC, Canada, 2015.
20	X. Corbillon, G. Simon, A. Devlic and J. Chakareski, "Viewport-Adaptive Navigable 360-Degree Video Delivery," in Proc. of IEEE ICC, Paris, France, 2017.