Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Configuration of Supplemental Tile Sets based on Prediction of Viewport Direction for Tile-based VR Video Streaming

  • An, Eun-bin (Division of Computer and Telecommiunications Engineering, Yonsei University) ;
  • Kim, A-young (Division of Computer and Telecommiunications Engineering, Yonsei University) ;
  • Seo, Kwang-deok (Division of Computer and Telecommiunications Engineering, Yonsei University)
  • Received : 2020.10.12
  • Accepted : 2020.11.30
  • Published : 2020.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

As the market demand for immersive media increases, an efficient streaming method is required in consideration of network conditions while maintaining the user's immersive experience. Accordingly, transmitting a viewport with relatively high-quality, such as tile-based streaming, is mainly used. But there still remains a lot of technical challenges, such as quickly providing a new viewport in high-quality according to the gaze. To solve the aforementioned problem, in this paper, we propose a method of configuring and transmitting a supplemental tile set through the predicted direction, and a range of stable utilization of the transmitted supplemental tile set.

Keywords

References

  1. M. Zink, R. Sitaraman, K. Nahrstedt, "Scalable 360° Video Stream Delivery: Challenges, Solutions, and Opportunities", Proceedings of the IEEE, vol. 107, no. 4, pp. 639-650, 2019. https://doi.org/10.1109/JPROC.2019.2894817
  2. ISO/IEC 23009-1:2019, "Information Technology-Dynamic Adaptive Streaming over HTTP (DASH)-Part 1: Media Presentation Description and Segment Formats", 2019.
  3. ISO/IEC 23008-1:2017 "High efficiency coding and media delivery in heterogeneous environments MPEG-H Part 1: MPEG Media Transport (MMT)", 2017.
  4. O. A. Niamut, E. Thomas, L. D'Acunto, C. Concolato, F. Denoual, S. Y. Lim, "MPEG DASH SRD: spatial relationship description", Proceedings of the 7th International Conference on Multimedia Systems, Klagenfurt, Austria, pp. 1-8, 2016.
  5. K. K. Sreedhar, A. Aminlou, M. M. Hannuksela, M. Gabbouj, "Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications", 2016 IEEE International Symposium on Multimedia (ISM), pp. 583-586, 2016.
  6. M. Hosseini, V. Swaminathan, "Adaptive 360 VR video streaming based on MPEG-DASH SRD", 2016 IEEE International Symposium on Multimedia (ISM), pp. 407-408, 2016.
  7. L. D'Acunto, J. Van den Berg, E. Thomas, O. Niamut, "Using MPEG DASH SRD for zoomable and navigable video", Proceedings of the 7th International Conference on Multimedia Systems, pp. 1-4, 2016.
  8. J. Le Feuvre, C. Concolato, "Tiled-based adaptive streaming using MPEG-DASH", Proceedings of the 7th International Conference on Multimedia Systems, pp. 1-3, 2016.
  9. A. Zare, A. Aminlou, M. M. Hannuksela, M. Gabbouj, "HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications", Proceedings of the 24th ACM international conference on Multimedia, Amsterdam, The Netherlands, pp. 601-605, 2016.
  10. C. Concolato, J. Le Feuvre, F. Denoual, F. Maze, E. Nassor, N. Ouedraogo, et al., "Adaptive Streaming of HEVC Tiled Videos Using MPEG-DASH", IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 8, pp. 1981-1992, 2018. https://doi.org/10.1109/TCSVT.2017.2688491
  11. X. Corbillon, G. Simon, A. Devlic, J. Chakareski, "Viewport-adaptive navigable 360-degree video delivery", 2017 IEEE international conference on communications (ICC), pp. 1-7, 2017.
  12. ISO/IEC 23008-2:2020, "Information technology High efficiency coding and media delivery in heterogeneous environments Part 2: High efficiency video coding", 2020.
  13. A. Van Rhijn, R. Van Liere, J. D. Mulder, "An analysis of orientation prediction and filtering methods for VR/AR", IEEE Proceedings. VR 2005. Virtual Reality, 2005., pp. 67-74, 2005.
  14. X. Hou, S. Dey, J. Zhang, M. Budagavi, "Predictive Adaptive Streaming to Enable Mobile 360-degree and VR Experiences", IEEE Transactions on Multimedia, 2020.
  15. E. Jeong, D. You, C. Hyun, B.-S. Seo, N. Kim, D. H. Kim, et al., "Viewport prediction method of 360 VR video using sound localization information", 2018 Tenth International Conference on Ubiquitous and Future Networks (ICUFN), pp. 679-681, 2018.
  16. J. Zou, C. Li, C. Liu, Q. Yang, H. Xiong, E. Steinbach, "Probabilistic Tile Visibility-Based Server-Side Rate Adaptation for Adaptive 360-Degree Video Streaming", IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 1, pp. 161-176, 2019. https://doi.org/10.1109/jstsp.2019.2956716
  17. X. Feng, V. Swaminathan, S. Wei, "Viewport Prediction for Live 360-Degree Mobile Video Streaming Using User-Content Hybrid Motion Tracking", Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 3, no. 2, pp. 1-22, 2019. https://doi.org/10.1145/3328933
  18. M. Jamali, S. Coulombe, A. Vakili, C. Vazquez, "LSTM-Based Viewpoint Prediction for Multi-Quality Tiled Video Coding in Virtual Reality Streaming", 2020 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1-5, 2020.
  19. M. Fiedler, H.-J. Zepernick, V. Kelkkanen, "Network-induced temporal disturbances in virtual reality applications", 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), pp. 1-3, 2019.
  20. M. S. Elbamby, C. Perfecto, M. Bennis, K. Doppler, "Toward low-latency and ultra-reliable virtual reality", IEEE Network, vol. 32, no. 2, pp. 78-84, 2018. https://doi.org/10.1109/MNET.2018.1700268