Browse > Article
http://dx.doi.org/10.7472/jksii.2021.22.3.1

Performance Analysis of Viewport-dependent Tiled Streaming on 16K Ultra High-quality 360-degree Video  

Jeong, Jong-Beom (Department of Computer Education, Sungkyunkwan University)
Lee, Soonbin (Department of Computer Education, Sungkyunkwan University)
Kim, Inae (Department of Computer Education, Sungkyunkwan University)
Ryu, Eun-Seok (Department of Computer Education, Sungkyunkwan University)
Publication Information
Journal of Internet Computing and Services / v.22, no.3, 2021 , pp. 1-8 More about this Journal
Abstract
Ultra high-quality and ultra high-resolution omnidirectional 360-degree video streaming is needed to provide immersive media through head-mounted display(HMD) in virtual reality environment, which requires high bandwidth and computational complexity. One of the approaches avoiding these problems is to apply viewport-dependent selective streaming using tile-based segmentation method. This paper presents a performance analysis of viewport-dependent tiled streaming on 16K ultra high-quality 360-degree videos and 4K 360-degree videos which are widely used. Experimental results showed 42.47% of bjotegaard delta rate(BD-rate) saving on 16K ultra high-quality 360-degree video tiled streaming compared to viewport-independent streaming while 4K 360-degree video showed 26.41% of BD-rate saving. Therefore, this paper verified that tiled streaming is more efficient on ultra-high quality video.
Keywords
360-degree Video; 16K video; tiled streaming; MCTS; virtual reality;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Lee, D. Jang, J. B. Jeong, E. -S. Ryu, "Motion-constrained tile set based 360-degree video streaming using saliency map prediction", In Proceedings of the 29th ACM Network and Operating System Support for Digital Audio and Video (NOSSDAV), pp. 20-24, 2019. https://doi.org/10.1145/3304112.3325614   DOI
2 M. -L. Champel, T. Stockhammer, T. Fautier, E. Thomas, R. Koenen, "Quality Requirements for VR", 116th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 116/m39532, 2016.
3 J. -W. Son, E. -S. Ryu, "Tile-Based 360-Degree Video Streaming for Mobile Virtual Reality in Cyber Physical System", Elsevier, Computers and Electrical Engineering, Vol. 72, pp. 361-368, 2018. https://doi.org/10.1016/j.compeleceng.2018.10.002   DOI
4 A. Zare, A. Aminlou, M. M. Hannuksela, "6K Effective Resolution with 4K HEVC Decoding Capability for OMAF-compliant 360° Video Streaming", In Proceedings of the 23rd Packet Video Workshop (PV), pp. 72-77, 2018. https://doi.org/10.1145/3210424.3210425   DOI
5 J. Boyce, E. Alshina, A. Abbas, Y. Ye, "JVET common test conditions and evaluation procedures for 360° video", 6th JVET meeting, JVET-F1030-v4, 2017.
6 J. Jung, B. Kroon, "Common Test Conditions for MPEG Immersive Video", 131th MPEG meeting of ISO/IEC JTC1/SC29/WG11, n19484, 2020.
7 T. Ikai, Y. Yasugi, and T. Aono, "Ahg8: Dynamic viewport generation for 360° video evaluation." 127th MPEG meeting of ISO/IEC JTC1/SC29/WG11, MPEG2017/m39669, 2017.
8 J. -B. Jeong, S. Lee, I. Kim, E. -S. Ryu, "Implementing Viewport Tile Extractor for Viewport-Adaptive 360-Degree Video Tiled Streaming", In 2021 International Conference on Information Networking (ICOIN), pp. 8-12, 2021. https://doi.org/10.1109/ICOIN50884.2021.9333964   DOI
9 J. B. Jeong, D. Jang, J. Son, E. -S. Ryu, "3DoF+ 360 Video Location based Asymmetric Down-sampling for View Synthesis to Immersive VR Video Streaming", Sensors, 18(9):3148, 2018. https://doi.org/10.3390/s18093148.   DOI
10 J. -B. Jeong, S. Lee, D. Jang, E. -S. Ryu, "Towards 3DoF+ 360 Video Streaming System for Immersive Media", IEEE Access, Vol. 7, pp. 136399-136408,, 2019. https://doi.org/10.1109/ACCESS.2019.2942771.   DOI
11 J. -B. Jeong, S. Lee, I. -W. Ryu, T. T. Le, E. -S. Ryu, "Towards Viewport-dependent 6DoF 360 Video Tiled Streaming for Virtual Reality Systems", In Proceedings of the 28th ACM International Conference on Multimedia (ACM MM), pp. 3687-3695, 2020. https://doi.org/10.1145/3394171.3413712   DOI
12 T. T. Le, J. -B. Jeong, S. Kim, J. Kim, E. -S. Ryu, "An Efficient Viewport-Dependent 360 VR System Based on Adaptive Tiled Streaming", CMC-Computers, Materials & Continua, Vol. 66, No. 3, pp. 2627-2643, 2020. https://doi.org/10.32604/cmc.2021.013399   DOI
13 J. -B. Jeong, S. Lee, I. Kim, S. Lee, E. -S. Ryu, "Implementing VVC Tile Extractor for 360-degree Video Streaming Using Motion-Constrained Tile Set", Journal of Broadcast Engineering, Vol. 25, No. 7, pp. 1073-1080, 2020. https://doi.org/10.5909/JBE.2020.25.7.1073   DOI
14 360Lib reference software, [Online] available at: https://jvet.hhi.fraunhofer.de/svn/svn_360Lib/branches/360Lib-5.1-dev
15 A. Zare, M. Homayouni, A. Aminlou, M. M. Hannuksela, M. Gabbouj, "6K and 8K Effective Resolution with 4K HEVC Decoding Capability for 360 Video Streaming", ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 15, No. 2s, pp. 1-22, 2019. https://doi.org/10.1145/3335053   DOI
16 HM reference software, [Online] available at: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.20
17 R. Skupin, Y. Sanchez, D. Podborski, C. Hellge, T. Schierl, "HEVC tile based streaming to head mounted displays", In 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC), pp. 613-615, 2017. https://doi.org/10.1109/CCNC.2017.7983191   DOI
18 C. G. Bampis, A. C. Bovik, Z. Li. "A Simple Prediction Fusion Improves Data-driven Full-Reference Video Quality Assessment Models", In 2018 Picture Coding Symposium (PCS), pp. 298-302, 2018.
19 A. Dziembowski, "Software manual of IV-PSNR for Immersive Video", 128th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG127/n18709, 2019.