Journal of the Korea Convergence Society (한국융합학회논문지)

Korea Convergence Society (한국융합학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the High Quality 360 VR Tiled Video Edge Streaming

방송 케이블 망 기반 고품질 360 VR 분할 영상 엣지 스트리밍에 관한 연구

  • Received : 2019.10.28
  • Accepted : 2019.12.20
  • Published : 2019.12.28
Download PDF
⟨ Previous Next ⟩

Abstract

360 Virtual Reality(VR) service is getting attention in the domestic streaming market as 5G era is upcoming. However, existing IPTV-based 360 VR video services use upto 4K 360 VR video which is not enough to satisfy customers. It is generally required that over 8K resolution is necessary to meet users' satisfaction level. The bit rate of 8K resolution video exceeds the bandwidth of single QAM channel(38.817mbps), which means that it is impossible to provide 8K resolution video via the IPTV broadcast network environment. Therefore, we suggest and implement the edge streaming system for low-latency streaming to the display devices in the local network. We conducted experiments and confirmed that 360 VR streaming with a viewport switching delay less than 500ms can be achieved while using less than 100mbps of the network bandwidth.

최근 5G의 등장에 따라 국내 스트리밍 시장에서는 360 VR(Virtual Reality) 서비스가 주목받고 있다. 하지만 기존 IPTV(Internet Protocol Television)의 360 VR 영상 서비스에서 사용자가 고품질로 느끼기 위해서는 8K 이상의 영상이 요구 되지만 현재는 4K 정도의 영상이 서비스되어 사용자의 만족도가 높지 않다. 8K 이상의 영상의 경우 비트율(bitrate)이 하나의 QAM 채널로 전송할 수 있는 38.8107mbps 이상이다. 때문에, 현재 IPTV 방송 케이블망 환경에서 8K 이상의 영상을 스트리밍 하는 것은 불가능 하다. 이에 본 논문에서는 8K이상의 360 VR 서비스를 위해 다수의 QAM 채널을 사용하여 영상을 분리 분산하여 전송하는 방식을 제안하고 설계 하였다. 그리고 IPTV 방송 수신기에서 댁내의 디스플레이 장치로 저지연 스트리밍을 할 수 있는 엣지 스트리밍 방식을 제안하고 구현하였다. 그리고 실험을 통해 100mbps 미만의 네트워크 대역폭을 사용하여 500ms 미만의 뷰포트(Viewport) 전환 지연 시간을 갖는 360 VR스트리밍을 할 수 있음을 확인하였다.

Keywords

References

  1. J. H. Jang, H. W. Kim, J. W. Yang, S. P. Yoon & W. C. Park. (2019, July). Design of 8K 360 VR Video edge streaming system based on IPTV set-top box. The 9th International Conference on Convergence Technology in 2019. (pp. 216-217). Jeju : KCS.
  2. H. W. Kim, W. S. Choi & S. H. Yang. (2018). Implementation of High Quality 360 VR Video Low-latency Live Streaming System using Multi Level Tile Caching based on MPEG DASH SRD. Journal of Korea Multimedia Society, 21(8), 942-951. DOI : 10.9717/kmms.2018.21.8.942
  3. H. W. Kim. (2019). A Study on the 16K 360 VR Tiled Video Streaming based on Edge Computing for Smart Home Media Service. Doctoral dissertation. Kwangwoon University, Seoul.
  4. H. W. Kim, T. T. Le & E. S. Ryu. (2018). 360-degree video offloading using millimeter-wave communication for cyberphysical system, Transactions of Emerging Telecommunications Technologies, 30(4). e3506. DOI : 10.1002/ett.3506
  5. G. J. Sullivan, J. R. Ohm, W. J. Han & T. Wiegand. (2012). Overview of the High Efficiency Video Coding(HEVC) Standard. IEEE TRANSACTION ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 22(12), 1649-1668 DOI : 10.1109/TCSVT.2012.2221191
  6. P. de Rivaz & J. Haughton. (2019. 01. 08.) AV1 Bitstream & Decoding Process Specification. The Alliance for Open Media [Online]. https://github.com/AOMediaCodec/av1-spec/releases /download/v1.0.0-errata1/av1-spec.pdf
  7. Y. Chen et al. (2018, June). An Overview of Core Coding Tools in the AV1 Video Codec. 2018 Picture Coding Symposium. San Francisco : IEEE DOI : https://doi.org/10.1109/PCS.2018.8456249
  8. K. Misra, A. Segall, M. Horowitz, S. Xu, A. Fuldseth & M. Zhou. (2013). An Overview of Tiles in HEVC. IEEE Journal of Selected Topics in Signal Processing, 7(6), 969-977. DOI : https://doi.org/10.1109/JSTSP.2013.2271451
  9. P. Bordes, G. Clare, F. Henry, M. Raulet & J. Vieron. (2012, July). An overview of the emerging HEVC standard. International Symposium on signal, Image, Video and Communications, Valenciennes : IEEE DOI : 10.13140/RG.2.1.3482.5762
  10. H. W. Kim & S. H. Yang. (2018). Implementation of 360 VR Tiled Video Player with Eye Tracking based Foveated Rendering. Journal of Korea Multimedia Society, 21(7), 795-801. DOI : 10.9717/kmms.2018.21.7.795
  11. J. W. Son, Y. I. Ryu, H. J. Roh & E. S. Ryu. (2016, Dec). SHVC-Based ROI Tiled Parallel Processing for Mobile Virtual Reality. Proceeding of the Winter Conference Korea Institute of Information Scientists and Engineers. (pp. 1715-1717). Gangwon-do : KIISE
  12. Y. I. Ryu, H. J. Roh & E. S. Ryu. (2016). Tile Partitioning-based HEVC Parallel Decoding Optimization for Asymmetric Multicore Processor, Journal of Korean Institute of Information Scientists and Engineers, 43(9), 1060-1065. DOI : 10.5626/JOK.2016.43.9.1060
  13. J. W. Son, Y. G. Ryu, H. J. Roh & E. S. Ryu. (2016, Dec). SHVC-based ROI tile parallel processing for mobile virtual reality. Proceedings of Korean Institute of Information Scientists and Engineers. Gangwondo : KIISE.
  14. A. Nasrabadi, A. Mahzari, J. Beshay & R. Prakash. (2017, Oct.). Adaptive 360-Degree Video Streaming using Scalable Video Coding. Proceedings of the 2017 ACM on Multimedia Conference. (pp. 1689-1697). New York : ACM. DOI : 10.1145/3123266.3123414
  15. O. A. Niamut,, E. Thomas, L. D'Acunto, C. Concolato, F. Denoual & S. Y. Lim. (2016, May.). MPEG DASH SRD - Spatial Relationship Description. Proceedings of the 7th International Conference on Multimedia Systems. Klagenfurt : ACM. DOI: 10.1145/2910017.2910606
  16. ISO/IEC 23009-1 International standard. (2017, Jan). Information technology - Dynamic adaptive streaming over HTTP(DASH) Part 1: Media presentation description and segment formats. ISO/IEC JTC 1/SC 29.
  17. IISO/IEC 3009-3 International standard. (2014. April). Information technology Dynamic adaptive streaming over HTTP(DASH) - Part 3: Implementation guidelines. ISO/IEC JTC 1/SC 29/WG 11.
  18. H. W. Kim, W. S. Choi & S. H. Yang. (2018). Implementation of MPEG-DASH based Low-Latency Live 360 VR Tiled Video Streaming Server. Journal of Broadcast Engineering, 23(4), 549-558 DOI : 10.5909/JBE.2018.23.4.549
  19. M. Hosseini & V. Swaminathan. (2016). Adaptive 360-Degree Video Streaming using Scalable Video Coding. IEEE International Symposium on Multimedia 2016. (pp. 407-408). California : IEEE.
  20. H. W. Kim, J. W. Yang, J. Y. Yang, J. H. Jang & W. C. Park. (2018, Oct.) MPEG-DASH SRD based 360 VR Tiled Streaming System for Foveated Rendering. 2018 International Conference on Information and Communication Technology Convergence. (pp. 587-591). Jeju : IEEE DOI : https://doi.org/10.1109/ICTC.2018.8539484
  21. H. W. Kim et al. (2018, June). Immersive 360 VR tiled streaming system for esports service. Proceedings of the 9th ACM Multimedia Systems Conference. (pp. 541-544). Amsterdam : ACM. DOI : 10.1145/3204949.3209619
  22. Y. Sanchez de la Fuente, R. Skupin & T. Schierl. (2017). Video processing for panoramic streaming using HEVC and its scalable extensions. Multimedia Tools and Applications, 76(4), 5631-5659. https://doi.org/10.1007/s11042-016-4097-4
  23. Y. H. Kim, W. S. Cheong & J. J. Lee. (2017). A Study on the Existing Cable network-based Tiled Streaming System for High Fidelity 360 VR Video Service. in Proceeding of the 2017 Winter Conference on The Korean Institute of Communications and Information Sciences. (pp. 901-902). Gangwon-do : KICIS.
  24. J. W. Wee & W. C. Park. (2018). 360 VR image division transmission system and method. Seoul : KETI