Browse > Article
http://dx.doi.org/10.5909/JBE.2018.23.6.747

Implementing Renderer for Viewport Dependent 360 Video  

Jang, Dongmin (Department of Computer Engineering, Gachon University)
Son, Jang-Woo (Department of Computer Engineering, Gachon University)
Jeong, JongBeom (Department of Computer Engineering, Gachon University)
Ryu, Eun-Seok (Department of Computer Engineering, Gachon University)
Publication Information
Journal of Broadcast Engineering / v.23, no.6, 2018 , pp. 747-759 More about this Journal
Abstract
In this paper, we implement viewport dependent tile partitioning for high quality 360 video transmission and rendering method to present a HMD (Head Mounted Display) screen for 360 video quality evaluation. As a method for high-quality video transmission based on a user's viewport, this paper introduces MCTS (Motion Constrained Tile Sets) technique for solving the motion reference problem and EIS (Extraction Information Sets) SEI including pre-configured tile information, and extractor that extracts tiles. In addition, it explains tile extraction method based on user's viewport and implementation contents of the method of expressing on an HMD. Therefore, if 360 video is transferred by the proposed implementation which only transfers video from the user viewport area, it is possible to express higher quality video with lower bandwidth while avoiding unnecessary image transmission.
Keywords
360 Video; Viewport; HEVC; MCTS; Renderer;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Boyce, A. Ramasubramanian, R. Skupin, G. J. Sullivan, A. Tourapis, and Y. Wang, "HEVC Additional Supplemental Enhancement Information (Draft 4)," 29th JCT-VC meeting of ISO/IEC JTC1/SC29/ WG11, JCTVC-AC1005, 2017.
2 R. Skupin, Y. Sanchez, K. Suehring, T. Schierl, E. Ryu, and J. Son, "Temporal MCTS Coding Constraints Implementation," 120th MPEG meeting of ISO/IEC JTC1/SC29/WG11, MPEG 120/m41626, 2017.
3 M. Champel, T. Stockhammer, T. Fautier, E. Thomas, and R. Koenen, "Quality Requirements for VR," 116th MPEG meeting of ISO/IEC JTC1/SC29/WG11, MPEG 116/m39532, 2016.
4 Y. Ryu, and E. S. Ryu. "Video on Mobile CPU: UHD Video Parallel Decoding for Asymmetric Multicores," Proceedings of the 8th ACM International Conference on Multimedia System (MMSys 2017), Taipei, Taiwan, pp. 229-232, 2017.
5 T. T. Le, D. N. Van, and E. S. Ryu. "Real-time 360-Degree Video Streaming over Millimeter Wave Communication," International Conference on Information Networking 2018 (ICOIN2018), Chiang Mai, Thailand, pp. 5-17, 2018.
6 A. Zare, A. Aminlou, M. Hannuksela, and M. Gabbouj. "HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications," In Proceedings of the 24th ACM Multimedia Conference, Amsterdam, Netherlands, pp. 601-605, 2016.
7 High Efficiency Video Coding (HEVC), https://hevc.hhi.fraunhofer.de/ (accessed Sep. 03, 2018).
8 R. Skupin, Y. Sanchez, D. Podborski, C. Hellge, and T. Schierl, "Viewport-dependent 360 degree video streaming based on the emerging Omnidirectional Media Format (OMAF) standard," Image Processing (ICIP), 2017 IEEE International Conference on. IEEE, Beijing, China, pp. 4592-4592, 2017.
9 K. Brunnstrom, S. A. Beker, K. De Moor, A. Dooms, S. Egger, M.-N. Garcia, T. Hossfeld, S. Jumisko-Pyykko, C. Keimel, M.-C. Larabi et al. "Qualinet white paper on definitions of quality of experience," https://hal.archives-ouvertes.fr/hal-00977812 (accessed Sep. 03, 2018).
10 F. Qian, L. Ji, B. Han, and V. Gopalakrishnan, "Optimizing 360 video delivery over cellular networks," Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges. ACM, New York, USA, pp. 1-6, 2016.
11 T. Ikai, Y. Yasugi, and T. Aono, "AHG8: Dynamic viewport generation for $360^{\circ}$ video evaluation," 5th JVET Meeting of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JVET-E0024, 2016.
12 J. Son, D. Jang, and E. S. Ryu, "Implementing Motion-Constrained Tile and Viewport Extraction for VR Streaming," ACM Network and Operating System Support for Digital Audio and Video 2018 (NOSSDAV2018), Amsterdam, Netherlands, pp. 61-66, 2018.
13 K. K. Sreedhar, A. Aminlou, and M. M. Hannuksela, "Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications," IEEE International Symposium Multimedia (ISM) 2016 on. IEEE, San Jose, USA, pp. 583-586, 2016.
14 J. Son, D. Jang, J. Chung, E. S. Ryu, "Implementing 360 Video Tiled Streaming System," ACM Multimedia Systems 2018 (ACM MMSys 2018), Amsterdam, Netherlands, pp. 521-524, 2018.
15 L. Bassbouss, S. Steglich, and M. Lasak, "High quality $360^{\circ}$ video rendering and streaming," NEM Summit proceedings, Porto, Portugal, 2016.
16 Oculus rift, https://www.oculus.com/rift (accessed Sep. 03, 2018).
17 P. Hanhart, J. Boyce, and K. Choi, "JVET common test conditions and evaluation procedures for $360^{\circ}$ video," 11th JVET Meeting of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JVET-K1012-v1, 2018.
18 Y. Ye, and J. Boyce, "Algorithm descriptions of projection format conversion and video quality metrics in 360Lib Version 7," 11th JVET Meeting of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JVET-K1004, 2018.