Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Projection Conversion for Efficient 3DoF+ 360-Degree Video Streaming

  • Jeong, Jong-Beom (Department of Computer Education, Sungkyunkwan University) ;
  • Lee, Soonbin (Department of Computer Engineering, Gachon University) ;
  • Jang, Dongmin (Department of Computer Education, Sungkyunkwan University) ;
  • Kim, Sungbin (Department of Computer Engineering, Gachon University) ;
  • Lee, Sangsoon (Department of Computer Engineering, Gachon University) ;
  • Ryu, Eun-Seok (Department of Computer Education, Sungkyunkwan University)
  • Received : 2019.10.01
  • Accepted : 2019.10.24
  • Published : 2019.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

The demand for virtual reality (VR) is rapidly increasing. Providing the immersive experience requires much operation and many data to transmit. For example, a 360-degree video (360 video) with at least 4K resolution is needed to offer an immersive experience to users. Moreover, the MPEG-I group defined three degrees of freedom plus (3DoF+), and it requires the transmission of multiview 360 videos simultaneoulsy. This could be a burden for the VR streaming system. Accordingly, in this work, a bitrate-saving method using projection conversion is introduced, along with experimental results for streaming 3DoF+ 360 video. The results show that projection conversion of 360 video with 360lib shows a Bjontegaard delta bitrate gain of as much as 11.4%.

Keywords

References

  1. Bart Kroon, Gauthier Lafruit. 2018. Reference view synthesizer (rvs) 2.0 manual. 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG123/n17759.
  2. Jong-Beom Jeong, Dongmin Jang, Jangwoo Son, and Eun-Seok Ryu. 2018. 3DoF+ 360 Video Location-Based Asymmetric Down-Sampling for View Synthesis to Immersive VR Video Streaming. Sensors 18, 9(2018), 3148. https://doi.org/10.3390/s18093148
  3. Joel Jung, Bart Kroon, Renaud Doré, Gauthier Lafruit, Jill Boyce. 2018. CTC on 3DoF+ and Windowed 6DoF (v2). 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG123/n17726.
  4. Bart Kroon. 2018. 3DoF+ test sequence ClassroomVideo. 122th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG2018/m42415.
  5. Tuan Thanh Le, Dien Ngyuen Van, and Eun-Seok Ryu. 2018. Real-time 360-degree video streaming over millimeter wave communication. 2018 International Conference on Information Networking (ICOIN), IEEE. pp. 857-862.
  6. Masayuki Tanimoto, Toshiaki Fujii, Kazuyoshi Suzuki. 2009. View Synthesis Algorithm in View Synthesis Reference Software 2.0 (VSRS2.0). 87th MPEG meeting of ISO/IEC JTC1/SC29/ WG11,MPEG2009/m16090.
  7. Masayuki Tanimoto, Toshiaki Fujii. 2010. FTV - Free Viewpoint Television. 61th MPEG meeting of ISO/IEC JTC1/SC29/ WG11,MPEG2010/m8595.
  8. Sejin Oh. 2017. Projections under Considerations for ISO/IEC 23090-2 Omnidirectional MediA Format. 118th MPEG meeting of ISO/IECJTC1/SC29/ WG11, MPEG2017/n16828.
  9. Hyun-Joon Roh, SungWon Han, and Eun-Seok Ryu. 2017. Prediction complexitybased HEVC parallel processing for asymmetric multicores. Multimedia Tools and Applications 76, 23 (2017), 25271-25284. https://doi.org/10.1007/s11042-017-4413-7
  10. Robert Skupin, Yago Sanchez, Karsten SÃijhring, Thomas Schierl, Eun-Seok Ryu, and Jangwoo Son. 2018. Temporal MCTS Coding Constraints Implementation. 122th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 122/m42423.
  11. Jang-Woo Son, Dongmin Jang, Eun-Seok Ryu. 2018. Implementing 360 video tiled streaming system. Proceedings of the 9th ACM Multimedia Systems Conference. ACM. pp. 521-524.
  12. Jang-Woo Son, Dongmin Jang, Eun-Seok Ryu. 2018. Implementing Motion-Constrained Tile and Viewport Extraction for VR Streaming. ACM Network and Operating System Support for Digital Audio and Video 2018 (NOSSDAV2018). pp. 61-66.
  13. Jang-Woo Son, Eun-Seok Ryu. 2018. Tile-Based 360-Degree Video Streaming for Mobile Virtual Reality in Cyber Physical System. Elsevier, Computers and Electrical Engineering.
  14. Yule Sun, Lu Ang, Lu Yu. 2017. Weighted-to-spherically-uniform quality evaluation for omnidirectional video. IEEE signal processing letters 24.9. pp. 1408-1412. https://doi.org/10.1109/LSP.2017.2720693
  15. Takanori Senoh, Nobuji Tetsutani, Hiroshi Yasuda. 2018. MPEG-I-Visual: View Synthesis Reference Software (VSRSx). 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 123/m42911.
  16. Xin Wang, Lulin Chen, Shuai Zhao and Shawmin Lei. 2017. From OMAF for 3DoF VR to MPEG-I Media Format for 3DoF+, Windowed 6DoF and 6DoF VR. 119th MPEG meeting of ISO/IEC JTC1/SC29/WG11, MPEG 119/m41197.
  17. Yule Sun, Bin Wang, Lu Yu. 2018. ERP WS-PSNR Software Manual. 123th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 123/n17760.