Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of 360 VR Tiled Video Player with Eye Tacking based Foveated Rendering

시점 추적 기반 Foveated Rendering을 지원하는 360 VR Tiled Video Player 구현

  • Kim, Hyun Wook (Dept. of Electronic Eng., Graduate School, Kwangwoon University) ;
  • Yang, Sung Hyun (Dept. of Electronic Eng., Graduate School, Kwangwoon University)
  • Received : 2018.03.08
  • Accepted : 2018.06.11
  • Published : 2018.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

In these days, various technologies to provide a service of high quality of 360 VR media contents is being studied and developed. However, rendering high-quality of media images is very difficult with the limited resources of HMD (Head Mount Display). In this paper, we designed and implemented a 360 VR Player for high quality 360 tiled video image render to HMD. Furthermore, we developed multi-resolution-based Foveated Rendering technology. By conducting several experiments, We have confirmed that it improved the performance of video rendering far more than existing tiled video rendering technology.

Keywords

References

  1. J.W. Son, Y.I. Ryu, H.J Roh, and E.S. Ryu, "SHVC-Based ROI Tiled Parallel Processing for Mobile Virtual Reality," Proceeding of the Winter Conference of Korea Institute of Information Scientists and Engineers, pp. 1715-1717, 2016.
  2. Y.I. Rye, H.J. Roh, and E.S. Ryu, “Tile Partitioning-Based HEVC Parallel Decoding Optimization for Asymmetric Multicore Processor,” Journal of Korea Institute of Information Scientists and Engineers, Vol. 43, No. 9, pp. 1060-1065, 2016.
  3. J.Y. Lee, “MPEG-DASH Standardization and Commercialization Trend,” Broadcasting and Media Magazine, Vol. 20, No. 1, pp. 68-74, 2015.
  4. O.A. Niamut, E. Thomas, L. D'Acunto, C. Concolato, F. Denoual, and S.Y. Lim, "MPEGDASH SRD-Spatial Relationship Description," Proceedings of the 7th International Conference on Multimedia Systems, No. 5, pp.5:1-5:8, 2016.
  5. I. Kim, S. Hong, S. Jung, K. Lim, “An Intelligent Video Streaming Mechanism based on a Deep Q-Network for QoE Enhancement,” Journal of Korea Multimedia Society, Vol. 21, No. 2, pp. 188-198, 2018. https://doi.org/10.9717/KMMS.2018.21.2.188
  6. B. Guenter, M. Finch, S. Drucker, D. Tan, and J. Snyder, “Foveated 3D Graphics,” ACM Transactions on Graphics, Vol. 31, No. 6, pp. 1-22, 2012.
  7. VRWorks-Multi-Res Shading, https://developer.nvidia.com/vrworks/graphics/multiresshading (accessed Oct., 09, 2017).
  8. A. Patney, D. luebke, and J.H. Kim, "Latency Requirements for Foveated Rendering in Virtual Reality," ACM Transactions on Applied Perception, Vol. 14, No. 4, pp. 25:1-25:13, 2017.
  9. OpenHEVC, http://openhevc.github.io/openHEVC/ (accessed May., 30, 2017)

Cited by

  1. 방송 케이블 망 기반 고품질 360 VR 분할 영상 엣지 스트리밍에 관한 연구 vol.10, pp.12, 2018, https://doi.org/10.15207/jkcs.2019.10.12.043