Browse > Article
http://dx.doi.org/10.9717/kmms.2018.21.7.795

Implementation of 360 VR Tiled Video Player with Eye Tacking based Foveated Rendering  

Kim, Hyun Wook (Dept. of Electronic Eng., Graduate School, Kwangwoon University)
Yang, Sung Hyun (Dept. of Electronic Eng., Graduate School, Kwangwoon University)
Publication Information
Journal of Korea Multimedia Society / v.21, no.7, 2018 , pp. 795-801 More about this Journal
Abstract
In these days, various technologies to provide a service of high quality of 360 VR media contents is being studied and developed. However, rendering high-quality of media images is very difficult with the limited resources of HMD (Head Mount Display). In this paper, we designed and implemented a 360 VR Player for high quality 360 tiled video image render to HMD. Furthermore, we developed multi-resolution-based Foveated Rendering technology. By conducting several experiments, We have confirmed that it improved the performance of video rendering far more than existing tiled video rendering technology.
Keywords
MPEG-DASH; MPEG-DASH SRD; Live Streaming; 360 VR; Tiled Video; Multi-Resolution; Foveated Rendering;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 J.W. Son, Y.I. Ryu, H.J Roh, and E.S. Ryu, "SHVC-Based ROI Tiled Parallel Processing for Mobile Virtual Reality," Proceeding of the Winter Conference of Korea Institute of Information Scientists and Engineers, pp. 1715-1717, 2016.
2 Y.I. Rye, H.J. Roh, and E.S. Ryu, “Tile Partitioning-Based HEVC Parallel Decoding Optimization for Asymmetric Multicore Processor,” Journal of Korea Institute of Information Scientists and Engineers, Vol. 43, No. 9, pp. 1060-1065, 2016.
3 J.Y. Lee, “MPEG-DASH Standardization and Commercialization Trend,” Broadcasting and Media Magazine, Vol. 20, No. 1, pp. 68-74, 2015.
4 O.A. Niamut, E. Thomas, L. D'Acunto, C. Concolato, F. Denoual, and S.Y. Lim, "MPEGDASH SRD-Spatial Relationship Description," Proceedings of the 7th International Conference on Multimedia Systems, No. 5, pp.5:1-5:8, 2016.
5 I. Kim, S. Hong, S. Jung, K. Lim, “An Intelligent Video Streaming Mechanism based on a Deep Q-Network for QoE Enhancement,” Journal of Korea Multimedia Society, Vol. 21, No. 2, pp. 188-198, 2018.   DOI
6 B. Guenter, M. Finch, S. Drucker, D. Tan, and J. Snyder, “Foveated 3D Graphics,” ACM Transactions on Graphics, Vol. 31, No. 6, pp. 1-22, 2012.
7 VRWorks-Multi-Res Shading, https://developer.nvidia.com/vrworks/graphics/multiresshading (accessed Oct., 09, 2017).
8 A. Patney, D. luebke, and J.H. Kim, "Latency Requirements for Foveated Rendering in Virtual Reality," ACM Transactions on Applied Perception, Vol. 14, No. 4, pp. 25:1-25:13, 2017.
9 OpenHEVC, http://openhevc.github.io/openHEVC/ (accessed May., 30, 2017)