Browse > Article
http://dx.doi.org/10.9717/kmms.2019.22.2.311

Fast Ray Reordering and Approximate Sibson Interpolation for Foveated Rendering on GPU  

Kwon, Oh-Seok (Dept. of IT Convergence and Application Engineering, Graduate School, Pukyong National University)
park, Keon-kuk (Dept. of IT Convergence and Application Engineering, Graduate School, Pukyong National University)
Yoon, Joseph (Dept. of IT Convergence and Application Engineering, Graduate School, Pukyong National University)
Kim, Young-Bong (Dept. of IT Convergence and Application Engineering, Graduate School, Pukyong National University)
Publication Information
Journal of Korea Multimedia Society / v.22, no.2, 2019 , pp. 311-321 More about this Journal
Abstract
Virtual reality applications in Head-Mounted Displays require high frame rates and low latency rendering techniques. Ray tracing offers many benefits, such as high-quality image generation, but has not been utilized due to lower performance than rasterization. But that can obtain good result combined with gaze-tracking technology and human visual system's operation principle. In this paper, we propose a method to optimize the foveated sampling map and to maintain the visual quality through the fast voronoi nearest interpolation. The proposed method further reduces the computational cost that has been improved by the previous foveated sampling. It also smoothes the voronoi boundary using adaptive sibson interpolation, which was not possible in real-time. As a result, the proposed method can render real-time high-quality images with low visual difference.
Keywords
Virtual Reality; Head-Mounted Display; Foveated Rendering; Ray Tracing; Gaze-Tracking; Ray Reordering; Fast Voronoi Nearest Interpolation;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 M. Weier, T. Roth, E. Kruijff, A. Hinkenjann, A.P. Perard-Gayot, P. Slusallek, et al., "Foveated Real-Time Ray Tracing for Head-Mounted Displays," Computer Graphics Forum, Vol. 35, No. 7, pp. 289-298, 2016.   DOI
2 J. Yoon, K. Park, O. Kwon, and Y. Kim, "A Development of Semi-automatic Trawl-net Surfaces Reconstruction System Using Motion Equations and User Interactions," Journal of Korea Multimedia Society, Vol. 20, No. 8, pp. 1447-1455, 2017.   DOI
3 W. Hunt, Virtual Reality: The Next Great Graphics Revolution, Keynote Talk High-Performance Grapics, Oculus Research, 2015.
4 M. Koskela, T. Vitanen, P. Jaaskelainen, and J. Takala, "Foveated Path Tracing," Proceeding of International Symposium on Visual Computing, Springer, Cham, pp. 723-732, 2016.
5 M. Weier, M. Stengel, T. Roth, P. Didyk, E. Eisemann, M. Eisemann, et al., "Perceptiondriven Accelerated Rendering," Computer Graphics Forum, Vol. 36, Issue 2, pp. 611-643, 2017.   DOI
6 T.C. Ruch and J.F. Fulton, Medical Physiology and Biophysics, Academic Medicine, 1960.
7 G. Rong and T. Tan, "Jump Flooding in GPU with Applications to Voronoi Diagram and Distance Transform," Proceedings of the 2006 symposium on Interactive 3D Graphics and Games Association for Computing Machinery, pp. 109-116, 2006.
8 M.F. Deering, “A Photon Accurate Model of the Human Eye,” Association for Computing Machinery Transactions on Graphics, Vol. 24, No. 3, pp. 649-658, 2005.
9 H. Dammertz, D. Sewtz, J. Hanika, and H.P.A. Lensch, "Edge-avoiding-trous Wavelet Transform for Fast Global Illumination Filtering," Proceedings of the Conference on High Performance Graphics, Eurographics Association, pp. 67-75, 2010.
10 D. Purves, G.J. Augustine, D. Fitzpatrick, W.C. Hall, A. Lamantia, J.O. Mcnamara, et al., Neuroscience, Sinauer Associates, Sunderland, 2004.
11 S. Park, L. Linsen, O. Kreylos, J. Owens, and B. Hamann, “Discrete Sibson Interpolation,” IEEE Transactions On Visualization and Computer Graphics, Vol. 12, No. 2, pp. 243-253, 2006.   DOI
12 A. Patney, M. Salvi, J. Kim, A. Kaplanyan, C. Wyman, N. Benty, et al., "Towards Foveated Rendering for Gaze-Tracked Virtual Reality," Association for Computing Machinery Transactions on Graphics, Vol. 35, No. 6, pp. 179.1-179.12, 2016.
13 M. Bauer, H. Cook, and B. Khailany, "Cuda DMA: Optimizing GPU Memory Bandwidth via Warp Specialization," Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, Association for Computing Machinery, No. 12, pp. 96-106, 2011.
14 M. Fujita and T. Harada, "Foveated Realtime Ray Tracing for Virtual Reality Headset," Tech. rep., Light Transport Entertainment Research. 2014.
15 B. Guenter, M. Finch, S. Drucker, D. Tan, and J. Snyder, "Foveated 3D Graphics," Association for Computing Machinery Transactions on Graphics, Vol. 31, No. 6, pp. 164.1-164.10, 2012.
16 D. Nehab, P.V. Sander, J. Lawrence, N. Tatarchuk, and J.R. Isidoro, "Accelerating Real-Time Shading with Reverse Reprojection Caching," Proceedings of the 22nd Association for Computing Machinery SIGGRAPH/EUROGRAPHICS Symposium on Graphics Hardware, pp. 25-35, 2007.
17 M. Bock, A.K. Tyagi, J. Kreft, and W. Alt, “Generalized Voronoi Tessellation as a Model of Two-dimensional Cell Tissu Dynamics,” Bulletin of Mathematical Biology, Vol. 72, No. 7, pp. 1696-1731, 2010.   DOI