Browse > Article
http://dx.doi.org/10.9708/jksci.2022.27.11.081

Efficient Sound Control Method in Virtual Environments Using Raytracing Based Diffraction  

Kim, Jong-Hyun (School of Software Application, Kangnam University)
Choi, Jong-In (Dept. of Digital Media, Seoul Women's University)
Abstract
In this paper, we propose diffraction-based sound control method to improve sound immersion in a virtual environment. The proposed technique can express the wave and flow of sound in a physical environment and a pattern similar to diffraction in real-time. Our approach determines whether there is an obstacle from the location of the sound source and then calculates the position of the new sound reflected and diffracted by the obstacle. Based on ray tracing, it determines whether or not it collides with an obstacle, and predicts the sound level of the agent behind the obstacle by using the vector reflected and refraction by the collision. In this process, the sound attenuation according to the distance/material is modeled by attenuating the size of the sound according to the number of reflected/refracted rays. As a result, the diffraction pattern expressed in the physics-based approach was expressed in real time, and it shows that the diffraction pattern also changes as the position of the obstacle is changed, thereby showing the result of naturally spreading the size of the sound. The proposed method restores the diffusion and diffraction characteristics of sound expressed in real life almost similarly.
Keywords
Sound propagation; Refraction vector; Sound flow; Sound diffraction; Sound wave;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Kim, Kwangki. "A study on complexity reduction of binaural decoding in multi-channel audio coding for realistic audio service.", 2015. DOI: 10.12988/ces.2016.512315.   DOI
2 Polap, Dawid, Karolina Kesik, Kamil Ksiazek, and Marcin Wozniak. "Obstacle detection as a safety alert in augmented reality models by the use of deep learning techniques." Sensors, Vol. 17, No. 12, 2017. DOI: 10.3390/s17122803.   DOI
3 Lahav, Orly, and David Mioduser. "Multisensory virtual environment for supporting blind persons' acquisition of spatial cognitive mapping-a case study." In EdMedia+ Innovate Learning, pp. 1046-1051. Association for the Advancement of Computing in Education, 2001.
4 Wang, Yong, Uma Jayaram, Sankar Jayaram, and Kevin Lyons. "Physically based modeling in virtual assembly." In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp. 295-305, 2001. DOI:10.20870/IJVR.2001.5.1.2679.   DOI
5 De Poli, G. and Rocchesso, D., 1998. "Physically based sound modelling.", Organised Sound, Vol. 3, No. 1, pp.61-76, 2001. DOI: 10.1017/S1355771898009182.   DOI
6 Schroder, Dirk. "Physically based real-time auralization of interactive virtual environments". Vol. 11. Logos Verlag Berlin GmbH, 2011.
7 Van Den Doel, Kees, Paul G. Kry, and Dinesh K. Pai. "FoleyAutomatic: physically-based sound effects for interactive simulation and animation." In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pp 537-544, 2001. DOI: 10.1145/383259.383322.   DOI
8 Fujisaki, Waka, Naokazu Goda, Isamu Motoyoshi, Hidehiko Komatsu, and Shin'ya Nishida. "Audiovisual integration in the human perception of materials." Journal of Vision, Vol. 14, No. 4, pp. 12-12, 2014. DOI: 10.1167/14.4.12.   DOI
9 Breebaart, Jeroen, Jurgen Herre, Craig Jin, Kristofer Kjorling, Jeroen Koppens, Jan Plogsties, and Lars Villemoes. "Multi-channel goes mobile: MPEG Surround binaural rendering." In Audio Engineering Society Conference: 29th International Conference: Audio for Mobile and Handheld Devices. Audio Engineering Society, 2006.
10 Nagao, Katashi, Menglong Yang, and Yusuke Miyakawa. "Building-scale virtual reality: reconstruction and modification of building interior extends real world." International Journal of Multimedia Data Engineering and Management, Vol. 10, No. pp. 1-21, 2019.
11 Kern, Angelika C., and Wolfgang Ellermeier. "Audio in VR: effects of a soundscape and movement-triggered step sounds on presence." Frontiers in Robotics and AI, Vol. 7, pp. 20, 2020. DOI: 10.3389/frobt.2020.000.   DOI
12 Inman, Dean P., Ken Loge, and Aaron Cram. "Teaching orientation and mobility skills to blind children using computer generated 3D sound environments." Georgia Institute of Technology, 2000.
13 Kim, Kwangki. "Sound scene control of multi-channel audio signals for realistic audio service in wired/wireless network." International Journal of Multimedia and Ubiquitous Engineering, Vol. 9, No. 2, pp. 253-258, 2014. DOI: 10.14257/ijmue.2014.9.2.25.   DOI
14 Gugenheimer, Jan, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. "Sharevr: Enabling co-located experiences for virtual reality between hmd and non-hmd users." In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 4021-4033, 2017. DOI: 10.1145/3025453.3025683.   DOI
15 Siu, Alexa F., Mike Sinclair, Robert Kovacs, Eyal Ofek, Christian Holz, and Edward Cutrell. "Virtual reality without vision: A haptic and auditory white cane to navigate complex virtual worlds." In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1-13. 2020. DOI: 10.1145/3313831.3376353.   DOI