Journal of Satellite, Information and Communications (한국위성정보통신학회논문지)

Korea Society of Satellite Technology (한국위성정보통신학회)
권호 표지

A Study of 3D Sound Modeling based on Geometric Acoustics Techniques for Virtual Reality

가상현실 환경에서 기하학적 음향 기술 기반의 3차원 사운드 모델링 기술에 관한 연구

  • 김정길 (남서울대학교 컴퓨터학과)
  • Received : 2016.12.23
  • Accepted : 2016.12.27
  • Published : 2016.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

With the popularity of smart phones and the help of high-speed wireless communication technology, high-quality multimedia contents have become common in mobile devices. Especially, the release of Oculus Rift opens a new era of virtual reality technology in consumer market. At the same time, 3D audio technology which is currently used to make computer games more realistic will soon be applied to the next generation of mobile phone and expected to offer a more expansive experience than its visual counterpart. This paper surveys concepts, algorithms, and systems for modeling 3D sound virtual environment applications. To do this, we first introduce an important design principle for audio rendering based on physics-based geometric algorithms and multichannel technologies, and introduce an audio rendering pipeline to a scene graph-based virtual reality system and a hardware architecture to model sound propagation.

스마트 폰의 대중화와 고속 무선 통신 기술의 도움으로 고품질 멀티미디어 콘텐츠가 모바일 기기에서 보편화되고 있다. 특히, Oculus Rift의 출시는 소비자 시장에서 가상현실 기술의 새로운 시대를 열고 있다. 또한 컴퓨터 게임을 보다 사실적 구동을 위한 3D 오디오 기술은 곧 차세대 모바일 기기에 적용될 것이며, 시각적인 것보다 더 광범위한 사실적 경험을 제공 할 것으로 예상된다. 따라서 이 논문에서는 가상현실 기반의 응용 프로그램에서 3D 사운드 모델링을 위한 개념, 알고리즘 및 시스템에 대하여 기술하고자 하며 특히 기하학적 음향 기술 기반의 알고리즘에 초점을 맞추었다. 이를 위하여 먼저, 사운드 전파를 모델링하기 위해 물리적 기반의 기하학적 알고리즘과 다중 채널 기술 중심으로 오디오 렌더링을 위한 중요한 설계 원칙 소개와 오디오 렌더링 파이프 라인을 씬 그래프 기반의 가상 현실 시스템 및 최신 하드웨어 구조 소개를 포함한다.

Keywords

References

  1. Juwon Yun, Dukki Hong, Woo-Chan Park, Cheong-Ghil Kim, "The design of a Software Development Kit for Virtual Reality 3D Audios", Proceedings of the 2nd EEECS 2016, Science and Engineering Letters Vol. 2, (2016) 44-46
  2. Dukki Hong, Seiyoung Lee, Woo-Chan Park, "3D Audio Down-Mixing System for Immersive Realistic Virtual Reality", Proceedings of the 2nd EEECS 2016, Science and Engineering Letters Vol. 2, (2016) 15-16
  3. https://www.ossic.com/
  4. C Lauterbach, A Chandak, D Manocha, "Interactive sound rendering in complex and dynamic scenes using frustum tracing", IEEE Transactions on Visualization and Computer Graphics, 13 (6), (2007) 1672-1679 https://doi.org/10.1109/TVCG.2007.70567
  5. ZhiYing Zhou, Adrian David Cheok, Yan Qiu, and Xubo Yang, "The Role of 3-D Sound in Human Reaction and Performance in Augmented Reality Environments", IEEE Transaction on Systems, MAN, and Cybernetics-PART A: Systems and Humans, 37 (2) (2007) 262-272 https://doi.org/10.1109/TSMCA.2006.886376
  6. William W. Gaver, Randall B. Smith, Tim O'Shea, "Effective sounds in complex systems: the ARKola simulation", Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1991) 85-90
  7. Durand R. Begault, "3D Sound for Virtual Reality and Multimedia", AP Professional, Boston, MA, 1994.
  8. Fakheredine Keyrouz, Klaus Diepold, "An Enhanced Binaural 3D Sound Localization Algorithm", 2006 IEEE International Symposium on Signal Processing and Information Technology, (2006) 662-665
  9. C. Phillip Brown and Richard O. Duda, "A Structural Model for Binaural Sound Synthesis", IEEE Transactions on speech and audio processing, 6 (5) (1998) 476-488 https://doi.org/10.1109/89.709673
  10. Jurgen Herre, Johannes Hilpert, Achim Kuntz, Jan Plogstie, "MPEG-H Audio - The New Standard for Universal Spatial / 3D Audio Coding", International Symposium on Signal Processing and Information Technology, (2006) 662-665
  11. M. Vorlander, Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality, Springer, 2008.
  12. A. Febretti et al., "Cave2: a hybrid reality environment for immersive simulation and information analysis," in Proceedings SPIE Electronic Imaging 2013, Burlingame, CA , 2013, 864903-864903-12.
  13. Thomas Funkhouser, Nicolas Tsingos, Jean-Marc Jot, "Survey of Methods for Modeling Sound Propagation in Interactive Virtual Environment Systems, http://citeseerx.ist.psu.edu/viewdoc/versions?doi=10.1.1.9.5567
  14. Jae-Ho Nah, Jin-Woo Kim, Junho Park, Won-Jong Lee, Jeong-Soo Park, Seok-Yoon Jung, Woo-Chan Park, Dinesh Manocha, and Tach-Don Han, "HART: A Hybrid Architecture for Ray Tracing Animated Scenes," IEEE Transactions on Visualization and Computer Graphics, 21 (3) (2015) 389-401 https://doi.org/10.1109/TVCG.2014.2371855
  15. Jae-Ho Nah, Hyuck-Joo Kwon, Dong-Seok Kim, Cheol-Ho Jeong, JinHong Park, Tack-Don Han, Dinesh Manocha, and Woo-Chan Park, "RayCore: A ray-tracing hardware architecture for mobile devices," ACM Transactions on Graphics, 33 (5) (2014) Article 162