• Title/Summary/Keyword: sound rendering

Search Result 37, Processing Time 0.022 seconds

A Real Time 6 DoF Spatial Audio Rendering System based on MPEG-I AEP (MPEG-I AEP 기반 실시간 6 자유도 공간음향 렌더링 시스템)

  • Kyeongok Kang;Jae-hyoun Yoo;Daeyoung Jang;Yong Ju Lee;Taejin Lee
    • Journal of Broadcast Engineering
    • /
    • v.28 no.2
    • /
    • pp.213-229
    • /
    • 2023
  • In this paper, we introduce a spatial sound rendering system that provides 6DoF spatial sound in real time in response to the movement of a listener located in a virtual environment. This system was implemented using MPEG-I AEP as a development environment for the CfP response of MPEG-I Immersive Audio and consists of an encoder and a renderer including a decoder. The encoder serves to offline encode metadata such as the spatial audio parameters of the virtual space scene included in EIF and the directivity information of the sound source provided in the SOFA file and deliver them to the bitstream. The renderer receives the transmitted bitstream and performs 6DoF spatial sound rendering in real time according to the position of the listener. The main spatial sound processing technologies applied to the rendering system include sound source effect and obstacle effect, and other ones for the system processing include Doppler effect, sound field effect and etc. The results of self-subjective evaluation of the developed system are introduced.

A study on the arrangement of actuators and speaker zones of the panel speaker (패널 스피커의 가진기 및 스피커 배치에 관한 연구)

  • Jung-Han Woo;Seong-Hyun Lee;Yun-Ho Seo;Pyung-Sik Ma;Dongjoon Kim
    • The Journal of the Acoustical Society of Korea
    • /
    • v.42 no.5
    • /
    • pp.388-394
    • /
    • 2023
  • When the vibration of the thin panel by exciting single point is used to radiate sound, the inherent vibration characteristic of the plate itself causes influence on the radiated sound. A conventional panel speaker system usually uses the single or double point excitations for generating the sound through the panel itself. The radiated sound can be easily distorted due to the modal characteristics of the plate so it is difficult to expect sufficient sound power or high radiation efficiency. In this paper, to achieve an immersive sound field, the multiple speaker zones on a thin panel are created with the limited number of actuators. The designated vibration field which can generates directional sound is realized by employing the vibro-acoustic inverse rendering methods. Actuators are arranged from the positions which have the advantage of implementing with multi-modal excitations. The location and number of actuators are compared with the location and number of controllable speaker zones by conducting numerical simulations.

A Study on Improving the Reality of the Vehicle Simulator Based on the Virtual Reality (가상현실 기반의 차량 시뮬레이터의 현실감 향상에 관한 연구)

  • Choi Young-Il;Kwon Seong-Jin;Jang Suk;Kim Kyu-Hee;Cho Ki-Yong;Suh Myung-Won
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.28 no.8 s.227
    • /
    • pp.1116-1124
    • /
    • 2004
  • In these days, a vehicle simulator has been developed with a VR(Virtual Reality) system. A VR system must provide a vehicle simulator with natural interaction, sufficient immersion and realistic images. In addition, a VR system must present a driver with the realistic driving situation. To achieve these, it is important to obtain a fast and uniform rendering performance regardless of the complexity of virtual worlds. In this paper, the factors to improve the reality for the VR based vehicle simulator have been investigated. For the purpose, the modeling and the rendering methods which offer an improved performance for complex VR applications as the 3D road model have been implemented and verified. Then, we experiment on the influence of graphic and sound factors to the driver, and analyze each result for improving the reality such as the driver's viewport, the form of texture, the lateral distance of the side object, and the sound effect. These factors are evaluated on the driving system which is constructed for qualitative analysis. The research results could be used for improving the reality of the VR based vehicle simulator.

A Study of 3D Sound Modeling based on Geometric Acoustics Techniques for Virtual Reality (가상현실 환경에서 기하학적 음향 기술 기반의 3차원 사운드 모델링 기술에 관한 연구)

  • Kim, Cheong Ghil
    • Journal of Satellite, Information and Communications
    • /
    • v.11 no.4
    • /
    • pp.102-106
    • /
    • 2016
  • With the popularity of smart phones and the help of high-speed wireless communication technology, high-quality multimedia contents have become common in mobile devices. Especially, the release of Oculus Rift opens a new era of virtual reality technology in consumer market. At the same time, 3D audio technology which is currently used to make computer games more realistic will soon be applied to the next generation of mobile phone and expected to offer a more expansive experience than its visual counterpart. This paper surveys concepts, algorithms, and systems for modeling 3D sound virtual environment applications. To do this, we first introduce an important design principle for audio rendering based on physics-based geometric algorithms and multichannel technologies, and introduce an audio rendering pipeline to a scene graph-based virtual reality system and a hardware architecture to model sound propagation.

An Objective Performance Analysis of Crosstalk Cancellation Scheme for Sound Rendering Systems Based on Listener Position Tracking (청취자 위치정보 기반 Sound Rendering 시스템 상호간섭 제거기법의 객관적 성능분석)

  • Lee, Jung-Hyuck;Kim, Yeong-Moon;Yoo, Seung-Soo;Kim, Sun-Yong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.36 no.2C
    • /
    • pp.112-118
    • /
    • 2011
  • In this paper, we conduct an objective performance analysis of the crosstalk cancellation scheme studied in [11]. While the conventional scheme is only applicable to a listener on the optimal listenable region (sweetspot), the space skew/crosstalk cancellation (SS/CC) scheme in [11] can mitigate crosstalk regardless of the listener's position by using listener position tracking (LPT) system. The SS/CC scheme is composed of two parts: LPT-based SS and CC parts. In this paper, the SS/CC scheme is evaluated by some criteria such as follows: condition number, and the balance characteristic, its root mean square error, and running average.

A Novel Method for Material Rendering and Real Measurement of Thickness Using Ultrasound (초음파를 이용한 실측 두께 측정과 재질 렌더링)

  • Choi, Taeyoung;Chin, Seongah
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.6
    • /
    • pp.190-197
    • /
    • 2014
  • In this paper, we present a method for optical parameter-based material rendering with measuring the thickness of a material using ultrasonic waves. Thickness is an important element in determining the reflectance and transmittance of a material along with its optical characteristics and plays a crucial role in more realistic object rendering. In studies conducted thus far, thickness has been measured and used for rendering. The proposed method is a novel method attempted for the first time ever to render a material considering the thickness of a material whose thickness cannot be measured by visual assessment, using ultrasonic waves. It was implemented by measuring the sound velocity of the reference sample and applying the results to the thickness measurement of other objects that have the same characteristics. The characteristics of the objects measured are reflected in the quality of the final rendering, thus verifying the importance of thickness in rendering.

A Study on Sweet Spot of Crosstalk Cancellation Schemes for Sound Rendering Systems (입체음향시스템을 위한 상호간접제거 기법의 유효청취범위 분석)

  • Lee, Jung-Hyuck;Jeong, Sang-Hyo;Yoo, Seung-Soo;Song, Iick-Ho;Kim, Sun-Yong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.36 no.5C
    • /
    • pp.309-316
    • /
    • 2011
  • In this paper, equalization zone of two crosstalk cancellation (CC) schemes, which are the one based on only head related transfer function (HRTF) and the other one based on interaural intensity/time difference (ITD/IID) as well as HRTF is studied. To do this, the condition numbers and ITD/IID levels of two schemes are shown.

Method for 3D Visualization of Sound Data (사운드 데이터의 3D 시각화 방법)

  • Ko, Jae-Hyuk
    • Journal of Digital Convergence
    • /
    • v.14 no.7
    • /
    • pp.331-337
    • /
    • 2016
  • The purpose of this study is to provide a method to visualize the sound data to the three-dimensional image. The visualization of the sound data is performed according to the algorithm set after production of the text-based script that form the channel range of the sound data. The algorithm consists of a total of five levels, including setting sound channel range, setting picture frame for sound visualization, setting 3D image unit's property, extracting channel range of sound data and sound visualization, 3D visualization is performed with at least an operation signal input by the input device such as a mouse. With the sound files with the amount an animator can not finish in the normal way, 3D visualization method proposed in this study was highlighted that the low-cost, highly efficient way to produce creative artistic image by comparing the working time the animator with a study presented method and time for work. Future research will be the real-time visualization method of the sound data in a way that is going through a rendering process in the game engine.

Smart Virtual Sound Rendering System for Digital TV (지능형 입체음향 TV)

  • Kim, Sun-Min;Kong, Dong-Geon
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2008.04a
    • /
    • pp.939-946
    • /
    • 2008
  • 본 논문은 시청자의 위치에 최적화된 입체음향을 제공하는 TV 개발에 관한 것으로 2 개의 TV 스피커만으로 5.1 채널 스피커가 주는 입체음향 효과를 제공해준다. 기존의 Speaker Virtualizer 기술은 시청자가 특정 위치(Sweet Spot)를 벗어나면 입체음향 성능이 현저히 저하된다. 반면, 본 논문에서 제안하는 Adaptive Virtualizer 기술은 초음파가 장착된 리모콘을 사용하여 시청자의 위치를 인식하고 인식된 시청자의 위치 정보를 활용하여 청취위치에 해당하는 HRTF로부터 설계된 Filter를 Update 하고 두 스피커의 출력레벨 및 시간지연 값을 보정함으로써 최적의 입체음향을 재현한다. 본 논문에서는 실시간 구현을 위해 Speaker Virtualizer의 계산량을 최소화하는 기술을 제안하고 다양한 청취 위치에 해당하는 Filter를 설계하고 설계된 Filter를 효율적으로 Update 하는 Adaptive Virtualizer 기술을 제안한다. 또한, 초음파를 이용한 시청자 위치 인식 기술 및 전체 시스템 통합 기술을 제시한다.

  • PDF