• Journal of Broadcast Engineering
• /
• v.26 no.5
• /
• pp.643-651
• /
• 2021

Most people acquire information visually. Screens of computers, smart phones, etc. constantly stimulate people's eyes, increasing fatigue. In this social phenomenon, the realistic and rich sound of the 21st century's state-of-art sound system can affect people's bodies and minds in various ways. Through sound, human beings are given space to calm and observe themselves. The purpose of this paper is to introduce immersive yoga training based on 3D sound conducted together by ALgruppe & Rory's PranaLab and to promote the understanding of immersive audio system. As a result, people, experienced immersive yoga, not only enjoy the effect of sound, but also receive a powerful energy that gives them a sense of inner self-awareness. This is a response to multidisciplinary exchange required by the knowledge of modern society, and at the same time, informs the possibility of new cultural contents.

• Journal of Broadcast Engineering
• /
• v.27 no.7
• /
• pp.974-984
• /
• 2022

In this paper, we introduce the minimum and maximum distance setting methods used in geometric distance attenuation processing, which is one of spatial sound reproduction methods. In general, sound attenuation by distance is inversely proportional to distance, that is 1/r law, but when the relative distance between the user and the audio object is very short or long, exceptional processing might be performed by setting the minimum distance or the maximum distance. While MPEG-I Immersive Audio's RM0 uses fixed values for the minimum and maximum distances, this study proposes effective methods for setting the distances considering the signal gain of an audio object. Proposed methods were verified through simulation of the proposed methods and experiments using RM0 renderer.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.4
• /
• pp.420-430
• /
• 2003

This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. First, the multimodal Interface with 3D vision and speech allows a user to move around and to shout without distracting the user. Second, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback by a big screen and sound effects helps a user experience an immersive interaction. The proposed system thus provides the user with an immersive Gumdo experience with the whole body movement. The suggested system can be applied to various applications such as education, exercise, art performance, etc.

• Broadcasting and Media Magazine
• /
• v.19 no.1
• /
• pp.22-30
• /
• 2014

• International Journal of Advanced Culture Technology
• /
• v.9 no.4
• /
• pp.194-203
• /
• 2021

Virtual reality is being increasingly used for healing and therapy for mental health. In this study, we developed VR-based immersive content that enables virtual travel without the limitations of time and physical conditions. We aim to develop and produce VR content for relaxation and meditation using the beautiful natural scenery. To make realistic and immersive content, we took a video of natural sceneries with a small UAV connected to a VR camera. The content was developed through stitching, video editing and post-processing of the initially captured video data, and then the created VR video was inserted into the VR device. The produced content will be helpful for stress and used to heal the mind and body of exhausted modern people by providing the place with great scenery and sound in an immersive way at any time.

• International Journal of Internet, Broadcasting and Communication
• /
• v.13 no.1
• /
• pp.161-167
• /
• 2021

This paper proposes a new personalized HRTF estimation method which is based on a deep neural network (DNN) model and improved elevation reproduction using a notch filter. In the previous study, a DNN model was proposed that estimates the magnitude of HRTF by using anthropometric measurements [1]. However, since this method uses zero-phase without estimating the phase, it causes the internalization (i.e., the inside-the-head localization) of sound when listening the spatial sound. We devise a method to estimate both the magnitude and phase of HRTF based on the DNN model. Personalized HRIR was estimated using the anthropometric measurements including detailed data of the head, torso, shoulders and ears as inputs for the DNN model. After that, the estimated HRIR was filtered with an appropriate notch filter to improve elevation reproduction. In order to evaluate the performance, both of the objective and subjective evaluations are conducted. For the objective evaluation, the root mean square error (RMSE) and the log spectral distance (LSD) between the reference HRTF and the estimated HRTF are measured. For subjective evaluation, the MUSHRA test and preference test are conducted. As a result, the proposed method can make listeners experience more immersive audio than the previous methods.

• Journal of Broadcast Engineering
• /
• v.28 no.2
• /
• pp.213-229
• /
• 2023

In this paper, we introduce a spatial sound rendering system that provides 6DoF spatial sound in real time in response to the movement of a listener located in a virtual environment. This system was implemented using MPEG-I AEP as a development environment for the CfP response of MPEG-I Immersive Audio and consists of an encoder and a renderer including a decoder. The encoder serves to offline encode metadata such as the spatial audio parameters of the virtual space scene included in EIF and the directivity information of the sound source provided in the SOFA file and deliver them to the bitstream. The renderer receives the transmitted bitstream and performs 6DoF spatial sound rendering in real time according to the position of the listener. The main spatial sound processing technologies applied to the rendering system include sound source effect and obstacle effect, and other ones for the system processing include Doppler effect, sound field effect and etc. The results of self-subjective evaluation of the developed system are introduced.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.12
• /
• pp.5936-5954
• /
• 2018

Eight out of the top ten the largest technology companies in the world are involved in some way with the coming mobile VR revolution since Facebook acquired Oculus. This trend has allowed the technology related with mobile VR to achieve remarkable growth in both academic and industry. Therefore, the importance of reproducing the acoustic expression for users to experience more realistic is increasing because auditory cues can enhance the perception of the complicated surrounding environment without the visual system in VR. This paper presents a audio downmixing system for auralization based on hardware, a stage of sound rendering pipelines that can reproduce realiy-like sound but requires high computation costs. The proposed system is verified through an FPGA platform with the special focus on hardware architectural designs for low power and real-time. The results show that the proposed system on an FPGA can downmix maximum 5 sources in real-time rate (52 FPS), with 382 mW low power consumptions. Furthermore, the generated 3D sound with the proposed system was verified with satisfactory results of sound quality via the user evaluation.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2018.07a
• /
• pp.76-77
• /
• 2018

본 논문에서는 재미있는 게임을 제작하기 위해 사용자 몰입을 극대화 할 수 있는 장치를 분석하고 이 가운데 청각적인 요소를 집중적으로 활용한 게임 디자인에 대해 소개하고자 한다. 암흑의 공간에서 긴장감을 조성하고 다양한 오브젝트들의 특성을 반영한 사운드를 이용하여 게임월드를 탐험하도록 설계하였고 이를 구현하였다. 본 게임은 사용자 몰입을 위한 게임 설계에 좋은 가이드라인이 될 것으로 기대한다.

• The Journal of the Acoustical Society of Korea
• /
• v.42 no.5
• /
• pp.388-394
• /
• 2023

When the vibration of the thin panel by exciting single point is used to radiate sound, the inherent vibration characteristic of the plate itself causes influence on the radiated sound. A conventional panel speaker system usually uses the single or double point excitations for generating the sound through the panel itself. The radiated sound can be easily distorted due to the modal characteristics of the plate so it is difficult to expect sufficient sound power or high radiation efficiency. In this paper, to achieve an immersive sound field, the multiple speaker zones on a thin panel are created with the limited number of actuators. The designated vibration field which can generates directional sound is realized by employing the vibro-acoustic inverse rendering methods. Actuators are arranged from the positions which have the advantage of implementing with multi-modal excitations. The location and number of actuators are compared with the location and number of controllable speaker zones by conducting numerical simulations.